AI Evaluation Task Creation
Budget: $10 – $30 USD
I need an expert to create a complete AI evaluation task from scratch, including:
1. Prompt Creation
Write a high-quality, clear, realistic scenario prompt aligned with AML/CTF compliance concepts.
Must follow strict clarity, realism, neutrality, and temporal-stability rules.
The prompt must be fully original and pass automated validation (Rhea validator).
2. Rubric Development
Create 45 evaluation rubrics total:
26 positive, 19 negative
Each rubric must include:
A score weight (integers only, no decimals)
A clear criterion
A justification
Source citations (e.g., regulations, official guidance)
Weights must be diverse and consistent across the rubric set.
3. Automated Validator Compliance
The final deliverables must pass validation with:
No scale-consistency errors
No weight-diversity errors
No formatting or temporal violations
All model scores falling within the required scoring thresholds
Requirements
The freelancer must be able to:
Understand complex written guidelines
Create structured rubrics and prompts
Fix issues flagged by an automated evaluator until fully approved
Write clean, professional English
Preferably have experience in:
Compliance / AML / audit writing, OR
Technical writing / academic rubric creation
What I will provide
The general guideline document only
I will NOT provide templates, drafts, examples, or text
Freelancer must build everything from scratch following the rules
Ongoing Work
If successful, more projects will follow.
Please apply only if you can follow detailed written rules and revise your work until the evaluator fully approves it.
1. Prompt Creation
Write a high-quality, clear, realistic scenario prompt aligned with AML/CTF compliance concepts.
Must follow strict clarity, realism, neutrality, and temporal-stability rules.
The prompt must be fully original and pass automated validation (Rhea validator).
2. Rubric Development
Create 45 evaluation rubrics total:
26 positive, 19 negative
Each rubric must include:
A score weight (integers only, no decimals)
A clear criterion
A justification
Source citations (e.g., regulations, official guidance)
Weights must be diverse and consistent across the rubric set.
3. Automated Validator Compliance
The final deliverables must pass validation with:
No scale-consistency errors
No weight-diversity errors
No formatting or temporal violations
All model scores falling within the required scoring thresholds
Requirements
The freelancer must be able to:
Understand complex written guidelines
Create structured rubrics and prompts
Fix issues flagged by an automated evaluator until fully approved
Write clean, professional English
Preferably have experience in:
Compliance / AML / audit writing, OR
Technical writing / academic rubric creation
What I will provide
The general guideline document only
I will NOT provide templates, drafts, examples, or text
Freelancer must build everything from scratch following the rules
Ongoing Work
If successful, more projects will follow.
Please apply only if you can follow detailed written rules and revise your work until the evaluator fully approves it.