Audio Evaluation Project (Native Spanish Freelancers) 2

Job ID: 39784445

Budget: $100 – $150 USD

We are looking for native Spanish freelancers to help evaluate conversational agent audio responses. The task is to listen to short conversation contexts (audio + transcript), compare two agent responses and rate their quality.

What you’ll do:
- Listen to a short conversation and two agent audio responses.
- Rate each response on key dimensions:
Faithfulness – Does the response match the intended meaning and context?
Expressiveness – Does it sound natural, engaging, and expressive?
Speech Controllability – Were tone, pacing, or style instructions followed?
Voice Consistency – Is the voice consistent with the provided reference sample?
Overall Quality – General impression of the audio delivery.

Choose which response is better overall (or mark them tied).

Ratings:
Excellent (5): Perfect, natural, would happily interact again.
Good (4): Very good, small issues but acceptable.
Fair (3): Satisfactory, usable, but needs improvement.
Poor (2): Weak, unlikely to engage again.
Bad (1): Very poor, not usable.

Important notes:
- Focus only on audio quality and delivery, not the meaning of the content.
- Some conversations may be single-turn or multi-turn.

Use the discard option if:
- There are technical issues.
- The task is in a language you don’t understand.
- Both responses read punctuation marks aloud.