other
Posted 2 days agoAudio Specialist- Freelance AI Trainer Project
at Agency
GlobalRemote
Responsibilities
- Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
- Evaluate model performance across a standardized set of qualitative and quantitative metrics.
- Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow. Evaluation Metrics
- Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
Requirements
- Basic computer programming literacy , including:
- Understanding of JSON structures
- Familiarity with functions and methods
- English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
Benefits
- We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location.
- Final offer amounts may vary from the pay range listed above.
- benefits such as health insurance and PTO do not apply.
Additional details
- A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems.
- The program’s mission is to evaluate and optimize model performance for real-world customer support use cases. Responsibilities
- Flight bookings and travel support Financial services
- Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
- Conversational naturalness (tone, flow, and coherence)
- Instruction adherence and contextual understanding
- Ability to reason about structured data and simple logic