other
Posted YesterdayItalian Audio Evaluations Specialist - Freelance AI Trainer Project
at Agency
GlobalRemote
You are nearing today's limit. Upgrade for unlimited access.
Responsibilities
- Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
- Model Performance Auditing: Evaluating AI model performance across standardized qualitative and quantitative metrics, focusing strictly on task completion accuracy, conversational naturalness, and audio comprehension.
Requirements
- We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models.
- As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios like flight bookings, financial services, and telecommunications—their accuracy relies entirely on robust, expert-crafted training data.
- The objective of this project is to autonomously produce high-quality evaluation tasks through simulated interactions, audit conversational AI outputs, and generate clean, reliable datasets to optimize model performance.
- Technical Metric Evaluation: Assessing the model's basic computer programming literacy, including its understanding of JSON structures, functions, methods, and ability to reason about structured data within a support context.
- To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios. Core skillset includes:
- Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
- Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening, writing, and speaking), alongside strong analytical and verbal communication skills to confidently conduct simulated customer support role-plays.
- Basic computer programming literacy, specifically a comfortable understanding of JSON structures, functions, methods, and simple logic.
Benefits
- We offer a pay range of $6-to-$65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location.
- Final offer amounts may vary from the pay range listed above.