意大利音频评估专员 - 自由职业AI训练项目
Italian Audio Evaluations Specialist - Freelance AI Trainer Project
项目概述
我们正在为一项AI基准评估项目寻找独立的音频评估专家，该项目旨在评估先进的代理型音频模型。随着AI模型在该领域处理复杂工作流程的日益增多——特别是现实中的客户服务场景，如航班预订、金融服务和电信行业——它们的准确性完全依赖于强大且由专家精心构建的训练数据。该项目的目标是通过模拟交互自主生成高质量的评估任务，审核对话式AI的输出，并生成干净、可靠的数据库以优化模型性能。
项目交付物与范围
独立操作以设计复杂的评估框架并提供结构化的训练数据。预期交付物包括：
- 角色扮演情景执行：创建并执行复杂的基于角色扮演的评估情景，模拟旅行、金融和技术支持领域的实际客户服务互动。
- 模型性能审计：根据标准化的定性和定量指标评估AI模型的性能，严格聚焦于任务完成的准确性、对话的自然性以及音频理解能力。
- 技术指标评估：评估模型的基本计算机编程素养，包括对JSON结构、函数、方法的理解，以及在支持情境中对结构化数据进行推理的能力。
- 代表性数据集生成：参与开发多样化的高质量音频数据集，准确反映真实客户对清晰度、效率和自然对话流程的期望。
所需专业技能
为成功完成本项目的交付物，承包商必须具备深厚的行业知识，以构建真实的职场情景。核心技能包括：
- 在复杂客户服务、技术故障排除或对话式AI评估方面具有可证明的专业经验。
- 目标语言的母语或双语水平，包括所有语言技能（阅读、听力、写作和口语）的流利程度，同时具备强大的分析能力和口头沟通技巧，能够自信地进行模拟客户服务角色扮演。
- 基础的计算机编程素养，特别是对JSON结构、函数、方法和简单逻辑的熟练理解。
- 对结构化提示和复杂评估具有细致、注重细节的工作方式。
查看英文原文
Project Overview
We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios like flight bookings, financial services, and telecommunications—their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks through simulated interactions, audit conversational AI outputs, and generate clean, reliable datasets to optimize model performance.
Project Deliverables & Scope
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
- Role-Play Scenario Execution: Creating and executing complex, role-play-based evaluation scenarios that simulate realistic customer service interactions across travel, finance, and technical support domains.
- Model Performance Auditing: Evaluating AI model performance across standardized qualitative and quantitative metrics, focusing strictly on task completion accuracy, conversational naturalness, and audio comprehension.
- Technical Metric Evaluation: Assessing the model's basic computer programming literacy, including its understanding of JSON structures, functions, methods, and ability to reason about structured data within a support context.
- Representative Dataset Generation: Contributing to the development of diverse, high-quality audio datasets that accurately reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Required Expertise
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios. Core skillset includes:
- Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
- Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening, writing, and speaking), alongside strong analytical and verbal communication skills to confidently conduct simulated customer support role-plays.
- Basic computer programming literacy, specifically a comfortable understanding of JSON structures, functions, methods, and simple logic.
- A meticulous, detail-oriented approach to working with structured prompts, complex evaluation rubrics, and technical guidelines.
- Required Equipment: Access to a high-quality microphone to ensure clean, reliable audio input during voice evaluations.
We offer a pay range of $6-to-$65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
Originally posted on Himalayas