代理音频专员 - 自由职业AI训练师项目
Agentic Audio Specialist - Freelance AI Trainer Project
一个致力于评估和基准测试先进代理音频模型与领先系统的项目。该项目的使命是评估并优化模型在实际客户支持用例中的性能。
职责
- 创建并执行基于角色扮演的评估场景，模拟多个领域的现实客户服务中心互动，包括：
- 航班预订和旅行支持
- 金融服务
- 电信和技术支持
- 参与开发用于评估对话音频代理的多样化且具有代表性的数据集。
- 在标准化的一组定性和定量指标上评估模型性能。
- 确保评估符合真实客户的期望，包括清晰度、效率和自然对话流程。
评估指标
模型性能通过结合对话、技术和音频特定标准进行评估，包括但不限于：
- 任务完成的准确性和效率
- 对话自然性（语气、流程和连贯性）
- 音频理解和回应质量
- 指令遵循和上下文理解
- 基础的计算机编程素养，包括：
- 理解 JSON 结构
- 熟悉函数和方法
- 能够对结构化数据和简单逻辑进行推理
- 在处理支持风格问题解决时具备技术沟通清晰度
技术与设备要求
- 在模拟客户支持环境中具备良好的口头沟通能力
- 英语熟练，包括阅读、听力、写作和口语全部语言技能。
- 需要访问高质量麦克风，以确保评估期间的干净、可靠的音频输入
- 能够舒适地使用结构化提示、评估评分标准和技术指南
- 设备需能够运行音频录音软件并打开大型技术文档
我们提供每小时 11 至 30.65 美元的薪资范围，具体薪资将根据你的经验、专业技能和地理位置进行评估后确定。最终的薪资可能与上述薪资范围有所不同。作为承包商，你需要提供安全的电脑和高速互联网；公司提供的福利如健康保险和带薪假期不适用。
用工类型：合同工
工作地点：远程
职级：中高级
最初发布于喜马拉雅山
查看英文原文
A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities
- Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
- Flight bookings and travel support
- Financial services
- Telecommunications and technical support
- Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
- Evaluate model performance across a standardized set of qualitative and quantitative metrics.
- Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
- Task completion accuracy and efficiency
- Conversational naturalness (tone, flow, and coherence)
- Audio comprehension and response quality
- Instruction adherence and contextual understanding
- Basic computer programming literacy, including:
- Understanding of JSON structures
- Familiarity with functions and methods
- Ability to reason about structured data and simple logic
- Technical communication clarity when handling support-style problem-solving
Technical & Equipment Requirements
- Strong verbal communication skills in a simulated customer support context
- English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
- Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
- Comfort working with structured prompts, evaluation rubrics, and technical guidelines
- Device capable of running audio recording software and opening large technical documentation
We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level
Originally posted on Himalayas