会说英语的JSON及编码员用于音频评估
English-Speaking JSON & Coders for Audio Evaluations
一家企业客户正在寻找大量会说英语的编程专家，要求具备JSON专业知识，结合语言流利度、客户服务判断力和技术评估能力，以帮助提升AI生成内容在音频格式中的质量、准确性和可用性。
工作将立即开始，并持续2-3个月，有可能在此初始项目之外继续提供更多工作。
专家可以自行选择任何时间安排，只要任务可用。专家（操作员）将审查混合的客服风格回复和技术内容，重点在于编程知识、JSON结构、格式准确性以及整体回复质量。专家应能够识别输出是否清晰、有帮助、自然、技术准确，并符合项目指南。
需要熟练掌握英语，以加拿大、美国或英国的英语为母语。具备多语言能力的专家可能会被提供本项目及其他项目的相关工作。
任务包括：
· 参与与AI系统的实时对话场景
· 审核和标记对话记录
· 使用结构化评分标准评估AI生成的回复并提供书面理由
· 评估回复的语言质量、客户体验、技术准确性、格式和JSON结构
· 捕获所需的会话资料，包括录音、会话ID和工具调用/控制台日志 - 每次会话前进行环境准备和工具验证
专家应自然且自发地表达，如同实时响应一样，不能使用预先计划好的书面或脚本回复——客户正在评估自然的语音节奏。
如要申请此项目，专家需通过一项基础计算概念测试（JSON结构、函数、一般推理和语言能力），测试约需15分钟完成，且不支付报酬。如果专家通过了测试，将获得进一步的入职步骤。
“操作员”要求：
- 强大的口语能力：目标评估语言的C1/C2级流利度（CEFR），通过口语/听力测试验证，而非仅凭简历声明。
- 技术素养：需要具备JSON流利度——阅读、验证、排查故障以及识别结构/格式问题
- 音频设置：能够生成清晰的音频
查看英文原文
An Enterprise client is seeking a high volume of English-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format.
Work is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project.
Experts may work at any schedule of their choosing, for as long as tasks are available. Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines.
Fluency in English, as spoken in Canada, the United States, or the United Kingdom, is required. Experts with multilingual fluency may be offered work for this project and/or others, in additional languages
Tasks include:
· Participating in live, real-time conversational scenarios with AI systems
· Reviewing and labeling conversation transcripts
· Evaluating AI-generated responses using structured rubrics and providing written justifications
· Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
· Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs - Environment preparation and tool verification before each session
Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence.
To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps.
“Operator” requirements:
- Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
- Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
- Audio setup: capable of producing clear audio quality with no background noise
Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.