高级AI训练师
Senior AI Trainer
职位名称：高级AI训练师
职位类型：合同工，远程
地点：北美洲和欧洲
micro1 正在招募高级AI训练师，参与一个以客户为中心的项目，通过专家级模型训练和评估来提升AI系统质量。在此职位中，您将运用您的通才专业知识和对AI产品的实际经验，帮助训练下一代AI系统。您的工作将影响模型的学习、推理和表现方式，通过高质量的真实输入实现这一目标。
主要职责：
- 在标准化、可重复的条件下评估AI聊天和搜索工具的表现。
- 应用详细的评分指南，准确评估、排序和标注模型响应，提供结构化反馈以提高模型性能。
- 编写、优化和压力测试提示，以探测模型能力，确保覆盖多种场景、边缘案例和用户意图。
- 验证评估的一致性和准确性，纠正评分与评分标准或指南之间的差异。
- 使用AI训练工具和平台记录发现，并按照项目标准和里程碑提交评估数据集。
- 与项目训练师和贡献者合作，解决歧义，优化指南，并确保团队内评估的一致性。
- 参与持续的质量审查，结合反馈以保持严格的训练和标注标准。
所需技能和资格：
- 对AI生成内容进行审查和评估时，具备出色的关注细节和准确性。
- 具备良好的书面和口头沟通能力，以有效协作、报告并及时更新进展和挑战。
- 有证明的时间管理和自我组织能力，能够独立远程参与项目。
- 具备分析和解决问题的思维，积极应对评估中的挑战。
优先考虑的资质：
- 在AI模型训练、RLHF、数据标注或类似以数据为中心的评估项目中有实际经验。
- 熟悉AI产品和工具，包括提示工程以及对模型行为和限制的理解。
- 有编写评估量表、评分模型输出或审核AI响应以确保准确性、有用性和安全性的经验。
- 有AI训练、机器学习数据准备或LLM相关项目背景（强烈优先）。
最初发布于喜马拉雅山
查看英文原文
**Pay:** $14-$36 per hour (USD).
**Role Title:** Senior AI Trainer
**Role Type:** Contractor, Remote
**Location:** Northern America and Europe.
micro1 is engaging Senior AI Trainers to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. In this role, you'll apply your generalist expertise and hands-on experience with AI products to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.
**Key Responsibilities:**
1. Evaluate the performance of AI chat and search tools under standardized, repeatable conditions.
2. Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
3. Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
4. Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
5. Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
6. Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
7. Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.
**Required Skills and Qualifications:**
1. Exceptional attention to detail and accuracy in reviewing and evaluating AI-generated content.
2. Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges.
3. Demonstrated time management and self-organization abilities for independent, remote project participation.
4. Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges.
**Preferred Qualifications:**
1. Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
2. Familiarity with AI products and tools, including prompt engineering and understanding of model behaviors and limitations.
3. Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety.
4. Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).