分析评估员 - AI反馈
Analytical Evaluator - AI Feedback
关于职位
Mercor 将顶尖的创意和技术人才与领先的 AI 研究实验室相连接。公司总部位于旧金山，我们的投资人包括 Benchmark、General Catalyst、Peter Thiel、Adam D'Angelo、Larry Summers 和 Jack Dorsey。
职位：通用专家
类型：合同制
薪资：70 美元/小时
地点：远程
岗位职责
- 评估 AI 生成的回复，以增强模型输出的推理能力和严谨性。
- 提供结构化的书面反馈，以提升训练数据质量和下游性能。
- 撰写清晰、精确且有充分依据的书面理由，超越表面观察。
- 对细节保持严格关注，并准确应用结构化评估指南。
- 独立且异步工作，按时完成任务，同时提升 AI 模型性能。
任职要求
必须具备
- 优先考虑全球排名前 500 的大学学士学位。
- 强大的分析和书面沟通能力。
- 能够独立工作并遵循详细的任务指南。
- 强大的批判性阅读能力，能够识别细微差别、隐含含义和推理中的漏洞。
- 能够撰写清晰、精确且有充分依据的书面理由。
- 一致且诚实的判断力，包括提供批判性评估的能力。
- 对细节保持严格关注，并准确应用结构化评估指南。
- 能够完全不使用 AI 写作工具进行工作。
- 需要母语级别的英语流利度。
申请流程（需要 20-30 分钟完成）
- 上传简历
- 基于简历的 AI 面试
- 提交表单
资源与支持
- 有关面试流程和平台信息的详细内容，请查看：
- 如有任何帮助或支持需求，请联系：
备注：我们的团队每天都会审核申请。请完成 AI 面试和申请步骤，以考虑此机会。
最初发布于 喜马拉雅山
查看英文原文
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Generalist Expert
Type:Contract
Compensation:$70/hour
Location:Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply strict attention to detail and accurate application of structured evaluation guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas