数据科学家 - AI 评估
Data Scientist - AI Evaluation
Mercor 将顶尖的创意和技术人才与领先的 AI 研究实验室相连接。公司总部位于旧金山，我们的投资人包括 Benchmark、General Catalyst、Peter Thiel、Adam D'Angelo、Larry Summers 和 Jack Dorsey。
职位：数据科学家人才网络
类型：合同工
薪资：100–150 美元/小时
地点：远程办公
岗位职责
- 为数据科学交付成果设计精确的任务特定评分标准。这包括探索性数据分析、统计建模工作、机器学习流程和专业技术报告。
- 根据既定标准评估 AI 生成或人工创作的工作，以确保质量和准确性。
- 提供详细的书面评价理由和评分，以保持透明度。
- 应用一致的、基于证据的判断进行可重复和有依据的评估。
- 结合高级评审员的结构化反馈，并对提交的工作进行迭代以实现持续改进。
任职要求
必备条件
- 1 年以上专业数据科学经验。
- 在领先的技术、研究或量化公司有工作经验。
- 精通 Python、SQL、统计建模和机器学习。
- 优秀的书面沟通能力，能够传达技术发现。
- 对评估复杂工作有细致且一致的方法。
申请流程（需要 20–30 分钟完成）
- 上传简历
- 基于简历的 AI 面试
- 提交表单
资源与支持
- 关于面试流程和平台信息的详细内容，请查看：
- 如有任何帮助或支持，请联系：
注意：我们团队每天都会审核申请。请完成 AI 面试和申请步骤，以便考虑此机会。
最初发布于 Himalayas
查看英文原文
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Data Scientist Talent Network
Type:Contract
Compensation:$100–$150/hour
Location:Remote
Role Responsibilities
- Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, and A/B test write-ups.
- Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency.
- Provide detailed written justifications for evaluations and scores to maintain transparency and accountability.
- Apply consistent, evidence-based judgment to ensure assessments are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 1+ years of professional data science experience.
- Experience at a leading technology, research, or quantitative firm.
- Strong command of Python, SQL, statistical modeling, machine learning, and experimentation.
- Exceptional written communication skills.
- Detail-oriented and consistent approach to evaluating complex work.
- Comfort receiving feedback and calibrating judgment against established standards.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas