AI Safety Specialist - Evaluation Expert
关于工作的职位，默科尔将精英创意和技术人才与领先的人工智能研究实验室联系起来。总部位于旧金山，我们的投资者包括 Benchmark,General Catalyst,Peter Thiel,Adam D'Angelo,Larry Summers 和 Jack Dorsey.职位：AI 安全从业人员类型：合同补偿：$60$70/小时 地点：远程角色责任 ·评估人工智能生成的安全反应，事实的准确性，政策遵守以及整体质量。·审查涉及错误信息，政治说服，自我伤害，暴力，网络，生物安全和其他敏感领域的内容。·应用并完善对 RLHF,SFT 和安全基准 AI 的评价条目。· 识别不安全的输出，幻觉，推理失败和政策违规。· 为改善模型对准和安全性提供结构化反。· 与人工智能研究人员和安全团队合作进行持续评估举措。资格必须有 · 记者学，通信，心理学，社会学，公共政策，法律，生物学，化学，计算机科学或相关学科等专业学位或以上。· 5年以上在人工智能安全，信任与安全，新闻，公共政策،科学研究，安全或相关领域的专业经验。· 优秀的写作英语，批判性思维和分析推理技能。· 能够持续评估细微且对政策敏感的场景。首选 · 对 AI 安全，RLHF,SFT,信任和安全或人工智能评估的经验。·熟悉安全政策，内容调节或评价条目开发。· 复杂，高风险或模糊内容审查的经验。申请过程 （需要20~30分钟才能完成）· 上传简历 ·基于你的简历进行人工智能面试 ·提交表资源 & 支持 · 请查看有关采访流程和平台信息的详情：· 任何帮助或支持，请联系 PS:我们的团队每天审查应用程序。你可以完成 AI 面试和申请步骤，以便考虑这个机会。
查看英文原文
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Safety Practitioner
Type:Contract
Compensation:$60–$70/hour
Location:Remote
Role Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
Qualifications
Must-Have
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
- 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
- Excellent written English, critical thinking, and analytical reasoning skills.
- Ability to consistently evaluate nuanced and policy-sensitive scenarios.
Preferred
- Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
- Familiarity with safety policies, content moderation, or evaluation rubric development.
- Experience reviewing complex, high-risk, or ambiguous content.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas