DevOps 工程师 - AI 模型评估员
DevOps Engineer - AI Model Evaluator
关于职位
Mercor 将顶尖的创意和技术人才与领先的 AI 研究实验室连接起来。公司总部位于旧金山，我们的投资方包括 Benchmark、General Catalyst、Peter Thiel、Adam D'Angelo、Larry Summers 和 Jack Dorsey。
职位：DevOps / SRE / Cloud Engineer（编码代理经验）
类型：合同制
薪酬：85 美元/小时
地点：远程
岗位职责
- 使用前沿 AI 编码代理完成并评估复杂的基础设施工程任务。
- 审查涉及云平台、Kubernetes、CI/CD 系统和基础设施自动化的模型生成实现。
- 识别模型输出中的错误、边界情况、可靠性问题和故障模式。
- 比较多个前沿模型的输出，评估其优缺点。
- 在实际的基础设施工程场景中应用专业的工程判断。
任职要求
必备条件
- 2 年以上 DevOps、SRE 或 Cloud Engineering 相关工作经验。
- 具有 AWS、Azure、GCP、Kubernetes、Terraform、CI/CD 流水线或可观测性工具的经验。
- 定期使用 AI 编码代理，如 Cursor、Claude Code、Codex、Windsurf、Gemini CLI 或类似工具。
- 能够评估模型生成的基础设施和可靠性工程解决方案。
优先考虑
- 具有支持生产级系统的经验。
- 薪酬与法律
- 每个被接受的任务支付 400 美元。
- 薪酬与被接受的工作相关。
申请流程（需要 20-30 分钟完成）
- 上传简历
- 基于简历的 AI 面试
- 提交表单
资源与支持
- 有关面试流程和平台信息的详细信息，请查看：
- 如有任何帮助或支持，请联系：
备注：我们的团队每天都会审核申请。请完成 AI 面试和申请步骤，以考虑此机会。
最初发布于 Himalayas
查看英文原文
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type:Contract
Compensation:$85/hour
Location:Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
- Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
- Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
· Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task.
- Compensation is tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas