高级软件工程师，AI 训练 - 拉丁美洲
Senior Software Engineer, AI Training - LATAM
合同制 | 远程，全球 | 每小时100-200美元，根据经验和所在地而定 | 每周10-20小时
查看此 Loom 视频以获取更多信息：
我们正在寻找资深软件工程师（高级以上）来帮助评估与现代代码代理（如 OpenAI Codex 和 Claude Code）的交互质量。
这不是传统工程岗位。你不会编写生产代码。你会评估更难的事情：模型是否像优秀工程师一样思考。
这个岗位的实际内容
你将评估 AI 代码代理在真实场景中的表现，重点关注：
• 回答是否有意义
- 前置说明和推理是否有用
- 输出是否体现强大的工程判断力
- 与经验丰富的开发人员的体验是否一致
这个岗位关注的是工程品味。语法正确是容易的部分。
你将做的事情
- 全流程评估 AI 生成的代码交互
- 判断输出是否有用、在高层次上正确，并符合优秀工程师的思维方式
- 评估解释和推理的质量，而不仅仅是代码本身
- 区分响应质量的层次（什么是2分和4分的区别）
- 以书面形式给出明确、有观点的反馈，说明哪些有效、哪些无效，以及哪些感觉不对或具有误导性
- 帮助定义使用 Cursor、Codex 和 Claude Code 等工具时优秀的表现标准
我们所说的“品味”
我们寻找的工程师能够回答以下问题：
- 这听起来像优秀工程师会说的话吗？
- 这个解释有帮助，还是只是技术正确？
- 模型是否引导用户，还是只是输出结果？
- 这个交互会建立信任还是破坏信任？
你应该能够做出主观但严谨的判断，并清晰地解释它们。
你是谁
- 高级、资深或首席工程师（或同等经验）
- 强大的 TypeScript/JavaScript 或 Python 背景
- 至少有一个 OpenAI Codex、Claude Code 或 Cursor 的实战经验
- 熟悉现代 AI 辅助开发工作流
- 能够在不执行代码或逐行审查的情况下评估代码
- 英语写作和口语能力强（B2或以上）。你需要撰写详细反馈并录制简短视频解释，因此这是硬性要求
- 能够给予直接、有观点的反馈
- 对优秀工程的标准有高标准
- 加分项
- 有提示相关经验
查看英文原文
Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week
Check out this Loom video for more details:
We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.
This is not a traditional engineering role. You won't be writing production code. You'll be evaluating something harder: whether the model thinks like a great engineer.
What this role actually is
You will assess how AI coding agents behave in real-world scenarios, focusing on:
• Whether the response makes sense
- Whether the preamble and reasoning are useful
- Whether the output reflects strong engineering judgment
- Whether the interaction feels right to an experienced developer
This role is about engineering taste. Syntax correctness is the easy part.
What you'll be doing
- Evaluate AI-generated coding interactions end to end
- Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think
- Assess the quality of explanations and reasoning, not just the code
- Distinguish between levels of response quality (what makes something a 2 vs a 4)
- Give clear, opinionated feedback in writing on what worked, what didn't, and what felt off or misleading
- Help define what great looks like when working with tools like Cursor, Codex and Claude Code
What we mean by "taste"
We're looking for engineers who can answer questions like:
- Does this feel like something a strong engineer would actually say?
- Is this explanation helpful, or just technically correct?
- Is the model guiding the user well, or just dumping output?
- Would this interaction build or erode trust?
You should be comfortable making subjective but rigorous judgments, and explaining them clearly.
Who you are
- Senior, Staff or Principal-level engineer (or equivalent experience)
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code or Cursor
- Deep familiarity with modern AI-assisted dev workflows
- Able to evaluate code without executing it or reviewing every line
- Strong written and spoken English (B2 or above). You'll be writing detailed feedback and recording short video explanations, so this is a hard requirement
- Comfortable giving direct, opinionated feedback
- High bar for what good engineering looks like
Nice to have
- Prior exposure to prompt design or evaluation workflows
- Experience mentoring senior engineers or defining engineering standards
Engagement details
- Rate: $100-$200/hour depending on experience and location
• Hours: 10-20 hours/week, flexible
- Duration: ongoing. Projects run from about two weeks to a few months each, and we offer new ones to evaluators who do well
- Start: as soon as you clear the take-home and a project has an open seat
- Process: one take-home evaluation exercise with a recorded Loom walkthrough. No interview
Originally posted on Himalayas