高级软件工程师，（OpenAI Codex、Claude Code 或 Cursor）
Senior Software Engineer, (OpenAI Codex, Claude Code or Cursor)
合同制 | 远程办公，全球可选 | 时薪100-200美元，根据经验和所在地而定 | 每周10-20小时
查看此Loom视频获取更多信息：
我们正在寻找资深软件工程师（高级以上）来评估与现代代码代理（如OpenAI Codex和Claude Code）的交互质量。
这不是传统工程岗位。你不会编写生产代码。你会评估更难的事情：模型是否像优秀的工程师一样思考。
这个岗位的实际内容
你将评估AI代码代理在真实场景中的表现，重点包括：
• 回答是否有意义
- 前置说明和推理是否有用
- 输出是否体现良好的工程判断
- 与经验丰富的开发人员的感觉是否一致
这个岗位关注的是工程品味。语法正确只是基础。
你将做的事情
- 全流程评估AI生成的代码交互
- 判断输出是否有用、在高层次上正确，并符合优秀工程师的思维方式
- 评估解释和推理的质量，而不仅仅是代码本身
- 区分不同层次的响应质量（什么是2分，什么是4分）
- 以书面形式提供明确、有观点的反馈，说明哪些有效，哪些无效，哪些感觉不对或具有误导性
- 帮助定义使用Cursor、Codex和Claude Code等工具时优秀的表现标准
我们所说的“品味”
我们寻找的工程师能够回答以下问题：
- 这听起来像优秀工程师会说的话吗？
- 这个解释有帮助，还是只是技术正确？
- 模型是否引导用户得当，还是只是输出一堆内容？
- 这次交互会建立信任还是破坏信任？
你应该能够做出主观但严谨的判断，并清晰地解释它们。
你是什么样的人
- 高级、资深或首席工程师（或同等经验）
- 在TypeScript/JavaScript或Python方面有扎实背景
- 至少使用过OpenAI Codex、Claude Code或Cursor中的一个
- 对现代AI辅助开发流程有深入了解
- 能够在不执行代码或逐行审查的情况下评估代码
- 英语写作和口语能力强（B2或以上）。你需要撰写详细反馈并录制简短的视频解释，因此这是硬性要求
- 能够给予直接、有观点的反馈
- 对优秀工程的标准有高标准
- 加分项
- 有提示相关经验
查看英文原文
Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week
Check out this Loom video for more details:
We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.
This is not a traditional engineering role. You won't be writing production code. You'll be evaluating something harder: whether the model thinks like a great engineer.
What this role actually is
You will assess how AI coding agents behave in real-world scenarios, focusing on:
• Whether the response makes sense
- Whether the preamble and reasoning are useful
- Whether the output reflects strong engineering judgment
- Whether the interaction feels right to an experienced developer
This role is about engineering taste. Syntax correctness is the easy part.
What you'll be doing
- Evaluate AI-generated coding interactions end to end
- Judge whether outputs are useful, correct at a high level, and aligned with how a strong engineer would think
- Assess the quality of explanations and reasoning, not just the code
- Distinguish between levels of response quality (what makes something a 2 vs a 4)
- Give clear, opinionated feedback in writing on what worked, what didn't, and what felt off or misleading
- Help define what great looks like when working with tools like Cursor, Codex and Claude Code
What we mean by "taste"
We're looking for engineers who can answer questions like:
- Does this feel like something a strong engineer would actually say?
- Is this explanation helpful, or just technically correct?
- Is the model guiding the user well, or just dumping output?
- Would this interaction build or erode trust?
You should be comfortable making subjective but rigorous judgments, and explaining them clearly.
Who you are
- Senior, Staff or Principal-level engineer (or equivalent experience)
- Strong background in TypeScript/JavaScript or Python
- Hands-on experience with at least one of OpenAI Codex, Claude Code or Cursor
- Deep familiarity with modern AI-assisted dev workflows
- Able to evaluate code without executing it or reviewing every line
- Strong written and spoken English (B2 or above). You'll be writing detailed feedback and recording short video explanations, so this is a hard requirement
- Comfortable giving direct, opinionated feedback
- High bar for what good engineering looks like
Nice to have
- Prior exposure to prompt design or evaluation workflows
- Experience mentoring senior engineers or defining engineering standards
Engagement details
- Rate: $100-$200/hour depending on experience and location
• Hours: 10-20 hours/week, flexible
- Duration: ongoing. Projects run from about two weeks to a few months each, and we offer new ones to evaluators who do well
- Start: as soon as you clear the take-home and a project has an open seat
- Process: one take-home evaluation exercise with a recorded Loom walkthrough. No interview
Originally posted on Himalayas