软件工程师: 为AI代理评估支付代码审查
Software Engineers: Paid Code Review for AI Agent Evaluation
WHAT WE'RE RESEARCHING
我们正在进行一项关于用于基准人工智能代理的编码环境和编程任务的付费研究。创建稳健的评估工具可以确保人工智能模型在现实的软件工程场景中进行测试。这项工作直接有助于提升自主代理处理复杂编码目标的能力。
HOW IT WORKS
在此次远程会议中，您将审查一系列编程任务及其对应的评估工具。您将评估这些编程挑战是否准确反映现实中的软件工程问题。我们会要求您验证所提供的环境中的逻辑、测试用例和整体结构。您的技术反馈将通过引导式对话和屏幕共享练习来记录。
WHO THIS IS FOR
我们寻找具有扎实背景的在职软件工程师，他们在构建和测试复杂系统方面有丰富经验。候选人应具有编写测试套件、评估工具或全面代码审查的直接经验。我们欢迎后端工程师、全栈开发人员、机器学习工程师和软件架构师。
WHAT YOU'LL DO
- 审查现实中的编程任务，确保其准确性和难度
- 验证提供的评估工具中的逻辑和测试用例
- 评估编码环境是否有效衡量软件工程技能
- 在分析复杂代码结构时向我们解释您的思考过程
WHO SHOULD APPLY
- 具有活跃的软件工程师职业经验
- 具有构建或维护测试套件和评估工具的实际经验
- 能够审查代码并大声解释技术概念
- 熟悉复杂的现实世界软件架构
COMPENSATION
每小时65美元
READY TO PARTICIPATE?
立即开始您的付费面试 https://terac.com/interview/start/r/bf37b4c7-b2ce-40e5-8e13-d41d4d33e9b1?utm_source=ashby_listing_description
ABOUT TERAC
Terac 正在打造全球最大的经过认证的人类专家池，用于人工智能。研究人员、人工智能实验室和产品团队使用 Terac 在各个行业、语言和技能水平中招募、筛选和支付研究参与者。
在 terac.com 了解更多信息 https://terac.com 或在 YouTube 上关注 @jointerac https://www.youtube.com/@jointerac
查看英文原文
WHAT WE'RE RESEARCHING
We're running a paid study on the coding environments and programming tasks used to benchmark artificial intelligence agents. Creating robust evaluation harnesses ensures that AI models are tested against realistic software engineering scenarios. This work directly feeds into improving how autonomous agents handle complex coding objectives.
HOW IT WORKS
During this remote session, you will review a series of coding tasks and their corresponding evaluation harnesses. You will assess whether the programming challenges accurately reflect real-world software engineering problems. We will ask you to verify the logic, test cases, and overall structure of the environments provided. Your technical feedback will be captured through a guided conversation and screen-sharing exercises.
WHO THIS IS FOR
We are looking for practicing software engineers with strong backgrounds in building and testing complex systems. Candidates should have direct experience writing test suites, evaluation harnesses, or comprehensive code reviews. We welcome backend engineers, full-stack developers, machine learning engineers, and software architects.
WHAT YOU'LL DO
- Review realistic programming tasks for accuracy and difficulty
- Verify the logic and test cases within provided evaluation harnesses
- Assess whether coding environments effectively measure software engineering skills
- Walk us through your thought process while analyzing complex code structures
WHO SHOULD APPLY
- Active professional experience as a software engineer
- Hands-on experience building or maintaining test suites and evaluation harnesses
- Comfortable reviewing code and explaining technical concepts aloud
- Familiarity with complex real-world software architecture
COMPENSATION
$65 per hour
READY TO PARTICIPATE?
Start your paid interview now https://terac.com/interview/start/r/bf37b4c7-b2ce-40e5-8e13-d41d4d33e9b1?utm_source=ashby_listing_description
ABOUT TERAC
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.