拉美软件工程师：AI评估编码任务
LATAM Software Engineers: Coding Tasks for AI Evaluation
我们正在研究
我们正在开展一项付费研究，评估用于评估AI代理的编码任务的有效性。我们的团队正在构建一套全面的编程环境，以测试复杂的软件能力。我们希望确保这些评估框架是现实的、准确的，并且校准得当。
如何参与
您将审查一系列提议的编码任务，并评估它们对测试AI代理的适用性。我们会请您验证评估框架的逻辑，并提供关于其实际应用的反馈。您需要共享屏幕，演示环境并指出潜在的问题或改进建议。该过程包括代码审查、技术讨论以及对任务结构的直接反馈。
适合人群
我们寻找位于巴西和阿根廷、具有扎实技术背景的软件工程师。您应有直接构建、审查或测试评估框架和编程任务的经验。我们欢迎后端开发人员、全栈工程师和质量保证自动化专家。
您将负责
- 审查为AI评估设计的真实编程任务
- 评估各种评估框架的准确性和结构
- 在检查代码有效性时向我们展示您的思考过程
- 提供有关如何改进任务复杂性和真实性的可操作反馈
适合申请的人选
- 具有软件工程师或开发人员的专业经验
- 位于巴西或阿根廷
- 熟悉构建或验证编码任务和测试环境
- 擅长讨论技术架构和评估框架
报酬
每小时40美元
准备参与？
立即开始您的付费面试 https://terac.com/interview/start/r/9552dc7b-1052-4d96-8f97-7cf36d9ab9ce?utm_source=ashby_listing_description
关于TERAC
TERAC正在打造全球最大的经过认证的人类专家池，用于AI。研究人员、AI实验室和产品团队使用TERAC在各个行业、语言和技能水平中招聘、筛选和支付研究参与者。
了解更多请访问 terac.com https://terac.com 或在YouTube上关注 @jointerac https://www.youtube.com/@jointerac.
查看英文原文
WHAT WE'RE RESEARCHING
We're running a paid study on the effectiveness of coding tasks used to evaluate AI agents. Our team is building a comprehensive suite of programming environments designed to test complex software capabilities. We want to ensure these evaluation frameworks are realistic, accurate, and properly calibrated.
HOW IT WORKS
You will review a series of proposed coding tasks and assess their suitability for testing AI agents. We will ask you to verify the logic of the evaluation harnesses and provide feedback on their realistic application. You will share your screen to walk through the environments and point out potential flaws or improvements. The session involves a mix of code review, technical discussion, and direct feedback on the task structures.
WHO THIS IS FOR
We are looking for software engineers based in Brazil and Argentina with strong technical backgrounds. You should have direct experience building, reviewing, or testing evaluation harnesses and programming tasks. We welcome backend developers, full-stack engineers, and quality assurance automation specialists.
WHAT YOU'LL DO
- Review realistic programming tasks designed for AI evaluation
- Assess the accuracy and structure of various evaluation harnesses
- Walk us through your thought process while checking code validity
- Provide actionable feedback on how to improve task complexity and realism
WHO SHOULD APPLY
- Professional experience as a software engineer or developer
- Located in Brazil or Argentina
- Familiarity with building or verifying coding tasks and test environments
- Comfortable discussing technical architectures and evaluation frameworks
COMPENSATION
$40 per hour
READY TO PARTICIPATE?
Start your paid interview now https://terac.com/interview/start/r/9552dc7b-1052-4d96-8f97-7cf36d9ab9ce?utm_source=ashby_listing_description
ABOUT TERAC
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.