南亚软件工程师：AI评估编码任务
South Asian Software Engineers: Coding Tasks for AI Evaluation
WHAT WE'RE RESEARCHING
我们正在开展一项付费研究，评估用于测试 AI 代理的编码评估工具的有效性。我们的团队正在构建一套全面的编程环境，旨在准确衡量代理性能。这项工作确保 AI 编码助手在现实、高质量的开发场景中进行评估。
HOW IT WORKS
你将在一个由 AI 主持的会议中，逐一完成一系列提议的编码任务和环境。我们会请你审查这些编程挑战的结构、难度和真实性。你将对评估工具提供技术反馈，并提出对测试套件的改进建议。对话将聚焦于确保这些任务准确反映实际的工程需求。
WHO THIS IS FOR
我们正在招聘位于南亚的有经验的软件工程师，他们具有构建和审查复杂代码库的坚实背景。我们欢迎后端开发人员、测试自动化工程师和全栈工程师，他们了解评估工具。理想的候选人具备在专业环境中验证真实编程任务的实际经验。
WHAT YOU'LL DO
- 审查提议的编码任务和编程环境的真实性
- 对评估工具的结构和难度提供技术反馈
- 向我们展示你验证复杂代码挑战的方法
- 建议如何使测试套件更强大
WHO SHOULD APPLY
- 位于南亚的专业软件工程师
- 具有构建或审查真实编程任务的经验
- 熟悉编码评估工具或测试自动化
- 在面试环境中能够自如地讨论技术流程
COMPENSATION
每小时35美元
READY TO PARTICIPATE?
立即开始你的付费面试 https://terac.com/interview/start/r/8a9b5977-2713-40ab-be6a-71bd59f76ca9?utm_source=ashby_listing_description
ABOUT TERAC
Terac 正在打造全球最大的经过认证的人类专家池，用于人工智能。研究人员、人工智能实验室和产品团队使用 Terac 在各个行业、语言和技能水平中招募、筛选和支付研究参与者。
在 terac.com 了解更多 https://terac.com 或在 YouTube 上关注 @jointerac https://www.youtube.com/@jointerac
查看英文原文
WHAT WE'RE RESEARCHING
We're running a paid study on the effectiveness of coding evaluation harnesses used to test AI agents. Our team is building a comprehensive suite of programming environments designed to measure agent performance accurately. This work ensures that AI coding assistants are evaluated against realistic, high-quality development scenarios.
HOW IT WORKS
You will walk through a series of proposed coding tasks and environments during an AI-moderated session. We will ask you to review the structure, difficulty, and realism of these programming challenges. You will provide technical feedback on the evaluation harnesses and suggest improvements to the test suites. The conversation will focus on ensuring these tasks accurately reflect real-world engineering requirements.
WHO THIS IS FOR
We are hiring experienced software engineers based in South Asia who have a strong background in building and reviewing complex codebases. We welcome backend developers, test automation engineers, and full-stack engineers who understand evaluation harnesses. Ideal candidates have hands-on experience verifying realistic programming tasks in professional environments.
WHAT YOU'LL DO
- Review proposed coding tasks and programming environments for realism
- Provide technical feedback on the structure and difficulty of evaluation harnesses
- Walk us through your approach to verifying complex code challenges
- Suggest improvements to make the test suites more robust
WHO SHOULD APPLY
- Professional software engineer based in South Asia
- Experience building or reviewing realistic programming tasks
- Familiarity with coding evaluation harnesses or test automation
- Comfortable discussing technical workflows in an interview setting
COMPENSATION
$35 per hour
READY TO PARTICIPATE?
Start your paid interview now https://terac.com/interview/start/r/8a9b5977-2713-40ab-be6a-71bd59f76ca9?utm_source=ashby_listing_description
ABOUT TERAC
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.