任务撰写员:项目Agentic-MME
Task Writer: Project Agentic-MME
**薪资:** 每小时60美元(美元)。
关于项目
Agentic-MME 测试AI模型是否能够调查图像,而不仅仅是观看图像。为了解决一个任务,模型需要对图像进行裁剪、旋转或增强,使一个小细节变得可读,然后在网络上搜索一个事实,最后在回答之前将它们相互验证。
你将要做的
- 使用高分辨率图像,其中关键细节很小或已退化,以在原始图像上测试前沿AI模型,并找出它们遗漏的地方,然后围绕这些缺口构建任务
- 编写需要图像处理和至少一次网络搜索的现实场景提示
- 逐步记录最短解决方案路径,包括使用的图像操作和每个搜索的可信来源
- 提供一个确切的黄金答案、明确的答案格式以及任何被接受的变体
我们寻找的人才
- 对细节有很强的关注力
- 优秀的写作能力
- 具备网络研究技能,习惯使用原始、权威的来源
- 拥有高级学位
- 有制定评分标准经验者优先,但非必须
查看英文原文
**Pay:** $60 per hour (USD).
About the project
Agentic-MME tests whether AI models can investigate an image rather than just look at it. To solve a task, the model has to crop, rotate or enhance the image so a small detail becomes readable, then search the web for a fact, and then check each against the other before answering.
What you'll do
- Use high-resolution images where the key detail is small or degraded to test frontier AI models on the raw image and find what they miss, then build tasks around those gaps
- Write realistic prompts that need image work and at least one web search
- Record the shortest solution path step by step, with the image operations used and a credible source for each search
- Give one exact golden answer, a clear answer format and any accepted variants
What we're looking for
- Strong attention to detail
- Excellent writing skills
- Skill at web research, with a habit of using primary, authoritative sources
- Advanced degree holders
- Experience working on rubrics is a plus but not a must-have