Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
职位标题：研究评估专家 （博士或士/研究者）角色类型：承包商 （每周15小时）地点：远程，全球 micro1正在聘请研究评价专家 （PhD 或士 / 研究员）来为客户的项目的一部分开发先进 AI 模型评估进行严格测试材料。在这个角色中，你将应用自己的专业知识来帮助培训下一代人工智能系统。你的工作将通过高质量，现实世界的输入塑造学习，推理和性能模式的方式。需要在 AI 上前经验，而你的领域知识带来了高价值。工作范围 · 在专业领域最先进的位置创建原始，高难度的问题和答案对来，以严格评估人工智能模型的能力。· 使用主要来源和权威引用，包括清晰引述和推理，源码，验证和彻底记录答案。· 设计需要高级推理，方法细微或多种来源合成的问题，确保对过于简化或快捷解决方案的抵制性。· 对 AI 系统进行测试，识别不足为挑战性的项目，并不断增加复杂性，同时保持准确性。· 写出每一个问题和答案，以高精度和清晰度，消除模糊性并支持可辩护的回应。· 整合评论员反，并在你的产品中始终遵守所有项目指导方针和质量标准。首选资格 · 完成士或博士学位，积极候选人或作为专家，研究人员，助理教授或教授在你领域等同的研究经验。· 证明学术研究的历史记录，深入的课题专业知识以及熟悉初级文学。· 卓越的分析思维，密切关注细节，强有力的英语书面沟通技能。·经验从权威参考中获取和三角化信息。· 证明自主指导性和可靠性，可以在远程任务内独立地提供专家级工作。· 编写具有挑战性的，原始的和方法学的合理的问题的能力。·需要先前在人工智能培训，数据标签或模型评估方面的经验。补偿结构补偿是基于输出；专家每项符合项目规范的工作都会被支付。完成工作所需时间可能根据专家的经验而异。
查看英文原文
Role Title: Research Evaluation Specialist (PhD or Masters / Researcher)
Role Type: Contractor (~15 hs a week)
Location: Remote, worldwide
micro1 is engaging Research Evaluation Specialists (PhD or Masters / Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Prior experience in AI is required while your domain knowledge brings high value.
Scope of Work
- Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
- Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
Preferred Qualifications
- Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor or professor in your domain.
- Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
- Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
- Experience sourcing and triangulating information from authoritative references.
- Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
- Skill in composing challenging, original, and methodologically sound questions.
- Prior experience in AI training, data labeling, or model evaluation is required.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
Originally posted on Himalayas