教育者/评估员撰稿人
Educator/ Assessor Writer
职位名称:教育者/评估撰写者
职位类型:合同工
工作地点:远程
micro1 正在招募教育者/评估撰写者,为一个专注于高级人工智能系统开发的客户项目贡献专业知识。在此职位中,您将运用专业知识帮助训练下一代人工智能系统。您的工作将影响模型的学习、推理和表现方式,通过高质量的真实输入。无需人工智能相关经验——您的专业领域知识才是关键。此机会适合那些有评估书面作品、审查学术写作或设计有效评估经验的人士。该职位完全远程,可灵活参与其他职业任务。
工作范围
- 评估和比较多种由人工智能生成的书面回答,判断其清晰度、语气、帮助性以及是否遵循指示。
- 根据提供的评分标准和指南分配分析质量分数。
- 撰写详细的书面理由,以说明每项评估或分数。
- 识别出流畅但缺乏支持的回答,或全面但对目标受众不实用的回答。
- 发现事实性错误、内部矛盾以及影响可靠性或可用性的问题。
- 详细记录发现,并保持决策和观察的完整记录。
- 使用数字内容审核平台与项目经理和评审人员异步协作。
优先资格
- 英语书面语为母语水平或同等熟练程度。
- 在美国、加拿大、英国、爱尔兰、澳大利亚或新西兰的认证机构获得学位。
- 有根据既定标准或评分表对书面作品进行评分、评分或审查的经验。
- 有评估设计、教学设计、同行评审、论文指导或学术写作支持背景者优先。
- 对细节高度关注,具备批判性分析能力,并能做出客观、表达清晰的判断。
- 能够独立远程工作并按时完成项目截止日期。
- 具有模型评估、RLHF 或标注经验者为加分项,但非必需。
最初发布于喜马拉雅山
查看英文原文
Role Title: Educator/ Assessor Writer
Role Type: Contractor
Location: Remote
micro1 is engaging Educator/ Assessor Writers to contribute expertise on a customer project focused on advanced AI system development. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This opportunity is ideal for individuals experienced in evaluating written work against a rubric, examining academic writing, or designing effective assessments. The engagement is fully remote and offers the flexibility to participate alongside other professional obligations.
Scope of Work
- Evaluate and compare multiple AI-generated written responses for clarity, tone, helpfulness, and adherence to instructions.
- Assign analytical quality scores based on provided rubrics and guidelines.
- Compose detailed written rationales justifying each assessment or score.
- Identify responses that are fluent but unsupported, or comprehensive but not practical for their intended audience.
- Detect factual errors, internal inconsistencies, and issues affecting reliability or usability.
- Document findings meticulously and maintain thorough records of decisions and observations.
- Collaborate asynchronously with project managers and reviewers using digital content review platforms.
Preferred Qualifications
- First-language proficiency or fully equivalent fluency in written English.
- Completed degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Experience marking, grading, or examining written work against set criteria or rubrics.
- Background in assessment design, instructional design, peer review, thesis supervision, or academic writing support.
- Keen attention to detail, critical analysis skills, and the ability to deliver objective, well-articulated judgments.
- Capable of independent remote work and meeting project deadlines.
- Experience with model evaluation, RLHF, or annotation is an asset but not mandatory.
Originally posted on Himalayas