AI Project Reviewer (CONTRACT)
我们是谁：MasterClass 是世界最好的流媒体平台，让任何人，任何地方都可以通过他们的知识和故事获得启发。我们将你与改变世界的创造者，思想家，制造商和领导人一起放在房间里，这样你可以改变你的世界。成员可以在各种领域中获得前所未有的200多名教师和课程，包括艺术和娱乐，业务，设计和风格，体育和游戏，写作等。进入纳斯录音室和戈登·拉姆塞的厨房，并与詹姆斯卡梅伦一起回到大屏幕后面。设计你的职业生涯与 Elaine Welteroth,准备好和 Lewis Hamilton 赢得胜利，完善你的球场与 Shonda Rhimes 并发现你内部谈判者与 Chris Voss.如果你想帮助影响我们的成员的生活我们希望听从你！我们寻找不止简历可以显示的东西。如果你没有确切的经验或技能，但认为你会成为一个伟大的补充到 MasterClass,请申请这个角色。角色概述：作为一名自由人工智能项目评审员，你将负责评估学习者的提交对新产品详细条目。你将使用一致的判断来确定合格/失败结果，并提供明确的建设性反以帮助学习者改善。与我们的产品设计团队一起工作，你将有助于校准和验证评估方法，以确保为我们成员提供公平，精确和有价值的反。这是一个基于项目需求的灵活参与性的临时角色。~每周20小时。你将做什么：·根据详细条目审查和评价项目，提供一致的通过/失败判断。·写出清晰的，可操作的反，帮助学习者了解需要改进的领域。·与学习设计和产品团队合作，以精细化规范和评估标准。· 进行人为和人工智能评估结果的比较，确定应对领域。· 记录评估决定背后的推理，以支持评估一致性关于你：· 5年以上经验在评估，评价或教育反角色中。· 在多项提交过程中持续应用详细规范的能力。· 有能力明确阐述合理论的强有力的书面沟通技能。· 提供建设性的反来支持学生成长的经验。· 保持高标准同时独立工作的能力。· 愿意回顾。
查看英文原文
Who we are:
MasterClass is the streaming platform where the world's best come together so anyone, anywhere, can access and be inspired by their knowledge and stories. We put you in the room with the creators, thinkers, makers and leaders who have changed the world, so that you can change yours.
Members get unprecedented access to 200+ instructors and classes across a wide variety of fields, including Arts & Entertainment, Business, Design & Style, Sports & Gaming, Writing and more. Step into Nas' recording studio and Gordon Ramsay's kitchen, and go behind the big screen with James Cameron. Design your career with Elaine Welteroth, get ready to win with Lewis Hamilton, perfect your pitch with Shonda Rhimes and discover your inner negotiator with Chris Voss.
If you want to help make an impact on our members' lives – we want to hear from you!
We are looking for more than what a resume can show. If you don't have the exact experience or skills, but think you'd be a great addition to MasterClass, please apply for the role.
Role Overview:
As a freelance AI Project Reviewer, you will be responsible for evaluating learner submissions against detailed rubrics for a new product. You will apply consistent judgment to determine pass/fail outcomes and provide clear, constructive feedback to help learners improve. Working alongside our product and learning design teams, you’ll help calibrate and validate assessment approaches to ensure fair, accurate, and valuable feedback for our members.
This is a temporary role with flexible engagement based on project needs. ~20 hours per week.
What You Will Do:
- Review and evaluate projects against detailed rubrics, providing consistent pass/fail judgments.
- Write clear, actionable feedback that helps learners understand areas for improvement.
- Collaborate with the learning design and product team to refine rubrics and assessment criteria.
- Compare human and AI assessment outcomes to identify areas for calibration.
- Document reasoning behind evaluation decisions to support assessment consistency
About You:
- 5+ years of experience in assessment, evaluation, or educational feedback roles.
- Proven ability to consistently apply detailed rubrics across multiple submissions.
- Strong written communication skills with the ability to articulate reasoning clearly.
- Experience providing constructive feedback to support learner growth.
- Ability to work independently while maintaining high standards.
- Willingness to refrain from using AI during evaluations and written rationales.
- Experience in roles such as Mentor or Coach in educational settings, Educational Evaluator or Teaching Assistant (TA), Consultant in AI or learning design, or Instructor with experience in grading and providing feedback.
You’re a Great Fit If You:
- Are passionate about education and committed to helping learners succeed.
- Have a keen eye for detail and take pride in maintaining high standards in evaluation.
- Enjoy collaborating with cross-functional teams to enhance assessment quality.
- Are comfortable making nuanced judgments while ensuring consistency.
- Have experience working independently and managing your time efficiently.
- Are curious and open to learning more about AI-driven evaluation methods.
Hourly Range: $75-$125 USD
The hourly range listed is for NYC/CA/WA. As a company, we have a location based strategy, which means the disclosed range estimate has not been adjusted for any applicable geographic differential associated with the location where the position may be filled.
At MasterClass, we believe we put our best work forward when our employees bring together ideas that are diverse in thought. We are proud to be an equal opportunity workplace and are committed to equal employment opportunity regardless of race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, genetic information, veteran status, gender identity or expression, sexual orientation, or any other characteristic protected by applicable federal, state or local law. In addition, MasterClass will provide reasonable accommodations for qualified individuals with disabilities. If you have a disability or special need, we would like to know how we can better accommodate you.
Originally posted on Himalayas