行为健康专家,AI安全与模型评估
Behavioral Health Expert, AI Safety and Model Evaluation
**薪资:** 每小时45-70美元(美元)。
**帮助一家领先的AI实验室确保其模型以关怀、平衡和合理判断的方式回应用户。**
# 1. 概述
一家领先的AI实验室正在寻找行为健康专家,以帮助评估和改进其AI模型处理敏感日常对话的方式。人们越来越多地向AI寻求在人际关系、家庭动态、情绪健康、个人信仰和困难生活决策方面的支持。这些对话很少涉及危机内容,但正是在这些场景中,模型的判断最为重要:它是否保持平衡,避免偏袒,拒绝告诉人们他们想听的话,尊重个人的信仰而不加以肯定或否定,并理解自身的角色界限。您将审查这些互动,评估模型的回应是否恰当、中立且安全,并协助实验室的研究人员定义什么是好的回应。如果您具备心理健康、心理咨询、社会工作或行为科学的专业经验,并能清晰地说明为什么一个回应比另一个更有利于用户,那么这个职位适合您。该职位为兼职,每周至少20小时,也可增加至每周最多40小时。
这是与Cincinnatus LLC签订的W-2雇佣合同,有机会作为其扩展员工团队的一部分被派驻到一家领先的AI实验室。
# 2. 核心职责
- 在诸如关系和家庭建议、情绪健康、灵性和形而上学问题,以及非常规或无根据的信念等话题上,评估用户与AI模型之间的对话,并评估回应是否中立、恰当且安全。
- 识别关注模式,包括过度同意、偏袒、强化扭曲或无根据的信念、道德说教或越界提供临床或指导性建议,并用清晰的书面理由进行记录。
- 制定评分标准、指南和参考回应,定义平衡、支持且适当界定的回复,基于心理咨询和行为健康的既有实践。
- 设计测试场景和对话,以探究模型如何处理敏感但非危机话题。
- 与实验室的研究人员和同行专家合作,保持评估标准的一致性、校准和良好记录。
# 3. 核心资质
- 心理学、心理咨询、社会工作、行为健康、行为科学、人力资源服务等相关专业的学位,或具有同等专业经验。
查看英文原文
**Pay:** $45-$70 per hour (USD).
**Help a leading AI lab ensure its models respond to people with care, balance and sound judgment.**
# 1. Overview
A leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle sensitive, everyday conversations. People increasingly turn to AI for support with relationships, family dynamics, emotional wellbeing, personal beliefs and difficult life decisions. These conversations rarely involve crisis content, but they are exactly where a model's judgment matters most: whether it stays balanced, avoids taking sides, resists telling people what they want to hear, respects a person's beliefs without endorsing or dismissing them, and understands the limits of its role. You'll review these interactions, assess whether the model's responses are appropriate, neutral and safe, and help the lab's researchers define what good looks like. If you bring professional experience in mental health, counseling, social work or behavioral science, and you can articulate clearly why one response serves a person better than another, this role is for you. This is a part-time commitment of at least 20 hours per week, with the option to increase to up to 40 hours per week.
This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce.
# 2. Key Responsibilities
- Evaluate conversations between users and AI models across topics such as relationship and family advice, emotional wellbeing, spiritual and metaphysical questions, and unconventional or unfounded beliefs, and assess whether responses are neutral, appropriate and safe.
- Identify patterns of concern, including excessive agreement, taking sides, reinforcing distorted or unfounded beliefs, moralizing, or overstepping into clinical or directive advice, and document them with clear written rationale.
- Develop rubrics, guidelines and reference responses that define a balanced, supportive and appropriately bounded reply, grounded in established practice from counseling and behavioral health.
- Design test scenarios and conversations that probe how models handle sensitive but non crisis topics.
- Collaborate with the lab's researchers and fellow experts to keep evaluation standards consistent, calibrated and well documented.
# 3. Core Qualifications
- A degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a closely related field, or equivalent professional experience in the mental health field.
- 3+ years of professional experience supporting people in a mental health, counseling or social services setting, for example as a therapist, counselor, clinical social worker, psychologist, psychiatric nurse, case manager, crisis counselor, peer support specialist or mental health advocate. Clinical licensure (for example LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required.
- Demonstrated ability to remain neutral and nonjudgmental across diverse perspectives, relationships, belief systems and worldviews, and to explain the reasoning behind a professional judgment.
- Working familiarity with concepts such as sycophancy, cognitive distortions, healthy boundaries and client centered approaches such as motivational interviewing.
- Ability to engage reliably for at least 20 hours/week during weekdays.
- Strong written communication skills and the ability to deliver precise, well structured written feedback.
**Nice to have:** a background in AI safety, applied ethics, trust and safety or content policy; experience in couples, family or relationship counseling; familiarity with spiritual care, religious or alternative belief communities, or the psychology of misinformation and conspiracy belief; prior experience evaluating, annotating or red teaming AI systems. You don't need all of these to apply.
**About Cincinnatus LLC:**
Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.
**Equal Employment Opportunity:**
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.