高级生成式AI科学家II - (模型风险)
Sr Generative AI Scientist II - (Model Risk)
Overview
加入一个新成立的团队,专注于模型风险和负责任的AI。高级生成式AI科学家II将运用专业知识和经验解决现实问题,并利用其技能降低医疗成本,提高医疗质量和结果。作为该团队的数据科学家,您将专注于三个主要项目领域:模型验证、模型指标和监控,以及负责任的AI。这需要从数据科学角度具备AI/ML/GenAI的深度知识,能够以技术系统思维灵活思考,并对负责任的AI和AI伦理的新兴领域有一定理解。这是一份面向有抱负的技术人员的职位,需要在动态环境中具备灵活性和个人驱动力,根据其对业务成果的直接影响来评估表现。
Responsibilities
- 作为Cotiviti的高级生成式AI科学家II,您将负责交付帮助客户识别支付完整性问题、降低医疗流程成本或提高医疗结果质量的解决方案。您将作为团队的一员工作,并对与您的项目相关的价值交付负有个人责任。
- 独立进行现有模型的验证,用于基准测试、评估和衡量有效性。确定模型漂移及相关数据漂移方面的问题,以实现模型风险管理(MRM),从而降低风险并发现推动新收入增长和创新的机会。应用在AI/ML/GenAI模型开发方面的深厚专业知识,包括模型构建和模型评估的实际经验。
- 根据需要使用更新的数据,可能采用更现代、更有效的算法对现有模型进行基准测试和重建。
- 积极推动模型监控活动的改进,包括模型注册方法、模型元数据管理,以及相关工具和技术的方法概念化。完成年度绩效评审和/或目标设定中列出的所有职责。完成所有特殊项目和其他指派的任务。
- 能够在合理便利条件下履行职责。
本职位描述旨在描述正在执行工作的总体性质和级别,不应被解释为职责、义务和技能要求的完整列表。本职位描述不构成雇佣协议,仅供参考。
查看英文原文
Overview
Join a recently formed team focused on Model Risk and Responsible AI. The Senior GenAI Scientist II – Risk will apply knowledge and experience to real world problems and seek to utilize their skills to reduce the cost of healthcare and improve health quality and outcomes. As a Data Scientist on this team, you will focus on three main project areas: Model Validation, Model Metrics and Monitoring, and Responsible AI. This requires someone with depth in AI/ML/GenAI from a data science perspective, versatility to think in terms of technology systems, and some understanding of emerging areas of Responsible AI and AI Ethics. This is for an ambitious technologist, with the flexibility and personal drive to succeed in a dynamic environment where they are judged based on their direct impact to business outcomes.
Responsibilities
- As a Senior GenAI Scientist II within Cotiviti you will be responsible for delivering solutions that help our clients identify payment integrity issues, reduce the cost of healthcare processes, or improve the quality of healthcare outcomes. You will work as part of a team and will be individually responsible for the delivery of value associated with your projects.
- Conduct independent model validation of existing models for benchmarking, assessment, and gauging effectiveness. Determine aspects of model drift and related data drift for the purpose of model risk management (MRM) to both reduce risk and also find opportunities to drive new revenue growth and innovation. Apply deep expertise with AI/ML/GenAI model development, including hands-on experience with model building and model evaluation.
- Benchmark and potentially rebuild existing models as needed using updated data, and potentially newer, more modern and effective algorithms.
- Actively drive improvements in model monitoring activities, including methods for model registration, model metadata management, and conceptualizing approaches for related tools and techniques. Complete all responsibilities as outlined in the annual performance review and/or goal setting. Complete all special projects and other duties as assigned.
- Must be able to perform duties with or without reasonable accommodation.
This job description is intended to describe the general nature and level of work being performed and is not to be construed as an exhaustive list of responsibilities, duties and skills required. This job description does not constitute an employment agreement and is subject to change as the needs of Cotiviti and requirements of the job change.
Qualifications
- Graduate Degree in a quantitative discipline such as Computer Science/Engineering, Statistics, Operations Research covering Advanced Statistics, Machine learning and AI.
- Experience with the latest techniques in natural language processing including transformers, fine-tuning LLMs, measuring/benchmarking and deploying LLMs with tools such as HuggingFace, Langchain, LLAMA/Mistral and OpenAI, vector databases.
- 5+ years of hands-on data science/AI experience, using typical machine learning and data science tools including pandas, scikit-learn, keras, nltk, and TensorFlow/PyTorch, GPU.
- General understanding of Responsible AI (RAI), including explainability (XAI), AI NIST RMF, and related AI risk management frameworks.
- Experience and understanding evaluating models for bias and fairness, with aptitude for detecting bias in the model design and data, as well as using metrics such as SHAP and LIME.
- Understanding appropriate model metrics and techniques for managing, evaluating and monitoring GenAI models and LLMs · Experience building production-grade machine learning deployments on AWS, Azure, or GCP.
- Experience working with Apache Spark™ and large-scale distributed datasets.
- Experience communicating technical concepts to non-technical and technical audiences is a plus. Passion for collaboration, learn it all mindset and driving value with AI.
Preferred Qualifications:
- Familiarity with healthcare payor ecosystem and related data.
- Understanding and familiarity with model governance and data governance best practices.
- Strong understanding of technology systems for model development (e.g., Python, DataRobot, AWS Sagemaker), model deployments (AWS, Azure, DataRobot, DataBricks), model monitoring (AWS Model Monitor, MLFlow, NannyML, FiddlerAI, Arize) and related tools for model management and metadata management.
Cognitive / Mental Requirements:
- Ability to work independently as well as collaborate as a team with a sense of urgency.
- Professional with ability to properly handle confidential information.
- Be value-driven, understand that success is based on the impact of your work rather than its complexity or the level of effort.
- Ability to handle multiple tasks, prioritize and meet deadlines.
- Ability to work within a matrixed organization.
- Proficiency in all required skills and competencies above.
- Communicating with others and teamwork.
- Assessing the accuracy, neatness, and thoroughness of the work assigned.
Physical Requirements and Working Conditions:
- Flexibility to work with global teams as well geographically dispersed US based teams.
- Remaining in a stationary position, often standing or sitting for prolonged periods.
- Repeating motions that may include the wrists, hands, and/or fingers.
- Must be able to provide high-speed internet access/connectivity and office setup and maintenance.
- Must be able to provide a dedicated, secure work area.
Base compensation ranges from $153,000 to $180,000 per year. Specific offers are determined by various factors, such as experience, education, skills, certifications, and other business needs.
Cotiviti offers team members a competitive benefits package to address a wide range of personal and family needs, including medical, dental, vision, disability, and life insurance coverage, 401(k) savings plans, paid family leave, 9 paid holidays per year, and 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with Cotiviti. For information about our benefits package, please refer to our Careers page.
Since this job will be based remotely, all interviews will be conducted virtually.
Date of posting: 9/16/2026
Applications are assessed on a rolling basis. We anticipate that the application window will close on 12/16/2026, but the application window may change depending on the volume of applications received or close immediately if a qualified candidate is selected.
#senior
Originally posted on Himalayas