GenAI 安全分析师
GenAI Safety Analyst
描述
Alice 正在寻找一位积极主动、注重细节的专业人士，成为我们的团队成员，担任 GenAI 安全分析师。在这个职位中，您将深入技术前沿，仔细分析各种内容侵权行为，以保障新一代生成式 AI 工具的安全。您的职责包括与 Hate Speech（仇恨言论）、Misinformation（虚假信息）、Intellectual Property 和 Copyright（知识产权和版权）等不同领域的专家合作。
您的任务将涉及编写对抗性提示，以发现各种 AI 模型（包括大型语言模型 LLM、文本到图像、文本到视频、AI 代理等）中的弱点。您还将负责数据管理，以确保输出的最高质量。
职责：
- 在多个滥用领域开发对抗性和高风险提示策略，以揭示模型中的潜在漏洞。
- 全程管理项目，从最初的规划和监督到质量保证，最终交付。
- 处理多语言和多种滥用领域的大量数据集，确保精确性和细致入微的注意力。
- 持续研究新的绕过基础模型安全措施的方法。
- 与多样化团队（工程、产品、政策）合作，应对新挑战，制定前瞻性策略和解决方案。
- 在团队内部促进知识共享和持续学习的文化。
要求
必须具备：
- AI 安全和/或负责任 AI 和/或信任与安全方面的背景
- 熟悉最新的生成式 AI 模型和代理是必要的，尽管不需要直接的技术经验。
- 英语水平接近母语。
- 注重细节、组织能力强，并能同时处理多项任务。
加分项：
- 具有多种模型类型（文本到文本、文本到图像）的经验是理想的。
- 有 OSINT（开源情报）经验将被视为优势。
- 自主性强，能够在快速变化和多变的环境中表现出色。
该职位的薪资范围为 8 万美元至 8.7 万美元 OTE（根据经验可能有所变动）。实际录用时的薪资将根据经验进行调整。
关于 Alice
Alice 是一家为人工智能时代而打造的信任、安全和安全公司。我们保护人们用于创造、协作和互动的通信技术——无论是人与人之间，还是人与机器之间。
在一个世界里
查看英文原文
Description
Alice is seeking a driven, detail-focused professional to become a vital part of our team as a GenAI Safety Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, among others.
Your tasks will involve writing adversarial prompts to identify weaknesses in various AI models, including Large Language Models (LLMs), Text-to-Image, Text-to-Video, AI Agents and beyond. You'll also oversee data management to guarantee the highest quality of outputs.
Responsibilities:
- Developing adversarial and risky prompt strategies across several areas of abuse to expose potential vulnerabilities in models.
- Managing projects end-to-end, from initial planning and oversight through quality assurance to final delivery.
- Handling extensive datasets across multiple languages and areas of abuse, ensuring precision and meticulous attention to detail.
- Ongoing investigation into new tactics for circumventing foundational models' safety measures.
- Working alongside diverse teams, engineering, product, policy, to tackle new challenges and craft forward-thinking strategies and resolutions.
- Promoting a culture of knowledge exchange and continual learning within the team.
Requirements
Must have:
- Background in AI Safety and/or Responsible AI and/or Trust and Safety
- Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite.
- Command of English at a near-native level.
- Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently.
Additional Wants:
- Experience with various model types (Text-to-Text, Text-to-Image) is desirable.
- Prior experience with OSINT (Open Source Intelligence) will be considered an asset.
- A self-starter attitude, with the energy to excel in a fast-moving and variable environment.
The salary range for this role is $80K - $87K OTE - Range may vary based on experience. Salary at the time of offer will be commensurate with experience.
About Alice
Alice is a trust, safety, and security company built for the AI era. We safeguard the communicative technologies people use to create, collaborate, and interact—whether with each other or with machines.
In a world where AI has fundamentally changed the nature of risk, Alice provides end-to-end coverage across the entire AI lifecycle. We support frontier model labs, enterprises, and UGC platforms with a comprehensive suite of solutions: from model hardening evaluations and pre-deployment red-teaming to runtime guardrails and ongoing drift detection.
Originally posted on Himalayas