机器学习工程师，多模态感知与认证
Machine Learning Engineer, Multimodal Perception and Authentication
关于团队
计算未来研究团队是OpenAI消费者设备部门中的一个应用研究团队。我们研究AI系统如何感知人类及其周围环境，并将这些研究转化为未来产品的功能。
我们的工作涵盖机器学习、传感和硬件，重点是构建可在非受控环境中运行的系统。
关于职位
我们正在寻找一名机器学习工程师，帮助塑造未来AI系统对物理世界和其中人类的理解方式。该职位专注于多模态感知和认证，结合来自摄像头、麦克风和其他传感器的信号。
你将与专门的感知模型和更大的多模态模型合作，并与硬件、固件、软件和产品团队协作，将新研究带入实际系统中。
该职位位于旧金山。我们每周在办公室工作三天，并提供搬迁协助。
在此职位中，你将：
- 研究并开发跨视觉、音频和其他传感信号的多模态感知和认证方法。
- 探索专用感知模型和更大规模多模态模型如何协同工作。
- 设计数据、训练和评估方法，以提升真实环境中的性能。
- 研究模型行为、鲁棒性和故障模式，覆盖传感、数据和部署环境。
- 在实时或资源受限系统中集成和验证新功能。
- 与硬件、固件、软件和产品团队合作，将研究转化为实际系统。
如果你具备以下条件，可能会在这个职位中表现出色：
- 具有计算机视觉、音频或语音机器学习、多模态学习或传感方面的扎实背景。
- 有开发专用机器学习模型、大规模多模态模型或两者的经验。
- 有将研究想法转化为实际系统、原型或产品的经验。
- 擅长设计实验、构建评估并研究模型行为。
- 有使用传感硬件、实时系统或其他部署限制的经验。
- 精通Python和PyTorch，并熟悉C++或系统集成。
- 有认证、生物识别或其他隐私敏感应用的经验。
- 喜欢跨学科合作，解决仍在形成中的研究问题。
关于OpenAI
OpenAI是一家致力于人工智能研究和部署的公司，致力于确保通用人工智能（AGI）的开发造福全人类。
查看英文原文
About the Team
The Future of Computing Research team is an applied research team within OpenAI’s Consumer Devices group. We study how AI systems perceive people and their surroundings, and we turn that research into capabilities for future products.
Our work spans machine learning, sensing, and hardware, with a focus on building systems that work beyond controlled environments.
About the Role
We’re looking for a machine learning engineer to help shape how future AI systems understand the physical world and the people in it. The role focuses on multimodal perception and authentication, bringing together signals from cameras, microphones, and other sensors.
You’ll work with specialized perception models and larger multimodal models, and partner with hardware, firmware, software, and product teams to bring new research into real-world systems.
This role is based in San Francisco. We work in the office three days per week and offer relocation assistance.
In this role, you will:
- Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
- Explore how specialized perception models and larger multimodal models can work together.
- Design data, training, and evaluation approaches that improve performance in real-world conditions.
- Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
- Integrate and validate new capabilities in real-time or resource-constrained systems.
- Work with hardware, firmware, software, and product teams to turn research into working systems.
You might thrive in this role if you:
- Have a strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing.
- Have experience developing specialized machine learning models, larger multimodal models, or both.
- Have brought research ideas into practical systems, prototypes, or products.
- Know how to design experiments, build evaluations, and investigate model behavior.
- Have worked with sensing hardware, real-time systems, or other deployment constraints.
- Are proficient in Python and PyTorch and comfortable with C++ or systems integration.
- Have experience with authentication, biometrics, or other privacy-sensitive applications.
- Enjoy working across disciplines on research problems that are still taking shape.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement https://cdn.openai.com/policies/eeo-policy-statement.pdf.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form https://form.asana.com/?d=57018692298241&k=5MqR40fZd7jlxVUh5J-UeA. No response will be provided to inquiries unrelated to job posting compliance.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link https://form.asana.com/?k=bQ7w9h3iexRlicUdWRiwvg&d=57018692298241.
OpenAI Global Applicant Privacy Policy https://cdn.openai.com/policies/global-employee-and-contractor-privacy-policy.pdf
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.