高级软件工程师，矩阵乘法
Senior Software Engineer, Matrix Multiplication
我们正在寻找优秀的AI系统工程师，开发推理系统软件堆栈中的突破性技术！我们构建创新的AI系统软件，以加速AI推理。作为团队成员，你将为NVIDIA的硬件架构开发库、代码生成器和GPU内核技术。这意味着设计和构建如新的抽象、高效的注意力内核实现、新的LLM推理运行时组件以及内核代码生成器，以加速大型语言模型、智能体和其他高影响力AI工作负载。
你将负责：
- 创新并开发用于高效推理的新AI系统技术
- 为高影响力AI工作负载设计、实现和优化内核
- 为LLM服务引擎设计和实现可扩展的抽象
- 构建高效的即时领域特定编译器和运行时
- 与NVIDIA其他工程师紧密合作，涉及深度学习框架、库、内核和GPU架构团队
- 为FlashInfer、vLLM和SGLang等开源社区做出贡献
我们需要看到：
- 计算机科学、电子工程或相关领域的硕士学位（或同等经验）；博士优先
- 6年以上（学术/工业）ML/DL系统开发经验者优先
- 在开发或使用深度学习框架（如PyTorch、JAX、TensorFlow、ONNX等）方面有较强经验，最好有推理引擎和运行时（如vLLM、SGLang、MLC）的经验
- 强大的Python和C/C++编程技能
- 在GPU内核开发和性能优化方面有较强经验（特别是使用CUDA C/C++、cuTile、Triton或类似工具），并有矩阵乘法的实际经验
脱颖而出的方式：
- 在LLM推理和训练的领域特定编译器和库解决方案方面有背景（如FlashInfer、Flash Attention）
- 精通推理引擎如vLLM和SGLang
- 精通机器学习编译器（如Apache TVM、MLIR）
- 有开源项目的所有权或贡献经验
你的基本薪资将根据你的所在地、经验和类似职位员工的薪资确定。基本薪资范围为184,000美元至287,500美元。你还将有资格获得股权和福利。
该职位的申请至少将持续到2026年7月18日。此职位为现有空缺。
NVIDIA在招聘过程中使用AI工具
查看英文原文
We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems software to accelerate for AI inference. As a member of the team, you'll develop libraries, code generators, and GPU kernel technologies for NVIDIA's hardware architecture. This means designing and building things like new abstractions, efficient attention kernel implementations, new LLM inference runtimes components, and kernel code generators to accelerate large language models, agents, and other high-impact AI workloads.
What you'll be doing:
- Innovating and developing new AI systems technologies for efficient inference
- Designing, implementing, and optimizing kernels for high impact AI workloads
- Designing and implementing extensible abstractions for LLM serving engines
- Building efficient just-in-time domain specific compilers and runtimes
- Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams
- Contributing to open source communities like FlashInfer, vLLM, and SGLang
What we need to see:
- Masters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); PhD are preferred
- 6+ years (academic/ industry) experience with ML/DL systems development preferable
- Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX, etc) and ideally inference engines and runtimes such as vLLM, SGLang, and MLC.
- Strong Python and C/C++ programming skills
- Strong experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, cuTile, Triton, or similar) with hands-on experience with Matrix Multiplication
Ways to stand out from the crowd:
- Background in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention)
- Expertise in inference engines like vLLM and SGLang
- Expertise in machine learning compilers (e.g. Apache TVM, MLIR)
- Open source project ownership or contributions
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until July 18, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas