机器学习基础设施工程师
Machine Learning Infrastructure Engineer
机器学习基础设施工程师 – 远程
Bright Vision Technologies 是一家技术咨询和软件开发公司，为美国各地提供云、AI、数据和企业解决方案。
这是加入一家知名且备受尊敬的组织的绝佳机会，提供巨大的职业发展潜力。
职位名称：机器学习基础设施工程师
地点：100% 远程（美国）
职位类型：全职，直接 W2
薪资范围：每年 105,000–143,000 美元
所需经验：6 年以上
赞助：美国公民、绿卡持有者、EAD 持有者以及 H-1B 转移候选人可申请。我们无法为此职位提供新的 H-1B 签证申请。
职位简介
我们正在寻找一名机器学习基础设施工程师，负责设计、构建和运营高性能、高可靠性的推理平台，用于在生产环境中部署大型机器学习模型。该职位专注于 AI 部署的系统工程方面，包括请求路由、批处理、缓存、自动扩展、GPU 利用率以及跨多样化模型工作负载的端到端可观测性。理想的候选人具备强大的分布式系统和性能工程专业知识，有大规模部署服务系统的经验，并理解机器学习推理中延迟、吞吐量、成本和质量之间的权衡。
所需资格
· 计算机科学或相关领域的学士或硕士学位。
- 在分布式系统、基础设施或机器学习平台工程方面有六年或更多经验。
- 精通 Python 和一种系统语言，如 Go、Rust 或 C++。
- 在生产环境中操作高吞吐、低延迟服务有丰富经验。
- 有 LLM 或大型模型推理框架（如 vLLM 或 TensorRT-LLM）的实际经验。
- 对 GPU 架构、内存层次结构和加速器利用有深入理解。
- 熟悉 Kubernetes、自动扩展和现代云平台。
- 有使用可观测性堆栈（包括指标、追踪和结构化日志）的经验。
- 具备性能工程和容量规划的基础知识。
- 具备良好的沟通能力和事件响应技能。
优先资格
· 参与模型推理基础设施的开源贡献。
- 有多区域或全球分布的 AI 推理经验。
- 熟悉模型量化、蒸馏和压缩技术。
- 了解 AI 工作负载的 FinOps 以及成本效率方法
查看英文原文
Machine Learning Infrastructure Engineer – Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Machine Learning Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $105,000–$143,000 Annually
Experience Required: 6+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary
We are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads. The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving.
Required Qualifications
· Bachelor’s or Master’s degree in Computer Science or a related field.
- Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
- Strong proficiency in Python and a systems language such as Go, Rust, or C++.
- Deep experience operating high-throughput, low-latency services in production.
- Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
- Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
- Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
- Experience with observability stacks including metrics, tracing, and structured logging.
- Solid grounding in performance engineering and capacity planning.
- Strong communication and incident response skills.
Preferred Qualifications
· Open-source contributions to model serving infrastructure.
- Experience with multi-region or globally distributed AI serving.
- Familiarity with model quantization, distillation, and compression techniques.
- Exposure to FinOps for AI workloads and cost-efficient serving design.
- Experience supporting external-facing AI APIs at scale.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to
Vision Technologies is an Equal Opportunity Employer.Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Originally posted on Himalayas