产品经理 - AI推理与模型服务
Product Manager - AI Inference & Model Serving
关于 Mirantis
Mirantis 是一家 Kubernetes 原生的 AI 基础设施公司,使组织能够构建和运营可扩展、安全且自主的基础设施,用于现代 AI、机器学习和数据密集型应用。通过将开源创新与对 Kubernetes 编排的深入专业知识相结合,Mirantis 使平台工程团队能够在任何环境中——本地部署、云中、边缘或自主数据中心——交付可组合、生产就绪的开发者平台。随着企业应对日益复杂的 AI 驱动工作负载,Mirantis 提供了自动化、GPU 编排和策略驱动的控制,以自信和敏捷的方式管理基础设施。Mirantis 致力于开放标准并避免锁定,确保客户对其基础设施战略拥有完全控制权。
职位概述
Mirantis 正在寻找一位具有商业驱动力、深度技术背景的产品经理,负责 k0rdent AI 的 AI 推理和模型服务,这是我们的 GPU 基础设施和分布式 AI 工作负载的控制平面。该职位位于 AI 推理、云原生基础设施、分布式系统和性能工程的交汇点。您将定义 NeoClouds 和企业客户如何部署、扩展和操作生产推理服务,同时从底层 GPU、网络和存储基础设施中提取最大性能。
该职位负责推理产品在本地部署、云和边缘环境中的产品策略和解决方案开发。范围包括无服务器推理、专用端点、工作负载放置、自动扩展、路由、生命周期管理、可观测性以及全栈性能优化。该人员将定义客户如何大规模运行生产模型服务工作负载,同时提高延迟、吞吐量、利用率、可靠性、成本和操作控制。
理想的候选人具备高性能基础设施产品的经验,并了解生产系统在真实负载下的行为。他们应能跨整个技术栈进行推理,识别性能瓶颈,评估系统设计权衡,并将技术洞察转化为清晰的产品需求、架构方向和面向客户的解决方案。
职责
· 负责推理和模型服务的产品策略、路线图和生命周期,包括无服务器推理、专用端点、自动扩展、路由、K
查看英文原文
About Mirantis
Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.
Job Summary
Mirantis is looking for a commercially driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for GPU infrastructure and distributed AI workloads. This role sits at the intersection of AI inference, cloud-native infrastructure, distributed systems, and performance engineering. You will define how NeoClouds and Enterprise customers deploy, scale, and operate production inference services while extracting maximum performance from the underlying GPU, network, and storage infrastructure.
This role owns product strategy and solution development for inference products across on-premises, cloud, and edge environments. The scope includes serverless inference, dedicated endpoints, workload placement, autoscaling, routing, lifecycle management, observability, and full-stack performance optimization. This person will define how customers run production model-serving workloads at scale while improving latency, throughput, utilization, reliability, cost, and operational control.
The ideal candidate has experience with high-performance infrastructure products and understands how production systems behave under real-world load. They should be comfortable reasoning across the full stack, identifying performance bottlenecks, evaluating system design trade-offs, and translating technical insight into clear product requirements, architecture direction, and customer-facing solutions.
Responsibilities
· Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference, dedicated endpoints, autoscaling, routing, KV cache management, and the related observability
· Lead deep technical discovery with NeoClouds, sovereign clouds, and enterprise platform teams, and translate findings into prioritized requirements and architecture direction
· Partner with engineering on system design trade-offs across runtime integration, GPU scheduling, network, storage, and serving topology, including disaggregated serving and multi-model serving
· Define positioning grounded in measurable outcomes: latency distributions, throughput per GPU, utilization, tail reliability, and cost per tokens
· Drive go-to-market execution: pricing and packaging, reference architectures, sizing guides, PoC playbooks, and direct engagement with customers, analysts, and ecosystem partners
- 7+ years in product management, technical product management, or a senior technical role owning AI/ML and inference product(s)
- Strong understanding of production AI inference, including model serving, serverless execution, dedicated endpoints, autoscaling, routing, workload placement, observability, and reliability
- Proven capability to reason about performance trade-offs across GPU, network, storage, orchestration, and runtime layers, and to translate low-level technical capability into business value such as TTFT, throughput per GPU, and TCO
- Working knowledge of modern inference runtimes (vLLM, SGLang, TensorRT-LLM, Dynamo, Triton) and the optimization patterns that matter in production: continuous batching, KV cache management, cold starts, prefill versus decode, disaggregated serving, and multi-model serving
- Credibility with engineering leaders and infrastructure operators, including comfort in production architecture reviews and technical commercial conversations with platform engineering buyers
- Why you’ll love Mirantis
- Build the token factory foundation for the AI cloud era, working directly with leading GPU cloud operators, NeoClouds, sovereign clouds, and AI-first enterprises
- Collaborate with a world-class, distributed team committed to openness and technical excellence
- Shape the product narrative and influence go-to-market success
What does Mirantis offer you?
· Work with an established Silicon Valley leader in the cloud infrastructure industry.
· Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
· Be a part of cutting-edge, open-source innovation.
· Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
· Professional development and training.
· Attend conferences and working groups.
· Customized workstation (macOS, Windows).
· A competitive compensation package with strong benefits plan and stock options.
It is understood that Mirantis, Inc. may use automated decision-making technology (ADMT) for specific employment-related decisions. Opting out of ADMT use is requested for decisions about evaluation and review connected with the specific employment decision for the position applied for. You also have the right to appeal any decisions made by ADMT by sending your request to isamoylova@mirantis.com
By submitting your resume, you consent to the processing and storage of your personal data in accordance with applicable data protection laws, for the purposes of considering your application for current and future job opportunities.
#remote
We are a Leader for Container Management in G2 (#2 after AWS)!