站点可靠性工程师，推理基础设施
Site Reliability Engineer, Inference Infrastructure
我们是谁？
Cohere 是一家以安全为先的企业人工智能公司，处于行业领先地位。我们构建前沿的基础人工智能模型和端到端产品，旨在解决现实世界中的业务问题。
我们正在为正在构建人工智能系统的公司训练和部署前沿模型。我们认为我们的工作对人工智能的广泛应用至关重要，我们正在寻找希望参与其中的人才。
我们对所构建的产品充满热情。我们每个人都负责提升模型的能力，并为客户创造价值。Cohere 是一个由研究人员、工程师、设计师等组成的团队，他们对各自的专业充满热情。
我们是一家总部位于多伦多的全球科技公司，在伦敦、纽约市、旧金山、蒙特利尔、巴黎、柏林和首尔设有主要办公室。加入我们吧！
为什么选择这个职位？
你是否热衷于构建高性能、可扩展且可靠的机器学习系统？你是否希望参与定义和构建下一代人工智能平台，以支持先进的自然语言处理应用？我们正在寻找一名站点可靠性工程师，加入 Cohere 的模型服务团队。该团队负责开发、部署和运营通过易于使用的 API 端点交付 Cohere 大型语言模型的人工智能平台。在这个职位上，你将与多个团队密切合作，将优化的自然语言处理模型部署到低延迟、高吞吐量和高可用性的环境中。你还将有机会与客户互动，并根据他们的具体需求创建定制化部署。
作为站点可靠性工程师，你将：
- 构建自助服务系统，自动化管理、部署和运营服务。
- 这包括我们用于支持语言模型部署的自定义 Kubernetes 运算符。
- 自动化环境的可观测性和弹性。使所有开发人员能够排查和解决问题。
- 采取必要措施确保达到定义的 SLO（服务级别目标），包括参与值班轮班。
- 与内部开发人员建立牢固的关系，并根据他们的反馈影响基础设施团队的路线图。
- 通过知识共享和积极的评审流程来提升团队能力。
如果你具备以下条件，可能会是一个合适的人选：
- 5 年以上在大规模生产环境中运行基础设施的工程经验
- 具有使用 Kubernetes 和 GPU 工作负载设计大型高可用分布式系统的经验
查看英文原文
Who are we?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
WHY THIS ROLE?
Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for a Site Reliability Engineer to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
As a Site Reliability Engineer you will:
- Build self-service systems that automate managing, deploying and operating services.
- This includes our custom Kubernetes operators that support language model deployments.
- Automate environment observability and resilience. Enable all developers to troubleshoot and resolve problems.
- Take steps required to ensure we hit defined SLOs, including participation in an on-call rotation.
- Build strong relationships with internal developers and influence the Infrastructure team’s roadmap based on their feedback.
- Develop our team through knowledge sharing and an active review process.
You may be a good fit if you have:
- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience with Kubernetes dev and production coding and support
- Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Experience in compute/storage/network resource and cost management
- Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork
- The grit and adaptability to solve complex technical challenges that evolve day to day
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference.
- Strong understanding or working experience with distributed systems.
- Experience in Golang, C++ or other languages designed for high-performance scalable servers).
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.