资深软件工程师，推理基础设施
Staff Software Engineer, Inference Infrastructure
我们是谁？
Cohere 是一家以安全为首要任务的企业人工智能公司。我们构建前沿的基础 AI 模型和端到端产品，旨在解决现实世界中的业务问题。
我们正在为正在构建 AI 系统的企业训练和部署前沿模型。我们认为我们的工作对 AI 的广泛应用至关重要，我们正在寻找希望成为其中一员的人才。
我们对所构建的东西充满热情。我们每个人都负责提升模型的能力以及为客户创造的价值。Cohere 是一个由研究人员、工程师、设计师等组成的团队，他们对各自的专业充满热情。
我们是一家总部位于多伦多的全球科技公司，在伦敦、纽约市、旧金山、蒙特利尔、巴黎、柏林和首尔设有主要办公室。加入我们吧！
为什么选择这个职位？
你是否热衷于构建高性能、可扩展且可靠的机器学习系统？你是否想帮助定义和构建下一代 AI 平台，以支持先进的自然语言处理（NLP）应用？我们正在寻找技术员工加入 Cohere 的模型服务团队。该团队负责开发、部署和运营通过易于使用的 API 端点交付 Cohere 大型语言模型的 AI 平台。在这个职位上，你将与多个团队紧密合作，将优化的 NLP 模型部署到低延迟、高吞吐量和高可用性的环境中。你还将有机会与客户互动，并创建定制化部署以满足他们的特定需求。
如果你具备以下条件，可能会是一个合适的人选：
- 5年以上在大规模生产基础设施上工作的工程经验
- 具有使用 Kubernetes 设计大型、高可用分布式系统的经验，以及在这些集群上运行 GPU 工作负载的经验
- 具有 Kubernetes 开发和生产环境的编码及支持经验
- 具有 GCP、Azure、AWS、OCI、多云本地/混合部署的经验
- 在复杂基于 Linux 的计算环境中进行设计、部署、支持和故障排除的经验
- 在计算/存储/网络资源和成本管理方面的经验
- 优秀的协作和故障排除技能，用于构建关键任务系统，确保平稳运行和高效团队合作
- 具备毅力和适应能力，以解决每天不断变化的复杂技术挑战
- 熟悉加速器的计算特性
查看英文原文
Who are we?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
WHY THIS ROLE?
Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for Members of Technical Staff to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
You may be a good fit if you have:
- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience with Kubernetes dev and production coding and support
- Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Experience in compute/storage/network resource and cost management
- Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork
- The grit and adaptability to solve complex technical challenges that evolve day to day
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference.
- Strong understanding or working experience with distributed systems.
- Experience in Golang, C++ or other languages designed for high-performance scalable servers).
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.