软件工程师 - 专用推理
Software Engineer - Dedicated Inference
ABOUT BASETEN
Baseten 为全球最具活力的 AI 公司提供关键任务的推理服务,例如 Cursor、Notion、OpenEvidence、Abridge、Clay、Gamma 和 Writer。通过结合应用 AI 研究、灵活的基础架构和无缝的开发者工具,我们使处于 AI 前沿的公司能够将最前沿的模型投入生产。我们正在快速成长,并最近完成了 15 亿美元的 F 轮融资 https://www.baseten.co/blog/announcing-our-series-f/,由 Altimeter Capital、Conviction Partners 和 Spark Capital 领投。加入我们,帮助构建工程师用于部署 AI 产品的平台。
THE ROLE
作为 Dedicated Inference 团队的工程师,你将塑造部署和运行 AI 工作负载的最先进的开发者体验。从 CLI 和 SDK 到 API、可观测性和调试流程,你将构建客户每天依赖的工具来管理关键任务的推理部署。
在 Baseten,Dedicated Inference 团队拥有最广泛和最可见的工作范围。该团队经常处于新产品开发的最前沿,为工程师提供了塑造我们最重要客户体验的机会。
EXAMPLE INITIATIVES
你将作为 Dedicated Inference 团队的一员,参与以下类型的项目:
- 多组件工作流的 Chains https://www.baseten.co/blog/baseten-chains-explained/
- 异步推理 https://www.baseten.co/blog/using-asynchronous-inference-in-production/
- 前沿模型的 Model APIs https://www.baseten.co/products/model-apis/
- 专为生产推理设计的模型训练 https://www.baseten.co/products/training/
RESPONSIBILITIES
- 为团队实现新功能和产品
- 设计符合人体工学的 API 和抽象层来解决客户问题
- 快速修复 bug 并解决客户问题
- 在整个技术栈中工作 - 无论你从哪里开始,最终都会接触到 React 组件和 Kubernetes Pod
- 与产品和前向部署工程团队紧密合作,开发并推动新的产品想法
REQUIREMENTS
- 计算机科学或相关领域的学士学位或更高学历
- 精通一种或多种流行的编程或脚本语言;具备 Python、Go 或 JavaScript 编程能力者优先
- 熟悉 Web 应用和数据库
- 对产品有良好的品味,尤其是面向开发者的工具
- 对 ML/AI 基础设施感兴趣,并愿意学习
查看英文原文
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage mission-critical inference deployments.
Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Dedicated Inference team:
- Chains for multi-component workflows https://www.baseten.co/blog/baseten-chains-explained/
- Asynchronous inference https://www.baseten.co/blog/using-asynchronous-inference-in-production/
- Model APIs for frontier models https://www.baseten.co/products/model-apis/
- Model training built for production inference https://www.baseten.co/products/training/
RESPONSIBILITIES
- Implement new features and products for the team
- Design ergonomic APIs and abstractions to solve customer problems
- Fix bugs and resolve customer issues with urgency
- Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
- Work closely with the product and forward deployed engineering teams to develop and drive new product ideas
REQUIREMENTS
- Bachelor's degree or higher in Computer Science or related field
- Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or JavaScript proficiency is a plus
- Familiarity with web applications & databases
- Good taste in product, particularly developer-oriented tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).