高级数据工程师
Senior Data Engineer
关于Nebius:
Nebius正在引领全球AI经济的云基础设施新纪元。我们构建了一个全栈AI云平台,支持开发者和企业从数据和模型训练到生产部署的全流程,而无需承担构建大型内部AI/ML基础设施的成本和复杂性。
由工程师打造,为工程师服务。从大规模GPU编排到推理优化,我们在计算、存储、网络和应用AI领域掌握着最困难的问题。
在纳斯达克上市(NBIS),总部位于阿姆斯特丹,我们在全球拥有业务覆盖,欧洲、英国、北美和以色列设有研发中心。我们的团队超过1500人,包括数百名在硬件、软件和AI研发方面具有深厚专业知识的工程师。
职位描述
数据工程团队构建并运营为Nebius各业务提供支持的数据平台,包括分析、商业智能、运营报告和数据驱动的产品。我们从内部和外部系统中获取数据,开发可靠的转换管道和数据模型,并为业务和产品团队提供可信的数据集。
我们正在寻找一名高级数据工程师,负责我们数据平台的重要部分,并端到端交付复杂的数据产品。你将把模糊的业务需求转化为务实的技术解决方案,做出架构和实现上的权衡,并提升我们数据生态系统的可靠性、可扩展性和可用性。
你将与产品、平台和业务团队紧密合作,帮助他们有效利用数据,同时确保随着Nebius的发展,我们的系统保持可维护和可信。
你的职责:
- 负责复杂数据管道、数据集和平台组件的设计、交付和运营。
- 将业务和分析需求转化为可扩展的数据模型、可靠的数据产品和清晰的技术方案。
- 设计和演进适用于大规模工作负载的数据架构、存储、处理和编排模式。
- 提升关键数据集和管道的数据质量、可观测性、血缘关系和事件响应能力。
- 调查并解决生产环境中复杂的性能、可靠性和数据正确性问题。
- 建立可重用的工具、规范和自动化流程,以提高工程效率并降低运营风险。
- 与产品团队和业务利益相关者合作,定义数据契约、优先级和成功标准。
- 参与技术方向的制定
查看英文原文
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
The role
The Data Engineering team builds and operates the data platform that powers analytics, business intelligence, operational reporting, and data-driven products across Nebius. We ingest data from internal and external systems, develop reliable transformation pipelines and data models, and make trusted datasets available to business and product teams.
We are looking for a Senior Data Engineer to own substantial parts of our data platform and deliver complex data products end to end. You will turn ambiguous business needs into pragmatic technical solutions, make architecture and implementation trade-offs, and improve the reliability, scalability, and usability of our data ecosystem.
You will work closely with product, platform, and business teams, helping them use data effectively while ensuring that our systems remain maintainable and trustworthy as Nebius grows.
Your responsibilities:
- Own the design, delivery, and operation of complex data pipelines, datasets, and platform components.
- Translate business and analytical requirements into scalable data models, reliable data products, and clear technical plans.
- Design and evolve data architecture, storage, processing, and orchestration patterns for large-scale workloads.
- Improve data quality, observability, lineage, and incident response for critical datasets and pipelines.
- Investigate and resolve challenging performance, reliability, and data-correctness issues in production.
- Establish reusable tools, conventions, and automation that improve engineering productivity and reduce operational risk.
- Work with product teams and business stakeholders to define data contracts, priorities, and success criteria.
- Contribute to technical direction through design reviews, thoughtful trade-offs, and documentation.
- Support and mentor other engineers through reviews, pairing, and knowledge sharing.
- Participate in the on-call rotation and take ownership of improving the operational health of the systems you support.
Must-haves:
- 5+ years of experience in data engineering, backend engineering, or a related role; or equivalent experience delivering and operating production data systems.
- Proven experience independently delivering complex data pipelines or data-platform capabilities from problem definition through production operation.
- Strong Python and SQL skills, including writing maintainable production code and optimizing non-trivial queries.
- Hands-on experience with workflow orchestration tools such as Airflow, Prefect, or Dagster.
- Strong understanding of data modeling, including designing maintainable analytical models and data contracts for multiple consumers.
- Solid knowledge of data architectures and storage systems, including the trade-offs between different processing and storage approaches.
- Experience designing for reliability: testing, monitoring, data-quality validation, alerting, debugging, and incident resolution.
- Ability to make technical decisions under ambiguity, explain trade-offs clearly, and collaborate effectively with engineers and non-technical stakeholder
Nice-to-haves:
- Experience with real-time or event-driven data platforms and streaming technologies.
- Experience building or operating cloud-native services with Docker and Kubernetes.
- Familiarity with Infrastructure as Code, particularly Terraform.
- Experience with data governance, access control, privacy, and compliance requirements such as GDPR or SOC 2.
- Experience with data observability and quality tools or frameworks, such as Great Expectations.
- Experience improving engineering standards through shared libraries, platform tooling, technical documentation, or mentoring.
We conduct coding interviews as part of the process.
Benefits & Perks:
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
What's it like to work at Nebius:
Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI
Equal Opportunity Statement:
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.