数据工程师
Data Engineer
Sonatype 是软件供应链安全公司。我们提供全球最优秀的端到端软件供应链安全解决方案,结合针对恶意开源代码的唯一主动防护、唯一的企业级 SBOM 管理以及领先的开源依赖管理平台。这使企业能够大规模创建和维护安全、高质量且具有创新性的软件。
作为 Nexus Repository 的创始人和 Maven Central 的管理者,世界上最大的 Java 开源软件仓库,我们是软件先驱,我们的开源专业知识无可匹敌。我们以无与伦比的承诺,致力于构建更快、更安全的软件,并利用人工智能和数据智能来降低风险、提高效率并推动强大的软件开发。
超过 2000 家组织,包括 70% 的财富 100 强企业以及 1500 万名软件开发者,依赖 Sonatype 来优化他们的软件供应链。
你将负责:
构建和维护可靠的数据管道和 ETL/ELT 工作流
为分析和内部工具开发和优化数据模型
与团队成员合作交付干净、可信的数据集
支持核心数据平台工具如 Spark 和 AWS(S3、SNS、SQS、ECS/Fargate、EMR)
监控数据管道的质量、性能和可靠性
编写清晰的文档并参与测试覆盖率和 CI/CD 流程
帮助塑造我们的数据湖仓架构和平台路线图
你将具备:
计算机科学、工程或相关领域的学士学位,或同等的实际经验
2–4 年数据工程或后端数据相关岗位的经验
扎实的 Java、Scala 或其他后端编程语言技能
Python(PySpark/pandas)技能
熟悉 SQL 和分布式数据系统(如 Spark、Kafka、SQS)
了解 NoSQL 存储如 Cassandra、HBase 或类似系统
理解分析和报告的数据建模
精通英语,具备良好的沟通能力——能够向非工程师解释或演示工作
自我驱动——能在很少指导的情况下掌握新技术和框架
有条理地调试;能将复杂问题分解为较小步骤
乐于接受反馈——通过代码审查进行迭代和改进
在日常工作中使用 AI 辅助工程工具(如 Claude Code、Codex、Cursor 等)
可靠的互联网连接以支持视频、音频和屏幕共享
如果具备以下条件会更好:
查看英文原文
Sonatype is the software supply chain security company. We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open source, the only enterprise grade SBOM management and the leading open source dependency management platform. This empowers enterprises to create and maintain secure, quality, and innovative software at scale.
As founders of Nexus Repository and stewards of Maven Central, the world’s largest repository of Java open-source software, we are software pioneers and our open source expertise is unmatched. We empower innovation with an unparalleled commitment to build faster, safer software and harness AI and data intelligence to mitigate risk, maximize efficiencies, and drive powerful software development.
More than 2,000 organizations, including 70% of the Fortune 100 and 15 million software developers, rely on Sonatype to optimize their software supply chains.
What you'll do:
Build and maintain reliable data pipelines and ETL/ELT workflows
Develop and optimize data models for analytics and internal tools
Work with team members to deliver clean, trusted datasets
Support core data platform tools like Spark and AWS (S3, SNS, SQS, ECS/Fargate, EMR)
Monitor data pipelines for quality, performance, and reliability
Write clear documentation and contribute to test coverage and CI/CD processes
Help shape our data lakehouse architecture and platform roadmap
What you'll bring:
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
2–4 years of experience in data engineering or a backend data-related role
Strong skills in Java, Scala, or another backend programming language
Python (PySpark/pandas) skills
Experience with SQL and distributed data systems (e.g., Spark, Kafka, SQS)
Familiarity with NoSQL stores like Cassandra, HBase, or similar
Understanding of data modeling for analytics and reporting
Proficient in English with strong communication skills — able to explain or demo work to non-engineers
Self-driven — picks up new technologies and frameworks with little guidance
Debugs methodically; breaks complex problems into smaller steps
Open to feedback — iterates and improves through code reviews
Uses AI-assisted engineering tools (Claude Code, Codex, Cursor, etc.) as part of daily workflow
Reliable internet connection to sustain video, audio, and screen sharing
It'd be great if you had:
Experience with dbt, Databricks, or real-time data pipelines
Familiarity with cloud infrastructure tools like Terraform or CloudFormation
Interest in data governance, ML pipelines, or compliance standards
Personal projects or open source contributions demonstrating initiative
Why you'll love working here:
Work on data that supports meaningful software security outcomes
Modern tools in a cloud-first, open-source-friendly environment
A team that values clarity, learning, and autonomy
#LI-AL1
At Sonatype, we value diversity and inclusivity. We offer perks such as parental leave, diversity and inclusion working groups, and flexible working practices to allow our employees to show up as their whole selves. We are an equal-opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. If you have a disability or special need that requires accommodation, please do not hesitate to let us know.