数据工程师
Data Engineer
职位描述
作为Analytics Data Engineering团队的数据工程师，你将构建和运营其他Dropbox团队用来了解其产品和业务的数据管道和数据模型。你将全程负责范围明确的管道——设计、构建、测试、发布、监控——在高级工程师的协助下处理更复杂的架构决策。你的工作为数据科学、产品和公司管理层使用的数据集市和关键指标提供支持，因此你所构建的内容质量会很快显现出来。这是一个以构建为导向的团队，使用现代技术栈，而不是维护型岗位，是成长为能够负责整个数据领域的工程师的理想之地。
我们的工程职业发展框架对所有公司外部人员开放，描述了我们在各个职业阶段对工程师的期望。请查看我们关于此主题的博客文章和其他内容。
职责
- 构建和维护填充公司数据模型的Spark和SparkSQL作业
- 全程负责范围明确的管道，从需求到部署、监控和迭代
- 参与数据质量框架、测试和数据血缘追踪工具的开发
- 与数据科学家、分析师、产品经理和工程师合作，将数据需求转化为持久的数据模型
- 扩展支持跨产品定期报告和分析的数据集市和数据模型
- 提高现有管道、仪表板和框架的可靠性和成本效率
- 参与工作时间内的值班轮班，并帮助改进操作手册和警报系统
Dropbox的许多团队都通过值班轮班运行服务，这意味着在核心和非核心工作时间都需要保持可用。如果一个团队有值班轮班，该团队的所有工程师都需参与轮班，这是雇佣的一部分。申请人可要求了解申请岗位的值班轮班详情。
要求
- 2年以上Spark、Python、Java、C++或Scala的开发经验
- 2年以上SQL经验，包括查询性能调优
- 2年以上模式设计和维度数据建模经验
- 有构建和维护他人依赖的生产数据管道的经验
- 有使用云数据湖或湖仓平台的经验，Databricks优先
- 与非技术人员清晰地书面和口头沟通，并有早期寻求帮助和反馈的记录
- 计算机科学学士学位或相关专业
查看英文原文
Role Description
As a Data Engineer on Analytics Data Engineering, you will build and operate the pipelines and data models the rest of Dropbox relies on to understand its products and its business. You will own well-scoped pipelines end to end — design, build, test, ship, monitor — with senior engineers alongside you for the harder architectural calls. Your work feeds the datamarts and KPIs used by data science, product, and company leadership, so the quality of what you build is visible quickly. This is a build-oriented team on a modern stack rather than a maintenance role, and a strong place to develop into an engineer who can own a full data domain.
Our Engineering Career Framework is viewable by anyone outside the company and describes what’s expected for our engineers at each of our career levels. Check out our blog post on this topic and more here.
Responsibilities
- Build and maintain Spark and SparkSQL jobs that populate company data models
- Own well-scoped pipelines end to end, from requirements through deployment, monitoring, and iteration
- Contribute to data quality frameworks, testing, and data lineage instrumentation
- Partner with data scientists, analysts, product managers, and engineers to turn data needs into durable models
- Extend datamarts and data models supporting recurring reporting and analysis across products
- Improve the reliability and cost efficiency of existing pipelines, dashboards, and frameworks
- Participate in a business-hours on-call rotation and help improve runbooks and alerting
Many teams at Dropbox run Services with on-call rotations, which entails being available for calls during both core and non-core business hours. If a team has an on-call rotation, all engineers on the team are expected to participate in the rotation as part of their employment. Applicants are encouraged to ask for more details of the rotations to which the applicant is applying.
Requirements
- 2+ years of development experience in Spark, Python, Java, C++, or Scala
- 2+ years of SQL experience, including query performance tuning
- 2+ years of experience with schema design and dimensional data modeling
- Experience building and maintaining production data pipelines that others depend on
- Working exposure to a cloud data lake or lakehouse platform, Databricks preferred
- Clear written and verbal communication with non-engineering partners, and a track record of asking for help and feedback early
- BS in Computer Science or a related technical field involving coding (e.g. physics or mathematics), or equivalent technical experience
Preferred Qualifications
- 4+ years of SQL experience
- Experience with medallion architectures and incremental data modeling patterns
- Experience with Airflow or a similar orchestration framework
- Exposure to data quality monitoring using Monte Carlo or similar tools
- Exposure to streaming architectures (Kafka, Kinesis, Structured Streaming)
Durable Skills
AI fluency means using these tools to amplify human judgment, not replace it. We believe people with these skills will thrive as work and technology continue to evolve:
- Awareness: Understand yourself and others.
- Judgment: Evaluate information and make decisions in complex situations.
- Adaptability: Learn, adjust, and stay effective through change.
- Connection: Communicate, collaborate, and build trust.
To learn more about why these skills matter and what the data shows about thriving through change, read this blog post from our Chief People Officer, Melanie Rosenwasser.
Compensation
US Zone 1
This role is not available in Zone 1
US Zone 2
$120,900—$163,500 USD
US Zone 3
$107,400—$145,400 USD