数据工程师
Data Engineer
Movable Ink 通过数据驱动的内容生成和 AI 决策，为营销人员提供内容个性化扩展。全球最具创新力的品牌依赖 Movable Ink 来最大化收入、简化工作流程并提升营销敏捷性。Movable Ink 总部位于纽约市，拥有近 600 名员工，其业务运营遍布北美、中美洲、欧洲、澳大利亚和日本，为全球客户提供服务。
作为数据工程师，你将推动企业数据仓库的发展方向，与组织内各团队紧密合作以获取相关数据，并赋能团队基于数据做出业务决策。Movable Ink 每天处理数十亿次请求，收集大量活动数据。加入我们，帮助我们管理并理解我们正在摄入的海量数据！
职责：
- 设计、构建、测试、部署和维护端到端多源 ELT 流水线，同时优化成本并满足数据服务等级协议（SLA）
- 维护和扩展我们的数据仓库基础设施，以减少人工操作，提高性能，并降低事件发生的频率和严重程度
- 与数据平台、产品工程和分析团队协作，了解数据需求并交付可靠的数据产品
- 与其余的（站点可靠性工程）SRE 团队合作，确保我们服务的平稳持续交付
- 聚合、整合并整理事件数据与我们的内部业务系统，以支持关键业务决策
要求：
- 3 年以上数据工程师经验
- 具有列式/OLAP（联机分析处理）数据库在 PB 级别的实际操作经验
- 在数据流水线的生产化方面有成功经验，包括构建监控、警报、SLA 仪表盘和运行手册
- 在构建数据库管理和维护的工具及自动化方面有丰富经验
- 精通现代 ELT 工具（如 dbt、Airbyte、Flink）和编排平台（如 Airflow、Dagster）
- 对 Kimball 和银盘架构有深入的技术理解
- 具有某种或多种高级编程语言（如 Python、Java 和 SQL）的实际经验
- 具有敏捷软件开发经验
- 具有使用版本控制工具（如 git）的经验
- 具有在持续集成/持续交付（CI/CD）范式中工作的经验
- 具有
查看英文原文
Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most innovative brands rely on Movable Ink to maximize revenue, simplify workflow and boost marketing agility. Headquartered in New York City with close to 600 employees, Movable Ink serves its global client base with operations throughout North America, Central America, Europe, Australia, and Japan.
As a Data Engineer, you will help drive the direction of our Enterprise Data Warehouse, work hands-on with teammates across the organization to get access to relevant data, and empower teams to make data driven decisions about the direction of our business. Movable Ink collects campaign data resulting from Billions of requests served each day. Come and help us manage and make sense of the massive amount of data we’re ingesting!
Responsibilities:
- Design, build, test, deploy, and maintain end-to-end multi-source ELT pipelines while optimizing for costs and meeting data service level agreements (SLAs)
- Maintain and extend our Data Warehouse infrastructure to minimize manual work, increase performance, and decrease the frequency and severity of incidents
- Collaborate with the data platform, product engineering, and analytics teams to understand data needs and deliver reliable data products
- Work with the rest of the (Site Reliability Engineering) SRE team to ensure smooth, continued delivery of our service our business partners
- Aggregate, combine, and curate event data with our internal business systems to enable key business decisions
Qualifications:
- 3+ years experience as a Data Engineer
- Hands-on experience with columnar/OLAP (Online Analytical Processing) databases at petabyte scale
- Proven track record of operationalizing data pipelines, including building monitoring, alerting, SLA dashboards, and runbooks for production systems
- Strong experience building tooling and automation for database management and maintenance
- Expertise with modern ELT Tools (e.g. dbt, Airbyte, Flink) and orchestration platforms (e.g. Airflow, Dagster)
- Deep, technical understanding of Kimball and medallion architectures
- Experience with one or more high level programming languages (e.g. Python, Java, and SQL)
- Experience with Agile software development
- Experience working with version control tools (e.g. git)
- Experience working within the Continuous Integration / Continuous Delivery (CI/CD) paradigm
- Experience with Infrastructure-as-Code (IaC) tools such as Terraform, CloudFormation, or similar
How to Stand Out:
- Experience with implementing APIs, Reverse ETL, and data contracts
- Significant experience with AWS & AWS Managed Services (e.g Redshift, Aurora, Airflow, Flink)
- Familiarity with data visualization tools (e.g. Tableau)
- Experience with managing data lakes with open-source file formats (e.g. Iceberg)
The base pay range for this position is $125,000-$170,000/year, which can include additional bonus depending on the position ultimately offered, in addition to a full range of medical, financial, and/or other benefits. The base pay offered may vary depending on job-related knowledge, skills, and experience.
Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.
We welcome and employ people regardless of race, color, gender identity or expression, religion, genetic information, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, ethnicity, family or marital status, physical and mental ability, political affiliation, disability, Veteran status, or other protected characteristics. We are proud to be an equal opportunity employer.
Originally posted on Himalayas