Data Engineer
作为巴克斯特计划公司的数据工程师，你将在构建和发展我们的数据湖平台中发挥关键作用，支持分析和基于数据的产品。你将设计并运营可靠的生产级数据管道和编制数据集使用现代 AWS 服务和 Python.本职位侧重于数据建模，数据质量和近实时摄入以确保可信的，BI 准备的数据。你将与工程师和利益相关者密切合作，同时为建筑，自动化和最佳做法做出贡献。你所做的 · 开发增量/微批次管道，支持 CDC 近实时摄入 (AWS DMS) ·设计 BI 友好的数据模型 （星际方案）和管理计划 · 在 Python 中构建 ETL/ELT （极点）,并通过 Athena 和/或 Redshift 进行服务/查询 ·实现数据质量+可观测性 （新鲜度，完整性，重复式，图案漂移，异常）·使用 Airflow 和 AWS 本土工具 （例如：功能）•为 CI/CD,IaC,建筑讨论以及最佳做法做贡献 •我们正在寻找什么 • 4年建立和运营生产数据管道 • Python （async/aws 是加大的）强大的竞争：• ,雅典娜，红转，湖泊形成，云视频，DMS,兰布达，步骤函数，SQS/SNS,ECS,dynamoDB （+云形式）•与湖泊表 （德尔塔或类似）,方案演变，分区，紧缩，升级/合并的经验 •数据建模技能 （星际计划）和对测试和数据质量的承诺 •我们提供的产品 （监控/解决问题）AWS DMS 运行经验 ·竞争性薪水 （55000-65000欧元）·在友好而多样化的团队工作 ·私人健康保险 ·健身房会员 ·学习机会 ·灵活的优势 ·团队活动 ·免费办公零食和饮料 贝克斯特计划署致力于创造多元化的环境，并自豪成为平等机会的雇主。所有合格申请者将得到就业考虑不论种族，颜色，宗教，性别，性别身份或表达，性取向，国家起源，遗传学，残疾，年龄或退伍军人地位。贝克斯特规划公司也致力于遵守公民和移民状态的所有公平就业实践。原始地发布在喜马拉雅山
查看英文原文
As a Data Engineer at Baxter Planning you will play a key role in building and evolving our data lake platform, supporting analytics and data-driven products across the business. You will design and operate reliable, production-grade data pipelines and curated datasets using modern AWS services and Python. This role focuses on data modeling, data quality, and near-real-time ingestion to ensure trustworthy, BI-ready data. You will work closely with engineers and stakeholders while contributing to architecture, automation, and best practices.
What you’ll do
- Build the data-serving layer: curated datasets, marts, and product-ready tables
- Develop incremental / micro-batch pipelines and support CDC near-real-time ingestion (AWS DMS)
- Design BI-friendly data models (star schema) and manage schemas
- Build ETL/ELT in Python (Polars) and serve/query via Athena and/or Redshift
- Implement data quality + observability (freshness, completeness, duplicates, schema drift, anomalies)
- Orchestrate with Airflow and AWS-native tools (e.g., Step Functions)
- Contribute to CI/CD, IaC, architecture discussions, and best practices
What we’re looking for
• 4+ years building and operating production data pipelines
• Strong Python (async/concurrency is a plus)
• Strong AWS across services like: S3, Glue, Athena, Redshift, Lake Formation, CloudWatch, DMS, Lambda, Step Functions, SQS/SNS, ECS, DynamoDB (+ CloudFormation)
• Experience with lakehouse tables (Delta or similar), schema evolution, partitioning, compaction, upserts/merge
• Solid data modeling skills (star schema) and commitment to testing & data quality
• Experience running AWS DMS in production (monitoring/troubleshooting)
What we offer
- A competitive salary (€ 55000 - € 65000)
- Work in a friendly and diverse team
- private health insurance
- gym membership
- learning opportunities
- flexible benefits
- team events
- free office snacks and drinks
Baxter Planning is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. Baxter Planning is also committed to compliance with all fair employment practices regarding citizenship and immigration status.Originally posted on Himalayas