数据工程师
Data Engineers
Data Engineer
职位概述
我们正在寻找一位专业的数据工程师，负责设计、优化和维护支撑我们BI环境的数据架构。
该职位专注于构建可扩展的BigQuery数据集市，优化数据模型，并确保可靠的数据流水线以支持分析和报告。
理想的候选人具备云数据仓库、数据建模以及构建可分析数据集的经验，这些数据集能够实现高效的BI使用。
主要职责
1. 数据架构与工程
- 设计、构建和维护用于BI报告的BigQuery数据集市和分析表。
- 开发可扩展的数据模型，包括星型模式、雪花模式和反范式模型。
- 优化云数据仓库中的查询性能和存储效率。
- 与BI团队合作，确保数据集符合语义模型和仪表板的要求。
2. 数据流水线与转换
- 构建和维护数据流水线，用于数据摄取、转换和加载到分析环境中。
- 使用SQL或dbt等框架实现转换流程。
- 确保数据质量、验证和数据集的一致性。
3. 数据治理与性能
- 维护数据标准、命名规范和适当的文档。
- 实施治理实践，包括模式管理和版本控制。
- 监控并排查流水线故障和数据不一致问题。
4. 与BI团队协作
- 与BI专家紧密合作，确保数据集满足语义层需求。
- 提供优化后的数据集，减少在BI工具中进行复杂转换的需求。
所需资格
- 3年以上数据工程或分析工程相关经验。
- 强大的SQL技能，适用于分析工作负载。
- 具有以下云数据仓库经验：
- BigQuery
- Amazon Redshift
- Snowflake
- 类似平台
- 有设计星型模式或维度数据模型的实际经验。
- 有构建分析就绪数据集市的经验。
优先资格
- 有dbt或其他数据转换框架的经验。
- 熟悉基于Git的工作流和数据流水线的CI/CD。
- 有以下BI工具的经验：
- Looker
- Tableau
- Power BI
- 有在零售或多地点数据环境工作的背景。
关键技能
- SQL
- 提示工程
- 数据工程
- 分析工程
- BigQuery
- 数据建模
- 数据仓库
- 数据流水线
查看英文原文
Data Engineer
Job Overview
We are looking for a skilled Data Engineer to design, optimize, and maintain the data architecture that powers our BI environment.
This role focuses on building scalable BigQuery datamarts, optimizing data models, and ensuring reliable data pipelines to support analytics and reporting.
The ideal candidate has strong experience in cloud data warehousing, data modeling, and building analytics-ready datasets that enable efficient BI consumption.
Key Responsibilities
1. Data Architecture & Engineering
- Design, build, and maintain BigQuery datamarts and analytical tables for BI reporting.
- Develop scalable data models, including star schema, snowflake, and denormalized models.
- Optimize query performance and storage efficiency within cloud data warehouses.
- Collaborate with BI teams to ensure datasets align with semantic models and dashboards.
2. Data Pipeline & Transformation
- Build and maintain data pipelines for data ingestion, transformation, and loading into analytics environments.
- Implement transformation workflows using SQL or frameworks such as dbt.
- Ensure data quality, validation, and consistency across datasets.
3. Data Governance & Performance
- Maintain data standards, naming conventions, and proper documentation.
- Implement governance practices, including schema management and version control.
- Monitor and troubleshoot pipeline failures and data inconsistencies.
4. Collaboration with BI Teams
- Work closely with BI specialists to ensure datasets support semantic-layer requirements.
- Deliver optimized datasets that minimize the need for heavy transformations within BI tools.
Required Qualifications
- 3+ years of experience in Data Engineering or Analytics Engineering.
- Strong SQL expertise for analytical workloads.
- Experience with cloud data warehouses such as:
- BigQuery
- Amazon Redshift
- Snowflake
- Similar platforms
- Proven experience designing star-schema or dimensional data models.
- Experience building analytics-ready datamarts.
Preferred Qualifications
- Experience with dbt or similar data-transformation frameworks.
- Familiarity with Git-based workflows and CI/CD for data pipelines.
- Experience with BI tools such as:
- Looker
- Tableau
- Power BI
- Background working with retail or multi-location data environments.
Key Skills
- SQL
- Prompt Engineering
- Data Engineering
- Analytics Engineering
- BigQuery
- Data Modeling
- Data Warehousing
- Data Pipelines
- BI & Analytics
- dbt
- Git / CI/CD
Salary: Up to $17/hrOriginally posted on Himalayas