Microsoft Fabric开发工程师/数据工程师
Microsoft Fabric Developer / Data Engineer
Microsoft Fabric 开发者 / 数据工程师
经验：3年以上
职位类型：全职
主要技术：Microsoft Fabric / Azure 数据平台
职位概述
我们正在寻找一位有3年以上数据工程和基于 Azure 数据解决方案经验的动手型 Microsoft Fabric 开发者 / 数据工程师。候选人将负责使用 Microsoft Fabric、OneLake、Lakehouse、Data Warehouse、Fabric Data Factory、Python/PySpark 和 SQL 设计、开发和维护可扩展的数据管道和现代数据解决方案。
理想的候选人应具备构建端到端数据解决方案的实际经验，整合多个企业数据源，并支持分析和报告工作负载。
主要职责
- 使用 Microsoft Fabric 设计、开发和维护数据解决方案。
- 构建和管理 Fabric Lakehouse、Data Warehouse 和 OneLake 解决方案。
- 使用 Fabric Data Factory、Data Pipelines 和 Dataflows Gen2 开发可扩展的 ETL/ELT 管道。
- 使用 Python、PySpark、SQL 和 Fabric Notebooks 开发数据转换和处理工作流。
- 从数据库、API、文件、Azure 服务和其他企业系统中提取和集成数据。
- 实现 Lakehouse/Medallion 架构，包括 Bronze、Silver 和 Gold 数据层。
- 设计和优化用于分析、报告和下游应用的数据模型。
- 优化 SQL 查询、Spark 工作负载和管道以提高性能和可扩展性。
- 实现数据验证、质量检查、监控、日志记录和错误处理。
- 与开发、分析和业务团队合作，将需求转化为可扩展的技术解决方案。
- 支持 Microsoft Fabric 工作负载的部署和 CI/CD 流程。
- 所需技术技能
- 3年以上数据工程 / Azure 数据平台经验
- 对 Microsoft Fabric 有扎实的实战经验
- Fabric Data Factory、Pipelines 和 Dataflows Gen2
- OneLake 和 Fabric Lakehouse
- Fabric Data Warehouse
- Fabric Notebooks
- 强大的 SQL / T-SQL 能力
- Python 和 PySpark
- ETL/ELT 和数据管道开发
- 数据仓库和数据建模
- Azure 生态系统，如 Azure Data Factory、Azure SQL、ADLS 和/或 Azure Synapse
- 整合 REST API 和多个企业数据源的经验
- 了解 Delta Lake 和 Medallion 架构
- Git/Azure DevOps 和 CI/CD 基础知识
- 加分项
- Power BI、DAX、语义模型和 Direct Lake
- 实时分析或流处理
查看英文原文
Microsoft Fabric Developer / Data Engineer
Experience: 3+ Years
Role Type: Full-Time
Primary Technology: Microsoft Fabric / Azure Data Platform
Role Overview
We are looking for a hands-on Microsoft Fabric Developer / Data Engineer with 3+ years of experience in data engineering and Azure-based data solutions. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data solutions using Microsoft Fabric, OneLake, Lakehouse, Data Warehouse, Fabric Data Factory, Python/PySpark and SQL.
The ideal candidate should have practical experience building end-to-end data solutions, integrating multiple enterprise data sources, and supporting analytics and reporting workloads.
Key Responsibilities
- Design, develop and maintain data solutions using Microsoft Fabric.
- Build and manage Fabric Lakehouse, Data Warehouse and OneLake solutions.
- Develop scalable ETL/ELT pipelines using Fabric Data Factory, Data Pipelines and Dataflows Gen2.
- Develop data transformation and processing workflows using Python, PySpark, SQL and Fabric Notebooks.
- Ingest and integrate data from databases, APIs, files, Azure services and other enterprise systems.
- Implement Lakehouse/Medallion architecture including Bronze, Silver and Gold data layers.
- Design and optimize data models for analytics, reporting and downstream applications.
- Optimize SQL queries, Spark workloads and pipelines for performance and scalability.
- Implement data validation, quality checks, monitoring, logging and error handling.
- Work with development, analytics and business teams to translate requirements into scalable technical solutions.
- Support deployment and CI/CD processes for Microsoft Fabric workloads.
Required Technical Skills
- 3+ years of Data Engineering / Azure Data Platform experience
- Strong hands-on experience with Microsoft Fabric
- Fabric Data Factory, Pipelines and Dataflows Gen2
- OneLake and Fabric Lakehouse
- Fabric Data Warehouse
- Fabric Notebooks
- Strong SQL / T-SQL
- Python and PySpark
- ETL/ELT and data pipeline development
- Data warehousing and data modelling
- Azure ecosystem such as Azure Data Factory, Azure SQL, ADLS and/or Azure Synapse
- Experience integrating REST APIs and multiple enterprise data sources
- Understanding of Delta Lake and Medallion Architecture
- Git/Azure DevOps and CI/CD fundamentals
Good to Have
- Power BI, DAX, Semantic Models and Direct Lake
- Real-time analytics or streaming experience
- Azure OpenAI or other AI/ML integration experience
- Experience supporting enterprise-scale data platforms
- Data governance, security and access-control experience
- Microsoft DP-600 / Fabric Analytics Engineer or related Azure certification
Preferred Candidate
We are looking for someone who has actually built and deployed Microsoft Fabric solutions, rather than having only certification or theoretical exposure. The candidate should be comfortable explaining the architecture, pipelines, transformations and Fabric components they personally implemented in previous projects.
Originally posted on Himalayas