Data Engineer (Azure, Fabric, Databricks)
角色概述数据工程师负责使用微软织物和数据的现代数据平台设计，实施和支持。重点放在湖泊建筑，分析工程和语义建模上。这个职位面向客户，需要将业务要求转化为可扩展技术解决方案，同时遵守数据工程最佳实践。你将与客户利益相关者，集体顾问和跨功能团队合作提供支持报告，先进分析和自动服务 BI 的数据平台。关键责任客户端交付&解决方案设计 · 设计和实施利用微软织品 (OneLake, Lakehouse, Data Factory, Power BI) 和数据块 (Spark, Delta Lake, SQL Warehouses) 的现代数据平台 · 使用 ELT/ETL 最佳实践构建和优化数据摄入，转型和调整管道 ·开发可扩展的湖泊建筑物支持分析，报告和下游数据产品 ·将业务和分析要求转换为技术设计和数据模型 & BI 启用 ·开发和维护能够实现性能报告和自动服务分析的语义模型 ·与分析和业务团队合作，提供可靠的数据集和仪表板 （Power BI 或相等）·确保在分析平台上 தரவு质量，可靠性和可用性工程最佳实践 ·为大型分析工作负载编写，优化和调整 SQL 和 Spark 基于转型 ·将版本控制，CI/CD 概念和代码审查标准应用于数据工程工作流程 ·确保解决方案符合性能，扩展性和维护性相关的质量标准 咨询与协作 ·直接与客户利益相关方合作收集要求，沟通技术概念和管理期望 ·与项目经理，建筑师和其他顾问合作，将技术交付与项目目标相一致 · 贡献内部文档，可重复使用模式以及知识共享在集体要求资格的范围内 · 从认证大学获得本科学位 · 4年以上数据工程，分析工程或数据平台咨询工作经验 · 在生产环境中实践经验 （两者都强烈优先）· 强大的 SQL 技能，包括性能 t
查看英文原文
Role Overview
The Data Engineer is responsible for designing, implementing, and supporting modern data platforms using Microsoft Fabric and Databricks, with a strong emphasis on lakehouse architecture, analytics engineering, and semantic modeling. This role is client-facing and requires translating business requirements into scalable technical solutions while adhering to data engineering best practices.
You will collaborate with client stakeholders, Collectiv consultants, and cross-functional teams to deliver data platforms that support reporting, advanced analytics, and self-service BI.
Key Responsibilities
Client Delivery & Solution Design
- Design and implement modern data platforms leveraging Microsoft Fabric (OneLake, Lakehouse, Data Factory, Power BI) and Databricks (Spark, Delta Lake, SQL Warehouses)
- Build and optimize data ingestion, transformation, and orchestration pipelines using ELT/ETL best practices
- Develop scalable lakehouse architectures that support analytics, reporting, and downstream data products
- Translate business and analytical requirements into technical designs and data models
Analytics & BI Enablement
- Develop and maintain semantic models that enable performant reporting and self-service analytics
- Partner with analytics and business teams to deliver trusted datasets and dashboards (Power BI or equivalent)
- Ensure data quality, reliability, and usability across the analytics platform
Engineering Best Practices
- Write, optimize, and tune SQL and Spark-based transformations for large-scale analytical workloads
- Apply version control, CI/CD concepts, and code review standards to data engineering workflows
- Ensure solutions meet quality criteria related to performance, scalability, and maintainability
Consulting & Collaboration
- Work directly with client stakeholders to gather requirements, communicate technical concepts, and manage expectations
- Collaborate with project managers, architects, and fellow consultants to align technical delivery with project goals
- Contribute to internal documentation, reusable patterns, and knowledge sharing across Collectiv
Required Qualifications
- Bachelor's degree from an accredited university
- 4+ years of experience in data engineering, analytics engineering, or data platform consulting
- Hands-on experience with Microsoft Fabric and/or Databricks in production environments (experience with both strongly preferred)
- Strong SQL skills, including performance tuning and optimization
- Experience designing data models for analytics (star schemas, semantic models, lakehouse patterns)
- Experience working in cloud data platforms (Azure preferred)
- Ability to work independently in a client-facing consulting role
Preferred Qualifications
- Experience migrating or modernizing data platforms (e.g., legacy DW to lakehouse)
- Familiarity with Power BI dataset modeling and performance optimization
- Experience integrating data platforms with downstream applications or APIs
- Consulting experience with multiple clients or industries
- Strong written and verbal communication skills
- Relevant Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer), Fabric (DP-600, DP-700) certifications, and Databricks certifications are highly desirable
What Success Looks Like in This Role
- Clients trust you as a technical advisor for their data platform decisions
- Delivered solutions are scalable, well-documented, and aligned to best practices
- Business users are enabled through reliable data models and analytics-ready datasets
- You actively contribute to Collectiv’s data platform standards and consulting excellence
Join Collectiv for a rewarding career in a fully remote work environment with quarterly in person team experiences and a competitive compensation. We provide a clear growth trajectory with professional development opportunities and a top-shelf benefits package. Enjoy unlimited time off and 100% covered health insurance, encompassing medical, dental, and vision plans for you and your family. Our comprehensive offerings, from a competitive 401(k) with a 4% match to educational assistance, tech stipend, and discounts on various goods and services, demonstrate our commitment to your well-being and success. At Collectiv, your career thrives with a perfect blend of remote flexibility, growth potential, and unparalleled benefits prioritizing your financial, physical, and emotional well-being.
Collectiv is the leading boutique consulting and strategy firm specializing in Analytics, Planning and AI with Power BI and the Microsoft Data Stack.
Our mission at Collectiv is simple: We help enterprises make better decisions.
Our Core Values:
Growth Mindset– Bring solutions, not problems.
Excel with Humility – Be humbly brilliant.
Communicate Actively and Empathetically – Listen, ask, understand, help.
Work Hard, Play Hard – Results are proportional to effort.
Keep Calm and Carry On – Stay cool, calm and Collectiv.
Originally posted on Himalayas