Data Engineer Databricks/Azure
客户端：一个知名的全球专业服务公司。他们正在启动一项新的数据平台项目，以利用微软技术来构建和优化数据转型工作流程。项目描述：该项目涉及使用微软织品，达尔塔湖和 Apache Spark 进行数据转换工作流程的架构和优化。角色重点是为 Azure 的数据服务提供技术专业知识，以确保高效，可靠和可扩展的数据处理。核心任务包括设计数据管道，与各种 Azure 服务 （例如 Data Lake,Synapse, Data Factory）集成，建议数据建模和性能最佳实践，确保数据安全和合规。堆：微软织物，达尔塔湖，Apache Spark,Azure 服务，Python,Scala,SparkSQL,Pyspark,Azure SDK/API.团队结构：角色涉及与一个全站式开发人员的团队合作。英语：需要优秀的沟通技能。最初发布在喜马拉雅山。
查看英文原文
Client:A well-known global professional services firm. They are starting a new data platform project focused on leveraging Microsoft technologies to build and optimize data transformation workflows.
Project description:The project involves architecting and optimizing data transformation workflows using Microsoft Fabric, Delta Lake, and Apache Spark. The role focuses on providing technical expertise on Azure's data services to ensure efficient, reliable, and scalable data processing. Key tasks include designing data pipelines, integrating with various Azure services (e.g., Data Lake, Synapse, Data Factory), advising on best practices for data modeling and performance, and ensuring data security and compliance.
Stack:Microsoft Fabric, Delta Lake, Apache Spark, Azure services (Data Lake, Synapse, Data Factory, Purview), Python, Scala, SparkSQL, PySpark, Azure SDKs/APIs.
Team structure:Role involves collaboration with a team of full-stack developers.
English: Excellent communication skills are required.
Originally posted on Himalayas