数据工程师
Data Engineer
我们正在寻找一个具有高技能的数据工程师，在 Azure Data Lake 中拥有丰富经验，以为创意混乱的动态团队做出贡献。理想候选人将负责构建，开发和优化大数据管道，从而促进大型数据集的有效处理。责任：· 在 Azure Data lake 内设计和实施强大的数据管道解决方案。· 从各种来源中的数据进行整合并转换，以便实现全面分析和报告。·确保数据质量和完整性，实施数据治理实践。· 与跨功能团队合作，了解数据需求并开发可扩展的解决方案。· 监测和优化数据处理工作流程以确保性能和可靠性。· 记录过程和架构以确保可维护性和扩展性。· 跟随 Azure 新技术和数据工程最佳实践。要求成功的候选人将拥有以下资格：·计算机科学，信息技术或相关领域学士学位。· 最少5年作为数据工程师的工作经验，重点放在 Azure Data Lake 上。· Azure 数据服务，特别是 Azure 数据湖存储，Azure 数据工厂和 Azure Synapse Analytics 方面的熟练知识。· 有了对数据建模，ETL 流程和数据仓库解决方案的经验证明。· 在 Python,SQL 上有强大的编程技能，并熟悉 Java 或 C#. · 非常擅长解决问题，并且以细节为导向的工作方式。·能够清楚地将技术概念与非技术利益相关者沟通。·具有管理多项优先事项和满足最后期限的能力的强大组织能力。
查看英文原文
We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos. The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets.
Responsibilities:
- Designing and implementing robust data pipeline solutions within Azure Data Lake.
- Integrating and transforming data from various sources to enable comprehensive analytics and reporting.
- Ensuring data quality and integrity, implementing data governance practices.
- Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
- Monitoring and optimizing data processing workflows for performance and reliability.
- Documenting processes and architecture to ensure maintainability and scalability.
- Staying abreast of new Azure technologies and best practices for data engineering.
Requirements
The successful candidate will possess the following qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- A minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake.
- Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics.
- Demonstrated experience with data modeling, ETL processes, and data warehousing solutions.
- Strong programming skills in Python, SQL, and familiar with Java or C#.
- Excellent problem-solving skills and a detail-oriented approach to work.
- Ability to communicate technical concepts clearly to non-technical stakeholders.
- Strong organizational skills with the ability to manage multiple priorities and meet deadlines.
Benefits
Perks & benefits
- Paid Time Off
- Work From Home
- Health Insurance
- OPD
- Training and Development
Originally posted on Himalayas