PySpark数据工程师
PySpark Data Engineer
我们是微软数据平台卓越中心——微软数据技术领域的专家团队。我们的团队在现代数据解决方案的全领域都有实战经验，包括Azure Data Factory、Synapse Analytics、Microsoft Fabric、Power BI、Purview、Azure SQL Database、Databricks、Palantir等。
我们不断学习、实验并优化工程实践，在数据生态系统中实施新创新。
我们的团队已发展到40名专家，分别在捷克共和国和瑞士工作。
作为PySpark数据工程师，您将：
- 使用Python和PySpark设计、构建和优化可扩展的数据管道
- 与现代数据平台（Palantir Foundry / Databricks / 类似平台）合作
- 从金融和保险源系统集成数据
- 支持分析和报告解决方案（如Power BI）的数据交付
- 确保数据管道的数据质量、可靠性和性能
- 与业务、分析和工程团队协作
- 支持部署、监控和生产运维
我们期望您具备：
- 在Python和PySpark方面的丰富经验
- 在基于Spark的数据平台上的经验（熟悉Palantir Foundry是加分项）
- 在数据工程和构建ETL/ELT管道方面的扎实经验
- 对SQL和大规模数据处理有深入理解
- 在金融服务领域（保险优先）的经验
- 使用Git和CI/CD流水线的经验
- 良好的英语沟通能力
我们为您提供：
- 用于个人发展的预算（课程、会议、认证）
- 参与国际项目的远程工作机会
- 在家或我们新的设计办公室工作
- 我们重视时间——不加班
- 接入公司图书馆获取灵感
- 有吸引力的手机套餐、多运动卡和加油卡
- 露台烧烤和众多其他团队活动
最初发布于Himalayas
查看英文原文
We are the Microsoft Data Platform Competence Center – leading experts in Microsoft data technologies. Our team has hands-on experience with the full spectrum of modern data solutions including Azure Data Factory, Synapse Analytics, Microsoft Fabric, Power BI, Purview, Azure SQL Database, Databricks, Palantir, and more.
We constantly learn, experiment, and refine our engineering practices, implementing new innovations across the data ecosystem.
Our team has grown to 40 specialists operating in both the Czech Republic and Switzerland.
What you will do as a PySpark Data Engineer
- Design, build and optimize scalable data pipelines using Python & PySpark
- Work with modern data platforms (Palantir Foundry / Databricks / similar)
- Integrate data from finance and insurance source systems
- Support data delivery for analytics and reporting solutions (e.g. Power BI)
- Ensure data quality, reliability and performance of pipelines
- Collaborate with Business, Analytics and Engineering teams
- Support deployment, monitoring and production operations
What we expect
- Strong experience in Python & PySpark
- Experience with Spark-based data platforms (Palantir Foundry is a big plus)
- Solid experience in data engineering and building ETL/ELT pipelines
- Strong knowledge of SQL and large-scale data processing
- Experience from financial services (insurance is preferred)
- Experience with Git and CI/CD pipelines
- Good communication skills in English
What we offer you
- Budget for personal development (courses, conferences, certifications)
- Opportunity to work remotely on international projects
- Work from the comfort of your home or from our new design office
- We value our time – no overtime
- Access to our company library for inspiration
- Attractive mobile plan, Multisport card, and fuel card
- Barbecues on the terrace and plenty of other team events
Originally posted on Himalayas