Palantir数据工程师
Palantir Data Engineer
职位简介：
我们正在寻找一名Palantir数据工程师加入我们的数据工程团队！我们希望您具备Palantir Foundry和PySpark或Python的经验。在该职位中，您将设计、开发和维护复杂的数据管道，优化Palantir平台内的数据工作流，并与跨职能团队紧密合作，挖掘数据驱动的洞察力。如果您热衷于使用前沿技术解决复杂业务挑战，这个职位适合您！
主要职责：
- 在Palantir Foundry生态系统中设计、构建和维护可扩展的数据基础设施和管道。
- 集成、处理和管理来自多个来源的大型数据集，确保组织内部数据的无缝流动。
- 优化数据工作流并保持数据管道的高性能，利用Palantir的功能。
- 与数据分析师和其他团队合作，理解并实现技术数据需求。
- 确保所有数据操作中的数据质量、安全性和合规性。
- 排查、监控和解决数据问题，以确保顺畅高效的运营。
- 持续探索并实施数据工程的最佳实践，及时了解Palantir不断发展的工具和技术。
- 要求
- 所需技能和资格：
- 在数据工程、数据集成和ETL/ELT流程方面有实际经验，最好是在Palantir平台上。
- 精通编程语言如Python或其他类似语言，特别是在Palantir Foundry环境中。
- 具备云平台的实际操作经验。
- 优秀的解决问题和业务分析能力，能够处理复杂的数据结构和系统。
- 对数据安全原则、合规性和最佳实践有扎实的理解。
- 强大的沟通和协作能力，能够在多学科团队中工作。
- 英语是必需的，德语是加分项。
优先考虑的资质：
- 具备Palantir Foundry的经验，包括Foundry的本体论、数据血缘和模型管理功能。
- 了解数据可视化工具如Power BI，或Palantir内置的可视化功能。
- 熟悉机器学习框架和库，以及它们如何在Palantir Foundry中集成。
- 具备CI/CD实践经验者优先。
- 具备敏捷开发方法的经验，并能在敏捷环境中交付成果。
查看英文原文
Job Summary:
We are looking for a Palantir Data Engineer to join our data engineering team! We are seeking someone with experience in Palantir Foundry and PySpark or Python. In this role, you will design, develop, and maintain complex data pipelines, optimize data workflows within the Palantir platform, and collaborate closely with cross-functional teams to unlock data-driven insights. If you're passionate about working with cutting-edge technologies to tackle complex business challenges, this role is for you!
Key Responsibilities:
- Design, build, and maintain scalable data infrastructure and pipelines within the Palantir Foundry ecosystem.
- Integrate, process, and manage large datasets from multiple sources, ensuring seamless data flow across the organization.
- Optimize data workflows and maintain high performance of data pipelines, leveraging Palantir's capabilities.
- Collaborate with Data Analysts and other teams to understand and implement technical data requirements.
- Ensure data quality, security, and compliance in all data operations.
- Troubleshoot, monitor, and resolve data issues to ensure smooth and efficient operations.
- Continuously explore and implement best practices in data engineering and keep up-to-date with Palantir's evolving tools and technologies.
Requirements
Required Skills and Qualifications:
- Proven experience in data engineering, data integration, and ETL/ELT processes, ideally within the Palantir platform.
- Strong proficiency in programming languages such as Python or equivalent, particularly within a Palantir Foundry environment.
- Hands-on experience with cloud platforms
- Excellent problem-solving and business analysis skills, with the ability to navigate complex data structures and systems.
- Solid understanding of data security principles, compliance, and best practices.
- Strong communication and collaboration skills to work across multidisciplinary teams.
- English language is required, German language is an advantage.
Preferred Qualifications:
- Experience with Palantir Foundry, including Foundry's ontology, data lineage, and model management features.
- Knowledge of data visualization tools such as Power BI, or Palantir's built-in visualization capabilities.
- Familiarity with machine learning frameworks and libraries, and how they integrate within Palantir Foundry.
- Experience with CI/CD practices is a plus.
- Experience with agile development methodologies and delivering in agile environments.
- Previous experience in mentoring or leading a team of data engineers or analysts.
Originally posted on Himalayas