[C3T] 数据平台工程师（元数据，数据质量）
[C3T] Data Platform Engineer (Metadata, DQ)
Software Mind 为全球的公司提供具有影响力的技术解决方案。科技巨头和独角兽企业、变革性项目、新兴技术以及无限的机会——这些是我们的日常写照。我们组建跨职能的工程团队，他们拥有主人翁意识并追求卓越，因此我们一直在寻找有才华的人才，他们为每个项目带来热情和创造力。我们的文化倡导开放、尊重、坚韧与勇气，并将工作与乐趣结合。
项目 – 你将承担的职责
加入一个媒体与娱乐项目，开发现代分析解决方案。你将帮助在 AWS 上构建云原生数据生态系统，专注于元数据管理和数据质量。关键亮点：对关键数据平台组件拥有实际所有权，使用现代开源工具，与数据工程、数据治理、AI 和数据管理团队紧密合作，制定组织的数据标准。
职位 – 你将做出的贡献
· 实施、配置和维护元数据管理平台和数据质量环境。
· 将解决方案与湖仓、数据仓库、领域系统和分析工具集成。
· 自动化元数据摄入、数据血缘、数据质量监控和 DQ 报告。
· 实现并维护用于执行数据质量规则的元模型和技术机制。
· 开发和扩展数据质量与元数据管理解决方案之间的集成。
· 监控环境的稳定性、性能和安全性。
· 与数据治理、数据工程和业务团队合作，推出标准并推动数据目录和 DQ 机制的实际应用。
· 编写技术文档并提供用户支持。
要求 – 你需要具备的经验
· 至少 3–5 年作为数据工程师 / 数据平台工程师或相关角色的经验。
· 有构建和维护生产数据管道（ETL/ELT）的实际经验。
· 有元数据管理 / 数据目录工具的经验（例如 DataHub、Apache Atlas、Amundsen）。
· 有数据质量工具的经验（例如 Great Expectations、Soda、Deequ 或类似工具）。
· 了解事件驱动架构。
· 有已建立数据治理或主数据管理流程的环境经验。
· 精通 Python（API、自动化、集成）和 SQL。
· 有在 AWS 环境中工作的实际经验。
· 扎实的知识
查看英文原文
Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities – these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines employment with enjoyment.
Project – the aim you’ll have
Join a Media & Entertainment project building modern analytical solutions. You'll help develop a cloud-native data ecosystem on AWS, focused on metadata management and data quality. Key selling points: real ownership of a critical data platform component, work with modern open-source tooling, and close collaboration with Data Engineering, Data Governance, AI, and Data Management teams shaping organizational data standards.
Position – how you’ll contribute
· Implement, configure, and maintain the Metadata Management platform and Data Quality environment.
· Integrate the solution with the lakehouse, data warehouse, domain systems, and analytical tools.
· Automate metadata ingestion, data lineage, data quality monitoring, and DQ reporting.
· Implement and maintain the metamodel and technical mechanisms for enforcing data quality rules.
· Develop and extend integrations between Data Quality and Metadata Management solutions.
· Monitor the stability, performance, and security of the environment.
· Collaborate with Data Governance, Data Engineering, and business teams to roll out standards and drive practical adoption of the data catalog and DQ mechanisms.
· Produce technical documentation and provide user support.
Expectations – the experience you need
· Minimum 3–5 years of experience as a Data Engineer / Data Platform Engineer or in a related role.
· Proven experience building and maintaining production data pipelines (ETL/ELT).
· Experience with Metadata Management / Data Catalog tools (e.g., DataHub, Apache Atlas, Amundsen).
· Experience with Data Quality tools (e.g., Great Expectations, Soda, Deequ, or similar).
· Knowledge of event-driven architecture.
· Experience in environments with established Data Governance or Master Data Management processes.
· Strong proficiency in Python (APIs, automation, integrations) and SQL.
· Hands-on experience working in an AWS environment.
· Solid knowledge of CI/CD practices and GitHub.
· Experience implementing data validation, data testing, or data quality control mechanisms within pipelines.
· Experience with system integrations (REST API, GraphQL, or similar).
· Understanding of Data Governance, Metadata Management, Data Lineage, and Data Quality concepts.
· Ability to work independently in a project-based environment.
· Good communication skills in both Polish and English.
Our offer – professional development, personal growth
· Flexible employment and remote work
· International projects with leading global clients
· International business trips
· Non-corporate atmosphere
· Language classes
· Internal & external training
· Private healthcare and insurance
· Multisport card
· Well-being initiatives