数据工程师负责人
Data Engineer Lead
Blend 是一家领先的 AI 服务提供商,致力于通过数据科学、人工智能、技术和人才的力量,与客户共同创造有意义的影响。公司使命是激发大胆的愿景,通过无缝结合人类专业知识和人工智能来解决重大挑战。公司通过世界级的人才和数据驱动的战略,为客户提供价值并推动创新。我们相信,人与 AI 的力量可以对你的世界产生深远影响,为我们的员工和客户创造更有意义的工作和项目。更多信息,请访问 www.blend360.com
Data Engineer Lead 负责设计、开发和支持数据解决方案,以在组织内实现报告、商业智能和预测分析。该职位包括将重复的手动报表转换为自动化数据管道和可扩展的 BI 解决方案,如 Excel 工作簿、手动数据提取和重复流程。此外,该职位还负责支持团队的预测模型生产流程,包括模型评分、生产数据准备,并确保分析模型的可靠运行。
职责
· 设计、开发和维护自动化数据管道和分析解决方案。
· 自动化手动报告流程和重复的数据工作流。
· 优化 SQL 查询、数据模型和处理性能。
· 支持预测分析的生产数据准备和模型评分。
· 监控数据质量,排查管道问题,提高可靠性。
· 与业务和技术利益相关者合作,交付可扩展的数据解决方案。
· 推广数据工程最佳实践,推动持续改进。
要求
· 在数据工程师、分析数据工程师、分析工程师、BI 开发人员、报告工程师或类似职位上有丰富经验,有设计、自动化和交付生产报告和分析解决方案的成果。
· 精通 SQL Server 和数据库。具备强大的 SQL Server 开发和数据库管理技能,包括编写复杂查询、优化性能,并支持生产报告和分析工作负载。能够使用连接、窗口函数、CTE 和良好的数据建模原则,将模糊的业务问题转化为高效的 SQL 解决方案。
· 编程和现代数据平台。精通 Python、SQL、Kubernetes、AWS 或 Azure 等技术栈,熟悉数据仓库、ETL 流程和大数据工具。
查看英文原文
Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com
Job Description
Build and maintain scalable data solutions to support marketing analytics and audience activation initiatives, with a strong focus on Databricks, governed data structures, reusable components, and reliable data pipelines.
The ideal candidate has strong experience working with Databricks, Git-based development workflows, marketing performance data, customer identity matching, and data governance. You will work with data from multiple enterprise sources, transform legacy audience logic into governed definitions, and build reliable data products that support analytics and downstream activation.
Responsibilities
· Develop and maintain scalable data pipelines in Databricks, using Unity Catalog and Delta.
- Curate Genie spaces and semantic layers, including table and column metadata, certified metric definitions, example SQL, and trusted assets.
- Maintain and refactor existing Git/GitHub repositories, developing modular and reusable data components.
- Implement CI/CD workflows for Databricks solutions, including promotion from development to controlled UAT environments.
- Model marketing performance data including email events, campaign and promotion history, offers, packages, and tours.
- Build point-in-time audience histories and connect marketing sends with downstream sales outcomes.
- Develop data solutions at the person and household grain, using ID crosswalks and match rules based on existing identity resolution outputs.
- Implement suppression and consent requirements, including Do Not Email rules, marketability flags, and PII handling.
- Ingest and integrate data from SQL Server enterprise data warehouses and translate legacy SQL audience logic into governed definitions.
- Deliver audiences from Databricks to Adobe Campaign or Segment, including service accounts, encryption, and auditing.
- Profile unfamiliar data sources independently, producing data dictionaries and ERDs and verifying data availability and structure.
- Develop data quality tests and validated query/result sets to support reliable datasets and agent evaluation.
- Collaborate with analytics, engineering, marketing, data, and security teams to improve data solutions and processes.
Qualifications
· 5+ years of experience in Data Engineering or similar roles.
- Hands-on experience developing data pipelines in Databricks, including Unity Catalog and Delta.
- Strong hands-on experience with Python for data processing and transformation.
- Strong SQL skills, including the ability to understand and translate complex existing SQL logic.
- Experience with Git-based development and CI/CD, preferably using Databricks Asset Bundles or an equivalent approach.
- Experience with Azure and promoting data solutions across development and controlled UAT environments.
- Experience modeling data for marketing analytics, customer data, or similar business domains.
- Experience with customer identity, person/household data, ID crosswalks, and identity matching rules.
- Experience handling consent, suppression, marketability, and PII requirements.
- Experience integrating data from SQL Server enterprise data warehouses.
- Ability to independently profile unfamiliar data sources and document findings through data dictionaries and ERDs.
- Strong analytical and problem-solving skills, with the ability to investigate ambiguous data issues independently.
- Strong communication and collaboration skills for working with technical and business stakeholders.
What about languages?
· You will need excellent written and verbal English for clear and effective communication with the team.
How much experience must I have?
· In order to thrive in this role, you must have at least 5+ years of experience in data engineering or similar roles.
Our Perks and Benefits:
📚 Learning Opportunities:
· Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.
- Access to AI learning paths to stay up to date with the latest technologies.
- Study plans, courses, and additional certifications tailored to your role.
- Access to Udemy Business, offering thousands of courses to boost your technical and soft skills.
- English lessons to support your professional communication.
🛫 Travel opportunities to attend industry conferences and meet clients.
👩🏫 Mentoring and Development:
· Career development plans and mentorship programs to help shape your path.
🎁 Celebrations & Support:
· Special day rewards to celebrate birthdays, work anniversaries, and other personal milestones.
- Company-provided equipment.
⚖️ Flexible working options to help you strike the right balance.
Other benefits may vary according to your location in LATAM. For detailed information regarding the benefits applicable to your specific location, please consult with one of our recruiters.