Data Engineer Analyst
结合 AI 是首屈一指的人工智能服务提供商,致力于通过数据科学,人工智能,技术和人才力量为客户共同创造有意义的影响。以推动大胆的愿景的使命,结合 AI 与人工智能的无地调整人类专业知识来解决重大挑战。公司致力于利用世界级的人类和数据驱动战略来释放价值并促进其客户创新。我们相信人们的力量和人工智能可以对你的世界产生有意义影响,为我们的人员和客户创造更充满的工作和项目。更多信息请访问 www.blend360.com 我们正在寻找一个数据工程师分析师,以促进我们的下一层次的增长和扩张。该立场是什么?· 设计,构建和维护可扩展的数据管道和摄入框架,支持批量处理,流媒体和变化数据捕获 (CDC) 模式。· 使用 Apache Spark 和 PySpark 开发和优化数据处理工作流程,确保在大型数据集中可靠且性能高的转型。· 在 AWS 上实现并管理数据湖架构,利用 S3 为主要存储层以及 Apache Iceberg 来管理表格式,进化和时间旅行能力。· 与 AWS 原生服务合作,包括 ETL 主编的 Glue,无服务器查询的 Athena 和基于事件的数据处理的 Lambda. · 使用 AWS IAM 管理数据访问控制和安全配置,确保在整个数据平台上具有符合性和最小特权的访问。·与数据分析师,数据科学家和平台工程师协作,了解数据需求并提供生产准备的解决方案。·监测管道健康,解决数据质量问题,并实施改进以确保数据可靠性和新鲜度。· 贡献团队内部数据流动,建筑决策和工程标准的文档。· AWS Glue · Amazon S3 · Amazon Athena · AWS IAM · Apache Spark / PySpark 用于数据处理。· 理想情况下,具有 Apache Iceberg 的知识。· 数据摄入模式,包括批量处理,流媒体和 CDC 模式。· SQL 用于查询,验证和探索分析;· 对数据建模和大规模数据处理有充分理解;· 在跨功能团队合作并沟通的能力。
查看英文原文
Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com
We are seeking a Data Engineer Analyst to contribute to our next level of growth and expansion.
What is this position about?
· Design, build, and maintain scalable data pipelines and ingestion frameworks supporting batch processing, streaming, and change data capture (CDC) patterns.
· Develop and optimize data processing workflows using Apache Spark and PySpark, ensuring reliable and performant transformation across large datasets.
· Implement and manage data lake architectures on AWS, leveraging S3 as the primary storage layer and Apache Iceberg for table format management, schema evolution, and time-travel capabilities.
· Work with AWS-native services including Glue for ETL orchestration, Athena for serverless querying, and Lambda for event-driven data processing.
· Manage data access controls and security configurations using AWS IAM, ensuring compliant and least-privilege access across the data platform.
· Collaborate with data analysts, data scientists, and platform engineers to understand data requirements and deliver production-ready solutions.
· Monitor pipeline health, troubleshoot data quality issues, and implement improvements to ensure data reliability and freshness.
· Contribute to the documentation of data flows, architecture decisions, and engineering standards within the team.
- Advanced hands-on experience with AWS services, including:· AWS Glue
- Amazon S3
- Amazon Athena
- AWS IAM
- Apache Spark / PySpark for data processing.
- Data lake architectures, ideally with knowledge of Apache Iceberg.
- Data ingestion patterns, including batch processing, streaming, and CDC patterns
- Experience with SQL for data querying, validation, and exploratory analysis
- Solid understanding of data modeling and large-scale data processing
- Ability to work collaboratively in cross-functional teams and communicate technical concepts clearly to non-technical stakeholders.
- Experience with infrastructure-as-code or pipeline orchestration tools (e.g., Airflow, Step Functions, dbt) is a plus.
- Familiarity with AI-assisted development workflows and engineering productivity tools
- What about languages?
- English: Advanced (required for effective communication with global teams)
- How much experience must I have?
- 2+ years of experience in Data Engineering or related roles, with hands-on work building and maintaining cloud-based data pipelines and lake architectures on AWS.
Our Perks and Benefits:
📚 Learning Opportunities:
· Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.
· Access to AI learning paths to stay up to date with the latest technologies.
· Study plans, courses, and additional certifications tailored to your role.
· Access to Udemy Business, offering thousands of courses to boost your technical and soft skills.
· English lessons to support your professional communication.
👨🏽💻 Travel opportunities to attend industry conferences and meet clients.
👩🏫 Mentoring and Development:
· Career development plans and mentorship programs to help shape your path.
🎁 Celebrations & Support:
· Special day rewards to celebrate birthdays, work anniversaries, and other personal milestones.
· Company-provided equipment.
⚖️ Flexible working options to help you strike the right balance.
Other benefits may vary according to your location in LATAM. For detailed information regarding the benefits applicable to your specific location, please consult with one of our recruiters.