Data Infrastructure Engineer [Talents Bench]
关于金属金是战略人工智能合作伙伴。我们帮助客户使用 AI 来构建未来增长的引擎，并将 AI 的能力与其最重要的业务机会结合起来。我们是一个 AWS,人类和 OpenAI 合作伙伴。我们的团队包括顾问，软件工程师，devops 工程师，UX 设计师，项目经理，营销人员和支持工作人员。这当然不言之喻，但每个在 Metal Toad 上的工作者都应该对人工智能的影响感兴趣，并且相信一个由人先实现的人工智能化的未来。申请这个职位，请以 PDF 为形式提交你的简历。我们正在寻找一个高度技术，实践的数据基础设施工程师加入我们的团队。这不是标准的数据工程角色；相反，你将专注于使用开源软件构建强大可扩展的数据基础架构平台。你的主要任务是部署和管理高性能数据技术如 Apache Pinot,Apache Druid 和 Trino 在一个完善的亚马逊 EKS 环境中。你将致力于创新，高风险的技术解决方案，导航复杂的客户环境，以提供超越标准实现边界的尖端基础设施。责任关键责任 · 基础设施实施：· 开发实践：使用 IDE,Git 和严格的编码最佳做法来管理基础设施作为代码。· 解决问题：导航复杂的客户层次结构和技术景观以确定，提出和实施定制解决方案。· 先性工作：设计和实现以前尚未建立的新型高风险解决方案。• 合作：作为开源技术专家，确保所有构建都有良好的架构和生产准备。·相信公司的使命：帮助人们。·信任开源原则。·对于这一角色来说，先进和流利的英语沟通技能是必不可少的。· Kubernetes/EKS:Kubernetes 和 Amazon EKS 方面的深入专业知识是必须拥有的。·核心基础设施工具：Terraform,Helm,Docker 和 Karpenter 的熟练性。·数据 OSS 专业知识：在部署和管理数据 OSS 软件中至少获得3分 （以5点级别）的评分，包括 Trino,
查看英文原文
About Metal Toad
Metal Toad is a strategic AI partner. We help our customers to use AI to build the engines of their future growth, aligning AI’s capabilities with their most important business opportunities. We are an AWS, Anthropic, and OpenAI partner.
Our team includes consultants, software engineers, devops engineers, UX designers, project managers, marketers, and supporting staff. It should go without saying, but everyone working at Metal Toad should be interested in the impact of AI, and believe in a human-first, AI-enabled future.
To apply for this position, please submit your resume in English as a PDF.
Job Description
We are looking for a highly technical, hands-on Data Infrastructure Engineer to join our team. This is not a standard Data Engineering role; instead, you will focus on building robust, scalable Data Infrastructure platforms using Open Source software. Your primary mission is to deploy and manage high-performance data technologies—such as Apache Pinot, Apache Druid, and Trino—within a well-architected Amazon EKS environment.
You will work on pioneering, high-risk technical solutions, navigating complex customer environments to deliver cutting-edge infrastructure that pushes the boundaries of standard implementations.
Responsibilities
Key Responsibilities
- Infrastructure Implementation: Architect and deploy Open Source Data OSS (Trino, Spark, Pinot, Druid) on Amazon EKS.
- Hands-on Development: Maintain a 100% hands-on approach, utilizing IDEs, Git, and strict coding best practices to manage infrastructure as code.
- Problem Solving: Navigate complex customer hierarchies and technical landscapes to identify, propose, and implement bespoke solutions.
- Pioneering Work: Design and implement novel, high-risk solutions that have not been previously established.
- Collaboration: Act as a subject-matter expert in Open Source technologies, ensuring all builds are well-architected and production-ready.
QUALIFICATIONS REQUIRED
- Agree with our Corporate Values Statement.
- Believes in the company's mission: to help people.
- Believes in the principles of open source.
- Advanced to fluent English communication skills are essential for this role.
- Kubernetes/EKS: Deep expertise in Kubernetes and Amazon EKS is a must-have.
- Core Infrastructure Tooling: Proficiency in Terraform, Helm, Docker, and Karpenter.
- Data OSS Expertise: Minimum rating of 3 (on a 5-point scale) in deploying and managing Data OSS software, including Trino, Spark, or Pinot.
- Data Foundations: Strong familiarity with Data Lakes, Spark, and Hive architectures.
- Versatility: A demonstrated willingness to work with non-AWS and broad Open Source ecosystems.
- Soft Skills: High comfort level engaging with complex customer environments and an aptitude for high-stakes technical troubleshooting.
NICE TO HAVE
- Prior hands-on experience working with Fruitstand.
- Demonstrated history of contributing to or managing complex open-source projects in production environments.
Originally posted on Himalayas