高级AWS EMR管理员
Sr. AWS EMR Admin
职位概述
我们正在寻找一位经验丰富的高级AWS EMR管理员，负责管理、优化和扩展我们的云数据基础设施。在这个实际操作的技术岗位中，您将负责设计、部署和维护持久性和临时性的AWS EMR集群，以支持大规模的批处理数据处理流程。您将与数据工程团队紧密合作，并利用基础设施即代码（IaC）来确保我们在AWS生态系统中的可靠、安全和自动化操作。
要求
主要职责
- 集群管理：根据业务工作负载和运营需求，设计、部署和维护持久性和临时性的AWS EMR集群。
- 基础设施自动化：使用AWS CloudFormation、AWS CodePipeline或Terraform设计和实现部署自动化。
- 存储与计算优化：管理AWS EC2、S3及相关计算和存储资源，确保高性能、安全性和成本效率。
- 数据流程支持：监控和支持批量数据处理任务，排查EMR环境中的性能瓶颈和操作问题。
- 系统管理：在EMR及相关的AWS服务中执行常规维护、补丁、扩展、访问控制和安全配置。
必备资格
- 经验：7–8年以上AWS云基础设施和AWS EMR管理的实际工作经验。
- 核心AWS技术栈：熟练掌握AWS EMR、EC2、S3、CloudFormation以及批处理数据环境。
- 基础设施即代码（IaC）与CI/CD：有使用AWS CloudFormation、Terraform和AWS CodePipeline（或类似CI/CD工具）部署云资源的经验。
- EMR架构：对Amazon EMR架构、集群生命周期和节点配置有深入的技术理解。
优先资格
- 具有Hadoop生态系统、HDFS和大数据技术的经验。
- 接触过AWS EKS（弹性Kubernetes服务）和容器化工作负载。
- 具有Kerberos认证和企业安全集成的实际操作经验。
福利
随着公司的发展，该职位提供了显著的职业发展机会。该岗位提供了一个独特的机会，加入一个小型、具有挑战性且富有创业精神的环境，并承担高度的个人责任。
最初发布于喜马拉雅山
查看英文原文
Role Overview
We are seeking an experienced Senior AWS EMR Administrator to manage, optimize, and scale our cloud data infrastructure. In this hands-on technical role, you will be responsible for designing, deploying, and maintaining persistent and transient AWS EMR clusters to support large-scale batch data processing pipelines. You will collaborate closely with data engineering teams and leverage Infrastructure as Code (IaC) to ensure reliable, secure, and automated operations across our AWS ecosystem.
Requirements
Key Responsibilities
- Cluster Management: Architecture, deploy, and maintain persistent and transient AWS EMR clusters tailored to business workloads and operational needs.
- Infrastructure Automation: Design and implement deployment automation using AWS CloudFormation, AWS CodePipeline, or Terraform.
- Storage & Compute Optimization: Manage AWS EC2, S3, and related compute and storage resources to ensure high performance, security, and cost efficiency.
- Data Pipeline Support: Monitor and support batch data processing workloads, troubleshooting performance bottlenecks and operational issues across the EMR environment.
- System Administration: Perform routine maintenance, patching, scaling, access controls, and security configurations across EMR and associated AWS services.
Required Qualifications
- Experience: 7–8+ years of hands-on experience in AWS Cloud Infrastructure and AWS EMR Administration.
- Core AWS Technical Stack: Strong proficiency with AWS EMR, EC2, S3, CloudFormation, and batch data environments.
- Infrastructure as Code (IaC) & CI/CD: Demonstrated experience deploying cloud resources using AWS CloudFormation, Terraform, and AWS CodePipeline (or equivalent CI/CD tools).
- EMR Architecture: Deep technical understanding of Amazon EMR architecture, cluster life cycles, and node configurations.
Preferred Qualifications
- Experience with Hadoop ecosystem, HDFS, and Big Data technologies.
- Exposure to AWS EKS (Elastic Kubernetes Service) and containerized workloads.
- Hands-on experience with Kerberos authentication and enterprise security integration.
Benefits
Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.
Originally posted on Himalayas