云与数据运维工程师
Cloud & DataOps Engineer
职位概述
职位名称:云与数据运维工程师
工作模式:远程
职能:云平台工程 / 数据工程
职级:高级 / 资深工程师
云平台:Google Cloud Platform(GCP)
主要技术:GCP、Terraform、Cloud Build、Python、BigQuery、Dataplex、Cloud Composer、Datastream、Power BI
职位目的
我们正在寻找一位经验丰富的云与数据运维工程师,负责构建、自动化、保障安全并运营GCP数据平台。该职位将专注于基础设施即代码、持续集成/持续交付(CI/CD)、环境管理、安全、可观测性以及跨开发、测试和生产环境的FinOps。
主要职责
- 构建和维护可重用的Terraform模块,用于GCP基础设施,包括VPC、VPC-SC、BigQuery、Cloud Storage、Composer、Datastream、Dataplex、IAM、KMS及相关服务。
- 使用一致的基础设施即代码模式,提供和维护开发、测试和生产环境。
- 实现Terraform远程状态、政策即代码控制和自动漂移检测。
- 构建和管理Cloud Build CI/CD流水线,用于数据摄取、转换、数据质量规则和语义模型。
- 实现自动化单元测试、集成测试、基础设施测试和数据质量测试门禁。
- 通过适当的PII屏蔽/令牌化自动化非生产环境刷新。
- 配置Cloud Logging、Cloud Monitoring、仪表板、SLA监控和故障警报。
- 实施FinOps控制,包括将账单导出到BigQuery、预算、警报、资源标签和成本报告。
- 支持云安全加固,并修复基础设施级别的渗透测试结果。
要求
- 6年以上云基础设施、平台工程、DevOps、数据运维或类似领域的经验。
- 至少3年GCP实际操作经验。
- 有支持生产级云或企业数据平台的证明经验。
- 对云基础设施、网络、安全、CI/CD和可观测性有深入理解。
- 有管理多个环境(如开发、测试和生产)的经验。
必备技能
- Google Cloud Platform(GCP)
- Terraform,包括模块设计、远程状态、环境管理及政策即代码
- Cloud Build / CI/CD
- Python用于自动化和工具开发
- BigQuery和Cloud Storage
- GCP网络:共享VPC、私有服务连接、私有Google访问
- 安全:IAM、KMS、Secret Manager、VPC服务控制
- Cloud Logging
查看英文原文
Role Overview
Job Title: Cloud & DataOps Engineer
Work Mode : Remote
Function: Cloud Platform Engineering / Data Engineering
Seniority: Senior / Lead Engineer
Cloud Platform: Google Cloud Platform (GCP)
Primary Technologies: GCP, Terraform, Cloud Build, Python, BigQuery, Dataplex, Cloud Composer, Datastream, Power BI
Role Purpose
We are looking for an experienced Cloud & DataOps Engineer to build, automate, secure, and operate the Google Cloud data platform. The role will focus on Infrastructure as Code, CI/CD, environment management, security, observability, and FinOps across Development, Test, and Production environments.
Key Responsibilities
- Build and maintain reusable Terraform modules for GCP infrastructure, including VPC, VPC-SC, BigQuery, Cloud Storage, Composer, Datastream, Dataplex, IAM, KMS, and related services.
- Provision and maintain Dev, Test, and Production environments using consistent Infrastructure as Code patterns.
- Implement Terraform remote state, policy-as-code controls, and automated drift detection.
- Build and manage Cloud Build CI/CD pipelines for data ingestion, transformation, data quality rules, and semantic models.
- Implement automated unit, integration, infrastructure, and data-quality testing gates.
- Automate non-production environment refreshes with appropriate PII masking/tokenisation.
- Configure Cloud Logging, Cloud Monitoring, dashboards, SLA monitoring, and failure alerts.
- Implement FinOps controls, including billing exports to BigQuery, budgets, alerts, resource labelling, and cost reporting.
- Support cloud security hardening and remediation of infrastructure-level penetration-test findings.
Requirements
- 6+ years of experience in Cloud Infrastructure, Platform Engineering, DevOps, DataOps, or similar roles.
- Minimum 3+ years of hands-on GCP experience.
- Proven experience supporting production-grade cloud or enterprise data platforms.
- Strong understanding of cloud infrastructure, networking, security, CI/CD, and observability.
- Experience managing multiple environments such as Dev, Test, and Production.
Must-Have Skills
- Google Cloud Platform (GCP)
- Terraform, including module design, remote state, environment management, and policy-as-code
- Cloud Build / CI/CD
- Python for automation and tooling
- BigQuery and Cloud Storage
- GCP networking: Shared VPC, Private Service Connect, Private Google Access
- Security: IAM, KMS, Secret Manager, VPC Service Controls
- Cloud Logging and Cloud Monitoring
- Automated testing and deployment gates for data pipelines
- Git workflows, code reviews, branch protection, tagged releases, and rollback
- Container fundamentals: Docker, Cloud Run, GKE
Mandatory Certification
At least one of:
- Google Cloud Professional Cloud DevOps Engineer
- Google Cloud Associate Cloud Engineer
Good-to-Have Skills
- Cloud Composer
- Dataplex
- Datastream
- GKE / Kubernetes
- Cloud Interconnect and hybrid networking
- Data masking, tokenisation, and PII protection
- FinOps and GCP cost optimisation
- GCP Billing Export to BigQuery
- Power BI for cloud consumption and cost dashboards
- Penetration-test remediation and cloud security hardening
- GitHub Actions or GitLab CI/CD
Preferred Certifications
- HashiCorp Terraform Associate
- Google Cloud Professional Cloud Security Engineer
Ideal Candidate
A hands-on Senior Cloud/DataOps Engineer with strong GCP, Terraform, CI/CD, automation, networking, security, and observability expertise who can build and operate a secure, scalable, automated, and cost-efficient enterprise data platform.
Originally posted on Himalayas