高级数据工程师
Senior Data Engineer
Zencore 是一家由前 Google Cloud 领导人、架构师和工程师创立的快速发展的公司。我们正在寻找在 Google Cloud 有丰富经验的候选人加入我们的团队。我们的项目旨在消除障碍，降低风险，并加快客户向 Google 迁移的进程，同时帮助他们进行数据和应用现代化。我们将嵌入客户团队中，提供战略指导，促进技术决策，并以协作、共同开发的方式执行项目。
你将负责...
作为我们的数据工程团队成员，你将与快速发展的创新公司合作，利用云作为其转型的关键驱动力。他们会将你视为值得信赖的顾问，一个可以依靠并帮助他们完成 Google Cloud 旅程的人。你将需要覆盖广泛的技术主题，如 ETL/ELT、数据仓库、分布式数据处理和流数据系统。
职责：
使用 Apache Beam / Google Cloud Dataflow、Apache Spark 或 Apache Flink 设计、构建和优化大规模分布式数据流水线。
在 GCP 上开发 ETL/ELT 工作流，整合多个结构化和非结构化数据源。
在将数据仓库迁移到 BigQuery 时解决模式、类型转换和性能优化问题。
在流水线中实现可观测性、监控、日志记录和错误处理。
与数据分析师合作，将验证规则、质量检查和自动化测试集成到流水线生命周期中。
支持大规模数据迁移和高吞吐量工作负载的性能调优。
我们是一家完全远程的公司，提供具有竞争力的薪酬和福利。
Zencore 致力于打造多元化和包容性的工作环境。Zencore 是一家平等机会雇主，不会基于种族、国籍、性别、性别认同、性取向、退伍军人身份、残疾、年龄或其他受法律保护的身份而歧视。
我们需要的人...
· 在现代云环境中担任数据工程师 4 年以上。
· 在 GCP（BigQuery、Dataflow、Dataform、Composer、Dataproc、Pub/Sub）上有 2 年以上的实际操作经验。
· 在分布式数据处理框架方面有丰富经验（至少需要一种框架的经验）
· Apache Beam / Google Cloud Dataflow
· Apache Spark
· Apache Flink
熟练掌握：
· Python（流水线开发）
· SQL（Oracle 和 BigQuery 语法理想）
查看英文原文
Zencore is a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google Cloud to join our team. Our engagements aim to eliminate obstacles, reduce risk, and accelerate timelines for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to provide strategic guidance, facilitate technology decisions, and execute projects in a collaborative, co-development style.
What you will do...
As a member of our Data Engineering team, you will be working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Google Cloud. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems.
Responsibilities:
Design, build, and optimize large-scale distributed data pipelines using Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
Develop ETL/ELT workflows on GCP integrating multiple structured and unstructured data sources.
Address schema, type conversion, and performance optimization challenges when migrating data warehouses to BigQuery.
Implement observability, monitoring, logging, and error-handling within pipelines.
Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle.
Support large-scale data migrations and performance tuning for high-volume workloads.
We are a fully remote company and offer competitive compensation and benefits.
Zencore is committed to a diverse and inclusive workplace. Zencore is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Who we need...
· 4+ years working as a Data Engineer in modern cloud environments.
· 2+ years hands-on experience in GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).
· Strong experience with distributed data processing frameworks (experience in at least one is required)
· Apache Beam / Google Cloud Dataflow
· Apache Spark
· Apache Flink
Proficiency in:
· Python (pipeline development)
· SQL (Oracle + BigQuery dialects ideal)
· Apache Airflow (orchestration)
· Experience with big data workloads, batch/streaming pipelines, and large-scale data migrations.
· Experience with data warehousing (BigQuery, Snowflake, Databricks a plus).
· Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.
Why work here...
· We are professionals you can Trust. Our people have the extensive experience to get the job done
· We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers.
· We are the Missing Link. You will connect our customers to Google and move quickly when others can’t
· We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers
· We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers
· We show empathy. Our customers believe in us because we can relate to their complexities.
How to succeed...
· First rule at Zencore - Be Kind
· Own the process - own your customer’s success by proactive practices
· Work hard to reach the destination, but make sure to enjoy the journey
· Champion a consistent collaborative culture
· Be receptive to Feedback
· Challenge the Status Quo