Data Engineer GCP/Python/SQL remote
作为数据工程师,你将与国际客户密切合作,提供咨询和技术架构来塑造可靠的高性能数据解决方案。你将处理从大数据集到分布式系统等所有内容,为数据质量设定一个高标准。责任:·利用创造力和技术开发复杂的数据挑战创新解决方案。·设计和建立满足客户需求并优化用户体验的数据系统。·跨团队协作,以整合独特方法和出箱思维,解决问题。·担任全球客户的定制数据解决方案的可信顾问和建筑师。· 管理大规模数据处理和分布式系统以确保可靠性和性能。· 保持高标准的数据质量,并完善方法来符合最佳实践。· 培养协作,工艺和持续改进文化。要求:· 在设计可扩展的数据处理系统 (管道线,ETL,数据仓库和湖泊)中经验丰富。· GCP,特别是 BigQuery 的熟练度。· 对数据转换的 Dbt 的经验。· 强大的 SQL 技能和关系数据库的经验。• 用 Apache Airflow 进行工作流调整。· Python 的熟悉度用于数据工程任务。技能:·英语沟通能力 (最低 B2). · 解决问题和分析思维能力强。最初发表在喜马拉雅山脉
查看英文原文
As a Data Engineer, you’ll work closely with international clients, providing both consultancy and technical architecture to shape reliable, high-performance data solutions.
You’ll handle everything from large data sets to distributed systems, setting a high bar for data quality.
Responsibilities:
- Develop innovative solutions for complex data challenges, using creativity and technology.
- Design and build data systems that fulfill client requirements and optimize user experience.
- Collaborate across teams to integrate unique approaches and out-of-the-box thinking into problem-solving.
- Serve as a trusted consultant and architect for customized data solutions for global clients.
- Handle large-scale data processing and manage distributed systems to ensure reliability and performance.
- Uphold high standards of data quality and refine approaches to align with best practices.
- Foster a culture of collaboration, craftsmanship, and continuous improvement.
Requirements:
- Strong experience in designing scalable data processing systems (pipelines, ETL, data warehouses, and lakes).
- Proficiency in GCP, especially BigQuery.
- Experience with dbt for data transformation.
- Strong SQL skills and experience with relational databases.
- Familiarity with Apache Airflow for workflow orchestration.
- Proficiency in Python for data engineering tasks.
Soft Skills:
- Good communication skills in English (minimum B2).
- Strong problem-solving and analytical thinking.
Originally posted on Himalayas