大数据与GCP-高级软件工程师
Big Data & GCP- Senior Software Engineer
职位简介
在 PradeepIT 加速你的职业生涯
PradeepIT 是一家全球知名的 IT 咨询公司，致力于将印度经过严格筛选的人才团队与全球客户连接起来。
我们总部位于班加罗尔，印度的硅谷。PradeepIT 的客户包括 SAP 实验室、博世、劳斯莱斯、大金、戴姆勒和强生，以及数百家财富 500 强企业和快速发展的初创公司。
通过持续的努力和自主选择远程办公，PradeepIT 被认证为“值得工作的优秀企业”！我们受到全球领先品牌和财富 500 强企业的信赖，已取得以下成就：
6+ 年经验
580+ 开源技术顾问
120+ SAP 顾问
40+ Salesforce 顾问
60+ Adobe 顾问
100+ 移动性顾问
890+ 客户覆盖亚太、欧洲中东非洲及美国地区
我们的理念
PradeepIT 相信连接全球的人，并为他们提供远程工作的机会。作为一家以人为核心的企业，PradeepIT 不断寻找那些不仅能够跟上节奏，还能突破新领域、使用前沿技术并借助 PradeepIT 学院由垂直负责人和高级架构师设计的课程自由提升技能的个人。
职责
- 设计、开发和维护 GCP 云上的数据架构、数据模型和标准，结合其他技术用于各种数据集成和数据仓库项目
- 确保使用 Big Query SQL、Java/Python/Scala 和 Spark 缩短交付周期，并与整体集团战略方向保持一致，使跨职能开发可被使用
- 从设计和架构的角度负责技术解决方案，确保正确的方向并提出潜在数据管道相关问题的解决方法
- 扩展和优化我们的数据和数据管道架构，以及优化跨职能团队的数据流和采集
- 为充满活力的工程团队提供技术指导和支持。指导和教授你的同事如何进行出色的数据工程
- 对数据架构原则和数据仓库方法论有深入理解，特别是 Kimball 或 Data Vault 方法
要求
- 在 GCP 方面是专家，至少有 5-7 年的交付经验，涉及：Dataproc、Dataflow、Big Query、Compute、Pub/Sub 和 Cloud Storage
- 非常熟悉 ETL 设计、原理和概念的行业最佳实践
- 具备 3 年以上 Python 编程语言的经验
查看英文原文
About the job
Accelerate your career with PradeepIT
PradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.
Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500 companies and fast-growing startups.
With continuous hard work and working remotely by choice, PradeepIT is certified as a Great Place to Work! Trusted by leading brands and fortune 500 companies from around the world, we have achieved:
6+ Years of Experience
580+ Open source technology Consultant
120+ SAP Consultant
40+ Salesforce Consultant
60+ Adobe Consultant
100+ Mobility Consultant
890+ Clients in APAC, EMEA & USA
Our Beliefs
PradeepIT believes in connecting people across the globe and provide them an opportunity work on remotely. Being a people-first organization, PradeepIT constantly strives for individuals who won't just keep up, but break new ground, work with cutting edge technology and ramp-up their skills with course created by our Vertical Heads, Senior Architect for freely with help of PradeepIT Academy.
Responsibilities
- Design, developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehousing projects in GCP cloud, combined with other technologies
- Ensure the use of Big Query SQL, Java/Python/Scala and Spark reduces lead time to delivery and aligns to overall group strategic direction so that cross-functional development is usable
- Ownership of technical solutions from design and architecture perspective, ensure the right direction and propose resolution to potential data pipeline-related problems.
- Expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
- Provide technical guidance and support to a vibrant engineering team. Coaching and teaching your teammates how to do great data engineering.
- A deep understanding of data architecture principles and data warehouse methodologies specifically Kimball or Data Vault.
Requirements
- An expert in GCP, with at least 5-7 years of delivery experience with: Dataproc, Dataflow, Big Query, Compute, Pub/Sub, and Cloud Storage
- Highly knowledgeable in industry best practices for ETL Design, Principles, and Concepts
- Equipped with 3 years of experience with programming languages Python
- A DevOps and Agile engineering practitioner with experience in a test-driven development
- Experienced in the following technologies: Google Cloud Platform, Dataproc, Dataflow, Spark SQL, Big Query SQL, PySpark and Python/Scala
- Experienced in the following BigData technologies: Spark, Hadoop, Kafka etc..
Technologies
- Big Data
- Spark
- Python/Scala
- GCP
Originally posted on Himalayas