高级数据工程师 - 数据分析
Sr. Data Engineer - Data Analytics
我们正在为一家国际客户招聘一名高级数据工程师。这是一份100%远程的工作。该职位人员将在印度工作,并与全球团队合作。
总经验:7年以上
你的职责
- 在需求分析、可扩展且低延迟的流媒体平台解决方案设计、架构以及关键模块的端到端交付中承担主要责任,以为我们产品提供实时数据解决方案
- 使用Go、Typescript/Node.js/Scala/Python/SQL编写干净可扩展的代码,并测试和部署应用程序和系统
- 解决我们最复杂的数据问题,在实时环境中,利用最优的数据架构、框架、查询技术,从结构化和非结构化数据源获取数据
- 作为工程团队的一员,为客户提供高质量、安全且可扩展的解决方案
- 参与产品和平台性能优化及线上监控
- 通过给予和接受可操作的反馈来指导团队成员
我们的技术栈:
- AWS(Lambda、SQS、Kinesis、KDA、Redshift、Athena、DMS、Glue、Go/Typescript、Dynamodb)、Airflow、Flink、Spark、Looker、EMR
- 基于GitLab的持续部署流程
你还需要具备以下条件:
- 技术领域的学士学位(如计算机科学或数学)
- 3年以上实时、事件驱动架构的经验
- 3年以上使用现代编程语言(如Scala、Python、Go、Typescript)的经验
- 具有设计复杂数据处理流程的经验
- 具有数据建模经验(星型模式、维度建模等)
- 具有查询优化经验
- 具有Kafka经验者优先
- 具有在生产环境中发布和维护代码的经验
- 你喜欢分享想法,思维开放
为什么加入我们?
🚀 一个增长和机会的关键时刻
💆♀️ 我们重视员工,工作与生活平衡很重要
📚 快速学习的环境,具有创业精神和强烈的团队精神
🌍 45+个国家的员工:具有国际化和多元文化思维
💶 竞争力的薪资包及福利(健康保险、午餐、通勤、运动)
DE&I声明:
我们认为无论出身、身份、背景和取向,多样性、公平性和包容性都是我们旅程的核心。
具备Scala/Python的数据建模经验,实时/流数据处理经验。具有复杂数据处理流程和数据建模经验。
计算机科学学士/本科
你可以来自任何地区
查看英文原文
We are looking for a Sr. Data Engineer for an International client. This is a 100% remote job. The person will be working from India and will be collaborating with global team.
Total Experience: 7+ Years
Your role
- Have key responsibilities within the requirements analysis, scalable & low latency streaming platform solution design, architecture, and end-to-end delivery of key modules in order to provide real-time data solutions for our product
- Write clean scalable code using Go, Typescript / Node.js / Scala / python / SQL and test and deploy applications and systems
- Solve our most challenging data problems, in real-time, utilizing optimal data architectures, frameworks, query techniques, sourcing from structured and unstructured data sources.
- Be part of an engineering organization delivering high quality, secure, and scalable solutions to clients
- Involvement in product and platform performance optimization and live site monitoring
- Mentor team members through giving and receiving actionable feedback.
Our tech. stack:
- AWS (Lambda, SQS, Kinesis, KDA, Redshift, Athena, DMS, Glue,Go/Typescript, Dynamodb), Airflow, Flink, Spark, Looker, EMR
- A continuous deployment process based on GitLab
A little more about you:
- A Bachelor's degree in a technical field (eg. computer science or mathematics).
- 3+ years experience with real-time, event driven architecture
- 3+ years experience with a modern programming language such as Scala, Python, Go, Typescript
- Experience of designing complex data processing pipeline
- Experience of data modeling(star schema, dimensional modeling etc)
- Experience of query optimisation
- Experience of kafka is a plus
- Shipping and maintaining code in production
- You like sharing your ideas, and you're open-minded
Why join us?
🚀 Key moment to join in term of growth and opportunities
💆♀️ Our people matter, work-life balance is important
📚 Fast-learning environment, entrepreneurial and strong team spirit
🌍 45+ Nationalities: cosmopolite & multi-cultural mindset
💶 Competitive salary package & benefits (health coverage, lunch, commute, sport
DE&I Statement:
We believe diversity, equity and inclusion, irrespective of origins, identity, background and orientations, are core to our journey.
Hands-on experience in Scala / Python with Data Modeling, Real Time / Streaming Data. Experience of complex data processing pipeline and Data Modeling.
BE/ BTech in Computer Science
You can be based out of any part of India. This is a 100% Remote job.
An MNC servicing their clients in Digital Transformation journey.
Originally posted on Himalayas