高级数据工程师
Senior Data Engineer
职位：高级数据工程师位置：远程 （美国）工资125K-155K+12%奖金经验- 5-8年开放角色数 1责任：·设计和构建使用 SQL,DBT 和 Jinja 模板的强大可扩展数据转换管道 ·开发并维护 DBT 和亚马逊红晶体采用的数据集成和数据仓库项目数据架构和标准 ·与跨功能团队合作收集要求并提供作为一个单一来源的尺寸数据模型 ·拥有全堆 DBT 中的数据建模，赋予分析师，数据科学家和 BI 工程师能力 · 提高和维护分析代码库，包括 DBT 模型，SQL 脚本和 ERD 文档 ·确保数据管道的数据质量，治理配对和运营准备性 ·应用软件工程最佳实践如版本控制，CI/CD 和代码审查 ·优化 SQL 查询性能，可扩展性和可维护性在大型数据集中 ·实施 SQL 性能调整的最佳实践，包括分区，聚类和现实的视图 ·使用 AWS CDK 作为代码管理可扩展和重复部署。通过 AWS CodeCommit,CodePip 工具以及相关 DevOps 系统将部署工作流进行集成并自动化 ·支持敏捷开发过程和与离岸团队合作 要求资格：· 数量或技术领域的学士学位，例如统计学，数学，计算机科学，信息技术，计算机工程等等；· 5年以上现代数据平台上的数据工程和分析经验；3年以上使用 DBT 或类似数据转换工具的广泛经验，包括构建复杂且可维护的 DBT 模型以及开发 DBT 包/宏观程序。· 深入熟悉维度建模/数据仓库概念和设计，实施，运营和扩展企业维度模型的专业知识 ·了解变化数据捕获理念 ·与 AWS 服务 (Lambda, Step Functions, MWAA, Glue, Redshift) 合作经验 · AWS CDK, CodeCommit 和 CodePipeline 的实践经验基础设施自动化和 CI/CD · Python 技能或一般知识在 python 和/ PySpark 中 Jinja 模板 ·敏捷的经验和愿意与扩大海上团队一起工作并协助客户进行设计和代码评审 · A
查看英文原文
Job Title: Senior Data Engineer
Location: Remote (US)
Salary 125K-155K + 12% bonus
Experience- 5-8 years
No. of open roles 1
Responsibilities:
- Design and build robust, scalable data transformation pipelines using SQL, DBT, and Jinja templating
- Develop and maintain data architecture and standards for Data Integration and Data Warehousing projects using DBT and Amazon Redshift
- Collaborate with cross-functional teams to gather requirements and deliver dimensional data models that serve as a single source of truth
- Own the full stack of data modeling in DBT to empower analysts, data scientists, and BI engineers
- Enhance and maintain the analytics codebase, including DBT models, SQL scripts, and ERD documentation
- Ensure data quality, governance alignment, and operational readiness of data pipelines
- Apply software engineering best practices such as version control, CI/CD, and code reviews
- Optimize SQL queries for performance, scalability, and maintainability across large datasets
- Implement best practices for SQL performance tuning, including partitioning, clustering, and materialized views
- Build and manage infrastructure as code using AWS CDK for scalable and repeatable deployments. Integrate and automate deployment workflows using AWS CodeCommit, CodePipeline, and related DevOps tools
- Support Agile development processes and collaborate with offshore teams
Required Qualifications:
- Bachelors or Masters (preferred) degree in a quantitative or technical field such as Statistics, Mathematics, Computer Science, Information Technology, Computer Engineering or equivalent
- 5+ years of experience in data engineering and analytics on modern data platforms
- 3+ years extensive experience with DBT or similar data transformation tools, including building complex & maintainable DBT models and developing DBT packages/macros
- Deep familiarity with dimensional modeling/data warehousing concepts and expertise in designing, implementing, operating, and extending enterprise dimensional models
- Understand change data capture concepts
- Experience working with AWS Services (Lambda, Step Functions, MWAA, Glue, Redshift)
- Hands-on experience with AWS CDK, CodeCommit, and CodePipeline for infrastructure automation and CI/CD
- Python proficiency or general knowledge of Jinja templating in Python and/or PySpark
- Agile experience and willingness to work with extended offshore teams and assist with design and code reviews with customer
- A great teammate and self-starter, strong detail orientation is critical in this role.
Originally posted on Himalayas