AWS ETL数据工程师 - 远程(哈利法克斯,NS,加拿大)
AWS ETL Data Engineer - REMOTE (Halifax, NS, CA)
Req ID:387430
NTT DATA致力于招募卓越、创新且充满热情的个人,他们希望与我们共同成长。如果您希望加入一个包容、灵活且具有前瞻性的工作环境,请立即申请。
我们目前正在寻找一名AWS ETL数据工程师 - 远程办公,加入我们在加拿大新斯科舍省哈利法克斯(CA-NS)的团队。
我们正在寻找一位有经验的技术人员,能够设计、开发、支持和增强企业级数据平台,同时确保符合隐私和数据治理要求。该职位结合了数据工程、系统集成、分析、解决方案设计和运营支持。
日常职责:
- 使用Spark(Scala/Python)、AWS Glue、AWS Lambda和Shell脚本设计、开发和维护可扩展的数据管道。
- 在AWS平台上构建和维护ETL/ELT流程,包括S3、Hive、Apache Iceberg和Amazon Redshift。
- 开发和维护Redshift SQL/PLSQL代码、存储过程和数据处理框架。
- 执行查询调优、性能优化和数据共享实现。
- 支持结构化和半结构化数据格式的摄入和处理,包括JSON、CSV、XML、ORC、Parquet和Avro。
- 设计、增强和支持提供跨系统客户数据统一视图的解决方案。
- 集成多个数据源、应用程序和业务流程,以支持报告、分析和客户参与计划。
- 与业务和技术团队合作,定义和实施可扩展的数据解决方案。
- 管理和支持数据主体请求(DSRs),包括客户数据删除请求。
- 与DPO团队紧密合作,确保符合隐私法规和内部政策。
- 维护和支持MicroStrategy隐私合规模块。(非常少见,每年或每两年一次)
- 参与数据治理计划,以提高数据质量、一致性和合规性。
- 使用Redshift SQL、MySQL、Python/PySpark、Shell脚本和Excel分析和解决复杂的数据问题。
- 调查数据不一致、报告问题和业务数据异常。
- 支持与客户等级、忠诚度计划和电子邮件营销相关的业务分析。
- 为关键数据平台问题提供生产支持和根本原因分析。
技术领导力与协作
- 参与客户360、隐私、数据治理和Phaedon项目。
- 协作
查看英文原文
Req ID:387430
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a AWS ETL Data Engineer - REMOTE to join our team in Halifax, Nova Scotia (CA-NS), Canada (CA).
We are seeking an experienced technical resource who could design, develop, support, and enhance enterprise data platforms while ensuring compliance with privacy and data governance requirements. The role combines data engineering, systems integration, analytics, solution design, and operational support.
Day to Day Responsibilities:
- Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting.
- Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift.
- Develop and maintain Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
- Perform query tuning, performance optimization, and data-sharing implementations.
- Support ingestion and processing of structured and semi-structured data formats including JSON, CSV, XML, ORC, Parquet, and Avro.
- Design, enhance, and support solutions that provide a unified view of customer data across systems.
- Integrate multiple data sources, applications, and business processes to support reporting, analytics, and customer engagement initiatives.
- Collaborate with business and technical teams to define and implement scalable data solutions.
- Manage and support Data Subject Requests (DSRs), including customer data erasure requests.
- Work closely with the DPO team to ensure compliance with privacy regulations and internal policies.
- Maintain and support the MicroStrategy Privacy Compliance module. (Very infrequent once in year or 2 years)
- Contribute to data governance initiatives that improve data quality, consistency, and compliance.
- Analyze and troubleshoot complex data issues using Redshift SQL, MySQL, Python/PySpark, Shell scripting, and Excel.
- Investigate data mismatches, reporting issues, and business data anomalies.
- Support business analysis related to customer tiers, loyalty programs, and email marketability.
- Provide production support and root-cause analysis for critical data platform issues.
Technical Leadership & Collaboration
- Participate in Customer 360, Privacy, Data Governance, and Phaedon initiatives.
- Conduct code reviews and design reviews.
- Provide cross-team technical support and problem resolution.
- Research, design, and develop next-generation data capabilities and products.
- Act as a subject matter expert for customer data platforms.
Primary Technologies
- AWS: S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
- Spark (Scala/Python)
- Redshift SQL/PLSQL, MySQL
- Data Modeling and Query Optimization
Key Strengths
- Strong ownership and accountability
- Strong AWS Data Engineering stack awareness
- Ability to bridge business and technical teams
- Expertise across engineering, analytics, compliance, architecture, and operational support
- Adaptability and willingness to take on diverse data-related challenges
Minimum Requirements:
- 10+ years of experience in Data Warehouse / Big Data ecosystems.
- 5+ years in a lead /SME role
- 5+ years with AWS architecture and data engineering, including S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
- 3+ years with Spark (Scala/Python)
- 5+ years with SQL/PLSQL, MySQL
- 5+ years strong understanding of:
- Data architecture & dimensional modeling
- ETL/ELT frameworks
- Distributed data processing
- Cloud data platforms
- Data governance and security
Preferred Skills:
- Experience managing large-scale enterprise data environments.
- Proven track record of delivering complex data programs.
- Excellent communication and stakeholder management abilities.
- Experience in large enterprise or global delivery environments.
- Exposure to data modernization and cloud transformation programs.
- Certifications in cloud platforms or data engineering.
- Experience in regulated industries (Hospitality, Finance, Healthcare, Telecom, etc.).
NTT DATA provides a reasonable range of compensation for Canada-based positions. The starting pay range for this remote role is $86,212 - $133,100 Canadian. This range reflects the minimum and maximum target compensation for the position across all Canada locations. Actual compensation will depend on a number of factors, including the candidate’s actual work location, relevant experience, technical skills, and other qualifications.
This position may also be eligible for incentive compensation based on individual and/or company performance.
This position is eligible for the Company’s comprehensive benefits program in Canada, including customizable health and dental coverage with telemedicine, wellness credits, and gym discounts. Employees receive income protection through life, disability, and optional insurance plans, plus access to a 24/7 Employee Assistance Program. Additional perks include retirement savings, a remote work allowance for eligible employees, and various discounts and travel insurance.
About NTT DATA
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.
Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client’s needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, .
NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.
Originally posted on Himalayas