Software Developer/Data Engineer
软件开发者/数据工程师 - 12个月合同教育资格 · 本科计算机科学 / BEng 专业资格 · AWS 专业认证经验年 · 4至8年的数据工程或软件开发经验在数据驱动生态系统上工作技能 /要求 · 4到8年的数据技术或软件发展经验在 Data 驱动生態系统上工作 ·需要使用 BA 提供的载荷器规范编码复杂转型 ·与大数据集团合作和解决数据相关挑战 ·通过 AWS Lambda 或 Glue 构建吞管道来自动化摄入能力 · 编码语言的熟练知识：PySpark, Python,SQL · 在 AWS 服务中实践经验，包括 S3,Athena,Lambda Functions,GLUE,EC2 · AWS 经验和需要 AWS 认证 · 数据建模和数据架构设计的经验关键责任 · 使用 PySpark,Python,SQL 实现可扩展的数据管道和建筑 ·建立在 AWS Lambda 和 Glue 上运行的分布式数据管道与计算层次 ·作为团队成员和初级工程师的技术资源 · 与团队合作提供符合业务要求的高质量解决方案 ·确保代码是精心设计，可维护，并遵循最佳实践和标准 · 通过在一个 Scrum 团队中工作，以确保实现冲刺交付结果。• 使用像 JIRA,Confluence 和 GIT 这样的项目开发工具。•协助 DEVOPS 工程师自动化和 CI/CD 实践。•评估并推新技术来提高软件系统性能，可扩展性和可靠性。原创发布于喜马拉雅山。
查看英文原文
Software Developer/Data Engineer - 12 Month Contract
Educational Qualifications
· BSc Computer Science / BEng
Professional Qualifications
· AWS Professional Certification
Years of Experience
· 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
Skills / Requirements
- 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
- Required to code complex transformations using loader specifications provided by the BA
- Experience working with Big Data sets and solving data-related challenges
- Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
- Proficiency in coding languages: PySpark, Python, SQL
- Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2
- AWS experience and AWS certification required
- Experience in data modeling and data architecture design
Key Responsibilities
- Implement scalable data pipelines and architectures using PySpark, Python, SQL
- Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
- Serve as a technical resource for team members and mentor junior engineers
- Collaborate with the team to deliver high-quality solutions that meet business requirements
- Ensure code is well-designed, maintainable, and follows best practices and standards
- Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
- Utilize project development tools such as JIRA, Confluence, and GIT
- Assist DEVOPS Engineer in automation and CI/CD practices
- Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.
Originally posted on Himalayas