高级AWS数据工程师 - 自由职业
Senior AWS Data Engineer - freelance
通过多样性、公平和包容实现增长。作为一家有道德的企业，我们做正确的事——包括确保平等的机会，并在每个员工中培养安全、尊重的工作环境。我们认为多样性推动个人和业务的增长。我们致力于打造一个包容的社区，无论背景、身份或其他个人特征如何，我们的每个人都能茁壮成长。
该项目的高级数据工程师将负责维护和开发全面的数据工程平台。该职位专注于构建可扩展、可重用的解决方案，这些方案可以在项目框架内的多个国家和业务环境中部署。
任务
• 使用 AWS 原生技术栈开发和维护数据工程平台
• 使用现代 Python 开发实践设计和实现通用模块，这些模块可在不同国家和业务环境中重用
• 应用面向对象编程原则，创建可维护和可扩展的数据处理解决方案
• 在敏捷开发团队中有效协作，按时交付高质量的解决方案
• 识别现有数据和建议生成流程中的问题根源，并实施稳健的修复方案（跨 AWS Step Functions、Glue、Athena 和 Lambda 进行调试）
• 利用现代 Python 开发工具和工程实践，确保代码质量、测试和部署效率
要求
• 高级 Python 编程技能，特别在以下方面有较强能力：
o pandas 用于数据操作和分析
o 面向对象编程（OOP）原则和设计模式
o 现代 Python 开发工具和最佳实践
• AWS 云技术经验，特别是：
o AWS Glue 用于 ETL 流程
o Amazon Athena 用于数据查询
o DynamoDB 用于 NoSQL 数据存储
o AWS Step Functions 和 Lambda 用于工作流编排
• 对云架构有深入理解，尤其是基于 AWS 的解决方案
• 有敏捷软件开发方法和常用项目管理工具（如 Azure DevOps）的经验
• 有 5-10 年数据工程经验，有全球或区域项目经验者优先
• 有现代软件工程实践经验，包括 CI/CD、版本控制和自动化测试
如果缺少其中一两项资格？我们仍然希望收到你的申请！如果你有积极的心态，我们会与你联系！
查看英文原文
Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.
The Senior Data Engineer for the project will be responsible for maintaining and developing a comprehensive Data Engineering platforms. This role focuses on building scalable, reusable solutions that can be deployed across multiple countries and business environments within the project framework.
Tasks
• Develop and maintain the Data Engineering platforms using AWS Native stack
• Design and implement generalized modules using modern Python development practices that are reusable across various countries and business settings
• Apply object-oriented programming principles to create maintainable and scalable data processing solutions
• Collaborate effectively within agile development teams to deliver high-quality solutions on schedule
• Identify root causes of issues with existing data and suggestion generation pipelines and implement robust fixes (debugging across AWS Step Functions, Glue, Athena, and Lambda)
• Leverage modern Python development tools and engineering practices to ensure code quality, testing, and deployment efficiency
Requirements
• Advanced Python programming expertise, with particular strength in: o pandas for data manipulation and analysis o Object-oriented programming (OOP) principles and design patterns o Modern Python development tools and best practices
• AWS cloud technologies experience, specifically: o AWS Glue for ETL processes o Amazon Athena for data querying Information Sensitivity: General\Internal o DynamoDB for NoSQL data storage o AWS Step Functions and Lambda for workflow orchestration
• Strong understanding of cloud architectures, particularly AWS-based solutions
• Experience with agile software development methodologies and common project management tools (e.g., Azure DevOps)
• 5-10 years of data engineering experience with global or regional project exposure is nice to have
• Experience with modern software engineering practices including CI/CD, version control, and automated testing
Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.
Originally posted on Himalayas