高级数据工程师（AWS、Python 和 SQL）
Senior Data Engineer (AWS, Python & SQL)
我们寻找一位高级数据工程师，负责设计、构建和优化可扩展的数据平台，以支持数据分析、电子商务、物流和营销计划。该职位将负责开发稳健的数据管道，改进数据基础设施，并在AWS环境中确保高质量、可靠的数据解决方案。理想的候选人具备Python、SQL、Spark、Airflow和基于云的数据架构方面的专业知识，同时具备出色的沟通能力和协作精神。
职责
- 为数据分析、电子商务、物流和营销设计、构建和维护可扩展的数据管道。
- 改进和维护公司的数据基础设施和工具，包括Redshift/Snowflake、Airflow和Fivetran。
- 构建能够处理复杂数据流和大规模数据集的数据处理系统。
- 在AWS环境中开发可靠、高效且成本效益高的数据解决方案。
- 通过自动化和最佳工程实践确保高标准的数据质量。
- 优化平台性能、弹性、可扩展性和运营成本。
- 与软件工程师、分析师和业务利益相关者紧密合作。
- 指导工程师和分析师遵循数据工程的最佳实践。
- 参与架构讨论和技术决策。
要求
必须具备
- 4年以上使用现代数据技术的数据工程师经验。
- 精通Python和SQL。
- 具备处理大规模数据集的经验。
- 熟悉Apache Spark和Apache Airflow。
- 具备在AWS中设计和构建数据处理系统的经验。
- 具备Redshift和/或Snowflake的经验。
- 了解Fivetran或其他类似的数据采集工具。
- 熟悉数据质量、自动化和数据工程最佳实践。
- 出色的沟通和人际交往能力。
加分项
- 具备Kafka或AWS Kinesis Firehose等流媒体技术的经验。
- 了解Docker和/或Kubernetes。
- 熟悉Ruby或R。
- 具备构建或迁移数据仓库的经验。
- 具备领导项目或指导技术团队的经验。
福利
稳定长期合同。持续培训。私人健康保险。灵活的工作时间。与拉丁美洲和美国最优秀的软件工程师一起工作，完成具有挑战性的任务，为客户打造世界级的软件。
查看英文原文
We are looking for a Senior Data Engineer to design, build, and optimize scalable data platforms that support analytics, ecommerce, logistics, and marketing initiatives. This role will be responsible for developing robust data pipelines, improving the data infrastructure, and ensuring high-quality, reliable data solutions in an AWS environment. The ideal candidate has strong expertise in Python, SQL, Spark, Airflow, and cloud-based data architectures, along with excellent communication skills and a collaborative mindset.
Responsibilities
- Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing.
- Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran.
- Architect data processing systems capable of handling complex data flows and large-scale datasets.
- Develop reliable, efficient, and cost-effective data solutions in an AWS environment.
- Ensure high standards of data quality through automation and best engineering practices.
- Optimize platform performance, resiliency, scalability, and operational costs.
- Collaborate closely with software engineers, analysts, and business stakeholders.
- Mentor engineers and analysts on data engineering best practices.
- Participate in architecture discussions and technical decision-making.
Requirements
Must Have
- 4+ years of experience as a Data Engineer working with modern data technologies.
- Strong proficiency in Python and SQL.
- Experience processing large-scale datasets.
- Hands-on experience with Apache Spark and Apache Airflow.
- Experience designing and architecting data processing systems in AWS.
- Experience with Redshift and/or Snowflake.
- Knowledge of Fivetran or similar data ingestion tools.
- Strong understanding of data quality, automation, and data engineering best practices.
- Excellent communication and interpersonal skills.
Nice to Have
- Experience with streaming technologies such as Kafka or AWS Kinesis Firehose.
- Knowledge of Docker and/or Kubernetes.
- Familiarity with Ruby or R.
- Experience building or migrating a Data Warehouse.
- Experience leading projects or mentoring technical teams.
Benefits
A stable, long-term contract. Continuous Training. Private Health insurance. Flexible schedule. Work with some of the most talented software engineers in Latin America and the US, doing challenging work and world-class software for clients in the US and around the world.
At Devsu, we believe in creating an environment where you can thrive both personally and professionally. By joining our team, you’ll enjoy:
• A stable, long-term contract with opportunities for career growth
• Private health insurance
• A remote-friendly culture that promotes work-life balance
• Continuous training, mentorship, and learning programs to keep you at the forefront of the industry
• Free access to AI training resources and state-of-the-art AI tools to elevate your daily work
• A flexible Paid Time Off (PTO) policy as well as paid holiday days
• Challenging, world-class software projects for clients in the US and LatAm
• Collaboration with some of the most talented software engineers in Latin America and the US, in a diverse work environment
Join Devsu and discover a workplace that values your growth, supports your well-being, and empowers you to make a global impact.
Originally posted on Himalayas