高级数据工程师 - 全球，兼职
Senior Data Engineer - Worldwide, Part Time
职位概述：
我们正在寻找一位高级数据工程师，在以云为主导的环境中领导可扩展、可靠且高效的解决方案开发。该职位需要深入理解ETL/ELT流程、AWS数据服务以及管道编排，以支持企业级分析和决策系统。
你将与数据团队、分析师和工程师紧密合作，将原始数据转化为可操作的见解，并支持驱动数据的产品基础设施。
这是一个独特的机会，加入一家高增长的初创公司，采用100%股权薪酬模式，你的成功将直接与公司的发展挂钩。你将成为基础团队的一员，直接参与长期价值的创造。
主要职责：
- 设计、构建和维护高效且可靠的ETL/ELT管道，处理大规模数据。
- 使用AWS Glue、Python和SQL开发和管理云原生数据管道。
- 使用AWS Step Functions编排数据工作流和有状态任务，实现强大的流程管理和自动化。
- 在Amazon S3中存储和管理大型数据集，采用高效的分区、数据格式（如Parquet）和访问控制策略。
- 在PostgreSQL中设计和优化关系型数据结构，确保数据准确性和性能。
- 在所有管道流程中实现数据质量监控、日志记录和警报功能。
- 与跨职能团队协作，定义数据需求，确保数据的一致性、可用性和可访问性。
- 参与代码审查、架构讨论和工程最佳实践的持续改进。
- 确保符合数据安全、隐私和治理标准。
我们寻找的人选：
- 5年以上数据工程师或类似数据导向工程岗位的工作经验。
- 在生产环境中具有构建和管理ETL/ELT管道的丰富经验。
- 具备AWS Glue和Step Functions的实际操作经验。
- 深入了解Amazon S3和数据湖的最佳实践。
- 精通SQL，特别是PostgreSQL，包括性能调优和复杂查询。
- 具备扎实的Python编程技能（或类似语言），用于数据处理。
- 具有设计可扩展数据架构和工作流编排解决方案的经验。
- 熟悉CI/CD工具、版本控制（如Git）和DevOps原则。
加分项：
- 具有其他AWS数据服务（如At）
查看英文原文
Role Summary:
We are looking for a Senior Data Engineer to lead the development of scalable, reliable, and efficient data solutions in a cloud-first environment. This role requires a deep understanding of ETL/ELT processes, AWS data services, and pipeline orchestration to support enterprise-grade analytics and decision-making systems.
You will work closely with data, analysts, and engineers to transform raw data into actionable insights and support the infrastructure that powers data-driven products.
This is a unique opportunity to join a high-growth startup on a 100% equity-based compensation model, aligning your success directly with the company's. You'll be part of the foundational team and directly participating in long-term value creation.
Key Responsibilities:
- Design, build, and maintain ETL/ELT pipelines that process large-scale data efficiently and reliably.
- Develop and manage cloud-native data pipelines using AWS Glue, Python, and SQL.
- Orchestrate data workflows and stateful jobs using AWS Step Functions for robust process management and automation.
- Store and manage large datasets in Amazon S3 with efficient partitioning, data formats (e.g., Parquet), and access control strategies.
- Design and optimize relational data structures in PostgreSQL, ensuring data accuracy and performance.
- Implement data quality monitoring, logging, and alerting within all pipeline processes.
- Collaborate with cross-functional teams to define data requirements and ensure consistency, availability, and accessibility.
- Participate in code reviews, architecture discussions, and continuous improvement of engineering best practices.
- Ensure adherence to data security, privacy, and governance standards.
What We're Looking For:
- 5+ years of experience as a Data Engineer or in a similar data-focused engineering role.
- Strong experience building and managing ETL/ELT pipelines in production environments.
- Hands-on experience with AWS Glue and Step Functions.
- Deep understanding of Amazon S3 and data lake best practices.
- Advanced proficiency in SQL, particularly with PostgreSQL, including performance tuning and complex queries.
- Solid programming skills in Python (or similar languages) for data processing.
- Experience designing scalable data architectures and workflow orchestration solutions.
- Familiarity with CI/CD tools, version control (e.g., Git), and DevOps principles.
Bonus Skills:
- Experience with other AWS data services (e.g., Athena, Lambda).
- Familiarity with workflow orchestration alternatives (e.g., AWS Step Functions).
- Exposure to modern data modeling concepts
- Knowledge of data security and compliance frameworks (e.g., GDPR).
What we Offer
- Equity: Participation in VendueTech Ltd ESOP Trust, with share allocation based on hours worked and achievements.
- Opportunity to work on innovative, data & AI-driven projects transforming the real estate auction market.
- Flexible remote work environment with global collaboration.
- Direct contribution to the success and growth of a mission-driven, forward-thinking company.
VendueTech is an equal opportunity employer and does not discriminate on the basis of race, religion, gender identity or expression, national origin, age, disability, marital status, sexual orientation, or any other legally protected characteristics. We are committed to creating a diverse and inclusive workplace and encourage applications from all qualified individuals.
Originally posted on Himalayas