数据工程师
Data Engineer
我们是#VLteam – 技术爱好者，持续追求成长。团队是我们发展的基础，因此我们最重视的是友好的氛围、大量的自我发展机会和良好的工作条件。信任和自主性是推动我们表现的两个关键品质。我们坚信“以结果衡量，而非工时”。加入我们，亲自感受一下！
职位要求
完整职位描述：数据工程师/顾问
职位简介
你将参与定义新平台的需求和架构，实施解决方案，并在发布后继续参与其运营和维护。你的工作将引入数据治理和管理，为之前无法实现的准确且全面的报告奠定基础。
你将遵守并积极推广工程最佳实践、数据治理标准和开放标准的使用。构建数据摄入和处理流程。与相关方合作定义需求，开发数据流程和数据质量指标。
所需技能：
- Python（高级）
- Databricks/Snowflake（高级）
- 数据工程（高级）
- 强大的沟通能力，以便与相关方协作（高级）
- SQL（常规）
- Azure/AWS/GCP（常规）
- Airflow 或其他编排工具（常规）
- dbt（加分项）
- 数据建模（加分项）
- LLM 生产力工具如 Cursor/Claude Code（加分项）
- 保险领域知识将被视为一大优势（加分项）
我们通常期望：
- 具有 Python 的实际操作经验
- 具有数据仓库解决方案（如 BigQuery、Redshift、Snowflake）的实际经验
- 具有 Databricks 或数据湖仓平台的经验
- 具有数据建模、数据目录概念、数据格式以及数据流程/ETL 设计、实施和维护的扎实背景
- 能够在敏捷环境中茁壮成长，与团队成员协作解决复杂问题，保持透明度
- 具有 AWS/GCP/Azure 云服务经验，包括：GCS/S3/ABS、EMR/Dataproc、MWAA/Composer 或 Microsoft Fabric、ADF/AWS Glue
- 具有需要改进的生态系统经验，并有动力将最佳实践作为长期过程来实施
- 具有基础设施即代码实践经验，尤其是 Terraform，是加分项
- 主动的态度
- 熟悉 Spark 是加分项
- 熟悉流处理工具是加分项
查看英文原文
We are #VLteam – tech enthusiasts constantly striving for growth. The team is our foundation, that’s why we care the most about the friendly atmosphere, a lot of self-development opportunities and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of “measuring outcomes, not hours”. Join us & see for yourself!
Requirements
Full job description: Data Engineer/Consultant
About the role
You will participate in defining the requirements and architecture for the new platform, implement the solution, and remain involved in its operations and maintenance post-launch. Your work will introduce data governance and management, laying the foundation for accurate and comprehensive reporting that was previously impossible.
You will adhere to and actively promote engineering best practices, data governance standards, and the use of open standards. Build data ingestion & processing pipelines. Collaborate with stakeholders to define requirements, develop data pipelines and data quality metrics.
Required skills:
- Python (Advanced)
- Databricks/Snowflake (Advanced)
- data engineering (Advanced)
- Strong communication skills are essential to collaborate with stakeholders (Advanced)
- SQL (Regular)
- Azure/AWS/GCP (Regular)
- Airflow or other orchestration tool (Regular)
- dbt (nice to have)
- data modelling (nice to have)
- LLM productivity tools like Cursor/Claude Code (nice to have)
- Knowledge of the insurance domain will be considered a strong advantage (nice to have)
What we expect in general:
- Hands-on experience with Python
- Proven experience with data warehouse solutions (e.g., BigQuery, Redshift, Snowflake)
- Experience with Databricks or data lakehouse platforms
- Strong background in data modelling, data catalogue concepts, data formats, and data pipelines/ETL design, implementation and maintenance
- Ability to thrive in an Agile environment, collaborating with team members to solve complex problems with transparency
- Experience with AWS/GCP/Azure cloud services, including: GCS/S3/ABS, EMR/Dataproc, MWAA/Composer or Microsoft Fabric, ADF/AWS Glue
- Experience in ecosystems requiring improvements and the drive to implement best practices as a long-term process
- Experience with Infrastructure as Code practices, particularly Terraform, is an advantage
- Proactive approach
- Familiarity with Spark is a plus
- Familiarity with Streaming tools is a plus
Don’t worry if you don’t meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!
Highlights
Join our team as a Data Engineer and deliver cost-effective data migrations while implementing best practices in cutting-edge data architectures!
Originally posted on Himalayas