Snowflake 数据工程师
Snowflake Data Engineer
这是一个远程职位。
Snowflake 数据工程师将加入数据工程团队,负责在 Snowflake 上构建数据仓库和数据湖。该职位将专注于使用 Snowflake 数据云构建和维护可扩展、高效且可靠的数据显示流程。理想的候选人应具备对 Snowflake 架构、功能和最佳实践的深入了解。
职责:
1. 使用 Snowflake 和其他相关数据集成工具设计、构建和维护高效、可扩展且可靠的数据显示流程。
2. 与数据架构师、分析师和业务利益相关者合作,了解数据需求并提供端到端解决方案。
3. 使用最佳实践(如聚类键、物化视图和缓存)优化和性能调优 Snowflake 数据流程。
4. 通过实施适当的验证、监控和访问控制来确保数据质量、准确性和安全性。
5. 监控数据处理操作以确保及时且成功完成,并主动排查任何问题。
6. 跟踪最新的 Snowflake 功能、升级和最佳实践,持续改进数据流程。
7. 将复杂的功能和技术需求转化为详细的设计方案。
8. 通过提供指导、进行代码审查和分享专业知识来为团队的知识积累做出贡献。
要求
• 至少 [具体数字,例如“3”] 年的数据工程师或类似职位经验,有 Snowflake 的实际操作经验。
• 熟练掌握 SQL,并有 Snowflake 工具如 SnowSQL、SnowPipe 和 SnowPark 的使用经验。
• 熟悉数据建模概念和 ETL 流程。
o Data Vault 2.0
o Kimball 数据集市
• 拥有 Snowflake SnowPro 认证
• 熟悉 Python 等脚本语言。
• 强大的问题解决能力和细致的关注点。
• 优秀的沟通和协作能力
• 有 AWS 云平台的经验
• 有 Agile 方法论的经验
最初发布于 Himalayas
查看英文原文
This is a remote position.
The Snowflake Data Engineer will be a member of the data engineering team for creating a data vault and data warehouse on Snowflake.This role will focus on building and maintaining scalable, efficient, and reliable data pipelines using the Snowflake Data Cloud. The ideal candidate will have extensive knowledge of Snowflake's architecture, features, and best practices.
Responsibilities:
1. Design, build, and maintain efficient, scalable, and reliable data pipelines using Snowflake and other relevant data integration tools.
2. Collaborate with data architects, analysts, and business stakeholders to understand data needs and deliver end-to-end solutions.
3. Optimize and performance-tune Snowflake data processes using best practices such as clustering keys, materialized views, and caching.
4. Ensure data quality, accuracy, and security by implementing proper validation, monitoring, and access controls.
5. Monitor data processing operations to ensure timely and successful completion, and proactively troubleshoot any issues.
6. Stay updated with the latest Snowflake features, upgrades, and best practices to continually improve data processes.
7. Translate complex functional and technical requirements into detailed designs.
8. Contribute to the team's knowledge by providing guidance, conducting code reviews, and sharing expertise.
Requirements
• Minimum of [specific number, e.g., "3"] years of experience as a Data Engineer or similar role with hands-on experience with Snowflake. • Strong SQL skills and experience with Snowflake utilities like SnowSQL, SnowPipe, and SnowPark. • Familiarity with data modeling concepts and ETL processes. o Data Vault 2.0 o Kimball Data Marts • Snowflake SnowPro certification • Familiarity with scripting languages like Python. • Strong problem-solving skills and attention to detail. • Excellent communication and collaboration skills • Experience with AWS cloud platforms • Experience with Agile methodology
Originally posted on Himalayas