高级Databricks工程师
Senior Databricks Engineers
Databricks 数据工程师（远程，美国）
职位概述
我们正在寻找一位经验丰富的 Databricks 解决方案架构师加入我们不断壮大的医疗健康分析团队。这是一份全职远程职位，位于美国。理想的候选人应具备在 Databricks 和云平台上设计和实施可扩展数据解决方案的丰富实战经验，并对医疗健康数据和现代数据架构有深入理解。
该职位为独立贡献者岗位，负责解决方案设计、技术领导以及交付高质量的数据平台，以支持分析、报告和运营决策。
主要职责
- 使用 Databricks Lakehouse 架构设计和实现可扩展的数据解决方案。
- 开发和优化用于大规模数据处理的批处理和实时数据管道。
- 领导数据集成、转换和分析工作负载的技术解决方案设计。
- 与业务利益相关者、数据工程师、分析师和产品团队合作，将需求转化为技术解决方案。
- 使用 Unity Catalog 和相关技术实现数据治理、安全性和数据质量最佳实践。
- 优化 Databricks 工作负载的性能、可靠性和成本效率。
- 支持数据仓库现代化和云迁移计划。
- 创建架构文档、技术标准和设计指南。
- 解决复杂的数据平台问题并提供技术建议。
- 跟踪 Databricks 和云平台的功能，推动最佳实践的采用。
所需资格
- 计算机科学、信息系统、工程或相关领域的学士学位。
- 至少 5 年的数据工程、数据架构或相关技术岗位的经验。
- 在企业环境中使用 Databricks 的实战经验。
- 精通 PySpark、Spark SQL、Python 和 SQL。
- 具有设计和实施 Lakehouse 架构的经验。
- 具有构建可扩展 ETL/ELT 数据管道的经验。
- 对数据建模、数据仓库和分析平台有深刻理解。
- 具有处理结构化和非结构化数据的经验。
- 强大的问题解决能力和沟通能力。
- 能够在远程环境中独立工作。
- 具有实施数据治理和安全框架的经验。
优先资格
- 医疗健康行业经验
查看英文原文
Databricks Data engineer (Remote, USA)
Position Summary
We are seeking an experienced Databricks Solution Architect to join our growing healthcare analytics team. This is a full-time, remote position based in the United States. The ideal candidate will have strong hands-on experience designing and implementing scalable data solutions on Databricks and cloud platforms, with a deep understanding of healthcare data and modern data architecture.
This role is an individual contributor position responsible for solution design, technical leadership, and delivering high-quality data platforms that support analytics, reporting, and operational decision-making.
Key Responsibilities
- Design and implement scalable data solutions using Databricks Lakehouse architecture.
- Develop and optimize batch and real-time data pipelines for large-scale data processing.
- Lead technical solution design for data integration, transformation, and analytics workloads.
- Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions.
- Implement data governance, security, and data quality best practices using Unity Catalog and related technologies.
- Optimize performance, reliability, and cost efficiency of Databricks workloads.
- Support data warehouse modernization and cloud migration initiatives.
- Create architecture documentation, technical standards, and design guidelines.
- Troubleshoot complex data platform issues and provide technical recommendations.
- Stay current with Databricks and cloud platform capabilities and drive adoption of best practices.
Required Qualifications
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- Minimum 5 years of experience in data engineering, data architecture, or related technical roles.
- Hands-on experience with Databricks in enterprise environments.
- Strong knowledge of PySpark, Spark SQL, Python, and SQL.
- Experience designing and implementing Lakehouse architectures.
- Experience building scalable ETL/ELT data pipelines.
- Strong understanding of data modeling, data warehousing, and analytics platforms.
- Experience working with structured and unstructured data.
- Strong problem-solving and communication skills.
- Ability to work independently in a remote environment.
- Experience implementing data governance and security frameworks.
Preferred Qualifications
- Experience in the healthcare industry, including claims, clinical, provider, member, or revenue cycle data.
- Experience with Azure, AWS, or GCP cloud platforms.
- Exposure to machine learning and AI/ML workloads on Databricks.
Certifications
Required:
- Databricks Certified Data Engineer Associate
- Databricks Certified Data Engineer Professional
Preferred:
· Cloud platform certifications (Azure, AWS, or GCP)
Originally posted on Himalayas