Databricks 工程师
Databricks Engineer
构建重要事物的Databricks工程师职位在RevStar。
RevStar是一家Databricks合作伙伴，正在推出一个以数据、机器学习（ML）和人工智能（AI）服务为核心的跨云实践。我们的使命是帮助企业在数据平台现代化、优化分析工作流以及使用Databricks实现可扩展的AI驱动解决方案方面取得进展。
我们对所构建的内容以及构建方式充满热情。从架构和设计到编码和交付，我们以敏捷的心态对待每个项目，持续分析目标和业务需求，以确保最佳结果。
在RevStar，我们营造一种协作、以远程优先的文化，团队可以自由分享想法、共同创新，并在个人和集体层面成长。加入我们，你将有机会在多个行业中使用前沿技术，为重视质量和性能的客户提供价值驱动的产品。我们相信追求更好，不仅是在云原生应用开发中，更是在创造有意义的体验和成果上。
我们正在寻找一位高度熟练的Databricks工程师加入我们的团队。该职位需要亲力亲为，与架构师、数据科学家和客户紧密合作，构建、优化和部署高性能的数据和AI解决方案。
作为Databricks工程师，你将负责构建和优化数据管道，实现数据处理框架，并在Databricks中启用AI/ML解决方案。你将在数据摄取、转换和编排方面开展工作，同时确保可扩展性、性能和安全性。
这是一个需要技术实操能力的职位，要求精通Apache Spark、Delta Lake和MLOps，以及在大规模数据架构方面的经验。你将与架构师和业务利益相关者合作，确保解决方案符合客户需求和最佳实践。
最重要的是，理想的候选人体现了RevStar的核心价值观：
- 自我精进：我们对如何思考、沟通和提升设定了高标准。
- 责任感：我们关注结果，而不仅仅是努力。
- 共同命运：我们共荣共辱。
关键职责
数据工程与管道开发
- 使用Apache Spark和Delta Lake在Databricks中开发和优化数据管道。
- 实现ETL/ELT工作流，确保高效的数据摄取、转换和存储。
- 设计基于Lakehouse架构的解决方案，实现结构化和非结构化数据的扩展。
查看英文原文
Build what matters as a Databricks Engineer at RevStar.
RevStar is a Databricks Partner launching a cloud-agnostic practice focused on Data, Machine Learning (ML), and Artificial Intelligence (AI) services. Our mission is to help businesses modernize their data platforms, optimize analytics workflows, and implement scalable AI-driven solutions using Databricks.
We are passionate about what we build and how we build it. From architecture and design to coding and delivery, we approach each project with an agile mindset, continuously analyzing goals and business needs to ensure optimal outcomes.
At RevStar, we foster a collaborative, remote-first culture where teams freely share ideas, innovate together, and grow both individually and collectively. By joining us, you’ll have the opportunity to work with cutting-edge technologies across diverse industries, delivering value-driven products for clients who prioritize quality and performance. We believe in the pursuit of better, not just in cloud-native app development, but in creating meaningful experiences and outcomes that matter.
We are seeking a highly skilled Databricks Engineer to join our team. This role will be hands-on, working closely with architects, data scientists, and customers to build, optimize, and deploy high-performance data and AI solutions.
As a Databricks Engineer, you will be responsible for building and optimizing data pipelines, implementing data processing frameworks, and enabling AI/ML solutions within Databricks. You will work across data ingestion, transformation, and orchestration while ensuring scalability, performance, and security.
This is a technical hands-on role, requiring expertise in Apache Spark, Delta Lake, and MLOps, as well as experience working with large-scale data architectures. You will collaborate with architects and business stakeholders to ensure solutions align with customer needs and best practices.
Above all, the ideal candidate embodies RevStar’s core values:
- Self-Mastery: We hold a high bar for how we think, communicate, and improve.
- Ownership: We own outcomes, not just effort.
- Shared Destiny: We rise or fall together.
Key Responsibilities
Data Engineering & Pipeline Development
- Develop and optimize data pipelines using Apache Spark and Delta Lake within Databricks.
- Implement ETL/ELT workflows, ensuring efficient data ingestion, transformation, and storage.
- Design Lakehouse architecture-based solutions that scale across structured and unstructured data sources.
- Integrate Databricks with cloud storage solutions (Azure Data Lake, AWS S3, Google Cloud Storage) for seamless data management.
Performance Optimization & Automation
- Optimize Spark jobs for scalability, cost efficiency, and low latency.
- Implement monitoring and alerting solutions to track job performance and detect failures.
- Develop automated data validation, testing, and quality assurance processes.
Management AI/ML Integration & MLOps Support
- Support ML model training and deployment within Databricks, integrating with MLflow for experiment tracking and model versioning.
- Collaborate with data scientists and ML engineers to enable scalable AI solutions.
- Implement feature engineering pipelines and integrate models into production environments.
Security, Governance & Best Practices
- Ensure data security, access control, and compliance with industry standards (GDPR, HIPAA, SOC 2, etc.).
- Follow Databricks best practices for data lineage, governance, and metadata management.
- Document processes, configurations, and best practices for internal and client use.
Requirements
Must-Have:
- 3+ years of hands-on experience in data engineering, with a focus on big data processing and cloud-native architectures.
- 2+ years of hands-on experience with Databricks, including Apache Spark, Delta Lake, and MLflow.
- Databricks Certifications (Mandatory):
- Databricks Certified Data Engineer Associate (or higher)
- Proficiency in Python, SQL, and Spark-based frameworks.
- Experience in developing and optimizing large-scale ETL/ELT pipelines.
- Strong understanding of Lakehouse architecture and cloud-agnostic data solutions.
- Familiarity with CI/CD pipelines and Infrastructure-as-Code (IaC) for Databricks (e.g., Terraform, Databricks CLI).
- Knowledge of data governance, security, and compliance best practices.
- Experience working in Agile development environments, following DevOps/MLOps best practices.
Nice-to-Have:
- Additional Databricks Certifications (e.g., Databricks Certified Machine Learning Associate).
- Experience with real-time streaming solutions (e.g., Kafka, Kinesis, Event Hub).
- Familiarity with cloud storage and orchestration tools (e.g., Apache Airflow, Prefect).
- Background in AI/ML integration within Databricks, assisting in feature engineering and model deployment.
- Experience working in client-facing roles or consulting environments.
Benefits
Benefits for Full-Time W2 Positions:
- Paid Time Off – Take the time you need to recharge and stay productive.
- Remote-First Working Environment – Collaborate from anywhere while staying connected with our global team.
- Comprehensive Health Coverage – Medical, Dental, Vision
- 401(k) Retirement Plan – Plan for your future with access to a company-sponsored 401(k) program.
- Annual Learning & Development Stipend – Invest in your skills with conferences, certifications, or courses.
- Peer Mentorship & Coaching – Learn from experienced engineers, product managers, and architects to accelerate your growth.
- Professional Growth Opportunities – Exposure to cutting-edge AWS GenAI, data, and cloud technologies across diverse industries.
- Company Outings & Volunteer Opportunities – Build relationships and give back to the community.
- Collaborative, Innovative Culture – Work alongside top talent in a fast-paced, supportive environment that values curiosity and initiative.
Equal Opportunity Employment
At RevStar, we don’t just accept differences — we celebrate them, we support them, and we thrive on them for the benefit of our employees, our customers, and our community. RevStar is proud to be an equal opportunity workplace.
Reasonable Accommodations
RevStar is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, contact HR at .
Originally posted on Himalayas