Databricks 工程师
Databricks Engineer
职位名称:
Databricks 工程师职位描述
我们是 Concentrix。智能转型合作伙伴。以解决方案为导向。以技术为驱动。以智能为燃料。
全球技术和服务领导者,为世界一流的品牌提供动力,现在和未来。我们以解决方案为导向,以技术为驱动,以智能为燃料。凭借独特数据和洞察力、深厚的行业专业知识以及先进的技术解决方案,我们是推动一个高效运作世界的智能转型合作伙伴,帮助公司变得令人耳目一新地简单,以便于工作、互动和交易。我们在 70 多个国家塑造了改变游戏规则的职业,吸引最优秀的人才。
Concentrix 技术产品与服务团队是推动 Concentrix 转型、数据和技术服务的驱动力。我们整合世界级的数字工程、创造力以及对人类行为的深刻理解,通过技术驱动和智能赋能的体验来发现并释放价值。我们结合以用户为中心的设计、强大的数据和强大的技术,以加速大规模的转型。你将置身于世界上最优秀的人才之中,为现代客户体验提供市场领先的科技和洞察力。在我们的专业服务团队中,你将交付战略咨询、设计、顾问服务、市场调研和客服中心分析,为客户提供见解以改善结果和价值。从而实现我们的愿景。
我们全球的变革者致力于确保每一段关系都卓越非凡。我们自豪地连续多年获得“全球最佳办公场所”、“职业成长最佳公司”和“最佳企业文化”等荣誉。
加入我们,成为这段通往更多机遇和更美好未来的旅程的一部分。职位:Databricks 工程师
地点:美国远程办公
工作时间:EST(东部标准时间)
所需认证:有效的 Databricks 认证数据工程师助理证书。
职位概述
数据工程师负责在运行于 Microsoft Azure、AWS 或 GCP 上的 Databricks 数据智能平台上构建、维护和支持数据解决方案。该职位利用 Databricks、Python、PySpark 和 SQL 实现数据摄取、转换、建模和流程编排。
在高级数据工程师设定的标准和设计框架内,该职位独立负责从开发到生产环境的指定流程的交付。
查看英文原文
Job Title:
Databricks EngineerJob Description
We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled.
The global technology and services leader that powers the world’s best brands, today and into the future. We’re solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we’re the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent.
The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. We integrate world-class digital engineering, creativity, and a deep understanding of human behavior to find and unlock value through tech-powered and intelligence-fueled experiences. We combine human-centered design, powerful data, and strong tech to accelerate transformation at scale. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience. Within our professional services team, you will deliver strategic consulting, design, advisory services, market research, and contact center analytics that deliver insights to improve outcomes and value for our clients. Hence achieving our vision.
Our gamechangers around the world have devoted their careers to ensuring every relationship is exceptional. And we’re proud to be recognized with awards such as "World's Best Workplaces," “Best Companies for Career Growth,” and “Best Company Culture,” year after year.
Join us and be part of this journey towards greater opportunities and brighter futures.Title: Databricks Engineer
Location: Remote in USA
Working hours in EST
Required certification: Active Databricks Certified Data Engineer Associate certification.
Role Summary
The Data Engineer is responsible for building, maintaining, and supporting data solutions on the Databricks Data Intelligence Platform running on Microsoft Azure, AWS or GCP. The role leverages Databricks, Python, PySpark, and SQL to deliver data ingestion, transformation, modeling, and pipeline orchestration.
Working within the standards and designs set with the Senior Data Engineer, this role independently owns the delivery of assigned pipelines from development through production support.
Responsibilities
· Build and maintain batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.
· Implement data ingestion using Auto Loader, Lakeflow Connect, and Azure Data Factory.
· Develop pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations.
· Perform data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for analytics and reporting.
· Configure, schedule, and monitor data workflows with Lakeflow Jobs (formerly Databricks Workflows).
· Implement data models within the lakehouse following medallion architecture (bronze/silver/gold) and team modeling standards.
· Apply Unity Catalog permissions and governance standards to the data assets you build.
· Write unit and data quality tests and deploy pipelines through CI/CD using Git folders and Declarative Automation Bundles (formerly Databricks Asset Bundles).
· Monitor, troubleshoot, and resolve pipeline failures and data quality issues in production.
· Participate in code reviews and contribute to team documentation and engineering standards.
· Collaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business and performance requirements aligned to project goals.
Required Qualifications
Experience
· 6+ years of professional experience in data engineering, data & analytics or data warehousing.
· 3+ years of hands-on experience working with Databricks in a data engineering capacity.
· 3+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.
· 2+ years of data engineering experience on Microsoft Azure (e.g., ADLS Gen2, Azure Data Factory, Key Vault).
Skills and Knowledge
· Proficiency in Python programming for data engineering tasks.
· Strong knowledge of SQL for data modeling, transformation, and querying.
· Working knowledge of Delta Lake fundamentals (e.g., MERGE, schema evolution, time travel).
· Working knowledge of Unity Catalog concepts, including catalogs, schemas, and permissions.
· Experience with Git-based version control and familiarity with CI/CD practices for data pipelines.
· Understanding of testing and deployment strategies for data pipelines, including productionizing ETL pipelines and Databricks SQL queries.
Education
· Bachelor’s degree in computer science, Information Systems, Data Engineering, or a closely related field, or equivalent professional experience.
Preferred Qualifications
· Experience implementing streaming data ingestion in Databricks (Structured Streaming, Auto Loader, Event Hubs).
· Experience with healthcare data (e.g., claims, EHR/clinical data, HL7/FHIR) and HIPAA/PHI handling.
· Exposure to Spark and Delta Lake performance tuning and compute cost optimization.
· Familiarity with dimensional modeling and SCD Type 1 and Type 2 patterns.
· Experience enabling BI consumption through Databricks SQL warehouses and tools such as Power BI.
The base salary for this position is $92,250 to $120,000 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.
We accept applications for this position on an ongoing basis. It is currently for an existing, immediate vacancy; however, we are also considering applications for future opportunities as they arise. We encourage all interested candidates to apply.
As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Company will provide the legally required disclosures and obtain any required written consent prior to such collection, and will handle such information in accordance with applicable biometric privacy laws and Company policies.
#Concentrix
#WAH
Location:
USA, TX, Work-at-HomeLanguage Requirements:
Time Type:
Full timePhysical and Mental Requirements:
The employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.
Equal Employment Opportunity:
Concentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.
For more information regarding your EEO rights as an applicant, please visit the following websites:
· English
· Spanish
Accommodation:
Concentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting . All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.
Artificial Intelligence:
As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.
Work Authorization:
In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.
For further information on available work states and Equal Employment Opportunity as an applicant, please click HERE
Originally posted on Himalayas