资深数据分析工程师,Databricks(R5493)
Staff Analytics Engineer, Databricks (R5493)
成立于2015年,Shield AI是一家风险投资支持的国防科技公司,使命是通过智能系统保护现役军人和平民。其产品包括Hivemind自主软件以及V-BAT和X-BAT无人机。Shield AI在美国、欧洲、中东和亚太地区设有办事处和设施,其技术在全球范围内积极支持作战行动。如需更多信息,请访问 。在LinkedIn、X、Instagram和YouTube上关注Shield AI。
职位描述:
该职位负责Databricks数据湖的Gold层和企业语义层,其中干净且受控的Silver层数据转化为可信、业务就绪的模型、KPI和语义资产。该角色将经批准的业务定义转化为可审计的转换逻辑和持久的分析模型,这些模型可在多个领域中一致使用。
该职位需要超越技术模型构建。分析工程师必须理解所建模数据的业务含义、关键指标背后的运营背景,以及影响数据如何在受监管环境中暴露、连接、治理和消费的分类或使用限制。
您将负责:
- 负责Gold层的设计和交付,包括事实表、维度表、领域数据集市以及在Databricks上的受控KPI实现。
- 通过定制视图、受控语义模型、指标定义和可重用模式,构建并维护企业语义层,以支持可信的业务消费。
- 将经批准的KPI和指标定义转化为精确、可测试、可审计的转换逻辑,以匹配商定的业务含义。
- 定义并执行从领域Gold到企业Gold的发布路径,确保共享指标在获得必要的业务和治理审批前不被发布。
- 直接与各领域的业务利益相关者合作,明确KPI定义,挑战模糊性,并在实施前解决竞争性定义。
- 通过创建建模标准、可重用设计模式、审查流程和辅导机制,为领域团队赋能,而不是长期作为每个下游用例的所有者。
- 审查其他团队或合作伙伴创建的Gold层模型,确保其正确性、定义完整性、可用性以及符合企业标准。
- 优化Gold层结构,以便BI和自助分析消费,同时保留可追溯性、治理和可度量性
查看英文原文
Founded in 2015, Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software and V-BAT and X-BAT aircraft. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit . Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
Job Description:
The Staff Analytics Engineer owns the Gold layer and enterprise semantic layer of the Databricks lakehouse, where clean and governed Silver-layer data becomes trusted, business-ready models, KPIs, and semantic assets. This role translates approved business definitions into auditable transformation logic and durable analytics models that can be used consistently across multiple domains.
This role is expected to go beyond technical model building. The Analytics Engineer must understand the business meaning of the data being modeled, the operational context behind key metrics, and the classification or usage constraints that affect how data can be exposed, joined, governed, and consumed in a regulated environment.
What you'll do:
- Own Gold-layer design and delivery, including facts, dimensions, domain data marts, and governed KPI implementations on Databricks.
- Build and maintain the enterprise semantic layer through curated views, governed semantic models, metric definitions, and reusable patterns for trusted business consumption.
- Translate approved KPI and metric definitions into precise, testable, auditable transformation logic that matches agreed business meaning.
- Define and enforce the promotion path from domain Gold to enterprise Gold, ensuring shared metrics are not published without required business and governance sign-off.
- Partner directly with business stakeholders across domains to clarify KPI definitions, challenge ambiguity, and resolve competing definitions before implementation.
- Enable domain teams by creating modeling standards, reusable design patterns, review processes, and coaching mechanisms rather than acting as the long-term owner of every downstream use case.
- Review Gold-layer models created by other teams or partners for correctness, definition integrity, usability, and conformance to enterprise standards.
- Optimize Gold-layer structures for BI and self-service analytics consumption while preserving traceability, governance, and metric consistency.
- Ensure semantic models, tables, columns, ownership, and business definitions are documented and discoverable.
- Apply awareness of data sensitivity, classification, and approved use when designing joins, dimensions, semantic views, and access patterns so the semantic layer reflects both business meaning and compliance requirements.
Required qualifications:
- 8+ years of experience in analytics engineering, BI engineering, or data engineering with strong dimensional modeling expertise.
- Hands-on Databricks experience, including Delta Lake and Spark SQL and/or PySpark, with strong familiarity with semantic-layer concepts.
- Demonstrated experience translating ambiguous business KPI requests into precise and auditable transformation logic.
- Strong SQL and data modeling fundamentals, including star schemas, fact and dimension design, and slowly changing dimensions.
- Ability to work directly with business stakeholders and serve as a strong technical counterpart on metric definitions and model quality.
- Demonstrated ability to understand the underlying business processes and data domains behind the metrics being modeled, not just implement requested transformations.
- Ability to evaluate whether data can and should be exposed in a semantic layer based on sensitivity, ownership, classification, and policy constraints.
- Experience with BI tools and an understanding of how semantic models support governed self-service analytics.
- Track record of reviewing another team's models for correctness, quality, and alignment with shared definitions.
Preferred qualifications:
- Experience with dbt or comparable transformation frameworks on Databricks.
- Experience building or maintaining a KPI registry, metrics layer, semantic layer, or comparable governance artifact.
- Experience in a multi-domain enterprise environment where metrics and definitions overlap across business areas.
- Databricks certification or comparable evidence of advanced platform expertise.
- Experience in defense, aerospace, financial services, healthcare, or another highly regulated environment.
#LD
Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
###
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.
Originally posted on Himalayas