出海雷达

数据工程师负责人

Lead Data Engineer

开发工程限定地区(需当地身份)
公司UFS
薪资未公开
工作地点United States
地域资格限定地区(需当地身份)
时区要求日间重叠约 9 小时,基本正常作息
用工类型Full Time
发布时间14 天前
数据来源Himalayas
前往 Himalayas 查看并投递 →
注意地域限制:该职位明确限定在 United States 招聘。如果你是位于中国大陆的求职者,通常需要当地工作身份才能投递,或需与雇主确认是否接受独立合同(Contractor)形式合作。

负责 Navanta 的数据基础架构 —— 初期是公开的通话报告数据,随着每个客户本地环境的搭建,逐步实现从银行核心系统安全地摄取数据到湖仓。在技术与商业 AI 副总裁的领导下,并与 AI/ML、安全和平台团队紧密合作,该职位构建架构清晰、建模良好、可对账的数据基础,使 Navanta AI 平台能够提供银行家会采取行动的数据。

关键职责

  • 设计湖仓:基于对象存储的 Apache Iceberg(或类似技术),用于表管理的目录和按银行隔离,dbt 模型,以及查询引擎
  • 从银行系统构建安全、最小权限的摄取流程 —— 在允许的情况下使用日志级 CDC,同时具备基于查询和批量/SFTP 的回退方案,以及银行内收集器模式
  • 负责语义层和指标层的数据建模(存款、集中度、未保险敞口、资产质量及同业组)
  • 处理模式漂移、数据质量和对账;使摄取过程可观测且可恢复
  • 与 AI/ML 团队合作处理结构化查询路径,并与安全团队合作在数据落地时进行 PII 分类,符合监管数据处理要求
  • 文档化数据血缘、转换逻辑和访问控制,以支持审计和检查准备
  • 定义并执行数据契约、质量阈值和管道失败警报

核心能力

  • 对从摄取到服务的端到端流程拥有所有权,偏向可靠性和可观测性
  • 严谨的数据建模用于分析 —— 语义层、指标定义和可对账的输出
  • 安全与合规意识:PII 处理、最小权限访问,以及符合监管指导的数据治理
  • 与 AI/ML 和平台工程团队跨职能合作,交付受控、可查询的数据产品

关键绩效指标(KPI)

  • 数据新鲜度和管道可靠性 —— 数据摄取和银行核心数据源的 SLA 达标
  • 关键指标的数据质量评分与源数据对账
  • 从启动到可查询湖仓,新银行数据环境的上线时间
  • 数据落地时 PII 分类覆盖率和零未经授权的数据访问事件
  • 语义层采用率 —— 通过受控指标解决的助手查询百分比,而非临时 SQL 查询

资格要求

要成功胜任此职位,个人必须能够

查看英文原文

The Lead Data Engineer owns the Navanta data backbone — public Call Report data in the early build, and secure ingestion from bank cores into lakehouses as each client’s on-premises environment is stood up. Working under the SVP of Technology and Commercial AI and in close partnership with the AI/ML, security, and platform teams, this role builds the architecturally clean, well-modeled, reconcilable data foundation that makes it possible for the Navanta AI platforms to give numbers a banker will act on.

Key Responsibilities

  • Design the lakehouse: Apache Iceberg (or similar technology) on object storage, a catalog for table management and per-bank isolation, dbt models, and a query engine
  • Build secure, least-privilege ingestion from bank systems — log-based CDC where permitted, with query-based and batch/SFTP fallbacks, plus an in-bank collector pattern
  • Own data modeling for the semantic and metric layer (deposits, concentration, uninsured exposure, asset quality, and peer groups)
  • Handle schema drift, data quality, and reconciliation; make ingestion observable and recoverable
  • Partner with the AI/ML team on the structured-query path and with Security on PII classification at landing, in alignment with regulatory data-handling requirements
  • Document data lineage, transformation logic, and access controls to support audit and exam readiness
  • Define and enforce data contracts, quality thresholds, and alerting for pipeline failures

Core Competencies

  • End-to-end ownership of ingestion-through-serving pipelines, with a bias toward reliability and observability
  • Rigorous data modeling for analytics — semantic layers, metric definitions, and reconcilable outputs
  • Security and compliance mindset: PII handling, least-privilege access, and data governance aligned to regulatory guidance
  • Cross-functional partnership with AI/ML and platform engineering to deliver governed, queryable data products

Key Performance Indicators (KPIs)

  • Data freshness and pipeline reliability — SLAs met for data ingestion and bank-core feeds
  • Data quality score across key metrics versus source reconciliation
  • Time to onboard a new bank’s data environment, from kickoff to queryable lakehouse
  • PII classification coverage at landing and zero unauthorized data-access incidents
  • Semantic layer adoption — percentage of assistant queries resolved via governed metrics versus ad hoc SQL

Qualifications

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.

  • 8–12+ years in data engineering with end-to-end ownership of ingestion through serving, and 2+ years in a lead or senior role
  • Strong Python and expert SQL; rigorous data modeling for analytics
  • Hands-on lakehouse experience (Iceberg/Delta/Hudi or equivalent) and modern transformation tooling
  • Built reliable pipelines from messy operational and transactional source systems
  • Comfort with CDC mechanics and the realities of pulling from databases you do not control

Core Technologies

·Languages: Python, SQL (deep)

  • Lakehouse & catalog: Apache Iceberg; Polaris / Nessie / Lakekeeper
  • Transform & query: dbt; Trino / Presto / DuckDB
  • CDC & streaming: Debezium (SQL Server CDC, Postgres logical replication), Kafka / Redpanda

·Orchestration: Dagster (or Airflow)

·Storage: S3 / MinIO

  • SQL Server and PostgreSQL data modeling, pgvector (or equivalent)

Nice to Have

  • Experience with financial or core-banking data, or FFIEC / Call Report data specifically

·Strong SQL Server familiarity

  • Data contracts, lineage, and governance practices

Education and/or Experience

  • Bachelor’s degree in computer science, mathematics, information systems, or a related field, or equivalent hands-on experience
  • Experience in the financial services industry or a regulated data environment strongly preferred

Work Structure & Expectations

  • Full-time role combining ongoing pipeline operations with initiative-based lakehouse build-out and new bank onboarding
  • Close collaboration with AI/ML, platform engineering, and security teams; on-call rotation covering data pipeline reliability

Physical Demands

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is regularly required to sit and use hands to finger, handle, or touch objects, tools, or controls. The employee frequently is required to talk or hear. The employee is occasionally required to stand; walk; and stoop, kneel, crouch, or crawl. The employee must occasionally lift and/or move up to 10 pounds, usually waist high, up to 50 feet away. Specific vision abilities required by this job include close vision and the ability to adjust focus.

Work Environment

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

•Typical office environment

•Up to 20% travel time may be required

Who is Navanta?

Navanta is the trusted technology and services partner for community financial institutions, unifying critical systems, security, cloud infrastructure, and support into one seamless, purpose built experience. With more than 35 years of banking expertise — from Managed IT to Core Banking, CRM, and Advisory Services — Navanta helps institutions simplify complexity, reduce risk, and strengthen daily operations. Navanta empowers community bankers and their people to thrive together. Go Bankers, Go.™

Originally posted on Himalayas

本页面信息整理自 Himalayas,版权归原发布方所有。职位可能随时关闭,投递请以原始页面为准。 本站只做信息聚合展示,不参与招聘流程,也不向求职者收取任何费用。

该公司其他在招职位

← 返回全部职位