解决方案架构师 4
Solutions Architect 4
Overview
Edgewater Federal Solutions 正在寻找一名 Solutions Architect 4 来支持一家主要的国家实验室。
Responsibilities
- 就 Databricks 参考架构提供建议,包括 Lakeflow、Delta Lake、Unity Catalog Mosaic AI、Databricks SQL 和 Databricks Apps
- 提供 Databricks 全栈解决方案设计的实际指导
- 就数据迁移(例如批量处理、实时流)和零拷贝模式的设计提供建议
- 指导从传统 SQL 和文档存储向 Databricks 及相关云数据平台的平台迁移
- 推荐安全、治理和合规即代码:Unity Catalog ABAC、受管标签、行过滤/列掩码、密钥管理、网络安全性及合规安全配置文件
- 就符合组织数据分类政策和适用法规要求的隔离/分层数据池架构设计提供建议,包括跨层级数据迁移
- 推荐 FinOps 和性能标准、工作负载和成本管理
- 指导数据工程师、分析师和 AI/ML 团队参与架构评审并为标准做出贡献
- 在需要时与信息与网络安全及其他团队合作以确保符合政策和标准
- 评估新兴的 Databricks 功能并推荐采用策略,包括随着发展与第三方的端点集成
Qualifications
- 7 年以上使用 Medallion 层架构设计、构建和运行 Databricks 工作负载的经验
- 具有 Delta Lake、Unity Catalog、Spark Structured Streaming、Lakeflow(或 DLT/Live Tables)、Databricks SQL、MLflow 和 Mosaic AI 模型服务的实际经验
- 在支持平台的云架构方面有丰富经验(VPC/VNet、安全、S3/ADLS、KMS 等)
- 有将企业数据工作负载从传统/本地数据仓库/数据湖迁移到 Databricks 的实际经验
- 具备生产级流处理和 CDC 经验
- 在安全和治理方面有深厚经验:Unity Catalog 策略(ABAC)、分类、加密、访问审计、合规到控制的转换
- 具有根据数据分类需求设计多层 Databricks 架构的实际经验
- 精通 Python 和 SQL、Spark、Notebooks
- 优秀的口头和书面沟通能力
Desired:
- 活跃的 Databricks 认证
- 在 Databricks 上的 GenAI 和代理系统经验
- 使用 Delta Sharing 和 Databricks Clean Rooms 实现组织间受控、受治理的数据交换经验
查看英文原文
Overview
Edgewater Federal Solutions is seeking a Solutions Architect 4 to support a major national laboratory.
Responsibilities
- Advise on the Databricks reference architecture covering Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps
- Provide hands-on guidance on Databricks full-stack solution design
- Advise on design of both data movement (e.g. batch, real-time streaming) and zero-copy patterns
- Guide platform migrations from legacy SQL and document stores onto Databricks and related cloud data platforms
- Recommend security, governance, and compliance-as-code: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security and compliance security profiles.
- Advise on design of segregated/tiered data pool architectures aligned to the organization's data classification policy and applicable regulatory requirements, including cross-tier data movement
- Recommend FinOps and performance standards, workload and cost management
- Mentor data engineers, analysts, and AI/ML teams participate in architecture reviews and contribute to standards
- Work with information & cyber security, and other teams as needed for compliance to policies and standards
- Evaluate emerging Databricks capabilities and recommend adoption strategies, including endpoint integrations with third parties as they evolve
Qualifications
- 7+ years designing, building, and operating Databricks workloads with medallion layer architecture
- Hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
- Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)
- Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks
- Production streaming and CDC experience
- Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation
- Hands-on experience designing multi-tier Databricks architectures driven by data classification requirements
- Strong Python and SQL, Spark, Notebooks
- Excellent verbal and written communication skills
Desired:
- Active Databricks certifications
- GenAI and agent systems on Databricks experience
- Delta Sharing and Databricks Clean Rooms for controlled, governed data exchange across organizational/cross-tier/system boundaries
- Familiarity with Oracle EBS and SAP enterprise data
- Experience with SAP BDC/DataSphere and Databricks integration to SAP BDC, with zero-copy patterns
- Lakeflow Designer, Databricks Apps, Genie, Databricks One
- CI/CD, Infrastructure-as-Code (e.g. Terraform) for data platforms
- Experience in designing, building, supporting BI reporting layers
- Data Quality and Data Governance experience
- Prior experience in regulated industries (e.g. utilities, life sciences, government services) and exposure to related frameworks (e.g. FERC/NERC, HIPAA, GxP, GDPR, FedRAMP, ITAR, etc.)
About Us:
Edgewater Federal Solutions is a privately held government contracting firm located in Frederick, MD. The company was founded in 2002 with the vision of being highly recognized and admired for supporting customer missions through employee empowerment, exceptional services and timely delivery. Edgewater Federal Solutions is ISO 9001, 20000-1, 270001 certified, appraised at CMMI Level 3 Maturity for Development and Services, and has been named in the Top Workplaces in the Greater Washington Area Small Companies for 2018 through 2025.
It has been and continues to be the policy of Edgewater Federal Solutions to provide equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, marital status, veteran status, and/or other statuses protected by applicable law.
Originally posted on Himalayas