数据工程产品架构师
Data Engineering Product Architect
职位名称:数据工程产品架构师
职位类别:工程
工作类型:全职
开始所需的最低安全许可:公共信任
员工类型:正式员工
所需旅行比例:最多10%
旅行类型:美国大陆
机会简介:
CACI不断壮大的敏捷数字解决方案运营部门正在寻找一名数据工程产品架构师,支持美国国家航空航天局(NASA)使用的一系列企业业务解决方案的现代化和转型。候选人将加入一个团队,其中复杂问题解决能力和沟通技巧对成功至关重要。
职责:
- 领导可扩展ETL流程的设计、构建、优化和维护
- 指导标准化不同数据集的规范化和转换框架的开发,用于分析、网络安全和任务操作
- 推动使用已建立的软件工程实践开发高质量、现代且完全可重复的代码——包括版本控制、模块化设计、自动化测试、文档和CI/CD——以确保数据流程和Databricks工作流的可靠性、可重用性和可维护性
- 指导团队在软件工程设计原则方面进行培训,帮助团队成员随着时间的推移提高代码质量和设计
- 在安全的基于云的架构中开发解决方案,利用Databricks Lakehouse功能(Unity Catalog、Delta Lake、Auto Loader、集群配置)
- 管理数据流程和Databricks应用的环境设置、版本控制、部署和CI/CD流程
- 开发并维护Databricks与企业系统的集成,通过API、S3摄入端点和数据库连接器
- 与跨职能的工程、网络安全和产品团队合作,设计和实现改进数据摄入、元数据管理、自动化工作流和平台可用性的功能
- 记录数据集成和接口开发的技术需求、用户故事和工作流规范
- 协助Scrum主管和团队估算、排序和优先安排工作,以确保优先开发能力的高效交付
资格要求:
- 领导可扩展ETL流程的设计、构建、优化和维护
- 指导标准化不同数据集的规范化和转换框架的开发
查看英文原文
Job Title: Data Engineering Product ArchitectJob Category: EngineeringTime Type: Full timeMinimum Clearance Required to Start: Public TrustEmployee Type: RegularPercentage of Travel Required: Up to 10%Type of Travel: Continental US* * *The Opportunity:
The Opportunity: CACI’s growing Agile Digital Solutions Operating Group is searching for a Data Engineering Product Architect supporting the modernization and transformation of a large portfolio of enterprise business solutions used by the National Aeronautics and Space Administration (NASA). The candidate will be part of a team where complex problem solving, and communication skills are critical to success.
Responsibilities:
- Lead the design, build, optimization, and maintenance of scalable ETL pipelines
- Guide the development of normalization and transformation frameworks to standardize disparate datasets for analytics, cybersecurity, and mission operations.
- Champion the development of high‑quality, modern, and fully reproducible code using established software engineering practices — including version control, modular design, automated testing, documentation, and CI/CD—to ensure reliability, reusability, and maintainability across data pipelines and Databricks workflows.
- Mentor and coach team on software engineering design principles to help improve code quality and design by team members over time
- Develop solutions within a secure cloud-based architecture leveraging Databricks Lakehouse features (Unity Catalog, Delta Lake, Auto Loader, cluster configuration).
- Manage environment setup, version control, deployment, and CI/CD processes for data pipelines and Databricks apps.
- Develop and maintain integrations between Databricks and enterprise systems through APIs, S3 ingestion endpoints and database connectors.
Collaborate with cross-functional engineering, cybersecurity, and product teams to design and implement features that improve data ingestion, metadata management, automation workflows, and platform usability
- Document technical requirements, user stories, and workflow specifications for data integrations and interface development.
- Help scrum master and teammates estimate, sequence, and prioritize work to ensure efficient delivery of prioritized development capabilities
Qualifications:
Required:
- Lead the design, build, optimization, and maintenance of scalable ETL pipelines
- Guide the development of normalization and transformation frameworks to standardize disparate datasets for analytics, cybersecurity, and mission operations.
- Champion the development of high‑quality, modern, and fully reproducible code using established software engineering practices — including version control, modular design, automated testing, documentation, and CI/CD—to ensure reliability, reusability, and maintainability across data pipelines and Databricks workflows.
- Mentor and coach team on software engineering design principles to help improve code quality and design by team members over time
- Develop solutions within a secure cloud-based architecture leveraging Databricks Lakehouse features (Unity Catalog, Delta Lake, Auto Loader, cluster configuration).
- Manage environment setup, version control, deployment, and CI/CD processes for data pipelines and Databricks apps.
- Develop and maintain integrations between Databricks and enterprise systems through APIs, S3 ingestion endpoints and database connectors.
- Collaborate with cross‑functional engineering, cybersecurity, and product teams to design and implement features that improve data ingestion, metadata management, automation workflows, and platform usability
- Document technical requirements, user stories, and workflow specifications for data integrations and interface development.
- Help scrum master and teammates estimate, sequence, and prioritize work to ensure efficient delivery of prioritized development capabilities.
Qualifications:
Required:
- Experience building scalable data-driven services, data ingestion pipelines, and automation workflows, contributing to high‑reliability cloud solutions at an enterprise scale
- Experience working on complicated problems and providing solutions that are creative, yet practical and feasible
- Strong communication and problem‑solving skills in dynamic, remote environments
- Ability to empathetically work with platform customers (software or data engineering teams) to triage and resolve issues, enable self-service, and introduce improvements based on feedback
- Ability to collaborate with data scientists, software engineers, platform engineers, cybersecurity, and product stakeholders to support data platform requirements
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline. Experience will be considered in lieu of a degree
- Demonstrated experience working with agile project management tools
- Must be able to obtain and maintain a NASA Public Trust background investigation
Desired:
- Experience supporting the NASA Web Services Operational Environment
- Experience working with industry-standard Enterprise Data Platform applications, such as Databricks, Apache Airflow, or similar technologies
- Displays tenacity in the face of hard problems and ambiguous requirements
- Interest in driving innovation through independent contributions and strategic guidance of a team of software engineers and data scientists.
- Experience supporting Federal government project
- Ability to design and document technical solutions related to continuous integration and continuous deployment
-What You Can Expect:
A culture of integrity.
At CACI, we place character and innovation at the center of everything we do. As a valued team member, you’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation.
An environment of trust.
CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.
A focus on continuous growth.
Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground — in your career and in our legacy.
Pay Range:
There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.
Since this position can be worked in more than one location, the range shown is the national average for the position.
The proposed salary range for this position is:
$98,500-$206,800CACI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.
Originally posted on Himalayas