Senior Data Engineer
540正在寻找一名高级数据工程师来支持一个关键的联邦卫生数据现代化倡议。该团队将来自各种国防和联邦系统的信息汇集起来，以构建可扩展的数据管道，API 和数据产品，从而改善了关键健康数据如何整合，访问和使用。在这个角色中，你将担任高级技术贡献者，提供可扩展，生产准备的数据能力，同时建立可重复使用的数据摄入，集成和交付模式。你将解决复杂的数据挑战，指导工程团队，帮助塑造支持联邦卫生任务的不断增长的数据平台生态系统的技术基础。地点：远程在美国大陆内。定期旅行可能需要公民身份和许可要求：根据客户需求，候选人必须是具有活跃的 DoW 秘密 （或更高）授权教育要求的美国公民：计算机科学，工程学，数据科学或相关技术领域的本科学位 （优先）540 内进水平：数据工程师为什么540?540是一个前性公司政府转向以实现#getshitdone. 我们不仅谈论创新，我们提供它。我们打破障碍，建立具有影响力的技术和解决任务关键问题。你如何驱动影响力 ·设计，开发和维护可扩展的生产式数据管道和数据产品使用 Spark (Python/SQL) 在数据环境中 ·领导从多种 DoW 和联邦卫生系统和来源中的复杂数据集成和转化为可靠，可重用数据产品 ·设计可扩展方法用于数据摄入，整合和交换，包括基于 API 的集成和服务 · 建立和促进可重复使用的数据工程模式，标准和最佳实践，以提高数据产品的一致性，扩展性和维护性 ·提供有关数据架构，管道设计，数据建模，集成方法和工程实践的技术指导 ·监测，解决问题并优化生产工作流程和数据管道，确定性能，可靠性和扩展性的改善 ·定义和实施数据验证，质量和治理实践，从而提高数据产物的可靠性与可用性 ·解决复杂的技术和数据集成挑战，识别根本原因，推动可持续解决方案
查看英文原文
540 is seeking a Senior Data Engineer to support a mission-critical federal health data modernization initiative. The team is bringing together information from diverse defense and federal systems to build scalable data pipelines, APIs, and data products that improve how critical health data is integrated, accessed, and used.
In this role, you’ll serve as a senior technical contributor, delivering scalable, production-ready data capabilities while establishing reusable patterns for data ingestion, integration, and delivery. You’ll solve complex data challenges, guide engineering teams, and help shape the technical foundation of a growing data platform ecosystem supporting federal health missions.
Location: Remote within the continental United States. Periodic travel may be required
Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance
Education Requirement: Bachelor’s Degree in Computer Science, Engineering, Data Science, or a related technical field (preferred)
540 Internal Thrive Level: SeniorData Engineer
WHY 540?
540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.
HOW YOU’LL DRIVE IMPACT
- Design, develop, and maintain scalable, production-ready data pipelines and data products using Spark (Python/SQL) in a Databricks environment
- Lead the integration and transformation of complex data from diverse DoW and federal health systems and sources into reliable, reusable data products
- Design scalable approaches for data ingestion, integration, and exchange, including API-based integrations and services
- Establish and promote reusable data engineering patterns, standards, and best practices that improve consistency, scalability, and maintainability across data products
- Provide technical guidance on data architecture, pipeline design, data modeling, integration approaches, and engineering practices
- Monitor, troubleshoot, and optimize production workflows and data pipelines, identifying performance, reliability, and scalability improvements
- Define and implement data validation, quality, and governance practices that improve the reliability and usability of data products
- Troubleshoot complex technical and data integration challenges, identify root causes, and drive sustainable solutions
- Collaborate with engineers, architects, analysts, and customer stakeholders to translate complex data needs into scalable technical solutions
- Provide technical guidance and mentorship to other engineers, helping teams navigate complex or unfamiliar technical challenges
- Proactively identify opportunities to improve engineering tools, processes, and patterns and help drive their adoption across the team
- Take ownership of complex technical areas and help maintain engineering quality, consistency, and cohesion as the platform and portfolio of data products grow
REQUIRED SKILLS & EXPERIENCE
- 10+ years of data engineering, software engineering, or related technical experience
- Extensive hands-on experience designing, building, and operating production data pipelines and data products
- Advanced proficiency with Python and SQL
- Strong experience with Apache Spark and distributed data processing
- Experience working with Databricks or similar modern data platforms
- Experience designing and maintaining ETL/ELT processes for complex, large-scale datasets
- Experience integrating data across disparate systems and consuming or developing API-based data integrations
- Strong understanding of data modeling, data architecture, data quality, and data governance principles
- Experience troubleshooting and optimizing complex production data pipelines for performance, reliability, and scalability
- Experience working with Git-based development workflows and modern software engineering practices
- Experience working in terminal / command-line environments
- Demonstrated experience providing technical guidance, mentoring engineers, and influencing engineering practices
- Strong client and stakeholder communication skills, with the ability to translate technical concepts and recommendations for both technical and non-technical audiences
- Ability to independently navigate ambiguity, identify technical risks, and drive complex engineering challenges toward resolution
- Experience spotting security, privacy and compliance issues and working with security/compliance/legal stakeholders
NICE TO HAVE SKILLS & EXPERIENCE
- AWS cloud experience
- Experience working with very large datasets, including datasets with billions of records
- Experience with Palantir Foundry
- GitLab experience
- Experience working with Advana or similar DoW data environments
- Experience working with federal health, financial, or other regulated and sensitive data
- Experience using AI/ML to accelerate work, including automating routine tasks, accelerating development and debugging
BENEFITS & PERKS
- Flexible PTO + all Federal holidays off
- Health, dental and vision insurance plans
- Flexible Spending Account (FSA)
- 401k with employer match
- Company-sponsored life insurance, short- and long-term disability
- Professional development (training, certifications, conferences)
- Paid cloud developer accounts
- Referral bonuses
- HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
- Annual social events (540 Week, hackathon, charity golf tournament, etc.)
- Access to 540’s Washington Capitals & Nationals tickets
EQUAL EMPLOYMENT OPPORTUNITY (EEO)
540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
Originally posted on Himalayas