软件工程师，后端（平台）
Software Engineer, Backend (Platform)
Vannevar 为国防部最重要的任务构建人工智能系统。我们的核心平台和五个独立产品已部署到所有军种和作战司令部，共125个部署点。例如，当与伊朗的军事行动开始时，我们在三个月内推出了一款新产品，支持7x24小时运作，服务超过9000名用户。
我们如何构建是我们的一大优势：我们与负责任务的人一起前进。我们的工程师、产品团队和首席技术官会前往问题发生的前线，包括访问乌克兰的单位。我们专注于直接嵌入支持与中国大国竞争、与伊朗的作战行动以及反毒品任务的作战单位。
关于职位
在 Vannevar，我们为国家安全、国防和情报界构建任务软件。数据采集平台团队构建从网站、API、数据流和第三方平台获取关键任务数据的系统。
在这个职位上，你将负责网络爬虫、第三方集成和数据管道，即使上游系统不可靠，也能产出完整、正确和及时的数据。你将与任务团队、产品经理和工程师合作，定义需求，并在数据质量、可靠性、规模和成本之间做出权衡。
你会做
- 构建和运营生产环境的网络爬虫、第三方集成和数据管道。
- 设计应对模式变化、速率限制、认证要求和部分失败的方案。
- 构建可靠的重试、回填、去重、幂等性和重放机制。
- 定义并监控数据完整性、正确性、新鲜度、重复性和来源。
- 开发用于采集流程的 API、数据库和共享服务。
- 与任务团队、平台团队和产品经理合作，评估数据源并支持新的数据需求。
- 影响采集系统的架构、技术选型和工程标准。
我们寻找
- 你有4年以上后端工程经验，包括生产环境的网络爬虫、数据摄入、ETL或第三方集成。
- 你使用 Python 编写生产软件，并熟悉关系型数据库和 API 设计。
- 你知道如何在大型、变化的数据集上保持数据质量。
- 你设计过能够容忍上游故障和外部接口变化的系统。
- 你能在可靠性、可扩展性等方面做出深思熟虑的权衡
查看英文原文
Vannevar builds AI systems for the Department of War's most consequential missions. We have 125 deployments across every branch and combatant command spanning our core platform and five distinct products. An an example of how we work, when major combat operations started with Iran, we fielded a new product supporting 24/7 operations and 9,000+ users in three months.
How we build is our advantage: we deploy forward with the people who own the mission. Our engineers, product team, and CTO deploy forward to the point of friction, including visiting units in Ukraine. We focus on embedding directly with operational units supporting great power competition with China, combat operations with Iran, and counter-narcotics missions.
About the Role
At Vannevar, we build mission software for the national security, defense, and intelligence communities. The Collection Platform team builds the systems that acquire mission-critical data from websites, APIs, feeds, and third-party platforms.
In this role, you’ll own web scrapers, third-party integrations, and data pipelines that produce complete, correct, and timely data despite unreliable upstream systems. You’ll partner with mission teams, product managers, and engineers to define requirements and make tradeoffs among data quality, reliability, scale, and cost.
What you’ll do
- Build and operate production web scrapers, third-party integrations, and data pipelines.
- Design for schema changes, rate limits, authentication requirements, and partial failures.
- Build reliable retry, backfill, deduplication, idempotency, and replay mechanisms.
- Define and monitor data completeness, correctness, freshness, duplication, and provenance.
- Develop APIs, databases, and shared services for collection workflows.
- Partner with mission teams, platform teams, and product managers to evaluate sources and support new data requirements.
- Influence architecture, technology selection, and engineering standards for collection systems.
What we’re looking for
- You have 4+ years of backend engineering experience, including production web scraping, data ingestion, ETL, or third-party integrations.
- You write production software in Python and are familiar with relational databases and API design.
- You know how to maintain data quality across large, changing datasets.
- You have designed systems that tolerate upstream failures and changing external interfaces.
- You can make thoughtful tradeoffs among reliability, scalability, performance, maintainability, and cost.
- You communicate technical decisions clearly and work well across engineering, product, and mission teams.
- U.S. Person status is required, as this role requires access to U.S.-only data systems and the ability to obtain a security clearance.
Nice to Have
- Experience with distributed task processing, workflow orchestration, or large-scale data pipelines.
- Experience monitoring data quality and investigating production regressions.
What we offer
We’re proud to offer competitive benefits that support our employees. Some key highlights of our benefits package include:
- Health, dental, and vision insurance
- Remote friendly with WeWork access
- Unlimited PTO, shared downtime during the federal holiday calendar, and company-wide off time at the end of each year
- 401(k) match
- Lifestyle & wellbeing stipends
- Salary top-up during military reserve duty
- Fully paid parental leave
- Child and pet care reimbursement during travel
Vannevar is an equal opportunity employer, and qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.
We encourage candidates from all backgrounds to apply, even if you don't feel like you're a perfect fit. If you're passionate about contributing to our mission, we'd love to hear from you!
IMPORTANT NOTICE
We are committed to protecting the privacy of all applicants. Official emails from the company will come from an @vannevarlabs.com domain. Under no circumstances will a legitimate representative from our company contact you to request passwords, financial information, or other sensitive personal data. Please be vigilant of potential scams.
Originally posted on Himalayas