资深软件工程师，数据平台基础架构
Staff Software Engineer, Foundations Data Platform
在 Vanta，我们的使命是帮助企业在获得信任的同时证明信任。我们相信安全需要持续监控和验证，我们赋能企业实践更安全的措施，并轻松地证明这一点。Vanta 有一支善良且才华横溢的团队，虽然一些成员有之前的安全经验，但许多人在没有这些经验的情况下也在 Vanta 取得了成功。
作为 Automation - Foundations 团队的高级软件工程师，你将领导 Vanta 整个合规产品底层数据层的重构。
Foundations 每秒从客户环境的各个地方接收数以万计的安全和合规资源。我们存储这些数据，对其进行分类，使其可查询，并将其转化为必须经受真实 SOC 2 或 FedRAMP 审计的证据。
我们正处于将平台从以 MongoDB 为中心的单体架构迁移到 Kafka 数据流水线的阶段，该流水线解耦了数据获取与处理，并由 Postgres 和 S3 支持。我们面临的最大挑战是在一个需要正确性的领域中大规模支持这一迁移，同时还要支持即将推出的产品不断变化的需求。
访问我们的 Vanta 工程博客 https://www.vanta.com/all-categories/engineering 了解我们团队正在做什么的更多信息。
在 Vanta 担任高级软件工程师，你将：
- 领导将 Vanta 的资源数据模型从以 MongoDB 为中心的解决方案迁移至具有模式感知能力的 Postgres 支持的解决方案，并在不破坏客户集成的情况下并行运行两个版本。
- 在你并不负责但依赖于你团队构建的平台的跨团队项目中推动解决方案。
- 在最终一致性下设计正确性，包括幂等会话处理、可承受无序交付的条件写入、通过协调而非严格的跨服务验证，以及显式背压而非隐式的数据库限制。
- 设计和演进 Vanta 的数据摄入和流水线架构，确保在分布式系统中可靠地处理 TB 级数据流。
- 将我们的 Query API 从内部使用扩展为生产级平台，包括模式版本控制、连接和导出、按租户隔离，以及在负载下的可预测延迟。
- 构建数据基础设施，使正确性可以被外部审计，因为 Vanta 生成的证据必须能在审计师面前站得住脚。
- 诊断仅在生产数据结构中出现的故障，这些故障可能包括热点分区等问题。
查看英文原文
At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it.
As a Staff Software Engineer on the Automation - Foundations team, you will lead the re-platforming of the data layer underneath Vanta’s entire compliance product.
Foundations ingests tens of thousands of security and compliance resources per second from across our customer’s environments. We store the data, catalog it, make it queryable, and turn it into evidence that has to survive a real SOC 2 or FedRAMP audit.
We are in the middle of moving our platform from a monolithic Mongo-centric architecture to a Kafka data pipeline that decouples data fetching from processing and is backed by Postgres and S3. Our biggest challenges are around supporting this migration at scale in a domain that requires correctness and while supporting an evolving set of requirements for upcoming products.
Visit our Vanta Engineering Blog https://www.vanta.com/all-categories/engineering to learn more about what our team is working on.
What you'll do as a Staff Software Engineer at Vanta:
- Lead the migration of Vanta’s resource data model from a Mongo-centric solution to a schema-aware Postgres-backed solution and running both generations in parallel without breaking a customer integration.
- Drive solutions across teams that you do not own but are dependent on the platform built by your team.
- Design for correctness under eventual consistency with idempotent session handling, conditional writes that survive out-of-order delivery, reconciliation rather than strict cross-service validation, and explicitly backpressure instead of implicit database limits.
- Design and evolve Vanta's data ingestion and pipeline architecture, ensuring reliable, high-throughput processing of terabyte-scale data streams across distributed systems
- Take our Query API from internal use to a production platform with schema versioning, joins and exports, per-tenant isolation, and predictable latency under load.
- Build data infrastructure where correctness is externally auditable as the evidence Vanta produces has to hold up in front of an auditor.
- Diagnose the failures that only appear at production data shapes and can include hot partitions, unbounded fan-out, and online rewrites of continuously-written tables.
- Set architectural direction for streaming infrastructure (Kafka and event queuing), caching layers (Redis), and persistent storage (Postgres, MongoDB) across the Foundations stack
- Mentor senior engineers across the team, raising the technical bar through design reviews, architectural guidance, and hands-on contributions to the most complex systems challenges
- Champion engineering excellence in reliability, observability, and operational hygiene across the data infrastructure that powers Vanta's core product
- Leverage AI tools and systems to accelerate your own work and explore how they can improve the systems you build
How to be successful in this role:
- Proven track record leading platform migration initiatives (v1→v2 architecture transitions) while maintaining backward compatibility and system availability
- Strong command of streaming and queuing infrastructure (Kafka or equivalent), including partitioning strategy, consumer group semantics, redelivery, and idempotency.
- Deep industry experience in distributed systems and data pipeline engineering, with demonstrated experience designing and operating systems at enterprise scale (terabyte-scale ingestion, high-throughput event processing)
- Fluency in both relational and document data modeling at scale (Postgres and MongoDB), including query planning, connection pooling, and online schema change on large, continuously written tables.
- Experience collaborating with engineering leadership to define multi-quarter technical roadmaps and drive them through to delivery
- Solid AWS fundamentals and comfort operating in TypeScript and Node.
- Able to articulate complex systems tradeoffs to both technical and non-technical audiences and bring cross-functional partners along on long-horizon technical decisions
- Open to using AI to amplify your skills and strengthen your work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact.
What you can expect as a Vanta’n:
- Industry-competitive salary and equity
- Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
- 16 weeks of paid Parental Leave for all new parents
- Health & wellness stipend
- Remote workspace, internet, and cellphone stipend
- Commuter benefits for team members who report to the SF and NYC offices
- Family planning benefits
- Matching 401(k) contribution with immediate vesting
- Flexible PTO policy, plus 80 hours of Sick Time
- 11 company-paid holidays
- Virtual team-building activities, lunch-and-learns, and other company-wide events!
- Offices in SF, NYC, London, Dublin, Tel Aviv, and Sydney
#LI-remote
At Vanta, we are committed to hiring diverse talent of different backgrounds and as such, it is important to us to provide an inclusive work environment for all. We do not discriminate on the basis of race, gender identity, age, religion, sexual orientation, veteran or disability status, or any other protected class. As an equal opportunity employer, we encourage and welcome people of all backgrounds to apply.
About Vanta
We started in 2018, in the wake of several high-profile data breaches. Online security was only becoming more important, but we knew firsthand how hard it could be for fast-growing companies to invest the time and manpower it takes to build a solid security foundation. Vanta was inspired by a vision to restore trust in internet businesses by enabling companies to improve and prove their security. From our early days automating security monitoring for compliance standards like SOC 2, HIPAA and ISO 27001 to creating the world's leading Trust Management Platform, our vision remains unchanged.
Now more than ever, making security continuous—not just a point-in-time check— is essential. Thousands of companies rely on Vanta to build, maintain and demonstrate their trust— all in a way that's real-time and transparent.
Referral Instructions
If you are being referred for the role, please contact that person to apply on your behalf.