资深软件工程师 - 收集平台
Staff Software Engineer - Ingestion Platform
Reddit 是一个由社区组成的社区。它建立在共同的兴趣、热情和信任之上,是互联网上最开放和真实的对话场所。每天,Reddit 用户提交、投票并评论他们最关心的话题。拥有 100,000+ 个活跃社区,以及大约 1.3 亿日活跃独立访客,Reddit 是互联网上最大的信息来源之一。更多信息,请访问 www.redditinc.com。
我们是谁:
基础设施团队使 Reddit 能够提供可靠性、性能和效率,并使用单一的有观点的技术栈。基础设施中的内容平台团队则专注于让产品团队能够轻松可靠地构建最佳的内容相关体验。这是一个高影响力的团队,负责管理支撑我们产品中最显著部分的核心服务和数据模型——查看动态、发帖、评论、点赞等,我们与消费者、广告、动态、存储和排名等团队紧密合作。该团队还负责运行和维护 R2——Reddit 的单体遗留技术栈,几乎涉及 Reddit 上每个关键用户旅程的路径。
我们正在寻找一名资深软件工程师来帮助我们完成这一使命。这是一个影响力巨大的职位,你对提升我们的运营状况的独特见解以及从客户那里获得的反馈将塑造我们平台的未来方向。
你将负责:
作为资深工程师,你将领导 Reddit 数据摄入平台的开发和演进。
- 设计、编写并交付用于跨流式和批处理工作负载的分布式数据传输的可靠软件,重点关注可用性、可扩展性、延迟、正确性和成本效率。
- 负责平台控制平面和数据平面的架构及演进,包括管道 API、控制器、连接器、目标管理器、模式和接收端集成。
- 扩展平台,使其不仅限于 Kafka 到 BigQuery,还要帮助实现到 S3/GCS 和 Apache Iceberg 的生产就绪路径,以及转换、去重、死信队列和其他可重用功能。
- 为 Kafka、BigQuery、S3、GCS、Iceberg、Flink 和其他数据存储系统构建高质量的连接器和抽象层,同时保持平台模块化且易于扩展。
- 通过清晰的 API、安全的默认设置和自动化功能,提升平台用户的自助体验。
查看英文原文
Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com.
Who We Are:
The Infrastructure organization enables Reddit to deliver Reliability, Performance and Efficiency, with a single opinionated technology stack. The Content Platform team within Infrastructure additionally focuses on empowering product teams to build the best possible Content-related experiences, easily and reliably. This is a high-impact team that owns the Tier-0 services and core data models that power some of the most visible aspects of our product - viewing a feed, posting, commenting, upvoting - and we work closely with teams like Consumer, Ads, Feeds, Storage and Ranking. This team is also responsible for running and maintaining R2 – Reddit’s monolith legacy stack that is pretty much in the critical path for every Critical User Journey at Reddit.
We are looking to hire a Staff Software Engineer to help us in this mission. This is a high impact role where your unique insights into improving our operational posture as well as harmonizing feedback from customers will shape the future direction of our platform.
What You’ll Do:
As a Staff Engineer, you will lead the development and evolution of Reddit’s Ingestion Platform.
- Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency.
- Own the architecture and evolution of the platform’s control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
- Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities.
- Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend.
- Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
- Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch.
- Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
- Identify gaps in the platform’s architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit’s continued growth.
- Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.
- Mentor and guide backend and data infrastructure engineers across the company, raising the bar for technical design, operational excellence, and customer focus.
Who You Might Be:
- 10+ years of hands-on experience building internet-scale distributed systems, data infrastructure, or platforms used by other developers.
- BS, MS, PhD in Computer Science, a related field, or equivalent practical experience.
- Strong software development experience in one or more general-purpose languages such as Go, Python, Java, or Scala.
- Deep experience designing and operating high-throughput, fault-tolerant data pipelines or platform services, including streaming and batch processing.
- Experience with data movement patterns and systems such as Kafka, BigQuery, S3, GCS, Apache Iceberg, Flink, or comparable technologies.
- Experience designing APIs and platform abstractions, including schema evolution, serialization formats such as Protocol Buffers, and service-to-service communication such as gRPC.
- Familiarity with Kubernetes and cloud-native platform concepts, including controllers, custom resources, workload identity, infrastructure automation, and multi-cluster deployments.
- A strong understanding of observability and operational excellence: metrics, logging, alerting, SLOs, incident response, data quality, and safe migration practices.
- A product-minded engineer who advocates for platform users and can turn ambiguous customer and partner needs into simple, reliable, and scalable solutions.
- Demonstrated technical leadership and a history of guiding teams through complex, cross-functional initiatives with meaningful impact.
- Exceptional written and verbal communication skills, with the ability to collaborate effectively across engineering teams and stakeholders.
- Experience building low-code or self-service developer platforms, or curiosity to learn, is a strong plus.
Pay Transparency:
This job posting may span more than one career level.
In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.
To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
The base salary range for this position is:
$217,000—$303,900 USD
In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.
Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.