Data Engineer
每个开发人员都在 Stack Overflow 上开放了一个页面。我们是世界上最受欢迎的网站之一 - 一个基于社区的空间，专注于提高生产力，减少周期时间，加速市场进入时间和保护机构知识。创新是我们所做的一切核心。我们拥抱合作，透明度，并相信同情心地领导；创造一个每个 Stacker 知道他们属于的地方环境。我们接受所有 Stacker 独特的贡献和观点为我们的成功做出了贡献。我们是最好的公司，除了获得最佳公司领导力，最佳公司幸福，最佳公司优惠和福利，最佳公司工作生活平衡，最佳公司补偿和最佳公司展望之外。我们是一个远程第一的公司，拥有美国，加拿大，英国和德国设置的招聘中心。在 Stack Overflow,我们的使命是赋予世界开发人员权力。每天，数百万开发者都会来到我们那里寻求更好的编程问题的答案，与他们的团队合作，并找到下一个梦想的工作。随着世界不断变化，技术成为领先力量，我们致力于使 Stack Overflow 成为每个编码者都感到欢迎学习，分享知识和建立职业生涯的地方。我们正在寻找一个数据工程师来帮助设计和提供新的应用功能背后的数据能力，与软件工程师和产品合作伙伴密切合作。我们试图解决从可扩展的连接到定制外部系统等问题，再到在服务之间制定数据契约，以可靠的方式创造产品价值。我们相信采用数据并将其转换成一致模型，并安全可靠地为应用服务提供数据。你将帮助塑造这些系统的运作方式：数据是如何组织的，变化是如何处理的，管道在某些东西失败时如何恢复，以及我们随着发展而建筑结构如何扩大。你还将支持分析师，数据科学家和工程团队使用的共享数据基础。我们通过确保它准确，适当地可访问，产品需要的时候准备好来测量成功，最重要的是：为我们的用户提供价值。你将会做什么 · 与工程团队合作将应用要求转换成数据模型，管道设计和系统之间的清晰界面。· 使用 SQL,cl,PythonSpark 和 pyronSpark 进行设计，构建和操作生产数据操作。
查看英文原文
Every developer has a tab open on Stack Overflow.
We are one of the most popular websites in the world - a community-based space focused on increasing productivity, decreasing cycle times, accelerating time to market, and protecting institutional knowledge.
Innovation is at the heart of everything we do. We embrace collaboration, transparency, and believe in leading with empathy; creating an environment where every Stacker knows they belong. We embrace that the unique contributions and points of view of all Stackers contribute to our success.
We are a Best Company to Work For, in addition to being recognized for Best Company Leadership, Best Company Happiness, Best Company Perks and Benefits, Best Company Work-Life Balance, Best Company Compensation, and Best Company Outlook.
We are a remote-first company with Hiring HUBs based in the US, Canada, UK, and Germany.
At Stack Overflow, our mission is to empower the world’s developers. Every day, millions of developers come to us to get answers to their programming questions, collaborate better with their teams, and find their next dream job. As the world continues to transform with technology as a leading force, we’re driven to make Stack Overflow a place where everyone who codes feels welcome to learn, share their knowledge, and build their careers.
We're looking for a Data Engineer to help design and deliver the data capabilities behind new application features, working closely with software engineers and product partners. We are trying to solve problems from scalable connections to bespoke external systems to crafting data contracts between services which reliably create product value.We believe in taking data and transforming it into consistent models, and making it available to application services securely and reliably.
You'll help shape how those systems work: how data is organized, how changes are processed, how pipelines recover when something fails, and how the architecture scales as we grow. You'll also support the shared data foundations used by analysts, data scientists, and engineering teams. We measure success by making sure it is accurate, appropriately accessible, ready when the product needs it, and most importantly: provides value to our users.
What you'll do
- Embed with engineering teams to turn application requirements into data models, pipeline designs, and clear interfaces between systems.
- Design, build, and operate production data operations using SQL, Python, PySpark and cloud data technologies such as Databricks, integrating APIs, databases, and structured, semi-structured, and unstructured content.
- Build ingestion and transformation workflows that deliver usable data to application services and downstream capabilities.
- Design customer-aware data flows that preserve tenant boundaries, source permissions, and data lifecycle requirements, including updates, deletions, and regional constraints.
- Make pipelines resilient through incremental processing, checkpointing, safe retries, backfills, replay, and data-quality checks.
- Build observability that helps the team understand data freshness, completeness, processing progress, and failures across the pipeline.
- Evaluate architecture and tooling choices against product needs, balancing reliability, performance, maintainability, and operating cost.
- Maintain and improve shared datasets and pipelines that support both application features and internal analytics, avoiding unnecessary duplication of data and processing.
- Contribute to design reviews, testing, documentation, and deployment practices. Share what you learn and mentor less experienced engineers.
Skills and requirements
We expect to see:
- 5+ years of relevant engineering experience, including building and operating production data pipelines and contributing to their architecture.
- Strong SQL and Python skills, with experience in relational databases, data modeling, and query optimization.
- Experience integrating external APIs and working with changing schemas, imperfect source data, and incremental updates.
- Experience applying software engineering practices to data systems, including version control, automated testing, code review, CI/CD tooling, observability logging and monitoring.
- You love solving hard problems with the ability to investigate issues across ingestion, transformation, and downstream delivery.
- The ability to explain technical tradeoffs and collaborate with technical and non-technical stakeholders to deliver customer value through reliable, understandable, and maintainable solutions.
- A track record of sharing knowledge and helping other engineers grow, along with the communication and self-direction needed to work effectively on a distributed team.
- Experience with Azure/GCP and cloud data platforms such as Databricks, Apache Spark, Delta Lake, or comparable technologies.
Helpful, but not required
- Experience building data systems for customer-facing applications, particularly multi-tenant products or integrations with third-party services.
- Experience with document processing, knowledge systems, or pipelines that support AI-powered features.
- Experience with access controls, data governance, regional data requirements, or customer-data retention and deletion.
- Experience with event-driven processing, infrastructure as code, and monitoring or optimizing cloud workload costs.
- Examples of work you're proud of, whether from a previous role, a personal project, open source, or contributions to the Stack Overflow community.
What you’ll get in return:
- Competitive Base Salary
- Generous paid vacation
- Generous parental leave, family care leave, and unlimited sick days
- Industry-leading health benefits that are applicable per country of residence for all our full-time employees
- Company-paid Life Insurance
- Home Internet stipend
- Professional allocation for your growth and development
- One-time allowance to assist with your home office setup
- Company-paid access to Calm, Prosus Academy and Overdrive
Stack Overflow is proud to be an equal opportunity workplace. We value diversity, inclusion, equity and belonging and these pillars are at the heart of how we work together here at Stack. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying.
For individuals based in California, and other locations where required, we will consider employment qualified applicants with arrest and conviction records.
Originally posted on Himalayas