资深软件工程师 - 数据基础设施
Staff Software Engineer - Data Infrastructure
我们相信，人们与财务的互动方式将在未来几年发生巨大变化。我们致力于通过构建工具和体验来推动这一变革，成千上万的开发者使用这些工具来创建他们自己的产品。Plaid 为数以百万计的人提供他们依赖的工具，帮助他们过上更健康的财务生活。我们与 Venmo、SoFi、多家财富 500 强公司以及许多大型银行合作，让人们能够轻松地将他们的财务账户连接到他们想要使用的应用和服务中。Plaid 的网络覆盖美国、加拿大、英国和欧洲的 12,000 家金融机构。公司成立于 2013 年，总部位于旧金山，纽约、西雅图、华盛顿特区、罗利、伦敦和阿姆斯特丹设有办事处。
数据驱动决策是 Plaid 文化的关键。为了支持这一点，我们需要在保持数据准确和完整的同时扩展我们的数据系统。我们为工程、产品和业务团队提供工具和指导，帮助他们快速且安全地探索我们的数据，获取所需的数据洞察，从而更有效地服务我们的客户。
数据基础设施工程师是数据仓库、数据湖仓、Spark、工作流编排和流处理技术领域的专家。我们在性能和成本效率方面扩展现有的数据管道，同时创建必要的抽象，使 Plaid 的其他工程师在此平台上开发变得极其简单。
职责
- 参与 Plaid 数据驱动和机器学习迭代的长期技术路线图
- 领导关键的数据基础设施项目，如改进机器学习开发的黄金路径，实现离线流解决方案以提高数据新鲜度，构建全新的 ETL 管道基础设施，并提升数据仓库或数据湖仓的能力
- 与其他团队和职能的负责人合作，定义 Plaid 关键后端系统和抽象的技术路线图
- 调试、排查问题并减轻数据平台的运维负担
- 通过指导和领导力扩大团队，审查技术文档和代码变更
资格要求
- 6 年以上软件工程经验
- 在数据基础设施或平台领域有丰富的实际软件工程经验，有成功交付项目的显著记录
查看英文原文
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam.
Making data driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively.
Engineers on Data Infrastructure are domain experts in Data Warehouse, Data Lakehouse, Spark, Workflow Orchestration, and Streaming technologies. We scale our existing data pipelines in a performant and cost efficient way while creating the necessary abstractions to make developing on top of this platform extremely simple for other engineers at Plaid.
Responsibilities
- Contribute towards the long-term technical roadmap for data-driven and machine learning iteration at Plaid
- Leading key data infrastructure projects such as improving ML development golden paths, implementing offline streaming solutions for data freshness, building net new ETL pipeline infrastructure, and evolving data warehouse or data lakehouse capabilities.
- Working with stakeholders in other teams and functions to define technical roadmaps for key backend systems and abstractions across Plaid.
- Debugging, troubleshooting, and reducing operational burden for our Data Platform.
- Growing the team via mentorship and leadership, reviewing technical documents and code changes.
Qualifications
- 6+ years of software engineering experience
- Extensive hands-on software engineering experience, with a strong track record of delivering successful projects within the Data Infrastructure or Platform domain at similar or larger companies.
- Deep understanding of one of the below:
- Data Infrastructure systems, including Data Warehouses, Data Lakehouses, Apache Spark, Streaming Infrastructure, Workflow Orchestration.
- Strong cross-functional collaboration, communication, and project management skills, with proven ability to coordinate effectively.
- Proficiency in coding, testing, and system design, ensuring reliable and scalable solutions.
- Demonstrated leadership abilities, including experience mentoring and guiding junior engineers.
- Experience with Python
- Nice-to-Have:
- Experience with Databricks
- Experience with Airflow
- Experience with AWS EMR
Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at accommodations@plaid.com.
Please review our Candidate Privacy Notice here https://plaid.com/legal/#candidate-privacy-notice.
Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.