高级数据工程师
Senior Data Engineer
我们相信，人们与财务的互动方式将在未来几年发生巨大变化。我们致力于通过构建数千名开发者用来创建自己产品的工具和体验，推动这一变革。Plaid 为数以百万计的人提供支持，帮助他们过上更健康的财务生活。我们与 Venmo、SoFi、多家财富 500 强公司以及许多大型银行合作，让人们能够轻松地将财务账户连接到他们想要使用的应用和服务。Plaid 的网络覆盖美国、加拿大、英国和欧洲的 12,000 家金融机构。公司成立于 2013 年，总部位于旧金山，并在纽约、西雅图、华盛顿特区、罗利、伦敦和阿姆斯特丹设有办公室。
数据驱动决策是 Plaid 文化的关键。为了支持这一点，我们需要在保持数据正确性和完整性的前提下扩展我们的数据系统。我们为工程、产品和业务团队提供黄金数据集和工具，帮助他们快速且安全地探索我们的数据，获取所需的数据洞察，从而更有效地服务客户。此外，如果无法快速行动，Plaid 就不会成功。我们构建数据系统和工具，使 Plaid 每个人都能进行数据驱动的决策，让分析变得简单、明显且具有前瞻性。
数据工程师大量使用 SQL 和 Python 来构建与我们的 Golang 应用程序集成的数据工作流。我们使用 DBT、Airflow、Redshift、Atlan 和 Retool 等工具来编排数据管道并定义工作流。我们与工程师、产品经理、商业智能、数据分析师和其他多个团队合作，共同构建 Plaid 的数据战略和数据优先的理念。
你将担任一个高影响力的角色，直接帮助业务领导者基于你构建的数据集做出更快、更明智的业务决策。你将有机会在 Plaid 内部数据集和可视化方面建立所有权和范围，这目前是一个尚未被完全覆盖的领域，我们计划接管并建立 SLA。你将有机会从我们强大的 DE 团队以及更广泛的 Data Platform 团队中学习最佳实践并提升技术能力。你将与 Plaid 所有团队（从工程到产品再到市场营销/财务等）进行协作，并建立强有力的跨职能合作关系。
查看英文原文
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam.
Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide golden datasets and tooling to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. In addition, Plaid will not be successful if we can't move quickly. We build the data systems and tools that enable everyone at Plaid to be data-driven, making analytics easy, obvious, and proactive across the company.
Data Engineers heavily leverage SQL and Python to build data workflows that integrate with our Golang applications. We use tools like DBT, Airflow, Redshift, Atlan, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset.
You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownership and scope of internal datasets and visualizations across Plaid which is a currently unowned area that we intend to take over and build SLAs on. You will have the opportunity to learn best practices and up-level your technical skills from our strong DE team and from the broader Data Platform team. You will collaborate with and have strong and cross functional partnerships with literally all teams at Plaid from Engineering to Product to Marketing/Finance etc.
Responsibilities
- Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
- Have data quality and performance top of mind while designing datasetsLeading key data engineering projects that drive collaboration across the company.
- Advocating for adopting industry tools and practices at the right time.
- Owning core SQL and python data pipelines that power our data lake and data warehouse.
- Well-documented data with defined dataset quality, uptime, and usefulness.
Qualifications
- 4+ years of dedicated data engineering experience, solving complex data pipelines issues at scale.
- You’ve have experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
- You value SQL as a flexible and extensible tool, and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow.
- You have experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks.
- You have experience building and maintaining batch and realtime pipelines using technologies like Spark, Kafka.
- You appreciate the importance of schema design, and can evolve an analytics schema on top of unstructured data.
- You are excited to try out new technologies. You like to produce proof-of-concepts that balance technical advancement and user experience and adoption.
- You like to get deep in the weeds to manage, deploy, and improve low level data infrastructure.
- You are empathetic working with stakeholders. You listen to them, ask the right questions, and collaboratively come up with the best solutions for their needs while balancing infra and business needs.
- You are a champion for data privacy and integrity, and always act in the best interest of consumers.
Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at accommodations@plaid.com.
Please review our Candidate Privacy Notice here https://plaid.com/legal/#candidate-privacy-notice.
Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.