高级数据工程师
Senior Data Engineer
在 SPD Technology,我们汇聚了一群志同道合的人,他们通过工作创造价值,致力于高绩效并交付定制化、前沿的技术解决方案,推动客户的增长。我们以卓越的文化赋能员工,并提供机会让他们在每个层级上履行责任。我们重视人性与协作,鼓励专业和个人成长,营造一个支持性强、灵活的工作环境,欢迎每个人贡献自己的力量。
现在,我们正在寻找一名高级数据工程师加入我们的团队。
职位简介
我们正在寻找一名高级数据工程师,负责为支付领域的客户构建自动化支付报告和分析平台。目前,该业务的收入报告依赖于手动分录和手动汇总结果——总账和BI报告需要人工干预才能对账,且报告过于汇总,无法解释表现。
你的任务是用一致的自动化数据流取代现有流程:每日将处理器、CRM和ERP数据导入云数据仓库,自动记入总账,并提供足够细粒度的报告层,以分解任何差异到其根本原因。这是一个高度自主的职位,直接面向财务和业务利益相关者,你数据模型的质量直接决定业务是否信任其数据。
技术栈
核心:Snowflake、dbt、SQL、Python、现代编排工具(Airflow / Dagster / Prefect)、Git + CI/CD。
涉及的源系统:多个支付处理器和核心支付API、CRM(客户和定价属性)以及ERP/总账。BI工具在建模数据之上呈现最终用户仪表盘。
作为合格的专家,你将
- 设计并构建自动化、可靠的ELT管道,将来自多个源系统(支付处理器、CRM和ERP)的数据按每日节奏集成到云数据仓库中。
- 自动化财务报告至总账,通过设计实现与报告层对账,取代手动、易出错的流程。
- 构建并维护数据映射层,解决跨系统的客户身份问题,并将交易汇总到单一客户键。
- 构建干净、文档齐全的数据集市,使业务表现可解释
查看英文原文
At SPD Technology, we bring together a team of like-minded people who are driven by the desire to bring value through their work, united in their commitment to high performance and delivering custom, cutting-edge tech solutions that drive clients’ growth. We empower our people with a culture of excellence and enable them with the opportunity to uphold their accountability to contribute on each level. We value humanity and collaboration, encourage professional and personal growth, and foster a supportive and flexible work environment where everyone’s contribution is welcomed.
And now we are looking for a Senior Data Engineer to join us as part of our team.
About the role
We are looking for a Senior Data Engineer to lead the build of an automated payments reporting and analytics platform for a client in the payments space. Today, revenue reporting for this business depends on manual journal entries and manual assembly of results — the general ledger and BI reporting do not reconcile without human intervention, and reporting is too aggregated to explain performance.
Your mission is to replace that with a consistent, automated data flow: daily pipelines that land processor, CRM, and ERP data into a cloud data warehouse, post automatically to the general ledger, and feed a reporting layer granular enough to decompose any variance to budget down to its root cause. This is a high-ownership role with direct visibility to finance and business stakeholders, where the quality of your data models directly determines whether the business can trust its numbers.
Technical Stack
Core: Snowflake, dbt, SQL, Python, a modern orchestrator (Airflow / Dagster / Prefect), Git + CI/CD.
Source systems in scope: multiple payment processors and a core payments API, a CRM (customer & pricing attributes), and an ERP/general ledger. A BI tool renders the end-user dashboards on top of the modeled data.
As a qualified expert You will
- Design and build automated, reliable ELT pipelines that integrate data from multiple source systems (payment processors, CRM, and ERP) into a cloud data warehouse on a daily cadence.
- Automate financial reporting to the general ledger that reconciles with the reporting layer by design, replacing manual, error-prone processes.
- Build and maintain a data-mapping layer that resolves customer identity across systems and rolls transactions up to a single customer key.
- Model clean, well-documented data marts that make business performance explainable and support drill-down and variance analysis.
- Deliver the data models that power a KPI and forecasting dashboard for finance and business stakeholders.
- Ensure pipelines are robust and auditable with monitoring, data-quality checks, and alerting so issues are caught before reporting is consumed.
- Collaborate with BI, finance, and integration partners to turn business requirements into reliable data products and define phased delivery.
We’re looking for you if you have
- 5+ years of professional experience in data engineering, with a track record of owning production data pipelines end to end.
- Expert-level SQL — complex analytical queries, window functions, query optimization, and dimensional / star-schema data modeling.
- Hands-on experience on a modern cloud data warehouse, ideally Snowflake (or comparable: BigQuery, Redshift, Databricks).
- Strong experience with dbt (or an equivalent ELT transformation framework) for transformation and building tested, documented, version-controlled data models.
- Proven experience building and scheduling ELT/ETL pipelines using a workflow orchestrator (e.g. Airflow, Dagster, Prefect) and designing idempotent, re-runnable, incremental loads.
- Experience implementing data-quality testing, monitoring, and alerting as first-class parts of a pipeline.
- Strong communication skills with the ability to work directly with finance/business stakeholders, clarify requirements, and explain data-model decisions clearly (English, written and spoken).
Bonus points
- Domain experience in payments, FinTech, or financial-services data — familiarity with concepts such as interchange, scheme/network fees, take rate, chargebacks, authorization rates, or surcharging.
- Experience integrating payment-processor data (e.g. Worldpay, Adyen, Stripe) and normalizing heterogeneous processor data into a single model.
- Experience supporting BI/analytics teams and self-service reporting tools (e.g. Power BI, Tableau, Looker, Sigma).
- Exposure to analytics engineering or hands-on work with forecasting / cohort-based analytical models.
- Data contracts and governance practices (dbt exposures, contracts/tests, semantic layers).
What’s in it for You
Reveal great tech solutions
Join the team of experts who create custom, cutting-edge tech solutions for world-renowned businesses, fueling client growth. Unleash your potential, tackle new challenges, and be part of a team that values your skills and contributions. Focus on long-term impact and building tailored, long-lasting partnerships with our clients.
Experience an agile and flexible working environment
Enjoy the freedom of fully remote work with a flexible working schedule. Empower yourself with a stable workload and a stable income, supported by provided laptops and licensed software. We focus on lasting cooperation and unite result-oriented individuals who stand on a high-performance approach to work.
Embrace the opportunity for personal and professional growth
Benefit from performance and merit reviews, elevate your skills with personal development plans, and individual learnings through the corporate library, public speaking support, and more.
Be among like-minded people
Work with a team of one mind who cares about what they do and how they do. Collaborate with top-notch experts who are always ready to help and support you through any challenges. Join company-wide tech and cultural events, and contribute to meaningful CSR initiatives that resonate with your values. Feel supported by your HR, and take advantage of our referral bonus program.
Interview steps
- Pre-Screening with the recruiter (up to 30 min)
- Technical Interview (up to 90 min)
- Interview with Manager (45 min)
Originally posted on Himalayas