高级集成工程师
Senior Integration Engineer
我们正在寻找一位具有高度责任感的工程师，加入一家处于种子阶段的AI供应链初创公司，专注于快消品（CPG）领域。你将负责整合层的开发，该层将平台的AI决策引擎与客户数据所处的现实世界系统连接起来：传统ERP系统、云数据仓库、对象存储、FTP文件传输和自定义电子表格。正确构建这一层意味着AI驱动的建议能够可靠且大规模地落地到核心系统中。
你将负责的工作包括：
- 在ERP系统、云数据仓库、对象存储和自定义数据源之间构建、扩展和维护集成。
- 设计并协调近实时同步，每个客户处理数百万条记录而无需人工干预。
- 深入研究每个外部API，包括其特点和未记录的行为，构建能够应对真实客户数据的连接器。
- 编写双向集成测试，保护从数据读取、更新到写入的完整生命周期，防止数据丢失。
- 在管道早期验证和交叉匹配数据，以在问题造成业务损害前发现错误。
- 构建监控和警报系统，确保故障在客户察觉前被发现和处理。
- 直接与快消品运营商及其IT团队合作，从需求分析到交付和持续运营，全程负责集成工作。
- 不断优化整合层，使连接新的、未见过的数据源成为一种配置操作，而不是重新构建。
我们寻找的人选应具备：
- 3年以上使用Python构建和交付数据管道和集成的实战经验。
- 深厚的通过REST、SOAP和查询语言API集成第三方系统的经验，包括OAuth、速率限制、分页和未记录的API特性。
- 熟练掌握Python后端技术栈：FastAPI、SQLAlchemy和Pydantic。
- 高级SQL技能，包括高性能查询编写和大规模批量插入操作（数十亿条记录）。
- 设计幂等、可重试管道的经验，具备清晰的获取、验证、标准化和插入模式。
- 构建写入路径集成的经验，包括安全机制、预演运行、故障捕获和完整的审计追踪。
- 构建可运维系统的经验：结构化日志、同步运行跟踪、警报集成和故障归因。
- 使用云数据仓库平台（如Snowflake、BigQuery或Databricks）的经验。
- 使用后台任务编排框架（如Celery、Airflow或Prefect）的经验。
查看英文原文
ABOUT THE ROLE
Join an early-stage AI supply chain software team building reliable connections between its platform and the systems used by consumer goods businesses. You will own integrations that bring customer data into the platform and safely send decisions back to systems of record.
WHAT YOU'LL DO
- Build and maintain integrations with ERPs, data warehouses, object storage, FTP sources, and custom systems.
- Design reliable, near-real-time syncs that handle millions of records per customer.
- Investigate external API behavior and build connectors that work with real-world data and undocumented quirks.
- Write round-trip tests to verify read, update, and write workflows and prevent data loss.
- Validate and reconcile data early, before errors can affect customer operations.
- Build monitoring, structured logging, sync tracking, and alerts to identify and triage failures.
- Work with customer operators and IT teams to scope, deliver, and operate integrations end to end.
- Improve the integration layer so new data sources can be added through configuration where possible.
WHAT WE'RE LOOKING FOR
- At least 3 years of experience shipping production data pipelines and integrations in Python.
- Hands-on experience with FastAPI, SQLAlchemy, and Pydantic.
- Strong experience integrating third-party systems through REST, SOAP, and query-language APIs, including OAuth, pagination, rate limits, and credential management.
- Advanced SQL skills, including high-performance queries and bulk upserts at large scale.
- Experience designing idempotent, auditable pipelines with fetch, validate, normalize, and upsert workflows.
- Experience with data warehouses such as Snowflake, Databricks, or BigQuery, and background task orchestration tools such as Temporal or similar.
- Experience building safe write paths with dry runs, failure capture, and auditability, as well as operational logging and alerting.
- Experience with unstructured data, AWS, or legacy ERP integrations is helpful.
COMPENSATION & BENEFITS
Visa sponsorship is available.
LOCATION
On-site in New York, United States.