高级数据工程师，数据建模与流处理
Senior Data Engineer, Data Modeling & Streaming
职位名称：高级数据工程师，数据建模与流处理
工作地点：100% 远程，加拿大
职位类型：T4 合同工
经验要求：8+ 年
薪资：每小时加元 70 - 78 元
职位简介：NearSource 正在寻找一名高级数据工程师，负责设计、开发、测试、部署和运营分析就绪的数据模型和数据管道。该职位将支持一个从共同优先级待办事项中工作的全球工程团队。
工程师将在数据建模、批处理和流处理管道、数据质量、测试、生产部署和运维支持方面做出贡献。
主要职责
- 为分析就绪的数据平台设计逻辑和物理数据模型。
- 在适当的情况下使用维度建模和星型模式原则开发二级数据模型。
- 定义事实、维度、关系、度量和数据转换。
- 开发数据摄取、转换和编排管道。
- 实现批处理和流式数据处理工作流。
- 支持数据复制和历史数据回填。
- 实现数据质量控制和验证逻辑。
- 执行单元测试、集成测试、回归测试和数据质量测试。
- 核对源数据集和目标数据集以验证数据的准确性和完整性。
- 准备生产就绪的代码、配置和数据模型。
- 参与代码审查和批准的发布流程。
- 支持生产部署和部署后验证。
- 排查生产缺陷并进行根本原因分析。
- 编写技术文档、发布说明和操作材料。
- 参与每日站会、设计评审、演示和知识传递活动。
- 支持与分布在不同地区的全球工程团队协作，参与 AMER 对齐的工程活动、利益相关者讨论、技术评审和交付工作。
- 必备技能
- 5+ 年数据工程或分布式系统领域的专业经验。
- 在批处理和流式数据架构方面有丰富的生产经验。
- 有构建和维护生产数据管道的经验。
- 有维度数据建模和星型模式设计的经验。
- 精通 Python 编程。
- 精通 Java 编程。
- 精通 SQL。
- 有数据质量和自动化测试的经验。
- 有生产环境排查和根本原因分析的经验。
- 有源代码控制、CI/CD、代码审查和敏捷工程实践的经验。
查看英文原文
Job Title: Senior Data Engineer, Data Modeling & Streaming
Job Location:100% Remote, Canada
Job Type:T4 Contract
Experience:8+ Years
Rate: CAD 70 - 78 per hour
Role Summary: NearSource is looking for a Senior Data Engineer to design, develop, test, deploy, and operationalize analytics-ready data models and data pipelines. The role will support a global engineering organization working from a jointly prioritized backlog.
The engineer will contribute across data modeling, batch and streaming pipelines, data quality, testing, production deployment, and operational support.
Key Responsibilities
- Design logical and physical data models for analytics-ready data platforms.
- Develop Tier-2 data models using dimensional modeling and star-schema principles where appropriate.
- Define facts, dimensions, relationships, measures, and data transformations.
- Develop ingestion, transformation, and orchestration pipelines.
- Implement batch and streaming data-processing workflows.
- Support data replication and historical data backfills.
- Implement data-quality controls and validation logic.
- Execute unit, integration, regression, and data-quality testing.
- Reconcile source and target datasets to validate data accuracy and completeness.
- Prepare production-ready code, configurations, and data models.
- Participate in code reviews and approved release processes.
- Support production deployments and post-deployment validation.
- Troubleshoot production defects and perform root-cause analysis.
- Create technical documentation, release notes, and operational materials.
- Participate in daily stand-ups, design reviews, demonstrations, and knowledge-transfer activities.
- Support collaboration with distributed global engineering teams across AMER-aligned engineering activities, stakeholder discussions, technical reviews, and delivery.
Must-Have Skills
- 5+ years of professional experience in data engineering or distributed systems.
- Strong production experience with batch and streaming data architectures.
- Experience building and maintaining production data pipelines.
- Experience with dimensional data modeling and star-schema design.
- Strong programming skills using Python.
- Strong programming skills using Java.
- Strong SQL skills.
- Experience with data quality and automated testing.
- Experience with production troubleshooting and root-cause analysis.
- Experience with source control, CI/CD, code reviews, and agile engineering practices.
- Experience working effectively within a distributed global engineering team.
- Hands-on experience with Apache Iceberg.
- Hands-on experience with Apache Airflow.
- Hands-on experience with Apache Spark.
- Hands-on experience with Apache Kafka.
- Hands-on experience with Apache Flink.
- Hands-on experience with Snowflake.
- Experience with Amazon Web Services.
Expected Deliverables
- Completed source code, configurations, and data models.
- Technical and operational documentation.
- Approved pull requests.
- Testing and validation evidence.
- Engineering demonstrations or technical walkthroughs.
- Release notes and change summaries.
- Production deployment artifacts.
- Post-release validation.
- Knowledge transfer and documented handoff of remaining work.
Apply now, or share your resume with salary expectations at
you for considering a career with us! Once you submit your application, our Talent Acquisition team will review your resume thoroughly. If there's a strong match, we'll reach out to discuss your experience, role details, benefits, compensation, and next steps. While we strive for transparency, we may not be able to respond to every applicant due to high volume, but we genuinely appreciate your time and interest.
About NearSource: NearSource Technologies is a trusted partner for future-ready software consulting, enabling Fortune 500 enterprises to accelerate digital transformation. Our global engineering teams build and deploy impactful technology for some of the world's most admired brands, working directly on long-term client initiatives.
Equal Opportunity: NearSource is an equal opportunity employer committed to fostering an inclusive and respectful environment. We celebrate diversity and do not discriminate based on race, gender, religion, sexual orientation, age, disability, or background. Innovation thrives when everyone feels empowered to contribute.
Originally posted on Himalayas