Data Engineer- Silver Conversions and Scheduling
我们是谁？PLATO 是加拿大最大的本土软件测试和技术服务公司。近30年来，我们的专家团队帮助客户提供可靠产品，用户享受互动。我们100%位于加拿大的团队在 QA,软件测量和 IT 服务方面拥有深厚经验，以及对合作，指导和持续改进的共同承诺。我们是一个代表彼此的团队，无论是在解决复杂的客户挑战还是通过辅导和知识分享帮助同事成长。作为加拿大最大的土著企业软件测试公司，我们为我们的根源和建立更强大的，更包容性的技术工作人员使命感到自豪。同时，我们热烈欢迎来自各个背景和经验的申请人，他们对质量，团队合作和产生影响感兴趣。时间：2026年12月至2027年3月 （可能会延长）.机会：数据工程师将在微软织品上的银层湖馆建造银层转换和规划管道。他们将金铜数据转化成清洁，符合银色数据集并可靠地编排其执行。安全要求：积极可靠性和符合秘密清除条件责任：使用微软织品，Azure 数据工厂，Spark 和 Delta Lake 构建开发银层转换和变化管道并维护银线的规划和编排，包括依赖性，重试和故障处理 使用可回用的 PySpark 库和基于元数据的配置以加速交付应用标准错误处理，记录，监控和单位测试模式支持调整，检查点，反弹和恢复来保持数据完整性 Tune Spark 工作负载性能和成本效率要求：必须有至少5年的经验：微软织品 （数据工厂，湖泊）,PySpark,Spark SQL,Delta Lake,Azure 数据工厂，Azure 存储 ·管道编程和规划 (Fabric Data Factory/Azure Data Factory) · PySpark 和 Spark SQL 数据转型 ·Microsoft Purview 对目录化和流派的曝光 •Azure DevOps,Git,CI/CD 管道与我们合作 在 PLATO,我们相信当人们感觉得到正确支持，联系和挑战时，伟大的工作会发生。你将成为一个专业人士分享知识的协作环境的一部分。
查看英文原文
Who We Are
PLATO is Canada’s largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients deliver reliable products that users enjoy interacting with.
Our 100% Canada‑based team brings deep experience in QA, software testing, and IT services, along with a shared commitment to collaboration, mentorship, and continuous improvement. We’re a team that shows up for each other, whether that’s tackling complex client challenges or helping colleagues grow through coaching and knowledge‑sharing.
As Canada’s largest Indigenous‑owned software testing company, we’re proud of our roots and our mission to build a stronger, more inclusive technology workforce. At the same time, we warmly welcome applicants of all backgrounds and experiences who are passionate about quality, teamwork, and making an impact.
Duration: December 2026- March 2027 (good likelihood of being extended)
The Opportunity:
The Data Engineer will build Silver layer conversion and scheduling pipelines in the medallion Lakehouse on Microsoft Fabric. They will transform Bronze data into cleansed, conformed Silver datasets and orchestrate their execution reliably.
Security Clearance requirement: Active Reliability and eligible for Secret clearance
Responsibilities:
Develop Silver layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark and Delta Lake
Build and maintain scheduling and orchestration of Silver pipelines, including dependencies, retries and failure handling
Use reusable PySpark libraries and metadata-driven configuration to speed up delivery
Apply standard error handling, logging, monitoring and unit-testing patterns
Support reconciliation, checkpointing, replay and recovery to maintain data integrity
Tune Spark workloads for performance and cost efficiency
Requirements:
Must have a minimum of 5 years of experience with the following:
Microsoft Fabric (Data Factory, Lakehouse), PySpark, Spark SQL, Delta Lake, Azure Data Factory, Azure Storage
- Pipeline orchestration and scheduling (Fabric Data Factory / Azure Data Factory)
- PySpark and Spark SQL data transformation
- Microsoft Purview exposure for cataloguing and lineage
• Azure DevOps, Git, CI/CD pipelines
Work With Us
At PLATO, we believe that great work happens when people feel supported, connected, and challenged in the right ways. You’ll be part of a collaborative environment where experienced professionals share knowledge, mentor others, and contribute to solving complex, real‑world client projects.
We are committed to inclusive hiring practices and encourage applications from individuals of all backgrounds, including women, persons with disabilities, visible minorities, and Indigenous peoples. If you require accommodation at any stage of the recruitment process, we’re here to support you.
PLATO respectfully acknowledges that we operate on treaty territories, unceded First Nations and Inuit territories, and within Métis homelands. We honour the long history of these lands and actively work toward reconciliation between Indigenous and non‑Indigenous peoples on Turtle Island.
Originally posted on Himalayas