数据工程师 - 高级 JP992
Data Engineer - Senior JP992
项目名称:
数字监管保障系统
范围:
阿尔伯塔省政府的现代化举措正在从根本上改变各部门用户收集、管理、分析和使用数据的方式,随着旧系统转变为现代数据管理和地理空间平台。这需要在多个旧系统和现代平台之间实现无缝的数据集成,以创建一个可信的统一信息来源。
DRAS 是阿尔伯塔省政府环境与保护区域(EPA)主导的监管转型计划,旨在现代化、数字化并简化环境和自然资源监管流程。DRAS 通过单一的整合数字平台支持整个监管生命周期,包括申请和授权、监测、合规、补救和关闭。
随着 DRAS 的持续开发,结构化数据的规模、种类和复杂性不断增加,持续需要专门的数据工程和数据集成专业知识。Talend 集成分析师在阿尔伯塔省政府的 Talend 集成平台上设计、构建、运营和支持数据集成解决方案,以在部门系统、云服务和分析环境以及运营系统之间移动、转换和整合数据。
这是一个注重实践的技术岗位,要求具备强大的 Talend 和 SQL 开发技能,并采用有纪律的服务导向方法进行平台操作,包括作业调度、监控、错误处理和事件解决;同时与数据工程师、平台管理员、部门利益相关者和供应商支持合作伙伴协作。
该职位将主要支持数字监管保障系统(DRAS)项目,该职位可能会扩展以支持其他企业级数据项目。
职责:
- 具有使用 Talend(Data Integration / Data Fabric / Talend Studio)开发数据集成解决方案的实际经验
- 强大的 SQL 技能,以及在关系型数据库(如 Oracle、SQL Server、PostgreSQL)上的实际工作经验
- 在企业数据中设计 ETL/ELT 流程、数据映射和转换逻辑方面的实际经验
- 在生产环境中操作和支持集成作业的经验,包括调度、监控和事件解决
- 将业务和数据需求转化为稳健的技术设计,应用数据映射、转换和对账逻辑
- 构建参数化作业和配置数据管道,确保数据的一致性和完整性
查看英文原文
Project Name:
Digital Regulatory Assurance System
Scope:
Modernization initiatives across the Government of Alberta are fundamentally changing how ministry users collect, manage, analyze, and use data as legacy systems are transformed into modern Data Management and Geospatial Platforms. This requires seamless data integration across multiple legacy and modern platforms to create a trusted, unified source of information.
DRAS is a Government of Alberta regulatory transformation initiative led by Environment and Protected Areas (EPA) to modernize, digitize, and streamline environmental and natural resource regulatory processes. DRAS supports the full regulatory lifecycle, from application and authorization to monitoring, compliance, remediation, and closure through a single, consolidated digital platform
As DRAS development continues, the volume, variety, and complexity of structured data continue to grow, creating a sustained need for dedicated data engineering and data integration expertise. The Talend Integration Analyst designs, builds, operates, and supports data integration solutions on the Government of Alberta's Talend Integration Platform, to move, transform, and consolidate data across ministry systems, cloud services, and analytics environments, and operational systems.
This is a hands-on technical role for someone who combines strong Talend and SQL development skills with a disciplined, service-oriented approach to platform operations including job scheduling, monitoring, error handling, and incident resolution; while collaborating with data engineers, platform administrators, ministry stakeholders, and vendor support partners.
This position will primarily support the Digital Regulatory Assurance System (DRAS) program, the role may be expanded to support additional enterprise data initiatives.
Duties:
- Demonstrated hands-on experience developing data integration solutions with Talend (Data Integration / Data Fabric / Talend Studio)
- Strong SQL skills and experience working with relational databases (e.g., Oracle, SQL Server, PostgreSQL).
- Proven experience designing ETL/ELT processes, data mappings, and transformation logic for enterprise data.
- Experience operating and supporting integration jobs in a production environment, including scheduling, monitoring, and incident resolution.
- Translate business and data requirements into robust technical designs, applying data-mapping, transformation, and reconciliation logic
- Build parameterized, reusable, and context-aware jobs that promote cleanly across development, test, and production environments.
- Implement performance-tuned, scalable integration patterns for both batch and near-real-time data movement.
- Design and expose secure data services and APIs using Azure API Management for downstream systems.
- Implement data governance practices, including metadata management, data classification, and lineage tracking.
- Ensure compliance with privacy and regulatory standards (e.g., POPA) through role-based access controls, encryption, and data masking.
- Design, develop, and unit-test Talend integration jobs, routes, and reusable components to extract, transform, and load data between source systems, databases, files, APIs, and cloud storage
- Schedule, orchestrate, deploy, and monitor Talend jobs; proactively track execution, throughput, and failures.
- Provide day-to-day operational support including triage, troubleshooting, and resolve integration incidents and data-load failures within agreed service levels.
- Monitor and troubleshoot data pipelines and integrations, ensuring reliability, scalability, and performance across the platform.
- Utilize AI and automation tools to streamline data engineering workflows, including pipeline development, testing, monitoring, and documentation.
- Leverage AI-assisted tools for code generation, optimization, and review to improve development efficiency and code quality.
- Other duties as needed
Originally posted on Himalayas