Senior Analytics Engineer
人力资源公司 (Human Power BG) 是一个人力资源机构,为保加利亚一些最好的公司提供咨询和招聘。------ 你的角色:你将向最终用户提供清洁数据集,以使最终用户能够回答自己的问题的方式建模数据。虽然数据分析师花费时间分析数据,但分析工程师花费了他们的时间转换,测试,部署和记录数据。你将负责 ELT 自动化,包括数据处理和清理,管理数据管道等。你应拥有传统和现代的 ELT 工具以及最新的大数据云工具之间的知识,并提供高效的数据摄入和转换技术。你将负责使用维度建模或其他类似框架最终数据设计。责任:· 从 OLTP 系统中提取和加载数据到大数据仓库 (Google BigQuery); ·创建和维护灵活的数据摄取管道,包括从各种源系统优化数据交付流程;实施新的 ELT 过程以支持业务分析和报告;· 使用维度建模 (或类似的框架)为准备数据进行分析;·积极监测 ELT 流程和程序,并提供预防措施以确保数据质量,系统性能和流量的优化;·通过优化数据结构,系统,过程和使用情况降低相关成本;要求:·精良了解 ELT 技术;· 3年以上与数据仓库和/或大型复杂数据库管理体系经验;· SQL 专家知识;·编写复杂分析 SQL 实践经验;· 间接 python 编程 (管理管道,构建 SQL); · DBT (或类似的 SQL 转换工具); · 流利写字,阅读和说英语;• Google BigQuery, Redshift, Snowflake 或 Azure Synapse 的经验;· MongoDB, Cosmos DB 等非关系数据库的经验。· Google Cloud Storage 或 Azure Storage 这样的云 BLOB 存储的经验;
查看英文原文
Human Power BG is an HR agency that offers consultations and recruitment for some of the best companies in Bulgaria.
------
Your role:
You will provide clean data sets to end users, modeling data in a way that empowers end users to answer their own questions. While a data analyst spends their time analyzing data, an analytics engineer spends their time transforming, testing, deploying, and documenting data.
You will be responsible for ELT automation, including data processing and cleaning, managing data pipelines, etc. You should have knowledge across data extraction and transformation tools traditional and modern ELT tools as well as more recent big data cloud tools and provide efficient data ingestion and transformation techniques. You will be responsible for the final data design using Dimensional Modeling or other similar framework.
Responsibilities:
- Extract & load data from OLTP systems to big data warehouse (Google BigQuery);
- Create and maintain flexible data ingestion pipelines including data delivery process optimization from various source systems;
- Implement new ELT processes in support of business analytics and reporting;
- Use dimensional modeling (or similar framework) to prepare data for analysis;
- Proactively monitor the ELT processes and procedures and provide preemptive measures ensuring data quality, system performance, and optimizations of the flows;
- Decrease the related costs by optimizing the structure, systems, processes and the use cases of the data;
Requirements:
- Excellent understanding of ELT techniques;
- 3+ years of experience with data warehousing and/or large and complex database management systems;
- Expert knowledge of SQL;
- Hands-on experience in writing complex analytical SQL;
- Strong dimensional data modeling skills;
- Intermediate python programming (to manage pipelines, compose SQL);
- DBT (or similar SQL transformation tool);
- Fluent English writing, reading and speaking;
Advantages:
- Experience with Google BigQuery, Redshift, Snowflake or Azure Synapse;
- Experience with non-relational databases like MongoDB, Cosmos DB, etc.
- Experience with cloud BLOB storages like Google Cloud Storage or Azure Storage.
- Experience with Airbyte, Alooma, Hevo, Stitch or Azure Data Factory;
- Experience working in Agile teams;
The company offers:
- Impact over hundreds of thousands of live customers;
- A small team where your work makes big difference;
- Work with well established development and release processes;
- Be part of a fast-moving agile team where quality always comes first;
- Research & Development of sophisticated high quality product, not thousands of small
- customer's projects;
Benefits
- 25 days paid leave;
- Laptop;
- Health insurance on company expenses;
- Multisport card (shared expenses between company and employee);
- Vouchers for food and monthly utility bills;
- Flexible options for balance between working from the office and working from home;
- Healthy fresh and dry fruits and nuts, fresh juices, cereals (while in the office);
- Hot drinks (coffee, tea, milk) (while in the office);
-------
For any questions you may have, please contact us:
0877 339 331 or
Thank you!
~~~~~~~~~~
We will contact only approved candidates!
Our services are free of charge to all applicants.
***
All candidates will be treated in strict confidence.
All data provided by you is protected by the meaning of the Personal Data Protection Law and will be used only for the purposes of this selection.
***
Human Power has an indefinite license 3084 issued by the National Employment Agency to provide services in the field of human resources.
***
Originally posted on Himalayas