Data Engineer (Freelancer)
在 Tectu,你可以产生真正的影响！作为数据工程师，你将在提供数据和业务战略，解决方案和流程中发挥主要作用来支持数据导向项目。理想的候选人热衷于为不断变化的业务需求和技术景观提供尖端解决方案。你将与我们的产品和工程团队密切合作定义并提供这些解决方案。如果你是数据痴迷，对技术热情，自动化和有纪律的自由职业者，我们很喜欢与你交谈。理想的候选人既有愿意，也希望在动态环境中工作，能够在日常活动中应用敏捷方法，并且喜欢独立地工作，几乎没有监督，而且还是在团队环境中。关于 Tectu 的角色，我们与各种客户合作，为解决不同问题和需求提供先进技术解决方案。作为 Tectu 的数据工程师，你的日期很可能会根据你参与的项目而异，但一般情况下你将执行以下的活动：·从创立到生产部署，拥有大型项目，快速运输 ·为各种客户设计，设计和开发简单但灵活的解决方案 · 设计和构建数据基础设施，如数据摄入，管道，仓库和数据湖泊，这些基础架构是高效的，能够存储和分析大量数据 · 解决具有挑战性的数据集成问题，利用最佳的 ETL 模式，框架，查询技术，采购结构化和非结构化的数据来源。· 推和实施提高数据可靠性，效率，成本和质量的方式 ·参与定义数据战略和能力路线图。· 参与团队的努力 - 代码审查，设计评审，技术决策和辅导他人要求 · 5年以上数据工程，数据仓库和数据湖平台经验 · SQL 和 Python 的强熟练 · 数据分析，数据建模，ETL/ELT,数据集成和编排 （例如 Airflow）以及结构化和非结构化的数据处理方面的经验。· AWS EMR (Spark) 和 Athena (Presto) 等各种大数据技术的经验 · AWS Redshift,BigQuery,Clickhouse 等 DWH 解决方案的经验
查看英文原文
At Tectu, you can make a real impact! As a Data Engineer you will play a lead role in delivering data and business strategies, solutions and processes to support the data oriented projects. The ideal candidate is passionate about delivering cutting edge solutions to support the changing business needs and technology landscape. You will be working closely with others on our Product and Engineering teams to define and deliver these solutions.
If you are data obsessed, passionate about technology, self-motivated and a disciplined freelancer, we would love to speak with you. The ideal candidate has both a willingness and desire to work in a dynamic environment, is able to apply Agile methodologies in day-to-day activities, and who enjoys working both independently with little oversight and in a team environment.
About the Role
At Tectu, we work with various customers, providing advanced tech solutions to solve different problems and needs. As a Data Engineer at Tectu, your day will most likely vary according to which projects youre involved in, but generally youll be performing the following activities:
- Owning major projects from inception to production deployment, shipping at a rapid pace
- Architecting, designing and developing simple, yet flexible solutions for a variety of customers
- Designing and building data infrastructure such as data ingestion, pipelines, warehouses, and data lakes that are efficient architectures and capable of storing and analyzing large quantities of data
- Solving challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources.
- Recommending and implementing ways to improve data reliability, efficiency, cost and quality
- Participating in defining data strategy and capabilities roadmap
- Contributing to team-wide efforts - code reviews, design reviews, technical decisions, and mentoring others
Requirements
- 5+ years of experience in data engineering, data warehousing and data lake platforms
- Strong proficiency of SQL and Python
- Experience in data analytics, data modeling, ETL/ELT, data integration and orchestration (e.g. Airflow) and processing of structured and unstructured data.
- Experience in a variety of big data technologies such as AWS EMR (Spark) and Athena (Presto)
- Experience with DWH solutions like AWS Redshift, BigQuery, Clickhouse
- Experience with latest cloud technologies of one of the biggest vendors (AWS is an advantage)
- A proven track record of owning and delivering tasks and projects on time
Soft Skills
- Strong work ethic and strong core values (honesty, integrity, creativity)
- Sense of urgency, ownership mindset, and customer focus
- Innovative problem solver who takes initiative never stops thinking about ways to improve
- Ability to self-learn new skills and technologies
Advantage
- BS in highly-quantitative field (Analytics, Computer Science, Mathematics, EE) is preferred
- Experience designing data systems from scratch
- Data driven mindset
- Able to create and communicate the 'big picture' in a clear way.
- Experience with data testing and data ops tools
- Experience with writing tested code as part of development lifecycle (e.g. Unit, Integration, API)
Originally posted on Himalayas