首席架构师 - Databricks
Principal Architect - Databricks
Tiger Analytics 是一家快速发展的高级分析咨询公司。我们的顾问在数据科学、机器学习和人工智能领域拥有深厚的专业知识。我们是多家财富100强公司的信赖的分析合作伙伴，帮助他们从数据中创造商业价值。我们的业务价值和领导力得到了包括 Forrester 和 Gartner 在内的多家市场研究机构的认可。随着我们继续打造全球最佳的分析咨询团队，我们正在寻找顶尖人才。
职位概述
我们正在寻找一位技术能力出众的首席数据架构师，负责设计和实现我们下一代的数据生态系统。您将主导端到端的数据管理、数据仓库和物联网数据采集管道的技术策略。理想的候选人应精通云数据平台（Azure 或 AWS）和高级数据治理。
主要职责
数据架构：设计基于 Databricks 的企业数据仓库（EDW）、湖仓一体和商业智能（BI）系统。
物联网与流数据采集：使用 Azure Hub、Device SDK、DPS 和 Stream Analytics 构建可扩展的数据管道。
数据管理：从数据采集到归档，实施信息生命周期管理（ILM）。
数据战略：定义、构建并执行全球数据治理和主数据管理实践。
数据集创建：将非结构化数据提取并处理为可用于高级分析的关联数据集。
要求
- 核心云数据平台（必须具备）
- Databricks：熟练构建优化的 Spark 管道、Delta Lake 和 Lakehouse。
- 云生态系统（选项 A：Azure 套件）
- 物联网基础设施：Azure Hub、Device SDK、设备预配服务（DPS）和设备孪生。
- 计算与存储：Azure Functions、Cosmos DB 和 Azure Stream Analytics。
- 云生态系统（选项 B：AWS 替代方案）
- 物联网基础设施：AWS IoT Core、IoT 设备管理、IoT 设备防护。
- 计算与存储：AWS Lambda、DynamoDB、Amazon Kinesis 和 EMR。
- 数据工程与治理
- BI 与 EDW：在企业数据仓库和商业智能工具方面有深入经验。
- 数据建模：能够有效管理结构化和非结构化数据资产。
- 资格与软技能
- 沟通能力：能够向不同技术团队清晰地传达复杂的技术概念。
- 协作能力：具备良好的团队合作精神，在跨职能环境中有成功经验。
- 经验：丰富的相关工作经验
查看英文原文
Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.
Job Summary
We are seeking a highly skilled Principal Data Architect to design and implement our next-generation data ecosystem. You will lead the technical strategy for end-to-end data management, data warehousing, and IoT ingestion pipelines. The ideal candidate brings mastery in cloud data platforms (Azure or AWS) and advanced data governance.
Key Responsibilities
Data Architecture: Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.
IoT & Stream Ingestion: Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.
Data Management: Implement information lifecycle management (ILM) from data ingestion to archiving.
Data Strategy: Define, build, and enforce global data governance and master data management practices.
Dataset Creation: Extract and manipulate unstructured data into connected datasets for advanced analytics.
Requirements
- Core Cloud Data Platform (Must Have)
- Databricks: Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses.
- Cloud Ecosystem (Option A: Azure Suite)
- IoT Infrastructure: Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.
- Compute & Storage: Azure Functions, Cosmos DB, and Azure Stream Analytics.
- Cloud Ecosystem (Option B: AWS Alternative)
- IoT Infrastructure: AWS IoT Core, IoT Device Management, and IoT Device Defender.
- Compute & Storage: AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
- Data Engineering & Governance
- BI & EDW: Deep expertise in enterprise data warehousing and business intelligence tools.
- Data Modeling: Proven ability to manage both structured and unstructured data assets.
- Qualifications & Soft Skills
- Communication: Ability to translate complex technical concepts clearly to diverse technical teams.
- Collaboration: Demonstrated teamwork skills with a proven track record in cross-functional environments.
- Experience: Extensive background in end-to-end data management principles and data lifecycle execution.
Good to have-Experience in architecting and building Azure IoT platforms/apps with good exposure to containerization and server less architecture.
Benefits
Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.
Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.
Originally posted on Himalayas