Azure数据架构师 - 自由职业
Azure Data Architect - freelance
通过多元化、公平性和包容性实现增长。作为一家有道德的企业,我们做正确的事——包括确保平等的机会,并为每个人营造安全、尊重的工作环境。我们相信,多元化能推动个人和业务的成长。我们致力于打造一个包容的社区,无论背景、身份或其他个人特征,所有员工都能蓬勃发展。
职责
- 提供标准的通用业务术语,表达战略数据需求,概述满足这些需求的高层次集成设计。
- 制定并实施数据治理政策、流程和框架,以确保数据完整性和合规性。
- 与相关方合作,使数据策略与业务目标和目的保持一致,以业务流程和数据旅程图的形式记录现状和目标状态。
- 设计和开发符合业务需求并与整体数据策略一致的概念、逻辑和物理数据模型。
- 制定数据标准、命名规范和数据分类指南。确保数据模型可扩展、高效,并针对性能进行优化。
- 根据组织需求和要求评估和选择适当的数据库技术和解决方案。
- 设计并监督数据平台的实施,包括关系型数据库、NoSQL 数据库、数据仓库和大数据解决方案。
- 优化数据库性能,确保数据安全,并实施备份和恢复策略。
- 设计数据集成解决方案,包括抽取、转换、加载(ETL)流程和数据管道,记录源到目标的映射。
- 与 IT 团队和数据专家合作,识别数据获取的机会。
- 理解并遵循各种类型数据系统的数据架构模式,例如数据湖平台、主数据管理系统、机器学习增强的数据流。
- 实施数据剖析和数据清洗流程,以识别并解决数据质量问题。
- 建立数据质量标准并实施流程来衡量、监控和提高数据质量。
- 主持讨论和研讨会,收集需求并使数据计划与业务目标保持一致,准备数据清单文档。
- 向技术及非技术相关方有效传达复杂的概念。
- 关注数据管理领域的行业趋势和新兴技术。
查看英文原文
Growth through diversity, equity, and inclusion. As an ethical business, we do what is right — including ensuring equal opportunities and fostering a safe, respectful workplace for each of us. We believe diversity fuels both personal and business growth. We're committed to building an inclusive community where all our people thrive regardless of their backgrounds, identities, or other personal characteristics.
Tasks
- Provides a standard common business vocabulary, expresses strategic data requirements, outlines high level integrated designs to meet these requirements.
- Define and implement data governance policies, procedures, and frameworks to ensure data integrity and compliance.
- Collaborate with stakeholders to align data strategy with business goals and objectives, document current and target state in the form of business process and data journey diagrams.
- Design and develop conceptual, logical, and physical data models that meet business requirements and align with the overall data strategy.
- Define data standards, naming conventions, and data classification guidelines. Ensure data models are scalable, efficient, and optimized for performance.
- Evaluate and select appropriate database technologies and solutions based on organizational needs and requirements.
- Design and oversee the implementation of data platforms, including relational databases, NoSQL databases, data warehousing, and Big Data solutions.
- Optimize database performance, ensure data security, and implement backup and recovery strategies.
- Design data integration solutions, including Extract, Transform, Load (ETL) processes and data pipelines, document source to target mappings.
- Collaborate with IT team and data experts to identify opportunities for data acquisition.
- Understand and follow data architecture patterns for various types of data systems, e.g. data lake platforms, master data management systems, ML enriched data flows.
- Implement data profiling and data cleansing processes to identify and resolve data quality issues.
- Establish data quality standards and implement processes to measure, monitor, and improve data quality.
- Facilitate discussions and workshops to gather requirements and align data initiatives with business goals, prepare data inventory documentation.
- Communicate complex technical concepts effectively to both technical and non-technical stakeholders.
- Stay abreast of industry trends and emerging technologies in data management, analytics, and security.
- Evaluate and recommend new tools, technologies, and frameworks to enhance data architecture capabilities.
- Provide guidance and support to developers and other team members on data-related topics.
- Conduct knowledge sharing sessions and training programs to promote understanding and adoption of data architecture best practices.
Requirements
- At least 6 years of professional experience in the Data & Analytics area
- Proven experience as a Data Architect or in a similar role, ideally in a complex organizational setting.
- Strong understanding of data management principles, data modeling techniques, database design and data integration flows.
- Experience in developing and implementing data governance policies, procedures, and frameworks to ensure data integrity and compliance.
- Familiarity with industry best practices and emerging trends in data management and governance.
- Ability to design and develop conceptual, logical, and physical data models that meet business requirements and align with the overall data strategy.
- Strong understanding of data modeling best-practices, e.g. data normalization, denormalization, generalization, and performance optimization techniques.
- Expertise in working with various database technologies, such as relational databases (e.g., Oracle, SQL Server, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB).
- Knowledge of database management systems, data warehousing, data integration technologies, and Big Data solutions.
- Familiarity with cloud-based database, warehouse, and lakehouse platforms.
- Experience in designing and implementing data integration solutions, including Extract,
- Transform, Load (ETL) processes and data pipelines, understanding of data integration patterns and best practices.
- Understanding of Business Intelligence and data analytics requirements, optimization of data storage and processing for reporting needs.
- Excellent communication and presentation skills to effectively articulate complex technical concepts to both technical and non-technical stakeholders.
- Ability to collaborate with cross-functional teams, including business analysts, developers, and data scientists, to understand requirements and drive data-related initiatives.
- Strong analytical and problem-solving abilities to identify data-related issues, propose solutions, and make data-driven decisions.
- Familiarity with data profiling, data cleansing, data harmonization, and data quality assessment techniques.
- Knowledge of data security and privacy regulations, such as GDPR or CCPA, understanding of data encryption, access controls, and data masking techniques to ensure the security of sensitive data.
- Professional certification in data management or related field would be advantageous.
Must have skills:
- Data Modelling and Design
- Data Management
- Requirement Gathering and Analysis
- Data Processing
- Technical Leadership
- Data Quality
- Azure Services – Synapse, ADF, ADL
- Technical Implementation and Monitoring
- One of: Python / Pyspark / R / Scala
Nice to have skills:
- CI/CD Automation
- GenAI for Data Engineering
Missing one or two of these qualifications? We still want to hear from you! If you bring a positive mindset, we'll provide an environment where you feel valued and empowered to learn and grow.
Originally posted on Himalayas