Google云认证专业人士
Google Cloud Certified Professionals
这是一个远程职位。
Comerit 正在寻找 Google Cloud 认证专业人士!随着市场在 Google Cloud 领域的增长,Comerit 基于 Google Cloud 平台的项目数量也在增加。特别是我们专注于数据转换和分析,因此我们更倾向于有 (GCP) BigQuery 经验的顾问。
虽然你的 GCP BigQuery 经验可能因具体职位和职责而异。但以下是一些可能相关的 BigQuery 经验方面:
- 查询与分析:编写类似 SQL 的查询,从存储在 BigQuery 中的大数据集提取见解。这包括理解数据模式、执行复杂的聚合、连接和转换,并优化查询以提高性能。
- 数据加载与提取:将数据从各种来源导入 BigQuery,包括来自 Cloud Storage 的文件、来自 Pub/Sub 的流数据,或来自外部系统的数据传输。同样,将数据从 BigQuery 导出到外部目标。
- 数据转换:使用 BigQuery 强大的 SQL 功能执行数据预处理和转换任务。这可能包括数据清洗、规范化、反规范化,以及创建派生表或视图。
- 数据建模与模式设计:在 BigQuery 中设计和维护逻辑数据模型和模式。这包括定义表、分区和聚类策略,以优化数据存储和查询性能。
- 性能优化:分析查询执行计划,识别瓶颈,并通过分区裁剪、缓存和查询调优等技术优化查询性能。
- 集成与自动化:与其他 GCP 服务(如 Cloud Storage、Pub/Sub、Dataflow 或 Data Studio)协作,构建端到端的数据管道,或将 BigQuery 与其他系统集成。使用调度工具或工作流框架(如 Cloud Composer 或 Cloud Data Fusion)自动化作业执行。
- 监控与故障排除:监控 BigQuery 作业的性能和健康状况,识别并解决与数据摄入、查询性能或数据一致性相关的问题。使用监控工具、日志记录和错误处理机制。
- 安全与合规:在 BigQuery 中实施适当的安全措施以保护敏感数据,遵守数据治理政策和合规法规。管理访问控制、数据加密
查看英文原文
This is a remote position.
Comerit is searching for Google Cloud Certified Professionals! As the market is growing in the Google Cloud space, so are the number of projects for Comerit that are Google Cloud Platform based. Specifically as we specialize in Data Transformation and Analytics, we would also prefer consultants with (GCP) BigQuery experience.
Although your GCP BigQuery experience may vary depending on the specific role and responsibilities assigned. However, here are some aspects of your BigQuery experience that may be relevant:
- Querying and Analysis: Writing SQL-like queries to extract insights from large datasets stored in BigQuery. This involves understanding the data schema, performing complex aggregations, joins, and transformations, and optimizing queries for performance.
- Data Loading and Extraction: Importing data from various sources into BigQuery, including files from Cloud Storage, streaming data from Pub/Sub, or data transfer from external systems. Similarly, exporting data from BigQuery to external destinations.
- Data Transformation: Performing data preprocessing and transformation tasks using BigQuery's powerful SQL capabilities. This may involve data cleaning, normalization, denormalization, and creating derived tables or views.
- Data Modeling and Schema Design: Designing and maintaining logical data models and schemas within BigQuery. This includes defining tables, partitions, and clustering strategies to optimize data storage and query performance.
- Performance Optimization: Analyzing query execution plans, identifying bottlenecks, and optimizing query performance through techniques like partition pruning, caching, and query tuning.
- Integration and Automation: Collaborating with other GCP services, such as Cloud Storage, Pub/Sub, Dataflow, or Data Studio, to build end-to-end data pipelines or integrate BigQuery with other systems. Automating job execution using scheduling tools or workflow frameworks like Cloud Composer or Cloud Data Fusion.
- Monitoring and Troubleshooting: Monitoring the performance and health of BigQuery jobs, identifying and resolving issues related to data ingestion, query performance, or data consistency. Utilizing monitoring tools, logging, and error handling mechanisms.
- Security and Compliance: Implementing appropriate security measures to protect sensitive data within BigQuery, adhering to data governance policies and compliance regulations. Managing access controls, data encryption, and auditing.
- Documentation and Collaboration: Maintaining documentation, including data dictionaries, process flows, and technical specifications. Collaborating with cross-functional teams, including data engineers, data scientists, and business stakeholders, to understand requirements and deliver solutions.
- Continuous Improvement: Staying up-to-date with the latest features and enhancements in BigQuery and related GCP services. Actively exploring opportunities to optimize data processing pipelines, enhance performance, and reduce costs.
If you are a Google Cloud Certified Professional, please apply and register.
Requirements
Any one of the following Google Cloud Platform Certifications:
· Professional Cloud Architect Certification
- Professional Data Engineer Certification
- Professional Cloud Developer Certification
- Professional Cloud Network Engineer Certification
- Professional Cloud Security Engineer Certification
- Professional Collaboration Engineer Certification
- Professional Cloud DevOps Engineer
- Google Cloud Certified Fellow: Hybrid Multi-Cloud
- Professional Machine Learning Engineer
Originally posted on Himalayas