数据工程师
[8AD] Data Engineer
我们是Software Mind，一支充满激情的工程师团队，随时准备为任何顶级公司的项目注入动力！我们的目标是始终领先一步。加入一家持续成长的多元文化公司，享受由Great Place To Work认证的优秀工作环境！
职责：
• 使用Terraform设计和实现基础设施即代码（IaC），在Azure和Cloudflare上自动化并管理基础设施，确保一致且可扩展的部署。
• 监督PostgreSQL数据库操作并自动化数据库相关任务，以优化数据库管理。
• 消息队列配置：部署和配置消息队列，以促进高效的数据处理和服务间的通信。
• 使用GitHub Actions开发和维护CI/CD流水线，自动化软件交付流程，提高部署效率。
• 确保基础设施的安全性，实施RBAC实践，并在DevOps生命周期中应用合规和安全的最佳实践。
• 实施和维护监控与可观测性解决方案，以跟踪和优化系统性能，识别瓶颈并保持系统健康。
• 快速诊断并解决任何与基础设施相关的问题，确保对服务的最小干扰。
- Power BI（必须）：语义模型、DAX、使用PBIP编写的报告定义及.pbix部署、增量刷新、查询折叠，以及解决模型性能问题（如刷新/XMLA超时）。
- Azure Synapse（必须）：笔记本、管道、触发器和工作区管理；源端查询优化。
- 熟练掌握SQL用于数据验证、转换和故障排除。
- 熟悉PowerShell脚本，能够熟练使用常见模块（如Az、MicrosoftPowerBIMgmt）进行部署和运维任务。
- 了解Azure Functions/函数应用和CI/CD部署流程。
- 具备Azure DevOps（工作项跟踪）和Git/GitHub（分支、拉取请求）的实际经验。
- 偏好具有高级经验的候选人，对该特定技术栈有扎实的掌握，并具备高度自主工作的能力。
查看英文原文
We are Software Mind, an awesome team of engineers who are ready to ramp up any top-notch company’s projects! Our aim? To always be one step ahead. Become part of a multicultural company in constant growth with an excellent work environment certified by Great Place To Work!
Responsibilities:
• Design and implement Infrastructure as Code (IaC) using Terraform to automate and manage infrastructure across Azure and Cloudflare, ensuring consistent and scalable deployments.
• Oversee PostgreSQL DB operations and automate DB-related tasks to streamline database management.
• Message Queue Configuration: Deploy and configure message queues to facilitate efficient data processing and communication between services.
• Develop and maintain CI/CD pipelines using GitHub Actions, automating the software delivery process to improve deployment efficiency.
• Ensure security across the infrastructure, enforcing RBAC practices and applying best practices for compliance and security within the DevOps lifecycle.
• Implement and maintain monitoring and observability solutions to track and optimize system performance, identify bottlenecks, and maintain system health.
• Quickly diagnose and resolve any infrastructure- related issues, ensuring minimum disruption to our services.
- Power BI (must-have): semantic models, DAX, report definitions authored as PBIP with .pbix deployment, incremental refresh, query folding, and troubleshooting model performance issues (e.g., refresh/XMLA timeouts).
- Azure Synapse (must-have): notebooks, pipelines, triggers, and workspace management; source-side query optimization.
- Strong SQL for data validation, transformation, and troubleshooting.
- PowerShell scripting, with comfort working across common modules (e.g., Az, MicrosoftPowerBIMgmt) for deployment and operational tasks.
- Familiarity with Azure Functions/function apps and CI/CD deployment workflows.
- Experience with Azure DevOps (work item tracking) and Git/GitHub (branching, pull requests).
- Senior-level experience preferred, with strong proficiency across this specific tech stack and the ability to work with a high degree of autonomy.