高级数据工程师
Senior Data Engineer
一个 cheesy 的笑话让你微笑：
两个 SQL 事务请牧师为他们主持婚礼，但牧师回答：“只有你们愿意 commit 的话。”
简介：
我们正在寻找一位动手能力强的数据工程师，其技能不仅限于编写查询。该职位专注于 SQL Server，适用于 Linux 和 Windows 环境，并要求在多种工具上具备灵活性，包括 PowerShell、API、Python 和新兴的 AI/LLM 技术。如果你喜欢将专业知识拓展到 SQL 之外，并希望为创新解决方案做出贡献，这个职位适合你。该职位是为我们北美的一家客户提供服务，客户拥有保险行业的专有软件。
职责：
- 设计、构建和优化复杂的 SQL Server 解决方案，重点在于性能调优、索引和数据建模。
- 管理关系型和半结构化数据，包括存储在 SQL Server 中的 JSON 和多维数据集。
- 使用原生 SQL Server 工具（如 OPENJSON 和 JSON_VALUE）查询和转换 JSON。
- 使用 PowerShell、SQL Server 工具和脚本自动化流程。
- 通过集成 API 和外部系统来增强功能。
- 综合性地解决问题，关注端到端的解决方案，而不仅仅是数据库层。
- 在复杂的多系统应用环境中工作，避免孤立的报表或分析任务。
- 探索并实现基于 LLM 的工作流，包括提示和结构化输出。
- 持续提高效率，用自动化替代手动流程。
所需技能：
- 精通 SQL Server，包括查询性能、索引和数据建模。
- 具有在 SQL Server 中处理 JSON 和管理混合数据模型的经验。
- 具有使用 PowerShell 或类似脚本语言进行自动化的经验。
- 能够在多个系统上工作，包括数据库、API 和服务。
- 有按时交付有效解决方案的实证能力。
优先考虑的技能：
- 在小型团队中具有端到端系统负责的经验。
- 具有复杂应用环境的经验，而非孤立的报表或分析环境。
- 能够在没有详细需求的情况下导航并解决问题。
- 具有保险、金融服务或其他监管严格、交易密集领域的经验。
- 具有 Python 经验，并熟悉 API 和集成。
- 接触过 LLM 如 OpenAI 和 Claude。
- 具有开发内部工具的经验或
查看英文原文
Cheesy joke to get you to smile:
Two SQL transactions ask a minister to marry them, but the minister replies, "Only if you're willing to commit."
Summary:
We are seeking a hands-on Data Engineer who is skilled in building complex systems beyond just writing queries. This role focuses on SQL Server in both Linux and Windows environments and requires versatility across various tools, including PowerShell, APIs, Python, and emerging AI/LLM technologies. If you enjoy stretching your expertise beyond SQL and want to contribute to innovative solutions, this position is for you. The role is for one of our North American clients with proprietary software for the insurance industry.
Responsibilities:
- Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling.
- Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets.
- Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE.
- Use PowerShell, SQL Server tools, and scripting to automate processes.
- Enhance functionalities by integrating with APIs and external systems.
- Address problems comprehensively, focusing on end-to-end solutions beyond the database layer.
- Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks.
- Explore and implement LLM-driven workflows, including prompting and structured outputs.
- Continuously enhance efficiency by replacing manual processes with automation.
Required Skills:
- Proficient in SQL Server, including query performance, indexing, and data modeling.
- Experience handling JSON in SQL Server and managing hybrid data models.
- Experience with PowerShell or similar scripting languages for automation purposes.
- Ability to work across multiple systems, including databases, APIs, and services.
- Proven ability to deliver effective solutions in a timely manner.
Preferred Skills:
- Background in smaller teams with end-to-end system ownership.
- Experience in complex application environments rather than isolated reporting or analytics settings.
- Capability to navigate and solve problems without detailed requirements.
- Experience in insurance, financial services, or other regulated, transaction-heavy domains.
- Python experience and familiarity with APIs and integrations.
- Exposure to LLMs like OpenAI and Claude.
- Experience developing internal tools or automation frameworks.
- Experience with cloud or hybrid infrastructure.
This is a fully remote position, offering the flexibility to work from anywhere. If you are ready to take ownership and thrive in a fast-paced, adaptive environment, we encourage you to apply!