资深软件工程师 - 查询执行
Senior Staff Software Engineer - Query Execution
### **成为未来建设者**
Dremio 是统一的湖仓平台,用于自助分析和 AI,为包括 Maersk、Amazon、Regeneron、NetApp 和 S&P Global 在内的数百家全球企业服务。客户依赖 Dremio 的云、混合和本地湖仓来支持他们的数据网格、数据仓库迁移、数据虚拟化和统一数据访问用例。基于开源技术,包括 Apache Iceberg 和 Apache Arrow,Dremio 提供开放的湖仓架构,使洞察速度最快,并以极低的成本实现平台灵活性。了解更多请访问 [www.dremio.com.](http://www.dremio.com/)
**关于该职位**
Dremio 的查询执行团队构建负责大规模执行分析查询的运行时系统。该团队位于查询计划和表扫描之间,负责将查询计划转换为高效、可靠的执行的系统。
作为高级资深软件工程师,您将负责查询运算符、表达式评估、内存管理、执行调度、运行时计划和性能优化。您的工作将直接影响 Dremio 云数据平台上查询的性能、可扩展性和可靠性。
**您将从事的工作**
- 构建执行引擎:设计、实现、测试和支持查询运算符、表达式评估、执行调度、运行时计划和资源管理。
- 提升运行时性能:优化向量化处理、并发、并行性、内存使用、数据交换和磁盘溢出。
- 诊断复杂问题:使用查询概要、分析工具、遥测、基准测试、日志和生产数据调查查询正确性和性能问题。
- 优化 Java 和 JVM:提升 CPU 利用率、分配行为、垃圾回收、线程行为和其他运行时特性。
- 跨查询引擎协作:与查询规划器、数据湖、产品、支持和现场工程团队合作,进行端到端查询优化。
- 使用 AI 辅助开发工具:应用 AI 工具进行代码理解、调试、测试生成、文档编写和事件分析。
- 应用工程判断:通过评审、测试、基准测试和工程判断验证 AI 生成的代码和建议。
- 提升工程标准:参与设计和代码评审,贡献技术方向,并指导其他工程师。
**我们寻找的人选**
- 软件工程经验
查看英文原文
### **Be Part of Building the Future**
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at [www.dremio.com.](http://www.dremio.com/)
**About the role**
Dremio’s Query Execution team builds the runtime responsible for executing analytical queries at scale. The team sits between query planning and table scans, owning the systems that turn query plans into efficient, reliable execution.
As a Senior Staff Software Engineer, you’ll work on query operators, expression evaluation, memory management, execution scheduling, runtime planning, and performance optimization. Your work will directly affect query performance, scalability, and reliability across Dremio’s cloud data platform.
**What you’ll be doing**
- Build the execution engine: Design, implement, test, and support query operators, expression evaluation, execution scheduling, runtime planning, and resource management.
- Improve runtime performance: Optimize vectorized processing, concurrency, parallelism, memory usage, data exchange, and disk spilling.
- Diagnose difficult problems: Investigate query correctness and performance issues using query profiles, profiling tools, telemetry, benchmarks, logs, and production data.
- Optimize Java and the JVM: Improve CPU utilization, allocation behavior, garbage collection, thread behavior, and other runtime characteristics.
- Collaborate across the query engine: Work with Query Planner, Datalake, Product, Support, and field engineering teams on end-to-end query improvements.
- Use AI-assisted development tools: Apply AI tools to code comprehension, debugging, test generation, documentation, and incident analysis.
- Apply engineering judgment: Validate AI-generated code and recommendations through review, testing, benchmarking, and engineering judgment.
- Raise the engineering bar: Participate in design and code reviews, contribute to technical direction, and mentor other engineers.
**What we’re looking for**
- Software engineering experience: 5+ years developing production software, preferably in database systems, query execution, distributed systems, or related areas.
- Programming skills: Strong Java skills; experience with C++ is a plus.
- Computer science fundamentals: Strong foundation in data structures, algorithms, concurrency, multithreaded programming, and asynchronous programming.
- Database and distributed systems knowledge: Understanding of database internals, query processing, distributed execution, and performance optimization.
- Performance engineering experience: Experience profiling and optimizing CPU, memory, garbage collection, thread behavior, or other runtime characteristics.
- Problem-solving ability: Ability to solve ambiguous technical problems and work effectively across team boundaries.
- Engineering judgment: Ability to evaluate tradeoffs, validate solutions rigorously, and make sound decisions when working with unfamiliar or AI-assisted implementations.
- Communication and ownership: Strong communication skills, a sense of ownership, and a commitment to delivering high-quality software.
**Bonus points if you have**
- Query engines: Distributed query engines, database engines, or large-scale data processing systems.
- Execution techniques: Vectorized execution, query operators, expression evaluation, code generation, or runtime optimization.
- Runtime systems: JVM profiling, memory management, caching, networking, data exchange, execution scheduling, or disk spilling.
- Data platforms: Apache Arrow, Apache Iceberg, Parquet, Avro, Spark, Hadoop, or cloud object stores.
- Open source: Contributing to open-source projects.
#### **What we value**
At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.
_Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor._
_Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter._
_Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click_ [_here_](https://docs.google.com/document/d/1CB96QFmOX-bFy48YFOe2GO5lmdawOpKKBj8DpTgsuNg/edit?usp=sharing) _to review the privacy notice._
#### **Important Security Notice for Candidates**
At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement [here](https://www.dremio.com/blog/stay-alert-for-fraudulent-recruitment-attempts-that-falsely-claim-association-with-dremio/).
_Dremio is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company._