cores
radaremprego

Senior Staff Software Engineer - Query Engine

Regimeremoto
Horáriosem indicação no anúncio
não indicado no anúnciocontrato · salário
publicado 2026-09-07 · anunciado há 75 dias

Onde

não indicado no anúncio

Entra para ver o tempo de viagem

Em resumo IA

Senior Staff Software Engineer (Query Engine) na Dremio, plataforma lakehouse para analytics e IA. Função de liderança técnica na equipa de Query Planner & Reflections (planeador e otimizador SQL sobre Apache Calcite). Localização e condições essenciais não indicadas no anúncio.

Descrição

anúncio longo (6 495 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.

Função
Definir a arquitetura e o roadmap do planeador de queries e do motor de reflections, incluindo funcionalidades de próxima geração. Desenhar, implementar, testar e suportar regras de planeamento, otimização baseada em custos, reescrita de queries e correspondência e substituição de reflections. Liderar projetos que atravessam equipas (Query Execution, Catalog, Datalake, Product). Trabalhar com Apache Calcite e Apache Iceberg, incluindo contribuições upstream. Diagnosticar problemas de correção e desempenho de planeamento e rever designs e código.
Requisitos
  • Mais de 10 anos de experiência a desenvolver software em produção, incluindo mais de 5 anos de Java sólido
  • Conhecimento profundo de otimização baseada em custos e reescrita de queries por regras, de preferência com Apache Calcite ou framework semelhante
  • Sólidos conhecimentos de SQL, processamento de queries, desempenho e modelação de dados
  • Fundamentos de ciência da computação: estruturas de dados, algoritmos, concorrência e programação multithread
  • Experiência comprovada em decisões de arquitetura de sistemas, liderança de iniciativas complexas entre equipas e mentoria de engenheiros seniores
  • Capacidade de avaliar compromissos, validar soluções e tomar decisões com código gerado por ferramentas de IA
  • …
Valorizado
  • controlo de acesso baseado em funções ou granular, sistemas de ficheiros distribuídos e object stores (S3, ADLS, HDFS), experiência com AWS, Azure ou Google Cloud, motores de queries distribuídos, correspondência de materialized views, estatísticas e estimativa de cardinalidade, contribuições para Apache Calcite, Apache Iceberg ou projetos …
Condições
Contrato: não indicado
Salário: não indicado
Horário: não indicado
Local: não indicado
Benefícios
não indicados

Be Part of Building the Future

Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost.  Learn more at www.dremio.com.

About the role

Dremio's Query Planner & Reflections team owns the SQL planner and optimizer, built on Apache Calcite, and the reflections engine that transparently rewrites queries to use pre-computed materializations instead of raw source data. The team sits between SQL and execution, owning the systems that turn queries into efficient plans and make them fast.

As a Senior Staff Software Engineer, you'll set technical direction for these systems: driving ambiguous, cross-team initiatives, raising the bar through design and code review, and growing other senior engineers. Your work will directly affect query performance, correctness, and cost across Dremio's cloud data platform.

What you'll be doing
  • Set technical direction: Define architecture and roadmap for the query planner and reflections systems, including next-generation features.
  • Build the planner: Design, implement, test, and support planning rules, cost-based optimization, query rewriting, and reflection matching and substitution.
  • Own complex initiatives: Lead design and delivery of projects that cross team boundaries, working with Query Execution, Catalog, Datalake, and Product.
  • Work with open source: Work deeply with Apache Calcite and Apache Iceberg, and drive contributions upstream where it benefits Dremio.
  • Diagnose difficult problems: Investigate query planning correctness and performance issues, including reflection matching, using query profiles, telemetry, benchmarks, logs, and production data.
  • Design for every deployment: Build systems that run correctly across Dremio's deployment models and public clouds.
  • Use AI-assisted development tools: Apply AI tools to code comprehension, debugging, test generation, documentation, and incident analysis.
  • Apply engineering judgment: Validate AI-generated code and recommendations through review, testing, benchmarking, and engineering judgment.
  • Raise the engineering bar: Participate in design and code reviews, set technical standards, and mentor senior and staff-level engineers.
  • Partner across the company: Work with Product on multi-quarter roadmap decisions and with Support and field engineering on the highest-impact customer issues.
What we're looking for
  • Software engineering experience: 10+ years developing production software, including 5+ years of strong Java.
  • Query planning and optimization: Deep understanding of cost-based optimization and rule-based query rewriting, ideally with hands-on experience in Apache Calcite or a similar framework.
  • Database fundamentals: Strong knowledge of SQL, query processing, performance, and schema design.
  • Computer science fundamentals: Strong foundation in data structures, algorithms, concurrency, and multithreaded programming.
  • Technical leadership: Track record of driving system-level architecture decisions, leading complex cross-team initiatives, and mentoring senior engineers.
  • Access control: Experience with role-based or fine-grained access control in data platforms or database systems is a plus.
  • Cloud and storage: Understanding of distributed file systems and object stores such as S3, ADLS, or HDFS; experience with AWS, Azure, or Google Cloud.
  • Engineering judgment: Ability to evaluate tradeoffs, validate solutions rigorously, and make sound decisions when working with unfamiliar or AI-assisted implementations.
  • Communication and ownership: Ability to navigate ambiguous, cross-org problems independently, with strong communication skills and a commitment to delivering high-quality software.
Bonus points if you have
  • Query engines: Experience with distributed query engines, database engines, or large-scale data processing systems.
  • Planning techniques: Materialized view matching, query rewriting, statistics and cardinality estimation, or cost model design.
  • Open source: Contributions to Apache Calcite, Apache Iceberg, or similar planner and data platform projects.
  • Data platforms: Apache Arrow, Apache Iceberg, Parquet, Spark, or cloud object stores.
  • Languages: C++.

What we value 

At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice. 

Important Security Notice for Candidates

At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.

Dremio is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company.

Como me candidatar

Candidatar no anúncio original ↗

Preparar candidatura

Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.

Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.

Algo errado ou ilegal neste anúncio? Reportar

Fica visível enquanto analisamos. Decidimos em até 7 dias (o que é claramente ilegal, como uma burla, mais depressa) e dizemos-te o resultado e porquê.

Ofertas semelhantes

Salário comparado ⓘ

Esta ofertaMediana?4 232 €
2 769 €6 080 €

84 ofertas · Analistas de sistemas · teletrabalho

ver as que pagam mais →

Formação para esta vaga

Publicado em (1)

  • Dremio visto 16 nov – 20 nov

Vista pela primeira vez a 16 nov, 08:02 · última vez a 20 nov, 22:41