Senior Software Engineer - Catalog
Em resumo IA · um número não foi encontrado no anúncio
Senior Software Engineer na equipa Dremio Catalog, que constrói o Open Catalog (baseado em Apache Polaris). Função de engenharia sénior com 5 ou mais anos de experiência. Localização e tipo de contrato não indicados.
Descrição
anúncio longo (6 866 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Ser responsável por funcionalidades do Catalog desde o levantamento de requisitos e desenho técnico até implementação, testes, lançamento e suporte em produção. Estender o Apache Polaris mantendo compatibilidade com a especificação Iceberg REST Catalog. Construir APIs e serviços de catálogo para namespaces, tabelas, vistas, identidades, permissões e operações de metadados. Resolver problemas de sistemas distribuídos (consistência, concorrência, recuperação de falhas, multi-tenancy). Diagnosticar problemas em produção, escrever documentos de desenho e rever código. Trabalhar com equipas de motores de consulta, segurança, plataforma e produto. …
- Requisitos
- Cinco ou mais anos de experiência profissional em desenvolvimento de software ou experiência prática equivalente
- Forte experiência em Java e num codebase de produção substancial
- Conhecimentos de estruturas de dados, algoritmos, concorrência, desenho de APIs e sistemas distribuídos
- Experiência a levar funcionalidades de backend ou sistemas distribuídos desde o desenho até ao suporte em produção
- Capacidade de transformar requisitos incompletos em especificações implementáveis
- Experiência a orientar agentes de codificação com IA e a rever o seu trabalho
- Bom critério em revisão de código (concorrência, autorização, compatibilidade, desempenho, manutenibilidade)
- Comunicação clara, escrita e oral
- …
- Valorizado
- experiência com Apache Polaris, Apache Iceberg ou Iceberg REST Catalog, metadados de catálogos, sistemas de autorização, credential vending, serviços cloud multi-tenant, bases de dados e modelos de consistência, Kubernetes e cloud pública, Apache Spark, Flink ou Trino, contributos para projetos open-source
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: não indicado
- Local: não indicado
- Benefícios
- não indicados
Be Part of Building the Future
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.
About the role
The Dremio Catalog team builds Dremioʼs Open Catalog, an enterprise data catalog based on Apache Polaris. The catalog provides a governed entry point for Iceberg tables and federated data sources across object stores,databases, data warehouses, and other lakehouse catalogs.As a Senior Software Engineer, you will own features from design through production. You will work on catalog services, metadata APIs, security, multi-tenant isolation, and integrations with Dremio and external query engines.This role suits an engineer who enjoys distributed systems, open standards, and software that must remain correct under concurrency and at scale.You will own changes from requirements through release and production support. After writing the specification and choosing an approach, you may use AI coding agents to help with implementation. You will review their work and validate its behavior, with particular attention to concurrency, authorization, compatibility, and failure handling. Changes that belong in Apache Polaris may also be contributed upstream.
What youʼll be doing
- Own multiple features within the Catalog team, from requirements and technical design through implementation, testing, rollout, and production support.
- Extend Apache Polaris while preserving compatibility with the Iceberg REST Catalog specification.
- Build catalog APIs and services for namespaces, tables, views, identities, permissions, and metadata operations.
- Solve distributed systems problems involving consistency, concurrency, failure recovery, multi-tenancy, and service performance.
- Diagnose production issues using logs, metrics, traces, and service data, then address the underlying cause.
- Write design documents for the features you own and review designs from other engineers.
- Work with query engine, security, platform, and product teams to define interfaces and manage dependencies.
- Improve test coverage, operational tooling, and engineering practices in the areas you touch.
- Review code with attention to correctness, security, maintainability, and performance.
- Share technical knowledge with the team and help onboard or mentor newer engineers.
- Contribute fixes and features upstream when they belong in Apache Polaris or another open-source project.
- Use AI-assisted development tools for code comprehension, debugging, and test generation, while verifying their output through engineering review and testing.
What weʼre looking for
- Five or more years of professional software development experience, or equivalent practical experience.
- Strong Java skills and experience with a substantial production codebase, supported by knowledge of data structures, algorithms, concurrency, API design, and distributed systems.
- A record of owning backend or distributed-system features from design through rollout and production support, including estimating work and managing dependencies.
- Ability to turn incomplete product requirements into implementation-ready specifications covering interfaces, invariants, failure cases, security, and acceptance criteria.
- Experience directing AI coding agents, reviewing their plans and output, and correcting unsafe or unsuitable approaches. You remain accountable for every change you own, regardless of how the code was produced.
- Strong code-review judgment, particularly around concurrency, authorization, compatibility, performance, and maintainability.
- Experience validating changes through automated tests, static analysis, and production telemetry, then using that evidence to diagnose failures and address their root causes.
- Clear written and verbal communication in specifications, design documents, technical discussions, and code reviews.
- A bachelorʼs degree in Computer Science or a related field, or equivalent practical experience.
Bonus points if you have
- Experience with Apache Polaris, Apache Iceberg, or the Iceberg REST Catalog specification.
- Knowledge of metadata catalogs, authorization systems, credential vending, or policy enforcement.
- Experience building multi-tenant cloud services.
- Familiarity with databases, transaction isolation, and consistency models.
- Experience with Kubernetes and public cloud infrastructure.
- Familiarity with Apache Spark, Apache Flink, Trino, or other engines that integrate with Iceberg catalogs.
- Contributions to Apache or other open-source projects
What we value
At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.
Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.
Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.
Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.
Important Security Notice for Candidates
At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.
Dremio is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company.
Como me candidatar
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- Senior Staff Software Engineer - Query EngineDremio
- Software Engineer - Query ExecutionDremio
- Staff Software Engineer - ConnectivityDremio
- Staff Software Engineer - Query Planner & ReflectionsDremio
- Senior Data Engineer DatabricksCushman & Wakefield · Lisboa
- Senior Data EngineerSafeguard Global
Salário comparado ⓘ
67 ofertas · Programadores de software · teletrabalho
ver as que pagam mais →Formação para esta vaga
- Linguagens de Programação - Programação em JavaServiço de Formação Profissional de Faroonline · horário laboral · 350 h · gratuito · início 07/12/2026Pedido neste anúncio: Java
- Programação Java SEGalileuonline · horário laboral · 35 h · 2205 € + IVA · início 14/12/2026Pedido neste anúncio: Java
- Web Development with Spring MVCRumosmisto · 30 h · 1730 €Pedido neste anúncio: Java
Requisitos IA
- 5+ anos de experiência profissional
Idiomas IA
Publicado em (1)
- Dremio visto 16 nov – 21 nov
Vista pela primeira vez a 16 nov, 08:02 · última vez a 21 nov, 22:31