Senior Databricks Engineer - AI & Data Platform
Onde
Entra para ver o tempo de viagem
Em resumo IA
Engenheiro Sénior Databricks (AI & Data Platform) na Vantiva. Função de engenharia de plataforma e dados Databricks, com apoio a aplicações de IA generativa. Localização e condições contratuais não indicadas.
Descrição
anúncio longo (5 278 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Apoiar o desenvolvimento e implementação de aplicações de IA (LLM/GenAI, pipelines RAG, integração com Mosaic AI). Desenhar, construir e manter a plataforma Lakehouse Databricks (configuração do workspace, Unity Catalog, cluster policies, segurança e governance). Desenvolver e otimizar pipelines de dados em produção. Definir arquiteturas de referência e padrões de ingestão, transformação e consumo de dados. Estabelecer normas de engenharia (qualidade de código, CI/CD com Databricks Asset Bundles e Repos, testes, monitorização, otimização de custos). Trabalhar com analistas de dados, equipas de cloud/infraestrutura e unidades de negócio. …
- Requisitos
- 5+ anos em engenharia de dados ou de plataforma
- 3+ anos de experiência prática com Azure Databricks (administração de workspace, Delta Lake, Spark, Unity Catalog)
- Proficiência em Python e SQL
- Experiência comprovada em segurança de workspace Databricks: Private Link, VNet injection, IP access lists, gestão de identidades e acessos, cluster policies, gestão de segredos e RBAC
- Experiência na construção e operação de pipelines de dados em produção à escala
- Experiência com Mosaic AI (AI Playground, AI Functions, Agent Framework)
- Valorizado
- padrões de aplicações GenAI/LLM (RAG, prompt engineering, bases de dados vetoriais), certificações Databricks (Data Engineer Associate/Professional, Gen AI Engineer Associate), governance Unity Catalog à escala empresarial, integração SAP (S/4HANA, BW/4HANA), migração de SAP BW/4HANA para Databricks, MLflow ou ferramentas equivalentes de MLOps
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: não indicado
- Local: não indicado
- Benefícios
- não indicados
About Vantiva
Pushing the Edge
Vantiva (Euronext Paris: VANTI) is a global technology leader in connectivity technologies. For over 130 years, we have delivered solutions that connect what matters most. Today, we continue to redefine connectivity with industry-leading broadband, video, and IoT-driven smart systems that elevate how people live, work, and connect globally.
Vantiva combines a customer-focused approach with decades of software development, electronics hardware design, and flexible supply chain expertise to deliver high-quality solutions at scale. This proficiency has positioned us as a trusted provider to leading network service providers, enterprise customers, and consumers around the world.
Our strong commitment to sustainability and responsible business practices has earned us multiple Gold and Platinum Medals from EcoVadis for environmental and social performance. These awards place us among the top 2% of organizations in our category evaluated globally.
With our headquarters in Paris and major offices in Australia, Brazil, China, India, South Korea, the United Kingdom, and the United States, we serve a diverse global customer base.
For more information, please visit vantiva.com and follow us on LinkedIn and X (Twitter).
This role combines Databricks platform engineering, data engineering, and AI application enablement, with responsibility for building and operating a secure, scalable Lakehouse foundation while supporting Generative AI and LLM-based solutionsKey Responsibilities
- AI Application Enablement: Support the development and deployment of AI-powered applications, including LLM/GenAI workflows, RAG pipelines, and integration with Mosaic AI tooling.
- Data Platform Foundation: Design, build, and maintain the core Databricks Lakehouse platform, including workspace configuration, Unity Catalog setup, cluster policies, security, and governance.
- Data Engineering: Develop and optimize production-grade data pipelines, delivering clean, reliable datasets for analytics and AI workloads.
- Solution Architecture: Evaluate requirements, produce reference architectures, and recommend patterns for data ingestion, transformation, storage, and consumption that align with AI use cases.
- Standards & Best Practices: Establish engineering standards for code quality, CI/CD (Databricks Asset Bundles, Repos), testing, monitoring, and cost optimization.
- Collaboration: Work cross-functionally with data analysts, cloud/infra teams, and business units to translate requirements into scalable technical solutions.
Required Qualifications
- 5+ years in data engineering or platform engineering roles.
- 3+ years hands-on experience with Azure Databricks (workspace administration, Delta Lake, Spark, Unity Catalog).
- Strong proficiency in Python and SQL.
- Databricks workspace security: Proven experience implementing and managing workspace-level security, including network security (Private Link, VNet injection, IP access lists), identity and access management, cluster policies, secrets management, and RBAC at workspace, catalog, and object levels.
- Experience building and operating production data pipelines at scale.
- Experience with Mosaic AI (AI Playground, AI Functions, Agent Framework)
- Familiarity with GenAI/LLM application patterns (RAG, prompt engineering, vector databases) is highly desirable.
- Strong communication skills, ability to produce architecture diagrams, design documents, and present trade-offs to technical and non-technical audiences.
Nice to Have
- Databricks certifications (Data Engineer Associate/Professional, Gen AI Engineer Associate).
- Experience with Unity Catalog governance at enterprise scale (metastore design, data access policies, lineage, audit logging).
- Hands-on experience with SAP integration , extracting data from S/4HANA, or BW/4HANA into a Lakehouse platform.
- Experience leading or participating in data migration from SAP BW/4HANA to Databricks, including InfoProvider mapping, transformation logic re-implementation, data validation, and cutover planning.
- Exposure to AI/ML workflows: model training infrastructure, feature stores, MLflow, or equivalent MLOps tooling — and ability to prepare SAP-sourced datasets for downstream ML consumption.
What You'll Be Part Of
- A growing portfolio of AI initiatives ranging from predictive analytics to generative AI applications.
- Migration of legacy to Databricks Lakehouse platform that will serve as the organization's single source of truth.
- A collaborative, engineering-driven culture that values automation, quality, and continuous improvement.
Our most important asset is our People.
Vantiva’s success greatly relies on our people’s energy, motivation, and talent.
We are dedicated to cultivating a workforce that embraces and celebrates diversity as we believe our differences drive our creativity, and innovation.
We are proactive in supporting equality and maintaining an inclusive work environment, developing, and enhancing career opportunities for all.
Vantiva is committed to ensuring that all its employees receive a fair wage that is sufficient to live with dignity.
If you require a reasonable accommodation at any step of the application process, please let us know by answering the dedicated question in this application form.
Como me candidatar
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- Senior Databricks Engineer - AI & Data Platform | LisbonMichael Page Portugal · Lisboa
- Senior Data Engineer DatabricksCushman & Wakefield · Lisboa
- Senior Databricks EngineerBridge 351 · Lisboa
- Senior Data EngineerValtech
- Demand Planning AnalystVantiva · Lisboa
- Data & AI Senior EngineerCapgemini Engineering · Fundão,Lisboa
Salário comparado ⓘ
207 ofertas · Analistas de sistemas · distrito de Lisboa
ver as que pagam mais →Formação para esta vaga
- DP-3014: Build machine learning solutions using Azure DatabricksGalileu7 h · 590 € + IVAPedido neste anúncio: Engenharia de dados (Spark, Databricks)
- Data Science Aplicada, Big Data e AIUniversidade Lusófonaonline · pós-laboral · 120 hPedido neste anúncio: Engenharia de dados (Spark, Databricks)
- DP-750: Implement data engineering solutions using Azure DatabricksRumosonline · horário laboral · 28 h · 1670 € · início 14/12/2026Pedido neste anúncio: Engenharia de dados (Spark, Databricks)
Requisitos IA
- 5+ anos em engenharia de dados ou de plataforma
- Segurança de workspace Databricks
Idiomas IA
Onde a empresa está ver no mapa →
- Lisboa (Lisboa) 3 oferta(s)
segundo outras ofertas da empresa; não é necessariamente o local desta oferta.
Vista pela primeira vez a 16 nov, 08:03