GCP Data Engineer | BPCE-SI
Onde
Entra para ver o tempo de viagem
Em resumo IA
Posição de GCP Data Engineer na Natixis em Portugal (equipa BPCE SI, departamento de IT), em modelo híbrido nos escritórios do Porto ou de Lisboa. Foco na migração de dados e ETL de SQL Server para GCP/BigQuery.
Descrição
anúncio longo (4 436 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Participar na concepção e execução da migração de dados e processos ETL de SQL Server para GCP. Desenvolver e manter pipelines ETL/ELT em GCP, orquestrados com Cloud Composer (ou Apache Airflow). Otimizar consultas SQL e esquemas no BigQuery. Desenvolver scripts Python para automatização de migração e transformação de dados. Colaborar com administradores SQL Server, analistas e utilizadores finais, e garantir monitorização e resolução de incidentes nos pipelines.
- Requisitos
- Experiência significativa com BigQuery (modelação de esquemas, consultas SQL complexas, otimização de desempenho e custos)
- Experiência sólida com Cloud Composer / Apache Airflow (criação, agendamento e depuração de DAGs)
- Domínio excelente de SQL, com capacidade de adaptar e otimizar SQL para BigQuery
- Domínio aprofundado de Python para scripts de migração, automatização e integração com APIs GCP
- Experiência ou forte conhecimento de migração de bases de dados on-premise (SQL Server) para cloud (GCP)
- Capacidade analítica e de resolução de problemas
- Inglês com nível B2
- CVs apenas em inglês
- Valorizado
- conhecimento direto de SQL Server (T-SQL, administração básica), outros serviços GCP (Storage, Dataflow), Database Migration Service, Power BI, Data Vault, versionamento de código
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: modelo de trabalho híbrido
- Local: Porto ou Lisboa
- Benefícios
- Cartão de transporte ecológico (Green Transportation Budget)
- Bicicletas elétricas
- Política de trabalho híbrido flexível
- Honolulu Wellness Club
- Sala de oração
- Sala de lactação
Natixis in Portugal is currently seeking Google Cloud Platform (GCP) Data Engineers to join its BPCE SI (BPCE Solutions Informatiques) team, within the IT (Information Technologies) department, to work in a hybrid model in the Porto or Lisbon office.
Responsibilities
Data and Database Migration:
- Actively participate in the design and execution of the data and ETL process migration strategy from SQL Server to GCP.
- Develop and optimize scripts and pipelines for efficiently transferring and transforming data into BigQuery.
Design and Development of Data Pipelines on GCP:
- Design, develop, and maintain robust and high-performing ETL/ELT pipelines on GCP, replacing or rebuilding existing flows.
- Orchestrate and schedule these pipelines using Google Cloud Composer (or Apache Airflow) to ensure reliable migration and operationalization.
Database Management and Optimization on GCP:
- Develop and optimize complex SQL queries for BigQuery, taking into account the specificities of migrating from SQL Server to BigQuery (e.g., optimizing partitioning, clustering).
- Contribute to the design and implementation of optimized data schemas for BigQuery, adapted to new cloud architectures.
Development and Automation:
- Use Python to develop scripts for automating migration tasks, data transformation, and integration with other GCP services.
- Implement processes to ensure data quality and integrity during and after migration.
Collaboration and Support:
- Collaborate closely with current teams (SQL Server administrators, analysts) to understand the existing environment and facilitate the transition.
- Exchange with end-users (business lines, data scientists) to understand their needs and ensure the new platform meets their expectations.
- Participate in code reviews, development best practices, and testing strategies for the new platform.
- Ensure monitoring, debugging, and incident resolution related to data pipelines during the transition phase and upon production deployment.
Technological Watch and Optimization:
- Stay informed about best practices for migration and the latest developments on Google Cloud Platform.
- Propose improvements and optimizations for the new Data platform on GCP.
Hard skills:
- Mastery of Google Cloud Platform (GCP):
- BigQuery: Significant experience in schema design, writing complex queries (SQL), performance optimization, and cost management in a cloud context.
- Cloud Composer / Apache Airflow: Solid experience in creating, scheduling, monitoring, and debugging DAGs to orchestrate data flows, particularly for migration and integration processes.
- SQL: Excellent mastery of the SQL language. Experience with SQL Server is a plus, but more importantly, the ability to adapt and optimize SQL for BigQuery.
- Python: In-depth mastery of the Python language for developing scripts (migration, automation, data transformation) and interacting with GCP APIs.
- Data Migration: Experience or strong understanding of the challenges and methodologies for migrating databases from an on-premise environment (SQL Server) to a cloud environment (GCP).
- Analytical and Problem-Solving Skills: Ability to analyze existing systems (SQL Server), understand business needs, design solutions on GCP, and resolve complex problems related to migration and pipeline operation.
- Good communication skills in English (B2 level required).
Additional Skills (Good to Have):
- Direct knowledge of SQL Server (architecture, T-SQL, basic administration).
- Experience with other GCP services relevant to data migration and integration (Storage, Dataflow, etc.).
- Knowledge of GCP-specific migration tools and strategies (e.g., Database Migration Service).
- Experience with data visualization tools (Power BI).
- Understanding of Data Warehousing concepts and data modeling (Data Vault).
- Experience with code versioning.
Soft skills:
- Autonomy, rigor, organizational skills, teamwork ability, technical curiosity, and the capacity to adapt to a new environment.
We will only consider CVs in English.
Our workplace reflects the vibrant spirit of our locations, with initiatives such as a Green Transportation Budget, electric bikes and a flexible Hybrid Work Policy. We promote wellbeing through the Honolulu Wellness Club, a Prayer Room, a Lactation Room, and themed Villages that inspire creativity and collaboration. Through our ESG and DEI strategies, we are committed to being inclusive, caring, and fair, ensuring every voice is heard and valued.
Como me candidatar
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- GCP/Python Data Engineer (French Speaker) | BPCE-SINatixis · Lisboa
- GCP Data EngineeriTRTech Group · Lisboa
- GCP Data EngineerOSQuay · Lisboa
- Distributed Cloud | GCP Data EngineerDevoteam · Porto
- Distributed Cloud | GCP Data EngineerDevoteam · Lisboa
- Senior Data Engineer DataWire IT · Lisboa,Porto
Salário comparado ⓘ
207 ofertas · Analistas de sistemas · distrito de Lisboa
ver as que pagam mais →Formação para esta vaga
- Linguagens de Programação - Programação em PythonCentro de Formação e Reabilitação Profissional de Alcoitãoonline · horário laboral · 350 h · gratuito · início 11/12/2026Pedido neste anúncio: Python
- SQL Database: Implementing a SQL Data WarehouseRumosonline · horário laboral · 21 h · 1100 € · início 02/12/2026Pedido neste anúncio: SQL e bases de dados
- DP-750: Implement data engineering solutions using Azure DatabricksGalileuonline · horário laboral · 28 h · 1670 € + IVA · início 14/12/2026Pedido neste anúncio: Engenharia de dados (Spark, Databricks)
Requisitos IA
- experiência com Cloud Composer / Apache Airflow
Idiomas IA
Publicado em (1)
- Natixis visto 16 nov – 20 nov
Onde a empresa está ver no mapa →
- Porto (Porto) 24 oferta(s)
- Lisboa (Lisboa) 12 oferta(s)
segundo outras ofertas da empresa; não é necessariamente o local desta oferta.
Vista pela primeira vez a 16 nov, 22:09