Distributed Cloud | GCP Data Engineer
Where
Sign in to see the travel time
In short AI
GCP data engineer to design, build and optimise data pipelines and ETL/ELT solutions exclusively on Google Cloud Platform, using BigQuery, Cloud Dataflow and Pub/Sub. Requires more than 3 years of experience.
Description
- Role
- Design, build and maintain scalable data pipelines and ETL/ELT processes using Cloud Dataflow (Apache Beam), Cloud Dataproc and BigQuery. Optimise data infrastructure for fast ingestion (Cloud Pub/Sub, Cloud Storage), implement data quality checks and monitoring, collaborate with data scientists and analysts (including integration with Vertex AI), automate deployments with Terraform and CI/CD, and provide technical guidance on data architecture. Offer from Devoteam Group.
- Requirements
- More than 3 years of experience as a data engineer building production data pipelines
- Mandatory hands-on experience with BigQuery, Cloud Dataflow, Cloud Storage and Cloud Pub/Sub
- Strong proficiency in SQL and data warehousing and data modelling concepts
- Experience in a data engineering programming language (Python preferred)
- Experience with Terraform or other Infrastructure as Code tools
- Sound understanding of distributed systems and ETL/ELT frameworks
- Preferred
- Google Professional Data Engineer certification, streaming and real-time processing, Docker and Kubernetes/GKE
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- none stated
We are seeking an experienced and dedicated GCP Data Engineer to join our team. You will be responsible for designing, building, and optimizing robust, scalable, and highly available data pipelines and ETL/ELT solutions exclusively within the Google Cloud Platform (GCP). This role requires a strong focus on utilizing GCP's native data services to ensure data quality, automation, and performance optimization across the data lifecycle.
Design, build, and maintain scalable data pipelines and ETL/ELT processes using core GCP data services such as Cloud Dataflow (Apache Beam), Cloud Dataproc, and BigQuery.
Develop and optimize data infrastructure on GCP to ensure reliable, high-speed data ingestion (e.g., using Cloud Pub/Sub and Cloud Storage).
Implement data quality checks, monitoring, and validation to ensure accuracy and integrity of data across all GCP systems.
Collaborate closely with Data Scientists and Data Analysts to ensure data readiness for reporting, analytics, and Machine Learning initiatives (e.g., integrating with Vertex AI).
Automate deployment, monitoring, and testing of data infrastructure and pipelines using Infrastructure as Code (IaC) tools like Terraform and CI/CD practices.
Manage and optimize GCP data storage solutions, primarily BigQuery (data warehouse) and Cloud Storage (data lake), for performance and cost efficiency.
Provide technical guidance and recommendations on data architecture and technology choices within the GCP ecosystem.
- 3+ years of proven experience as a Data Engineer, focusing heavily on building production-grade data pipelines.
Mandatory hands-on expertise with Google Cloud Platform (GCP) data services, including BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.
Strong proficiency in SQL and extensive experience with data warehousing concepts and data modeling techniques.
Expertise in at least one programming language commonly used for data engineering (Python is highly preferred).
Experience with Infrastructure as Code (IaC) tools like Terraform for automating GCP data infrastructure deployment.
Solid understanding of distributed systems and ETL/ELT frameworks.
Excellent analytical and problem-solving skills, with a passion for continuous learning and data governance.
Preferred Skills:
Google Certified Professional Data Engineer certification.
Experience with streaming data technologies and real-time processing within GCP.
Knowledge of containerization and orchestration (Docker, Kubernetes/GKE).
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Distributed Cloud | GCP Data EngineerDevoteam · Porto
- Distributed Cloud | Google Cloud DevOps EngineerDevoteam · Lisboa
- Distributed Cloud | Google Cloud DevOps EngineerDevoteam · Porto
- Distributed Cloud | Data EngineerDevoteam · Lisboa
- Distributed Cloud | Data EngineerDevoteam · Porto
- Distributed Cloud | Analytics Engineer Devoteam · Porto
Salary compared ⓘ
207 jobs · Systems analysts · Lisboa district
see the best paid →Training for this job
- Linguagens de Programação - Programação em PythonCentro de Formação e Reabilitação Profissional de Alcoitãoonline · daytime · 350 h · free · starts 11/12/2026Asked for in this ad: Python
- Terraform FundamentalsRumosonline · daytime · 14 h · 810 € · starts 18/01/2027Asked for in this ad: Infrastructure as code
- Programação em Python: Do Zero às Bases EssenciaisPwC's Academyonline · daytime · 16 h · 800 € + IVA · starts 14/12/2026Asked for in this ad: Python
Languages AI
Published on (1)
- Devoteam seen 16 Nov – 20 Nov
Where the company is see on the map →
- Lisboa (Lisboa) 166 jobs
- Porto (Porto) 93 jobs
- Maia (Porto) 1 job
according to the company's other jobs; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices.
First seen on 16 Nov, 22:25