Data Engineer Team Leader
Where
Probable location: the company is present in Lisboa, Porto, Sintra, Amadora, Aveiro, Espinho — a consultancy: the work is often at the client's.
In short AI
Data Engineer Team Leader: lead a data engineering team, building data pipelines and real-time data processing. Remote or on-site not stated; location not stated.
The ad, by section AI
- Role
- Build and scale robust data pipelines using Python, SQL, Airflow and DBT. Develop and maintain real-time data processing with Kafka and Spark Structured Streaming. Ingest and transform data from diverse sources and formats (JSON, Avro, Parquet, APIs, etc.). Influence and contribute to the evolution of the data platform and architecture. Deploy and manage services using Kubernetes and IaC tools. Mentor engineers and promote a collaborative, learning-focused team culture. Collaborate with stakeholders to deliver actionable, high-impact data solutions.
- Requirements
- Strong Python and SQL skills
- Hands-on experience with the modern data stack
- Experience with Kubernetes for service orchestration
- Experience with distributed data processing using Spark or Trino
- Proven ownership of data initiatives from idea to production
- Comfortable working autonomously and making architectural calls
- Experience with cloud platforms (AWS, GCP or Azure)
- Preferred
- Familiarity with Kafka (especially for data consumption use cases)
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- none stated
Principais tarefas Build and scale robust data pipelines using Python, SQL, Airflow, and DBT Develop and maintain real-time data processing with Kafka and Spark Structured Streaming Ingest and transform data from diverse sources and formats (JSON, Avro, Parquet, APIs, etc.) Influence and contribute to the evolution of our data platform and architecture Deploy and manage services using Kubernetes and IaC tools Mentor engineers and promote a collaborative, learning-focused team culture Collaborate with stakeholders to deliver actionable, high-impact data solutions Requisitos Strong Python and…
The source asked us not to reproduce the full text here: the complete ad is at the original link.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Data EngineerKWAN · Mafra
- Data EngineerElevus · Lisboa
- Data EngineerSOLVERDE, SA · Espinho
- Data Engineer (Apache Airflow/Spark/AWS) - Full Remote PortugalHumanIT Digital Consulting
- Data Engineer | AI & Data HubElevus · Lisboa
- Data Engineer GCP (Google Cloud Plataform)act digital · Porto
Space for courses and training in Systems analysts. Training providers, universities and trainers: [email protected]. Do you provide training?
Published on (2)
- Findmore Consulting seen 13 Oct · removed
- Teamlyzer (IT jobs, consultoras) seen 20 Oct – 27 Oct · removed
Where the company is see on the map →
- Lisboa (Lisboa) ≈ 199 jobs · 1 on the company's website (head office) · OSM · Google Maps
- Porto (Porto) ≈ 16 jobs · 1 on the company's website (office) · OSM · Google Maps
- Sintra (Lisboa) 5 jobs
- Amadora (Lisboa) 2 jobs
- Aveiro (Aveiro) 2 jobs
- Espinho (Aveiro) 2 jobs
- Mafra (Lisboa) 2 jobs
- Tomar (Santarém) 2 jobs
- Funchal (Ilha da Madeira) 1 on the company's website (office) · OSM · Google Maps
- Matosinhos (Porto) 1 job
- Palmela (Setúbal) 1 job
- Viseu (Viseu) ≈ 1 on the company's website (office) · OSM · Google Maps
according to the company's other jobs, the addresses on the company's website; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices. ≈ approximate point (only the locality or the postcode is known).
First seen on 13 Oct, 07:08 · last seen on 24 Oct, 09:46