Data Engineer – Middle/Senior
Where
Sign in to see the travel time
In short AI
Data Engineer (Middle/Senior) to design, implement and optimise DataHub solutions on Microsoft Azure, with ETL/ELT pipelines using Azure Databricks, Azure Data Factory and/or PySpark notebooks. Location, contract, salary and hours not stated.
Description
- Role
- Collaborate with business and technical teams to gather, analyse and interpret data requirements, and translate them into technical specifications. Design, implement and optimise DataHub solutions in Microsoft Azure environments, including scalable ETL/ELT pipelines and end-to-end data models (ingestion, transformation, modelling and delivery). Ensure data quality, security and governance, and provide technical guidance to junior team members.
- Requirements
- Minimum 5 years of professional experience in Data Engineering
- Strong experience with the Microsoft Azure ecosystem, particularly Azure Databricks
- Experience with distributed data storage technologies, especially Azure Data Lake Storage
- Strong knowledge of data formats such as Parquet and Delta Lake
- Experience across the full data solution lifecycle (ingestion, transformation, modelling and delivery)
- Proven ability to design scalable and performance-oriented data architectures
- Experience with Agile methodologies, particularly Scrum
- Strong analytical, problem-solving and critical-thinking skills
- Preferred
- Experience with Azure Data Factory
- Knowledge of Scala to PySpark migration
- Knowledge of Azure Synapse
- Experience with Jira and Confluence
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- none stated
Principais tarefas
• Collaborate with business and technical teams to gather, analyze and interpret data requirements
• Translate functional requirements into clear and actionable technical specifications
• Design, implement and optimize DataHub solutions within Microsoft Azure environments
• Develop efficient and scalable ETL/ELT pipelines using Azure Databricks, Azure Data Factory and/or PySpark notebooks
• Design and implement data models and end-to-end data solutions covering ingestion, transformation, modelling and data delivery
• Collaborate with technical teams on data architecture, standards and engineering best practices
• Ensure data quality, security and governance throughout the data solution lifecycle
• Provide technical guidance and support to junior team members, promoting data engineering best practices
Requisitos
• Minimum 5 years of professional experience in Data Engineering
• Strong experience with the Microsoft Azure ecosystem, particularly Azure Databricks
• Experience with distributed data storage technologies, especially Azure Data Lake Storage
• Strong knowledge of data formats such as Parquet and Delta Lake
• Experience across the full data solution lifecycle, including data ingestion, transformation, modelling and delivery
• Proven ability to design scalable and performance-oriented data architectures
• Experience working with Agile methodologies, particularly Scrum
• Strong analytical, problem-solving and critical-thinking skills
Valorizado
• Experience with Azure Data Factory
• Knowledge of Scala to PySpark migration
• Knowledge of Azure Synapse
• Experience with Jira and Confluence
Something wrong or unlawful in this ad? Report it
Similar jobs
- Azure Data EngineerShore · Lisboa
- Azure Data Factory Data Engineer (Hybrid, Porto)Shore · Porto
- Data Engineer - Mid & Senior LevelAccenture Portugal · Lisboa
- Data Engineer | TrofaWINPROVIT S.A. · Trofa
- Consultant/Senior Consultant - Data Engineer | Lisboa/PortoEY · Lisboa,Porto
- Data EngineerKWAN · Mafra
Space for courses and training in Systems analysts. Training providers, universities and trainers: [email protected]. Do you provide training?
Published on (1)
- Findmore Consulting seen 13 Oct · removed
Where the company is see on the map →
- Lisboa (Lisboa) ≈ 198 jobs · 1 on the company's website (head office) · OSM · Google Maps
- Porto (Porto) ≈ 16 jobs · 1 on the company's website (office) · OSM · Google Maps
- Sintra (Lisboa) 5 jobs
- Amadora (Lisboa) 2 jobs
- Aveiro (Aveiro) 2 jobs
- Espinho (Aveiro) 2 jobs
- Mafra (Lisboa) 2 jobs
- Tomar (Santarém) 2 jobs
- Funchal (Ilha da Madeira) 1 on the company's website (office) · OSM · Google Maps
- Matosinhos (Porto) 1 job
- Palmela (Setúbal) 1 job
- Viseu (Viseu) ≈ 1 on the company's website (office) · OSM · Google Maps
according to the company's other jobs, the addresses on the company's website; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices. ≈ approximate point (only the locality or the postcode is known).
First seen on 13 Oct, 07:08 · last seen on 21 Oct, 04:22