Data Engineer – Mid-Level Microsoft Azure
Where
Sign in to see the travel time
In short AI
Mid-level Data Engineer to build and maintain scalable ETL/ELT pipelines on Microsoft Azure (Azure Databricks, PySpark, Azure Data Factory) and Data Lakehouse solutions. Location not stated. Contract, salary and hours not stated.
Description
- Role
- Work with business and technical teams to gather and analyse data requirements. Implement data solutions in Microsoft Azure environments following data engineering best practices. Develop and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and/or PySpark notebooks. Prepare, transform and model data to support Data Lakehouse solutions. Contribute to the design and implementation of end-to-end data solutions, from ingestion to delivery. Ensure data quality, consistency and reliability across the data lifecycle. Contribute to continuous improvement initiatives in the data engineering environment.
- Requirements
- Between 2 and 5 years of professional experience in Data Engineering.
- Solid experience with the Microsoft Azure ecosystem, particularly Azure Databricks.
- Experience with distributed data storage technologies, especially Azure Data Lake Storage.
- Strong knowledge of data formats such as Parquet and Delta Lake.
- Experience across the data solution lifecycle: ingestion, transformation, modelling and delivery.
- Ability to contribute to scalable, performance-oriented data architectures.
- Experience with Agile methodologies, particularly Scrum.
- Good analytical and problem-solving skills.
- Preferred
- experience with Azure Data Factory.
- knowledge of Scala to PySpark migration.
- knowledge of Azure Synapse.
- experience with Jira and Confluence.
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- none stated
Principais tarefas
• Collaborate with business and technical teams to gather and analyze data requirements
• Implement data solutions in Microsoft Azure environments following data engineering best practices
• Develop and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and/or PySpark notebooks
• Prepare, transform and model data to support Data Lakehouse solutions
• Contribute to the design and implementation of end-to-end data solutions, from ingestion and transformation to data delivery
• Ensure data quality, consistency and reliability throughout the data lifecycle
• Collaborate with the technical team to deliver scalable and performance-oriented data solutions
• Contribute to continuous improvement initiatives within the data engineering environment
Requisitos
• Between 2 and 5 years of professional experience in Data Engineering
• Solid experience with the Microsoft Azure ecosystem, particularly Azure Databricks
• Experience with distributed data storage technologies, especially Azure Data Lake Storage
• Strong knowledge of data formats such as Parquet and Delta Lake
• Experience across the data solution lifecycle, including ingestion, transformation, modelling and delivery
• Ability to contribute to scalable and performance-oriented data architectures
• Experience working with Agile methodologies, particularly Scrum
• Good analytical and problem-solving skills
Valorizado
• Experience with Azure Data Factory
• Knowledge of Scala to PySpark migration
• Knowledge of Azure Synapse
• Experience with Jira and Confluence
Something wrong or unlawful in this ad? Report it
Similar jobs
- Azure Data EngineerShore · Lisboa
- Azure Data Factory Data Engineer (Hybrid, Porto)Shore · Porto
- Data Engineer – Unified Data Layer (UDL) (f/m/div.)Bosch · Braga
- Distributed Cloud | Azure Data EngineerDevoteam · Porto
- Distributed Cloud | Azure Data EngineerDevoteam · Lisboa
- Data Engineer - Mid & Senior LevelAccenture Portugal · Lisboa
Space for courses and training in Systems analysts. Training providers, universities and trainers: [email protected]. Do you provide training?
Published on (1)
- Findmore Consulting seen 13 Oct · removed
Where the company is see on the map →
- Lisboa (Lisboa) ≈ 198 jobs · 1 on the company's website (head office) · OSM · Google Maps
- Porto (Porto) ≈ 16 jobs · 1 on the company's website (office) · OSM · Google Maps
- Sintra (Lisboa) 5 jobs
- Amadora (Lisboa) 2 jobs
- Aveiro (Aveiro) 2 jobs
- Espinho (Aveiro) 2 jobs
- Mafra (Lisboa) 2 jobs
- Tomar (Santarém) 2 jobs
- Funchal (Ilha da Madeira) 1 on the company's website (office) · OSM · Google Maps
- Matosinhos (Porto) 1 job
- Palmela (Setúbal) 1 job
- Viseu (Viseu) ≈ 1 on the company's website (office) · OSM · Google Maps
according to the company's other jobs, the addresses on the company's website; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices. ≈ approximate point (only the locality or the postcode is known).
First seen on 13 Oct, 07:08 · last seen on 20 Oct, 04:28