Data Platform Engineering Lead | Lisbon or Oporto
Where
Sign in to see the travel time
In short AI
Data Platform Engineering Lead for a client in the aerospace, defence and security sector, in Lisbon or Oporto, via Randstad Digital. Responsible for designing, implementing and maintaining the data and analytics platform, including leading a team.
Description
a long ad (5 281 characters): the AI summarised it; the full text is in the next tab.
- Role
- Lead and mentor a team of data architects and data engineers. Oversee the design, development and maintenance of scalable data architectures and pipelines (ingestion, storage, processing, management and analytics). Define the platform architecture and technology stack, integrate data sources, optimise performance, implement security and compliance, collaborate with data scientists, analysts and product managers, and maintain documentation of pipelines, ETL processes and architectural decisions.
- Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems or a related field
- Minimum 7 years' experience in data engineering or a similar role, with at least 3 years in a leadership position
- Experience with data platform reference architectures (e.g. Lambda, Data Mesh)
- Deep knowledge of big data technologies (e.g. Hadoop, Spark, Kafka) and data warehousing solutions (e.g. Redshift, Snowflake)
- Extensive experience with cloud platforms and their data services, with a focus on Google Cloud
- Experience migrating from on-premise to cloud and vice versa
- Knowledge of security frameworks and standards
- Proficiency in Python, Java or Scala
- Strong understanding of database management systems (SQL, NoSQL, NewSQL) and data integration tools (e.g. Apache NiFi, Talend, Informatica)
- Familiarity with data modelling, data warehousing and data governance
- Solid knowledge of DevOps best practices (Git, CI/CD, telemetry and monitoring)
- …
- Preferred
- Google Cloud certification, IaC (Ansible, Terraform), Airflow, Docker, pandas, scikit-learn, FastAPI, PostGIS
- Conditions
- Contract: not stated
- Salary: compatible with proven experience (amount not stated)
- Hours: not stated
- Location: Lisbon or Oporto
- Benefits
- An excellent work environment and the opportunity to make a real impact
- High-tech engineering company with a flat structure
- Professional development opportunities
- Collaborative and inclusive work environment
Randstad Digital is specialized in the recruitment of middle and senior positions for the Digital Market.
Our client is the leading company in the Aerospace, defence, and security sectors on a global scale and he is looking for a Data Platform Engineering Lead for Lisbon or Oporto.
The Data Platform Engineering Lead will be responsible for overseeing the design, implementation and maintenance of our Data & Analytics platform, pipelines and infrastructure. This role requires a combination of strong technical expertise, leadership abilities and a strategic mindset. The ideal candidate will have a proven track record in data architecture, data engineering, cloud and on-premise technologies, with experience in managing a deeply technical team and driving complex projects to completion. This role involves collaborating with cross-functional teams to ensure our data platform is robust, scalable, secure and aligned with the company's strategic objectives.
responsabilidades chave
Leadership: Lead and mentor a team of data architects and data engineers, fostering a collaborative and high-performance culture.
Platform Development: Oversee the design, development and maintenance of scalable and robust data architectures and pipelines, ensuring efficient data processing, storage and retrieval, including data ingestion, storage, processing, management and analytics components.
Architecture Design: Develop and maintain the architecture of the data platform, ensuring it meets the needs of various business units and supports future growth.
Technology Strategy: Define the technology stack and architecture standards for the data platform, ensuring alignment with industry best practices and emerging trends.
Data Integration: Develop strategies for integrating diverse data sources, ensuring seamless data flow and high data quality.
Scalability and Performance: Design solutions that can scale with growing data volumes and ensure optimal performance across the data platform.
Performance Optimization: Continuously monitor and optimize the performance of the data platform to handle large-scale data efficiently.
Security and Compliance: Implement robust data security measures and ensure compliance with relevant regulations and industry standards.
Collaboration: Work closely with data scientists, analysts, product managers and other stakeholders to understand data requirements and deliver effective solutions.
Innovation: Stay up-to-date with the latest advancements in data technologies and drive continuous innovation within the data platform.
Documentation: Maintain comprehensive documentation of data pipelines, ETL processes and architectural decisions.
competências
Education: Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or a related field.
Experience: 7+ years of experience in data engineering or a similar role, with at least 3 years in a leadership position.
Technical Expertise:
Strong experience with Data Platform reference architectures (e.g. Lambda architecture, Data Mesh).
Deep knowledge of big data technologies (e.g., Hadoop, Spark, Kafka) and data warehousing solutions (e.g., Redshift, Snowflake).
Extensive experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services, with a focus on Google Cloud. Google Cloud certification is preferred.
Experience with migration from on-premise to cloud and vice versa.
Good knowledge of relevant security frameworks & standards.
Proficiency in programming languages such as Python, Java, or Scala.
Strong understanding of database management systems (e.g., SQL, NoSQL, NewSQL). Experience with SQL and database management systems (e.g., MySQL, PostgreSQL, SQL Server).
Knowledge of data integration tools and frameworks (e.g., Apache Nifi, Talend, Informatica).
Familiarity with data modeling, data warehousing and data governance practices.
Experience with Iaac (e.g. Ansible, Terraform), data pipeline orchestration (e.g. Airflow), log exploration tools (e.g. Streamlit, Dash), data extraction (e.g. PostGIS, Kafka, Airflow, FastAPI), pandas, scikit-learn, Docker.
Solid knowledge of DevOps best practices and tools: GIT, CI/CD, telemetry and monitoring, etc.
Analytical Skills: Strong analytical and problem-solving skills with a focus on delivering scalable and efficient data solutions.
Leadership: Proven leadership skills with experience in building and leading high-performing teams.
Communication: Excellent verbal and written communication skills, with the ability to effectively collaborate with technical and non-technical stakeholders.
Project Management: Strong project management skills with the ability to manage multiple projects and priorities simultaneously.
Attention to Detail: High attention to detail and a commitment to ensuring data quality and accuracy.
Adaptability: Ability to work in a fast-paced, dynamic environment and manage multiple priorities simultaneously.
principais benefícios
An excellent work environment and an opportunity to create a real impact in the world;
A truly high-tech, state-of-the-art engineering company with flat structure and no politics;
Professional development opportunities;
Collaborative and inclusive work environment;
Salary compatible with the level of proven experience.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Data Platform Lead - Hybrid, LisbonMichael Page Portugal · Lisboa
- Data Engineer Lead | Porto (Hybrid)Randstad Portugal · Porto
- Senior Platform DevOps EngineerEuronext's Technology Centre - Portugal · Porto
- Lead Security Engineer | Lisbon - HybridRandstad Portugal · Lisboa
- Lead Security Engineer | Lisbon - HybridRandstad Portugal · Lisboa
- Technical Lead / Solution Architect - Hybrid - LisbonA2IT Tecnologia · Lisboa
Space for courses and training in Systems analysts. Training providers, universities and trainers: [email protected]. Do you provide training?
Published on (1)
- Randstad Portugal seen 15 Oct · removed
First seen on 15 Oct, 07:12