AI Infrastructure Engineer (GPU) - Remote EMEA
Where
In short AI
AI Infrastructure Engineer (GPU), fully remote within the EMEA timezone, for a distributed cloud startup providing GPU infrastructure for AI/ML workloads. Start as soon as possible. Fluent English required.
Description
a long ad (4 584 characters): the AI summarised it; the full text is in the next tab.
- Role
- Build and operate production model serving infrastructure (frameworks such as vLLM, TGI, Triton or equivalent), with deployment pipelines using blue/green and canary rollout strategies, auto-scaling systems, multi-model serving architectures and request routing layers. Optimise GPU utilisation, memory efficiency, network throughput and model artifact storage. Design observability systems (latency, throughput, GPU usage, cost metrics). Manage model registries and CI/CD pipelines. Own the full lifecycle of ML systems, including operational support and on-call. Define engineering best practices.
- Requirements
- 4+ years of experience in ML Ops, Platform Engineering, SRE or similar roles focused on ML systems
- Hands-on experience with model serving frameworks such as vLLM, TGI, Triton or equivalent
- Strong background in container orchestration and operating GPU workloads in production
- Experience with MLOps tooling (model registries, experiment tracking, automated deployment pipelines)
- Proficiency in Python and infrastructure-as-code tools (Terraform, Helm or similar)
- Strong understanding of distributed systems, performance tuning and production reliability engineering
- Ability to use AI coding assistants
- Ownership mindset and ability to operate independently in a remote-first environment
- Preferred
- experience with Kubeflow, MLflow or KubeAI, knowledge of GPU scheduling, CUDA/ROCm or multi-tenant inference systems, experience with cost optimisation across GPU types, background in early-stage startups or greenfield infrastructure, experience building production systems from scratch
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: remote (EMEA timezone)
- Benefits
- none stated
Location: Fully remote (EMEA timezone)
Start date: ASAP
Languages: Fluent English required
Industry: Cloud Computing / AI / European Deep-Tech SaaS
About the Role
Pragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services. The company is redefining how compute is delivered by providing GPU-powered infrastructure for AI/ML workloads, secure storage, and high-speed data transfer through a decentralized architecture that significantly reduces environmental impact compared to traditional cloud providers.
We are seeking a AI Infrastructure Engineer with strong experience in production-grade model serving and infrastructure for AI systems. This is a highly technical, hands-on role focused on building scalable, reliable, and efficient ML inference platforms powering real-time AI applications.
You will be responsible for designing and operating the core infrastructure that serves machine learning models at scale. You will work closely with infrastructure, platform, and applied AI teams to ensure high availability, low latency, and cost-efficient inference systems. Strong ownership, production mindset, and experience with distributed GPU systems are essential.
Your Responsibilities
Build and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton, or equivalent
Design and implement robust deployment pipelines with blue/green and canary rollout strategies for ML models
Develop and maintain auto-scaling systems, multi-model serving architectures, and intelligent request routing layers
Optimize GPU utilization, memory efficiency, network throughput, and model artifact storage performance
Design observability systems for tracking inference latency, throughput, GPU usage, cost metrics, and system health
Manage model registries and CI/CD pipelines enabling automated and reproducible model deployments
Own the full lifecycle of ML systems from development through production, including operational support and on-call responsibilities
Define engineering best practices and contribute to platform scalability in a fast-moving startup environment
Required Qualifications
4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems
Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent
Strong background in container orchestration and operating GPU-based workloads in production
Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines
Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)
Strong understanding of distributed systems, performance tuning, and production reliability engineering
Ability to effectively use AI coding assistants to accelerate development and debugging workflows
Ownership mindset with the ability to operate independently in a remote-first environment
Preferred Qualifications
Experience with ML platforms such as Kubeflow, MLflow, or KubeAI
Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems
Experience with cost optimization across different GPU types and inference workloads
Background in early-stage startups or greenfield infrastructure projects
Proven experience building production systems from scratch rather than maintaining legacy platforms
Why Join Us
Take ownership of critical infrastructure powering a rapidly scaling AI-native cloud platform
Build foundational ML inference systems from the ground up in a high-growth, well-funded startup
Work at the intersection of distributed systems, GPU computing, and sustainable cloud architecture
Gain deep expertise in next-generation AI infrastructure and large-scale model serving systems
Influence core engineering decisions and define best practices that will scale with the company.
Pragmatike is committed to a fair, transparent, and inclusive recruitment process. We do not discriminate based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation.
In accordance with GDPR, your personal data will be processed lawfully, fairly, and securely, and used solely for recruitment purposes, including sharing it with our client(s) for employment consideration.
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- ML Infrastructure EngineerNebius
- AI Infrastructure & Platform Operations Engineer (remote in the EU)Mirantis
- AI Infrastructure & Platform Operations Engineer (remote in the EU)Mirantis
- Infrastructure Platform Engineer (Linux & Virtualization) – Remote (EMEA) (f/m/dSecurityBridge
- AI Infrastructure EngineervCluster Labs
- Software Engineer, Infrastructure (Go) - remote in the EUMirantis
Training for this job
- Machine Learning & Python CourseLe Wagononline · daytime · 1900 € · starts 01/03/2027Asked for in this ad: AI / machine learning
- AI-103: Develop AI apps and agents on AzureGalileuonline · daytime · 28 h · 1670 € + IVAAsked for in this ad: AI / machine learning
- Machine Learning com Python - IntroduçãoCESAE Digitalonline · evenings · 100 h · freeAsked for in this ad: AI / machine learning
Languages AI
Published on (1)
- Pragmatike seen 19 Nov – 21 Nov
First seen on 19 Nov, 15:45 · last seen on 21 Nov, 22:33