Machine Learning Engineer — Distillation
In short AI
Machine learning engineer role focused on model distillation, building smaller, faster and cheaper models for production. Remote, async-first work. Not stated: salary, contract type and schedule.
Description
- Role
- Design and implement knowledge distillation pipelines (teacher-student, self-distillation, multi-teacher), distill large foundation models into smaller, cheaper models for inference, run and analyse large-scale training experiments, work with research to turn new ideas into production code, optimise training and inference performance, and contribute to internal tooling and evaluation frameworks.
- Requirements
- Strong background in machine learning or deep learning
- Hands-on experience with model distillation (LLMs or other neural networks)
- Solid understanding of training dynamics, loss functions and optimisation
- Experience with PyTorch (or JAX) and modern ML tooling
- Comfort running experiments on multi-GPU or distributed setups
- Ability to reason about model quality vs. performance tradeoffs
- Preferred
- distilling LLMs, inference optimisation (quantisation, pruning, kernels), evaluation of language models, open-source contributions or publications, experience in fast-moving startups
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated; remote, async-first environment
- Location: remote
- Benefits
- Competitive compensation and meaningful equity
- High ownership and direct impact on product and roadmap
- Small, senior team with a strong research and engineering culture
About the Role
We’re looking for a Machine Learning Engineer focused on model distillation to help us build smaller, faster, and more efficient models without sacrificing quality. You’ll work at the intersection of research and production—taking cutting-edge techniques and turning them into systems that scale.
This is a hands-on role with real ownership: you’ll design distillation pipelines, run large-scale experiments, and ship models used in production.
What You’ll Do
Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.)
Distill large foundation models into smaller, faster, and cheaper models for inference
Run and analyze large-scale training experiments to evaluate quality, latency, and cost tradeoffs
Collaborate with research to translate new distillation ideas into production-ready code
Optimize training and inference performance (memory, throughput, latency)
Contribute to internal tooling, evaluation frameworks, and experiment tracking
(Optional) Contribute back to open-source models, tooling, or research
What We’re Looking For
Strong background in machine learning or deep learning
Hands-on experience with model distillation (LLMs or other neural networks)
Solid understanding of training dynamics, loss functions, and optimization
Experience with PyTorch (or JAX) and modern ML tooling
Comfort running experiments on multi-GPU or distributed setups
Ability to reason about model quality vs. performance tradeoffs
Pragmatic mindset: you care about shipping, not just papers
Nice to Have
Experience distilling LLMs or large sequence models
Experience with inference optimization (quantization, pruning, kernels, etc.)
Familiarity with evaluation for language models
Open-source contributions or research publications
Experience in early-stage or fast-moving startups
Why Join
Work on core model quality and cost efficiency—not side projects
High ownership and direct impact on product and roadmap
Small, senior team with strong research + engineering culture
Competitive compensation + meaningful equity
Remote-friendly, async-first environment
Originally posted on Himalayas
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Machine Learning Engineer — Training OptimizationFeatherless AI
- Machine Learning Engineer — Inference OptimizationFeatherless AI
- Machine Learning Engineer — Multilingual DataFeatherless AI
- AI Researcher — DistillationFeatherless AI
- Machine Learning Engineer — AI Architecture ResearchFeatherless AI
- Distributed Cloud | Machine Learning EngineerDevoteam · Lisboa
Salary compared ⓘ
86 jobs · Systems analysts · remote
see the best paid →Training for this job
- Agentes de IA: Como Construir Aplicações Inovadoras Alimentadas por LLMsRumosonline · weekends · evenings · 30 h · 1538 € · starts 19/04/2027Asked for in this ad: AI / machine learning
- Inteligência Artificial Aplicada a Dados – Previsão, Análise e Interpretação com LLMs e MLCESAE Digitalonline · evenings · 100 h · freeAsked for in this ad: AI / machine learning
- a Inteligência Artificial no QuotidianoServiço de Formação Profissional de Viana do Casteloonline · evenings · 8 h · free · starts 03/12/2026Asked for in this ad: AI / machine learning
Published on (2)
- Himalayas seen 17 Nov
- Featherless AI seen 17 Nov – 21 Nov
First seen on 17 Nov, 00:20 · last seen on 21 Nov, 22:32