colours
radaremprego

Machine Learning Engineer — Distillation

Hoursnot stated in the ad
not stated in the adwork mode · contract · salary
posted 2026-09-24 · advertised for 59 days ·

In short AI

Machine learning engineer role focused on model distillation, building smaller, faster and cheaper models for production. Remote, async-first work. Not stated: salary, contract type and schedule.

Description

Role
Design and implement knowledge distillation pipelines (teacher-student, self-distillation, multi-teacher), distill large foundation models into smaller, cheaper models for inference, run and analyse large-scale training experiments, work with research to turn new ideas into production code, optimise training and inference performance, and contribute to internal tooling and evaluation frameworks.
Requirements
  • Strong background in machine learning or deep learning
  • Hands-on experience with model distillation (LLMs or other neural networks)
  • Solid understanding of training dynamics, loss functions and optimisation
  • Experience with PyTorch (or JAX) and modern ML tooling
  • Comfort running experiments on multi-GPU or distributed setups
  • Ability to reason about model quality vs. performance tradeoffs
Preferred
  • distilling LLMs, inference optimisation (quantisation, pruning, kernels), evaluation of language models, open-source contributions or publications, experience in fast-moving startups
Conditions
Contract: not stated
Salary: not stated
Hours: not stated; remote, async-first environment
Location: remote
Benefits
  • Competitive compensation and meaningful equity
  • High ownership and direct impact on product and roadmap
  • Small, senior team with a strong research and engineering culture

About the Role

We’re looking for a Machine Learning Engineer focused on model distillation to help us build smaller, faster, and more efficient models without sacrificing quality. You’ll work at the intersection of research and production—taking cutting-edge techniques and turning them into systems that scale.

This is a hands-on role with real ownership: you’ll design distillation pipelines, run large-scale experiments, and ship models used in production.

What You’ll Do

  • Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.)

  • Distill large foundation models into smaller, faster, and cheaper models for inference

  • Run and analyze large-scale training experiments to evaluate quality, latency, and cost tradeoffs

  • Collaborate with research to translate new distillation ideas into production-ready code

  • Optimize training and inference performance (memory, throughput, latency)

  • Contribute to internal tooling, evaluation frameworks, and experiment tracking

  • (Optional) Contribute back to open-source models, tooling, or research

What We’re Looking For

  • Strong background in machine learning or deep learning

  • Hands-on experience with model distillation (LLMs or other neural networks)

  • Solid understanding of training dynamics, loss functions, and optimization

  • Experience with PyTorch (or JAX) and modern ML tooling

  • Comfort running experiments on multi-GPU or distributed setups

  • Ability to reason about model quality vs. performance tradeoffs

  • Pragmatic mindset: you care about shipping, not just papers

Nice to Have

  • Experience distilling LLMs or large sequence models

  • Experience with inference optimization (quantization, pruning, kernels, etc.)

  • Familiarity with evaluation for language models

  • Open-source contributions or research publications

  • Experience in early-stage or fast-moving startups

Why Join

  • Work on core model quality and cost efficiency—not side projects

  • High ownership and direct impact on product and roadmap

  • Small, senior team with strong research + engineering culture

  • Competitive compensation + meaningful equity

  • Remote-friendly, async-first environment

Originally posted on Himalayas

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

This jobMedian?4 107 €
2 788 €6 138 €

86 jobs · Systems analysts · remote

see the best paid →

Training for this job

Published on (2)

First seen on 17 Nov, 00:20 · last seen on 21 Nov, 22:32