colours
app
radaremprego

AI Researcher — Training Optimization

Hoursnot stated in the ad
not stated in the adwork mode · contract · salary
posted 2026-09-25 · advertised for 58 days ·

In short AI

Applied research on optimizing the training of large-scale models: efficiency, stability and scalability, with experimental validation and publication. Ad written in English, published on Himalayas. Location and contract type not stated.

Description

Role
Design and evaluate training optimization techniques for large models (optimization algorithms, schedulers, normalization, curriculum strategies). Improve the efficiency and stability of long training runs on large datasets. Research and implement optimizers and schedulers, mixed-precision and low-precision training, gradient noise reduction, scaling laws and convergence analysis, regularization and robustness. Run large-scale experiments, analyze results and turn findings into improvements. Publish papers, technical reports or blog posts. Collaborate with infrastructure and inference teams.
Requirements
  • Strong background in machine learning research, with emphasis on training dynamics and optimization
  • Experience training large neural networks (LLMs, multimodal or long-sequence models)
  • Publications at ML venues (NeurIPS, ICML, ICLR, ACL, EMNLP, COLM) or equivalent high-quality open research, including arXiv
  • Solid understanding of optimization theory and practice, backpropagation, gradient flow and training stability, and distributed and large-batch training
  • Proficiency in Python and modern ML frameworks
  • Ability to independently design experiments and reason from data
Preferred
  • non-standard architectures (RNN variants, long-context models, hybrid systems), large-scale GPU training optimization (FSDP, ZeRO, custom kernels), open-source ML contributions, PyTorch, comfort in fast-moving, ambiguous startup environments
Conditions
Contract: not stated
Salary: not stated
Hours: not stated
Location: not stated
Benefits
none stated

About the Role

We’re looking for an AI Researcher focused on training optimization to help us push the efficiency, stability, and scalability of large-scale model training. You’ll work at the intersection of research and systems, developing novel techniques to reduce training cost, accelerate convergence, and improve model quality—while validating ideas through rigorous experiments and publications.

This role is ideal for someone who enjoys turning research insights into practical training wins, and who has a track record (or strong ambition) of publishing applied ML research.

What You’ll Work On

  • Design and evaluate training optimization techniques for large models (e.g. optimization algorithms, schedulers, normalization, curriculum strategies)

  • Improve training efficiency and stability across long runs and large datasets

  • Research and implement methods such as:

    • Optimizer and scheduler innovations

    • Mixed-precision, low-precision, and memory-efficient training

    • Gradient noise reduction, scaling laws, and convergence analysis

    • Training-time regularization and robustness techniques

  • Run large-scale experiments, analyze results, and translate findings into actionable improvements

  • Author or co-author research papers, technical reports, or blog posts

  • Collaborate closely with infrastructure and inference teams to ensure training decisions translate to real-world performance

What We’re Looking For

  • Strong background in machine learning research, with emphasis on training dynamics and optimization

  • Experience training large neural networks (LLMs, multimodal models, or large sequence models)

  • Publication experience in ML venues (e.g. NeurIPS, ICML, ICLR, ACL, EMNLP, COLM, arXiv) or equivalent high-quality open research

  • Solid understanding of:

    • Optimization theory and practice

    • Backpropagation, gradient flow, and training stability

    • Distributed and large-batch training

  • Proficiency in Python and modern ML frameworks (PyTorch preferred)

  • Ability to independently design experiments and reason from data

Nice to Have

  • Experience with non-standard architectures (e.g. RNN variants, long-context models, hybrid systems)

  • Experience optimizing training on GPUs at scale (FSDP, ZeRO, custom kernels)

  • Contributions to open-source ML or research codebases

  • Comfort operating in fast-moving, ambiguous startup environments

Why This Role

  • Real influence over core model training decisions

  • Freedom to pursue and publish novel research

  • Direct access to large-scale experiments and real production constraints

  • A small, senior team that values thinking deeply and shipping thoughtfully

Originally posted on Himalayas

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

This jobMedian?4 179 €
2 763 €6 116 €

83 jobs · Systems analysts · remote

see the best paid →

Training for this job

Languages AI

Published on (2)

First seen on 17 Nov, 00:20 · last seen on 21 Nov, 22:32