Machine Learning Engineer — AI Architecture Research
In short AI
Research and prototyping of new neural network architectures (alternatives to Transformers, recurrent and hybrid models, long-context systems), with a path to production. Series-A company, small team. Ad in English; location and salary not stated.
Description
- Role
- Research, develop and validate new machine learning model architectures. Design and run architecture-level experiments (scaling laws, memory mechanisms, compute trade-offs). Prototype models end-to-end, in collaboration with inference and systems engineers. Analyse model behaviour, failure modes and inductive biases, and reproduce and extend research papers.
- Requirements
- Solid foundations in machine learning and deep learning
- Experience implementing model architectures from scratch
- Knowledge of attention mechanisms, RNNs, state-space models or hybrid architectures
- Training dynamics, scaling behaviour and optimisation
- Memory, latency and compute constraints at the model level
- Ability to work in PyTorch or JAX
- Clear communication of architectural trade-offs
- Preferred
- experience with non-Transformer architectures, large-scale training or custom training loops, publications or preprints, inference optimisation
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- Competitive compensation and meaningful equity
About the Role
We’re looking for a Machine Learning Engineer focused on AI architecture research to help design, prototype, and validate next-generation model architectures. You’ll work at the intersection of research and production — turning new ideas into scalable, real-world systems.
This role is ideal for someone who enjoys questioning architectural assumptions, experimenting with novel model designs, and pushing beyond standard Transformer-style approaches.
What You’ll Work On
Research and develop new neural network architectures (e.g. alternatives or extensions to Transformers, recurrent / hybrid models, long-context systems)
Design and run architecture-level experiments (scaling laws, memory mechanisms, compute trade-offs)
Prototype models end-to-end — from research code to training-ready implementations
Collaborate with inference and systems engineers to ensure architectures are deployable and efficient
Analyze model behavior, failure modes, and inductive biases
Read, reproduce, and extend cutting-edge research papers
Contribute to internal research notes, benchmarks, and open-source efforts (where applicable)
What We’re Looking For
Strong background in machine learning fundamentals and deep learning
Hands-on experience implementing model architectures from scratch
-
Solid understanding of:
Attention mechanisms, RNNs, state-space models, or hybrid architectures
Training dynamics, scaling behavior, and optimization
Memory, latency, and compute constraints at the model level
Comfortable working in PyTorch or JAX
Ability to move fluidly between theory, experimentation, and engineering
Clear communicator who can explain architectural trade-offs
Nice to Have
Experience with non-Transformer architectures (RNN variants, SSMs, long-context models)
Background in research-driven startups or open-source ML projects
Experience with large-scale training or custom training loops
Publications, preprints, or notable research contributions
Familiarity with inference optimization and deployment constraints
Why Join
Work on core model architecture, not just fine-tuning
Direct influence on the technical direction of a Series-A company
Small, high-caliber team with fast feedback loops
Opportunity to ship research into production
Competitive compensation + meaningful equity
Originally posted on Himalayas
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- AI Researcher — AI Architecture ResearchFeatherless AI
- Machine Learning Engineer — Inference OptimizationFeatherless AI
- Machine Learning Engineer — Training OptimizationFeatherless AI
- Machine Learning Engineer — Multilingual DataFeatherless AI
- Machine Learning EngineerElevus · Lisboa
- Machine Learning Engineer — DistillationFeatherless AI
Salary compared ⓘ
83 jobs · Systems analysts · remote
see the best paid →Training for this job
- a Inteligência Artificial no QuotidianoServiço de Formação Profissional de Viana do Casteloonline · evenings · 8 h · free · starts 03/12/2026Asked for in this ad: AI / machine learning
- Utiliz. Ferramentas de Inteligência Artificial - Pós-laboralServiço de Emprego de Portimãoonline · evenings · 25 h · free · starts 23/11/2026Asked for in this ad: AI / machine learning
- Utilizar ferramentas da inteligência artificial na organizaçãoAcademia CITEVEblended · 25 h · free · starts 09/12/2026 · Vila Nova de FamalicãoAsked for in this ad: AI / machine learning
Languages AI
Published on (2)
- Himalayas seen 17 Nov
- Featherless AI seen 17 Nov – 21 Nov
First seen on 17 Nov, 00:20 · last seen on 21 Nov, 22:32