Backend Engineer, AI (Agent Systems)
In short AI
Backend engineer for the inference and orchestration layer powering AI features in production, focused on latency, reliability and cost. Process of 3 to 4 technical interviews, by video and/or onsite.
Description
a long ad (3 224 characters): the AI summarised it; the full text is in the next tab.
- Role
- Build and operate backend systems that serve AI features in production. Design inference pipelines, orchestration layers and service boundaries around models. Own monitoring, logging, alerting and incident response. Optimise latency and throughput across inference, caching, batching and streaming.
- Requirements
- Solid backend engineering fundamentals in production environments
- Experience with high-throughput, low-latency services
- Familiarity with AI inference patterns (LLMs, embeddings, multimodal)
- Debugging distributed systems under load
- Bias toward shipping and learning from production behaviour
- Preferred
- Python, Node.js, PyTorch, SQL and NoSQL, Kubernetes, Docker, OpenAI/Anthropic APIs or open-source LLMs
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated
- Benefits
- none stated
About ActAI
There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.
Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. We believe products will greatly reduce hallucinations.
Our objective is to organise anyone's life, allowing us all to spend time on valuable and meaningful things.
Role
As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.
You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.
Focus
Build and operate backend systems that serve AI-powered features in production.
Design inference pipelines, orchestration layers, and service boundaries around models.
Own production concerns: monitoring, logging, alerting, and incident response.
Optimize latency and throughput across inference, caching, batching, and streaming.
Ideal Experiences
Strong backend engineering fundamentals in production environments.
Experience running high-throughput, low-latency services.
Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
Comfortable debugging distributed systems under load.
Bias toward shipping and learning from production behavior.
Outcomes
Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
APIs are stable, clear, and support seamless integration with frontend and ML systems.
Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
Iterative improvements based on real usage continuously increase system performance and reliability.
Tech Stack
Python
NodeJs
Pytorch
OpenAI / Anthropic / open-source LLMs
SQl & noSQL
Kubernetes
Docker
How We Work
The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product
Interview process
If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.
Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.
We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.
Originally posted on Himalayas
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
Salary compared ⓘ
50 jobs · Systems analysts · remote
see the best paid →Training for this job
- AI267 - Developing and Deploying AI/ML Applications on Red Hat OpenShift AIRumosblended · 21 h · 953 € + IVA · starts 01/01/2027Asked for in this ad: AI / machine learning
- AI267: Developing and Deploying AI/ML Applications on Red Hat OpenShift AI (B-Learning)Galileuself-paced · flexible hours · 40 h · 1905 €Asked for in this ad: AI / machine learning
- a Inteligência Artificial no QuotidianoServiço de Formação Profissional de Viana do Casteloonline · evenings · 8 h · free · starts 03/12/2026Asked for in this ad: AI / machine learning
Languages AI
Published on (1)
- Himalayas seen 17 Nov
First seen on 17 Nov, 00:25