Staff Software Engineer - AI Copilot (Backend)
In short AI
Staff Software Engineer (Backend) role at Zendesk's AI Copilot organisation, focused on the architecture and delivery of the conversational AI backend for administrators. Requires 8+ years of software engineering experience. Location not stated.
Description
a long ad (5 851 characters): the AI summarised it; the full text is in the next tab.
- Role
- Lead the technical vision and architecture of the Admin Copilot conversational backend (LLM orchestration, intent detection, context retrieval and tool execution). Own end-to-end delivery of complex features, from technical design to production. Collaborate with ML Scientists, Product Management, Design and partner engineering teams, mentor engineers, set engineering standards and address technical and reliability risks.
- Requirements
- 8+ years of software engineering experience, with technical leadership in backend systems
- Experience designing distributed systems at scale (APIs, service architectures, data pipelines)
- Experience with LLM integration in production (orchestration, prompt engineering, evaluation, guardrails or multi-provider setups)
- Proficiency in at least one backend language (Ruby, Python, Go or similar)
- Deep knowledge of AWS cloud infrastructure, containerised deployments (Docker, Kubernetes) and CI/CD practices
- Track record of driving technical direction for a team or project (architecture decisions, technical roadmaps, cross-team alignment)
- Ability to operate with ambiguity and communicate effectively
- Preferred
- experience with conversational or chat-based systems (intent detection, context management, tool use), ML infrastructure (model serving, inference pipelines, evaluation frameworks), Metaflow, MLflow, Kafka, SQL, Snowflake, dbt, technically leading a team of 3+ engineers
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: not stated
- Location: not stated (hybrid model, with part of the week in a Zendesk office and part remote)
- Benefits
- none stated
Job Description
Job Summary
At Zendesk, our focus is helping our customers build great relationships with their customers. Founded by three Danish entrepreneurs, Zendesk has experienced remarkable success and growth while maintaining a fun, positive, and down-to-earth culture.
We are looking for a Staff Engineer to join our AI Copilot organisation. AI Copilot is a multi-million ARR product that puts AI directly into the hands of customer service agents and administrators. You will be a technical leader driving the architecture and delivery of our conversational AI backend — the system that enables admins to configure and optimize Zendesk through natural language.
We ship to learn: our philosophy is to deliver early, deliver often, and iterate based on real-world customer feedback.
What you'll be doing
- Drive the technical vision and architecture for the Admin Copilot Conversational backend — LLM orchestration, intent detection, context retrieval, and tool execution.
- Own end-to-end delivery of complex, cross-cutting features — from technical design through implementation, release, and production operation.
- Be a hands-on technical leader: set engineering standards, make key architecture decisions, and ensure the team builds reliable, scalable systems.
- Collaborate closely with ML Scientists, Product Management, Design, and partner engineering teams to shape the product roadmap from a technical perspective.
- Influence technical direction beyond your team — contribute to architecture decisions across the Copilot organisation and adjacent teams.
- Design and improve evaluation frameworks, guardrails, and safety mechanisms for LLM-powered features in production.
- Mentor and grow engineers on the team through technical guidance, code review, and pairing. Raise the bar for engineering quality.
- Identify and address systemic technical risks, performance bottlenecks, and reliability gaps before they become customer-facing problems.
What you bring to the role
Required
- 8+ years of experience in software engineering, with demonstrated technical leadership in backend systems.
- Strong experience designing and building distributed systems at scale — APIs, service architectures, and data pipelines.
- Experience with LLM integration in production systems — orchestration, prompt engineering, evaluation, guardrails, or multi-provider setups.
- Fluent in at least one backend language (Ruby, Python, Go, or similar); working proficiency across multiple languages.
- Deep understanding of cloud infrastructure (AWS), containerised deployments (Docker, Kubernetes), and CI/CD practices.
- A track record of driving technical direction for a team or project — architecture decisions, technical roadmaps, and cross-team alignment.
- Ability to operate effectively with ambiguity — you can break down complex problems, make pragmatic tradeoffs, and move fast without sacrificing quality.
- Strong collaboration and communication skills — you influence through technical credibility and clear articulation of tradeoffs, not authority.
Preferred
- Experience building conversational AI or chat-based systems (intent detection, context management, tool use).
- Experience with ML infrastructure: model serving, inference pipelines, or evaluation frameworks.
- Familiarity with ML pipeline tooling (e.g., Metaflow) and experiment tracking (e.g., MLflow).
- Experience with event-driven architectures (e.g., Kafka).
- Experience with SQL and data infrastructure (Snowflake, dbt).
- Experience mentoring or technically leading a team of 3+ engineers.
Tech Stack
- Our code is written in Ruby and Python
- Our servers live in AWS
- Our ML pipelines use Metaflow
- Our data is stored in S3, RDS MySQL, and Snowflake (with dbt for transformations)
- Our services and models are deployed to Kubernetes using Docker
- Heavy usage of LLM technology from multiple providers via our LLM Proxy
- Our conversational backend uses the Vercel AI SDK for LLM orchestration
The intelligent heart of customer experience
Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.
Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.
As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.
Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer. If you are based in the United States and would like more information about your EEO rights under the law, please click here.
Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law. If you are an individual with a disability and require a reasonable accommodation to submit this application, complete any pre-employment testing, or otherwise participate in the employee selection process, please send an e-mail to [email protected] with your specific accommodation request.
How to apply
Contacts read from the ad: check them against the original before sending.
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- Senior Software Engineer - AI Copilot (Backend)Zendesk
- Staff Software EngineerZencoder
- Staff Software EngineerStartup Talents
- Staff Software Engineer, AI EngineeringTebra
- Staff Security EngineerZencoder
- Staff Backend Engineer - Platform (f/m/d)Apaleo
Salary compared ⓘ
347 jobs · Systems analysts · Portugal
see the best paid →Training for this job
- Developing Generative AI Applications on AWSRumosonline · daytime · 14 h · 1420 € · starts 01/02/2027Asked for in this ad: AI / machine learning
- Generative AI Essentials on AWSGalileuonline · daytime · 7 h · 700 € + IVA · starts 02/12/2026Asked for in this ad: AI / machine learning
- Inteligência Artificial & Data ScienceCESAE Digitalonline · evenings · 75 h · freeAsked for in this ad: AI / machine learning
Languages AI
Published on (1)
- Zendesk seen 10 Nov – 21 Nov
Where the company is see on the map →
- Lisboa (Lisboa) ≈ 17 jobs · 1 on the company's website (office) · OSM · Google Maps
according to the company's other jobs, the addresses on the company's website; not necessarily where this job is. ≈ approximate point (only the locality or the postcode is known).
First seen on 10 Nov, 00:10