colours
radaremprego

Senior LLM Ops Engineer

Innotech consultancy
Hoursnot stated in the ad
Contractpermanent
not stated in the adwork mode · salary
posted 2026-06-17 · advertised for 158 days
This ad is no longer available since 21 Nov: the source stopped publishing it.

Where

Lisboa (Lisboa)

improve the location

More jobs: Systems analysts in Lisboa (1 195)

Sign in to see the travel time

Median rent ⓘ
T1870 €T21 310 €

In short AI

Senior LLM Ops Engineer at InnoTech (a company of about 180 employees) to design and operate production data pipelines and ML/LLM evaluation systems. Requires CPLP nationality or an EU work permit. Location and contract not stated.

Description

a long ad (3 393 characters): the AI summarised it; the full text is in the next tab.

Role
Design and implement scalable pipelines to collect and process production ML and LLM traffic from multiple sources; define data storage strategies, retention policies and privacy controls; develop observability, debugging and monitoring capabilities; build and maintain evaluation frameworks, automated rating systems and alerts for model and prompt regressions; implement data protection measures, including PII redaction, content safety controls and end-to-end platform operations.
Requirements
  • Proven experience building and operating production-grade data or ML platforms (ingestion, storage, governance, monitoring and operational support)
  • Hands-on experience with ML/LLM evaluation frameworks, autorating systems, golden datasets and LLM-as-a-judge workflows
  • Practical experience with LLM observability, tracing solutions and troubleshooting production AI systems
  • Strong Python development skills, with production-ready solutions
  • CPLP nationality or an EU work permit
Preferred
  • experience with multi-tenant SaaS environments, data isolation strategies, Azure and AWS, vector databases, data versioning, GDPR practices, Claude Code, GitHub, SQL, TypeScript, LLM ecosystems (Anthropic, OpenAI, open-source models), automotive, Android, AAOS or resource-constrained environments, BSc or MSc in Computer Science/Engineering, Information Technology or related fields
Conditions
Contract: not stated
Salary: not stated
Hours: not stated
Location: not stated
Benefits
  • Health partnerships, including free mental health support
  • 25 vacation days, including your birthday, Carnival and a bridging day between Christmas and New Year
  • Half a vacation day on your children's birthday and a school supplies voucher
  • Petsitting partnerships and a pet bereavement day
  • Regular team buildings, four annual company parties, game nights and social events
  • InnoSports initiatives (football, marathons and more)
  • Events focused on sustainability and social responsibility

A Company you will be happy to grow with!

At InnoTech, it´s all about connecting people with business through technology.

We truly care about you, your happiness, and your well-being. We look for passionate people who are eager to learn, evolve, and grow with us - because growth is in our DNA.

This commitment has been consistently recognized: we are proud to be a Great Place to Work for five consecutive years, to be one of the Best IT Companies in Portugal, and to be recognized as a Best Workplace Wellbeing. We are also proud to hold ISO 27001 and ISO 9001 certifications, reinforcing our commitment to information security, quality, and continuous improvement.

For us, sustainability is not just a buzzword. Integrity, social responsibility, and people-first values guide everything we do.

Join our team of 180+ InnoTechers and bring your talent as a Senior LLM Ops Engineer.

Your Mission Will Be

  • Design and implement scalable pipelines to collect and process production ML and LLM traffic from multiple sources;
  • Define data storage strategies, retention policies, and privacy controls aligned with business and regulatory requirements;
  • Develop observability, debugging, and monitoring capabilities to support production issue investigation and operational excellence;
  • Build and maintain evaluation frameworks, automated rating systems, and alerting mechanisms to detect model and prompt performance regressions;
  • Implement data protection measures, including PII redaction, content safety controls, and end-to-end platform operations.

You Will Need

  • Proven experience building and operating production-grade data or ML platforms, including ingestion, storage, governance, monitoring, and operational support;
  • Hands-on experience creating and maintaining ML/LLM evaluation frameworks, autorating systems, golden datasets, and LLM-as-a-judge workflows;
  • Practical experience with LLM observability, tracing solutions, and troubleshooting production AI systems;
  • Strong Python development skills, with the ability to deliver production-ready solutions and leverage AI-assisted development practices;
  • CPLP nationality or an EU work permit is required to facilitate employment.

Would Be Awesome If You Have

  • Experience working with multi-tenant SaaS environments, data isolation strategies, and cloud platforms such as Azure and AWS;
  • Knowledge of vector databases, embedding-based analysis, data versioning solutions, and GDPR-related data management practices;
  • Experience with Claude Code, GitHub, SQL, TypeScript, and LLM ecosystems including Anthropic, OpenAI, and open-source models;
  • Exposure to automotive, Android, AAOS, or other resource-constrained technology environments;
  • BSc or MSc in Computer Science/Engineering, Information Technology, or related fields.

What we offer:

  • Health-focused partnerships, including free mental health support;
  • 25 days of vacation, including your birthday, Carnival, and a bridging day between Christmas and New Year;
  • Half a vacation day on your children's birthday and a school supplies voucher;
  • Petsitting partnerships and a pet bereavement day;
  • Regular team buildings, four annual company parties, game nights, and social events;
  • InnoSports initiatives (football, marathons, and more);
  • Events focused on sustainability and social responsibility actions.

Are you convinced? Come see it for yourself.

Join our Top-Notch Team!

#LI-CS1

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Advertising · training

Space for courses and training in Systems analysts. Training providers, universities and trainers: [email protected]. Do you provide training?

Languages AI

Published on (1)

Where the company is see on the map →

  • Lisboa (Lisboa) ≈ 76 jobs · 2 on the company's website (office)
  • Porto (Porto) 26 jobs
  • Braga (Braga) 2 jobs
  • Leiria (Leiria) 1 job
  • Loulé (Faro) 1 job
  • Setúbal (Setúbal) 1 job

according to the company's other jobs, the addresses on the company's website; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices. ≈ approximate point (only the locality or the postcode is known).

First seen on 13 Oct, 07:03