colours
radaremprego

QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)

Hoursnot stated in the ad
not stated in the adwork mode · contract · salary

In short AI

QA / Test Automation Engineer role in Porto, hybrid (3 days a week in the office), within the engineering team of a major Belgian telecom operator. Greenfield position with full ownership of test automation, including testing of AI voice and chat agents.

Description

Role
Design, build and maintain the automated test suite across all levels (unit, API, integration, end-to-end, UI and contract tests), assess existing tests to keep, refactor or replace them, build supporting infrastructure (test data, mocks, service virtualisation), define strategy and release criteria with the Tech Leads and integrate tests into CI/CD with quality gates. First major deliverable: define how to test the AI voice agent (already live) and the upcoming AI chat agent, using multi-turn scripted conversations, criteria-based evaluation and statistical thresholds.
Requirements
  • Strong TypeScript/JavaScript programming, production-grade code
  • Ability to read and navigate application code (Node.js, React/Vue)
  • Proven experience building an automated test suite from a low or fragmented baseline
  • Modern test automation frameworks (Playwright, Cypress, Vitest/Jest or equivalents)
  • API and integration testing, including test data and mocking strategies
  • Experience with CI/CD pipelines (Azure DevOps, GitHub Actions)
  • Current hands-on use of AI coding assistants (Claude, Copilot, Cursor)
  • Practical experience designing and evaluating LLM-based systems: evaluation sets, prompt regression testing
  • Reasoning about non-deterministic results
  • SQL and databases for verification and test data setup
  • Git and standard engineering workflows
  • English B2 or above
Preferred
  • experience with contract testing (Pact) or performance testing (k6)
  • experience testing voice or conversational AI agents
  • experience in telecom or other large-scale regulated platforms
Conditions
Contract: not stated
Salary: not stated
Hours: hybrid, 3 days a week in the office; remaining schedule not stated
Location: Porto
Benefits
none stated

QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)

ABOUT THE OPPORTUNITY

Join the engineering team of a major Belgian telecom operator to take full ownership of test automation, including one of the most technically interesting challenges in QA today: testing AI Voice and Chat Agents that don't behave deterministically. This is a greenfield role with real influence — you'll propose the tooling, agree it with the Tech Leads, and then own it end to end.

PROJECT & CONTEXT

You will design, build, and maintain the automated test suite across all levels — unit and component guidance for developers, API and integration tests, end-to-end and UI tests, and contract tests for integrations — while assessing existing tests to keep, refactor, or replace them under a common approach. You'll build supporting infrastructure such as test data management, mocks, and service virtualisation, act as the testing expert alongside each product's Tech Lead to define strategy and release criteria, and integrate tests into CI/CD with quality gates that block unsafe releases. A first major deliverable is establishing how to test the AI Voice Agent (already live) and the upcoming AI Chat Agent — building an end-to-end approach that survives non-determinism, with scripted multi-turn conversations, criteria-based quality judgment, and statistical thresholds instead of exact matching.

WHAT WE'RE LOOKING FOR (Required)

  • Strong programming ability in TypeScript/JavaScript, writing production-grade code
  • Comfortable reading and navigating application code (Node.js, React/Vue)
  • Proven experience building an automated test suite from a low or fragmented baseline, and consolidating inconsistent existing tests
  • Modern test automation frameworks (e.g. Playwright, Cypress, Vitest/Jest, or equivalents)
  • API and integration testing, including test data and mocking strategies
  • Experience with CI/CD pipelines and integrating automated tests into them (e.g. Azure DevOps, GitHub Actions)
  • Hands-on, current use of AI coding assistants (e.g. Claude, Copilot, Cursor) in real delivery work
  • Practical experience designing and evaluating LLM-based systems: building evaluation sets, prompt regression testing, and working knowledge of how prompts, context windows, retrieval, and tool calling affect output
  • Comfortable reasoning about non-deterministic results rather than expecting a binary pass/fail
  • Solid SQL and database knowledge for verification and test data setup
  • Git and standard engineering workflows
  • B2 English (Upper Intermediate) or above

NICE TO HAVE (Preferred)

  • Experience with contract testing (e.g. Pact) or performance testing tools (e.g. k6)
  • Prior experience testing voice-based or conversational AI agents specifically
  • Background working in telecom or other large-scale, regulated platform environments

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

This jobMedian?2 234 €
1 688 €2 582 €

32 jobs · Software testers and ICT quality specialists · Portugal

see the best paid →

Training for this job

Languages AI

Published on (1)

Where the company is see on the map →

  • Porto (Porto) 59 jobs
  • Lisboa (Lisboa) 58 jobs
  • Braga (Braga) 5 jobs
  • Coimbra (Coimbra) 5 jobs
  • Mafra (Lisboa) 5 jobs
  • Aveiro (Aveiro) 3 jobs
  • Vila do Conde (Porto) 3 jobs
  • Amadora (Lisboa) 1 job
  • Covilhã (Castelo Branco) 1 job
  • Matosinhos (Porto) 1 job

according to the company's other jobs; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices.

First seen on 31 Oct, 21:39