QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)
Where
Sign in to see the travel time
In short AI
QA / Test Automation Engineer role in Porto, hybrid (3 days a week in the office), within the engineering team of a major Belgian telecom operator. Greenfield position with full ownership of test automation, including testing of AI voice and chat agents.
Description
- Role
- Design, build and maintain the automated test suite across all levels (unit, API, integration, end-to-end, UI and contract tests), assess existing tests to keep, refactor or replace them, build supporting infrastructure (test data, mocks, service virtualisation), define strategy and release criteria with the Tech Leads and integrate tests into CI/CD with quality gates. First major deliverable: define how to test the AI voice agent (already live) and the upcoming AI chat agent, using multi-turn scripted conversations, criteria-based evaluation and statistical thresholds.
- Requirements
- Strong TypeScript/JavaScript programming, production-grade code
- Ability to read and navigate application code (Node.js, React/Vue)
- Proven experience building an automated test suite from a low or fragmented baseline
- Modern test automation frameworks (Playwright, Cypress, Vitest/Jest or equivalents)
- API and integration testing, including test data and mocking strategies
- Experience with CI/CD pipelines (Azure DevOps, GitHub Actions)
- Current hands-on use of AI coding assistants (Claude, Copilot, Cursor)
- Practical experience designing and evaluating LLM-based systems: evaluation sets, prompt regression testing
- Reasoning about non-deterministic results
- SQL and databases for verification and test data setup
- Git and standard engineering workflows
- English B2 or above
- Preferred
- experience with contract testing (Pact) or performance testing (k6)
- experience testing voice or conversational AI agents
- experience in telecom or other large-scale regulated platforms
- Conditions
- Contract: not stated
- Salary: not stated
- Hours: hybrid, 3 days a week in the office; remaining schedule not stated
- Location: Porto
- Benefits
- none stated
QA / Test Automation Engineer (TypeScript/Playwright/Cypress) - Hybrid Porto (3 days/week office)
ABOUT THE OPPORTUNITY
Join the engineering team of a major Belgian telecom operator to take full ownership of test automation, including one of the most technically interesting challenges in QA today: testing AI Voice and Chat Agents that don't behave deterministically. This is a greenfield role with real influence — you'll propose the tooling, agree it with the Tech Leads, and then own it end to end.
PROJECT & CONTEXT
You will design, build, and maintain the automated test suite across all levels — unit and component guidance for developers, API and integration tests, end-to-end and UI tests, and contract tests for integrations — while assessing existing tests to keep, refactor, or replace them under a common approach. You'll build supporting infrastructure such as test data management, mocks, and service virtualisation, act as the testing expert alongside each product's Tech Lead to define strategy and release criteria, and integrate tests into CI/CD with quality gates that block unsafe releases. A first major deliverable is establishing how to test the AI Voice Agent (already live) and the upcoming AI Chat Agent — building an end-to-end approach that survives non-determinism, with scripted multi-turn conversations, criteria-based quality judgment, and statistical thresholds instead of exact matching.
WHAT WE'RE LOOKING FOR (Required)
- Strong programming ability in TypeScript/JavaScript, writing production-grade code
- Comfortable reading and navigating application code (Node.js, React/Vue)
- Proven experience building an automated test suite from a low or fragmented baseline, and consolidating inconsistent existing tests
- Modern test automation frameworks (e.g. Playwright, Cypress, Vitest/Jest, or equivalents)
- API and integration testing, including test data and mocking strategies
- Experience with CI/CD pipelines and integrating automated tests into them (e.g. Azure DevOps, GitHub Actions)
- Hands-on, current use of AI coding assistants (e.g. Claude, Copilot, Cursor) in real delivery work
- Practical experience designing and evaluating LLM-based systems: building evaluation sets, prompt regression testing, and working knowledge of how prompts, context windows, retrieval, and tool calling affect output
- Comfortable reasoning about non-deterministic results rather than expecting a binary pass/fail
- Solid SQL and database knowledge for verification and test data setup
- Git and standard engineering workflows
- B2 English (Upper Intermediate) or above
NICE TO HAVE (Preferred)
- Experience with contract testing (e.g. Pact) or performance testing tools (e.g. k6)
- Prior experience testing voice-based or conversational AI agents specifically
- Background working in telecom or other large-scale, regulated platform environments
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- QA Engineer (PyTest/Jest/Robot Framework) - Hybrid Portugal (3 days/week office)HumanIT Digital Consulting · Porto
- Senior Automation QA EngineeriTRTech Group · Porto
- QA Automation EngineerOlisipo
- QA AUTOMATION ENGINEERiTRTech Group · Lisboa
- QA Automation Engineer (m/f)Grupo EGOR · Lisboa
- QA Automation EngineerBridge 351 · Lisboa,Oeiras
Salary compared ⓘ
32 jobs · Software testers and ICT quality specialists · Portugal
see the best paid →Training for this job
- AI+ Quality Assurance Practitioner™Galileuself-paced · flexible hours · 40 h · 695 € + IVAAsked for in this ad: Testing / QA
- ISTQB® Testing with Generative AIRumosonline · daytime · 14 h · 1320 € + IVA · starts 09/12/2026Asked for in this ad: Testing / QA
- Back-End Web Developer JSCESAE Digitalonline · evenings · 75 h · freeAsked for in this ad: JavaScript / TypeScript
Languages AI
Published on (1)
- HumanIT Digital Consulting seen 31 Oct – 21 Nov
Where the company is see on the map →
- Porto (Porto) 59 jobs
- Lisboa (Lisboa) 58 jobs
- Braga (Braga) 5 jobs
- Coimbra (Coimbra) 5 jobs
- Mafra (Lisboa) 5 jobs
- Aveiro (Aveiro) 3 jobs
- Vila do Conde (Porto) 3 jobs
- Amadora (Lisboa) 1 job
- Covilhã (Castelo Branco) 1 job
- Matosinhos (Porto) 1 job
according to the company's other jobs; consultancy: the work is often at a client's premises; these are the addresses of the consultancy's offices.
First seen on 31 Oct, 21:39