AI Agent Tester
In short AI
Test two AI agents on everyday errands (bills, bookings, shopping, travel) from your own phone, with screen recording and scoring of each run. Remote in Europe, contractor role, about 1.5 hours per task, $25 to $45 an hour.
Description
- Role
- Run real-life scenarios with two AI agents side by side (paying bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, forms), approve or stop the agent at key steps, screen record each attempt, and score each run on completion, quality, control issues, satisfaction and time, with written feedback.
- Requirements
- Bachelor's degree or local equivalent
- Based in Europe
- Uses AI in daily life and has an active personal account (Free, Go, Plus or Pro)
- Smartphone that can screen record
- 2 to 3 years of experience, preferably in engineering, business management or office/operations
- Ability to follow instructions and document each step carefully
- Clear written communication
- No coding or AI background needed
- Preferred
- domain knowledge in engineering, business management or operations
- Conditions
- Contract: contractor (independent), duration not stated
- Salary: $25 to $45 per hour
- Hours: not stated; about 1.5 hours per task, entirely from your phone
- Location: remote, Europe
- Benefits
- none stated
Role Title: AI Agent Tester
Role Type: Contractor
Location: Remote — Europe
Opportunity Snapshot
Pay: $25-45/hour
Time per task: ~1.5 hours per run (evidence and scoring included)
Onboarding: Once you are presented to the hiring manager, onboarding typically takes 24–48 hours before you can start tasking.
You’ll need: An active personal popular AI account (Free, Go, or Plus, Pro), an active personal and a smartphone that can screen record
Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results
About the role
AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you.
You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.
What you’ll do
- Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
- Approve or stop the agent at key steps
- Screen record every attempt
- Score each run on completion, quality, control issues, satisfaction, and time
- Share clear written feedback on the agent experience
Who we’re looking for
- Based in Europe, with a bachelor’s degree or local equivalent.
- Someone who already uses AI in daily life
- 2-3 years of experience, preferably in engineering, business management, or office/operations
- Detail-oriented, great at following instructions and documenting each step
- Clear written communication
- Generalists welcome, domain experts preferred
- No coding or AI background needed
Why you’ll like it
- Get paid to use the AI tools you already use
- Work entirely from your phone, on your schedule
- Have a direct say in how next-generation AI agents get built and improved
How the selection process works
- Apply
- Complete the screening questions
- Interview: 15-30 minutes max
- Profile review: if everything looks good, we present you to the client
- Onboarding: our Talent Ops team will contact you to get you started
Originally posted on Himalayas
How to apply
Apply via the original posting (Himalayas), then complete screening questions, a 15 to 30 minute interview, profile review and onboarding in 24 to 48 hours with the Talent Ops team. AI
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- AI Agent Tester – Remote (Worldwide)RemoteJobsOne
- AI Conversation Evaluatormicro1
- Software Engineer, AI Coding Tasks (Contract)Askable
- Voice Actor - Freelance AI Trainer ProjectInvisible Technologies
- Expert Talent Pool, Agents and Reinforcement LearningClera
- AI Trainer (Life Sciences)micro1
Salary compared ⓘ
32 jobs · Software testers and ICT quality specialists · Portugal
see the best paid →Training for this job
- ISTQB® Testing with Generative AIGalileuonline · daytime · 14 h · 1320 € + IVA · starts 09/12/2026Asked for in this ad: AI / machine learning
- Inteligência Artificial para Testes de SoftwareRumosonline · evenings · 21 h · 741 € · starts 11/01/2027Asked for in this ad: AI / machine learning
- Utilizar Ferramentas da Ia na OrganizaçãoServiço de Formação Profissional de Santarémonline · daytime · 25 h · free · starts 02/12/2026Asked for in this ad: AI / machine learning
Languages AI
Published on (1)
- Himalayas seen 16 Nov – 17 Nov
First seen on 16 Nov, 21:46