colours
radaremprego

SWE-Bench AI Task Auditor - Freelance AI Trainer Project

Invisible Technologies · advertises as Himalayas
Hoursnot stated in the ad
Contractfreelance
not stated in the adwork mode · salary
posted 2026-11-06

In short AI

Technical auditing of software engineering tasks used to train and evaluate AI systems (SWE-Bench). Remote work, freelance contract, 70 to 100 USD per hour.

Description

Role
Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. Provide clear, actionable feedback on codebase integration issues, test failures, or logic errors.
Requirements
  • Demonstrable professional experience and deep technical knowledge in software engineering, including complex codebase navigation and real-world application development
  • Knowledge of SWE-Bench standards
  • Strong analytical and problem-solving skills to test, troubleshoot, and evaluate complex technical scenarios
Conditions
Contract: freelance (independent), no company benefits such as health insurance or PTO
Salary: 70 to 100 USD per hour, final rate depends on experience and geographic location
Hours: not stated
Location: remote
Benefits
none stated

Project OverviewWe are sourcing experienced technical specialists in Software Engineering (SWE-Bench) to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.

Project Deliverables & Scope

  • Task Evaluation:Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.

  • Technical Auditing & Feedback:Provide clear, actionable feedback on any identified codebase integration issues, test failures, or logic errors within the tasks.

Required Expertise

  • Demonstrable professional experience and deep technical knowledge in software engineering (including complex codebase navigation, real-world application development, and SWE-Bench standards).(Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).

  • Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.

We offer a pay range of $70 - $100per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a securecomputer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Employment type:Freelance Contract

Workplace type:Remote

Originally posted on Himalayas

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

This jobMedian?2 234 €
1 688 €2 555 €

32 jobs · Software testers and ICT quality specialists · Portugal

see the best paid →

Training for this job

Published on (1)

First seen on 16 Nov, 22:37