SWE-Bench AI Task Auditor - Freelance AI Trainer Project
In short AI
Technical auditing of software engineering tasks used to train and evaluate AI systems (SWE-Bench). Remote work, freelance contract, 70 to 100 USD per hour.
Description
- Role
- Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. Provide clear, actionable feedback on codebase integration issues, test failures, or logic errors.
- Requirements
- Demonstrable professional experience and deep technical knowledge in software engineering, including complex codebase navigation and real-world application development
- Knowledge of SWE-Bench standards
- Strong analytical and problem-solving skills to test, troubleshoot, and evaluate complex technical scenarios
- Conditions
- Contract: freelance (independent), no company benefits such as health insurance or PTO
- Salary: 70 to 100 USD per hour, final rate depends on experience and geographic location
- Hours: not stated
- Location: remote
- Benefits
- none stated
Project OverviewWe are sourcing experienced technical specialists in Software Engineering (SWE-Bench) to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.
Project Deliverables & Scope
Task Evaluation:Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
Technical Auditing & Feedback:Provide clear, actionable feedback on any identified codebase integration issues, test failures, or logic errors within the tasks.
Required Expertise
Demonstrable professional experience and deep technical knowledge in software engineering (including complex codebase navigation, real-world application development, and SWE-Bench standards).(Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).
Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.
We offer a pay range of $70 - $100per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a securecomputer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type:Freelance Contract
Workplace type:Remote
Originally posted on Himalayas
How to apply
Prepare your application
A cover letter and a short pitch for this job, written from your profile, and what to learn next.
Sign in and create your profile from your CV. It is private: we share it with no one.
Something wrong or unlawful in this ad? Report it
Similar jobs
- CVE & Application Security AI Task Auditor - Freelance AI Trainer ProjectInvisible Technologies
- Machine Learning (ML) AI Task Auditor - Freelance AI Trainer ProjectInvisible Technologies
- Kubernetes AI Task Auditor - Freelance AI Trainer ProjectInvisible Technologies
- AWS Serverless & IaC AI Task Auditor - Freelance AI Trainer ProjectInvisible Technologies
- AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer PInvisible Technologies
- AI Trainer (SWE) | Remote - ContractXperteez Technology
Salary compared ⓘ
32 jobs · Software testers and ICT quality specialists · Portugal
see the best paid →Training for this job
- ISTQB® Testing with Generative AIGalileuonline · daytime · 14 h · 1320 € + IVA · starts 09/12/2026Asked for in this ad: AI / machine learning
- Inteligência Artificial para Testes de SoftwareRumosonline · evenings · 21 h · 780 € · starts 11/01/2027Asked for in this ad: AI / machine learning
- Utilizar Ferramentas da Ia na OrganizaçãoServiço de Formação Profissional de Santarémonline · daytime · 25 h · free · starts 02/12/2026Asked for in this ad: AI / machine learning
Published on (1)
- Himalayas seen 16 Nov
First seen on 16 Nov, 22:37