colours
app
radaremprego

Intelligence Analyst

micro1 · advertises as Himalayas
Hoursnot stated in the ad
Contractfreelance
not stated in the adwork mode · salary
posted 2026-10-28 ·

In short AI

Remote contractor role as an intelligence analyst to evaluate and improve AI systems: building analytic cases, writing test cases and grading AI-generated responses. No prior AI experience is required; all-source intelligence analysis experience is valued.

Description

Role
Develop and map analytic cases to defined taxonomies, write complex test cases on source handling, analytic rigor and expression of uncertainty, assess AI-generated responses, flag over-refusals by the model, document edge cases and work with project leads to calibrate analytic standards.
Requirements
  • All-source analytic experience or deep expertise in a specific analytic discipline
  • Strong proficiency in source evaluation, confidence-level assessment and established analytic standards
  • Experience teaching, mentoring or leading analytic reviews
  • Exceptional written and verbal communication, with clarity and precision
  • Ability to identify and articulate model limitations and over-refusal scenarios
Preferred
  • structured analytic techniques, intelligence tradecraft standards, prior participation in AI evaluation initiatives
Conditions
Contract: independent contractor
Salary: not stated
Hours: not stated
Location: remote
Benefits
none stated

Role Title: Intelligence Analyst

Role Type: Contractor

Location: Remote

micro1 is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  1. Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
  2. Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
  3. Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
  4. Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
  5. Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
  6. Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
  7. Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.

Preferred Qualifications

  1. Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
  2. Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
  3. Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
  4. Exceptional written and verbal communication skills, with a focus on clarity and precision.
  5. Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
  6. Familiarity with structured analytic techniques and intelligence tradecraft standards.
  7. Previous participation in AI evaluation or model assessment initiatives is a plus.

Originally posted on Himalayas

How to apply

Apply on the original ad ↗

Prepare your application

A cover letter and a short pitch for this job, written from your profile, and what to learn next.

Sign in and create your profile from your CV. It is private: we share it with no one.

Something wrong or unlawful in this ad? Report it

It stays visible while we review it. We decide within 7 days (anything clearly unlawful, such as a scam, sooner) and tell you the outcome and why.

Similar jobs

Salary compared ⓘ

This jobMedian?4 179 €
2 763 €6 116 €

83 jobs · Systems analysts · remote

see the best paid →

Training for this job

Languages AI

Published on (1)

First seen on 16 Nov, 23:19