AnnotationPrep

Every AI trainer assessment on AnnotationPrep

40 assessments across 6 tracks.

Core & Generalist RLHF

AssessmentPlatformAvailability
DataAnnotation Starter Assessment (Generalist)DataAnnotation.techRemote / Global
DataAnnotation Core Qualification AssessmentDataAnnotation.techRemote / Global
Outlier AI Generalist Onboarding & AssessmentOutlier AIRemote / Global
Alignerr Generalist Evaluation & Labeling TestAlignerr (Labelbox)Remote / Global
Mindrift AI Tutor & Writer Entry AssessmentMindrift (Toloka)Remote / Global
xAI AI Tutor Generalist & Writing AssessmentxAIRemote / Global
Invisible Technologies AI Data Trainer AssessmentInvisible TechnologiesRemote / Global
Scale AI / Remotasks Generalist RLHF EvaluationScale AIRemote / Global

Coding & SWE Evaluation

AssessmentPlatformAvailability
DataAnnotation Coding Qualification (Python, JS & Algorithms)DataAnnotation.techRemote / Global
Outlier AI Coding & SWE Tier QualificationOutlier AIRemote / Global
Mercor SWE & Coding RLHF AssessmentMercorRemote / Global
Alignerr Python & TypeScript Coding AssessmentAlignerr (Labelbox)Remote / Global
Turing LLM Training Developer EvaluationTuringRemote / Global
micro1 AI Coding & Technical Screening Testmicro1Remote / Global
Mercor SWE-Bench & Multi-File PR Review AssessmentMercorRemote / Global
Turing & Scale AI Repository Patch & Diff EvaluationTuring / Scale AIRemote / Global

Math, Logic & STEM

AssessmentPlatformAvailability
DataAnnotation Math & STEM Qualification AssessmentDataAnnotation.techRemote / Global
Outlier AI Math, Physics & Chain-of-Thought AssessmentOutlier AIRemote / Global
Alignerr Mathematics & Analytical Logic TestAlignerr (Labelbox)Remote / Global
Mercor STEM & Quantitative Reasoning EvaluationMercorRemote / Global

Rubric Design & Prompting

AssessmentPlatformAvailability
Mercor Rubric Academy & Generalist Evaluator TestMercorRemote / Global
Outlier AI Factuality, Groundedness & Citation Rubric TestOutlier AIRemote / Global
Adversarial Prompt Engineering & Golden Response EvaluationAI Training PlatformsRemote / Global
Multimodal Image & Vision-Language Rubric AssessmentAI Training PlatformsRemote / Global
Outlier Multimodal Vision & OCR Evaluation TestOutlier AIRemote / Global
DataAnnotation Audio, Video & Multimodal RLHF AssessmentDataAnnotation.techRemote / Global

Search Quality & Safety Rater

AssessmentPlatformAvailability
TELUS International Search Quality Rater Exam (Parts 1, 2 & 3)TELUS DigitalRemote / Global
Welocalize Search Quality Rater Qualification ExamWelocalizeRemote / Global
RWS TrainAI Search & Data Quality Rater AssessmentRWS MoraviaRemote / Global
Appen CrowdGen Search & AI Safety EvaluationAppenRemote / Global
TELUS Personalized Internet & Ads Assessor QualificationTELUS DigitalRemote / Global
Clickworker & UHRS Search Relevance QualificationClickworker / UHRSRemote / Global
AI Red-Teaming, Harmlessness & PII Safety QualificationAI Training PlatformsRemote / Global
AI Safety, Red-Teaming & Frontier Policy Calibration TestFrontier AI LabsRemote / Global
Mercor Adversarial Red-Teaming & Safety Eval AssessmentMercorRemote / Global
xAI AI Tutor Safety, Sycophancy & Over-Refusal AssessmentxAIRemote / Global
Outlier AI Safety, Harm Taxonomy & Refusal Tone QualificationOutlier AIRemote / Global

Bilingual & Writing

AssessmentPlatformAvailability
Bilingual RLHF & Localization Evaluation AssessmentAI Training PlatformsRemote / Global
Creative Writing, Tone & Stylistic Constraint AssessmentAI Training PlatformsRemote / Global
OneForma Linguistic & AI Data QA CertificationCentific (OneForma)Remote / Global

Missing an assessment?

Tell us the platform and assessment name and we will add it to the list.