AI Trainer - Data Annotation Specialist

A short-term, fully remote role supporting the development of AI systems by evaluating AI-generated responses against defined safety policies. It suits a detail-oriented, non-coding professional who writes clearly and concisely, reads closely, and applies sound judgement to sensitive material. The organisation works on AI training and evaluation projects for its clients. The project is hourly-paid, with an estimated start in late October and a duration of one to two weeks, with possible extension. Candidates with editorial, quality assurance, or trust and safety backgrounds are well suited.

What you'll do

• Evaluate AI-generated responses against defined safety policies and sub-policies
• Review single-turn and multi-turn conversations for safety, accuracy and policy compliance
• Assign consistent 1–5 ratings using established evaluation criteria
• Write clear, concise, evidence-based justifications for each rating
• Identify subtle safety concerns involving self-harm, violence, abuse and other sensitive topics

What you need

• Excellent English proficiency with strong reading comprehension and close-reading skills
• Ability to write clear, concise and objective evaluations
• Excellent attention to detail and strong judgement
• Ability to follow detailed safety policies and work accurately under time constraints
• Comfort reviewing sensitive content involving self-harm, violence and abuse
• Familiarity with US-specific references, systems and terminology

Open to applicants anywhere in the world.

How to apply

Sign up free on i'llTip to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.