AI Evaluator, Shopping Assistant (Remote - US only)

Pay: $50/hr - $50/hr (hourly rate). Applicants must be based in the US. This is a contract AI evaluation project for a company that recruits and vets subject-matter experts to support AI research and product teams. The work centers on testing a new digital shopping assistant, checking how accurately it handles real e-commerce questions and where its reasoning or product suggestions fall short. Your findings will be used to improve the model's response quality. The engagement is ongoing and requires at least 20 hours per week.

What you'll do

• Read real user conversation logs between people and an AI shopping assistant on an internal review platform
• Spot logical errors, factual inaccuracies, and weak or unhelpful product recommendations
• Build structured rubrics that score response quality consistently
• Design verifier checks that can be reused to judge future responses
• Maintain a steady workload of 20+ hours per week on the evaluation platform

What you need

• Must be located in the United States
• Background in quality assurance, data evaluation or annotation, AI training, or software testing
• Strong analytical skills and an eye for subtle errors in written text
• Familiarity with e-commerce search and online shopping experiences
• Comfortable building evaluation frameworks from scratch; prompt engineering experience is a plus
• Able to commit to 20+ hours per week over a sustained period

Applicants must be based in: United States.

How to apply

Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.

Prefer the website? Continue on illtip.comOr get the app: Android · iPhone

🔔 Get new jobs like this first: join i'llTip Jobs on Telegram · or get personal job alerts