Clinical Evaluator, AI Products (Contract, Remote)

Pay: $125/hr - $125/hr (hourly rate). The posting does not specify a country of residence. Applicants need a current independent therapist or professional counselor license and must set up or already hold an LLC or S-Corp. A mental healthcare technology company that supports thousands of independent therapy practices is hiring two contracted Clinical Evaluators to help judge the quality and safety of its AI tools. You will work with clinical and product staff to shape the standards that AI output must meet before launch. The work is judgment-heavy, and you will regularly settle difficult edge cases with a group of peer evaluators. The minimum commitment is 10 hours per week.

What you'll do

• Review AI-generated output for patient-facing and provider-facing products for clinical accuracy, safety, and appropriateness.
• Apply evaluation rubrics and suggest improvements where a rubric does not cover a case, documenting your reasoning.
• Take part in calibration sessions and inter-rater reliability rounds to keep evaluation standards consistent.
• Translate your clinical feedback into specific rubric or output changes with the clinical product team.
• Help label datasets and review new product use cases before launch as the programs grow.

What you need

• Current, independent, unrestricted license as a therapist or professional counselor.
• At least 3 years of direct therapy experience.
• Strong grasp of risk assessment, safety planning, and clinical documentation standards, with the ability to spot outputs that could put a patient at risk.
• Comfortable critically reviewing AI output and giving structured, written feedback.
• Able to explain clinical reasoning clearly in writing and revise your view when peers or data make a stronger case.
• Must set up or already have an LLC or S-Corp, and must follow HIPAA and the employer's privacy rules, keeping all patient information inside the employer's systems.

How to apply

Sign up free on i'llTip to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.