AI Agent Evaluation and RL Environment Specialist (Remote - Worldwide)
Pay: $35/hr - $70/hr (hourly rate). Open to applicants who can work remotely from any country. This is a paid talent pool for contractors supporting AI research projects on autonomous software agents and reinforcement learning. You will help design training environments and assess how agents carry out multi-step tasks in real software and business workflows. Projects are typically one week to several months, and pay depends on the project, field, and experience level. Pay is based on hours worked.
What you'll do
- Build reinforcement learning environments in Python and Docker that let agents take actions and receive feedback.
- Turn business workflows, such as ERP processes, CRM updates, and spreadsheet operations, into trainable task scenarios.
- Write task definitions, connect tools and REST APIs, and build checks that verify whether an agent's actions succeeded.
- Create and grade demonstrations of task completion, including screen recordings.
- Review execution traces, evaluate agent trajectories, and diagnose failures.
What you need
- Zero to five years of experience as a software engineer, QA automation engineer, ML or RL engineer, operations analyst, or power user of business software.
- Experience writing Python, or building automations or reports in Excel, Salesforce, or an ERP system.
- Experience testing, scripting, or automating multi-step software tasks, such as test cases, API calls, or UI steps.
- Understanding of business workflows and operations, or strong general software fundamentals.
- Useful extras: Docker, REST APIs, Gymnasium or OpenAI Gym-style environments, pytest, Playwright, or Selenium, and experience documenting workflows or recording screen-based tasks.
Open to applicants anywhere in the world.
How to apply
Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.
Apply on i'llTipPrefer the website? Continue on illtip.comOr get the app: Android · iPhone
🔔 Get new jobs like this first: join Tech & AI Jobs on Telegram · or get personal job alerts
More AI & Machine Learning jobs
Senior AI Rater and Reviewer (Remote - Worldwide)
Pay: $50/hr - $120/hr (hourly rate). This is a remote, project-based opportunity with an expert network that trains and evaluates AI systems. Senior raters grade complex model outputs against detailed rubrics and also he…
AI Response Evaluator, Talent Pool Associate (Remote - Worldwide)
Pay: $20/hr - $45/hr (hourly rate). This is a talent pool for project-based work that helps evaluate and improve AI models. You will review model outputs and give structured feedback so that AI systems are more accurate,…
AI Data Annotation Expert, 5+ Years (Remote - Worldwide)
Pay: $40/hr - $75/hr (hourly rate). Fully remote; no office or country restriction stated. This is an expert pool for an annotation network that supports advanced AI research projects. Contributors are matched to project…
AI Safety Red Team Expert (Remote - Worldwide)
Pay: $75/hr - $175/hr (hourly rate). Fully remote project work with no office requirement. This is an expert talent pool supporting AI safety testing projects for model developers. Members take on evaluation work coverin…
AI Evaluation Associate (Remote - Worldwide)
Pay: $30/hr - $60/hr (hourly rate). This is a remote role with a company that runs human-led evaluations of AI models. You will help measure what models can and cannot do by writing rigorous test questions, building scor…