Research Engineering Manager, STEM (Remote - Worldwide)
The posting lists Brazil and Colombia among hiring locations and is open to remote candidates in other regions as well. This is a management role at an AI company that builds training datasets, reinforcement learning environments, and evaluation benchmarks for frontier AI labs, and also deploys AI systems for large enterprises. The position leads a team of research engineers working on synthetic data for coding and STEM reasoning and on new benchmarks that measure capabilities current evaluations miss. The role works closely with research scientists and partner labs, and includes hiring and building the team.
What you'll do
- Hire, grow, and manage a team of research engineers, and run regular feedback and performance cycles.
- Set the team's operating rhythm: project selection, planning, experiment reviews, and design documents.
- Own synthetic data pipelines that generate, verify, filter, deduplicate, and version training data, and measure how data properties affect model results.
- Design and ship benchmarks and evaluation harnesses with sound difficulty calibration, contamination controls, and confidence intervals.
- Partner with research scientists to plan experiments, baselines, and ablations, and bring your own research hypotheses.
- Spend roughly a third of your time on hands-on work such as verifier logic, eval statistics, and debugging methodology questions.
What you need
- 8+ years of hands-on ML or research engineering experience, including at least 5 in industry and at least 3 years managing researchers or engineers.
- Demonstrated experience running synthetic or curated data pipelines whose output drove training decisions, with measured quality and downstream impact.
- Experience designing LLM evaluations or benchmarks used for model decisions, with understanding of judge bias, saturation, variance, and inter-annotator agreement.
- Strong Python and production experience with PyTorch or JAX; working knowledge of SFT, DPO, PPO/GRPO, and reinforcement learning with verifiable rewards.
- Daily use of LLM coding tools as part of how you build software, with the judgment to review their output critically (required).
- Clear written and spoken English for communicating with researchers and non-specialists. A PhD or Master's in a related field is preferred but equivalent research experience is also considered.
Open to applicants anywhere in the world.
How to apply
Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.
Apply on i'llTipPrefer the website? Continue on illtip.comOr get the app: Android · iPhone
🔔 Get new jobs like this first: join Tech & AI Jobs on Telegram · or get personal job alerts
More AI & Machine Learning jobs
AI Researcher / Engineer (Remote - Worldwide)
The posting does not list country restrictions, so confirm eligibility with the employer when applying. This is a full-time research and engineering role on a small, high-impact team building detection and forensic tools…
Technical Co-Founder, AI Agents (Remote - North America)
An early-stage AI venture is looking for a technical co-founder to build a personal AI agent that pairs automated task execution with human support. You would help define the product and engineering foundations from the …
AI Automation Practice Lead
This remote role is for an experienced practitioner who can teach AI automation to both learners and corporate teams. It suits someone who enjoys turning complex tools and workflows into clear, practical training. The or…
Forward Deployed Engineer - AI Process Orchestration (Remote - Worldwide)
Candidates may apply from anywhere; the team is fully distributed across time zones. A fast-growing enterprise software company that provides a platform for coordinating AI agents, people and systems across complex busin…
Senior AI Rater and Reviewer (Remote - Worldwide)
Pay: $50/hr - $120/hr (hourly rate). This is a remote, project-based opportunity with an expert network that trains and evaluates AI systems. Senior raters grade complex model outputs against detailed rubrics and also he…
Related job searches
Senior jobsWork From Home jobs in NigeriaWork From Home jobs