Lead Research Engineer, Data Quality (Visa Sponsorship - United States)
An early-stage AI company building infrastructure for training and evaluating AI systems is hiring a leader for its data quality team. This person will shape how training data is measured and improved, and help build reliable systems for evaluating agent tasks and producing high-value post-training data. The role is on-site in the United States in a small, fast-moving startup environment.
What you'll do
- Lead systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
- Define data quality standards and build quality-control systems, including experiments that assess agent outputs.
- Develop scalable methods to validate synthetic data, such as failure-mode analysis, task mutation checks, and trajectory audits.
- Work with research engineers, subject-matter experts, and data vendors to find quality issues and improve data generation workflows.
- Turn research findings into production tools, dashboards, validation pipelines, and feedback loops.
- Mentor research engineers and encourage rigorous, clear, and efficient technical work.
What you need
- At least 5 years of research or engineering experience, including building AI or machine learning data evaluation systems.
- Prior experience leading technical projects or teams from problem definition through implementation and iteration.
- Advanced proficiency in Python, Docker, and Linux, with a technical academic or professional background.
- Strong understanding of AI evaluation and post-training, and of what makes agent training data realistic, learnable, diverse, reliable, and useful.
- Experience with synthetic data validation, evaluation infrastructure, benchmarks, metrics, and quality-control workflows.
- Clear written communication, strong attention to detail, and the ability to work independently.
How to apply
Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.
Apply on i'llTipPrefer the website? Continue on illtip.comOr get the app: Android · iPhone
🔔 Get new jobs like this first: join Tech & AI Jobs on Telegram · or get personal job alerts
More Visa sponsored jobs jobs
Senior Android Software Engineer (Visa Sponsorship - San Francisco, USA)
Candidates based in Seattle may also be considered. Visa sponsorship available. A product-focused startup building a consumer mobile app in the financial technology space is hiring a senior Android engineer to help grow …
Creator Growth & Community Manager (Visa Sponsorship - San Francisco Bay Area, USA)
Visa sponsorship available (H-1B). A large consumer technology and social media platform with a global user base is building out its creator ecosystem and has created a new role focused on the US market. The role owns cr…
Technical Writer (Visa Sponsorship - San Francisco, USA)
Visa sponsorship available. A developer tools company building products for AI model training and evaluation is hiring a Technical Writer to turn product progress, customer work, and research into clear, technically accu…
Founding Engineer, Environments and Data (Visa Sponsorship - San Francisco, United States)
Visa sponsorship available. Applicants from any country may apply, but the role requires working on-site in San Francisco. This is a founding engineering role at an AI-focused startup building evaluation environments and…
Backend Engineer (Visa Sponsorship - Berlin, Germany)
Visa sponsorship available. An early-stage energy technology company is looking for a backend engineer to join its core infrastructure team. The team builds systems that power dynamic electricity plans and reliable billi…