Software Engineer (Remote - Worldwide)

Software Engineer (Remote - Worldwide) (full-time) · Remote - Worldwide. The full job description, the employer and how to apply are in the i'llTip app.

What you'll do

• Own features end to end, including data models, APIs, background workers and, where needed, UI changes.
• Build and improve how coding agents and language models are evaluated in sandboxed environments, including scoring and aggregating results across large numbers of runs.
• Improve automated task quality checks such as verifiers, rubric-based grading and LLM-as-a-judge scoring.
• Integrate new models, agents and benchmarks through general designs rather than one-off special cases.
• Keep the system fast and reliable under growing load, with efficient queries, safe migrations and sound concurrency.
• Review teammates' pull requests against written engineering guidelines.

What you need

• 5+ years building and operating production backend systems, including ownership of at least one service from design through on-call.
• Bachelor's degree or higher in software engineering, computer science or a related field.
• Strong Python, plus experience with Django or a similar framework, PostgreSQL and a task queue such as Celery.
• Hands-on experience with LLM evaluation beyond calling a model API, such as building benchmark tasks, scoring agent trials or comparing results. Experience with SWE-bench or similar evaluation harnesses is a plus.
• Good judgment about task quality, including spotting ambiguous instructions, weak verifiers and leaked answers.
• Comfort with TypeScript and React for visible changes, and clear written communication in pull requests and design notes.

Open to applicants anywhere in the world.

How to apply

Get the free i'llTip app to see the employer's details and apply. i'llTip's AI can tailor your résumé to this job, and you'll get alerts for similar roles.

Prefer the website? Continue on illtip.comOr get the app: Android · iPhone

🔔 Get new jobs like this first: join Tech & AI Jobs on Telegram · or get personal job alerts