About the Opportunity
The best models succeed on only a fraction of Terminal-Bench, a measure of how well agents perform on real world tasks. Your work will directly help the frontier labs close that gap. We are currently seeking experts in coding, machine learning, security, systems and hardware.
You Will
Author tasks: Design difficult terminal-based tasks in your domain, then build the automated verifier that grades agent outcomes. Tasks typically take 6-7 hours to complete.
Iterate as the agents evolve: Refine tasks based on results, closing loopholes and tightening specs
Example Tasks
Ideal Qualifications
Technical background: A degree in Computer Science, Engineering, or a related field (or equivalent professional experience) with deep expertise in at least one core domain — coding, machine learning, security, systems and hardware.
Hands-on experience: 6+ years of real-world experience building, shipping, or researching in your field.
Analytical rigor: The ability to dissect complex technical content for logical flow, correctness, and sound reasoning.
Why Join Outlier
How to Apply
Frequently Asked Questions (FAQs)
What is Outlier? How is it related to Scale AI?
What's the expected time commitment for participants?
When and how will I be paid?
How can I get support?
Who do I contact with questions as I onboard?
What do I need to sign up for this opportunity?
Will I be an Outlier employee?
Who else will be a part of the program?
Have more questions?
** Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
Get in touch
Send us your question and we'll reply by email
