About the Role
Outlier helps the world’s most innovative companies improve their AI models by providing feedback from experienced technical experts. We collaborate with leading AI organizations to train large language models to reason through complex, real-world systems, security, machine learning, and hardware problems.
In this role, you’ll use your expertise to design rigorous challenges, evaluate model outputs, and identify the gaps that separate plausible answers from reliable engineering judgment.
900K+
Outlier Experts
$600M+
Paid Out
52
Countries
Responsibilites
Task authoring: Design challenging, real-world technical problems across your domain (Systems, ML, Coding, Security, or Hardware) to push the limits of AI reasoning and train models on expert-level problem-solving.
Expert peer review: Critique AI-generated solutions for technical rigor and correctness, ensuring every output meets the highest standards of engineering soundness.
Strategic optimization: Rank and refine model outputs, identifying subtle flaws in logic, implementation, or approach to turn raw attempts into sophisticated technical insight.
Dynamic innovation: Adapt your expertise across a variety of high-impact projects as the technology and benchmarks evolve.
Ideal Qualification
Technical background: A degree in Computer Science, Engineering, or a related field (or equivalent professional experience) with deep expertise in at least one core domain — Systems, Machine Learning, Coding, Security, or Hardware.
Hands-on experience: Real-world experience building, shipping, or researching in your field; we prioritize practitioners who understand how technical work holds up in practice, not just in theory.
Domain mastery: Demonstrated depth in your specialty, with the ability to design and evaluate problems that challenge even strong AI systems.
English proficiency: Fluent in reading and writing, with an editorial eye for detail and zero tolerance for technical ambiguity.
Analytical rigor: The ability to dissect complex technical content for logical flow, correctness, and sound reasoning.
Currently accepting applicants from:
🌍
Global
Compensation
Work flexibly from anywhere, anytime - no minimum hours
Application Process
Frequently Asked Questions (FAQs)
What is Outlier? How is it related to Scale AI?
What's the expected time commitment for participants?
When and how will I be paid?
How can I get support?
Who do I contact with questions as I onboard?
What do I need to sign up for this opportunity?
Will I be an Outlier employee?
Who else will be a part of the program?
Have more questions?
** Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
