Outsmart Artificial Intelligence with Your Human Brilliance
Outsmart Artificial Intelligence with Your Human Brilliance
Join the top 1% of scholars in shaping the future of AI
Join the top 1% of scholars in shaping the future of AI
Outlier is powered by Scale AI to accelerate AI development at leading enterprises
Earn up to $118 per research challenge
for qualified problem
and solution pairs
for qualified problem + solution pairs
for qualified problem
+ solution pairs
Remote work,
flexible hours
Remote work, flexible hours
Remote work,
flexible hours
Work from
anywhere, anytime
Work from anywhere, anytime
Define
AI's future
Define AI's future
Define
AI's Future
Leverage your expertise
and train frontier AI models
Leverage your expertise and train frontier AI models
About Outlier
Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI, we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs.
About the role
Our mission is to challenge AI with Humanity’s Last Exam, a rigorous new way to test AI’s intelligence and reasoning. To do so, we are recruiting a group of exceptional minds to craft PhD and Master's level problems that current AI models cannot solve correctly.
Read more about Scale AI and Humanity's Last Exam
Read more about Scale AI and Humanity's Last Exam
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
Mark Zuckerberg
Founder and CEO, Meta
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
Mark Zuckerberg
Founder and CEO, Meta
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
Mark Zuckerberg
Founder and CEO, Meta
What you will be doing
Create Challenging Prompts for AI
Write a valid question that AIs and average humans cannot answer.
Subject
Medicine
Question
Provide a challenging prompt that will stump the AI model or cause it to "break".
Provide Benchmark Solutions
Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses.
Question
Difficult
Answer/Solution
Provide a high-quality, thorough response that directly matches the intent of the original prompt.
Participate in Peer Review
Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.
Contributor A’s response
Edit
Approve
What we’re looking for
Pursuing or holding a PhD or Master’s Degree in your field of expertise or a related field.
Attendance or a degree from a Top 200 accredited University or Institution such as Harvard, MIT, Stanford, Oxford.
Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.
Strong analytical and problem-solving skills, with experience in crafting rigorous, high-quality questions and solutions.
Attention to detail to accurately assess AI capabilities and evaluate peer submissions.
Fluency/High proficiency in English.
What you will get from contributing
Earn up to $118/research challenge
Rates vary based on quality, accuracy and time spent
Earn up to $118/research challenge
Rates vary based on quality, accuracy and time spent
Earn up to $118/research challenge
Rates vary based on quality, accuracy and time spent
Co-author a research paper on how data enhances AI reasoning
Analyze how effectively this data impacts industry-leading models
Co-author a research paper on how data enhances AI reasoning
Analyze how effectively this data impacts industry-leading models
Co-author a research paper on how data enhances AI reasoning
Analyze how effectively this data impacts industry-leading models
Flexible schedule and time commitment
No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home
Flexible schedule and time commitment
No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home
Flexible schedule and time commitment
No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home
Free access to
Model Playground
Interact, experiment and engage with leading large language models free of cost
Free access to
Model Playground
Interact, experiment and engage with leading large language models free of cost
Free access to
Model Playground
Interact, experiment and engage with leading large language models free of cost
Choose your expertise
All
STEM
Humanities
Business & Finance
Arts & Humanities
APPLY NOW
Biology
APPLY NOW
Business Management
APPLY NOW
Chemistry
APPLY NOW
Computer science
APPLY NOW
Design
APPLY NOW
Economics
APPLY NOW
Education
APPLY NOW
Finance
APPLY NOW
Industrial Engineering
APPLY NOW
Law & Legal Studies
APPLY NOW
Math
APPLY NOW
Media Communications
APPLY NOW
Medicine
APPLY NOW
Philosophy
APPLY NOW
Physics
APPLY NOW
Psychology
APPLY NOW
Sociology
APPLY NOW
Systems Engineering
APPLY NOW
All
STEM
Humanities
Business & Finance
Arts & Humanities
APPLY NOW
Biology
APPLY NOW
Business Management
APPLY NOW
Chemistry
APPLY NOW
Computer science
APPLY NOW
Design
APPLY NOW
Economics
APPLY NOW
Education
APPLY NOW
Finance
APPLY NOW
Industrial Engineering
APPLY NOW
Law & Legal Studies
APPLY NOW
Math
APPLY NOW
Media Communications
APPLY NOW
Medicine
APPLY NOW
Philosophy
APPLY NOW
Physics
APPLY NOW
Psychology
APPLY NOW
Sociology
APPLY NOW
Systems Engineering
APPLY NOW
All
STEM
Humanities
Business & Finance
Arts & Humanities
APPLY NOW
Biology
APPLY NOW
Business Management
APPLY NOW
Chemistry
APPLY NOW
Computer science
APPLY NOW
Design
APPLY NOW
Economics
APPLY NOW
Education
APPLY NOW
Finance
APPLY NOW
Industrial Engineering
APPLY NOW
Law & Legal Studies
APPLY NOW
Math
APPLY NOW
Media Communications
APPLY NOW
Medicine
APPLY NOW
Philosophy
APPLY NOW
Physics
APPLY NOW
Psychology
APPLY NOW
Sociology
APPLY NOW
Systems Engineering
APPLY NOW
Hear from other experts
Read about how MIT PhD Daniel Z earns extra income on Outlier
"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".
Being able to discuss the nuances of intricate genetic systems with people from around the world that I’ve never met before is super cool… and of course the money is a good bonus! I would absolutely recommend it (and in fact I already have). Getting paid to create prompts from my research to test the frontiers of AI, and then being able to talk about it with academics and scientists from around the world… any curious academic mind will really enjoy this opportunity.
Josh Cole
England
PHD in Biology
Being able to discuss the nuances of intricate genetic systems with people from around the world that I’ve never met before is super cool… and of course the money is a good bonus! I would absolutely recommend it (and in fact I already have). Getting paid to create prompts from my research to test the frontiers of AI, and then being able to talk about it with academics and scientists from around the world… any curious academic mind will really enjoy this opportunity.
Josh Cole
England
PHD in Biology
Being able to discuss the nuances of intricate genetic systems with people from around the world that I’ve never met before is super cool… and of course the money is a good bonus! I would absolutely recommend it (and in fact I already have). Getting paid to create prompts from my research to test the frontiers of AI, and then being able to talk about it with academics and scientists from around the world… any curious academic mind will really enjoy this opportunity.
Josh Cole
England
PHD in Biology
Outlier is a serious, committed, reliable and trustworthy company. It offers competitive and fair hourly rates, weekly pay, and not least a large and collaborative community. The support service is fast and effective.
I have participated in more than 10 projects within Outlier and all of them have been very interesting in terms of learning and challenge. Without a doubt, I totally recommend working with Outlier, it is a serious company, that complies with their payments, and that has a lot of interesting projects.
SP
Sebastián P.
Spain
Outlier is a serious, committed, reliable and trustworthy company. It offers competitive and fair hourly rates, weekly pay, and not least a large and collaborative community. The support service is fast and effective.
I have participated in more than 10 projects within Outlier and all of them have been very interesting in terms of learning and challenge. Without a doubt, I totally recommend working with Outlier, it is a serious company, that complies with their payments, and that has a lot of interesting projects.
SP
Sebastián P.
Spain
Outlier is a serious, committed, reliable and trustworthy company. It offers competitive and fair hourly rates, weekly pay, and not least a large and collaborative community. The support service is fast and effective.
I have participated in more than 10 projects within Outlier and all of them have been very interesting in terms of learning and challenge. Without a doubt, I totally recommend working with Outlier, it is a serious company, that complies with their payments, and that has a lot of interesting projects.
SP
Sebastián P.
Spain
Application and onboarding process
STEP 1
Create an account
on Outlier
STEP 1
Create an account
on Outlier
STEP 1
Create an account
on Outlier
STEP 2
Verify your identity and conduct a video interview
STEP 2
Verify your identity and conduct a video interview
STEP 2
Verify your identity and conduct a video interview
STEP 3
Contribute your expertise to outsmart models and earn
STEP 3
Contribute your expertise to outsmart models and earn
STEP 3
Contribute your expertise to outsmart models and earn
Frequently Asked Questions (FAQs)
What is Humanity's Last Exam (HLE) in simple terms?
What is Humanity's Last Exam (HLE) in simple terms?
What is Humanity's Last Exam (HLE) in simple terms?
What is the relationship between Outlier and Scale AI?
What is the relationship between Outlier and Scale AI?
What is the relationship between Outlier and Scale AI?
How will contributors be paid for their HLE submissions?
How will contributors be paid for their HLE submissions?
How will contributors be paid for their HLE submissions?
What are the main benefits of participating in HLE?
What are the main benefits of participating in HLE?
What are the main benefits of participating in HLE?
What's the expected time commitment for participants?
What's the expected time commitment for participants?
What's the expected time commitment for participants?
Ready to use your brilliance to outsmart AI?
© 2025 Outlier. All rights reserved.
© 2025 Outlier. All rights reserved.
© 2025 Outlier. All rights reserved.