Outsmart Artificial Intelligence with Your Human Brilliance

Outsmart Artificial Intelligence with Your Human Brilliance

Join a new expert-led project where you'll craft prompts using your skills to expose the reasoning limits of top AI models.

Join a new expert-led project where you'll craft prompts using your skills to expose the reasoning limits of top AI models.

CHOOSE YOUR EXPERTISE

CHOOSE YOUR EXPERTISE

CHOOSE YOUR EXPERTISE

4.1

trustpilot logo

4.1

trustpilot logo

4.1

trustpilot logo
A metallic human head wearing a graduation cap, facing a metallic robot head with a smooth, rounded design and a circular eye. Both heads are shown in profile, facing each other on a white background.
A metallic human head wearing a graduation cap, facing a metallic robot head with a smooth, rounded design and a circular eye. Both heads are shown in profile, facing each other on a white background.
A metallic human head wearing a graduation cap, facing a metallic robot head with a smooth, rounded design and a circular eye. Both heads are shown in profile, facing each other on a white background.
Earn an average $20 - $50/hr, paid out weekly
Earn an average $20 - $50/hr,
paid out weekly

Rates vary based on your
area of expertise

Remote work,
flexible hours

Remote work,
flexible hours

Work from
anywhere, anytime

Define
AI's future
Define
AI's Future
Define AI's future

Leverage your expertise
and train frontier AI models

About Outlier

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI, we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs.

About the role
Our mission is to challenge AI with Humanity’s Last Exam, a rigorous new way to test AI’s intelligence and reasoning. To do so, we are recruiting a group of exceptional minds to craft PhD and Master's level problems that current AI models cannot solve correctly.

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

What you will be doing

What you will be doing

What you will be doing

Create Challenging Prompts for AI
Create Challenging Prompts for AI
Create Challenging Prompts for AI

Write a valid question that AIs and average humans cannot answer.

Write a valid question that AIs and average humans cannot answer.

Write a valid question that AIs and average humans cannot answer.

Subject

Medicine

Question

Provide a challenging prompt that will stump the AI model or cause it to "break".

Provide a challenging prompt that will stump the AI model or cause it to "break".

Provide Benchmark Solutions
Provide Benchmark Solutions
Provide Benchmark Solutions

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Question

Difficult

Answer/Solution

Provide a high-quality, thorough response that directly matches the intent of the original prompt.

Provide a high-quality, thorough response that directly matches the intent of the original prompt.

Participate in Peer Review
Participate in Peer Review
Participate in Peer Review

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Contributor A’s response

Edit

Approve

What you will get from contributing

Earn $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Earn $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Earn $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Hear from other experts

A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.
A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.
A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.

Read about how MIT PhD Daniel Z earns extra income on Outlier

Read about how MIT PhD Daniel Z earns extra income on Outlier

Read about how MIT PhD Daniel Z earns extra income on Outlier

"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".

"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".

Read Daniel's Story

Read Daniel's Story

Read Daniel's Story

Outlier is a reliable and rewarding way to generate extra income — or even a full-time income. It requires a smart investment of time in training, but once you're up to speed, it's an excellent and flexible way to earn money. The work is varied and enjoyable, and best of all, payments are made weekly without any hassle.

J
Jellep

Netherlands

Outlier is a reliable and rewarding way to generate extra income — or even a full-time income. It requires a smart investment of time in training, but once you're up to speed, it's an excellent and flexible way to earn money. The work is varied and enjoyable, and best of all, payments are made weekly without any hassle.

J
Jellep

Netherlands

Outlier is a reliable and rewarding way to generate extra income — or even a full-time income. It requires a smart investment of time in training, but once you're up to speed, it's an excellent and flexible way to earn money. The work is varied and enjoyable, and best of all, payments are made weekly without any hassle.

J
Jellep

Netherlands

I’ve been working with Outlier as a freelancer, and in my case, it’s been an excellent way to earn extra income while traveling and managing other projects. I’ve never had any issues with payments — they’re always weekly and on time, which is essential for me.

JM
João M.

Portugal

I’ve been working with Outlier as a freelancer, and in my case, it’s been an excellent way to earn extra income while traveling and managing other projects. I’ve never had any issues with payments — they’re always weekly and on time, which is essential for me.

JM
João M.

Portugal

I’ve been working with Outlier as a freelancer, and in my case, it’s been an excellent way to earn extra income while traveling and managing other projects. I’ve never had any issues with payments — they’re always weekly and on time, which is essential for me.

JM
João M.

Portugal

Application and onboarding process

STEP 1

Create an account
on Outlier

STEP 1

Create an account
on Outlier

STEP 1

Create an account
on Outlier

STEP 2

Verify your identity and conduct a video interview

STEP 2

Verify your identity and conduct a video interview

STEP 2

Verify your identity and conduct a video interview

STEP 3

Contribute your expertise to outsmart models and earn

STEP 3

Contribute your expertise to outsmart models and earn

STEP 3

Contribute your expertise to outsmart models and earn

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

An abstract visualization for Scale AI's Series F funding announcement, with the company logo at the center of swirling data streams representing the "Data Foundry for AI."

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

An abstract visualization for Scale AI's Series F funding announcement, with the company logo at the center of swirling data streams representing the "Data Foundry for AI."

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

An abstract visualization for Scale AI's Series F funding announcement, with the company logo at the center of swirling data streams representing the "Data Foundry for AI."

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

Ready to use your brilliance to outsmart AI?

CHOOSE YOUR EXPERTISE

in collaboration with Scale AI

Ready to use your brilliance to outsmart AI?

CHOOSE YOUR EXPERTISE

in collaboration with Scale AI

Ready to use your brilliance to outsmart AI?

CHOOSE YOUR EXPERTISE

in collaboration with Scale AI

PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.

This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

© 2025 Outlier. All rights reserved.

© 2025 Outlier. All rights reserved.

© 2025 Outlier. All rights reserved.