4/5 of 1,987 reviews

Outsmart Artificial Intelligence with Your Human Brilliance

Join a global community of Code experts to shape the future of AI. Earn up to $50/hr.

CHOOSE YOUR EXPERTISE

Arabic
Earn Upto $50/hr
Shape the future of AI
Work Remotely

LANGUAGE

Arabic

LANGUAGE

Arabic

PAY

Earn Upto $50/hr

PAY

Earn Upto $50/hr

LANGUAGE

Arabic

PAY

Earn Upto $50/hr

Rated 4/5 from 1,987 reviews on

Outlier is powered by Scale AI to accelerate AI development at leading enterprises

Earn an average $20 - $50/hr, paid out weekly

Earn an average $20 - $50/hr,
paid out weekly

Rates vary based on your
area of expertise

Remote work,
flexible hours

Work from
anywhere, anytime

Define
AI's future

Define
AI's Future

Define AI's future

Leverage your expertise
and train frontier AI models

About Outlier

Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI, we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world, who help improve AI models by providing expert human feedback.

This data has led to AI advancements for the world's leading AI labs and large language model builders. We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills.

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO, Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO, Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO, Meta

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

Mark Zuckerberg, Founder and CEO, Meta

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

Mark Zuckerberg, Founder and CEO, Meta

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

Mark Zuckerberg, Founder and CEO, Meta

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta
"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."
-Forbes, A Growing Side Hustle For American College Grads: Fixing AI’s Wrong Answers
"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."
-Mark Zuckerberg, Founder & CEO Meta

What you will be doing

Create Challenging Prompts for AI

Write a valid question that AIs and average humans cannot answer.

Subject

Medicine

Question

Provide a challenging prompt that will stump the AI model or cause it to "break".

Provide Benchmark Solutions

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses.

Question

Difficult

Answer/Solution

Provide a high-quality, thorough response that directly matches the intent of the original prompt.

Participate in Peer Review

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Contributor A’s response

Edit

Approve

What we’re looking for

Pursuing or holding an Undergraduate, Master’s, or PhD degree in your field of expertise or a related field.
Attendance or a degree from a Top accredited University or institution such as Harvard, MIT, Stanford, Oxford.
2+ years of demonstrated expertise in your domain.
Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.
Strong analytical and problem-solving skills, with experience in crafting rigorous, high-quality questions and solutions.
Attention to detail to accurately assess AI capabilities and evaluate peer submissions.
Fluency/High proficiency in English.

What you will get from contributing

Earn up to $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Earn up to $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Earn up to $20-50 USD/hr, based on your area of expertise

Rates vary based on quality, accuracy and time spent. Paid out weekly via PayPal and AirTM

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Join an exclusive network of top 1% folks in their domains

Collaborate with leading experts at an all-expenses-covered event

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Flexible schedule and time commitment

No contracts, no 9-to-5. You control your schedule. (Most experts spend 5-10 hours/week, up to 40 hours working from home

Combine domain-specific images and prompts to challenge AI models

Combine meaningful domain-specific images with carefully crafted prompts to challenge state-of-the-art language models

Combine domain-specific images and prompts to challenge AI models

Combine meaningful domain-specific images with carefully crafted prompts to challenge state-of-the-art language models

Combine domain-specific images and prompts to challenge AI models

Combine meaningful domain-specific images with carefully crafted prompts to challenge state-of-the-art language models

Choose your expertise

Hear from other experts

Read about how MIT PhD Daniel Z earns extra income on Outlier

"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".

Read Daniel's Story

I view Outlier as a great opportunity for contributors to work flexibly, improve their skills, and earn more money at their own pace... Working with other contributors on Outlier makes the experience even more engaging, offering a perfect mix of collaborating and earning.

Vaibhav P.

India

Code Expert

Vaibhav P.

India

Code Expert

Vaibhav P.

India

Code Expert

As an engineer, I often use Al models to get the right answers, but this experience is the opposite:I need to make the models generate wrong answers. It is strange, exciting, and unforgettable

Cuong N.

Vietnam

Code Expert

As an engineer, I often use Al models to get the right answers, but this experience is the opposite:I need to make the models generate wrong answers. It is strange, exciting, and unforgettable

Cuong N.

Vietnam

Code Expert

As an engineer, I often use Al models to get the right answers, but this experience is the opposite:I need to make the models generate wrong answers. It is strange, exciting, and unforgettable

Cuong N.

Vietnam

Code Expert

The result is fewer tasks returning to the queue for all contributors, higher-quality tasks being completed correctly on the first attempt, and happier contributors thanks to easy access to high-touch, technical support channels.

Umair K.

Canada

Coding Expert

Umair K.

Canada

Coding Expert

Umair K.

Canada

Coding Expert

Application and onboarding process

STEP 1

Create an account
on Outlier

STEP 1

Create an account
on Outlier

STEP 1

Create an account
on Outlier

STEP 2

Verify your identity and conduct a video interview

STEP 2

Verify your identity and conduct a video interview

STEP 2

Verify your identity and conduct a video interview

STEP 3

Contribute your expertise to outsmart models and earn

STEP 3

Contribute your expertise to outsmart models and earn

STEP 3

Contribute your expertise to outsmart models and earn

In the News

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

Ready to use your brilliance to outsmart AI?

CHOOSE YOUR EXPERTISE

in collaboration with Scale AI

in collaboration with

Outsmart Artificial Intelligence with Your Human Brilliance

Outsmart Artificial Intelligence with Your Human Brilliance

Earn an average $20 - $50/hr, paid out weekly

Earn an average $20 - $50/hr,paid out weekly

Remote work,flexible hours

Remote work,flexible hours

DefineAI's future

Define AI's Future

Define AI's future

About Outlier

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone.

As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models.

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

"As artificial intelligence becomes ever more capable of mimicking human reasoning, it's increasingly requiring more highly skilled humans, often with specific areas of expertise, to hone its models."

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

What you will be doing

What you will be doing

What you will be doing

Create Challenging Prompts for AI

Create Challenging Prompts for AI

Create Challenging Prompts for AI

Provide Benchmark Solutions

Provide Benchmark Solutions

Provide Benchmark Solutions

Participate in Peer Review

Participate in Peer Review

Participate in Peer Review

What we’re looking for

What you will get from contributing

Earn up to $20-50 USD/hr, based on your area of expertise

Earn up to $20-50 USD/hr, based on your area of expertise

Earn up to $20-50 USD/hr, based on your area of expertise

Join an exclusive network of top 1% folks in their domains

Join an exclusive network of top 1% folks in their domains

Join an exclusive network of top 1% folks in their domains

Flexible schedule and time commitment

Flexible schedule and time commitment

Flexible schedule and time commitment

Combine domain-specific images and prompts to challenge AI models

Combine domain-specific images and prompts to challenge AI models

Combine domain-specific images and prompts to challenge AI models

Choose your expertise

Choose your expertise

Choose your expertise

Accounting

Agriculture

Architecture

Art

Basic Medical Science

Biology

Biomedical Science

Chemistry & Chemical Engineering

Civil Engineering

Computer Science & Engineering

Design

Diagnostics & Laboratory Medicine

Economics

Electrical Engineering

Electronics Engineering

Finance

History

Literature

Managerial Science

Marketing & Sales

Mathematics

Mechanical Engineering

Music

Operations Management & Research

Others (Geography, Sociology etc)

Physics

Earn an average $20 - $50/hr,
paid out weekly

Remote work,
flexible hours

Remote work,
flexible hours

Define
AI's future

Define
AI's Future