Outsmart Artificial Intelligence with Your Human Brilliance

Outsmart Artificial Intelligence with Your Human Brilliance

Join the top 1% of public health experts worldwide to shape the future of AI. Earn up to $45 USD/hr with the opportunity for additional rewards.

Join the top 1% of public health experts worldwide to shape the future of AI. Earn up to $45 USD/hr with the opportunity for additional rewards.

APPLY NOW

APPLY NOW

4.1

trustpilot logo

4.1

trustpilot logo

4.1

trustpilot logo
A metallic human head wearing a graduation cap, facing a metallic robot head with a smooth, rounded design and a circular eye. Both heads are shown in profile, facing each other on a white background.
A metallic human head wearing a graduation cap, facing a metallic robot head with a smooth, rounded design and a circular eye. Both heads are shown in profile, facing each other on a white background.
Earn up to $45 USD/hr,
paid out weekly

Additional opportunities to earn rewards
based on quality of submission

Additional opportunities to earn rewards based on quality of submission

Argentina, Australia, Canada, Mexico, NZ, Puerto Rico, US, UK
(Remote)

Choose your own schedule. Most experts
spend 5-10 hrs/week, up to 40 hours

Choose your own schedule. Most experts spend 5-10 hrs/week, up to 40 hours

Choose your own schedule. Most experts
spend 5-10 hrs per week, up to 40 hours

Valid, permanent ID issued by country of work is required
Valid, permanent ID issued by
country of work is required

Valid, permanent ID from the country you are in is required to complete verification

See accepted IDs for your country

See accepted IDs for your country

See accepted IDs for your country

See accepted IDs for your country

Overview

Outlier is a platform owned and operated by Scale AI and believes AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world, who help improve AI models by providing expert human feedback. This data has led to AI advancements for the world's leading AI labs and large language model builders.

We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

"We partnered with Scale AI to work with Enterprises to adopt Llama and train custom models with their own data. We are excited to collectively make Llama the industry standard and bring the benefits of AI to everyone."

Mark Zuckerberg

Founder and CEO,
Meta

What you will be doing

We are looking for proficient public-health experts to teach AI how to interpret and solve complex reasoning problems.

  • Create and answer medicine-related questions to train AI models.

  • Review, analyze, and rank AI-models chains of thought for correctness and clinical approach.

  • Provide clear, constructive feedback to improve AI-generated responses.
    Note: Depending on your skills, you will be assigned to different projects.

Common Tasks

Create Challenging Prompts for AI
Create Challenging Prompts for AI
Create Challenging Prompts for AI

Write a valid question that AIs and average humans cannot answer.

Write a valid question that AIs and average humans cannot answer.

Write a valid question that AIs and average humans cannot answer.

Subject

Medicine

Question

Provide a challenging prompt that will stump the AI model or cause it to "break".

Provide a challenging prompt that will stump the AI model or cause it to "break".

Provide Benchmark Solutions
Provide Benchmark Solutions
Provide Benchmark Solutions

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Provide a definitive, high quality solution that serves as the benchmark for evaluating AI responses. 

Question

Difficult

Answer/Solution

Provide a high-quality, thorough response that directly matches the intent of the original prompt.

Provide a high-quality, thorough response that directly matches the intent of the original prompt.

Participate in
Peer Review
Participate in Peer Review
Participate in Peer Review

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Work closely with fellow experts to evaluate and refine each other's solutions. Provide feedback to ensure high accuracy.

Contributor A’s response

Edit

Approve

What we’re looking for

  • Pursuing or holding an Undergraduate, Master’s, or PhD degree in your field of expertise or a related field.

  • Attendance or a degree from a Top accredited University or institution such as Harvard, MIT, Stanford, Oxford.

  • 2+ years of demonstrated expertise in your domain.

  • Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.

  • Strong analytical and problem-solving skills, with experience in crafting rigorous, high-quality questions and solutions.

  • Attention to detail to accurately assess AI capabilities and evaluate peer submissions.

  • Fluency/High proficiency in English.

Compensation and Benefits

Earn up to $45 USD/hr,
paid out weekly

Rates vary based on quality, accuracy and time spent. Paid via PayPal and AirTM

Earn up to $45 USD/hr,
paid out weekly

Rates vary based on quality, accuracy and time spent. Paid via PayPal and AirTM

Earn up to $45 USD/hr,
paid out weekly

Rates vary based on quality, accuracy and time spent. Paid via PayPal and AirTM

Flexible schedule and
time commitment

Most experts spend 5-10 hrs/week, up to 40 hours working from home

Flexible schedule and
time commitment

Most experts spend 5-10 hrs/week, up to 40 hours working from home

Flexible schedule and
time commitment

Most experts spend 5-10 hrs/week, up to 40 hours working from home

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Free access to
Model Playground

Interact, experiment and engage with leading large language models free of cost

Hear from other experts

A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.
A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.
A person wearing glasses speaks to the camera in a well-lit room with white cabinets and a white-painted brick wall in the background.

Read about how MIT PhD Daniel Z earns extra income on Outlier

Read about how MIT PhD Daniel Z earns extra income on Outlier

Read about how MIT PhD Daniel Z earns extra income on Outlier

"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".

"Daniel has enjoyed the combination of earning extra cash while contributing to AI development and has made over $4,000 on Outlier".

Read Daniel's Story

Read Daniel's Story

Read Daniel's Story

Great for PhDs to earn extra income

I joined Outlier a few month ago and have been active there in the last two months. It is a great place for a side job, and it is possible to earn upward of 1500$ per week if you are assigned to good projects. I especially recommend it to PhD students and graduates who are looking for some extra income.

M
Mo

United Kingdom

Great for PhDs to earn extra income

I joined Outlier a few month ago and have been active there in the last two months. It is a great place for a side job, and it is possible to earn upward of 1500$ per week if you are assigned to good projects. I especially recommend it to PhD students and graduates who are looking for some extra income.

M
Mo

United Kingdom

Great for PhDs to earn extra income

I joined Outlier a few month ago and have been active there in the last two months. It is a great place for a side job, and it is possible to earn upward of 1500$ per week if you are assigned to good projects. I especially recommend it to PhD students and graduates who are looking for some extra income.

M
Mo

United Kingdom

What I like most about Outlier.ai? I can work whenever I want, late in the evening or early in the morning. When a project is done I automatically receive other projects when available. Also if you show high quality you can move up the ladder from contributor, reviewer, quality control too.... Quality is appreciated and you can earn bonuses regularly depending on the project you are in.

ST
Steven T.

Netherlands

What I like most about Outlier.ai? I can work whenever I want, late in the evening or early in the morning. When a project is done I automatically receive other projects when available. Also if you show high quality you can move up the ladder from contributor, reviewer, quality control too.... Quality is appreciated and you can earn bonuses regularly depending on the project you are in.

ST
Steven T.

Netherlands

What I like most about Outlier.ai? I can work whenever I want, late in the evening or early in the morning. When a project is done I automatically receive other projects when available. Also if you show high quality you can move up the ladder from contributor, reviewer, quality control too.... Quality is appreciated and you can earn bonuses regularly depending on the project you are in.

ST
Steven T.

Netherlands

Application and Onboarding Process:

STEP 1

Create
an account
on Outlier

STEP 1

Create
an account
on Outlier

STEP 1

Create an account on Outlier

STEP 2

Upload your resume and tell us about your background

STEP 2

Upload your resume and tell us about your background

STEP 2

Upload your resume and tell us about your background

STEP 3

Upload your Valid ID and add your phone number

See accepted IDs for your country

See accepted IDs for your country

STEP 3

See accepted IDs for your country

Upload your Valid ID and add your phone number

STEP 3

Upload your Valid ID and add your phone number

See accepted IDs for your country

STEP 4

Start earning by
completing
tasks assigned

STEP 4

Start earning by completing tasks

STEP 4

Start earning by completing tasks assigned

Frequently Asked Questions (FAQs)

What is Outlier? How is it related to Scale AI?

What is Outlier? How is it related to Scale AI?

What is Outlier? How is it related to Scale AI?

Will I be an Outlier employee?

Will I be an Outlier employee?

Will I be an Outlier employee?

What do I need to sign up for this opportunity?

What do I need to sign up for this opportunity?

What do I need to sign up for this opportunity?

Who else will be a part of the program?

Who else will be a part of the program?

Who else will be a part of the program?

What's the expected time commitment for participants?

What's the expected time commitment for participants?

What's the expected time commitment for participants?

When and how will I be paid?

When and how will I be paid?

When and how will I be paid?

Who do I contact with questions as I onboard?

Who do I contact with questions as I onboard?

Who do I contact with questions as I onboard?

Have more questions?

View more FAQs here

Have more questions?

View more FAQs here

Have more questions?

View more FAQs here

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

In the News

A minimalist line drawing of a home office desk, chair, and laptop, illustrating a Scale AI article about platform updates designed to empower remote contributors.

Scale AI

Outlier Updates to Empower Contributors

April 3, 2025

An abstract image for a Scale AI article on "Advancing Frontier Model Evaluation." It features a grid of glowing squares and circles with varied lighting and textures, symbolizing the diverse and complex data points used to test advanced AI.

Scale AI

Advancing Frontier Model Evaluation

April 2, 2025

Scale AI

Scale’s Series F: Expanding the Data Foundry for AI

May 21, 2024

Ready to use your brilliance to outsmart AI?

APPLY NOW

APPLY NOW

APPLY NOW

in collaboration with Scale AI

© 2025 Outlier. All rights reserved.

© 2025 Outlier. All rights reserved.

© 2025 Outlier. All rights reserved.