In Collaboration with Scale AI

While AI reshapes engineering, the smart move is building it from the inside.

Test, evaluate, and improve AI agents for Outlier. Up to $50 USD/hr.
Weekly payments. No fixed schedule.

Help Outlier improve OpenClaw agents. Write rubrics, test vulnerabilities, refactor execution paths.

  • Build Real AI Skills

  • Up to $50 USD/hr

  • Free Access to Top AI Models

  • Remote Work

  • Build Real AI Skills

  • Up to $35 USD/hr

  • Free Access to Top AI Models

  • Remote Work

  • Build Real AI Skills

  • Up to $35 USD/hr

  • Free Access to Top AI Models

  • Remote Work

Build Real AI Skills

Free Access to Top AI Models

Up to $50 USD/hr

Remote Work

Trusted by 10,000+ engineers worldwide

About the Project

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?
We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.
Whether you are a passionate orchestration guru or experienced software developer — we want you to help us train the world's most advanced generative systems.

Key Responsibilites

Write Eval Rubrics

Debug Agent Traces

Stress Test Agent

Why Join Outlier

Earn Up to $50 USD/hr — Plus Additional Incentives

Core project work pays up to $50 USD/hr. On average, contributors earn an additional 7.5% through Missions — Outlier's version of surge pricing. The top quartile boosts their earnings by an average of 11%. Read More

Earn Up to $50 USD/hr — Plus Additional Incentives

Core project work pays up to $50 USD/hr. On average, contributors earn an additional 7.5% through Missions — Outlier's version of surge pricing. The top quartile boosts their earnings by an average of 11%. Read More

Earn Up to $50 USD/hr — Plus Additional Incentives

Core project work pays up to $50 USD/hr. On average, contributors earn an additional 7.5% through Missions — Outlier's version of surge pricing. The top quartile boosts their earnings by an average of 11%. Read More

Future-Proof Your Skills With Real AI Work
Future-Proof Your Skills With Real AI Work
Future-Proof Your Skills With Real AI Work
Work flexibly from anywhere, anytime - no minimum hours
Work flexibly from anywhere, anytime - no minimum hours
Work flexibly from anywhere, anytime - no minimum hours
Get free access to leading LLMs — worth $200+/month
Get free access to leading LLMs — worth $200+/month
Get free access to leading LLMs — worth $200+/month

Ideal Qualifications

  • 2+ years of experience in backend engineering, AI automation, or complex systems integration.

  • Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).

  • Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.

  • Practical experience building for live, non-mocked environments and handling multi-turn system interactions.

  • Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Currently accepting applicants from:

🇦🇺

Australia

🇨🇦

Canada

🇫🇮

Finland

🇫🇷

France

🇮🇹

Italy

🇳🇴

Norway

🇬🇧

United Kingdom

🇺🇸

United States

Nice to have

  • Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.

  • Hands on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.

  • High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.

  • Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Application and Onboarding Process

01

Create an account on Outlier

01

Create an account on Outlier

02

Upload your resume and tell us about your background

02

Upload your resume and tell us about your background

03

Upload your valid ID and add your phone number

03

Upload your valid ID and add your phone number

04

Start earning by completing tasks

04

Start earning by completing tasks

Frequently Asked Questions (FAQs)

What is Outlier? How is it related to Scale AI?

Will I be an Outlier employee?

What do I need to sign up for this opportunity?

Who else will be a part of the program?

What's the expected time commitment for participants?

When and how will I be paid?

Who do I contact with questions as I onboard?

How can I get support?

Have more questions?

** Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.

PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.

This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

Ready to use your brilliance to outsmart AI?

in collaboration with Scale AI

Ready to use your brilliance to outsmart AI?

in collaboration with Scale AI

© 2026 Outlier. All rights reserved.

© 2026 Outlier. All rights reserved.

© 2026 Outlier. All rights reserved.