Earn up to $100 USD/hr, paid out weekly
Rates vary based on expertise and project requirements. Paid out weekly
LATAM
(Remote)
Choose your own schedule. Most experts
spend 5-10 hrs/week, up to 40 hours
Danish
proficiency required
Content
Overview
Outlier is committed to improving the intelligence & safety of AI models. Owned and operated by Scale AI, we’ve recently been featured in Forbes for partnering experts with top AI labs to provide the high quality data for LLMs. We believe AI can only perform as well as the data it’s trained on. That’s why we work with contributors from all over the world, who help improve AI models by providing expert human feedback. This data has led to AI advancements for the world's leading AI labs and large language model builders.
We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.
What you will be doing
• Create a challenging prompt that the model fails to answer correctly.
• Create a grading rubric on what a good answer would be.
• Write the correct answer that scores 100% on the rubric.
• Provide clear, constructive feedback to improve AI-generated responses.
Common Tasks
Write a prompt
Write simple prompts that will act as a starting point for AI models
Edit
Preview
Correct AI-models chain of thought
Review, analyze, and rank AI-models chains of thought for correctness and approach
Step 1 Response
Step 2 Response
Approve
Improve
Step 3 Response
What we’re looking for
• PhD or Master's Degree in Electrical engineering or related field. Can be currently enrolled.
• Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.
• Strong analytical and problem-solving skills, with experience in crafting rigorous, high-quality questions and solutions.
• Attention to detail to accurately assess AI capabilities and evaluate peer submissions.
• Fluency/High proficiency in English.
Compensation and benefits
Disclaimer: For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project.
Equal Opportunity Employer: Outlier is committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.
Hear from other experts
Read about how MIT PhD Daniel Z earns extra income on Outlier
Application and Onboarding Process:
Frequently Asked Questions (FAQs)
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
