About the Opportunity
We are seeking surgeons to create clinically rigorous questions, evaluate model responses for surgical soundness, and apply operative judgment to procedural videos — all while working remotely on a flexible schedule.
At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. Through Outlier’s evaluation and feedback loop, your work helps turn frontier research into AI that performs better in the real world.
900K+
Outlier Experts
$600M+
Paid Out
52
Countries
Responsibilities
Write questions that AI can’t answer. If you’re confident a model would get your question right, it isn’t hard enough. We want the questions you’d genuinely want to ask a model and doubt it could answer.
Review model responses for clinical soundness, scientific rigor, and relevance.
Apply surgical judgment to operative videos. You’ll identify the anatomy and procedural steps, assess urgency, and flag safety events.
Common Tasks
Write a prompt
Write simple prompts that will act as a starting point for AI models
Edit
Preview
Correct AI models’ chain of thought
Review, analyze, and rank AI models’ chains of thought for correctness and approach
Step 1 Response
Step 2 Response
Improve
Approve
Step 3 Response
Ideal Qualifications
Medical degree: MD, DO, MBBS, or equivalent from an accredited medical program, plus previous residency or fellowship training in surgery.
English proficiency: Fluent in reading and writing, with minimal language errors.
Clinical judgment: Strong surgical judgment and experience evaluating operative videos.
Currently accepting applicants from:
🌍
Global
Why Join Outlier
How to Apply
Frequently Asked Questions (FAQs)
What is Outlier? How is it related to Scale AI?
What's the expected time commitment for participants?
When and how will I be paid?
How can I get support?
Who do I contact with questions as I onboard?
What do I need to sign up for this opportunity?
Will I be an Outlier employee?
Who else will be a part of the program?
Have more questions?
** Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates apply. Additional incentives data is based on payments made in the past six months and is updated quarterly. Certain projects offer incentive payments. Please review the payment terms for each project.
PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data.
This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.
Ready to use your brilliance to outsmart AI?
In collaboration with Scale AI
