Contribute expertise
Law, Medicine & Finance
Use your law, medicine, or finance credential to judge whether AI reasoning is actually correct.
What it is
AI models now answer questions in specialized fields, but they are often confidently wrong in ways only a trained professional can catch. This work pays credentialed experts to read a model's answer and judge whether it is correct, safe, and defensible in their field. You are the human standard the AI is measured against and taught to reach.
What you actually do
- Read a model's answer to a specialized question and rate whether it is correct, complete, and safe
- Write a clear explanation of exactly what is wrong and cite the governing rule, standard, or authority
- Compare two model answers and choose the more defensible one, marking the specific errors in the weaker one
- Verify that cited cases, statutes, studies, or figures actually exist and say what the model claims
- Rewrite or correct a flawed answer so it meets professional standard of care or practice
- Follow a detailed rubric and flag places where the rubric itself conflicts with sound professional judgment
What a real task looks like
Check a model's legal analysis for fabricated citations
You receive a contract question and the model's answer, which cites three cases and a statute. As an attorney, you verify that each authority exists, actually says what the model claims, and applies to the right jurisdiction. You flag any invented or misquoted citation and note the correct rule.
Rank two model answers to a financial analysis prompt
You are given a valuation or tax-treatment question and two competing model responses. As a CPA or analyst, you decide which is more defensible, mark the specific numerical or methodological errors in the weaker one, and explain why the better answer would hold up in front of a client or a regulator.
Catch an unsafe clinical recommendation
A model suggests a treatment and a dosage for a described patient. As a physician, you check it against the standard of care, catch a contraindication or wrong dose the model missed, and rewrite the answer so it is both correct and appropriately caveated.
Is it right for you?
This is for people who hold a real, verifiable credential and years of practice in law, medicine, finance, accounting, or high-stakes consulting. The professionals who thrive can not only spot an error but articulate exactly why it is wrong and cite the governing authority. It suits practitioners who want flexible, remote, well-paid work that uses their hardest-won expertise rather than setting it aside.
This is a good fit if
- You hold an active license or professional credential (MD, JD with bar admission, CPA, CFA, actuary, PE, or similar)
- You can explain not just the right answer but precisely why a wrong answer is wrong
- You want flexible, remote, per-project work that pays a premium for your specialty
- You are comfortable reviewing others' reasoning against a standard, the way you would a junior colleague's work
What you need
- A genuine, verifiable professional credential or license in law, medicine, finance, accounting, or a comparable field
- Years of real practice in that field, not just a degree
- Willingness to pass identity and credential verification during onboarding
- Fluent professional written communication in the working language (usually English)
Skills that help
How to get started
- 1Identify your strongest verifiable credential and the narrow specialty where your judgment is hardest to replace
- 2Find expert-network and AI-evaluation platforms that recruit licensed professionals, and apply with your real credentials
- 3Complete their identity and credential verification and any qualification test in your field
- 4Start with a small batch of evaluation tasks to learn the rubric and their quality expectations
- 5Write thorough, well-cited justifications every time; quality and reliability, not speed, get you invited back
- 6Deliver consistently and expert reviewers get routed to higher-paying, more specialized projects over time
Common misconceptions
Myth: You need to understand how AI or machine learning works.
Reality: You do not. The model's answer is just text you evaluate. Your job is your professional expertise, not the technology. If you can review a junior colleague's work, you can do this.
Myth: The work is easy because you already know the material.
Reality: Knowing the answer is only half of it. You have to articulate precisely why the model is wrong, cite the governing authority, and follow a strict rubric, which is slower and more demanding than it first sounds.
Myth: A degree in the field is enough to qualify.
Reality: The premium is paid for a verifiable active license and real practice. Platforms check your credentials, and generalist book knowledge is far less valued than a currently practicing specialist's judgment.
What it pays
Domain Experts work typically pays $60–$140/hr typical, $250–$450/hr for medical and finance specialists (compiled benchmark).
The complete guide
Everything about domain experts work
Written by Yuma Heymans, Founder & CEO of AITraining.jobs.
Founder and CEO of AITraining.jobs and co-founder of the AI recruitment platform HeroHunt.ai, based in San Francisco, with years spent mapping how AI-training and data work is sourced, staffed, and paid.
Your license is now a side income paying a median of Unavailable an hour on the roles open today, because frontier AI still cannot reason like a professional without you.
Here is the number that should reframe how you think about your credential. In September 2025, The Information reported that Anthropic had discussed spending over $1 billion over the following year on the reinforcement learning environments used to train its models, as Epoch AI's analysis of the RL-environment economy (12 January 2026) recounts. A large and growing slice of that spend flows to human experts: real lawyers, physicians, and finance professionals who grade what the model produces and write the answers it should have produced. The service industry that brokers this work is now estimated to be worth at least $17 billion, according to PitchBook senior AI analyst Dimitri Zabelin, cited in CNN's report of 17 February 2026 on the doctor training AI to do her own job. If you hold a bar admission, a medical license, a CPA, or a CFA, some of that money is addressable by you, from your laptop, on your own schedule.
This matters because the economics of AI training have flipped. Two years ago the money went to armies of low-cost generalists labeling images and rating chatbot politeness. That work is largely commoditized now. The frontier has moved into exactly the domains where being right requires years of training and a license: interpreting a lab panel, structuring a Regulation D exemption, building a discounted cash flow model that survives an audit. Frontier labs have run out of cheap data that improves those capabilities, so they are paying scarce credentialed professionals real professional rates to supply the missing judgment. This guide is the honest, sourced, deeply practical map of that opportunity: what the work is, what it pays, who it is for, how to land your first paid task, and how the whole thing is likely to change as the models get better at your job.
Contents
- What "domain expert" AI training actually is
- Why frontier models cannot do this without you (first principles)
- What you actually do day to day, with real task walk-throughs
- Who it is for, and the honest barrier to entry
- The real skills, and how to build the one most experts lack
- The platforms that hire law, medicine, and finance experts
- Realistic pay: by platform, seniority, and geography
- How to get started and land your first paid task
- Scams, pitfalls, and the effective-pay trap
- Taxes and payment logistics for 1099 experts
- How AI agents and 2026 model progress are changing this work
- A decision framework
1. What "domain expert" AI training actually is
The plainest description of the job is this: an AI lab is building a model that gives legal, medical, or financial answers, and it needs a real professional to judge whether those answers are correct, safe, and reasoned the way a practitioner would reason. You are the human standard the model is measured and trained against. This is not data entry, and it is not survey filler. It is the last mile of model quality, the part where the difference between a confident wrong answer and a genuinely useful one can only be told apart by someone who has actually done the work. The task types line up with how reinforcement learning from human feedback pipelines actually work, which is why the field is sometimes called RLHF work or, more precisely for the expert tiers, expert evaluation and reward modeling.
The category sits inside a much larger AI-training labor market that spans a dozen distinct kinds of work, from data labeling and annotation at the entry end to red-teaming and AI safety at the adversarial end. Domain expert work is the highest-credentialed, highest-paid slice of it, and it is defined less by the mechanics of the task (you rate, you rank, you write) than by who is allowed to do it. A generalist can label a stop sign. Only a securities attorney can reliably tell whether a model's answer about an accredited-investor exemption is subtly, dangerously wrong. That gap is what you are paid for, and it is why the law, medicine and finance roles open on this board pay a median of Unavailable an hour, against Unavailable for generalist data labeling. It is also worth comparing this work against the adjacent RLHF and model evaluation track and the STEM, math and proofs track, because many experts qualify for more than one and the pay differs.
2. Why frontier models cannot do this without you (first principles)
Start from the machine, not the marketing. A large language model learns from patterns in text, and it can be pushed toward better reasoning with reinforcement learning, where the model tries an answer and receives a reward signal telling it how good that answer was. In domains like arithmetic or code, that reward can be computed automatically: run the unit test, check the proof, verify the number. This is called reinforcement learning with verifiable rewards, and it is why models got dramatically better at math and coding first. The problem, laid out plainly in the research literature, is that this approach "has not been effectively extended to knowledge-intensive domains due to the issue of unverifiable answers and limited high-quality verifiable data," per a 2026 study on RLVR in knowledge-intensive domains. There is no unit test for whether a demand letter is well-drafted or a differential diagnosis is sound. The only reliable verifier is a professional.
That is the entire reason this job exists, and it is worth sitting with because it tells you how durable the work is. A model can memorize every statute and every clinical guideline and still fail at the thing professionals are actually paid for: applying judgment to a messy, specific, novel situation. Mercor's own benchmarks make the gap visible. On APEX, its index of real professional tasks in law, finance, consulting, and medicine, and on its medical leaderboards, models that can pass licensing exams like the USMLE (the US medical licensing exam) still fall well short of full marks on real professional tasks, as the APEX leaderboard results show (the best model scored 81.1 percent on the four-domain APEX-1, read 10 November 2026). Passing the exam is pattern recall. Doing the job is judgment under uncertainty. The exam has an answer key; the job does not, which is precisely why the labs need you to write one.
There are three specific capability gaps that only a credentialed human can close, and understanding them tells you where the highest-paid work is. First is factual grounding in a live field, where a model confidently invents a case citation or misstates a revenue-recognition rule and only a practitioner catches it. Second is calibrated risk judgment, where the safe answer for a 58-year-old with new-onset shortness of breath is not the statistically likeliest one but the one that will not kill them if you are wrong. Third is jurisdiction-specific and instrument-specific reasoning, where the correct answer for a UK-qualified employment solicitor differs from a US-barred one, and no amount of general training substitutes for the real thing. The first gap is easy to see in a fast-moving drug class: GLPcompare's dated log of FDA actions, label updates and trial results for GLP-1 medicines, kept by the same team as this guide, is the kind of record a model's confident claim gets checked against.
These three gaps interact, and the work that pays best targets the place where they overlap. A model that is right on almost every routine task fails exactly on the few that require all three at once: a novel fact pattern, in a high-stakes context, in a specific jurisdiction. Those few cases are where a senior specialist earns the top of the band, because closing it is worth enormous money to a lab whose product is only as valuable as its worst confident answer. Everything else in this guide, the platforms, the pay bands, the assessments, is downstream of this single structural fact: the labs are buying the judgment that their reward functions cannot compute, and only your license certifies that you have it.
3. What you actually do day to day, with real task walk-throughs
The work happens almost entirely in a browser interface where prompts, model responses, and grading rubrics sit side by side. You read, you think, and you write. There is no coding required for pure law, medicine, and finance evaluation, and no need to understand machine learning. What the platform needs from you is your professional reasoning, rendered in clear, structured, defensible writing. In practice the day divides into a handful of recurring task types, and knowing them concretely is the difference between a vague idea of the job and an accurate one. The tasks below are the real shapes the work takes, drawn from platform descriptions and expert accounts, and each one rewards a slightly different professional muscle.
Consider a concrete medical example. You are shown a patient vignette (a 62-year-old with specific labs and a medication list) and two AI-generated management plans. Your job is to rank them on correctness, safety, completeness, and reasoning quality, then write two or three sentences explaining exactly why the loser lost: it missed a contraindication, it ordered an unnecessary test, it buried the one finding that actually matters. A physician doing this work described the essence of it to CNN as teaching the model "to think, diagnose and prescribe like her," while stressing that the technology "is not a replacement for a doctor," per CNN's reporting of 17 February 2026. The recurring task types across all three domains are:
- Output evaluation and ranking. The model produces two or more answers to a realistic prompt and you rate or rank them on correctness, completeness, safety, and reasoning. This is the bread-and-butter comparison RLHF is built on.
- Gold-standard authoring. You write the ideal expert answer so the model has something authoritative to learn from and be graded against. This is the highest-value, highest-paid work because it captures how a professional actually thinks.
- Prompt and scenario writing. You invent hard, realistic problems with deliberately ambiguous edge cases (a fact pattern hiding a statute-of-limitations issue, a model with a subtle circular reference) that separate a competent model from a superficial one.
- Error spotting and critique. You read a long model output and flag exactly where it went wrong, then explain why in the language a supervising professional would use.
- Benchmark task authoring. The most prestigious version: building the evaluation set that decides whether a frontier model is good enough at your profession.
The common thread across all five is that you are being paid for the explanation, not just the verdict. A thumbs-down with no reasoning is nearly worthless to a lab; a thumbs-down that pinpoints the flawed premise and articulates the correct chain of reasoning is training signal of the highest quality. This is why the benchmark work is so demanding and so well compensated. Mercor spent more than $500,000 building the 200 tasks of its APEX benchmark across law, medicine, finance, and consulting, per TIME's coverage of 1 October 2025; in the first version of the APEX technical paper (30 September 2025), each case carries a mean of 26,677 tokens of source documents and a detailed grading rubric, written by 76 experts with a mean of 7.25 years of experience, and later versions of the paper grow the benchmark to 400 cases. That is the ceiling of the craft: not grading answers, but defining what a correct answer even is.
4. Who it is for, and the honest barrier to entry
For the premium law, medicine, and finance rates, the gate is a real, verifiable professional credential, and platforms verify it before assigning specialist projects. This is not a field where enthusiasm substitutes for a license. If you are a licensed attorney with a few years on complex matters, a board-certified physician, an RN or PharmD, a CPA, or a CFA charterholder, you are the target hire and the barrier is low: you already have the scarce input. If you do not hold a credential, the honest truth is that the premium tier is closed to you, though generalist annotation work (where the roles on this board have a median of Unavailable an hour) is open to almost anyone and can be a legitimate on-ramp. This guide is written for the credentialed reader, because that is who the economics actually favor.
The barrier that trips up strong professionals is not the credential; it is the second, quieter requirement. You have to be able to articulate your reasoning in clean, structured writing that a model and a lab's researchers can learn from. Being right is not enough. Many excellent practitioners reason brilliantly and explain poorly, and the platforms screen hard for the ones who can do both. The good news is that if you can write a tight memo, a clear clinical assessment, or a defensible valuation narrative, you already have the core skill, and the assessment is designed to surface exactly that. What qualifies, by domain:
- Law: an active bar admission or JD, with experience on complex matters. Litigation, transactional, corporate, compliance, regulatory, IP, tax, and bankruptcy are all in demand, per Mercor's lawyers page.
- Medicine: a medical license (MD/DO), plus board certification and clinical experience. Nurses (RN, NP), pharmacists (PharmD), and other licensed clinicians qualify for many medical-reasoning projects, per Mercor's healthcare page.
- Finance: a CPA, CFA, MBA in finance, or substantial experience in investment banking, equity research, accounting, or financial modeling.
- Adjacent credentials: a relevant PhD, or long documented senior experience, can substitute for a formal license on many platforms.
The interaction of these requirements explains why the field is generous to credentialed people and stingy to everyone else. The credential is a hard filter that keeps the labor pool small; the writing requirement filters it again; and most people who clear both already have well-paid day jobs, which keeps them from flooding the market. Scarcity on scarcity is what holds the rate up. If you clear both filters, you are competing in a genuinely thin pool for money that reflects that thinness, and the rarer your specific sub-specialty, the thinner the pool and the higher the number.
5. The real skills, and how to build the one most experts lack
The two skills that matter are your domain judgment (which you already have) and your ability to externalize it (which many experts have never had to practice). In daily professional life you make hundreds of correct micro-decisions without narrating them: you glance at a contract clause and know it is unenforceable, you see a lab value and know it is spurious, you look at a model and know the terminal-growth assumption is fantasy. AI training work forces you to slow down and write out the chain of reasoning that your expertise normally compresses to instinct. That externalization is the single skill most professionals need to build, and the fastest way to build it is to treat every rating as if you were teaching a sharp but literal junior associate who will do exactly what you say and nothing you imply.
The second skill, closely related, is calibrating to the rubric rather than to your instinct. The most common reason strong professionals get downgraded is that they answer the way they would in practice instead of the way the rubric asks. If the rubric says penalize every unsupported claim, you penalize every one, even the ones a real client would happily forgive. Learning to read instructions twice, follow them literally, and suppress the shortcuts that experience has taught you is a discipline in its own right. The toolset itself is deliberately light and takes minutes to learn: comparison and ranking UIs, long-form editors for gold-standard answers, structured forms for tagging errors, and occasionally time-tracking software on hourly contracts. The tools are not the challenge; the discipline is.
Here is a practical progression for building the externalization skill before you ever apply. First, take three recent decisions from your own work and write the full reasoning chain for each in under 150 words, as if grading an AI's version. Second, deliberately write the wrong answer and then critique it, which is the exact shape of error-spotting tasks. Third, draft a two-line rubric for one task in your specialty (what makes an answer correct, complete, and safe) because rubric-thinking is what separates mid-tier raters from benchmark authors. Do these three exercises and the qualification task will feel familiar rather than foreign, and your reviewer-quality score, which gates access to the best-paying projects, will start high instead of climbing slowly.
6. The platforms that hire law, medicine, and finance experts
The field is served by a cluster of specialist marketplaces and annotation platforms, and they differ in meaningful ways: how they vet you, how they pay, which countries they accept, and whether they lean toward high-end expert projects or high-volume task work. The premium tier for a credentialed professional is anchored by Mercor, AfterQuery, and Braintrust, with DataAnnotation as a strong option in eligible countries and Outlier and micro1 filling in volume and breadth. AITraining.jobs aggregates live domain expert roles and pay across these platforms in one place, which is useful precisely because availability is lumpy and no single platform is reliably hiring in your specialty at any given moment; you can browse live domain expert openings and compare pay across all AI training work rather than checking each platform's careers page by hand.
The differences among the platforms are not cosmetic; they change your effective hourly rate and your experience of the work. Mercor runs an AI-driven application and interview process and has assembled one of the largest professional networks, more than 30,000 experts across medicine, law, finance, consulting, and research as of October 2025, per Contrary Research's company breakdown (updated 20 October 2026). Braintrust is a user-owned talent network whose AI training page shows 100 percent of your rate as yours to keep (read 29 October 2026). AfterQuery leans hard into credentialed specialists (MD, JD, PhD). Task-based platforms like Outlier and DataAnnotation ( Surge AI's worker platform) offer more consistent volume but a lower and less transparent effective rate. Here is how the major platforms compare for a credentialed professional, each with the top law, medicine or finance role on this site's researched rate card and the day that card was last checked:
| Platform | Vetting style | Top law, medicine or finance role on its rate card | Checked | Best for |
|---|---|---|---|---|
| Mercor | AI application and interview | $45–$450/hr (physician / medical expert) | 8 Nov 2026 | Largest network, deep law/med/finance projects |
| AfterQuery | Credential verification (MD/JD/PhD) | $45–$175/hr (credentialed specialist) | 1 Nov 2026 | Highest-credentialed specialists |
| Braintrust | Profile plus AI skills interview | $60–$150/hr (expert reviewer) | 1 Nov 2026 | Keeping your full rate |
| DataAnnotation | Domain skills test | $40–$125+/hr (law, finance, medicine) | 2 Nov 2026 | US/CA/UK/IE/AU/NZ generalist-to-expert on-ramp |
| Outlier | Domain qualification task | up to $150/hr (ML, EE and quant finance) | 8 Nov 2026 | Volume backup, watch effective rate |
| micro1 | AI interviewer ("Zara") | $100–$170/hr typical, to $400 (attorney) | 8 Nov 2026 | Legal, finance and specialist projects |
Read that table with one caveat in mind: the high end of each band is the top of the range, reserved for the most senior specialists on the most demanding projects, not the number a newly approved contributor sees. Braintrust's own card, for instance, spans $20–$200/hr across all of its AI training work. The realistic middle for a solidly credentialed professional is closer to what the law, medicine and finance roles open on this board pay today: a median of Unavailable an hour, in a typical band of Unavailable to Unavailable. The strategy that follows from this is simple and non-negotiable: apply to several, because work availability swings with lab funding cycles, and having two or three approved platforms is the only reliable way to smooth out the dry spells. You can track which are hiring for your specialty right now on the domain expert pay and jobs hub.
7. Realistic pay: by platform, seniority, and geography
Pay in this field is genuinely wide, and averages mislead because they blend generalist tasks with specialist tasks into a meaningless middle: across every kind of AI training work open on this board the median is Unavailable an hour, while the law, medicine and finance roles have a median of Unavailable. What matters for you is the specialist band, and the single most important line is the jump from mid-level to expert, where your license moves you into a different band. Mercor's rate card, checked 8 Nov 2026, reads $63–$90/hr median listing; experts to $450/hr, and physicians sit near the top of the market: Handshake AI's card, checked 8 Nov 2026, reads $15–$150/hr; physicians and surgeons to $300/hr. Here is how pay scales by tier, using the tiers in Mercor's article on AI trainer pay across the industry (updated 23 June 2026, read 29 October 2026), its estimates for early 2026:
The tier chart makes the central fact visual: the leap from mid-level to expert is where the credential pays off, and within the expert tier your specific sub-specialty moves you further. Mercor's lawyers page (read 29 October 2026) lists transactional and corporate, compliance and regulatory, and IP experts at $100 to $150 an hour, against $55 to $135 for generalist legal projects. Medical roles range widely too: Mercor's card puts its physicians and medical experts at $45–$450/hr. Now compare what this work pays with the other kinds of AI training work, read live from the roles open on the board today:
- Data labeling: n/a / n/a
- AI evaluation (RLHF): n/a / n/a
- Coding: n/a / n/a
- Math and STEM: n/a / n/a
- Law, medicine, finance: n/a / n/a
Geography changes everything about these numbers. This work is remote and global, but pay is emphatically not flat. US-based experts command the top of every band, followed by Canada, the UK, Ireland, Australia, and New Zealand, which are eligible for most premium platforms (DataAnnotation publishes no country list, but worker reports point to those six countries only). Of the law, medicine and finance roles open on this board today, 0 take people in the US, 0 in the UK, 0 in Canada and 0 in the Philippines. Jurisdiction-specific expertise pays a premium precisely because it is scarce in that jurisdiction: a US-barred securities attorney or a UK-qualified employment solicitor is exactly what a lab building a jurisdiction-aware legal model needs, and it pays for the passport-plus-credential combination. Here is the realistic monthly picture across common weekly commitments, in paid hours: multiply them by your own rate, or by the median of the law, medicine and finance roles open today, Unavailable an hour.
| Weekly hours | Monthly hours | Realistic characterization |
|---|---|---|
| 8 hrs (weekend) | ~35 | High-value side income on top of a day job |
| 12 hrs | ~52 | Strong supplemental, still comfortably part-time |
| 20 hrs | ~87 | Serious second income, if projects are flowing |
| 30 hrs (busy project) | ~130 | Near full-time equivalent, not guaranteed to repeat |
The honest read on those numbers is that this is excellent part-time income and an unreliable full-time income. Work is project-based and comes in waves. A credentialed professional doing 10 to 15 focused hours a week is paid for roughly 43 to 65 hours a month when projects flow, and Mercor's rate card ( $63–$90/hr median listing; experts to $450/hr) shows how high sustained senior work can go. But sustaining that depends entirely on continuous project availability, which no platform guarantees. Treat the income as high-value and variable, stack it on top of a primary practice, and diversify across platforms so no single pipeline drying up sinks your month.
8. How to get started and land your first paid task
The path is consistent across platforms, and understanding it removes almost all the friction. The single most important thing to internalize is that the qualification task, not the application form, is what sets your rate and your project access. Mercor's own onboarding guide (updated 23 June 2026) tells applicants to anticipate one to four weeks for initial screening, followed by qualification tasks, and notes that some platforms respond within days while others take weeks, per Mercor's guide to becoming an AI trainer (read 29 October 2026). The qualification task will feel harder than the actual work, and that is by design: the platforms would rather over-screen than ship low-quality expert data to a lab paying millions for it.
Approach the whole process the way you would a bar exam answer or a board question, because that is effectively what the assessment is. Build a credential-forward profile that leads with your license, your institution, your specialty, and concrete matters or cases you have worked, and never inflate credentials, because domain claims are verified through the skills test and an inflated claim just means you fail it and wait longer to requalify. Then, on the task itself, follow the rubric to the letter, show your reasoning explicitly, and do not rush. Here is the sequence:
- Pick platforms matched to your credential and country. For a US/UK/CA/AU/NZ/IE professional, apply to Mercor, AfterQuery, and Braintrust as your premium tier, add DataAnnotation if eligible, and keep Outlier as a volume backup.
- Build a credential-forward profile. Lead with license, institution, specialty, and specific matters. This is where you prove your tier.
- Complete the qualification task like an exam. Follow the rubric exactly, externalize your reasoning, do not rush. This step sets your rate.
- Calibrate to the rubric, not your instinct. Answer the way the instructions ask, not the way you would in practice. This is the most common reason strong professionals get downgraded.
- Start small, build a quality record, then negotiate. High agreement with gold standards and clean writing unlock higher-paying projects and rate increases.
The reason to apply to two or three platforms at once, rather than perfecting one application, is structural: task flows on contract platforms fluctuate constantly with lab funding cycles, so approval on multiple platforms is the only reliable hedge against a slow month. Once you are in, your reviewer-quality score compounds. Your first few projects establish a track record of high agreement with gold-standard answers and clean, defensible writing, and that record is what moves you into the premium projects and unlocks the rate increases. Treat the first month as calibration, not income maximization, and the money follows. You can find which platforms are actively hiring in your specialty on the domain expert roles hub rather than polling each site manually.
9. Scams, pitfalls, and the effective-pay trap
The legitimate version of this work is real and well-paid, which is exactly why scammers imitate it. The single clearest rule, repeated across every credible fraud analysis, is that money only ever flows from the company to you, per the FTC's job-scam guidance. A real AI training platform never charges you a registration fee, a training fee, a background-check fee, or an equipment deposit. There is a second, subtler scam specific to this field worth naming: fake "assessment" tasks designed to extract free labor, where you spend hours labeling or rating, then receive a generic rejection while the operator keeps your output. Legitimate qualification tasks are short, domain-specific, and lead to a clear approval-and-pay pathway; a multi-hour "test" with no defined outcome is a warning sign.
Beyond the money-flow rule, a handful of red flags should be hard stops. Learn them once and you avoid essentially all of the fraud in this space, because scammers reuse the same playbook. The following are the reliable tells, drawn from 2026 fraud reporting:
- Any upfront fee of any kind. Legitimate platforms are free to join.
- A check to deposit and partially forward. The classic overpayment scam; the check bounces and you owe the bank.
- Off-platform recruiting to WhatsApp or Telegram, especially with pressure to act today.
- Mismatched or typo domains (dataannotation.tech versus dataannotation-tech.com) and Gmail addresses posing as company recruiters.
- Guaranteed pay or volume. No legitimate platform guarantees your hourly rate, task count, or monthly earnings.
The safe pattern is always the same: you go directly to a known platform's website, apply, complete a short qualification task, and start receiving paid tasks after review, with no fee at any point. Stick to the established names and you sidestep the fraud entirely. But there is a legal, non-fraud pitfall that costs experts more money in aggregate than scams do: the effective-pay trap. On task-based platforms, advertised rates ignore the unpaid time you spend reading instructions, waiting for work, and redoing rejected tasks. Counting that unpaid time lowers the effective rate by 20 to 30 percent, per Breaking Even's analysis (updated 14 September 2026). This is why the premium hourly-contract platforms, where you are paid for time rather than approved tasks, tend to produce a better real rate for credentialed experts even when the headline number looks similar.
One professional-conduct pitfall deserves explicit mention. If you hold a license, check your employer's moonlighting policy and your professional conduct rules, and never input real patient or client confidential information into these platforms. Evaluating anonymized model outputs is generally fine; feeding a real case file or a real patient chart into a third-party training pipeline is not, and it can put your license at risk. Keep your confidential professional data out of it, full stop.
10. Taxes and payment logistics for 1099 experts
You will almost always be classified as an independent contractor (1099), not an employee, and that has concrete consequences you should plan for from day one. Most platforms pay weekly or per-project via PayPal, Stripe, or direct deposit after your work passes review, and payment timing is generally reliable on established platforms, though task-based platforms pay only for approved work, so rejected tasks are unpaid. The bigger issue is tax. As a 1099 contractor you pay both halves of Social Security and Medicare: 15.3% total (12.4 percent Social Security plus 2.9 percent Medicare) on your net earnings, on top of ordinary income tax, per the IRS (read 29 October 2026). No employer withholds anything for you, which is the part that surprises people at year-end.
Because nothing is withheld, you are expected to pay estimated taxes quarterly using Form 1040-ES to avoid an underpayment penalty, per the IRS gig-work guidance. The safe habit is to set aside part of everything you earn the moment it lands. On forms: a platform that pays you directly issues a 1099-NEC (for payments made in tax year 2026 the reporting threshold rose from $600 to $2,000, adjusted for inflation from 2027, per IRS Publication 1099, read 29 October 2026), and if you are paid through a processor like PayPal the payment is reported on a 1099-K (whose threshold, after the July 2025 "One Big Beautiful Bill," went back to more than $20,000 across more than 200 transactions, per the IRS's Form 1099-K page, read 29 October 2026). The rule that catches people: you must report all income even if you never receive a form. No 1099 does not mean no tax.
The upside of contractor status is deductions. You report income on Schedule C and can deduct genuine business expenses: a portion of your internet, a home office, hardware you buy for the work. Keep clean records from the first dollar, because the deductions are only as good as your documentation. The mental model to adopt is that you are running a small professional-services business, not moonlighting for wages, and the same discipline that makes you good at the actual work (precision, documentation, following the rules to the letter) is what keeps the tax side clean and the effective rate high.
11. How AI agents and 2026 model progress are changing this work
Here is the tension at the center of this field, stated honestly: you are helping train the models that will eventually automate parts of the work you do. The current window exists precisely because AI is not yet good enough at law, medicine, and finance to operate without expert oversight, and that is exactly why the pay is high now. But the models are improving, and it is worth reasoning carefully about what that improvement does to the work rather than assuming it simply ends it. The APEX data is the clearest signal available: on Mercor's APEX benchmark page, the best model scored 64.5 percent on HealthBench Professional (525 physician-authored clinical tasks) and 27.4 percent on Harvey's 1,749 real legal tasks (read 10 November 2026). The gap between exam performance and job performance is not closing evenly, and the places it resists closing are exactly where credentialed judgment is hardest to replace.
The direction of travel, though, is unmistakable and it favors credentialed experts in the near term. The whole industry is shifting from cheap, high-volume generalist labeling toward scarce, high-value expert feedback, because the labs have largely exhausted the easy data and now compete on quality in the domains that require licensed judgment. Two things are happening at once as AI agents mature. First, agents are absorbing the routine end of every profession, which raises the bar for what the models still get wrong and pushes the paid work toward harder, more adversarial, more specialized tasks. Second, the labs increasingly need experts not just to grade single answers but to build the environments and rubrics that train agents to act, which is higher-skill, higher-paid work than simple rating. The following shifts are already visible in how projects are structured:
- From rating to authoring. Simple thumbs-up rating is commoditizing; writing gold-standard answers and grading rubrics is where the durable, premium work is moving.
- From single answers to multi-step agents. Projects increasingly evaluate an agent's whole workflow (research, tool use, a multi-step legal or financial task) rather than one response.
- Toward harder edge cases. As models master the routine, paid attention concentrates on the ambiguous, high-stakes, jurisdiction-specific problems only a specialist can adjudicate.
The practical implication for your career in this work is to climb the value ladder deliberately rather than staying at the rating tier. The rating work will face the most price pressure as models improve, while the rubric-authoring, benchmark-building, and agent-evaluation work compounds in value because it requires exactly the judgment that resists automation. The market is expanding fast enough to absorb this shift for now: the broader labeling market grows 22.95 percent a year to 2031 per Mordor Intelligence (read 29 October 2026), the human-in-the-loop segment 24.9 percent a year to 2030 per Research and Markets (March 2026), and the broader expert-training service industry is pegged at $17 billion or more by the PitchBook estimate CNN cited on 17 February 2026. The honest long-run view is that this is a lucrative window rather than a permanent career, and the smart move is to earn well from it now while building toward the parts of the work that stay hard. This applies across adjacent tracks too, from coding and software evaluation to research studies and surveys, and you can compare where the durable pay sits on the pay comparison hub.
This is the topic Yuma Heymans (@yumahey), founder and CEO of AITraining.jobs and co-founder of the AI recruitment platform HeroHunt.ai, spends his time mapping: which credentialed specialties frontier labs are actually paying for in law, medicine, and finance, and how those rates and requirements shift as the models improve.
12. A decision framework
Should you do this work? Run yourself through five questions, in order, and the answer resolves cleanly. First, do you hold a verifiable credential (bar admission, medical license, CPA/CFA, or a relevant PhD or long senior experience)? If yes, the premium tier is genuinely open to you and the economics are strong; if no, the honest answer is that generalist annotation is your entry point and it pays a fraction as much, so weigh it accordingly. Second, can you externalize your reasoning in clean, structured writing? If you write good memos or clinical assessments, you have the core skill. Third, are you in a top-paying jurisdiction (US, or CA/UK/IE/AU/NZ), and is your sub-specialty scarce and commercially valuable? The rarer and more jurisdiction-specific your expertise, the higher and more durable your rate.
Fourth, are you treating this as high-value variable side income rather than a guaranteed salary? The people who thrive stack it on a primary practice and diversify across two or three platforms; the people who get burned treat one platform's project pipeline as a permanent income and get blindsided when it dries up (as thousands did when Mercor abruptly ended a lower-tier project paying $21 an hour and offered $16 on the next one, per Forbes on 12 November 2025). Fifth, are you positioned to climb from rating toward rubric-authoring and agent-evaluation, the work that stays hard as models improve?
If your answers are mostly yes, the move is concrete and low-risk: apply to Mercor, AfterQuery, and Braintrust (add DataAnnotation if eligible), treat the qualification task like an exam, keep your confidential professional data out of it, set aside part of every payment for taxes, and diversify. Browse live domain expert openings and compare the pay against every other kind of AI training work before you commit your hours, and lean toward the platforms and projects that pay for your time and your judgment rather than raw task volume. Done that way, you turn a license you already hold into a professional-rate income for as long as the models still need you to teach them, which, on the evidence, will be a while yet.
This guide's own words were last checked on 10 November 2026; the pay of the roles open on this site and the platforms' rate cards are read live each time the page loads. Pay bands, platform policies, tax thresholds, and the pace of model progress change quickly; verify current figures with each platform and a tax professional before making decisions. Nothing here is tax, legal, or financial advice.
Frequently asked questions
Do I have to leave my current job to do this?
No. Almost all of this work is remote, per-project, and scheduled around you. Many reviewers are actively practicing professionals who pick up batches in the evenings or during downtime. It is designed as flexible expert work, not a replacement for your primary role.
Which credentials are in the most demand?
Practicing physicians and specialists, attorneys with active bar admission, and finance credential holders (CPA, CFA, actuaries) are consistently sought. The narrower and more verifiable your specialty, the better, because generalist knowledge is easier to source than a board-certified subspecialist or a licensed practitioner in a specific jurisdiction.
Will my professional judgment actually be respected, or do I just click buttons?
Your reasoning is the product. The whole reason a company pays a premium for a licensed reviewer is to capture judgment a layperson cannot give. Expect to write real explanations, cite standards, and sometimes push back on a rubric when it conflicts with sound practice. The careful written justification is what they are buying.
Related kinds of work
Red-Teaming & AI Safety
Get paid to break AI models: find the unsafe, biased, or wrong answers before the public does.
AI Evaluation & Rating (RLHF)
Rate, rank, and compare AI answers so a model learns which response is better.
Research Studies & Surveys
Get paid to take part in surveys, experiments, and human-preference studies that feed AI research.