Legal · SOC 23-1023
Judges, Magistrate Judges, and Magistrates
Arbitrate, advise, adjudicate, or administer justice in a court of law. May sentence defendant in criminal cases according to government statutes or sentencing guidelines. May determine liability of defendant in civil cases. May perform wedding ceremonies.
Will AI replace this job?
The data cannot say, and anyone who gives you a percentage for “replaced” is guessing. What it does show is a gap between three things, for the 21 tasks O*NET lists for this occupation:
Could an LLM do it?
0%–5%
of tasks: an LLM alone could do the task or cut its time by half. Human raters say 5%, GPT-4 says 0%.
Counting tasks that need extra software around the model: 14%–81%.
Is it happening?
3 of 21 tasks
show measurable use in Claude conversations (Anthropic Economic Index). Anthropic’s occupation score, which counts only tasks that were also rated feasible, is 31%. Observed is a subset of “could” by construction.
Claude only, mostly US users, sampled periods in 2025. Not all AI use, and not employment.
What is left?
4 of 21 tasks
were rated “no LLM speed-up” by every rater (so, by Anthropic’s method, they cannot show up as observed use either). That is the part of the job these studies see no sign of AI touching.
It does not mean those tasks are safe. It means these methods found nothing there.
Task by task
Sorted with the tasks seen in use first. The three coloured squares are the three raters, in this order: human raters, GPT-4, GPT-4 with an alternative rubric. “Usage score” is Anthropic’s published task_penetration value; 0 means none seen.
| Task (O*NET 31.0) | Could an LLM? | Claude usage score |
|---|---|---|
| Read documents on pleadings and motions to ascertain facts and issues. | all raters | 1.00 |
| Research legal issues and write opinions on the issues. | all raters | 0.84 |
| Write decisions on cases. | 2 of 3 raters | 0.86 |
| Provide information regarding the judicial system or other legal issues through the media and public speeches. (supplemental) | all raters | none seen |
| Preside over hearings and listen to allegations made by plaintiffs to determine whether the evidence supports the charges. | 2 of 3 raters | none seen |
| Award compensation for damages to litigants in civil cases in relation to findings by juries or by the court. | 2 of 3 raters | none seen |
| Issue arrest warrants. | 2 of 3 raters | none seen |
| Settle disputes between opposing attorneys. | 2 of 3 raters | none seen |
| Conduct preliminary hearings to decide issues, such as whether there is reasonable and probable cause to hold defendants in felony cases. (supplemental) | 2 of 3 raters | none seen |
| Sentence defendants in criminal cases, on conviction by jury, according to applicable government statutes. | 1 of 3 raters | none seen |
| Monitor proceedings to ensure that all applicable rules and procedures are followed. | 1 of 3 raters | none seen |
| Rule on admissibility of evidence and methods of conducting testimony. | 1 of 3 raters | none seen |
| Advise attorneys, juries, litigants, and court personnel regarding conduct, issues, and proceedings. | 1 of 3 raters | none seen |
| Interpret and enforce rules of procedure or establish new rules in situations where there are no procedures already established by law. | 1 of 3 raters | none seen |
| Impose restrictions upon parties in civil cases until trials can be held. | 1 of 3 raters | none seen |
| Rule on custody and access disputes, and enforce court orders regarding custody and support of children. (supplemental) | 1 of 3 raters | none seen |
| Grant divorces and divide assets between spouses. (supplemental) | 1 of 3 raters | none seen |
| Instruct juries on applicable laws, direct juries to deduce the facts from the evidence presented, and hear their verdicts. | no rater | none seen |
| Supervise other judges, court officers, and the court's administrative staff. | no rater | none seen |
| Participate in judicial tribunals to help resolve disputes. (supplemental) | no rater | none seen |
| Perform wedding ceremonies. (supplemental) | no rater | none seen |
Try it with your own task list
Sources: task list from O*NET® Database (U.S. Department of Labor, CC BY 4.0; modified by noworkleft.com); “could” labels from Eloundou et al., GPTs are GPTs (OpenAI/University of Pennsylvania, MIT licence, labels from early-2023 models); “seen in use” from the Anthropic Economic Index (Claude usage only, CC BY). Dates, versions and limits.
Other jobs in Legal
- Administrative Law Judges, Adjudicators, and Hearing Officers (30% observed)
- Paralegals and Legal Assistants (29% observed)
- Arbitrators, Mediators, and Conciliators (24% observed)
- Judicial Law Clerks (17% observed)
- Lawyers (17% observed)
- Title Examiners, Abstractors, and Searchers (2% observed)
Data built 2026-11-06. O*NET 31.0. Task match rates: 99.4% with the OpenAI/Penn labels, 99.2% with Anthropic usage.