noworkleft.com

Home › Jobs › Judges, Magistrate Judges, and Magistrates

Legal · SOC 23-1023

Judges, Magistrate Judges, and Magistrates

Arbitrate, advise, adjudicate, or administer justice in a court of law. May sentence defendant in criminal cases according to government statutes or sentencing guidelines. May determine liability of defendant in civil cases. May perform wedding ceremonies.

Will AI replace this job?

The data cannot say, and anyone who gives you a percentage for “replaced” is guessing. What it does show is a gap between three things, for the 21 tasks O*NET lists for this occupation:

Could an LLM do it?

0%–5%

of tasks: an LLM alone could do the task or cut its time by half. Human raters say 5%, GPT-4 says 0%.

Counting tasks that need extra software around the model: 14%–81%.

Is it happening?

3 of 21 tasks

show measurable use in Claude conversations (Anthropic Economic Index). Anthropic’s occupation score, which counts only tasks that were also rated feasible, is 31%. Observed is a subset of “could” by construction.

Claude only, mostly US users, sampled periods in 2025. Not all AI use, and not employment.

What is left?

4 of 21 tasks

were rated “no LLM speed-up” by every rater (so, by Anthropic’s method, they cannot show up as observed use either). That is the part of the job these studies see no sign of AI touching.

It does not mean those tasks are safe. It means these methods found nothing there.

Task by task

Sorted with the tasks seen in use first. The three coloured squares are the three raters, in this order: human raters, GPT-4, GPT-4 with an alternative rubric. “Usage score” is Anthropic’s published task_penetration value; 0 means none seen.

LLM aloneneeds extra softwareno speed-up
Task (O*NET 31.0)Could an LLM?Claude usage score
Read documents on pleadings and motions to ascertain facts and issues. all raters 1.00
Research legal issues and write opinions on the issues. all raters 0.84
Write decisions on cases. 2 of 3 raters 0.86
Provide information regarding the judicial system or other legal issues through the media and public speeches. (supplemental) all raters none seen
Preside over hearings and listen to allegations made by plaintiffs to determine whether the evidence supports the charges. 2 of 3 raters none seen
Award compensation for damages to litigants in civil cases in relation to findings by juries or by the court. 2 of 3 raters none seen
Issue arrest warrants. 2 of 3 raters none seen
Settle disputes between opposing attorneys. 2 of 3 raters none seen
Conduct preliminary hearings to decide issues, such as whether there is reasonable and probable cause to hold defendants in felony cases. (supplemental) 2 of 3 raters none seen
Sentence defendants in criminal cases, on conviction by jury, according to applicable government statutes. 1 of 3 raters none seen
Monitor proceedings to ensure that all applicable rules and procedures are followed. 1 of 3 raters none seen
Rule on admissibility of evidence and methods of conducting testimony. 1 of 3 raters none seen
Advise attorneys, juries, litigants, and court personnel regarding conduct, issues, and proceedings. 1 of 3 raters none seen
Interpret and enforce rules of procedure or establish new rules in situations where there are no procedures already established by law. 1 of 3 raters none seen
Impose restrictions upon parties in civil cases until trials can be held. 1 of 3 raters none seen
Rule on custody and access disputes, and enforce court orders regarding custody and support of children. (supplemental) 1 of 3 raters none seen
Grant divorces and divide assets between spouses. (supplemental) 1 of 3 raters none seen
Instruct juries on applicable laws, direct juries to deduce the facts from the evidence presented, and hear their verdicts. no rater none seen
Supervise other judges, court officers, and the court's administrative staff. no rater none seen
Participate in judicial tribunals to help resolve disputes. (supplemental) no rater none seen
Perform wedding ceremonies. (supplemental) no rater none seen
How to read this. These are averages over task lists written for the US labour market, rated by people and by GPT-4 using early-2023 model capabilities, next to a count of what one company’s chatbot users actually ask for. A task being “exposed” says nothing about whether employers will cut jobs, shift work, or hire more of you. See how to read an exposure score.

Try it with your own task list

Sources: task list from O*NET® Database (U.S. Department of Labor, CC BY 4.0; modified by noworkleft.com); “could” labels from Eloundou et al., GPTs are GPTs (OpenAI/University of Pennsylvania, MIT licence, labels from early-2023 models); “seen in use” from the Anthropic Economic Index (Claude usage only, CC BY). Dates, versions and limits.

Other jobs in Legal

Data built 2026-11-06. O*NET 31.0. Task match rates: 99.4% with the OpenAI/Penn labels, 99.2% with Anthropic usage.