Beyond accuracy: How humans evaluate legally correct but socially controversial legal advice from machines.

AI systems are increasingly used to provide legal advice, raising questions about whether laypeople accept guidance from algorithms-especially when that advice is legally correct but socially controversial.We report a preregistered survey experiment with 3,348 adults in mainland China examining how people evaluate identical legal advice when it is attributed either to an AI system or to a human lawyer and when it is accompanied by reasoning or not.Contrary to expectations of algorithm aversion, attribution to an AI system has no net effect on perceived reasonableness.However, mediation analyses reveal opposing psychological pathways underlying this null result.AI-attributed advice is perceived as more objective, which increases perceived reasonableness, but also as less comprehensive and less attentive to special circumstances, which decreases perceived reasonableness.By contrast, providing legal reasoning substantially increases perceived reasonableness regardless of source, largely by enhancing perceptions of objectivity.Qualitative responses corroborate this tension between objectivity and contextual sensitivity in evaluations of legal advice.Together, these findings suggest that public responses to AI legal advisors are shaped not by rigid attitudes toward automation but by the balancing of competing normative expectations.The results have implications for theories of algorithm aversion and the design of AI recommendation systems in normatively salient domains.

Authors

Institutions

Publication Details

Journal
Technology Mind and Behavior
Published
2026-10-15
DOI
https://doi.org/10.1037/tmb0000213
Primary Topic
Artificial Intelligence in Law
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond accuracy: How humans evaluate legally correct but socially controversial legal advice from machines.

Benjamin Minhao Chen, Zhiyu Li
Technology Mind and Behavior
Artificial Intelligence in Law
article

Beyond accuracy: How humans evaluate legally correct but socially controversial legal advice from machines.

Benjamin Minhao Chen, Zhiyu Li
article en

Abstract

AI systems are increasingly used to provide legal advice, raising questions about whether laypeople accept guidance from algorithms-especially when that advice is legally correct but socially controversial.We report a preregistered survey experiment with 3,348 adults in mainland China examining how people evaluate identical legal advice when it is attributed either to an AI system or to a human lawyer and when it is accompanied by reasoning or not.Contrary to expectations of algorithm aversion, attribution to an AI system has no net effect on perceived reasonableness.However, mediation analyses reveal opposing psychological pathways underlying this null result.AI-attributed advice is perceived as more objective, which increases perceived reasonableness, but also as less comprehensive and less attentive to special circumstances, which decreases perceived reasonableness.By contrast, providing legal reasoning substantially increases perceived reasonableness regardless of source, largely by enhancing perceptions of objectivity.Qualitative responses corroborate this tension between objectivity and contextual sensitivity in evaluations of legal advice.Together, these findings suggest that public responses to AI legal advisors are shaped not by rigid attitudes toward automation but by the balancing of competing normative expectations.The results have implications for theories of algorithm aversion and the design of AI recommendation systems in normatively salient domains.

Technology Mind and Behavior
Durham University (GB), University of Hong Kong (HK)
Impact Fund
Peace, justice, and strong institutions
Openalex Percentile: Top 49%
Artificial Intelligence in Law
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.