Toward explainable traffic crash liability analysis via neural-symbolic multimodal reasoning: Integrating visual perception with legal knowledge graphs

Determining traffic crash liability relies on rigorous on-site evidence and legal provisions and involves substantial manual intervention and potential human error. However, intelligent traffic monitoring systems focus on detection and tracking and cannot provide structured, rule-grounded decision support for formal crash-liability analysis. Moreover, emerging multimodal large language models (MLLMs) suffer from object hallucination that distorts or omits physical evidence, and their opaque reasoning cannot produce explicit evidence-to-rule chains required for traceable and reviewable liability analysis. This paper proposes CrashLex, an explainable neural-symbolic decision-support framework that integrates visual perception with legal knowledge graph reasoning to align multimodal inference with predefined statutory rules and traceability requirements. Within CrashLex, a dual-query vision-language architecture employs parallel semantic and symbolic streams to mitigate object hallucination, utilizing Scene Queries for global context modeling and Perception Queries for fine-grained atomic feature extraction, respectively. The domain-specific legal knowledge graph maps these atomic facts from observable physical conditions to corresponding statutory elements, providing a structured basis for rule-grounded assessment. A logic-driven aggregation protocol then imposes explicit constraints derived from extracted facts and statutory provisions onto the inference process, thereby enabling traceable and interpretable preliminary liability assessment. On the held-out DeepAccident benchmark, CrashLex achieves a Legal Accuracy of 94.0% under the fixed legal-output evaluation protocol and an Object Hallucination Rate of 2.8%, corresponding to an 82.1% relative reduction from the 15.6% rate of the best-performing MLLM baseline on this metric. CrashLex grounds its assessment results in the deterministic execution of predefined legal rules rather than relying solely on unconstrained probabilistic generation, providing verifiable reasoning chains for rule-grounded human review.

Authors

Institutions

Publication Details

Journal
Accident Analysis & Prevention
Published
2026-10-14
DOI
https://doi.org/10.1016/j.aap.2026.108813
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Toward explainable traffic crash liability analysis via neural-symbolic multimodal reasoning: Integrating visual perception with legal knowledge graphs

谢远昌, Jialun Yin, Jingyun Xu, Yuzhi Chen et al.
Accident Analysis & Prevention
Explainable Artificial Intelligence (XAI)
article

Toward explainable traffic crash liability analysis via neural-symbolic multimodal reasoning: Integrating visual perception with legal knowledge graphs

谢远昌, Jialun Yin, Jingyun Xu, Yuzhi Chen, Xinyu Zhang, Xiaoxi Hu, Chen Wang
article en

Abstract

Determining traffic crash liability relies on rigorous on-site evidence and legal provisions and involves substantial manual intervention and potential human error. However, intelligent traffic monitoring systems focus on detection and tracking and cannot provide structured, rule-grounded decision support for formal crash-liability analysis. Moreover, emerging multimodal large language models (MLLMs) suffer from object hallucination that distorts or omits physical evidence, and their opaque reasoning cannot produce explicit evidence-to-rule chains required for traceable and reviewable liability analysis. This paper proposes CrashLex, an explainable neural-symbolic decision-support framework that integrates visual perception with legal knowledge graph reasoning to align multimodal inference with predefined statutory rules and traceability requirements. Within CrashLex, a dual-query vision-language architecture employs parallel semantic and symbolic streams to mitigate object hallucination, utilizing Scene Queries for global context modeling and Perception Queries for fine-grained atomic feature extraction, respectively. The domain-specific legal knowledge graph maps these atomic facts from observable physical conditions to corresponding statutory elements, providing a structured basis for rule-grounded assessment. A logic-driven aggregation protocol then imposes explicit constraints derived from extracted facts and statutory provisions onto the inference process, thereby enabling traceable and interpretable preliminary liability assessment. On the held-out DeepAccident benchmark, CrashLex achieves a Legal Accuracy of 94.0% under the fixed legal-output evaluation protocol and an Object Hallucination Rate of 2.8%, corresponding to an 82.1% relative reduction from the 15.6% rate of the best-performing MLLM baseline on this metric. CrashLex grounds its assessment results in the deterministic execution of predefined legal rules rather than relying solely on unconstrained probabilistic generation, providing verifiable reasoning chains for rule-grounded human review.

Accident Analysis & PreventionVol. 239
University of Massachusetts Lowell (US), Southeast University (BD), Southeast University (CN), Tsinghua University (CN)
Outstanding Youth Foundation of Jiangsu Province of China
Peace, justice, and strong institutions
Openalex Percentile: Top 13%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.