Verifying Reasoning Chains Generated by Large Language Models: A Survey

Large Language Models (LLMs) are extensively used for many Natural Language Processing tasks such as question answering, natural language inference, document summarization, etc. Chain-of-Thought (CoT) prompting compels LLMs to generate step-by-step reasoning chains. While some of the reasoning chains may follow a correct thought process, they can also suffer from hallucinations, leading to errors in answer generation. Recently, many articles have targeted the problem of verifying these reasoning chains from various aspects. Despite this recent attention, to the best of our knowledge, no comprehensive survey currently summarizes these studies on reasoning chain verification. This work addresses that gap by presenting a detailed overview of the methods for verifying reasoning chains and categorizing them according to their methodology. This paper introduces a novel taxonomy of existing reasoning chain verification methods and mainly divides them into approaches that assess entire chains versus those that examine individual steps. This paper also reviews benchmarks for evaluating reasoning chains and verification methods and further discusses the challenges and future directions associated with these methods. By compiling and analyzing these approaches, our survey aims to advance the understanding and development of robust reasoning techniques in LLMs.

Authors

Institutions

Publication Details

Journal
ACM Computing Surveys
Published
2026-11-13
DOI
https://doi.org/10.1145/3862627
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Verifying Reasoning Chains Generated by Large Language Models: A Survey

Mehwish Alam, Bérénice Jaulmes, Mariam Barry, Jean-Christophe Arouete
2 links
ACM Computing Surveys
Topic Modeling
article

Verifying Reasoning Chains Generated by Large Language Models: A Survey

Mehwish Alam, Bérénice Jaulmes, Mariam Barry, Jean-Christophe Arouete
article en

Abstract

Large Language Models (LLMs) are extensively used for many Natural Language Processing tasks such as question answering, natural language inference, document summarization, etc. Chain-of-Thought (CoT) prompting compels LLMs to generate step-by-step reasoning chains. While some of the reasoning chains may follow a correct thought process, they can also suffer from hallucinations, leading to errors in answer generation. Recently, many articles have targeted the problem of verifying these reasoning chains from various aspects. Despite this recent attention, to the best of our knowledge, no comprehensive survey currently summarizes these studies on reasoning chain verification. This work addresses that gap by presenting a detailed overview of the methods for verifying reasoning chains and categorizing them according to their methodology. This paper introduces a novel taxonomy of existing reasoning chain verification methods and mainly divides them into approaches that assess entire chains versus those that examine individual steps. This paper also reviews benchmarks for evaluating reasoning chains and verification methods and further discusses the challenges and future directions associated with these methods. By compiling and analyzing these approaches, our survey aims to advance the understanding and development of robust reasoning techniques in LLMs.

ACM Computing Surveys
Institut Polytechnique de Paris (FR), BNP Paribas (France) (FR)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon