Counterfactual Neuro-Symbolic Proof-Carrying Memory for Auditable Multi-Hop Reasoning on Unstructured Data

Knowledge-intensive language understanding suffers a structural reliability bottleneck: fluent answers can be produced without logically sufficient support, especially in multi-hop question answering and dynamic knowledge graphs where edge drift degrades retrieval. We introduce Counterfactual Neuro-Symbolic Proof-Carrying Memory (CNS-PCM), a backbone-agnostic neuro-symbolic harness that decouples frozen neural representations from inspectable symbolic verification checks. Candidate reasoning chains are discovered via ontology-constrained beam search (Γ) and compiled into a compact proof-carrying memory carrying crisp domain validity flags (κk), NLI-derived contradiction scores (ρk), and textual support confidences (αk). At inference time, a counterfactual verifier stress-tests prediction stability across a targeted pool of J=12 graph interventions sampled via betweenness centrality, requiring O(J·K·d) localized re-scoring operations over the K≤16 retained proofs (or O(J·d) at fixed memory capacity K, where empirical proof depth satisfies d≤3 for >94% of retained paths under a search ceiling mmax=6, bounding verifier latency overhead to ≈45 ms per query), and abstains when evidence is unstable. Rather than invasive early token fusion or prompt linearization, CNS-PCM externalizes verification into an inspectable audit record while training lightweight adapter heads using task, logical-consistency, intervention-invariance, and differentiable Brier calibration objectives. Evaluated on official public splits of HoVer, HotpotQA, and FEVEROUS with headline F1 scoring ABSTAIN as incorrect, CNS-PCM achieves test F1 scores of 80.6%, 75.2%, and 79.0%, outperforming LLaMA-2-7B + CoT (72.4%/67.1%/70.2%), GraphRAG (78.5%/73.8%/77.4%), and unthresholded Logic-LM (79.1%/74.1%/77.9%). Specifically, CNS-PCM reduces total gold-unsupported accepted assertions on the validation splits by up to 2.4 percentage points (lowering total unsupported rate from 16.4% to 14.7%, and correct-but-ungrounded assertions from 6.8% to 5.3%) and reduces Expected Calibration Error (ECE) to 6.5%, maintaining 95.2% final test coverage via a bounded re-try feedback loop (R¯=0.471 re-tries). Component ablations confirm that training invariance and inference gating provide complementary gains, while sensitivity analyses identify Stage-2 entity linking as the primary reliability lever.

Authors

Institutions

Publication Details

Journal
Technologies
Published
2026-11-08
DOI
https://doi.org/10.3390/technologies14110736
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Counterfactual Neuro-Symbolic Proof-Carrying Memory for Auditable Multi-Hop Reasoning on Unstructured Data

M. Mahjoub, Abdelweheb Gueddes, Mourad Mars, Mohammed J. AlGhamdi et al.
Technologies
Topic Modeling
article

Counterfactual Neuro-Symbolic Proof-Carrying Memory for Auditable Multi-Hop Reasoning on Unstructured Data

M. Mahjoub, Abdelweheb Gueddes, Mourad Mars, Mohammed J. AlGhamdi, Hédi Sakli, Wyssem Fathallah
article en

Abstract

Knowledge-intensive language understanding suffers a structural reliability bottleneck: fluent answers can be produced without logically sufficient support, especially in multi-hop question answering and dynamic knowledge graphs where edge drift degrades retrieval. We introduce Counterfactual Neuro-Symbolic Proof-Carrying Memory (CNS-PCM), a backbone-agnostic neuro-symbolic harness that decouples frozen neural representations from inspectable symbolic verification checks. Candidate reasoning chains are discovered via ontology-constrained beam search (Γ) and compiled into a compact proof-carrying memory carrying crisp domain validity flags (κk), NLI-derived contradiction scores (ρk), and textual support confidences (αk). At inference time, a counterfactual verifier stress-tests prediction stability across a targeted pool of J=12 graph interventions sampled via betweenness centrality, requiring O(J·K·d) localized re-scoring operations over the K≤16 retained proofs (or O(J·d) at fixed memory capacity K, where empirical proof depth satisfies d≤3 for >94% of retained paths under a search ceiling mmax=6, bounding verifier latency overhead to ≈45 ms per query), and abstains when evidence is unstable. Rather than invasive early token fusion or prompt linearization, CNS-PCM externalizes verification into an inspectable audit record while training lightweight adapter heads using task, logical-consistency, intervention-invariance, and differentiable Brier calibration objectives. Evaluated on official public splits of HoVer, HotpotQA, and FEVEROUS with headline F1 scoring ABSTAIN as incorrect, CNS-PCM achieves test F1 scores of 80.6%, 75.2%, and 79.0%, outperforming LLaMA-2-7B + CoT (72.4%/67.1%/70.2%), GraphRAG (78.5%/73.8%/77.4%), and unthresholded Logic-LM (79.1%/74.1%/77.9%). Specifically, CNS-PCM reduces total gold-unsupported accepted assertions on the validation splits by up to 2.4 percentage points (lowering total unsupported rate from 16.4% to 14.7%, and correct-but-ungrounded assertions from 6.8% to 5.3%) and reduces Expected Calibration Error (ECE) to 6.5%, maintaining 95.2% final test coverage via a bounded re-try feedback loop (R¯=0.471 re-tries). Component ablations confirm that training invariance and inference gating provide complementary gains, while sensitivity analyses identify Stage-2 entity linking as the primary reliability lever.

TechnologiesVol. 14(11)
Prince Mohammad bin Fahd University (SA), Umm al-Qura University (SA), National Engineering School of Tunis (TN), Institut Supérieur d'Informatique et des Technologies de Communication de Hammam Sousse (TN), Tunis El Manar University (TN), University of Sousse (TN)
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon