An interpretable logic KBQA method based on open-source large language models

Knowledge Base Question Answering (KBQA) aims to find correct answers to natural language questions by reasoning over large-scale knowledge bases.The main challenge is multi-hop reasoning, which requires inferring answers through multiple edges and nodes.Due to high data annotation costs, most datasets only provide final answer annotations, leaving the reasoning process unknown.The model cannot provide the reasoning path along with the answer, making the answer uninterpretable.To address this, we propose a generation-retrieval multi-hop KBQA method combining large language models (LLMs) and the logic programming language Prolog.In the generation phase, we fine-tune the open-source LLMs to generate the logical form of the corresponding prolog representation for the natural language question.In the retrieval phase, the model uses prolog query to reasoning over the KB to get the final answer and the reasoning path.A transparent reasoning path also helps identify and correct errors, enhancing the model's reliability and practicality.Experimental results on two standard KBQA datasets, MetaQA and WebQSP, demonstrate that our method outperforms existing models in both performance and interpretability.

Authors

Publication Details

Journal
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Published
2024-10-28
DOI
https://doi.org/10.18293/seke2024-138
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An interpretable logic KBQA method based on open-source large language models

Lin Fang, Yongchang Ding, Bicheng Xu, Rong Peng
Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering
Semantic Web and Ontologies
article

An interpretable logic KBQA method based on open-source large language models

Lin Fang, Yongchang Ding, Bicheng Xu, Rong Peng
article en

Abstract

Knowledge Base Question Answering (KBQA) aims to find correct answers to natural language questions by reasoning over large-scale knowledge bases.The main challenge is multi-hop reasoning, which requires inferring answers through multiple edges and nodes.Due to high data annotation costs, most datasets only provide final answer annotations, leaving the reasoning process unknown.The model cannot provide the reasoning path along with the answer, making the answer uninterpretable.To address this, we propose a generation-retrieval multi-hop KBQA method combining large language models (LLMs) and the logic programming language Prolog.In the generation phase, we fine-tune the open-source LLMs to generate the logical form of the corresponding prolog representation for the natural language question.In the retrieval phase, the model uses prolog query to reasoning over the KB to get the final answer and the reasoning path.A transparent reasoning path also helps identify and correct errors, enhancing the model's reliability and practicality.Experimental results on two standard KBQA datasets, MetaQA and WebQSP, demonstrate that our method outperforms existing models in both performance and interpretability.

Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge EngineeringVol. 2024
Openalex Percentile: Top 77%
Semantic Web and Ontologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.