Improving Table Retrieval with Question Generation from Partial Tables

Recent advances in open-domain question answering over tables have widely adopted large language models (LLMs) under the Retriever-Reader architecture.Prior works have effectively leveraged LLMs to tackle the complex reasoning demands of the Reader component, such as text-to-text, text-to-SQL, and multi-hop reasoning.In contrast, the Retriever component has primarily focused on optimizing the query representation-training retrievers to retrieve relevant tables based on questions, or to select keywords from questions for matching table segments.However, little attention has been given to enhancing how tables themselves are represented in embedding space to better align with questions.To address this, we propose QGpT (Question Generation from Partial Tables), a simple yet effective method that uses an LLM to generate synthetic questions based on small portions of a table.These questions are generated to simulate how a user might query the content of the table currently under consideration.The generated questions are then jointly embedded with the partial table segments used for generation, enhancing semantic alignment with user queries.Without the need to embed entire tables, our method significantly improves retrieval performance across multiple benchmarks for both dense and late-interaction retrievers. 1

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.trl-1.19
Primary Topic
Data Quality and Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Table Retrieval with Question Generation from Partial Tables

Yao-Chung Fan, Che‐Wei Chang, Hongru Liang
Data Quality and Management
article

Improving Table Retrieval with Question Generation from Partial Tables

Yao-Chung Fan, Che‐Wei Chang, Hongru Liang
article en

Abstract

Recent advances in open-domain question answering over tables have widely adopted large language models (LLMs) under the Retriever-Reader architecture.Prior works have effectively leveraged LLMs to tackle the complex reasoning demands of the Reader component, such as text-to-text, text-to-SQL, and multi-hop reasoning.In contrast, the Retriever component has primarily focused on optimizing the query representation-training retrievers to retrieve relevant tables based on questions, or to select keywords from questions for matching table segments.However, little attention has been given to enhancing how tables themselves are represented in embedding space to better align with questions.To address this, we propose QGpT (Question Generation from Partial Tables), a simple yet effective method that uses an LLM to generate synthetic questions based on small portions of a table.These questions are generated to simulate how a user might query the content of the table currently under consideration.The generated questions are then jointly embedded with the partial table segments used for generation, enhancing semantic alignment with user queries.Without the need to embed entire tables, our method significantly improves retrieval performance across multiple benchmarks for both dense and late-interaction retrievers. 1

National Chung Hsing University (TW), National Taipei University (TW)
National Science and Technology Council
Openalex Percentile: Top 77%
Data Quality and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.