LLM-Symbolic Integration for Robust Temporal Tabular Reasoning

Temporal tabular question answering presents a significant challenge for Large Language Models (LLMs), requiring robust reasoning over structured data-a task where traditional prompting methods often fall short.These methods face challenges such as memorization, sensitivity to table size, and reduced performance on complex queries.To overcome these limitations, we introduce TEMPTABQA-C, a synthetic dataset designed for systematic and controlled evaluations, alongside a symbolic intermediate representation that transforms tables into database schemas.This structured approach allows LLMs to generate and execute SQL queries, enhancing generalization and mitigating biases.By incorporating adaptive fewshot prompting with contextually tailored examples, our method achieves superior robustness, scalability, and performance.Experimental results consistently highlight improvements across key challenges, setting a new benchmark for robust temporal reasoning with LLMs.Code and TEMPTABQA-C dataset: https:// coral-lab-asu.github.io/llm_symbolic.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1022
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM-Symbolic Integration for Robust Temporal Tabular Reasoning

Vivek Srikumar, Dan Roth, Atharv Kulkarni, Vivek Gupta et al.
Natural Language Processing Techniques
article

LLM-Symbolic Integration for Robust Temporal Tabular Reasoning

Vivek Srikumar, Dan Roth, Atharv Kulkarni, Vivek Gupta, Kushagra Dixit
article en

Abstract

Temporal tabular question answering presents a significant challenge for Large Language Models (LLMs), requiring robust reasoning over structured data-a task where traditional prompting methods often fall short.These methods face challenges such as memorization, sensitivity to table size, and reduced performance on complex queries.To overcome these limitations, we introduce TEMPTABQA-C, a synthetic dataset designed for systematic and controlled evaluations, alongside a symbolic intermediate representation that transforms tables into database schemas.This structured approach allows LLMs to generate and execute SQL queries, enhancing generalization and mitigating biases.By incorporating adaptive fewshot prompting with contextually tailored examples, our method achieves superior robustness, scalability, and performance.Experimental results consistently highlight improvements across key challenges, setting a new benchmark for robust temporal reasoning with LLMs.Code and TEMPTABQA-C dataset: https:// coral-lab-asu.github.io/llm_symbolic.

National Science Foundation, University of Pennsylvania, Arizona State University, Office of Naval Research, Army Research Office
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

LLM-Symbolic Integration for Robust Temporal Tabular Reasoning — Vivek Srikumar, Dan Roth, et al. · (2025) | TGRS Research Map | TGRS