Optimizing text-to-SQL conversion techniques through the integration of intelligent agents and large language models

In many organizations, retrieving valuable information from complex databases has traditionally required specialized technical skills, often leaving non-technical professionals dependent on others for timely insights. This study presents an approach that allows anyone, even without knowledge of query languages, to directly interact with databases by asking questions in everyday language. We achieve this by combining advanced generative language models, such as a high-capacity Generative Pre-trained Transformer (GPT) model, with intelligent software agents that translate natural language queries into precise SQL statements. Our evaluation compares different strategies, including models specifically trained on a particular database domain versus those guided by only a handful of examples. The results show that training a model with tailored examples yields more accurate and reliable database queries than relying solely on minimal guidance for the given use case. This work highlights the practical value of refining model complexity and balancing computational costs to empower business users with easy, direct access to data. By reducing reliance on technical teams, organizations can enable faster, more informed decision-making and foster a more inclusive environment where everyone can uncover data-driven insights on their own. • Large language models (LLMs) can enhance real-time business analytics. • We integrate LLMs and intelligent agents for text-to-SQL conversion optimization. • Results show that GPT-4 and Llama-3.3-70B-Instruct-Turbo demonstrate superior syntax and semantic understanding. • Model fine-tuning outperforms few-shot learning for domain-specific SQL generation. • Balance between model sophistication, cost, and enterprise usability is crucial.

Authors

Institutions

Publication Details

Journal
Information Processing & Management
Published
2025-04-27
DOI
https://doi.org/10.1016/j.ipm.2025.104136
Citations
10
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
24.81

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optimizing text-to-SQL conversion techniques through the integration of intelligent agents and large language models

The Anh Han, Raymond Chiong, Alessandro Di Stefano, Samuel Ojuri
10 citations
Information Processing & Management
Topic Modeling
24.81
article

Optimizing text-to-SQL conversion techniques through the integration of intelligent agents and large language models

The Anh Han, Raymond Chiong, Alessandro Di Stefano, Samuel Ojuri
article en
10 citations

Abstract

In many organizations, retrieving valuable information from complex databases has traditionally required specialized technical skills, often leaving non-technical professionals dependent on others for timely insights. This study presents an approach that allows anyone, even without knowledge of query languages, to directly interact with databases by asking questions in everyday language. We achieve this by combining advanced generative language models, such as a high-capacity Generative Pre-trained Transformer (GPT) model, with intelligent software agents that translate natural language queries into precise SQL statements. Our evaluation compares different strategies, including models specifically trained on a particular database domain versus those guided by only a handful of examples. The results show that training a model with tailored examples yields more accurate and reliable database queries than relying solely on minimal guidance for the given use case. This work highlights the practical value of refining model complexity and balancing computational costs to empower business users with easy, direct access to data. By reducing reliance on technical teams, organizations can enable faster, more informed decision-making and foster a more inclusive environment where everyone can uncover data-driven insights on their own. • Large language models (LLMs) can enhance real-time business analytics. • We integrate LLMs and intelligent agents for text-to-SQL conversion optimization. • Results show that GPT-4 and Llama-3.3-70B-Instruct-Turbo demonstrate superior syntax and semantic understanding. • Model fine-tuning outperforms few-shot learning for domain-specific SQL generation. • Balance between model sophistication, cost, and enterprise usability is crucial.

Information Processing & ManagementVol. 62(5)
New South Wales Institute of Psychiatry (AU), University of Newcastle Australia (AU), Teesside University (GB)
Engineering and Physical Sciences Research Council
Openalex Percentile: Top 1%
Topic Modeling
24.81
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.