A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars

In this paper, we propose a natural language interface visualization framework leveraging visualization grammar to balance the flexibility and stability of generated visualizations. Our system employs a JSON schema for visualization specification and an instruction prompt with semantically distinct sections for task context, visualizations, datasets, and control mechanisms. This design enables robust state management, live prompt adjustments, ensures clarity, consistency, and reusability in visualization generation.

Authors

Institutions

Publication Details

Published
2025-05-08
DOI
https://doi.org/10.1145/3701716.3717812
Citations
1
Primary Topic
Semantic Web and Ontologies
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars

Tobias Schreck, Adrian Jobst, Willy Scheibel, Daniel Atzberger et al.
1 citations
Semantic Web and Ontologies
2.48
article

A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars

Tobias Schreck, Adrian Jobst, Willy Scheibel, Daniel Atzberger, Jürgen Döllner, Mariia Tytarenko
article en
1 citations

Abstract

In this paper, we propose a natural language interface visualization framework leveraging visualization grammar to balance the flexibility and stability of generated visualizations. Our system employs a JSON schema for visualization specification and an instruction prompt with semantically distinct sections for task context, visualizations, datasets, and control mechanisms. This design enables robust state management, live prompt adjustments, ensures clarity, consistency, and reusability in visualization generation.

Hasso Plattner Institute (DE), University of Potsdam (DE), Graz University of Technology (AT)
Austrian Science Fund
Quality Education
Openalex Percentile: Top 10%
Semantic Web and Ontologies
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars — Tobias Schreck, Adrian Jobst, et al. · (2025) | TGRS Research Map | TGRS