A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars
In this paper, we propose a natural language interface visualization framework leveraging visualization grammar to balance the flexibility and stability of generated visualizations. Our system employs a JSON schema for visualization specification and an instruction prompt with semantically distinct sections for task context, visualizations, datasets, and control mechanisms. This design enables robust state management, live prompt adjustments, ensures clarity, consistency, and reusability in visualization generation.
Authors
- Tobias Schreck (ORCID: https://orcid.org/0000-0003-0778-8665)
- Adrian Jobst (ORCID: https://orcid.org/0009-0007-4894-451X)
- Willy Scheibel (ORCID: https://orcid.org/0000-0002-7885-9857)
- Daniel Atzberger
- Jürgen Döllner (ORCID: https://orcid.org/0000-0002-8981-8583)
- Mariia Tytarenko (ORCID: https://orcid.org/0009-0001-6925-272X)
Institutions
- Hasso Plattner Institute (DE)
- University of Potsdam (DE)
- Graz University of Technology (AT)
Publication Details
- Published
- 2025-05-08
- DOI
- https://doi.org/10.1145/3701716.3717812
- Citations
- 1
- Primary Topic
- Semantic Web and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- Austrian Science Fund