MatplotAlt: A Python Library for Adding Alt Text to Matplotlib Figures in Computational Notebooks
We present MatplotAlt, an open-source Python package for easily adding alternative text to Matplotlib figures. MatplotAlt equips Jupyter notebook authors to automatically generate and surface chart descriptions with a single line of code or command, and supports a range of options that allow users to customize the generation and display of captions based on their preferences and accessibility needs. Our evaluation indicates that MatplotAlt's heuristic and LLM-based methods to generate alt text can create accurate long-form descriptions of both simple univariate and complex Matplotlib figures. We find that state-of-the-art LLMs still struggle with factual errors when describing charts, and improve the accuracy of our descriptions by prompting GPT4-turbo with heuristic-based alt text or data tables parsed from the Matplotlib figure.
Authors
- Venkatesh Potluri (ORCID: https://orcid.org/0000-0002-5027-8831)
- Jennifer Mankoff (ORCID: https://orcid.org/0000-0001-9235-5324)
- Kai Nylund (ORCID: https://orcid.org/0009-0006-3956-7890)
Institutions
- University of Washington (US)
- University of Michigan (US)
Publication Details
- Journal
- Computer Graphics Forum
- Published
- 2025-05-23
- DOI
- https://doi.org/10.1111/cgf.70119
- Citations
- 6
- Primary Topic
- Software Engineering Research
- Type
- article
- Field-Weighted Citation Impact
- 19.48
Funders
- U.S. Department of Health and Human Services
- Microsoft
- University of Washington
- Australian Government
- Administration for Community Living
- National Institute on Disability, Independent Living, and Rehabilitation Research