Comparative analysis of LLM-based conversational agents as an assistive technology for web interaction

This study investigates whether LLM-based Conversational Agents (LLMCAs) could be employed as assistive technologies, helping anyone navigate a website by explaining its content and interactive features, and suggesting actions to accomplish specific goals. This would make the web more accessible especially to seniors, blind users and people with mild cognitive impairment. Specifically, the study examines whether such tools can analyze the source code of a webpage to identify its structure and interactive elements, understand which interactive components are required to support users in achieving their goals, and act effectively as assistive technologies. In addition, the work compares leading tools to assess differences in their effectiveness and behavior in supporting accessible web interaction. The work presents two empirical studies in which four popular LLMCA tools are evaluated on a set of public websites, in order to assess their ability to understand web page structures and interactive components and assist users in their tasks. The evaluation combines qualitative and quantitative measures, focusing on accuracy, completeness, and practical usefulness of the responses.Results show a good degree of pertinent and good-quality answers, even on websites with a poorly accessible structure. The user-friendly way to interact with a LLMCA makes it much comfortable to use for the average user. However, the study also highlights that some LLMCAs appear more 'skilled' in accessibility tasks than others. LLMCAs show promising potential not only to complement existing assistive technologies but also to support or replace the human assistance that is often required for many users to effectively access the web.

Authors

Institutions

Publication Details

Journal
Universal Access in the Information Society
Published
2026-11-18
DOI
https://doi.org/10.1007/s10209-026-01402-y
Primary Topic
Digital Accessibility for Disabilities
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Comparative analysis of LLM-based conversational agents as an assistive technology for web interaction

Giuseppe Della Penna, Marina Buzzi, Barbara Leporini
1 links
Universal Access in the Information Society
Digital Accessibility for Disabilities
article

Comparative analysis of LLM-based conversational agents as an assistive technology for web interaction

Giuseppe Della Penna, Marina Buzzi, Barbara Leporini
article en

Abstract

This study investigates whether LLM-based Conversational Agents (LLMCAs) could be employed as assistive technologies, helping anyone navigate a website by explaining its content and interactive features, and suggesting actions to accomplish specific goals. This would make the web more accessible especially to seniors, blind users and people with mild cognitive impairment. Specifically, the study examines whether such tools can analyze the source code of a webpage to identify its structure and interactive elements, understand which interactive components are required to support users in achieving their goals, and act effectively as assistive technologies. In addition, the work compares leading tools to assess differences in their effectiveness and behavior in supporting accessible web interaction. The work presents two empirical studies in which four popular LLMCA tools are evaluated on a set of public websites, in order to assess their ability to understand web page structures and interactive components and assist users in their tasks. The evaluation combines qualitative and quantitative measures, focusing on accuracy, completeness, and practical usefulness of the responses.Results show a good degree of pertinent and good-quality answers, even on websites with a poorly accessible structure. The user-friendly way to interact with a LLMCA makes it much comfortable to use for the average user. However, the study also highlights that some LLMCAs appear more 'skilled' in accessibility tasks than others. LLMCAs show promising potential not only to complement existing assistive technologies but also to support or replace the human assistance that is often required for many users to effectively access the web.

Universal Access in the Information SocietyVol. 26(1)
University of Pisa (IT), University of L'Aquila (IT), Institute of Informatics and Telematics (IT)
Digital Accessibility for Disabilities
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon