How Do GenAI Chatbots Communicate Fluoride Information? A Readability and Negative Framing Analysis

INTRODUCTION: As generative artificial intelligence (GenAI) chatbots increasingly mediate online health information seeking, this study aimed to assess the readability of chatbot-generated responses and characterize negatively framed content by estimating its prevalence and identifying its thematic patterns across different communicative scenarios and prompt formats. METHODS: This cross-sectional infodemiological study evaluated fluoride-related responses generated by 5 freely accessible GenAI chatbots. To support this assessment, prompts were developed to simulate 3 communicative scenarios through which users may request or evaluate fluoride-related information: fact-checking, opinion, and explanation. Each prompt was formulated in both organic and structured versions, representing simple user-like questions and formulations expanded using prompt-engineering principles. Responses were segmented into sentences, which were independently classified by 2 trained and calibrated evaluators as positively/neutrally or negatively framed with respect to fluoride use for dental caries prevention. Readability was assessed using distinct indices, and topic modeling was performed to characterize thematic patterns. RESULTS: A total of 1,326 sentences were analyzed, of which 1,040 were classified as positively/neutrally framed and 286 as negatively framed. The prevalence of negatively framed sentences did not differ significantly across chatbots or prompt formats. However, it varied according to the communicative scenario, with fact-checking prompts generating a higher prevalence of negatively framed content than opinion and explanation prompts. Topic modeling showed that negatively framed sentences were primarily organized around risk-oriented themes, including dental fluorosis, excessive fluoride exposure in children, toxicity, potential neurodevelopmental concerns, and skeletal fluorosis. Although structured prompts improved readability across most grade-level indices, chatbot-generated responses generally remained within difficult readability levels. CONCLUSION: GenAI chatbots have the potential to support communication about fluoride use; however, the frequent emphasis on fluoride-related risks in fact-checking responses and the generally difficult readability of the generated texts may hinder lay audiences' interpretation of evidence-based recommendations.Knowledge Transfer Statement:Although generative artificial intelligence (GenAI) chatbots can provide adequate fluoride-related information, the presence of unfavorable content and high readability demands limit their practical usefulness. Because patients use these tools for health queries, clinicians must proactively address AI-driven misconceptions during consultations. Additionally, public health policymakers should advocate for digital oversight to ensure AI platforms deliver accurate, unbiased, and broadly accessible information regarding dental caries prevention.

Authors

Institutions

Publication Details

Journal
JDR Clinical & Translational Research
Published
2026-09-04
DOI
https://doi.org/10.1177/23800844261478633
Primary Topic
Health Literacy and Information Accessibility
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Do GenAI Chatbots Communicate Fluoride Information? A Readability and Negative Framing Analysis

Olívia Santana Jorge, Thiago Cruvinel, Matheus Lotto, B. Nogueira et al.
JDR Clinical & Translational Research
Health Literacy and Information Accessibility
article

How Do GenAI Chatbots Communicate Fluoride Information? A Readability and Negative Framing Analysis

Olívia Santana Jorge, Thiago Cruvinel, Matheus Lotto, B. Nogueira, I.F. Baptista
article en

Abstract

INTRODUCTION: As generative artificial intelligence (GenAI) chatbots increasingly mediate online health information seeking, this study aimed to assess the readability of chatbot-generated responses and characterize negatively framed content by estimating its prevalence and identifying its thematic patterns across different communicative scenarios and prompt formats. METHODS: This cross-sectional infodemiological study evaluated fluoride-related responses generated by 5 freely accessible GenAI chatbots. To support this assessment, prompts were developed to simulate 3 communicative scenarios through which users may request or evaluate fluoride-related information: fact-checking, opinion, and explanation. Each prompt was formulated in both organic and structured versions, representing simple user-like questions and formulations expanded using prompt-engineering principles. Responses were segmented into sentences, which were independently classified by 2 trained and calibrated evaluators as positively/neutrally or negatively framed with respect to fluoride use for dental caries prevention. Readability was assessed using distinct indices, and topic modeling was performed to characterize thematic patterns. RESULTS: A total of 1,326 sentences were analyzed, of which 1,040 were classified as positively/neutrally framed and 286 as negatively framed. The prevalence of negatively framed sentences did not differ significantly across chatbots or prompt formats. However, it varied according to the communicative scenario, with fact-checking prompts generating a higher prevalence of negatively framed content than opinion and explanation prompts. Topic modeling showed that negatively framed sentences were primarily organized around risk-oriented themes, including dental fluorosis, excessive fluoride exposure in children, toxicity, potential neurodevelopmental concerns, and skeletal fluorosis. Although structured prompts improved readability across most grade-level indices, chatbot-generated responses generally remained within difficult readability levels. CONCLUSION: GenAI chatbots have the potential to support communication about fluoride use; however, the frequent emphasis on fluoride-related risks in fact-checking responses and the generally difficult readability of the generated texts may hinder lay audiences' interpretation of evidence-based recommendations.Knowledge Transfer Statement:Although generative artificial intelligence (GenAI) chatbots can provide adequate fluoride-related information, the presence of unfavorable content and high readability demands limit their practical usefulness. Because patients use these tools for health queries, clinicians must proactively address AI-driven misconceptions during consultations. Additionally, public health policymakers should advocate for digital oversight to ensure AI platforms deliver accurate, unbiased, and broadly accessible information regarding dental caries prevention.

JDR Clinical & Translational Research
Universidade de São Paulo (BR)
Fundação de Amparo à Pesquisa do Estado de São Paulo
Quality Education
Openalex Percentile: Top 6%
Health Literacy and Information Accessibility
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.