<scp>LLM</scp> ‐Supported Content Analysis of Motivated Reasoning on Climate Change

ABSTRACT Public discourse around climate change remains polarized despite scientific consensus on anthropogenic climate change (ACC). This study examines how “believers” and “skeptics” of ACC differ in their YouTube comment discourse. We analyzed 44,989 comments from 30 videos using a large language model (LLM) as a qualitative annotator, identifying ten distinct topics. These annotations were combined with social network analysis to examine engagement patterns. A linear mixed‐effects model showed that comments about government policy and natural cycles generated significantly lower interaction compared to misinformation, suggesting these topics are ideologically settled points within communities. These patterns reflect motivated reasoning, where users selectively engage with content that aligns with their identity and beliefs. Our findings highlight the utility of LLMs for large‐scale qualitative analysis and highlight how climate discourse is shaped not only by content, but by underlying cognitive and ideological motivations.

Institutions

Publication Details

Journal
Proceedings of the Association for Information Science and Technology
Published
2025-10-01
DOI
https://doi.org/10.1002/pra2.1261
Primary Topic
Climate Change Communication and Perception
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLM ‐Supported Content Analysis of Motivated Reasoning on Climate Change

Proceedings of the Association for Information Science and Technology
Climate Change Communication and Perception
article

LLM ‐Supported Content Analysis of Motivated Reasoning on Climate Change

article en

Abstract

ABSTRACT Public discourse around climate change remains polarized despite scientific consensus on anthropogenic climate change (ACC). This study examines how “believers” and “skeptics” of ACC differ in their YouTube comment discourse. We analyzed 44,989 comments from 30 videos using a large language model (LLM) as a qualitative annotator, identifying ten distinct topics. These annotations were combined with social network analysis to examine engagement patterns. A linear mixed‐effects model showed that comments about government policy and natural cycles generated significantly lower interaction compared to misinformation, suggesting these topics are ideologically settled points within communities. These patterns reflect motivated reasoning, where users selectively engage with content that aligns with their identity and beliefs. Our findings highlight the utility of LLMs for large‐scale qualitative analysis and highlight how climate discourse is shaped not only by content, but by underlying cognitive and ideological motivations.

Proceedings of the Association for Information Science and TechnologyVol. 62(1)
Syracuse University (US)
Climate action
Openalex Percentile: Top 36%
Climate Change Communication and Perception
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.