A Domain-Adaptive Soft Prompting Framework for Multi-Type Bias Detection in News

Advances in Large Language Models (LLMs) have enabled new opportunities to automate media analysis and improve collaborative social cybersecurity. A key task is bias detection in news reporting, which is essential for promoting information fairness and reducing polarization. However, existing approaches often rely on supervised fine-tuning with labeled datasets and fail to capture domain-specific linguistic patterns, limiting scalability and generalization. To address this, we propose a lightweight, modular framework that combines domain-adaptive pretraining (DAP) with Masked Language Modeling (MLM) and soft prompt tuning to detect six types of media bias (framing, group, semantic properties, connotation, informational spin, and phrasing). Our framework leverages 401,000+ New York Times articles from 2000 to 2024 to pretrain five LLMs, followed by bias prompting with small labeled data. The approach improves F1 by 7.6% and precision by 6.8% over hard prompts on average across the six types of biases. These results confirm DAP with soft prompts as an efficient and scalable solution for bias-aware NLP in resource-constrained environments

Authors

Publication Details

Journal
ScholarSpace (University of Hawaii at Manoa)
Published
2025-12-23
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Domain-Adaptive Soft Prompting Framework for Multi-Type Bias Detection in News

Sagar Samtani, Benjamin Ampel, Chengjun Zhang
ScholarSpace (University of Hawaii at Manoa)
Misinformation and Its Impacts
article

A Domain-Adaptive Soft Prompting Framework for Multi-Type Bias Detection in News

Sagar Samtani, Benjamin Ampel, Chengjun Zhang
article en

Abstract

Advances in Large Language Models (LLMs) have enabled new opportunities to automate media analysis and improve collaborative social cybersecurity. A key task is bias detection in news reporting, which is essential for promoting information fairness and reducing polarization. However, existing approaches often rely on supervised fine-tuning with labeled datasets and fail to capture domain-specific linguistic patterns, limiting scalability and generalization. To address this, we propose a lightweight, modular framework that combines domain-adaptive pretraining (DAP) with Masked Language Modeling (MLM) and soft prompt tuning to detect six types of media bias (framing, group, semantic properties, connotation, informational spin, and phrasing). Our framework leverages 401,000+ New York Times articles from 2000 to 2024 to pretrain five LLMs, followed by bias prompting with small labeled data. The approach improves F1 by 7.6% and precision by 6.8% over hard prompts on average across the six types of biases. These results confirm DAP with soft prompts as an efficient and scalable solution for bias-aware NLP in resource-constrained environments

ScholarSpace (University of Hawaii at Manoa)
Decent work and economic growth
Openalex Percentile: Top 23%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Domain-Adaptive Soft Prompting Framework for Multi-Type Bias Detection in News — Sagar Samtani, Benjamin Ampel, et al. · ScholarSpace (University of Hawaii at Manoa) (2025) | TGRS Research Map | TGRS