A Quantitative Evaluation of Computational Resource Constraints and Carbon Intensity in Transformer-Based Media Bias Detection

Automated media bias detection is becoming more important as disinformation spreads faster than human fact-checkers can respond. Yet most NLP research treats model accuracy as the only measure of success, ignoring training cost and energy use. This study asks a different question: is the accuracy gain from larger, more complex transformer models actually worth the environmental and computational price? We trained and evaluated three transformer architectures like RoBERTa-base, RoBERTa-large, and DeBERTa-v3-large on a three-class bias classification task using the News Bias Data corpus. Each model was tested across multiple hyperparameter configurations, including Focal Loss, class-balanced weights, and learning rate adjustments. A TF-IDF baseline provided a classical reference point. CO₂ emissions were estimated using the Green Algorithms calculator, based on the hardware specifications of the training environment. DeBERTa-v3-large with Focal Loss, class-balanced weights, and a reduced learning rate achieved the best classification result, with a Macro F₁ of 0.9756. The cost was steep: training took around 140 hours and produced more than four times the emissions of the Pareto-efficient RoBERTa-large setup. That setup was with Focal Loss and reached a Macro F₁ of 0.9487 for 9.95 kg CO₂e. The TF-IDF baseline used 99.9% less energy but fell 20–28 percentage points short on accuracy. The relationship between model quality and computational cost is strongly non-linear. Gains beyond a certain threshold require disproportionate resources. For most real-world applications, a well-tuned RoBERTa-large is a more responsible choice than the top-performing model available.

Authors

Institutions

Publication Details

Journal
The International Journal of Materials and Engineering Technology
Published
2026-06-30
DOI
https://doi.org/10.70858/tijmet.1951725
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Quantitative Evaluation of Computational Resource Constraints and Carbon Intensity in Transformer-Based Media Bias Detection

Krzysztof Siwek, Sylwia Snarska
The International Journal of Materials and Engineering Technology
Misinformation and Its Impacts
article

A Quantitative Evaluation of Computational Resource Constraints and Carbon Intensity in Transformer-Based Media Bias Detection

Krzysztof Siwek, Sylwia Snarska
article en

Abstract

Automated media bias detection is becoming more important as disinformation spreads faster than human fact-checkers can respond. Yet most NLP research treats model accuracy as the only measure of success, ignoring training cost and energy use. This study asks a different question: is the accuracy gain from larger, more complex transformer models actually worth the environmental and computational price? We trained and evaluated three transformer architectures like RoBERTa-base, RoBERTa-large, and DeBERTa-v3-large on a three-class bias classification task using the News Bias Data corpus. Each model was tested across multiple hyperparameter configurations, including Focal Loss, class-balanced weights, and learning rate adjustments. A TF-IDF baseline provided a classical reference point. CO₂ emissions were estimated using the Green Algorithms calculator, based on the hardware specifications of the training environment. DeBERTa-v3-large with Focal Loss, class-balanced weights, and a reduced learning rate achieved the best classification result, with a Macro F₁ of 0.9756. The cost was steep: training took around 140 hours and produced more than four times the emissions of the Pareto-efficient RoBERTa-large setup. That setup was with Focal Loss and reached a Macro F₁ of 0.9487 for 9.95 kg CO₂e. The TF-IDF baseline used 99.9% less energy but fell 20–28 percentage points short on accuracy. The relationship between model quality and computational cost is strongly non-linear. Gains beyond a certain threshold require disproportionate resources. For most real-world applications, a well-tuned RoBERTa-large is a more responsible choice than the top-performing model available.

The International Journal of Materials and Engineering TechnologyVol. 9(1)
Warsaw University of Technology (PL), Wrocław University of Science and Technology (PL)
Openalex Percentile: Top 5%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.