A Quantitative Evaluation of Computational Resource Constraints and Carbon Intensity in Transformer-Based Media Bias Detection
Automated media bias detection is becoming more important as disinformation spreads faster than human fact-checkers can respond. Yet most NLP research treats model accuracy as the only measure of success, ignoring training cost and energy use. This study asks a different question: is the accuracy gain from larger, more complex transformer models actually worth the environmental and computational price? We trained and evaluated three transformer architectures like RoBERTa-base, RoBERTa-large, and DeBERTa-v3-large on a three-class bias classification task using the News Bias Data corpus. Each model was tested across multiple hyperparameter configurations, including Focal Loss, class-balanced weights, and learning rate adjustments. A TF-IDF baseline provided a classical reference point. CO₂ emissions were estimated using the Green Algorithms calculator, based on the hardware specifications of the training environment. DeBERTa-v3-large with Focal Loss, class-balanced weights, and a reduced learning rate achieved the best classification result, with a Macro F₁ of 0.9756. The cost was steep: training took around 140 hours and produced more than four times the emissions of the Pareto-efficient RoBERTa-large setup. That setup was with Focal Loss and reached a Macro F₁ of 0.9487 for 9.95 kg CO₂e. The TF-IDF baseline used 99.9% less energy but fell 20–28 percentage points short on accuracy. The relationship between model quality and computational cost is strongly non-linear. Gains beyond a certain threshold require disproportionate resources. For most real-world applications, a well-tuned RoBERTa-large is a more responsible choice than the top-performing model available.
Authors
- Krzysztof Siwek (ORCID: https://orcid.org/0000-0003-2642-2319)
- Sylwia Snarska
Institutions
- Warsaw University of Technology (PL)
- Wrocław University of Science and Technology (PL)
Publication Details
- Journal
- The International Journal of Materials and Engineering Technology
- Published
- 2026-06-30
- DOI
- https://doi.org/10.70858/tijmet.1951725
- Primary Topic
- Misinformation and Its Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.00