LogicJitter: Let LLMs play and uncover misinformation

In an era of pervasive online content, effectively distinguishing reliable information from misinformation has become an increasingly urgent challenge with broad societal implications. In this context, algorithmic solutions that focus on supervised learning can be effective within specific domains, but they require large labeled datasets for training. Producing such datasets is costly and time-consuming, and these approaches are prone to several issues, including annotation bias, temporal leakage, subjective interpretation, and poor generalization across domains. Alternative approaches include semi-supervised and weakly supervised learning, unsupervised or self-supervised methods, graph-based propagation models, zero-shot and few-shot learning, and Retrieval-Augmented Generation (RAG) with Large Language Models (LLMs). However, these approaches also present several limitations, such as potential label noise in semi-supervised methods, spurious correlations and reduced interpretability in unsupervised approaches, unrealistic assumptions in graph-based models, sensitivity to prompt design and pre-trained knowledge in zero-shot and few-shot methods, and dependence on the availability and quality of external knowledge in RAG-based methods. To mitigate several of these limitations, we propose LogicJitter, a novel and cost-efficient fine-tuning strategy that enhances the reasoning capabilities of LLMs by exposing them to structured, logic-based games specifically designed to counteract common human cognitive biases and logical fallacies. Rather than relying solely on domain-specific misinformation data, as in prior misinformation detection approaches that use such data either for direct training or as domain-specific knowledge, our method improves detection capabilities by strengthening domain-agnostic reasoning skills. We introduce an open-source framework for automatically generating both valid and fallacious logic statements to support training and reproducibility. Empirical results demonstrate that LLMs fine-tuned with LogicJitter lead to meaningful results in misinformation detection performance, highlighting the potential of reasoning-centric training as a robust alternative to traditional, data-intensive approaches. • Innovative strategy for improving AI reasoning capabilities. • Improved misinformation detection without domain-specific knowledge. • Approach to addressing cognitive biases and fallacies for consistent reasoning. • Fine-tuning method using logic games to strengthen reasoning accuracy. • Open-source package for automated logic game data generation.