Multisource Sensor Fusion and Large Language Model Integration for Explainable State Perception and Anomaly Awareness

With the rapid development of intelligent sensing systems, digital monitoring platforms, and multisource data acquisition technologies, accurate identification of operational states and potential risks from heterogeneous sensing signals has become an important research issue in artificial intelligence-driven sensing. Existing studies have primarily focused on either textual information understanding or behavioral data analysis, with limited attention paid to jointly modeling the consistency between textual declarations and executed behaviors. As a result, many potential risks that have not yet manifested as significant anomalies but already involve execution deviations are difficult to detect in a timely manner. To address this issue, a language–behavior consistency sensing framework for multisource sensing signals is proposed. Textual sensing signals and behavioral sensing signals are mapped into a shared state logic space, and intelligent perception and quantitative analysis of deviations between textual states and executed states are achieved through a textual state logic extraction module, an observed behavioral state modeling module, and a language–behavior consistency measurement module. Systematic experiments were conducted on a multisource sensing dataset containing public declaration texts, operation reports, behavioral logs, resource allocation records, and state-response information. The results show that the proposed method achieved the best performance in the baseline comparison experiment, with a language–behavior consistency score (LCS) of 0.742, an AUC of 0.846, an F1-score of 0.811, a Precision of 0.802, and an explanation consistency score (ECS) of 0.821, clearly outperforming advanced methods such as FinBERT, LSTM, Multimodal Transformer, and the Contrastive Multimodal Model. These results demonstrate that language–behavior consistency sensing can effectively fuse multisource sensing information and improve complex system state identification, anomaly early warning, and risk perception, providing an interpretable artificial intelligence-driven sensing framework with the potential to support industrial operation and maintenance, intelligent manufacturing, digital infrastructure management, and other intelligent monitoring scenarios.