Fusing a Slimming Network and Large Language Models for Intelligent Decision Support in Industrial Safety and Preventive Monitoring
Intelligent personnel safety management is a critical component of smart manufacturing infrastructure. This paper presents an integrated framework combining a structurally optimized neural network (enhanced with spatial and channel feature fusion mechanisms for multi-scale detection) with an agent-based large language model (LLM) enhanced with retrieval-augmented generation (RAG) capabilities for factory safety monitoring. The visual detection component employs the Similarity-Aware Channel Pruning (SACP) method for automated, performance-preserving compression by identifying and suppressing redundant channels based on similarity and norm regularization, while the agent-based LLM with RAG capabilities dynamically integrates real-time violation data with established safety management protocols to generate precise diagnostic reports and operational recommendations. The optimized network achieves real-time violation detection in parallel video streams, and the LLM-powered assistant facilitates intelligent decision-making through natural language querying. Extensive evaluations on multiple benchmark datasets and a real-world safety helmet detection dataset demonstrate the scheme’s superior performance in both accuracy and practical applicability for industrial deployment.
Authors
- Liqiang Zhu (ORCID: https://orcid.org/0000-0002-5436-6660)
- Wenjun Tian
- Jianbo Li (ORCID: https://orcid.org/0000-0002-3841-2946)
- Zhonghua Guo (ORCID: https://orcid.org/0000-0002-9606-752X)
- Wei Wang
- Jia Yin (ORCID: https://orcid.org/0000-0002-7858-4259)
Institutions
- Beijing Jiaotong University (CN)
Publication Details
- Journal
- Electronics
- Published
- 2025-12-04
- DOI
- https://doi.org/10.3390/electronics14234773
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00