Large Language Model-Assisted Multimodal Federated Sensing for Compliance Risk Screening in Cross-Border Trade

With the continuous expansion of cross-border agricultural supply chains, reliable food-safety risk screening under decentralized data ownership, heterogeneous sensing equipment, and jurisdiction-dependent, non-stationary regulatory limits pose a fundamental challenge to intelligent inspection systems. To address these limitations, this paper proposes an LLM-assisted regulation-aware heterogeneous multimodal federated learning framework that establishes a three-tier decoupling architecture. First, an available-modality and quality-adaptive fusion mechanism dynamically weights RGB images, near-infrared (NIR) spectra, and environmental time-series while enforcing strict zero weighting on unavailable modalities and continuous suppression of degraded observations. Second, a regulation-independent state-prototype collaboration and personalized federated learning strategy is developed on a unified continuous concentration scale, enabling cross-institutional transfer of physical contamination representations while avoiding the use of jurisdiction-dependent compliance labels to define shared prototype groups and preserving client-specific adapters against non-IID drift. Third, offline large language model (LLM) parsing transforms unstructured multi-jurisdictional trade regulations into machine-executable rule bases, which are coupled with an uncertainty-aware risk calibration module to dynamically determine exceedance probabilities and reinspection recommendations without retraining front-end sensing encoders when regulatory standards shift. Experimental evaluations on a multisource maize and aflatoxin B1 screening dataset in a workstation-based federated simulation demonstrate that the proposed framework achieves a mean absolute error (MAE) of 0.054±0.002 and a root mean square error (RMSE) of 0.078±0.003, while elevating the area under the curve (AUC) and F1-score to 0.862±0.008 and 0.833±0.009, respectively, reducing the false negative rate (FNR) to 0.121±0.007 (p<0.001). Under severe client heterogeneity and missing-modality scenarios, the proposed approach maintains an AUC of 0.823±0.010 and an F1-score of 0.796±0.011. Ablation and ownership-level analyses assess robustness, calibration (expected calibration error of 0.032), and regulatory adaptation with fixed sensing encoders, providing an end-to-end, traceable decision-support paradigm for international agricultural trade screening.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-10-28
DOI
https://doi.org/10.3390/s26216806
Primary Topic
Spectroscopy and Chemometric Analyses
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Large Language Model-Assisted Multimodal Federated Sensing for Compliance Risk Screening in Cross-Border Trade

Yong Zhang, Manzhou Li, Xinyi He, Qingxi Meng et al.
6 links
Sensors
Spectroscopy and Chemometric Analyses
article

Large Language Model-Assisted Multimodal Federated Sensing for Compliance Risk Screening in Cross-Border Trade

Yong Zhang, Manzhou Li, Xinyi He, Qingxi Meng, Yuening Wang, Jingke Liang, Yifan Yang
article en

Abstract

With the continuous expansion of cross-border agricultural supply chains, reliable food-safety risk screening under decentralized data ownership, heterogeneous sensing equipment, and jurisdiction-dependent, non-stationary regulatory limits pose a fundamental challenge to intelligent inspection systems. To address these limitations, this paper proposes an LLM-assisted regulation-aware heterogeneous multimodal federated learning framework that establishes a three-tier decoupling architecture. First, an available-modality and quality-adaptive fusion mechanism dynamically weights RGB images, near-infrared (NIR) spectra, and environmental time-series while enforcing strict zero weighting on unavailable modalities and continuous suppression of degraded observations. Second, a regulation-independent state-prototype collaboration and personalized federated learning strategy is developed on a unified continuous concentration scale, enabling cross-institutional transfer of physical contamination representations while avoiding the use of jurisdiction-dependent compliance labels to define shared prototype groups and preserving client-specific adapters against non-IID drift. Third, offline large language model (LLM) parsing transforms unstructured multi-jurisdictional trade regulations into machine-executable rule bases, which are coupled with an uncertainty-aware risk calibration module to dynamically determine exceedance probabilities and reinspection recommendations without retraining front-end sensing encoders when regulatory standards shift. Experimental evaluations on a multisource maize and aflatoxin B1 screening dataset in a workstation-based federated simulation demonstrate that the proposed framework achieves a mean absolute error (MAE) of 0.054±0.002 and a root mean square error (RMSE) of 0.078±0.003, while elevating the area under the curve (AUC) and F1-score to 0.862±0.008 and 0.833±0.009, respectively, reducing the false negative rate (FNR) to 0.121±0.007 (p<0.001). Under severe client heterogeneity and missing-modality scenarios, the proposed approach maintains an AUC of 0.823±0.010 and an F1-score of 0.796±0.011. Ablation and ownership-level analyses assess robustness, calibration (expected calibration error of 0.032), and regulatory adaptation with fixed sensing encoders, providing an end-to-end, traceable decision-support paradigm for international agricultural trade screening.

SensorsVol. 26(21)
Peking University (CN), China Agricultural University (CN)
Zero hunger
Openalex Percentile: Top 19%
Spectroscopy and Chemometric Analyses
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon