Multi-modal federated learning with differential privacy for privacy-preserving healthcare AI

The growing adoption of artificial intelligence in healthcare highlights the need for models that can leverage heterogeneous patient data while preserving strict privacy requirements. This paper proposes a novel multi-modal federated learning framework with differential privacy for decentralized healthcare AI. The model integrates electronic health records and ECG time-series using modality-specific encoders and a shared latent fusion network, enabling comprehensive representation learning without centralizing sensitive data. Differential privacy is incorporated into local updates to provide formal guarantees against information leakage in federated aggregation. Extensive experiments on real-world healthcare datasets show that the proposed method achieves [Formula: see text] accuracy, [Formula: see text] precision, [Formula: see text] recall, [Formula: see text] F1-score, and [Formula: see text] AUC, outperforming centralized, single-modality, and non-private baselines. The framework also converges [Formula: see text] faster than single-modality federated learning, reaching [Formula: see text] accuracy in 35 rounds. An ablation study confirms the contribution of multi-modal fusion and class balancing, while client variance analysis shows the lowest performance deviation ([Formula: see text]) under heterogeneous distributions. These results indicate that combining federated optimization, differential privacy, and multi-modal learning provides an effective framework for privacy-preserving clinical AI, with potential for deployment in distributed healthcare settings.