Label synchronization strategies for hybrid federated learning

Advances in artificial intelligence and sensing technologies are becoming instrumental in the adoption of condition-based and predictive maintenance strategies across various industrial sectors. Data-driven models enable the estimation of the current health state of systems and forecast their temporal evolution, promoting proactive maintenance approaches. Despite the evident benefits of collaborative data sharing for developing these models, challenges persist, including data scarcity in each stakeholder, the diversified nature of information held by various parties, and privacy concerns that hinder the willingness to disclose sensitive data. Consequently, parties monitoring similar systems have potential interest in collaborative solutions that respect data privacy policies. Federated Learning, a privacy-preserving and decentralized machine learning approach can address these challenges. By introducing various data partitioning settings – horizontal, vertical, and hybrid – it allows for different modes of data contribution from involved parties, thereby determining how data synchronization occurs. In this work, we introduce FedMulLabSync, a novel algorithm that extends the label synchronization to multidimensional spaces to address use cases where sharing unidimensional labels is insufficient. FedMulLabSync incorporates two synchronization strategies: time-sharing and similarity-based. Time-sharing augments the label space with time, while similarity-based computes the similarity between two multidimensional target labels of different parties. Both strategies are inspired by solutions designed to overcome non-independent and identically distributed (non-IID) data. The effectiveness of the proposed algorithm is demonstrated in forecasting and classifying the health condition of two systems using labels in multidimensional space: turbofan and maritime engines. In forecasting the remaining useful lifetime of turbofan engines, the MAE of the most precise non-federated model was reduced from ≈ 12 . 58 to ≈ 9 . 97 . In classifying the health condition of maritime engines, the F-score of the worst non-federated model was increased from 0.22 to 0.45. • Label synchronization in hybrid federated learning applications. • Strategies for handling non-IDD data heterogeneity in hybrid federated learning. • Client-server architecture for exchanging diverse information in federated solutions. • Challenges in collaborative prognostics and collaborative prognosis. • Collaborative RUL prediction of turbofans and anomaly detection in ship engines.

Authors

Institutions

Publication Details

Journal
Reliability Engineering & System Safety
Published
2024-12-13
DOI
https://doi.org/10.1016/j.ress.2024.110751
Citations
3
Primary Topic
Imbalanced Data Classification Techniques
Type
article
Field-Weighted Citation Impact
1.04
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Label synchronization strategies for hybrid federated learning

Raúl Llasag Rosero, Bernardete Ribeiro, Martin Brutsche, Manuel Arias Chao et al.
3 citations
Reliability Engineering & System Safety
Imbalanced Data Classification Techniques
1.04
article

Label synchronization strategies for hybrid federated learning

Raúl Llasag Rosero, Bernardete Ribeiro, Martin Brutsche, Manuel Arias Chao, Catarina Silva, Melania Albisser
article en
3 citations

Abstract

Advances in artificial intelligence and sensing technologies are becoming instrumental in the adoption of condition-based and predictive maintenance strategies across various industrial sectors. Data-driven models enable the estimation of the current health state of systems and forecast their temporal evolution, promoting proactive maintenance approaches. Despite the evident benefits of collaborative data sharing for developing these models, challenges persist, including data scarcity in each stakeholder, the diversified nature of information held by various parties, and privacy concerns that hinder the willingness to disclose sensitive data. Consequently, parties monitoring similar systems have potential interest in collaborative solutions that respect data privacy policies. Federated Learning, a privacy-preserving and decentralized machine learning approach can address these challenges. By introducing various data partitioning settings – horizontal, vertical, and hybrid – it allows for different modes of data contribution from involved parties, thereby determining how data synchronization occurs. In this work, we introduce FedMulLabSync, a novel algorithm that extends the label synchronization to multidimensional spaces to address use cases where sharing unidimensional labels is insufficient. FedMulLabSync incorporates two synchronization strategies: time-sharing and similarity-based. Time-sharing augments the label space with time, while similarity-based computes the similarity between two multidimensional target labels of different parties. Both strategies are inspired by solutions designed to overcome non-independent and identically distributed (non-IID) data. The effectiveness of the proposed algorithm is demonstrated in forecasting and classifying the health condition of two systems using labels in multidimensional space: turbofan and maritime engines. In forecasting the remaining useful lifetime of turbofan engines, the MAE of the most precise non-federated model was reduced from ≈ 12 . 58 to ≈ 9 . 97 . In classifying the health condition of maritime engines, the F-score of the worst non-federated model was increased from 0.22 to 0.45. • Label synchronization in hybrid federated learning applications. • Strategies for handling non-IDD data heterogeneity in hybrid federated learning. • Client-server architecture for exchanging diverse information in federated solutions. • Challenges in collaborative prognostics and collaborative prognosis. • Collaborative RUL prediction of turbofans and anomaly detection in ship engines.

Reliability Engineering & System SafetyVol. 256
ZHAW Zurich University of Applied Sciences (CH), Winterthur Gas & Diesel (Switzerland) (CH), University of Coimbra (PT)
Openalex Percentile: Top 18%
Imbalanced Data Classification Techniques
1.04
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.