Hybrid real-synthetic dataset framework for robotic hazard detection in industrial environments

The increasing complexity of industrial environments requires the development of real-time hazard detection and environmental monitoring using intelligent robotic systems. This paper introduces RoboFusion, an integrated framework that combines Autonomous Mobile Robots (AMRs), fixed sensing nodes, and a novel hybrid dataset generation pipeline for data-driven industrial safety. Deployed in a functioning industrial testbed, RoboFusion collected real-time telemetry over 180 days using four sensor suites: two fixed units and two additional units mounted on Near-Field Communication (NFC) guided AMRs, each equipped with 12 sensors sampling at one-minute intervals. This deployment yielded approximately one million multi-modal sensor records, including temperature, humidity, gas concentrations, air quality, and pressure. Data streams were processed onboard using ESP32 microcontrollers, and they were transmitted via Message Queuing Telemetry Transport (MQTT) to an Internet of Things (IoT) cloud platform. The scarcity and imbalance of hazard events in real collected data create a challenge for effective model training. RoboFusion addresses this issue through a structured synthetic dataset generation framework. This framework augments non-hazardous data using statistical augmentation techniques, and it simulates hazardous data through multi-phase curve fitting, spatial propagation modeling, and location-aware hazard scenarios. The resulting synthetic dataset improves coverage of rare and safety-critical scenarios while maintaining consistency with real-world dynamics. Evaluation across four machine learning models, namely Random Forest (RF), Support Vector Machine (SVM), Extreme Gradient Boosting (XGBoost), and Multi-Layer Perceptron (MLP), demonstrates significant cross-domain gains. As an example, hazard F1 scores improved from 0.47 to 0.85 for the RF model, and from 0.16 to 0.79 for the SVM model when models trained on synthetic data were tested against real hazard events. RoboFusion therefore delivers a reproducible robotic sensing platform and an openly accessible hybrid dataset. It introduces a novel approach to hazard simulation that mimics real-world hazards and supports the development of resilient Artificial Intelligence (AI) systems for industrial hazard detection and autonomous safety intelligence.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-01-12
DOI
https://doi.org/10.1038/s41598-025-33603-5
Primary Topic
Anomaly Detection Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Hybrid real-synthetic dataset framework for robotic hazard detection in industrial environments

Moustafa H. Aly, Amr Khamis, Heba A. Fayed, Heba A. Shaban
Scientific Reports
Anomaly Detection Techniques and Applications
article

Hybrid real-synthetic dataset framework for robotic hazard detection in industrial environments

Moustafa H. Aly, Amr Khamis, Heba A. Fayed, Heba A. Shaban
article en

Abstract

The increasing complexity of industrial environments requires the development of real-time hazard detection and environmental monitoring using intelligent robotic systems. This paper introduces RoboFusion, an integrated framework that combines Autonomous Mobile Robots (AMRs), fixed sensing nodes, and a novel hybrid dataset generation pipeline for data-driven industrial safety. Deployed in a functioning industrial testbed, RoboFusion collected real-time telemetry over 180 days using four sensor suites: two fixed units and two additional units mounted on Near-Field Communication (NFC) guided AMRs, each equipped with 12 sensors sampling at one-minute intervals. This deployment yielded approximately one million multi-modal sensor records, including temperature, humidity, gas concentrations, air quality, and pressure. Data streams were processed onboard using ESP32 microcontrollers, and they were transmitted via Message Queuing Telemetry Transport (MQTT) to an Internet of Things (IoT) cloud platform. The scarcity and imbalance of hazard events in real collected data create a challenge for effective model training. RoboFusion addresses this issue through a structured synthetic dataset generation framework. This framework augments non-hazardous data using statistical augmentation techniques, and it simulates hazardous data through multi-phase curve fitting, spatial propagation modeling, and location-aware hazard scenarios. The resulting synthetic dataset improves coverage of rare and safety-critical scenarios while maintaining consistency with real-world dynamics. Evaluation across four machine learning models, namely Random Forest (RF), Support Vector Machine (SVM), Extreme Gradient Boosting (XGBoost), and Multi-Layer Perceptron (MLP), demonstrates significant cross-domain gains. As an example, hazard F1 scores improved from 0.47 to 0.85 for the RF model, and from 0.16 to 0.79 for the SVM model when models trained on synthetic data were tested against real hazard events. RoboFusion therefore delivers a reproducible robotic sensing platform and an openly accessible hybrid dataset. It introduces a novel approach to hazard simulation that mimics real-world hazards and supports the development of resilient Artificial Intelligence (AI) systems for industrial hazard detection and autonomous safety intelligence.

Scientific ReportsVol. 16(1)
Arab Academy for Science, Technology, and Maritime Transport (EG)
Science and Technology Development Fund
Openalex Percentile: Top 91%
Anomaly Detection Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.