Bridge the Generalization Gap: A Comprehensive Framework for Enhance Reliability and Robustness in Deep Learning Models

Deep reinforcement learning (DRL) has been successful in a wide range of domains but its broad acceptance is limited by the generalization gap, which measures the performance difference between an environment a model was trained with versus new, unseen environments. This gap implies a challenge that needs to be addressed for DRL models used in real-world adaptation. This paper considers a strategy whose methodology outlines combining domain randomization, multitask learning, and regularization techniques. The study trains the models on multiple tasks and diverse environments, thus generalizing the ability of models. Our regularization strategy keeps the model from over-specialization to the training data and ensures improved performance. Benchmark environments are evaluated based on our approach, reducing the generalization gap with improvement in average returns in unseen environments and increasing the resilience of DRL models. In this regard, our study opens up the avenue for a significant contribution to the generalization capacity of more robust DRL models for real-world applicability.

Authors

Institutions

Publication Details

Published
2024-12-12
DOI
https://doi.org/10.1109/icses63760.2024.10910534
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bridge the Generalization Gap: A Comprehensive Framework for Enhance Reliability and Robustness in Deep Learning Models

R Sruthi, S. Vasanth, P Kanishka, Vijay Akash S et al.
Machine Learning and Data Classification
article

Bridge the Generalization Gap: A Comprehensive Framework for Enhance Reliability and Robustness in Deep Learning Models

R Sruthi, S. Vasanth, P Kanishka, Vijay Akash S, M. A., B Jovita
article en

Abstract

Deep reinforcement learning (DRL) has been successful in a wide range of domains but its broad acceptance is limited by the generalization gap, which measures the performance difference between an environment a model was trained with versus new, unseen environments. This gap implies a challenge that needs to be addressed for DRL models used in real-world adaptation. This paper considers a strategy whose methodology outlines combining domain randomization, multitask learning, and regularization techniques. The study trains the models on multiple tasks and diverse environments, thus generalizing the ability of models. Our regularization strategy keeps the model from over-specialization to the training data and ensures improved performance. Benchmark environments are evaluated based on our approach, reducing the generalization gap with improvement in average returns in unseen environments and increasing the resilience of DRL models. In this regard, our study opens up the avenue for a significant contribution to the generalization capacity of more robust DRL models for real-world applicability.

Thiruvalluvar University (IN)
Openalex Percentile: Top 74%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.