Federated Multi-Agent Reinforcement Learning for Incentive-Based DRS over Blockchain enabled Microgrids

The paper investigates the integration of multiagent reinforcement learning (MARL) and federated learning for smart energy management systems focusing on Sustainable Development Goals (SDG) 7 and 11 which are Affordable and Clean Energy, and Sustainable Cities and Communities. We present a demand response system (DRS) within microgrids that is incentive-based with solar energy as the main renewable resource. Our model incorporates the use of federated learning to improve data privacy and efficiency, while multi-agent reinforcement learning optimizes the process of energy trading, load balancing, and grid stability. Three algorithms-Deep Deterministic Policy Gradient (DDPG), Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and Asynchronous Advantage Actor-Critic (A3C)-are compared in terms of their performance for this purpose. The study also investigates how direct load control (DLC) programs along with demand bidding can be utilized as incentives that encourage participation in DRS. The experimental results show that merging MARL with federated learning in microgrids leads to improved energy efficiency, cost reduction, as well as sustainable energy consumption behaviours. These outcomes support broader targets to establish strong, durable energy systems in smart cities under the United Nations’ SDGs.

Authors

Institutions

Publication Details

Published
2024-11-12
DOI
https://doi.org/10.1109/icspis63676.2024.10812651
Citations
4
Primary Topic
Blockchain Technology Applications and Security
Type
article
Field-Weighted Citation Impact
3.12
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Federated Multi-Agent Reinforcement Learning for Incentive-Based DRS over Blockchain enabled Microgrids

Abhirup Khanna, Piyush Maheshwari
4 citations
Blockchain Technology Applications and Security
3.12
article

Federated Multi-Agent Reinforcement Learning for Incentive-Based DRS over Blockchain enabled Microgrids

Abhirup Khanna, Piyush Maheshwari
article en
4 citations

Abstract

The paper investigates the integration of multiagent reinforcement learning (MARL) and federated learning for smart energy management systems focusing on Sustainable Development Goals (SDG) 7 and 11 which are Affordable and Clean Energy, and Sustainable Cities and Communities. We present a demand response system (DRS) within microgrids that is incentive-based with solar energy as the main renewable resource. Our model incorporates the use of federated learning to improve data privacy and efficiency, while multi-agent reinforcement learning optimizes the process of energy trading, load balancing, and grid stability. Three algorithms-Deep Deterministic Policy Gradient (DDPG), Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and Asynchronous Advantage Actor-Critic (A3C)-are compared in terms of their performance for this purpose. The study also investigates how direct load control (DLC) programs along with demand bidding can be utilized as incentives that encourage participation in DRS. The experimental results show that merging MARL with federated learning in microgrids leads to improved energy efficiency, cost reduction, as well as sustainable energy consumption behaviours. These outcomes support broader targets to establish strong, durable energy systems in smart cities under the United Nations’ SDGs.

British University in Dubai (AE), University of Petroleum and Energy Studies (IN)
Openalex Percentile: Top 7%
Blockchain Technology Applications and Security
3.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.