Altruism in Fuzzy Reinforcement Learning

We propose using a genetic algorithm to select hyperparameters in multiagent reinforcement learning (MARL) settings. In particular, we look at this in the context of cooperation and altruism. We show through the use of three continuous space games, that certain algorithmic hyperparameters are better suited to allow to agents learn altruistic behaviors. The agents learn using fuzzy actor critic learning algorithms in either a hierarchical structure or a single actor critic policy. The genetic algorithm selects the discount factors, the reward weights, and the standard deviation of noise applied to actor during learning. The genetic algorithm uses a fitness function based on the ratio of successful tests the group of agents can pass after training. This automated selection of these specific hyperparameters show that they are important for cooperation and also not trivial to select.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Computational Social Systems
Published
2024-10-14
DOI
https://doi.org/10.1109/tcss.2024.3460653
Citations
1
Primary Topic
Experimental Behavioral Economics Studies
Type
article
Field-Weighted Citation Impact
0.53
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Altruism in Fuzzy Reinforcement Learning

Howard M. Schwartz, Sidney Givigi, Rachel Haighton
1 citations
IEEE Transactions on Computational Social Systems
Experimental Behavioral Economics Studies
0.53
article

Altruism in Fuzzy Reinforcement Learning

Howard M. Schwartz, Sidney Givigi, Rachel Haighton
article en
1 citations

Abstract

We propose using a genetic algorithm to select hyperparameters in multiagent reinforcement learning (MARL) settings. In particular, we look at this in the context of cooperation and altruism. We show through the use of three continuous space games, that certain algorithmic hyperparameters are better suited to allow to agents learn altruistic behaviors. The agents learn using fuzzy actor critic learning algorithms in either a hierarchical structure or a single actor critic policy. The genetic algorithm selects the discount factors, the reward weights, and the standard deviation of noise applied to actor during learning. The genetic algorithm uses a fitness function based on the ratio of successful tests the group of agents can pass after training. This automated selection of these specific hyperparameters show that they are important for cooperation and also not trivial to select.

IEEE Transactions on Computational Social SystemsVol. 12(1)
Queen's University (CA), Carleton University (CA)
Reduced inequalities
Openalex Percentile: Top 26%
Experimental Behavioral Economics Studies
0.53
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Altruism in Fuzzy Reinforcement Learning — Howard M. Schwartz, Sidney Givigi, et al. · IEEE Transactions on Computational Social Systems (2024) | TGRS Research Map | TGRS