國立虎尾科技大學 |

Reward Sharing Relational Networks : = Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Reward Sharing Relational Networks :/
Reminder of title:	Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning.
Author:	Haeri, Hossein.
Description:	1 online resource (85 pages)
Notes:	Source: Masters Abstracts International, Volume: 85-08.
Contained By:	Masters Abstracts International85-08.
Subject:	Robotics. -
Online resource:	click for full text (PQDT)
ISBN:	9798381447415

Reward Sharing Relational Networks : = Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning.
Haeri, Hossein.

Reward Sharing Relational Networks :Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning. - 1 online resource (85 pages)

Source: Masters Abstracts International, Volume: 85-08.

Thesis (M.S.)--University of Massachusetts Lowell, 2024.

Includes bibliographical references

This study introduces a novel framework for guiding the behaviors of agents in Multi-Agent Reinforcement Learning (MARL) systems towards socially preferred outcomes. A big challenge in human-AI integration is to ensure AI systems can interact within the complex web of human social structures, leading to more harmonious, ethical, and effective integration of AI in everyday life by fostering a socially-aware attitude that aligns with human values and societal structures. A crucial step toward achieving this objective involves enabling AI agents to infer and incorporate social preferences pertaining to their interactions with neighboring individuals into their decision-making processes and policies. Specifically, we introduce the notion of the Reward Sharing Relational Network (RSRN), which embeds social preferences of agents directly into their learning process by means of a directed graph structure. Within this framework, the graph encodes the relational structures among agents, which in turn dictate how they value each other's rewards and ultimately how they collaborate or compete within the environment. Additionally, we propose a systematic relational rewarding mechanism, by scalarizing neighborhood rewards, which can incorporate agents' social preferences into the learning framework for AI agents. We examine these novel concepts in a well-known multi-agent reinforcement learning (MARL) problem, called the simple-spread navigation scenario, where a given set of agents are required to learn policies that enable them to reach pre-specified landmarks in the least amount of time. Our investigation focuses on identifying and implementing efficient mechanisms for scalarizing neighborhood rewards, which involves transforming rewards acquired from neighboring agents into a shared relational reward used for the training of each individual agent. The combination of neighborhood reward scalarization and the reward-sharing relational network constitutes what we refer to as the concept of a Relationally-Networked Decentralized Markov Decision Process (RN-Dec-MDP) within the framework of MARL.We demonstrate the effectiveness of the Weighted Product Model (WPM) neighborhood scalarization function in comparison to two other commonly-used scalarization methods (viz., Weighted Sum Model (WSM) and MiniMax) in a 2-agent environment where agents try to capture the closest landmark and have different levels of capabilities in performing this task. Our results indicate that using the Weighted Sum Model to integrate a shared reward is ineffective in scenarios where agents have different characteristics whereas other alternative methods such as Weighted Product Model (WPM) exhibit promising performance in scenarios where some basic characteristics of the agents differ from each other. Further, we also evaluate RN-Dec-MDP framework and the WPM across 6 different RSRN structures for a 3-agent environment and analyze the resulting emergent behavior associated with the deployed social networks. The results demonstrate that the novel combination of the WPM neighborhood scalarization function and the RSRN network structures enable AI agents to learn policies that are intuitively similar to commonly observed social behaviors.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798381447415Subjects--Topical Terms:

561941
Robotics.
Subjects--Index Terms:

Multi-agent systemsIndex Terms--Genre/Form:

554714
Electronic books.

Reward Sharing Relational Networks : = Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning.
LDR:04654ntm a22003857 4500 001 1145506
005 20240624103711.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798381447415
035 $a (MiAaPQ)AAI30694860
035 $a AAI30694860
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Haeri, Hossein. $3 1437793
245 1 0 $a Reward Sharing Relational Networks : $b Cultivating Socially Aligned Agents Through Multi-Agent Reinforcement Learning.
264 0 $c 2024
300 $a 1 online resource (85 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Masters Abstracts International, Volume: 85-08.
500 $a Advisor: Jerath, Kshitij;Ahmadzadeh, Reza.
502 $a Thesis (M.S.)--University of Massachusetts Lowell, 2024.
504 $a Includes bibliographical references
520 $a This study introduces a novel framework for guiding the behaviors of agents in Multi-Agent Reinforcement Learning (MARL) systems towards socially preferred outcomes. A big challenge in human-AI integration is to ensure AI systems can interact within the complex web of human social structures, leading to more harmonious, ethical, and effective integration of AI in everyday life by fostering a socially-aware attitude that aligns with human values and societal structures. A crucial step toward achieving this objective involves enabling AI agents to infer and incorporate social preferences pertaining to their interactions with neighboring individuals into their decision-making processes and policies. Specifically, we introduce the notion of the Reward Sharing Relational Network (RSRN), which embeds social preferences of agents directly into their learning process by means of a directed graph structure. Within this framework, the graph encodes the relational structures among agents, which in turn dictate how they value each other's rewards and ultimately how they collaborate or compete within the environment. Additionally, we propose a systematic relational rewarding mechanism, by scalarizing neighborhood rewards, which can incorporate agents' social preferences into the learning framework for AI agents. We examine these novel concepts in a well-known multi-agent reinforcement learning (MARL) problem, called the simple-spread navigation scenario, where a given set of agents are required to learn policies that enable them to reach pre-specified landmarks in the least amount of time. Our investigation focuses on identifying and implementing efficient mechanisms for scalarizing neighborhood rewards, which involves transforming rewards acquired from neighboring agents into a shared relational reward used for the training of each individual agent. The combination of neighborhood reward scalarization and the reward-sharing relational network constitutes what we refer to as the concept of a Relationally-Networked Decentralized Markov Decision Process (RN-Dec-MDP) within the framework of MARL.We demonstrate the effectiveness of the Weighted Product Model (WPM) neighborhood scalarization function in comparison to two other commonly-used scalarization methods (viz., Weighted Sum Model (WSM) and MiniMax) in a 2-agent environment where agents try to capture the closest landmark and have different levels of capabilities in performing this task. Our results indicate that using the Weighted Sum Model to integrate a shared reward is ineffective in scenarios where agents have different characteristics whereas other alternative methods such as Weighted Product Model (WPM) exhibit promising performance in scenarios where some basic characteristics of the agents differ from each other. Further, we also evaluate RN-Dec-MDP framework and the WPM across 6 different RSRN structures for a 3-agent environment and analyze the resulting emergent behavior associated with the deployed social networks. The results demonstrate that the novel combination of the WPM neighborhood scalarization function and the RSRN network structures enable AI agents to learn policies that are intuitively similar to commonly observed social behaviors.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Robotics. $3 561941
650 4 $a Computer science. $3 573171
653 $a Multi-agent systems
653 $a Reinforcement learning
653 $a Social behaviors
653 $a Weighted Product Model
655 7 $a Electronic books. $2 local $3 554714
690 $a 0800
690 $a 0771
690 $a 0984
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a University of Massachusetts Lowell. $b Computer Science. $3 1437794
773 0 $t Masters Abstracts International $g 85-08.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30694860 $z click for full text (PQDT)