网络多智能体强化学习中节点相关性对学习动力学的影响

Valentina Y. Guleva
{"title":"网络多智能体强化学习中节点相关性对学习动力学的影响","authors":"Valentina Y. Guleva","doi":"10.1109/DCNA56428.2022.9923243","DOIUrl":null,"url":null,"abstract":"Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.","PeriodicalId":110836,"journal":{"name":"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Node Correlation Effects on Learning Dynamics in Networked Multiagent Reinforcement Learning\",\"authors\":\"Valentina Y. Guleva\",\"doi\":\"10.1109/DCNA56428.2022.9923243\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.\",\"PeriodicalId\":110836,\"journal\":{\"name\":\"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DCNA56428.2022.9923243\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DCNA56428.2022.9923243","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

智能交互智能体系统由于单个智能体学习的复杂性和它们之间的通信的复杂性,表现出了学习过程的高复杂性。智能体交互的目的是提高速度、质量和复杂性特征,然而,每次交互可能会使单个智能体的结果变差,也可能增强它们。因此,构建有效的通信模式对智能系统的学习过程具有重要意义。作为应用任务,我们考虑项目执行动态,其中单个任务分配给具有多个冲突参数的员工,而智能系统由多个智能代理组成,通过强化算法学习。根据智能体的相似度,探索了不同的交互模式作为影响学习过程的因素。两个agent连接的条件是存在相似值,大于某个确定的阈值;确定了五个静态和动态参数的相似函数,并通过相应的五个乘数调节它们的影响。实验显示,有显著的参数,表明连接对学习动态的影响更大。这可以通过参数的影响,调节邻居的贡献来看出。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Node Correlation Effects on Learning Dynamics in Networked Multiagent Reinforcement Learning
Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Discretization Effects in Speed-Gradient Two-rotor Vibration Setup Synchronization Control Broadcasting to noisy boosters: modulation of astrocytic calcium activity and gliotransmitter release by norepinephrine Testing approaches to statistical evaluation of connectivity estimates in epileptic brain based on simple oscillatory models Role of the Bidirectional Cardiorespiratory Coupling in the Nonlinear Dynamics of the Cardiovascular System CPG-based control of robotic fish by setting macro-commands with transient parameters
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1