{"title":"网络多智能体强化学习中节点相关性对学习动力学的影响","authors":"Valentina Y. Guleva","doi":"10.1109/DCNA56428.2022.9923243","DOIUrl":null,"url":null,"abstract":"Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.","PeriodicalId":110836,"journal":{"name":"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Node Correlation Effects on Learning Dynamics in Networked Multiagent Reinforcement Learning\",\"authors\":\"Valentina Y. Guleva\",\"doi\":\"10.1109/DCNA56428.2022.9923243\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.\",\"PeriodicalId\":110836,\"journal\":{\"name\":\"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DCNA56428.2022.9923243\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 6th Scientific School Dynamics of Complex Networks and their Applications (DCNA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DCNA56428.2022.9923243","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Node Correlation Effects on Learning Dynamics in Networked Multiagent Reinforcement Learning
Systems of intelligent interacting agents demonstrate high complexity of learning process due to complexity of single agent learning combined with their communication. Agent interactions are aimed at enhancing speed, quality, and complexity characterictics, nevetheless, each interaction may worse single agent results as well as enhance them. Therefore, building effective communication patterns is of high interest for learning process of intelligent systems. As an applied task, we consider project execution dynamics, where single tasks are assigned to employees having several conflicting parameters, while an intelligent system consists of multiple intelligent agents, learned by reinforcement algorithms. Different patterns of interaction according to agent similarities are explored as a factor affecting learning process. The condition of two agents connection is there similarity value, greater than some determined threshold; similarity function is determined for five static and dynamics parameters, and their influence is regulated by the corresponding five multipliers. The experiment shows there are significant parameters, showing more effect of connection on learning dynamics. This can be seen via effect of parameters, regulating neighbours contribution.