{"title":"通过降低等级相关均衡点实现非合作多人矩阵游戏中的协调","authors":"Jaehan Im;Yue Yu;David Fridovich-Keil;Ufuk Topcu","doi":"10.1109/LCSYS.2024.3414976","DOIUrl":null,"url":null,"abstract":"Coordination in multiplayer games enables players to avoid the lose-lose outcome that often arises at Nash equilibria. However, designing a coordination mechanism typically requires the consideration of the joint actions of all players, which becomes intractable in large-scale games. We develop a novel coordination mechanism, termed reduced rank correlated equilibria. The idea is to approximate the set of all joint actions with the actions used in a set of pre-computed Nash equilibria via a convex hull operation. In a game with n players and each player having m actions, the proposed mechanism reduces the number of joint actions considered from \n<inline-formula> <tex-math>${\\mathcal {O}}(m^{n})$ </tex-math></inline-formula>\n to \n<inline-formula> <tex-math>${\\mathcal {O}}(mn)$ </tex-math></inline-formula>\n and thereby mitigates computational complexity. We demonstrate the application of the proposed mechanism to an air traffic queue management problem. Compared with the correlated equilibrium—a popular benchmark coordination mechanism—the proposed approach is capable of solving a problem involving four thousand times more joint actions while yielding similar or better performance in terms of a fairness indicator and showing a maximum optimality gap of 0.066% in terms of the average delay cost. In the meantime, it yields a solution that shows up to 99.5% improvement in a fairness indicator and up to 50.4% reduction in average delay cost compared to the Nash solution, which does not involve coordination.","PeriodicalId":37235,"journal":{"name":"IEEE Control Systems Letters","volume":null,"pages":null},"PeriodicalIF":2.4000,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Coordination in Noncooperative Multiplayer Matrix Games via Reduced Rank Correlated Equilibria\",\"authors\":\"Jaehan Im;Yue Yu;David Fridovich-Keil;Ufuk Topcu\",\"doi\":\"10.1109/LCSYS.2024.3414976\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Coordination in multiplayer games enables players to avoid the lose-lose outcome that often arises at Nash equilibria. However, designing a coordination mechanism typically requires the consideration of the joint actions of all players, which becomes intractable in large-scale games. We develop a novel coordination mechanism, termed reduced rank correlated equilibria. The idea is to approximate the set of all joint actions with the actions used in a set of pre-computed Nash equilibria via a convex hull operation. In a game with n players and each player having m actions, the proposed mechanism reduces the number of joint actions considered from \\n<inline-formula> <tex-math>${\\\\mathcal {O}}(m^{n})$ </tex-math></inline-formula>\\n to \\n<inline-formula> <tex-math>${\\\\mathcal {O}}(mn)$ </tex-math></inline-formula>\\n and thereby mitigates computational complexity. We demonstrate the application of the proposed mechanism to an air traffic queue management problem. Compared with the correlated equilibrium—a popular benchmark coordination mechanism—the proposed approach is capable of solving a problem involving four thousand times more joint actions while yielding similar or better performance in terms of a fairness indicator and showing a maximum optimality gap of 0.066% in terms of the average delay cost. In the meantime, it yields a solution that shows up to 99.5% improvement in a fairness indicator and up to 50.4% reduction in average delay cost compared to the Nash solution, which does not involve coordination.\",\"PeriodicalId\":37235,\"journal\":{\"name\":\"IEEE Control Systems Letters\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2024-06-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Control Systems Letters\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10557654/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Control Systems Letters","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10557654/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
多人游戏中的协调能让玩家避免纳什均衡时经常出现的双输结果。然而,设计协调机制通常需要考虑所有博弈者的联合行动,这在大规模博弈中变得非常棘手。我们开发了一种新的协调机制,称为 "降低等级的相关均衡"。其思路是通过凸壳操作,用一组预先计算好的纳什均衡状态中使用的行动来近似所有联合行动的集合。在一个有 n 个棋手且每个棋手有 m 个行动的博弈中,所提出的机制将考虑的联合行动的数量从 ${mathcal {O}}(m^{n})$ 减少到 ${mathcal {O}}(mn)$ ,从而降低了计算复杂度。我们演示了所提机制在空中交通队列管理问题中的应用。与相关均衡--一种流行的基准协调机制--相比,所提出的方法能够解决涉及四千倍以上联合行动的问题,同时在公平性指标方面具有相似或更好的性能,并且在平均延迟成本方面显示出 0.066% 的最大最优性差距。同时,与不涉及协调的纳什方案相比,它所得到的方案在公平性指标上提高了 99.5%,在平均延迟成本上降低了 50.4%。
Coordination in Noncooperative Multiplayer Matrix Games via Reduced Rank Correlated Equilibria
Coordination in multiplayer games enables players to avoid the lose-lose outcome that often arises at Nash equilibria. However, designing a coordination mechanism typically requires the consideration of the joint actions of all players, which becomes intractable in large-scale games. We develop a novel coordination mechanism, termed reduced rank correlated equilibria. The idea is to approximate the set of all joint actions with the actions used in a set of pre-computed Nash equilibria via a convex hull operation. In a game with n players and each player having m actions, the proposed mechanism reduces the number of joint actions considered from
${\mathcal {O}}(m^{n})$
to
${\mathcal {O}}(mn)$
and thereby mitigates computational complexity. We demonstrate the application of the proposed mechanism to an air traffic queue management problem. Compared with the correlated equilibrium—a popular benchmark coordination mechanism—the proposed approach is capable of solving a problem involving four thousand times more joint actions while yielding similar or better performance in terms of a fairness indicator and showing a maximum optimality gap of 0.066% in terms of the average delay cost. In the meantime, it yields a solution that shows up to 99.5% improvement in a fairness indicator and up to 50.4% reduction in average delay cost compared to the Nash solution, which does not involve coordination.