首页 > 最新文献

Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...最新文献

英文 中文
GroupMixNorm Layer for Learning Fair Models GroupMixNorm层用于学习公平模型
Anubha Pandey, Aditi Rai, Maneet Singh, Deepak L. Bhatt, Tanmoy Bhowmik
{"title":"GroupMixNorm Layer for Learning Fair Models","authors":"Anubha Pandey, Aditi Rai, Maneet Singh, Deepak L. Bhatt, Tanmoy Bhowmik","doi":"10.1007/978-3-031-33374-3_41","DOIUrl":"https://doi.org/10.1007/978-3-031-33374-3_41","url":null,"abstract":"","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80889481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Leveraged Mel Spectrograms Using Harmonic and Percussive Components in Speech Emotion Recognition 利用Mel谱图在语音情感识别中的谐波和冲击分量
David Hason Rudd, H. Huo, Guandong Xu
{"title":"Leveraged Mel Spectrograms Using Harmonic and Percussive Components in Speech Emotion Recognition","authors":"David Hason Rudd, H. Huo, Guandong Xu","doi":"10.1007/978-3-031-05936-0_31","DOIUrl":"https://doi.org/10.1007/978-3-031-05936-0_31","url":null,"abstract":"","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75640033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
An Extended Variational Mode Decomposition Algorithm Developed Speech Emotion Recognition Performance 一种扩展的变分模态分解算法提高了语音情感识别性能
David Hason Rudd, H. Huo, Guandong Xu
{"title":"An Extended Variational Mode Decomposition Algorithm Developed Speech Emotion Recognition Performance","authors":"David Hason Rudd, H. Huo, Guandong Xu","doi":"10.1007/978-3-031-33380-4_17","DOIUrl":"https://doi.org/10.1007/978-3-031-33380-4_17","url":null,"abstract":"","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81399523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Vision Transformers for Small Histological Datasets Learned Through Knowledge Distillation 通过知识蒸馏学习的小型组织学数据集的视觉变换
Neel Kanwal, T. Eftestøl, Farbod Khoraminia, T. Zuiverloon, K. Engan
{"title":"Vision Transformers for Small Histological Datasets Learned Through Knowledge Distillation","authors":"Neel Kanwal, T. Eftestøl, Farbod Khoraminia, T. Zuiverloon, K. Engan","doi":"10.1007/978-3-031-33380-4_13","DOIUrl":"https://doi.org/10.1007/978-3-031-33380-4_13","url":null,"abstract":"","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74706670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Fast and Attributed Change Detection on Dynamic Graphs with Density of States 具有状态密度的动态图的快速属性变化检测
Shenyang Huang, Jacob Danovitch, Guillaume Rabusseau, Reihaneh Rabbany
How can we detect traffic disturbances from international flight transportation logs or changes to collaboration dynamics in academic networks? These problems can be formulated as detecting anomalous change points in a dynamic graph. Current solutions do not scale well to large real-world graphs, lack robustness to large amounts of node additions/deletions, and overlook changes in node attributes. To address these limitations, we propose a novel spectral method: Scalable Change Point Detection (SCPD). SCPD generates an embedding for each graph snapshot by efficiently approximating the distribution of the Laplacian spectrum at each step. SCPD can also capture shifts in node attributes by tracking correlations between attributes and eigenvectors. Through extensive experiments using synthetic and real-world data, we show that SCPD (a) achieves state-of-the art performance, (b) is significantly faster than the state-of-the-art methods and can easily process millions of edges in a few CPU minutes, (c) can effectively tackle a large quantity of node attributes, additions or deletions and (d) discovers interesting events in large real-world graphs. The code is publicly available at https://github.com/shenyangHuang/SCPD.git
我们如何从国际航班运输日志中发现交通干扰或学术网络中协作动态的变化?这些问题可以表述为动态图中异常变化点的检测。当前的解决方案不能很好地扩展到现实世界的大型图形,缺乏对大量节点添加/删除的鲁棒性,并且忽略了节点属性的变化。为了解决这些限制,我们提出了一种新的光谱方法:可扩展变化点检测(SCPD)。SCPD通过在每一步有效地逼近拉普拉斯谱的分布,为每个图快照生成嵌入。SCPD还可以通过跟踪属性和特征向量之间的相关性来捕获节点属性的变化。通过使用合成数据和现实世界数据的广泛实验,我们表明SCPD (a)实现了最先进的性能,(b)比最先进的方法快得多,可以在几分钟内轻松处理数百万条边,(c)可以有效地处理大量节点属性,添加或删除以及(d)在大型现实世界图中发现有趣的事件。该代码可在https://github.com/shenyangHuang/SCPD.git上公开获得
{"title":"Fast and Attributed Change Detection on Dynamic Graphs with Density of States","authors":"Shenyang Huang, Jacob Danovitch, Guillaume Rabusseau, Reihaneh Rabbany","doi":"10.48550/arXiv.2305.08750","DOIUrl":"https://doi.org/10.48550/arXiv.2305.08750","url":null,"abstract":"How can we detect traffic disturbances from international flight transportation logs or changes to collaboration dynamics in academic networks? These problems can be formulated as detecting anomalous change points in a dynamic graph. Current solutions do not scale well to large real-world graphs, lack robustness to large amounts of node additions/deletions, and overlook changes in node attributes. To address these limitations, we propose a novel spectral method: Scalable Change Point Detection (SCPD). SCPD generates an embedding for each graph snapshot by efficiently approximating the distribution of the Laplacian spectrum at each step. SCPD can also capture shifts in node attributes by tracking correlations between attributes and eigenvectors. Through extensive experiments using synthetic and real-world data, we show that SCPD (a) achieves state-of-the art performance, (b) is significantly faster than the state-of-the-art methods and can easily process millions of edges in a few CPU minutes, (c) can effectively tackle a large quantity of node attributes, additions or deletions and (d) discovers interesting events in large real-world graphs. The code is publicly available at https://github.com/shenyangHuang/SCPD.git","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85775162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MISNN: Multiple Imputation via Semi-parametric Neural Networks MISNN:通过半参数神经网络的多重输入
Zhiqi Bu, Zongyu Dai, Yiliang Zhang, Q. Long
Multiple imputation (MI) has been widely applied to missing value problems in biomedical, social and econometric research, in order to avoid improper inference in the downstream data analysis. In the presence of high-dimensional data, imputation models that include feature selection, especially $ell_1$ regularized regression (such as Lasso, adaptive Lasso, and Elastic Net), are common choices to prevent the model from underdetermination. However, conducting MI with feature selection is difficult: existing methods are often computationally inefficient and poor in performance. We propose MISNN, a novel and efficient algorithm that incorporates feature selection for MI. Leveraging the approximation power of neural networks, MISNN is a general and flexible framework, compatible with any feature selection method, any neural network architecture, high/low-dimensional data and general missing patterns. Through empirical experiments, MISNN has demonstrated great advantages over state-of-the-art imputation methods (e.g. Bayesian Lasso and matrix completion), in terms of imputation accuracy, statistical consistency and computation speed.
多重归算(Multiple imputation, MI)被广泛应用于生物医学、社会和计量经济学研究中的缺失值问题,以避免下游数据分析中的不正确推断。在存在高维数据的情况下,包括特征选择的输入模型,特别是正则化回归(如Lasso, adaptive Lasso和Elastic Net),是防止模型欠确定的常用选择。然而,用特征选择进行人工智能是困难的:现有的方法通常计算效率低,性能差。利用神经网络的近似能力,MISNN是一个通用的、灵活的框架,兼容任何特征选择方法、任何神经网络架构、高维/低维数据和一般缺失模式。通过实证实验,MISNN在插补精度、统计一致性和计算速度方面都比最先进的插补方法(如贝叶斯拉索和矩阵补全)有很大的优势。
{"title":"MISNN: Multiple Imputation via Semi-parametric Neural Networks","authors":"Zhiqi Bu, Zongyu Dai, Yiliang Zhang, Q. Long","doi":"10.48550/arXiv.2305.01794","DOIUrl":"https://doi.org/10.48550/arXiv.2305.01794","url":null,"abstract":"Multiple imputation (MI) has been widely applied to missing value problems in biomedical, social and econometric research, in order to avoid improper inference in the downstream data analysis. In the presence of high-dimensional data, imputation models that include feature selection, especially $ell_1$ regularized regression (such as Lasso, adaptive Lasso, and Elastic Net), are common choices to prevent the model from underdetermination. However, conducting MI with feature selection is difficult: existing methods are often computationally inefficient and poor in performance. We propose MISNN, a novel and efficient algorithm that incorporates feature selection for MI. Leveraging the approximation power of neural networks, MISNN is a general and flexible framework, compatible with any feature selection method, any neural network architecture, high/low-dimensional data and general missing patterns. Through empirical experiments, MISNN has demonstrated great advantages over state-of-the-art imputation methods (e.g. Bayesian Lasso and matrix completion), in terms of imputation accuracy, statistical consistency and computation speed.","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85953178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Knowledge Graph Entity Alignment with Graph Augmentation 利用图形增强改进知识图实体对齐
Feng Xie, Xiangji Zeng, Bin Zhou, Yusong Tan
Entity alignment (EA) which links equivalent entities across different knowledge graphs (KGs) plays a crucial role in knowledge fusion. In recent years, graph neural networks (GNNs) have been successfully applied in many embedding-based EA methods. However, existing GNN-based methods either suffer from the structural heterogeneity issue that especially appears in the real KG distributions or ignore the heterogeneous representation learning for unseen (unlabeled) entities, which would lead the model to overfit on few alignment seeds (i.e., training data) and thus cause unsatisfactory alignment performance. To enhance the EA ability, we propose GAEA, a novel EA approach based on graph augmentation. In this model, we design a simple Entity-Relation (ER) Encoder to generate latent representations for entities via jointly modeling comprehensive structural information and rich relation semantics. Moreover, we use graph augmentation to create two graph views for margin-based alignment learning and contrastive entity representation learning, thus mitigating structural heterogeneity and further improving the model's alignment performance. Extensive experiments conducted on benchmark datasets demonstrate the effectiveness of our method.
实体对齐(Entity alignment, EA)在知识融合中起着至关重要的作用,它将不同知识图谱中的等价实体连接在一起。近年来,图神经网络(gnn)已成功应用于许多基于嵌入的EA方法中。然而,现有的基于gnn的方法要么存在结构异质性问题,特别是在真实的KG分布中,要么忽略了对未见(未标记)实体的异构表示学习,这将导致模型在少数对齐种子(即训练数据)上过拟合,从而导致不满意的对齐性能。为了提高EA的能力,我们提出了一种新的基于图增广的EA方法。在该模型中,我们设计了一个简单的实体-关系(ER)编码器,通过联合建模全面的结构信息和丰富的关系语义来生成实体的潜在表示。此外,我们使用图增强技术创建了基于边界的对齐学习和对比实体表示学习的两个图视图,从而减轻了结构异质性,进一步提高了模型的对齐性能。在基准数据集上进行的大量实验证明了我们的方法的有效性。
{"title":"Improving Knowledge Graph Entity Alignment with Graph Augmentation","authors":"Feng Xie, Xiangji Zeng, Bin Zhou, Yusong Tan","doi":"10.48550/arXiv.2304.14585","DOIUrl":"https://doi.org/10.48550/arXiv.2304.14585","url":null,"abstract":"Entity alignment (EA) which links equivalent entities across different knowledge graphs (KGs) plays a crucial role in knowledge fusion. In recent years, graph neural networks (GNNs) have been successfully applied in many embedding-based EA methods. However, existing GNN-based methods either suffer from the structural heterogeneity issue that especially appears in the real KG distributions or ignore the heterogeneous representation learning for unseen (unlabeled) entities, which would lead the model to overfit on few alignment seeds (i.e., training data) and thus cause unsatisfactory alignment performance. To enhance the EA ability, we propose GAEA, a novel EA approach based on graph augmentation. In this model, we design a simple Entity-Relation (ER) Encoder to generate latent representations for entities via jointly modeling comprehensive structural information and rich relation semantics. Moreover, we use graph augmentation to create two graph views for margin-based alignment learning and contrastive entity representation learning, thus mitigating structural heterogeneity and further improving the model's alignment performance. Extensive experiments conducted on benchmark datasets demonstrate the effectiveness of our method.","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87169467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
TCR: Short Video Title Generation and Cover Selection with Attention Refinement 基于注意力细化的短视频标题生成和封面选择
Yu, Jiuding Yang, Weidong Guo, Hui Liu, Yu Xu, Di Niu
With the widespread popularity of user-generated short videos, it becomes increasingly challenging for content creators to promote their content to potential viewers. Automatically generating appealing titles and covers for short videos can help grab viewers' attention. Existing studies on video captioning mostly focus on generating factual descriptions of actions, which do not conform to video titles intended for catching viewer attention. Furthermore, research for cover selection based on multimodal information is sparse. These problems motivate the need for tailored methods to specifically support the joint task of short video title generation and cover selection (TG-CS) as well as the demand for creating corresponding datasets to support the studies. In this paper, we first collect and present a real-world dataset named Short Video Title Generation (SVTG) that contains videos with appealing titles and covers. We then propose a Title generation and Cover selection with attention Refinement (TCR) method for TG-CS. The refinement procedure progressively selects high-quality samples and highly relevant frames and text tokens within each sample to refine model training. Extensive experiments show that our TCR method is superior to various existing video captioning methods in generating titles and is able to select better covers for noisy real-world short videos.
随着用户生成短视频的广泛流行,内容创作者向潜在观众推广其内容变得越来越具有挑战性。为短视频自动生成吸引人的标题和封面有助于吸引观众的注意力。现有的视频字幕研究大多集中在生成动作的事实描述,这与旨在吸引观众注意力的视频标题不相符。此外,基于多模态信息的覆盖选择研究是稀疏的。这些问题激发了对定制方法的需求,以专门支持短视频标题生成和封面选择(TG-CS)的联合任务,以及创建相应数据集来支持研究的需求。在本文中,我们首先收集并呈现了一个名为短视频标题生成(SVTG)的真实数据集,该数据集包含具有吸引人的标题和封面的视频。然后,我们提出了一种基于注意力细化(TCR)的标题生成和封面选择方法。细化过程逐步选择高质量的样本和每个样本中高度相关的帧和文本标记来细化模型训练。大量的实验表明,我们的TCR方法在生成标题方面优于现有的各种视频字幕方法,并且能够为嘈杂的现实世界短视频选择更好的封面。
{"title":"TCR: Short Video Title Generation and Cover Selection with Attention Refinement","authors":"Yu, Jiuding Yang, Weidong Guo, Hui Liu, Yu Xu, Di Niu","doi":"10.48550/arXiv.2304.12561","DOIUrl":"https://doi.org/10.48550/arXiv.2304.12561","url":null,"abstract":"With the widespread popularity of user-generated short videos, it becomes increasingly challenging for content creators to promote their content to potential viewers. Automatically generating appealing titles and covers for short videos can help grab viewers' attention. Existing studies on video captioning mostly focus on generating factual descriptions of actions, which do not conform to video titles intended for catching viewer attention. Furthermore, research for cover selection based on multimodal information is sparse. These problems motivate the need for tailored methods to specifically support the joint task of short video title generation and cover selection (TG-CS) as well as the demand for creating corresponding datasets to support the studies. In this paper, we first collect and present a real-world dataset named Short Video Title Generation (SVTG) that contains videos with appealing titles and covers. We then propose a Title generation and Cover selection with attention Refinement (TCR) method for TG-CS. The refinement procedure progressively selects high-quality samples and highly relevant frames and text tokens within each sample to refine model training. Extensive experiments show that our TCR method is superior to various existing video captioning methods in generating titles and is able to select better covers for noisy real-world short videos.","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76891888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Regularization of the policy updates for stabilizing Mean Field Games 稳定平均场博弈的策略更新的正则化
Talal Algumaei, Rubén Solozabal, Réda Alami, Hakim Hacid, M. Debbah, Martin Takác
This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents due to the resultant non-stationarity that the many agents introduce. In order to address this issue, Mean Field Games (MFG) rely on the symmetry and homogeneity assumptions to approximate games with very large populations. Recently, deep Reinforcement Learning has been used to scale MFG to games with larger number of states. Current methods rely on smoothing techniques such as averaging the q-values or the updates on the mean-field distribution. This work presents a different approach to stabilize the learning based on proximal updates on the mean-field policy. We name our algorithm Mean Field Proximal Policy Optimization (MF-PPO), and we empirically show the effectiveness of our method in the OpenSpiel framework.
本文研究了多智能体在同一环境中以个体收益最大化为目标进行交互的非合作多智能体强化学习(MARL)。当增加代理数量时,由于许多代理引入的非平稳性而产生挑战。为了解决这个问题,平均场游戏(Mean Field Games, MFG)依靠对称性和同质性假设来近似具有大量人口的游戏。最近,深度强化学习被用于将MFG扩展到具有更多状态的游戏。目前的方法依赖于平滑技术,如平均q值或更新平均场分布。这项工作提出了一种基于平均场策略的近端更新来稳定学习的不同方法。我们将我们的算法命名为平均域近端策略优化(MF-PPO),并在OpenSpiel框架中实证地证明了我们的方法的有效性。
{"title":"Regularization of the policy updates for stabilizing Mean Field Games","authors":"Talal Algumaei, Rubén Solozabal, Réda Alami, Hakim Hacid, M. Debbah, Martin Takác","doi":"10.48550/arXiv.2304.01547","DOIUrl":"https://doi.org/10.48550/arXiv.2304.01547","url":null,"abstract":"This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents due to the resultant non-stationarity that the many agents introduce. In order to address this issue, Mean Field Games (MFG) rely on the symmetry and homogeneity assumptions to approximate games with very large populations. Recently, deep Reinforcement Learning has been used to scale MFG to games with larger number of states. Current methods rely on smoothing techniques such as averaging the q-values or the updates on the mean-field distribution. This work presents a different approach to stabilize the learning based on proximal updates on the mean-field policy. We name our algorithm Mean Field Proximal Policy Optimization (MF-PPO), and we empirically show the effectiveness of our method in the OpenSpiel framework.","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77109443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Model-Agnostic Reachability Analysis on Deep Neural Networks 深度神经网络模型不可知的可达性分析
Chi Zhang, Wenjie Ruan, Fu Lee Wang, Peipei Xu, Geyong Min, Xiaowei Huang
Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one particular network category, e.g., Feedforward Neural Networks (FNNs), or networks with specific activation functions, e.g., RdLU. In this paper, we develop a model-agnostic verification framework, called DeepAgn, and show that it can be applied to FNNs, Recurrent Neural Networks (RNNs), or a mixture of both. Under the assumption of Lipschitz continuity, DeepAgn analyses the reachability of DNNs based on a novel optimisation scheme with a global convergence guarantee. It does not require access to the network's internal structures, such as layers and parameters. Through reachability analysis, DeepAgn can tackle several well-known robustness problems, including computing the maximum safe radius for a given input, and generating the ground-truth adversarial examples. We also empirically demonstrate DeepAgn's superior capability and efficiency in handling a broader class of deep neural networks, including both FNNs, and RNNs with very deep layers and millions of neurons, than other state-of-the-art verification approaches.
验证在安全关键系统的形式化分析中起着至关重要的作用。目前大多数验证方法在处理深度神经网络(dnn)时都有特定的要求。它们要么针对一个特定的网络类别,例如前馈神经网络(fnn),要么针对具有特定激活函数的网络,例如RdLU。在本文中,我们开发了一个模型不可知的验证框架,称为DeepAgn,并表明它可以应用于fnn,递归神经网络(rnn),或两者的混合。在Lipschitz连续性假设下,DeepAgn基于一种具有全局收敛保证的优化方案分析了dnn的可达性。它不需要访问网络的内部结构,如层和参数。通过可达性分析,DeepAgn可以解决几个众所周知的鲁棒性问题,包括计算给定输入的最大安全半径,以及生成真实的对抗示例。与其他最先进的验证方法相比,我们还通过经验证明了DeepAgn在处理更广泛的深度神经网络(包括fnn和具有非常深层和数百万神经元的rnn)方面的卓越能力和效率。
{"title":"Model-Agnostic Reachability Analysis on Deep Neural Networks","authors":"Chi Zhang, Wenjie Ruan, Fu Lee Wang, Peipei Xu, Geyong Min, Xiaowei Huang","doi":"10.48550/arXiv.2304.00813","DOIUrl":"https://doi.org/10.48550/arXiv.2304.00813","url":null,"abstract":"Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one particular network category, e.g., Feedforward Neural Networks (FNNs), or networks with specific activation functions, e.g., RdLU. In this paper, we develop a model-agnostic verification framework, called DeepAgn, and show that it can be applied to FNNs, Recurrent Neural Networks (RNNs), or a mixture of both. Under the assumption of Lipschitz continuity, DeepAgn analyses the reachability of DNNs based on a novel optimisation scheme with a global convergence guarantee. It does not require access to the network's internal structures, such as layers and parameters. Through reachability analysis, DeepAgn can tackle several well-known robustness problems, including computing the maximum safe radius for a given input, and generating the ground-truth adversarial examples. We also empirically demonstrate DeepAgn's superior capability and efficiency in handling a broader class of deep neural networks, including both FNNs, and RNNs with very deep layers and millions of neurons, than other state-of-the-art verification approaches.","PeriodicalId":91995,"journal":{"name":"Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86978074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Advances in Knowledge Discovery and Data Mining : 21st Pacific-Asia Conference, PAKDD 2017, Jeju, South Korea, May 23-26, 2017, Proceedings. Part I. Pacific-Asia Conference on Knowledge Discovery and Data Mining (21st : 2017 : Cheju Isl...
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1