DropEdge的自适应节点相似度

IF 6.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Neurocomputing Pub Date : 2025-04-14 Epub Date: 2025-02-04 DOI:10.1016/j.neucom.2025.129574
Yangcai Xie, Jiecheng Li, Shichao Zhang
{"title":"DropEdge的自适应节点相似度","authors":"Yangcai Xie,&nbsp;Jiecheng Li,&nbsp;Shichao Zhang","doi":"10.1016/j.neucom.2025.129574","DOIUrl":null,"url":null,"abstract":"<div><div>There are two principal impediments of expanding deep graph convolutional networks (GCNs) due to the assumption of smoothness, <em>i.e.,</em> over-fitting and over-smoothing. DropEdge methods relieve the convergence speed and reduce the information loss by randomly dropping a specific rate of edges, hence effectively alleviates these two issues and has been widely used to many backbone models. However, thanks to the blindness and potential risks of randomly removing edges, current DropEdge methods often remove important edges and retain unimportant edges, this inevitably reduce the accuracy of learning results. In order to tackle the challenges in previous DropEdge methods, this paper proposes a precise removal technique through the node similarity, which is closely related to edges. Specifically, we employ the hybrid optimal node similarity to drop edges, on the one hand, the edges that severely affect over-fitting and over-smoothing of nodes, i.e., the edges with high node similarity, are removed; on the other hand, the edges that are outliers and noisy, i.e., the edges with a large difference in similarity to normal nodes, are also removed. Therefore, our methods significantly alleviate over-fitting and over-smoothing, accurately reduce the impact of outliers and noise, more importantly, our methods is a generic skill that can be deployed current GCN and its variants. Experimental results on seven benchmark datasets including three assortative datasets and four disassortative datasets show that our methods outperforms the state-of-the-art methods, improve the performance by a large margin especially for disassortative graphs.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"626 ","pages":"Article 129574"},"PeriodicalIF":6.5000,"publicationDate":"2025-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive node similarity for DropEdge\",\"authors\":\"Yangcai Xie,&nbsp;Jiecheng Li,&nbsp;Shichao Zhang\",\"doi\":\"10.1016/j.neucom.2025.129574\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>There are two principal impediments of expanding deep graph convolutional networks (GCNs) due to the assumption of smoothness, <em>i.e.,</em> over-fitting and over-smoothing. DropEdge methods relieve the convergence speed and reduce the information loss by randomly dropping a specific rate of edges, hence effectively alleviates these two issues and has been widely used to many backbone models. However, thanks to the blindness and potential risks of randomly removing edges, current DropEdge methods often remove important edges and retain unimportant edges, this inevitably reduce the accuracy of learning results. In order to tackle the challenges in previous DropEdge methods, this paper proposes a precise removal technique through the node similarity, which is closely related to edges. Specifically, we employ the hybrid optimal node similarity to drop edges, on the one hand, the edges that severely affect over-fitting and over-smoothing of nodes, i.e., the edges with high node similarity, are removed; on the other hand, the edges that are outliers and noisy, i.e., the edges with a large difference in similarity to normal nodes, are also removed. Therefore, our methods significantly alleviate over-fitting and over-smoothing, accurately reduce the impact of outliers and noise, more importantly, our methods is a generic skill that can be deployed current GCN and its variants. Experimental results on seven benchmark datasets including three assortative datasets and four disassortative datasets show that our methods outperforms the state-of-the-art methods, improve the performance by a large margin especially for disassortative graphs.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"626 \",\"pages\":\"Article 129574\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-04-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225002462\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/4 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225002462","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

由于对平滑性的假设,扩展深度图卷积网络(GCNs)存在两个主要障碍,即过度拟合和过度平滑。DropEdge方法通过随机丢弃特定比率的边缘,降低了收敛速度和信息损失,有效地缓解了这两个问题,并被广泛应用于许多骨干模型。然而,由于随机去除边缘的盲目性和潜在的风险,目前的DropEdge方法往往会去除重要的边缘,保留不重要的边缘,这必然会降低学习结果的准确性。为了解决以往DropEdge方法存在的问题,本文提出了一种利用与边缘密切相关的节点相似度进行精确去除的方法。具体地说,我们采用混合最优节点相似度来丢边,一方面去除了严重影响节点过拟合和过平滑的边缘,即节点相似度高的边缘;另一方面,对于异常点和有噪声的边缘,即与正常节点相似度差异较大的边缘,也会被去除。因此,我们的方法显著减轻了过拟合和过度平滑,准确地降低了异常值和噪声的影响,更重要的是,我们的方法是一种通用技能,可以部署当前GCN及其变体。在包括3个分类数据集和4个分类数据集在内的7个基准数据集上的实验结果表明,我们的方法优于目前最先进的方法,特别是对分类图的性能有很大的提高。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Adaptive node similarity for DropEdge
There are two principal impediments of expanding deep graph convolutional networks (GCNs) due to the assumption of smoothness, i.e., over-fitting and over-smoothing. DropEdge methods relieve the convergence speed and reduce the information loss by randomly dropping a specific rate of edges, hence effectively alleviates these two issues and has been widely used to many backbone models. However, thanks to the blindness and potential risks of randomly removing edges, current DropEdge methods often remove important edges and retain unimportant edges, this inevitably reduce the accuracy of learning results. In order to tackle the challenges in previous DropEdge methods, this paper proposes a precise removal technique through the node similarity, which is closely related to edges. Specifically, we employ the hybrid optimal node similarity to drop edges, on the one hand, the edges that severely affect over-fitting and over-smoothing of nodes, i.e., the edges with high node similarity, are removed; on the other hand, the edges that are outliers and noisy, i.e., the edges with a large difference in similarity to normal nodes, are also removed. Therefore, our methods significantly alleviate over-fitting and over-smoothing, accurately reduce the impact of outliers and noise, more importantly, our methods is a generic skill that can be deployed current GCN and its variants. Experimental results on seven benchmark datasets including three assortative datasets and four disassortative datasets show that our methods outperforms the state-of-the-art methods, improve the performance by a large margin especially for disassortative graphs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
期刊最新文献
TF-GNN: A temporal feedback graph neural network with discriminative regularization for heterogeneous fraud detection FSSG: Generative few-shot object detection via style-geometry fusion SSFA-Net: Sparse strip and dual-domain spatial-frequency attention for efficient image dehazing Analysis of adaptive optimal control theory for nonzero-sum stackelberg game based on high-order neural networks and conjugate gradient method Blind confusion of classification networks: A black box evaluation under common and structured image corruptions
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1