Contrastive Learning Network for Unsupervised Graph Matching

IF 11.1 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Circuits and Systems for Video Technology Pub Date : 2024-09-10 DOI:10.1109/TCSVT.2024.3457575
Yu Xie;Lianhang Luo;Tianpei Cao;Bin Yu;A. K. Qin
{"title":"Contrastive Learning Network for Unsupervised Graph Matching","authors":"Yu Xie;Lianhang Luo;Tianpei Cao;Bin Yu;A. K. Qin","doi":"10.1109/TCSVT.2024.3457575","DOIUrl":null,"url":null,"abstract":"Graph matching aims to establish node correspondences between graphs, which is a classic combinatorial optimization problem. In recent years, (deep) learning-based methods have emerged as a superior alternative to traditional graph matching solvers. However, these methods typically rely on node-level correspondence labels, which can be prohibitively expensive or unrealistic. Inspired by contrastive learning that is a prevalent paradigm for self-supervised representation learning, we develop a Contrastive Learning Network for Unsupervised Graph Matching (CUGM), which is an end-to-end differentiable pipeline to learn node permutations. Specifically, we propose three-level augmentation including raw image augmentation, graph augmentation and model augmentation for generating diverse enough contrastive views to enrich training instances. Then a contrastive learning network is constructed to capture the higher-order structural information in graphs and learn the final node representations for yielding the affinity matrix to directly solve a linear assignment problem. More importantly, we propose a node-level contrastive loss with false negative cancellation for optimizing the whole network to extract the tailored node feature representations to improve graph matching accuracy. Experimental results on standard graph matching benchmarks demonstrate that our end-to-end unsupervised method achieves the competitive performance compared with state-of-the-art supervised and unsupervised graph matching methods.","PeriodicalId":13082,"journal":{"name":"IEEE Transactions on Circuits and Systems for Video Technology","volume":"35 1","pages":"643-656"},"PeriodicalIF":11.1000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems for Video Technology","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10671578/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Graph matching aims to establish node correspondences between graphs, which is a classic combinatorial optimization problem. In recent years, (deep) learning-based methods have emerged as a superior alternative to traditional graph matching solvers. However, these methods typically rely on node-level correspondence labels, which can be prohibitively expensive or unrealistic. Inspired by contrastive learning that is a prevalent paradigm for self-supervised representation learning, we develop a Contrastive Learning Network for Unsupervised Graph Matching (CUGM), which is an end-to-end differentiable pipeline to learn node permutations. Specifically, we propose three-level augmentation including raw image augmentation, graph augmentation and model augmentation for generating diverse enough contrastive views to enrich training instances. Then a contrastive learning network is constructed to capture the higher-order structural information in graphs and learn the final node representations for yielding the affinity matrix to directly solve a linear assignment problem. More importantly, we propose a node-level contrastive loss with false negative cancellation for optimizing the whole network to extract the tailored node feature representations to improve graph matching accuracy. Experimental results on standard graph matching benchmarks demonstrate that our end-to-end unsupervised method achieves the competitive performance compared with state-of-the-art supervised and unsupervised graph matching methods.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于无监督图匹配的对比学习网络
图匹配的目的是建立图之间的节点对应关系,是一个经典的组合优化问题。近年来,基于(深度)学习的方法已经成为传统图匹配解决方案的一种优越选择。然而,这些方法通常依赖于节点级对应标签,这可能非常昂贵或不现实。受自监督表示学习中流行的对比学习范式的启发,我们开发了一种用于无监督图匹配的对比学习网络(cucm),这是一种端到端的可微管道,用于学习节点排列。具体来说,我们提出了原始图像增强、图形增强和模型增强三级增强,以生成足够多样化的对比视图,丰富训练实例。然后构建对比学习网络,捕获图中的高阶结构信息,学习最终节点表示,生成亲和矩阵,直接解决线性分配问题。更重要的是,我们提出了一种带有假负抵消的节点级对比损失,用于优化整个网络,以提取定制的节点特征表示,以提高图匹配精度。在标准图匹配基准上的实验结果表明,我们的端到端无监督图匹配方法与最先进的有监督和无监督图匹配方法相比,取得了具有竞争力的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
13.80
自引率
27.40%
发文量
660
审稿时长
5 months
期刊介绍: The IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) is dedicated to covering all aspects of video technologies from a circuits and systems perspective. We encourage submissions of general, theoretical, and application-oriented papers related to image and video acquisition, representation, presentation, and display. Additionally, we welcome contributions in areas such as processing, filtering, and transforms; analysis and synthesis; learning and understanding; compression, transmission, communication, and networking; as well as storage, retrieval, indexing, and search. Furthermore, papers focusing on hardware and software design and implementation are highly valued. Join us in advancing the field of video technology through innovative research and insights.
期刊最新文献
TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation GSCodec Studio: A Modular Framework for Gaussian Splat Compression Syntax Element Encryption for H.265/HEVC Using Chaotic Map-Based Coefficient Scrambling Scheme Learning Confidence-Aware Prototypes for Weakly-Supervised Video Anomaly Detection Learned Point Cloud Attribute Compression With Cross-Scale Point Transformer and Geometry-Aware Context Prediction Entropy Model
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1