Jingtong Huang , Xu Ma , Yuan Ma , Kehao Chen , Xiaoyu Zhang
{"title":"具有鲁棒聚合和隐私增强的双通道元联邦图学习","authors":"Jingtong Huang , Xu Ma , Yuan Ma , Kehao Chen , Xiaoyu Zhang","doi":"10.1016/j.future.2024.107677","DOIUrl":null,"url":null,"abstract":"<div><div>Graph neural networks (GNNs) are effective for graph-based node classification tasks, such as data mining and recommendation systems. Combining federated learning(FL) with GNN enables multiple participants to collaboratively train powerful models without sharing private data. However, subgraph-level FL faces challenges, including missing cross-client edges and non-IID data distributions. Additionally, ensuring security in non-fully trusted environments is a critical concern. To address these issues, we propose RMFGL (<strong>R</strong>obust <strong>M</strong>eta <strong>F</strong>ederated <strong>G</strong>raph <strong>L</strong>earning), a framework for subgraph-level node classification. RMFGL integrates cross-client information through pre-feature aggregation and leverages model-agnostic meta-learning (MAML) to optimize meta-parameters with minimal federated updates. For robustness, we employ a GCN architecture with dual-channel attention aggregation, while Multi-key Fully Homomorphic Encryption (MKFHE) ensures privacy during training. Experimental results on Cora, CiteSeer, PubMed and Coauthor-CS datasets show that RMFGL achieves up to a 2x accuracy improvement with minimal fine-tuning compared to baseline methods and outperforms state-of-the-art techniques. Notably, RMFGL significantly enhances robustness against malicious clients, with up to 100x improvement in stability, while maintaining strong performance with non-IID data.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":"166 ","pages":"Article 107677"},"PeriodicalIF":6.2000,"publicationDate":"2024-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-channel meta-federated graph learning with robust aggregation and privacy enhancement\",\"authors\":\"Jingtong Huang , Xu Ma , Yuan Ma , Kehao Chen , Xiaoyu Zhang\",\"doi\":\"10.1016/j.future.2024.107677\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Graph neural networks (GNNs) are effective for graph-based node classification tasks, such as data mining and recommendation systems. Combining federated learning(FL) with GNN enables multiple participants to collaboratively train powerful models without sharing private data. However, subgraph-level FL faces challenges, including missing cross-client edges and non-IID data distributions. Additionally, ensuring security in non-fully trusted environments is a critical concern. To address these issues, we propose RMFGL (<strong>R</strong>obust <strong>M</strong>eta <strong>F</strong>ederated <strong>G</strong>raph <strong>L</strong>earning), a framework for subgraph-level node classification. RMFGL integrates cross-client information through pre-feature aggregation and leverages model-agnostic meta-learning (MAML) to optimize meta-parameters with minimal federated updates. For robustness, we employ a GCN architecture with dual-channel attention aggregation, while Multi-key Fully Homomorphic Encryption (MKFHE) ensures privacy during training. Experimental results on Cora, CiteSeer, PubMed and Coauthor-CS datasets show that RMFGL achieves up to a 2x accuracy improvement with minimal fine-tuning compared to baseline methods and outperforms state-of-the-art techniques. Notably, RMFGL significantly enhances robustness against malicious clients, with up to 100x improvement in stability, while maintaining strong performance with non-IID data.</div></div>\",\"PeriodicalId\":55132,\"journal\":{\"name\":\"Future Generation Computer Systems-The International Journal of Escience\",\"volume\":\"166 \",\"pages\":\"Article 107677\"},\"PeriodicalIF\":6.2000,\"publicationDate\":\"2024-12-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Future Generation Computer Systems-The International Journal of Escience\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167739X24006411\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, THEORY & METHODS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X24006411","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
Dual-channel meta-federated graph learning with robust aggregation and privacy enhancement
Graph neural networks (GNNs) are effective for graph-based node classification tasks, such as data mining and recommendation systems. Combining federated learning(FL) with GNN enables multiple participants to collaboratively train powerful models without sharing private data. However, subgraph-level FL faces challenges, including missing cross-client edges and non-IID data distributions. Additionally, ensuring security in non-fully trusted environments is a critical concern. To address these issues, we propose RMFGL (Robust Meta Federated Graph Learning), a framework for subgraph-level node classification. RMFGL integrates cross-client information through pre-feature aggregation and leverages model-agnostic meta-learning (MAML) to optimize meta-parameters with minimal federated updates. For robustness, we employ a GCN architecture with dual-channel attention aggregation, while Multi-key Fully Homomorphic Encryption (MKFHE) ensures privacy during training. Experimental results on Cora, CiteSeer, PubMed and Coauthor-CS datasets show that RMFGL achieves up to a 2x accuracy improvement with minimal fine-tuning compared to baseline methods and outperforms state-of-the-art techniques. Notably, RMFGL significantly enhances robustness against malicious clients, with up to 100x improvement in stability, while maintaining strong performance with non-IID data.
期刊介绍:
Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications.
Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration.
Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.