Fulan Qian, Wenbin Chen, Hai Chen, Jinggang Liu, Shu Zhao, Yanping Zhang
{"title":"构建鲁棒深度推荐系统:利用带有鲁棒微调模块的加权对抗噪声传播框架","authors":"Fulan Qian, Wenbin Chen, Hai Chen, Jinggang Liu, Shu Zhao, Yanping Zhang","doi":"10.1016/j.knosys.2025.113181","DOIUrl":null,"url":null,"abstract":"<div><div>The performance of deep recommendation algorithms decreases significantly under adversarial attacks. While some approaches improve the recommender system robustness via adversarial training, they primarily target shallow models or rely on coarse-grained noise, so that deep models remain vulnerable. This study proposes a new adversarial training framework, the Random Adversarial Weight Perturbation Framework Equipped with Robust Fine-Tuning (RAWP-FT). Specifically, RAWP-FT first performs adversarial training of deep models by introducing more fine-grained adversarial noise into the hidden layer weight parameters. Subsequently, RAWP-FT identifies and targets the modules or layers with the lowest robustness after adversarial training and performs specialized adversarial training and fine-tuning to improve the model robustness further. Experiments demonstrate that RAWP-FT significantly enhances the robustness of deep recommendation models. We apply RAWP-FT to MLP and other deep models, highlighting its ability to strengthen vulnerable components through robust critical fine-tuning. Experiments on four publicly available datasets confirm that RAWP-FT-trained models can withstand adversarial noise while maintaining performance.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"314 ","pages":"Article 113181"},"PeriodicalIF":7.6000,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Building robust deep recommender systems: Utilizing a weighted adversarial noise propagation framework with robust fine-tuning modules\",\"authors\":\"Fulan Qian, Wenbin Chen, Hai Chen, Jinggang Liu, Shu Zhao, Yanping Zhang\",\"doi\":\"10.1016/j.knosys.2025.113181\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The performance of deep recommendation algorithms decreases significantly under adversarial attacks. While some approaches improve the recommender system robustness via adversarial training, they primarily target shallow models or rely on coarse-grained noise, so that deep models remain vulnerable. This study proposes a new adversarial training framework, the Random Adversarial Weight Perturbation Framework Equipped with Robust Fine-Tuning (RAWP-FT). Specifically, RAWP-FT first performs adversarial training of deep models by introducing more fine-grained adversarial noise into the hidden layer weight parameters. Subsequently, RAWP-FT identifies and targets the modules or layers with the lowest robustness after adversarial training and performs specialized adversarial training and fine-tuning to improve the model robustness further. Experiments demonstrate that RAWP-FT significantly enhances the robustness of deep recommendation models. We apply RAWP-FT to MLP and other deep models, highlighting its ability to strengthen vulnerable components through robust critical fine-tuning. Experiments on four publicly available datasets confirm that RAWP-FT-trained models can withstand adversarial noise while maintaining performance.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":\"314 \",\"pages\":\"Article 113181\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2025-04-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S095070512500228X\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S095070512500228X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Building robust deep recommender systems: Utilizing a weighted adversarial noise propagation framework with robust fine-tuning modules
The performance of deep recommendation algorithms decreases significantly under adversarial attacks. While some approaches improve the recommender system robustness via adversarial training, they primarily target shallow models or rely on coarse-grained noise, so that deep models remain vulnerable. This study proposes a new adversarial training framework, the Random Adversarial Weight Perturbation Framework Equipped with Robust Fine-Tuning (RAWP-FT). Specifically, RAWP-FT first performs adversarial training of deep models by introducing more fine-grained adversarial noise into the hidden layer weight parameters. Subsequently, RAWP-FT identifies and targets the modules or layers with the lowest robustness after adversarial training and performs specialized adversarial training and fine-tuning to improve the model robustness further. Experiments demonstrate that RAWP-FT significantly enhances the robustness of deep recommendation models. We apply RAWP-FT to MLP and other deep models, highlighting its ability to strengthen vulnerable components through robust critical fine-tuning. Experiments on four publicly available datasets confirm that RAWP-FT-trained models can withstand adversarial noise while maintaining performance.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.