Zheng-Ang Su, Juan Zhang, Zhijun Fang, Yongbin Gao
{"title":"Enhanced side information fusion framework for sequential recommendation","authors":"Zheng-Ang Su, Juan Zhang, Zhijun Fang, Yongbin Gao","doi":"10.1007/s13042-024-02328-8","DOIUrl":null,"url":null,"abstract":"<p>The fusion of side information in sequential recommendation (SR) is a recommendation system technique that combines a user’s historical behavior sequence with additional side information to provide more accurate personalized recommendations. Recent methods are based on self-attention mechanisms, incorporating side information as part of the attention matrix to update item representations. We believe that the integration method via self-attention mechanisms does not fully utilize side information. Therefore, we designed a new <b>E</b>nhanced <b>S</b>ide <b>I</b>nformation <b>F</b>usion framework (ESIF) for sequential recommendations. Specifically, we have altered the fusion strategy by using an attention matrix to simultaneously update the representations of items and side information, thereby increasing the use of side information. The attention matrix serves to balance various features, ensuring effective utilization of side information throughout the fusion process. We designed a Gated Linear Representation Fusion Module, comprising linear transformations and gated units. The linear transformation processes the input data, while the gated unit dynamically adjusts the degree of information flow based on the input. This module then combines the updated item representation with the side information representation for more efficient use of side information. Additionally, user interaction behavior data inevitably contains noise. The presence of noise can disrupt the model’s performance, affecting the accuracy and reliability of the results. Therefore, we introduced a denoising module in ESIF to enhance recommendation accuracy by reducing noise. Our experimental results demonstrate that ESIF achieves superior performance across five real-world datasets, surpassing the current state-of-the-art side information fusion SR models.</p>","PeriodicalId":51327,"journal":{"name":"International Journal of Machine Learning and Cybernetics","volume":"58 1","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Machine Learning and Cybernetics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s13042-024-02328-8","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
The fusion of side information in sequential recommendation (SR) is a recommendation system technique that combines a user’s historical behavior sequence with additional side information to provide more accurate personalized recommendations. Recent methods are based on self-attention mechanisms, incorporating side information as part of the attention matrix to update item representations. We believe that the integration method via self-attention mechanisms does not fully utilize side information. Therefore, we designed a new Enhanced Side Information Fusion framework (ESIF) for sequential recommendations. Specifically, we have altered the fusion strategy by using an attention matrix to simultaneously update the representations of items and side information, thereby increasing the use of side information. The attention matrix serves to balance various features, ensuring effective utilization of side information throughout the fusion process. We designed a Gated Linear Representation Fusion Module, comprising linear transformations and gated units. The linear transformation processes the input data, while the gated unit dynamically adjusts the degree of information flow based on the input. This module then combines the updated item representation with the side information representation for more efficient use of side information. Additionally, user interaction behavior data inevitably contains noise. The presence of noise can disrupt the model’s performance, affecting the accuracy and reliability of the results. Therefore, we introduced a denoising module in ESIF to enhance recommendation accuracy by reducing noise. Our experimental results demonstrate that ESIF achieves superior performance across five real-world datasets, surpassing the current state-of-the-art side information fusion SR models.
期刊介绍:
Cybernetics is concerned with describing complex interactions and interrelationships between systems which are omnipresent in our daily life. Machine Learning discovers fundamental functional relationships between variables and ensembles of variables in systems. The merging of the disciplines of Machine Learning and Cybernetics is aimed at the discovery of various forms of interaction between systems through diverse mechanisms of learning from data.
The International Journal of Machine Learning and Cybernetics (IJMLC) focuses on the key research problems emerging at the junction of machine learning and cybernetics and serves as a broad forum for rapid dissemination of the latest advancements in the area. The emphasis of IJMLC is on the hybrid development of machine learning and cybernetics schemes inspired by different contributing disciplines such as engineering, mathematics, cognitive sciences, and applications. New ideas, design alternatives, implementations and case studies pertaining to all the aspects of machine learning and cybernetics fall within the scope of the IJMLC.
Key research areas to be covered by the journal include:
Machine Learning for modeling interactions between systems
Pattern Recognition technology to support discovery of system-environment interaction
Control of system-environment interactions
Biochemical interaction in biological and biologically-inspired systems
Learning for improvement of communication schemes between systems