{"title":"DST:通过分解和协同任务的共性和特殊性来进行连续事件预测","authors":"Yuxin Zhang , Songlin Zhai , Yongrui Chen , Shenyu Zhang , Sheng Bi , Yuan Meng , Guilin Qi","doi":"10.1016/j.ipm.2024.103899","DOIUrl":null,"url":null,"abstract":"<div><div>Event prediction aims to forecast future events by analyzing the inherent development patterns of historical events. A desirable event prediction system should learn new event knowledge, and adapt to new domains or tasks that arise in real-world application scenarios. However, continuous training can lead to catastrophic forgetting of the model. While existing continuous learning methods can retain characteristic knowledge from previous domains, they ignore potential shared knowledge in subsequent tasks. To tackle these challenges, we propose a novel event prediction method based on graph structural commonality and domain characteristic prompts, which not only avoids forgetting but also facilitates bi-directional knowledge transfer across domains. Specifically, we mitigate model forgetting by designing domain characteristic-oriented prompts in a continuous task stream with frozen the backbone pre-trained model. Building upon this, we further devise a commonality-based adaptive updating algorithm by harnessing a unique structural commonality prompt to inspire implicit common features across domains. Our experimental results on two public benchmark datasets for event prediction demonstrate the effectiveness of our proposed continuous learning event prediction method compared to state-of-the-art baselines. In tests conducted on the IED-Stream, DST’s ET-TA metric significantly improved by 5.6% over the current best baseline model, while the ET-MD metric, which reveals forgetting, decreased by 5.8%.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"62 1","pages":"Article 103899"},"PeriodicalIF":7.4000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DST: Continual event prediction by decomposing and synergizing the task commonality and specificity\",\"authors\":\"Yuxin Zhang , Songlin Zhai , Yongrui Chen , Shenyu Zhang , Sheng Bi , Yuan Meng , Guilin Qi\",\"doi\":\"10.1016/j.ipm.2024.103899\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Event prediction aims to forecast future events by analyzing the inherent development patterns of historical events. A desirable event prediction system should learn new event knowledge, and adapt to new domains or tasks that arise in real-world application scenarios. However, continuous training can lead to catastrophic forgetting of the model. While existing continuous learning methods can retain characteristic knowledge from previous domains, they ignore potential shared knowledge in subsequent tasks. To tackle these challenges, we propose a novel event prediction method based on graph structural commonality and domain characteristic prompts, which not only avoids forgetting but also facilitates bi-directional knowledge transfer across domains. Specifically, we mitigate model forgetting by designing domain characteristic-oriented prompts in a continuous task stream with frozen the backbone pre-trained model. Building upon this, we further devise a commonality-based adaptive updating algorithm by harnessing a unique structural commonality prompt to inspire implicit common features across domains. Our experimental results on two public benchmark datasets for event prediction demonstrate the effectiveness of our proposed continuous learning event prediction method compared to state-of-the-art baselines. In tests conducted on the IED-Stream, DST’s ET-TA metric significantly improved by 5.6% over the current best baseline model, while the ET-MD metric, which reveals forgetting, decreased by 5.8%.</div></div>\",\"PeriodicalId\":50365,\"journal\":{\"name\":\"Information Processing & Management\",\"volume\":\"62 1\",\"pages\":\"Article 103899\"},\"PeriodicalIF\":7.4000,\"publicationDate\":\"2024-09-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Processing & Management\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306457324002589\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457324002589","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
DST: Continual event prediction by decomposing and synergizing the task commonality and specificity
Event prediction aims to forecast future events by analyzing the inherent development patterns of historical events. A desirable event prediction system should learn new event knowledge, and adapt to new domains or tasks that arise in real-world application scenarios. However, continuous training can lead to catastrophic forgetting of the model. While existing continuous learning methods can retain characteristic knowledge from previous domains, they ignore potential shared knowledge in subsequent tasks. To tackle these challenges, we propose a novel event prediction method based on graph structural commonality and domain characteristic prompts, which not only avoids forgetting but also facilitates bi-directional knowledge transfer across domains. Specifically, we mitigate model forgetting by designing domain characteristic-oriented prompts in a continuous task stream with frozen the backbone pre-trained model. Building upon this, we further devise a commonality-based adaptive updating algorithm by harnessing a unique structural commonality prompt to inspire implicit common features across domains. Our experimental results on two public benchmark datasets for event prediction demonstrate the effectiveness of our proposed continuous learning event prediction method compared to state-of-the-art baselines. In tests conducted on the IED-Stream, DST’s ET-TA metric significantly improved by 5.6% over the current best baseline model, while the ET-MD metric, which reveals forgetting, decreased by 5.8%.
期刊介绍:
Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing.
We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.