Zeju Xu;Guanzheng Liu;Guozhen Zhao;Zhiguo Zhang;Chenzhong Li;Changhong Wang
{"title":"A Topic-Guided Self-Attention Network for Daily Mental Wellbeing Prediction Using Mobile Devices","authors":"Zeju Xu;Guanzheng Liu;Guozhen Zhao;Zhiguo Zhang;Chenzhong Li;Changhong Wang","doi":"10.1109/TAFFC.2024.3471654","DOIUrl":null,"url":null,"abstract":"Prediction of daily mental wellbeing holds profound implications for individual healthcare and societal stability. Previous studies have shown the potential of using individual's multimodal behavioral data collected through mobile devices to predict his/her daily mental wellbeing metrics, such as stress, mood, and anxiety. However, effectively capturing long-range dependencies in behavioral time series data while accurately representing the statistical distribution patterns of various behaviors over a certain period is a significant challenge. In this paper, we propose a daily mental wellbeing prediction model based on a Topic-Guided Self-Attention Network (TGSAN). This model utilizes self-attention mechanism to capture long-range dependencies from the behavioral data collected by mobile devices. We utilize a multi-granularity time encoding method to inject time information of different granularities (i.e., day and hour, or week and day) into the behavioral data, thereby enhancing the sensibility of the self-attention network to capture every individual's habitual cyclicality rhythm. Then, we introduce a neural topic model to analyze the statistical distribution characteristics of various behaviors in the monitoring period as behavioral distribution patterns for different individuals, and further propose a topic attention network to enhance the model's classification performance by guiding the weights of long-range dependencies features from the self-attention network with the derived topic information. Compared to state-of-the-art methods, the proposed TGSAN achieved superior performance on datasets that measure different mental health indicators (stress, mood, and anxiety), with F1 scores outperforming by 4.5% and 2.3% on the Crosscheck and StudentLife datasets, respectively, and accuracy outperforming by 3.3% on the GLOBEM dataset. Our study demonstrates the effectiveness and interpretability of combining self-attention mechanisms with neural topic model, for a better understanding of the relationship between different individuals’ behaviors and their mental wellbeing.","PeriodicalId":13131,"journal":{"name":"IEEE Transactions on Affective Computing","volume":"16 2","pages":"783-798"},"PeriodicalIF":9.8000,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Affective Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10700969/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Prediction of daily mental wellbeing holds profound implications for individual healthcare and societal stability. Previous studies have shown the potential of using individual's multimodal behavioral data collected through mobile devices to predict his/her daily mental wellbeing metrics, such as stress, mood, and anxiety. However, effectively capturing long-range dependencies in behavioral time series data while accurately representing the statistical distribution patterns of various behaviors over a certain period is a significant challenge. In this paper, we propose a daily mental wellbeing prediction model based on a Topic-Guided Self-Attention Network (TGSAN). This model utilizes self-attention mechanism to capture long-range dependencies from the behavioral data collected by mobile devices. We utilize a multi-granularity time encoding method to inject time information of different granularities (i.e., day and hour, or week and day) into the behavioral data, thereby enhancing the sensibility of the self-attention network to capture every individual's habitual cyclicality rhythm. Then, we introduce a neural topic model to analyze the statistical distribution characteristics of various behaviors in the monitoring period as behavioral distribution patterns for different individuals, and further propose a topic attention network to enhance the model's classification performance by guiding the weights of long-range dependencies features from the self-attention network with the derived topic information. Compared to state-of-the-art methods, the proposed TGSAN achieved superior performance on datasets that measure different mental health indicators (stress, mood, and anxiety), with F1 scores outperforming by 4.5% and 2.3% on the Crosscheck and StudentLife datasets, respectively, and accuracy outperforming by 3.3% on the GLOBEM dataset. Our study demonstrates the effectiveness and interpretability of combining self-attention mechanisms with neural topic model, for a better understanding of the relationship between different individuals’ behaviors and their mental wellbeing.
期刊介绍:
The IEEE Transactions on Affective Computing is an international and interdisciplinary journal. Its primary goal is to share research findings on the development of systems capable of recognizing, interpreting, and simulating human emotions and related affective phenomena. The journal publishes original research on the underlying principles and theories that explain how and why affective factors shape human-technology interactions. It also focuses on how techniques for sensing and simulating affect can enhance our understanding of human emotions and processes. Additionally, the journal explores the design, implementation, and evaluation of systems that prioritize the consideration of affect in their usability. We also welcome surveys of existing work that provide new perspectives on the historical and future directions of this field.