Speech based suicide risk recognition for crisis intervention hotlines using explainable multi-task learning

IF 4.9 2区 医学 Q1 CLINICAL NEUROLOGY Journal of affective disorders Pub Date : 2024-11-09 DOI:10.1016/j.jad.2024.11.022
Zhong Ding , Yang Zhou , An-Jie Dai , Chen Qian , Bao-Liang Zhong , Chen-Ling Liu , Zhen-Tao Liu
{"title":"Speech based suicide risk recognition for crisis intervention hotlines using explainable multi-task learning","authors":"Zhong Ding ,&nbsp;Yang Zhou ,&nbsp;An-Jie Dai ,&nbsp;Chen Qian ,&nbsp;Bao-Liang Zhong ,&nbsp;Chen-Ling Liu ,&nbsp;Zhen-Tao Liu","doi":"10.1016/j.jad.2024.11.022","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Crisis Intervention Hotline can effectively reduce suicide risk, but suffer from low connectivity rates and untimely crisis response. By integrating speech signals and deep learning to assist in crisis assessment, it is expected to enhanced the effectiveness of crisis intervention hotlines.</div></div><div><h3>Methods</h3><div>In this study, a crisis intervention hotline suicide risk speech dataset was constructed, and the speech was labeled based on the Modified Suicide Risk Scale. On the dataset, the variability of speech duration between different callers and different speech high-level features were explored across callers. Finally, this study proposed a data-theoretically dual-driven, gender-assisted speech crisis recognition method based on multi-tasking and deep learning, and the results of the model were obtained through five-fold cross-validation.</div></div><div><h3>Results</h3><div>Analysis of the dataset demonstrated gender differences in callers, with male callers speaking more in crisis calls compared to females. Feature analysis revealed significant differences between crisis callers in terms of emotional intensity of speech, speech rate and texture. The proposed method outperformed other methods with an F1 score of 96 % on the validation data, and feature visualization of the model also demonstrated the validity of the method.</div></div><div><h3>Limitations</h3><div>The sample size of this study was limited and ignored information from other modalities.</div></div><div><h3>Conclusion</h3><div>These findings demonstrated the effectiveness of the proposed model in speech crisis recognition, and the statistical data analysis enhanced the Interpretability of the model, while showing that the integration of data and theoretical knowledge facilitates the effectiveness of the method.</div></div>","PeriodicalId":14963,"journal":{"name":"Journal of affective disorders","volume":"370 ","pages":"Pages 392-400"},"PeriodicalIF":4.9000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of affective disorders","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016503272401855X","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Background

Crisis Intervention Hotline can effectively reduce suicide risk, but suffer from low connectivity rates and untimely crisis response. By integrating speech signals and deep learning to assist in crisis assessment, it is expected to enhanced the effectiveness of crisis intervention hotlines.

Methods

In this study, a crisis intervention hotline suicide risk speech dataset was constructed, and the speech was labeled based on the Modified Suicide Risk Scale. On the dataset, the variability of speech duration between different callers and different speech high-level features were explored across callers. Finally, this study proposed a data-theoretically dual-driven, gender-assisted speech crisis recognition method based on multi-tasking and deep learning, and the results of the model were obtained through five-fold cross-validation.

Results

Analysis of the dataset demonstrated gender differences in callers, with male callers speaking more in crisis calls compared to females. Feature analysis revealed significant differences between crisis callers in terms of emotional intensity of speech, speech rate and texture. The proposed method outperformed other methods with an F1 score of 96 % on the validation data, and feature visualization of the model also demonstrated the validity of the method.

Limitations

The sample size of this study was limited and ignored information from other modalities.

Conclusion

These findings demonstrated the effectiveness of the proposed model in speech crisis recognition, and the statistical data analysis enhanced the Interpretability of the model, while showing that the integration of data and theoretical knowledge facilitates the effectiveness of the method.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用可解释多任务学习为危机干预热线提供基于语音的自杀风险识别。
背景:危机干预热线可有效降低自杀风险,但存在接通率低、危机响应不及时等问题。通过整合语音信号和深度学习来辅助危机评估,有望提高危机干预热线的有效性:本研究构建了危机干预热线自杀风险语音数据集,并根据修正自杀风险量表对语音进行了标注。在该数据集上,探讨了不同来电者之间的语音时长差异以及不同来电者之间的不同语音高级特征。最后,本研究提出了一种基于多任务和深度学习的数据理论双重驱动的性别辅助语音危机识别方法,并通过五倍交叉验证获得了模型结果:对数据集的分析表明,来电者存在性别差异,男性来电者在危机电话中的发言多于女性。特征分析表明,危机来电者在语音的情感强度、语速和质地方面存在明显差异。在验证数据上,所提出的方法优于其他方法,F1 得分为 96%,模型的特征可视化也证明了该方法的有效性:局限性:本研究的样本量有限,忽略了其他模式的信息:这些研究结果表明了所提出的模型在语音危机识别中的有效性,统计数据分析增强了模型的可解释性,同时表明数据和理论知识的整合促进了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of affective disorders
Journal of affective disorders 医学-精神病学
CiteScore
10.90
自引率
6.10%
发文量
1319
审稿时长
9.3 weeks
期刊介绍: The Journal of Affective Disorders publishes papers concerned with affective disorders in the widest sense: depression, mania, mood spectrum, emotions and personality, anxiety and stress. It is interdisciplinary and aims to bring together different approaches for a diverse readership. Top quality papers will be accepted dealing with any aspect of affective disorders, including neuroimaging, cognitive neurosciences, genetics, molecular biology, experimental and clinical neurosciences, pharmacology, neuroimmunoendocrinology, intervention and treatment trials.
期刊最新文献
A study on the plasma proteomics of different types of depressive disorders based on label-free data-independent acquisition proteomic technology. An ERP study characterizing how trait anxiety modulates proactive and reactive response inhibition independent of different emotional contexts. Gut microbiotas, inflammatory factors, and mental-behavioral disorders: A mendelian randomization study. Shadows of the past - Hierarchical regression analyses on the role of childhood maltreatment experiences for postpartum depression. Using dynamic graph convolutional network to identify individuals with major depression disorder.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1