Explainable depression symptom detection in social media.

IF 4.7 3区 医学 Q1 MEDICAL INFORMATICS Health Information Science and Systems Pub Date : 2024-09-06 eCollection Date: 2024-12-01 DOI:10.1007/s13755-024-00303-9
Eliseo Bao, Anxo Pérez, Javier Parapar
{"title":"Explainable depression symptom detection in social media.","authors":"Eliseo Bao, Anxo Pérez, Javier Parapar","doi":"10.1007/s13755-024-00303-9","DOIUrl":null,"url":null,"abstract":"<p><p>Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this online information to construct mental health detection models, which aim to identify users at risk on platforms like Twitter, Reddit or Facebook. Most of these models are focused on achieving good classification results, ignoring the explainability and interpretability of the decisions. Recent research has pointed out the importance of using clinical markers, such as the use of symptoms, to improve trust in the computational models by health professionals. In this paper, we introduce transformer-based architectures designed to detect and explain the appearance of depressive symptom markers in user-generated content from social media. We present two approaches: (i) train a model to classify, and another one to explain the classifier's decision separately and (ii) unify the two tasks simultaneously within a single model. Additionally, for this latter manner, we also investigated the performance of recent conversational Large Language Models (LLMs) utilizing both in-context learning and finetuning. Our models provide natural language explanations, aligning with validated symptoms, thus enabling clinicians to interpret the decisions more effectively. We evaluate our approaches using recent symptom-focused datasets, using both offline metrics and expert-in-the-loop evaluations to assess the quality of our models' explanations. Our findings demonstrate that it is possible to achieve good classification results while generating interpretable symptom-based explanations.</p>","PeriodicalId":46312,"journal":{"name":"Health Information Science and Systems","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11379836/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Information Science and Systems","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s13755-024-00303-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0

Abstract

Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this online information to construct mental health detection models, which aim to identify users at risk on platforms like Twitter, Reddit or Facebook. Most of these models are focused on achieving good classification results, ignoring the explainability and interpretability of the decisions. Recent research has pointed out the importance of using clinical markers, such as the use of symptoms, to improve trust in the computational models by health professionals. In this paper, we introduce transformer-based architectures designed to detect and explain the appearance of depressive symptom markers in user-generated content from social media. We present two approaches: (i) train a model to classify, and another one to explain the classifier's decision separately and (ii) unify the two tasks simultaneously within a single model. Additionally, for this latter manner, we also investigated the performance of recent conversational Large Language Models (LLMs) utilizing both in-context learning and finetuning. Our models provide natural language explanations, aligning with validated symptoms, thus enabling clinicians to interpret the decisions more effectively. We evaluate our approaches using recent symptom-focused datasets, using both offline metrics and expert-in-the-loop evaluations to assess the quality of our models' explanations. Our findings demonstrate that it is possible to achieve good classification results while generating interpretable symptom-based explanations.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
社交媒体中可解释的抑郁症状检测。
社交平台的用户通常将这些网站视为发布心理健康问题的支持性空间。这些对话包含了有关个人健康风险的重要痕迹。最近,研究人员利用这些在线信息构建了心理健康检测模型,旨在识别 Twitter、Reddit 或 Facebook 等平台上的风险用户。这些模型大多专注于实现良好的分类结果,而忽略了决策的可解释性和可解读性。最近的研究指出,使用临床标记(如使用症状)来提高医疗专业人员对计算模型的信任度非常重要。在本文中,我们介绍了基于转换器的架构,旨在检测和解释社交媒体用户生成内容中出现的抑郁症状标记。我们提出了两种方法:(i) 分别训练一个模型来分类,另一个模型来解释分类器的决定;(ii) 在一个模型中同时统一这两项任务。此外,对于后一种方式,我们还利用上下文学习和微调研究了近期会话大语言模型(LLM)的性能。我们的模型提供自然语言解释,并与经过验证的症状保持一致,从而使临床医生能够更有效地解释决定。我们使用最近的症状数据集对我们的方法进行了评估,使用离线度量和专家在环评估来评估模型解释的质量。我们的研究结果表明,在生成可解释的基于症状的解释的同时实现良好的分类结果是可能的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
11.30
自引率
5.00%
发文量
30
期刊介绍: Health Information Science and Systems is a multidisciplinary journal that integrates artificial intelligence/computer science/information technology with health science and services, embracing information science research coupled with topics related to the modeling, design, development, integration and management of health information systems, smart health, artificial intelligence in medicine, and computer aided diagnosis, medical expert systems. The scope includes: i.) smart health, artificial Intelligence in medicine, computer aided diagnosis, medical image processing, medical expert systems ii.) medical big data, medical/health/biomedicine information resources such as patient medical records, devices and equipments, software and tools to capture, store, retrieve, process, analyze, optimize the use of information in the health domain, iii.) data management, data mining, and knowledge discovery, all of which play a key role in decision making, management of public health, examination of standards, privacy and security issues, iv.) development of new architectures and applications for health information systems.
期刊最新文献
Explainable federated learning scheme for secure healthcare data sharing. Comorbidity progression analysis: patient stratification and comorbidity prediction using temporal comorbidity network. Explainable depression symptom detection in social media. A lightweight network based on multi-feature pseudo-color mapping for arrhythmia recognition. Tree hole rescue: an AI approach for suicide risk detection and online suicide intervention.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1