使用面部表情计算机视觉评估抗精神病药物无效的首发精神病患者的症状领域和治疗反应。

IF 5.3 2区 医学 Q1 PSYCHIATRY Acta Psychiatrica Scandinavica Pub Date : 2024-08-12 DOI:10.1111/acps.13743
Karen S Ambrosen, Cecilie K Lemvigh, Mette Ø Nielsen, Birte Y Glenthøj, Warda T Syeda, Bjørn H Ebdrup
{"title":"使用面部表情计算机视觉评估抗精神病药物无效的首发精神病患者的症状领域和治疗反应。","authors":"Karen S Ambrosen, Cecilie K Lemvigh, Mette Ø Nielsen, Birte Y Glenthøj, Warda T Syeda, Bjørn H Ebdrup","doi":"10.1111/acps.13743","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Facial expressions are a core aspect of non-verbal communication. Reduced emotional expressiveness of the face is a common negative symptom of schizophrenia, however, quantifying negative symptoms can be clinically challenging and involves a considerable element of rater subjectivity. We used computer vision to investigate if (i) automated assessment of facial expressions captures negative as well as positive and general symptom domains, and (ii) if automated assessments are associated with treatment response in initially antipsychotic-naïve patients with first-episode psychosis.</p><p><strong>Method: </strong>We included 46 patients (mean age 25.4 (6.1); 65.2% males). Psychopathology was assessed at baseline and after 6 weeks of monotherapy with amisulpride using the Positive and Negative Syndrome Scale (PANSS). Baseline interview videos were recorded. Seventeen facial action units (AUs), that is, activation of muscles, from the Facial Action Coding System were extracted using OpenFace 2.0. A correlation matrix was calculated for each patient. Facial expressions were identified using spectral clustering at group-level. Associations between facial expressions and psychopathology were investigated using multiple linear regression.</p><p><strong>Results: </strong>Three clusters of facial expressions were identified related to different locations of the face. Cluster 1 was associated with positive and general symptoms at baseline, Cluster 2 was associated with all symptom domains, showing the strongest association with the negative domain, and Cluster 3 was only associated with general symptoms. Cluster 1 was significantly associated with the clinically rated improvement in positive and general symptoms after treatment, and Cluster 2 was significantly associated with clinical improvement in all domains.</p><p><strong>Conclusion: </strong>Using automated computer vision of facial expressions during PANSS interviews did not only capture negative symptoms but also combinations of the three overall domains of psychopathology. Moreover, automated assessments of facial expressions at baseline were associated with initial antipsychotic treatment response. The findings underscore the clinical relevance of facial expressions and motivate further investigations of computer vision in clinical psychiatry.</p>","PeriodicalId":108,"journal":{"name":"Acta Psychiatrica Scandinavica","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Using computer vision of facial expressions to assess symptom domains and treatment response in antipsychotic-naïve patients with first-episode psychosis.\",\"authors\":\"Karen S Ambrosen, Cecilie K Lemvigh, Mette Ø Nielsen, Birte Y Glenthøj, Warda T Syeda, Bjørn H Ebdrup\",\"doi\":\"10.1111/acps.13743\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Facial expressions are a core aspect of non-verbal communication. Reduced emotional expressiveness of the face is a common negative symptom of schizophrenia, however, quantifying negative symptoms can be clinically challenging and involves a considerable element of rater subjectivity. We used computer vision to investigate if (i) automated assessment of facial expressions captures negative as well as positive and general symptom domains, and (ii) if automated assessments are associated with treatment response in initially antipsychotic-naïve patients with first-episode psychosis.</p><p><strong>Method: </strong>We included 46 patients (mean age 25.4 (6.1); 65.2% males). Psychopathology was assessed at baseline and after 6 weeks of monotherapy with amisulpride using the Positive and Negative Syndrome Scale (PANSS). Baseline interview videos were recorded. Seventeen facial action units (AUs), that is, activation of muscles, from the Facial Action Coding System were extracted using OpenFace 2.0. A correlation matrix was calculated for each patient. Facial expressions were identified using spectral clustering at group-level. Associations between facial expressions and psychopathology were investigated using multiple linear regression.</p><p><strong>Results: </strong>Three clusters of facial expressions were identified related to different locations of the face. Cluster 1 was associated with positive and general symptoms at baseline, Cluster 2 was associated with all symptom domains, showing the strongest association with the negative domain, and Cluster 3 was only associated with general symptoms. Cluster 1 was significantly associated with the clinically rated improvement in positive and general symptoms after treatment, and Cluster 2 was significantly associated with clinical improvement in all domains.</p><p><strong>Conclusion: </strong>Using automated computer vision of facial expressions during PANSS interviews did not only capture negative symptoms but also combinations of the three overall domains of psychopathology. Moreover, automated assessments of facial expressions at baseline were associated with initial antipsychotic treatment response. The findings underscore the clinical relevance of facial expressions and motivate further investigations of computer vision in clinical psychiatry.</p>\",\"PeriodicalId\":108,\"journal\":{\"name\":\"Acta Psychiatrica Scandinavica\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-08-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Acta Psychiatrica Scandinavica\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/acps.13743\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHIATRY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Acta Psychiatrica Scandinavica","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/acps.13743","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0

摘要

背景介绍面部表情是非语言交流的一个核心方面。面部情绪表达能力减弱是精神分裂症的常见阴性症状,然而,阴性症状的量化在临床上具有挑战性,而且涉及相当大的评分者主观因素。我们利用计算机视觉来研究:(i) 面部表情的自动评估是否能捕捉阴性以及阳性和一般症状领域;(ii) 自动评估是否与最初未使用抗精神病药的首发精神病患者的治疗反应有关:我们纳入了 46 名患者(平均年龄 25.4 (6.1);65.2% 为男性)。在使用氨磺必利单药治疗基线期和6周后,使用阳性和阴性综合征量表(PANSS)对患者的精神病理学进行评估。基线访谈视频均已录制。使用 OpenFace 2.0 从面部动作编码系统中提取了 17 个面部动作单元(AU),即肌肉的激活。为每位患者计算相关矩阵。使用频谱聚类在组水平上识别面部表情。使用多元线性回归法研究了面部表情与精神病理学之间的关联:结果:确定了与面部不同位置相关的三个面部表情群。第 1 组与基线时的积极症状和一般症状相关,第 2 组与所有症状领域相关,其中与消极领域的相关性最强,而第 3 组仅与一般症状相关。第 1 组与治疗后临床评定的积极症状和一般症状的改善明显相关,第 2 组与所有领域的临床改善明显相关:结论:在 PANSS 访谈中使用计算机自动视觉识别面部表情不仅能捕捉到阴性症状,还能捕捉到精神病理学三个总体领域的组合。此外,基线时的面部表情自动评估与最初的抗精神病治疗反应相关。这些发现强调了面部表情的临床相关性,并推动了计算机视觉在临床精神病学中的进一步研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Using computer vision of facial expressions to assess symptom domains and treatment response in antipsychotic-naïve patients with first-episode psychosis.

Background: Facial expressions are a core aspect of non-verbal communication. Reduced emotional expressiveness of the face is a common negative symptom of schizophrenia, however, quantifying negative symptoms can be clinically challenging and involves a considerable element of rater subjectivity. We used computer vision to investigate if (i) automated assessment of facial expressions captures negative as well as positive and general symptom domains, and (ii) if automated assessments are associated with treatment response in initially antipsychotic-naïve patients with first-episode psychosis.

Method: We included 46 patients (mean age 25.4 (6.1); 65.2% males). Psychopathology was assessed at baseline and after 6 weeks of monotherapy with amisulpride using the Positive and Negative Syndrome Scale (PANSS). Baseline interview videos were recorded. Seventeen facial action units (AUs), that is, activation of muscles, from the Facial Action Coding System were extracted using OpenFace 2.0. A correlation matrix was calculated for each patient. Facial expressions were identified using spectral clustering at group-level. Associations between facial expressions and psychopathology were investigated using multiple linear regression.

Results: Three clusters of facial expressions were identified related to different locations of the face. Cluster 1 was associated with positive and general symptoms at baseline, Cluster 2 was associated with all symptom domains, showing the strongest association with the negative domain, and Cluster 3 was only associated with general symptoms. Cluster 1 was significantly associated with the clinically rated improvement in positive and general symptoms after treatment, and Cluster 2 was significantly associated with clinical improvement in all domains.

Conclusion: Using automated computer vision of facial expressions during PANSS interviews did not only capture negative symptoms but also combinations of the three overall domains of psychopathology. Moreover, automated assessments of facial expressions at baseline were associated with initial antipsychotic treatment response. The findings underscore the clinical relevance of facial expressions and motivate further investigations of computer vision in clinical psychiatry.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Acta Psychiatrica Scandinavica
Acta Psychiatrica Scandinavica 医学-精神病学
CiteScore
11.20
自引率
3.00%
发文量
135
审稿时长
6-12 weeks
期刊介绍: Acta Psychiatrica Scandinavica acts as an international forum for the dissemination of information advancing the science and practice of psychiatry. In particular we focus on communicating frontline research to clinical psychiatrists and psychiatric researchers. Acta Psychiatrica Scandinavica has traditionally been and remains a journal focusing predominantly on clinical psychiatry, but translational psychiatry is a topic of growing importance to our readers. Therefore, the journal welcomes submission of manuscripts based on both clinical- and more translational (e.g. preclinical and epidemiological) research. When preparing manuscripts based on translational studies for submission to Acta Psychiatrica Scandinavica, the authors should place emphasis on the clinical significance of the research question and the findings. Manuscripts based solely on preclinical research (e.g. animal models) are normally not considered for publication in the Journal.
期刊最新文献
Issue Information Variation of subclinical psychosis as a function of population density across different European settings: Findings from the multi-national EU-GEI study. Risk and timing of postpartum depression in parents of twins compared to parents of singletons. Digital phenotyping in bipolar disorder: Using longitudinal Fitbit data and personalized machine learning to predict mood symptomatology. The risk of diabetes and HbA1c deterioration during antipsychotic drug treatment: A Danish two-cohort study among patients with first-episode schizophrenia.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1