A systematic review of measurement uncertainty visualizations in the context of standardized assessments.

IF 1.8 3区 心理学 Q2 PSYCHOLOGY, MULTIDISCIPLINARY Scandinavian journal of psychology Pub Date : 2023-10-01 Epub Date: 2023-05-31 DOI:10.1111/sjop.12918
Aleksander Heltne, Niek Frans, Benjamin Hummelen, Erik Falkum, Sara Germans Selvik, Muirne C S Paap
{"title":"A systematic review of measurement uncertainty visualizations in the context of standardized assessments.","authors":"Aleksander Heltne,&nbsp;Niek Frans,&nbsp;Benjamin Hummelen,&nbsp;Erik Falkum,&nbsp;Sara Germans Selvik,&nbsp;Muirne C S Paap","doi":"10.1111/sjop.12918","DOIUrl":null,"url":null,"abstract":"<p><p>This systematic review summarized findings of 29 studies evaluating visual presentation formats appropriate for communicating measurement uncertainty associated with standardized clinical assessment instruments. Studies were identified through systematic searches of multiple databases (Medline, Embase, PsycInfo, ERIC, Scopus, and Web of Science). Strikingly, we found no studies which were conducted using samples of clinicians and included clinical decision-making scenarios. Included studies did however find that providing participants with information about measurement uncertainty may increase awareness of uncertainty and promote more optimal decision making. Formats which visualize the shape of the underlying probability distribution were found to promote more accurate probability estimation and appropriate interpretations of the underlying probability distribution shape. However, participants in the included studies did not seem to benefit from the additional information provided by such plots during decision-making tasks. Further explorations into how presentations of measurement uncertainty impact clinical decision making are needed to examine whether findings of the included studies generalize to clinician populations. This review provides an important overview of pitfalls associated with formats commonly used to communicate measurement uncertainty in clinical assessment instruments, and a potential starting point for further explorations into promising alternatives. Finally, our review offers specific recommendations on how remaining research questions might be addressed.</p>","PeriodicalId":21435,"journal":{"name":"Scandinavian journal of psychology","volume":"64 5","pages":"595-608"},"PeriodicalIF":1.8000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Scandinavian journal of psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1111/sjop.12918","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/5/31 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 1

Abstract

This systematic review summarized findings of 29 studies evaluating visual presentation formats appropriate for communicating measurement uncertainty associated with standardized clinical assessment instruments. Studies were identified through systematic searches of multiple databases (Medline, Embase, PsycInfo, ERIC, Scopus, and Web of Science). Strikingly, we found no studies which were conducted using samples of clinicians and included clinical decision-making scenarios. Included studies did however find that providing participants with information about measurement uncertainty may increase awareness of uncertainty and promote more optimal decision making. Formats which visualize the shape of the underlying probability distribution were found to promote more accurate probability estimation and appropriate interpretations of the underlying probability distribution shape. However, participants in the included studies did not seem to benefit from the additional information provided by such plots during decision-making tasks. Further explorations into how presentations of measurement uncertainty impact clinical decision making are needed to examine whether findings of the included studies generalize to clinician populations. This review provides an important overview of pitfalls associated with formats commonly used to communicate measurement uncertainty in clinical assessment instruments, and a potential starting point for further explorations into promising alternatives. Finally, our review offers specific recommendations on how remaining research questions might be addressed.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
在标准化评估的背景下对测量不确定性可视化的系统审查。
这篇系统综述总结了29项研究的结果,这些研究评估了适用于传达与标准化临床评估仪器相关的测量不确定性的视觉呈现格式。研究是通过对多个数据库(Medline、Embase、PsycInfo、ERIC、Scopus和Web of Science)的系统搜索确定的。引人注目的是,我们没有发现使用临床医生样本进行的包括临床决策场景的研究。然而,纳入的研究确实发现,向参与者提供有关测量不确定性的信息可以提高对不确定性的认识,并促进更优化的决策。发现可视化潜在概率分布形状的格式可以促进更准确的概率估计和对潜在概率分布的形状的适当解释。然而,纳入研究的参与者似乎没有从决策任务期间此类图提供的额外信息中受益。需要进一步探索测量不确定性的表现如何影响临床决策,以检查纳入研究的结果是否适用于临床医生群体。这篇综述对临床评估仪器中通常用于传达测量不确定性的格式相关的陷阱进行了重要概述,并为进一步探索有前景的替代方案提供了潜在的起点。最后,我们的综述就如何解决剩余的研究问题提出了具体建议。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Scandinavian journal of psychology
Scandinavian journal of psychology PSYCHOLOGY, MULTIDISCIPLINARY-
CiteScore
4.20
自引率
0.00%
发文量
102
期刊介绍: Published in association with the Nordic psychological associations, the Scandinavian Journal of Psychology publishes original papers from Scandinavia and elsewhere. Covering the whole range of psychology, with a particular focus on experimental psychology, the journal includes high-quality theoretical and methodological papers, empirical reports, reviews and ongoing commentaries.Scandinavian Journal of Psychology is organised into four standing subsections: - Cognition and Neurosciences - Development and Aging - Personality and Social Sciences - Health and Disability
期刊最新文献
Adaptive and maladaptive pathways of COVID-19 worry on well-being: A cross-national study. Different contexts - different stories: Adolescents' experiences of how ethnicity is addressed in schools and sports and on social media in Sweden. Money talks? The motivational mechanisms of base pay on well-being and work performance. Up you get: Norwegian parents' reactions to children's negative emotions. Meaning in life after cancer: Validation of the sources of meaning card method among participants in cancer rehabilitation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1