Objectives: Diagnostic imaging decision support (DI-DS) system has emerged as an innovative evidence-based solution to decrease inappropriate diagnostic imaging. The aim of the present study was to design and evaluate a DI-DS system for cerebrovascular diseases.
Methods: The present study was an applied piece of research. First, the conceptual model of the DI-DS system was designed based on its functional and non-functional requirements. Afterwards, to create the system's knowledge base, cerebrovascular diseases diagnostic imaging algorithms were extracted from the American College of Radiology Appropriateness Criteria (ACR-AC). Subsequently, the system was developed based on the obtained conceptual model and the extracted algorithms. The software was programmed by means of the C#. After debugging the system, it was evaluated regarding its performance and also the users' satisfaction with it.
Results: Assessing the users' satisfaction with the system demonstrated that all the evaluation criteria met the acceptable threshold (85 %). The retrospective evaluation of the system's performance indicated that from among 76 imaging examinations, which had previously been performed for 30 patients, 12 (15.78 %) were deemed inappropriate. And, the system accurately identified all the inappropriate physicians' decisions. The concurrent evaluation of the system's performance indicated that the system's recommendations helped the physicians remove 100 % (4 out of 4) of the inappropriate and 40 % (2 out of 5) of the inconclusive imaging examinations from their initial choices.
Conclusions: A DI-DS system could increase the compliance of the physicians' decisions with diagnostic imaging guidelines, and also improve treatment outcomes through correct diagnosis and providing timely care.
{"title":"A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases.","authors":"Hamid Moghaddasi, Fatemeh Rahimi, Amir Saied Seddighi, Leila Akbarpour, Arash Roshanpoor","doi":"10.1515/dx-2024-0072","DOIUrl":"https://doi.org/10.1515/dx-2024-0072","url":null,"abstract":"<p><strong>Objectives: </strong>Diagnostic imaging decision support (DI-DS) system has emerged as an innovative evidence-based solution to decrease inappropriate diagnostic imaging. The aim of the present study was to design and evaluate a DI-DS system for cerebrovascular diseases.</p><p><strong>Methods: </strong>The present study was an applied piece of research. First, the conceptual model of the DI-DS system was designed based on its functional and non-functional requirements. Afterwards, to create the system's knowledge base, cerebrovascular diseases diagnostic imaging algorithms were extracted from the American College of Radiology Appropriateness Criteria (ACR-AC). Subsequently, the system was developed based on the obtained conceptual model and the extracted algorithms. The software was programmed by means of the C#. After debugging the system, it was evaluated regarding its performance and also the users' satisfaction with it.</p><p><strong>Results: </strong>Assessing the users' satisfaction with the system demonstrated that all the evaluation criteria met the acceptable threshold (85 %). The retrospective evaluation of the system's performance indicated that from among 76 imaging examinations, which had previously been performed for 30 patients, 12 (15.78 %) were deemed inappropriate. And, the system accurately identified all the inappropriate physicians' decisions. The concurrent evaluation of the system's performance indicated that the system's recommendations helped the physicians remove 100 % (4 out of 4) of the inappropriate and 40 % (2 out of 5) of the inconclusive imaging examinations from their initial choices.</p><p><strong>Conclusions: </strong>A DI-DS system could increase the compliance of the physicians' decisions with diagnostic imaging guidelines, and also improve treatment outcomes through correct diagnosis and providing timely care.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142616781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objectives: Clinicians can rapidly and accurately diagnose disease, learn from experience, and explain their reasoning. Computational Bayesian medical decision-making might replicate this expertise. This paper assesses a computer system for diagnosing cardiac chest pain in the emergency department (ED) that decides whether to admit or discharge a patient.
Methods: The system can learn likelihood functions by counting data frequency. The computer compares patient and disease data profiles using likelihood. It calculates a Bayesian probabilistic diagnosis and explains its reasoning. A utility function applies the probabilistic diagnosis to produce a numerical BAYES score for making a medical decision.
Results: We conducted a pilot study to assess BAYES efficacy in ED chest pain patient disposition. Binary BAYES decisions eliminated patient observation. We compared BAYES to the HEART score. On 100 patients, BAYES reduced HEART's false positive rate 18-fold from 58.7 to 3.3 %, and improved ROC AUC accuracy from 0.928 to 1.0.
Conclusions: The pilot study results were encouraging. The data-driven BAYES score approach could learn from frequency counting, make fast and accurate decisions, and explain its reasoning. The computer replicated these aspects of diagnostic expertise. More research is needed to reproduce and extend these finding to larger diverse patient populations.
{"title":"Bayesian intelligence for medical diagnosis: a pilot study on patient disposition for emergency medicine chest pain.","authors":"Mark W Perlin, Yves-Dany Accilien","doi":"10.1515/dx-2024-0049","DOIUrl":"https://doi.org/10.1515/dx-2024-0049","url":null,"abstract":"<p><strong>Objectives: </strong>Clinicians can rapidly and accurately diagnose disease, learn from experience, and explain their reasoning. Computational Bayesian medical decision-making might replicate this expertise. This paper assesses a computer system for diagnosing cardiac chest pain in the emergency department (ED) that decides whether to admit or discharge a patient.</p><p><strong>Methods: </strong>The system can learn likelihood functions by counting data frequency. The computer compares patient and disease data profiles using likelihood. It calculates a Bayesian probabilistic diagnosis and explains its reasoning. A utility function applies the probabilistic diagnosis to produce a numerical BAYES score for making a medical decision.</p><p><strong>Results: </strong>We conducted a pilot study to assess BAYES efficacy in ED chest pain patient disposition. Binary BAYES decisions eliminated patient observation. We compared BAYES to the HEART score. On 100 patients, BAYES reduced HEART's false positive rate 18-fold from 58.7 to 3.3 %, and improved ROC AUC accuracy from 0.928 to 1.0.</p><p><strong>Conclusions: </strong>The pilot study results were encouraging. The data-driven BAYES score approach could learn from frequency counting, make fast and accurate decisions, and explain its reasoning. The computer replicated these aspects of diagnostic expertise. More research is needed to reproduce and extend these finding to larger diverse patient populations.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142496966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aubrey Samost-Williams, Eric J Thomas, Olivia Lounsbury, Scott I Tannenbaum, Eduardo Salas, Sigall K Bell
The ambulatory diagnostic process is potentially complex, resulting in faulty communication, lost information, and a lack of team coordination. Patients and families have a unique position in the ambulatory diagnostic team, holding privileged information about their clinical conditions and serving as the connecting thread across multiple healthcare encounters. While experts advocate for engaging patients as diagnostic team members, operationalizing patient engagement has been challenging. The team science literature links improved team performance with shared mental models, a concept reflecting the team's commonly held knowledge about the tasks to be done and the expertise of each team member. Despite their proven potential to improve team performance and outcomes in other settings, shared mental models remain underexplored in healthcare. In this manuscript, we review the literature on shared mental models, applying that knowledge to the ambulatory diagnostic process. We consider the role of patients in the diagnostic team and adapt the five-factor model of shared mental models to develop a framework for patient-clinician diagnostic shared mental models. We conclude with research priorities. Development, maintenance, and use of shared mental models of the diagnostic process amongst patients, families, and clinicians may increase patient/family engagement, improve diagnostic team performance, and promote diagnostic safety.
{"title":"Bringing team science to the ambulatory diagnostic process: how do patients and clinicians develop shared mental models?","authors":"Aubrey Samost-Williams, Eric J Thomas, Olivia Lounsbury, Scott I Tannenbaum, Eduardo Salas, Sigall K Bell","doi":"10.1515/dx-2024-0115","DOIUrl":"https://doi.org/10.1515/dx-2024-0115","url":null,"abstract":"<p><p>The ambulatory diagnostic process is potentially complex, resulting in faulty communication, lost information, and a lack of team coordination. Patients and families have a unique position in the ambulatory diagnostic team, holding privileged information about their clinical conditions and serving as the connecting thread across multiple healthcare encounters. While experts advocate for engaging patients as diagnostic team members, operationalizing patient engagement has been challenging. The team science literature links improved team performance with shared mental models, a concept reflecting the team's commonly held knowledge about the tasks to be done and the expertise of each team member. Despite their proven potential to improve team performance and outcomes in other settings, shared mental models remain underexplored in healthcare. In this manuscript, we review the literature on shared mental models, applying that knowledge to the ambulatory diagnostic process. We consider the role of patients in the diagnostic team and adapt the five-factor model of shared mental models to develop a framework for patient-clinician diagnostic shared mental models. We conclude with research priorities. Development, maintenance, and use of shared mental models of the diagnostic process amongst patients, families, and clinicians may increase patient/family engagement, improve diagnostic team performance, and promote diagnostic safety.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Scott I Tannenbaum, Eric J Thomas, Sigall K Bell, Eduardo Salas
Dynamic teaming is required whenever people must coordinate with one another in a fluid context, particularly when the fundamental structures of a team, such as membership, priorities, tasks, modes of communication, and location are in near-constant flux. This is certainly the case in the contemporary ambulatory care diagnostic process, where circumstances and conditions require a shifting cast of individuals to coordinate dynamically to ensure patient safety. This article offers an updated perspective on dynamic teaming commonly required during the ambulatory diagnostic process. Drawing upon team science, it clarifies the characteristics of dynamic diagnostic teams, identifies common risk points in the teaming process and the practical implications of these risks, considers the role of providers and patients in averting adverse outcomes, and provides a case example of the challenges of dynamic teaming during the diagnostic process. Based on this, future research needs are offered as well as clinical practice recommendations related to team characteristics and breakdowns, team member knowledge/cognitions, teaming dynamics, and the patient as a team member.
{"title":"From stable teamwork to dynamic teaming in the ambulatory care diagnostic process.","authors":"Scott I Tannenbaum, Eric J Thomas, Sigall K Bell, Eduardo Salas","doi":"10.1515/dx-2024-0108","DOIUrl":"https://doi.org/10.1515/dx-2024-0108","url":null,"abstract":"<p><p>Dynamic teaming is required whenever people must coordinate with one another in a fluid context, particularly when the fundamental structures of a team, such as membership, priorities, tasks, modes of communication, and location are in near-constant flux. This is certainly the case in the contemporary ambulatory care diagnostic process, where circumstances and conditions require a shifting cast of individuals to coordinate dynamically to ensure patient safety. This article offers an updated perspective on dynamic teaming commonly required during the ambulatory diagnostic process. Drawing upon team science, it clarifies the characteristics of dynamic diagnostic teams, identifies common risk points in the teaming process and the practical implications of these risks, considers the role of providers and patients in averting adverse outcomes, and provides a case example of the challenges of dynamic teaming during the diagnostic process. Based on this, future research needs are offered as well as clinical practice recommendations related to team characteristics and breakdowns, team member knowledge/cognitions, teaming dynamics, and the patient as a team member.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mark L Graber, Bradford D Winters, Roni Matin, Rosann T Cholankeril, Daniel R Murphy, Hardeep Singh, Andrea Bradford
Cancer will affect more than one in three U.S. residents in their lifetime, and although the diagnosis will be made efficiently in most of these cases, roughly one in five patients will experience a delayed or missed diagnosis. In this integrative review, we focus on missed opportunities in the diagnosis of breast, lung, and colorectal cancer in the ambulatory care environment. From a review of 493 publications, we summarize the current evidence regarding the contributing factors to missed or delayed cancer diagnosis in ambulatory care, as well as evidence to support possible strategies for intervention. Cancer diagnoses are made after follow-up of a positive screening test or an incidental finding, or most commonly, by following up and clarifying non-specific initial presentations to primary care. Breakdowns and delays are unacceptably common in each of these pathways, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at 'closing the loop' represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Improving patient engagement, using 'safety netting,' and taking advantage of the functionality offered through health information technology are all viable options to address these problems.
{"title":"Interventions to improve timely cancer diagnosis: an integrative review.","authors":"Mark L Graber, Bradford D Winters, Roni Matin, Rosann T Cholankeril, Daniel R Murphy, Hardeep Singh, Andrea Bradford","doi":"10.1515/dx-2024-0113","DOIUrl":"https://doi.org/10.1515/dx-2024-0113","url":null,"abstract":"<p><p>Cancer will affect more than one in three U.S. residents in their lifetime, and although the diagnosis will be made efficiently in most of these cases, roughly one in five patients will experience a delayed or missed diagnosis. In this integrative review, we focus on missed opportunities in the diagnosis of breast, lung, and colorectal cancer in the ambulatory care environment. From a review of 493 publications, we summarize the current evidence regarding the contributing factors to missed or delayed cancer diagnosis in ambulatory care, as well as evidence to support possible strategies for intervention. Cancer diagnoses are made after follow-up of a positive screening test or an incidental finding, or most commonly, by following up and clarifying non-specific initial presentations to primary care. Breakdowns and delays are unacceptably common in each of these pathways, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at 'closing the loop' represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Improving patient engagement, using 'safety netting,' and taking advantage of the functionality offered through health information technology are all viable options to address these problems.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ashwin Gupta, Martha Quinn, M Todd Greene, Karen E Fowler, Vineet Chopra
Objectives: The inpatient setting is a challenging clinical environment where systems and situational factors predispose clinicians to making diagnostic errors. Environmental complexities limit trialing of interventions to improve diagnostic error in active inpatient clinical settings. Informed by prior work, we piloted a multi-component intervention designed to reduce diagnostic error to understand its feasibility and uptake.
Methods: From September 2018 to June 2019, we conducted a prospective, pre-test/post-test pilot study of hospital medicine physicians during admitting shifts at a tertiary-care, academic medical center. Optional intervention components included use of dedicated workspaces, privacy barriers, noise cancelling headphones, application-based breathing exercises, a differential diagnosis expander application, and a checklist to enable a diagnostic pause. Participants rated their confidence in patient diagnoses and completed a survey on intervention component use. Data on provider resource utilization and patient diagnoses were collected, and qualitative interviews were held with a subset of participants in order to better understand experience with the intervention.
Results: Data from 37 physicians and 160 patients were included. No intervention component was utilized by more than 50 % of providers, and no differences were noted in diagnostic confidence or number of diagnoses documented pre-vs. post-intervention. Lab utilization increased, but there were no other differences in resource utilization during the intervention. Qualitative feedback highlighted workflow integration challenges, among others, for poor intervention uptake.
Conclusions: Our pilot study demonstrated poor feasibility and uptake of an intervention designed to reduce diagnostic error. This study highlights the unique challenges of implementing solutions within busy clinical environments.
{"title":"Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned.","authors":"Ashwin Gupta, Martha Quinn, M Todd Greene, Karen E Fowler, Vineet Chopra","doi":"10.1515/dx-2024-0099","DOIUrl":"https://doi.org/10.1515/dx-2024-0099","url":null,"abstract":"<p><strong>Objectives: </strong>The inpatient setting is a challenging clinical environment where systems and situational factors predispose clinicians to making diagnostic errors. Environmental complexities limit trialing of interventions to improve diagnostic error in active inpatient clinical settings. Informed by prior work, we piloted a multi-component intervention designed to reduce diagnostic error to understand its feasibility and uptake.</p><p><strong>Methods: </strong>From September 2018 to June 2019, we conducted a prospective, pre-test/post-test pilot study of hospital medicine physicians during admitting shifts at a tertiary-care, academic medical center. Optional intervention components included use of dedicated workspaces, privacy barriers, noise cancelling headphones, application-based breathing exercises, a differential diagnosis expander application, and a checklist to enable a diagnostic pause. Participants rated their confidence in patient diagnoses and completed a survey on intervention component use. Data on provider resource utilization and patient diagnoses were collected, and qualitative interviews were held with a subset of participants in order to better understand experience with the intervention.</p><p><strong>Results: </strong>Data from 37 physicians and 160 patients were included. No intervention component was utilized by more than 50 % of providers, and no differences were noted in diagnostic confidence or number of diagnoses documented pre-vs. post-intervention. Lab utilization increased, but there were no other differences in resource utilization during the intervention. Qualitative feedback highlighted workflow integration challenges, among others, for poor intervention uptake.</p><p><strong>Conclusions: </strong>Our pilot study demonstrated poor feasibility and uptake of an intervention designed to reduce diagnostic error. This study highlights the unique challenges of implementing solutions within busy clinical environments.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nathan Stehouwer, Anastasia Rowland-Seymour, Larry Gruppen, Jeffrey M Albert, Kelli Qua
Objectives: Educators need tools for the assessment of clinical reasoning that reflect the ambiguity of real-world practice and measure learners' ability to determine diagnostic likelihood. In this study, the authors describe the use of the Brier score to assess and provide feedback on the quality of probabilistic diagnostic reasoning.
Methods: The authors describe a novel format called Diagnostic Forecasting (DxF), in which participants read a brief clinical case and assign a probability to each item on a differential diagnosis, order tests and select a final diagnosis. DxF was piloted in a cohort of senior medical students. DxF evaluated students' answers with Brier scores, which compare probabilistic forecasts with case outcomes. The validity of Brier scores in DxF was assessed by comparison to subsequent decision-making in the game environment of DxF, as well as external criteria including medical knowledge tests and performance on clinical rotations.
Results: Brier scores were statistically significantly correlated with diagnostic accuracy (95 % CI -4.4 to -0.44) and with mean scores on the National Board of Medical Examiners (NBME) shelf exams (95 % CI -474.6 to -225.1). Brier scores did not correlate with clerkship grades or performance on a structured clinical skills exam. Reliability as measured by within-student correlation was low.
Conclusions: Brier scoring showed evidence for validity as a measurement of medical knowledge and predictor of clinical decision-making. Further work must evaluated the ability of Brier scores to predict clinical and workplace-based outcomes, and develop reliable approaches to measuring probabilistic reasoning.
目标:教育工作者需要能反映真实世界实践中的模糊性并能衡量学习者判断诊断可能性的临床推理评估工具。在本研究中,作者介绍了如何使用布赖尔评分来评估和反馈概率诊断推理的质量:作者介绍了一种名为 "诊断预测"(DxF)的新颖形式,在这种形式中,参与者阅读一个简短的临床病例,并为鉴别诊断中的每个项目分配概率,下达检验单并选择最终诊断。DxF 在一批高年级医学生中进行了试点。DxF 采用布赖尔评分评估学生的答案,该评分将概率预测与病例结果进行比较。通过与 DxF 游戏环境中的后续决策以及包括医学知识测试和临床轮转表现在内的外部标准进行比较,评估了 DxF 中 Brier 分数的有效性:Brier 分数与诊断准确率(95 % CI -4.4--0.44)和美国国家医学考试委员会(NBME)架子考试的平均分数(95 % CI -474.6--225.1)有明显的统计学相关性。Brier 分数与实习成绩或结构化临床技能考试成绩没有相关性。以学生内部相关性衡量的可靠性较低:Brier 评分作为医学知识测量和临床决策预测指标的有效性得到了证实。进一步的工作必须评估布赖尔评分预测临床和工作场所结果的能力,并开发可靠的方法来测量概率推理。
{"title":"Validity and reliability of Brier scoring for assessment of probabilistic diagnostic reasoning.","authors":"Nathan Stehouwer, Anastasia Rowland-Seymour, Larry Gruppen, Jeffrey M Albert, Kelli Qua","doi":"10.1515/dx-2023-0109","DOIUrl":"https://doi.org/10.1515/dx-2023-0109","url":null,"abstract":"<p><strong>Objectives: </strong>Educators need tools for the assessment of clinical reasoning that reflect the ambiguity of real-world practice and measure learners' ability to determine diagnostic likelihood. In this study, the authors describe the use of the Brier score to assess and provide feedback on the quality of probabilistic diagnostic reasoning.</p><p><strong>Methods: </strong>The authors describe a novel format called Diagnostic Forecasting (DxF), in which participants read a brief clinical case and assign a probability to each item on a differential diagnosis, order tests and select a final diagnosis. DxF was piloted in a cohort of senior medical students. DxF evaluated students' answers with Brier scores, which compare probabilistic forecasts with case outcomes. The validity of Brier scores in DxF was assessed by comparison to subsequent decision-making in the game environment of DxF, as well as external criteria including medical knowledge tests and performance on clinical rotations.</p><p><strong>Results: </strong>Brier scores were statistically significantly correlated with diagnostic accuracy (95 % CI -4.4 to -0.44) and with mean scores on the National Board of Medical Examiners (NBME) shelf exams (95 % CI -474.6 to -225.1). Brier scores did not correlate with clerkship grades or performance on a structured clinical skills exam. Reliability as measured by within-student correlation was low.</p><p><strong>Conclusions: </strong>Brier scoring showed evidence for validity as a measurement of medical knowledge and predictor of clinical decision-making. Further work must evaluated the ability of Brier scores to predict clinical and workplace-based outcomes, and develop reliable approaches to measuring probabilistic reasoning.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Introduction: Diagnostic errors in emergency departments (ED) are a significant concern and exacerbated by cognitive biases during patient handoffs. The timing and accuracy of disclosing working diagnoses during these handoffs potentially influence diagnostic decisions, yet empirical evidence remains limited.
Materials and methods: This parallel, quasi-experimental study involved 40 interns from Japanese teaching hospitals, randomly assigned to control or intervention groups. Each group reviewed eight audio-recorded patient handoff scenarios where working diagnoses were disclosed at the start (control) or end (intervention). Four cases presented correct diagnoses, while four featured incorrect ones. The main measure was diagnostic error rate, calculated as the proportion of incorrect post-handoff responses to total questions asked.
Results: No significant difference in diagnostic error rates emerged between the control (39.4 %, 63/160) and intervention (38.8 %, 62/160) groups (point estimate -0.6 %; 95 % CI: -11.3-10.1 %, p=0.91). However, a substantial difference was evident between diagnostic errors after correct (20.6 %, 33/160) and incorrect (57.5 %, 92/160) working diagnoses presented (point estimate: 36.9 %; 95 % CI: 27.0-46.8 %, p<0.001). Diagnostic momentum accounted for 52 % (48/92) of errors under incorrect diagnoses.
Discussion: While the timing of working diagnosis disclosure did not significantly alter diagnostic accuracy during ED handoffs, exposure to incorrect diagnoses markedly increased error rates. These findings underscore the imperative to refine diagnostic skills and reconsider ED handoff protocols to mitigate cognitive biases and optimize patient care outcomes.
{"title":"Impact of disclosing a working diagnosis during simulated patient handoff presentation in the emergency department: correctness matters.","authors":"Masayuki Amano, Yukinori Harada, Taro Shimizu","doi":"10.1515/dx-2024-0121","DOIUrl":"https://doi.org/10.1515/dx-2024-0121","url":null,"abstract":"<p><strong>Introduction: </strong>Diagnostic errors in emergency departments (ED) are a significant concern and exacerbated by cognitive biases during patient handoffs. The timing and accuracy of disclosing working diagnoses during these handoffs potentially influence diagnostic decisions, yet empirical evidence remains limited.</p><p><strong>Materials and methods: </strong>This parallel, quasi-experimental study involved 40 interns from Japanese teaching hospitals, randomly assigned to control or intervention groups. Each group reviewed eight audio-recorded patient handoff scenarios where working diagnoses were disclosed at the start (control) or end (intervention). Four cases presented correct diagnoses, while four featured incorrect ones. The main measure was diagnostic error rate, calculated as the proportion of incorrect post-handoff responses to total questions asked.</p><p><strong>Results: </strong>No significant difference in diagnostic error rates emerged between the control (39.4 %, 63/160) and intervention (38.8 %, 62/160) groups (point estimate -0.6 %; 95 % CI: -11.3-10.1 %, p=0.91). However, a substantial difference was evident between diagnostic errors after correct (20.6 %, 33/160) and incorrect (57.5 %, 92/160) working diagnoses presented (point estimate: 36.9 %; 95 % CI: 27.0-46.8 %, p<0.001). Diagnostic momentum accounted for 52 % (48/92) of errors under incorrect diagnoses.</p><p><strong>Discussion: </strong>While the timing of working diagnosis disclosure did not significantly alter diagnostic accuracy during ED handoffs, exposure to incorrect diagnoses markedly increased error rates. These findings underscore the imperative to refine diagnostic skills and reconsider ED handoff protocols to mitigate cognitive biases and optimize patient care outcomes.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142460428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mario Plebani, Martina Zaninotto, Sandro Giannini, Stefania Sella, Maria Fusaro, Giovanni Tripepi, Maurizio Gallieni, Markus Herrmann, Mario Cozzolino
Over the last decades, in addition to the improvement of pathophysiological knowledge regarding the role and mechanisms of action of vitamin D, there has been a progressive advancement in analytical technologies for its measurement, as well as in methodological standardization. A significant number of scientific works, meta-analyses, and guidelines have been published on the importance of vitamin D and the need for supplementation in deficient individuals. However, it appears necessary to clarify the fundamental elements related to the measurement of vitamin D (both at the strictly analytical and post-analytical levels) and the scientific evidence related to the efficacy/safety of supplementation. In particular, there is a need to discuss current recommended levels for deficiency, insufficiency and possible toxicity in the light of evidence from standardization projects. Additionally, given the important interrelations between vitamin D, parathyroid hormone (PTH), and fibroblast growth factor-23 (FGF23), the analytical issues and clinical utility of these biomarkers will be discussed.
在过去的几十年里,除了有关维生素 D 作用和作用机制的病理生理学知识得到了提高之外,维生素 D 的测量分析技术和方法标准化也在不断进步。大量科学著作、荟萃分析和指南都已发表,论述了维生素 D 的重要性以及缺乏维生素 D 的人补充维生素 D 的必要性。然而,似乎有必要澄清与维生素 D 测量有关的基本要素(包括严格的分析和分析后水平)以及与补充维生素 D 的有效性/安全性有关的科学证据。特别是,有必要根据标准化项目的证据,讨论目前针对缺乏、不足和可能的毒性的建议水平。此外,鉴于维生素 D、甲状旁腺激素 (PTH) 和成纤维细胞生长因子-23 (FGF23) 之间的重要相互关系,还将讨论这些生物标记物的分析问题和临床效用。
{"title":"Vitamin D assay and supplementation: still debatable issues.","authors":"Mario Plebani, Martina Zaninotto, Sandro Giannini, Stefania Sella, Maria Fusaro, Giovanni Tripepi, Maurizio Gallieni, Markus Herrmann, Mario Cozzolino","doi":"10.1515/dx-2024-0147","DOIUrl":"https://doi.org/10.1515/dx-2024-0147","url":null,"abstract":"<p><p>Over the last decades, in addition to the improvement of pathophysiological knowledge regarding the role and mechanisms of action of vitamin D, there has been a progressive advancement in analytical technologies for its measurement, as well as in methodological standardization. A significant number of scientific works, meta-analyses, and guidelines have been published on the importance of vitamin D and the need for supplementation in deficient individuals. However, it appears necessary to clarify the fundamental elements related to the measurement of vitamin D (both at the strictly analytical and post-analytical levels) and the scientific evidence related to the efficacy/safety of supplementation. In particular, there is a need to discuss current recommended levels for deficiency, insufficiency and possible toxicity in the light of evidence from standardization projects. Additionally, given the important interrelations between vitamin D, parathyroid hormone (PTH), and fibroblast growth factor-23 (FGF23), the analytical issues and clinical utility of these biomarkers will be discussed.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142282009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objectives: To describe rare genetic interactions of α-thalassemia alleles causing Hb H disease and Hb Bart's hydrops fetalis which could lead to diagnostic errors in a routine practice.
Methods: Hematological and molecular characterization were carried out in a Thai family with a risk of having fetus with Hb Bart's hydrops fetalis.
Results: Both parents were found to be the thalassemia intermedia patients associated with unusual forms of Hb H disease. DNA analysis of common α-thalassemia mutations in Thailand identified α+-thalassemia (-α3.7 kb del) and unknown α0-thalassemia in the father and α0-thalassemia (--SEA) with unknown α+-thalassemia in the mother. Fetal DNA analysis unlikely identified a homozygosity for α0-thalassemia (--SEA/--SEA). Further analysis identified that the father carried a rare South African α0-thalassemia in combination with α+-thalassemia (--SA/-α), whereas the mother was a patient with Hb H-Queens Park disease (--SEA/ααQP). The fetus was, in fact, a compound heterozygote for (--SA/--SEA).
Conclusions: As shown in this study, routine screening for α-thalassemia at prenatal diagnosis in the region should include both common and rare α0-thalassemia alleles found in the population to effectively prevent a fatal condition of Hb Bart's hydrops fetalis syndrome.
摘要描述导致 Hb H 病和 Hb Bart 胎儿水肿的 α-地中海贫血等位基因的罕见遗传相互作用,这种相互作用可能导致常规诊断错误:结果:发现父母双方都是与不寻常的 Hb H 型疾病相关的中型地中海贫血患者。对泰国常见的α-地中海贫血突变进行的DNA分析发现,父亲患有α+地中海贫血(-α3.7 kb del)和未知的α0地中海贫血,母亲患有α0地中海贫血(--SEA)和未知的α+地中海贫血。胎儿 DNA 分析未发现同型 α0 地中海贫血症(--SEA/--SEA)。进一步分析发现,父亲患有罕见的南非α0地中海贫血合并α+地中海贫血(--SA/-α),而母亲则是一名 Hb H-Queens Park 病(--SEA/ααQP)患者。胎儿实际上是(--SA/--SEA)的复合杂合子:如本研究所示,该地区产前诊断中的α-地中海贫血常规筛查应包括人群中常见和罕见的α0-地中海贫血等位基因,以有效预防致命的Hb Bart胎儿水肿综合征。
{"title":"Prenatal diagnostic errors in hemoglobin Bart's hydrops fetalis caused by rare genetic interactions of α-thalassemia.","authors":"Kritsada Singha, Supawadee Yamsri, Kanokwan Sanchaisuriya, Goonnapa Fucharoen, Supan Fucharoen","doi":"10.1515/dx-2024-0114","DOIUrl":"https://doi.org/10.1515/dx-2024-0114","url":null,"abstract":"<p><strong>Objectives: </strong>To describe rare genetic interactions of α-thalassemia alleles causing Hb H disease and Hb Bart's hydrops fetalis which could lead to diagnostic errors in a routine practice.</p><p><strong>Methods: </strong>Hematological and molecular characterization were carried out in a Thai family with a risk of having fetus with Hb Bart's hydrops fetalis.</p><p><strong>Results: </strong>Both parents were found to be the thalassemia intermedia patients associated with unusual forms of Hb H disease. DNA analysis of common α-thalassemia mutations in Thailand identified α<sup>+</sup>-thalassemia (-α<sup>3.7 kb del</sup>) and unknown α<sup>0</sup>-thalassemia in the father and α<sup>0</sup>-thalassemia (--<sup>SEA</sup>) with unknown α<sup>+</sup>-thalassemia in the mother. Fetal DNA analysis unlikely identified a homozygosity for α<sup>0</sup>-thalassemia (--<sup>SEA</sup>/--<sup>SEA</sup>). Further analysis identified that the father carried a rare South African α<sup>0</sup>-thalassemia in combination with α<sup>+</sup>-thalassemia (--<sup>SA</sup>/-α), whereas the mother was a patient with Hb H-Queens Park disease (--<sup>SEA</sup>/αα<sup>QP</sup>). The fetus was, in fact, a compound heterozygote for (--<sup>SA</sup>/--<sup>SEA</sup>).</p><p><strong>Conclusions: </strong>As shown in this study, routine screening for α-thalassemia at prenatal diagnosis in the region should include both common and rare α<sup>0</sup>-thalassemia alleles found in the population to effectively prevent a fatal condition of Hb Bart's hydrops fetalis syndrome.</p>","PeriodicalId":11273,"journal":{"name":"Diagnosis","volume":" ","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142282007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}