首页 > 最新文献

JMIR Medical Informatics最新文献

英文 中文
How to Elucidate Consent-Free Research Use of Medical Data: A Case for "Health Data Literacy". 如何阐明医疗数据的自由研究使用:健康数据扫盲 "案例。
IF 3.1 3区 医学 Q1 Health Professions Pub Date : 2024-06-18 DOI: 10.2196/51350
Gesine Richter, Michael Krawczak

Unlabelled: The extensive utilization of personal health data is one of the key success factors of modern medical research. Obtaining consent to the use of such data during clinical care, however, bears the risk of low and unequal approval rates and risk of consequent methodological problems in the scientific use of the data. In view of these shortcomings, and of the proven willingness of people to contribute to medical research by sharing personal health data, the paradigm of informed consent needs to be reconsidered. The European General Data Protection Regulation gives the European member states considerable leeway with regard to permitting the research use of health data without consent. Following this approach would however require alternative offers of information that compensate for the lack of direct communication with experts during medical care. We therefore introduce the concept of "health data literacy," defined as the capacity to find, understand, and evaluate information about the risks and benefits of the research use of personal health data and to act accordingly. Specifically, health data literacy includes basic knowledge about the goals and methods of data-rich medical research and about the possibilities and limits of data protection. Although the responsibility for developing the necessary resources lies primarily with those directly involved in data-rich medical research, improving health data literacy should ultimately be of concern to everyone interested in the success of this type of research.

无标签:广泛利用个人健康数据是现代医学研究取得成功的关键因素之一。然而,在临床治疗过程中使用这些数据时,征得同意的风险在于同意率较低且不平等,并可能导致数据科学使用方法上的问题。鉴于这些缺陷,以及事实证明人们愿意通过分享个人健康数据为医学研究做出贡献,知情同意的模式需要重新考虑。欧洲通用数据保护条例》在允许未经同意对健康数据进行研究使用方面给予了欧洲成员国相当大的回旋余地。不过,采用这种方法需要提供其他信息,以弥补医疗过程中与专家缺乏直接交流的不足。因此,我们提出了 "健康数据素养 "的概念,其定义是查找、理解和评估有关研究使用个人健康数据的风险和益处的信息并采取相应行动的能力。具体来说,健康数据素养包括有关数据丰富的医学研究的目标和方法以及数据保护的可能性和局限性的基本知识。虽然开发必要资源的责任主要在于那些直接参与数据丰富的医学研究的人员,但提高健康数据素养最终应是每一个关心此类研究成功与否的人所关注的问题。
{"title":"How to Elucidate Consent-Free Research Use of Medical Data: A Case for \"Health Data Literacy\".","authors":"Gesine Richter, Michael Krawczak","doi":"10.2196/51350","DOIUrl":"10.2196/51350","url":null,"abstract":"<p><strong>Unlabelled: </strong>The extensive utilization of personal health data is one of the key success factors of modern medical research. Obtaining consent to the use of such data during clinical care, however, bears the risk of low and unequal approval rates and risk of consequent methodological problems in the scientific use of the data. In view of these shortcomings, and of the proven willingness of people to contribute to medical research by sharing personal health data, the paradigm of informed consent needs to be reconsidered. The European General Data Protection Regulation gives the European member states considerable leeway with regard to permitting the research use of health data without consent. Following this approach would however require alternative offers of information that compensate for the lack of direct communication with experts during medical care. We therefore introduce the concept of \"health data literacy,\" defined as the capacity to find, understand, and evaluate information about the risks and benefits of the research use of personal health data and to act accordingly. Specifically, health data literacy includes basic knowledge about the goals and methods of data-rich medical research and about the possibilities and limits of data protection. Although the responsibility for developing the necessary resources lies primarily with those directly involved in data-rich medical research, improving health data literacy should ultimately be of concern to everyone interested in the success of this type of research.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11196244/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141422040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparison of Synthetic Data Generation Techniques for Control Group Survival Data in Oncology Clinical Trials: Simulation Study. 肿瘤临床试验中对照组生存数据的合成数据生成技术比较:模拟研究
IF 3.1 3区 医学 Q2 MEDICAL INFORMATICS Pub Date : 2024-06-18 DOI: 10.2196/55118
Ippei Akiya, Takuma Ishihara, Keiichi Yamamoto

Background: Synthetic patient data (SPD) generation for survival analysis in oncology trials holds significant potential for accelerating clinical development. Various machine learning methods, including classification and regression trees (CART), random forest (RF), Bayesian network (BN), and conditional tabular generative adversarial network (CTGAN), have been used for this purpose, but their performance in reflecting actual patient survival data remains under investigation.

Objective: The aim of this study was to determine the most suitable SPD generation method for oncology trials, specifically focusing on both progression-free survival (PFS) and overall survival (OS), which are the primary evaluation end points in oncology trials. To achieve this goal, we conducted a comparative simulation of 4 generation methods, including CART, RF, BN, and the CTGAN, and the performance of each method was evaluated.

Methods: Using multiple clinical trial data sets, 1000 data sets were generated by using each method for each clinical trial data set and evaluated as follows: (1) median survival time (MST) of PFS and OS; (2) hazard ratio distance (HRD), which indicates the similarity between the actual survival function and a synthetic survival function; and (3) visual analysis of Kaplan-Meier (KM) plots. Each method's ability to mimic the statistical properties of real patient data was evaluated from these multiple angles.

Results: In most simulation cases, CART demonstrated the high percentages of MSTs for synthetic data falling within the 95% CI range of the MST of the actual data. These percentages ranged from 88.8% to 98.0% for PFS and from 60.8% to 96.1% for OS. In the evaluation of HRD, CART revealed that HRD values were concentrated at approximately 0.9. Conversely, for the other methods, no consistent trend was observed for either PFS or OS. CART demonstrated better similarity than RF, in that CART caused overfitting and RF (a kind of ensemble learning approach) prevented it. In SPD generation, the statistical properties close to the actual data should be the focus, not a well-generalized prediction model. Both the BN and CTGAN methods cannot accurately reflect the statistical properties of the actual data because small data sets are not suitable.

Conclusions: As a method for generating SPD for survival data from small data sets, such as clinical trial data, CART demonstrated to be the most effective method compared to RF, BN, and CTGAN. Additionally, it is possible to improve CART-based generation methods by incorporating feature engineering and other methods in future work.

背景:在肿瘤试验中生成用于生存分析的合成患者数据(SPD)对于加快临床开发具有巨大潜力。各种机器学习方法,包括分类和回归树(CART)、随机森林(RF)、贝叶斯网络(BN)和条件表格生成对抗网络(CTGAN),已被用于此目的,但它们在反映实际患者生存数据方面的性能仍有待研究:本研究的目的是确定最适合肿瘤试验的 SPD 生成方法,特别是针对无进展生存期(PFS)和总生存期(OS)这两个肿瘤试验的主要评估终点。为实现这一目标,我们对 CART、RF、BN 和 CTGAN 等 4 种生成方法进行了比较模拟,并对每种方法的性能进行了评估:使用多个临床试验数据集,针对每个临床试验数据集使用每种方法生成 1000 个数据集,并进行如下评估:(1) PFS 和 OS 的中位生存时间 (MST);(2) 危险比距离 (HRD),表示实际生存函数与合成生存函数之间的相似性;(3) Kaplan-Meier (KM) 图的视觉分析。每种方法模拟真实患者数据统计特性的能力都是从这些角度进行评估的:在大多数模拟案例中,CART 显示合成数据的 MST 在实际数据 MST 的 95% CI 范围内的百分比很高。PFS和OS的百分比分别为88.8%和98.0%,OS的百分比分别为60.8%和96.1%。在评估 HRD 时,CART 显示 HRD 值集中在 0.9 左右。相反,对于其他方法,PFS 和 OS 均未观察到一致的趋势。与 RF 相比,CART 表现出更好的相似性,因为 CART 会导致过度拟合,而 RF(一种集合学习方法)可以防止过度拟合。在生成 SPD 时,重点应放在与实际数据相近的统计特性上,而不是一个通用的预测模型。BN 和 CTGAN 方法都无法准确反映实际数据的统计特性,因为小数据集并不适合:作为从小规模数据集(如临床试验数据)中生成生存数据 SPD 的方法,与 RF、BN 和 CTGAN 相比,CART 被证明是最有效的方法。此外,在未来的工作中,还可以通过结合特征工程和其他方法来改进基于 CART 的生成方法。
{"title":"Comparison of Synthetic Data Generation Techniques for Control Group Survival Data in Oncology Clinical Trials: Simulation Study.","authors":"Ippei Akiya, Takuma Ishihara, Keiichi Yamamoto","doi":"10.2196/55118","DOIUrl":"10.2196/55118","url":null,"abstract":"<p><strong>Background: </strong>Synthetic patient data (SPD) generation for survival analysis in oncology trials holds significant potential for accelerating clinical development. Various machine learning methods, including classification and regression trees (CART), random forest (RF), Bayesian network (BN), and conditional tabular generative adversarial network (CTGAN), have been used for this purpose, but their performance in reflecting actual patient survival data remains under investigation.</p><p><strong>Objective: </strong>The aim of this study was to determine the most suitable SPD generation method for oncology trials, specifically focusing on both progression-free survival (PFS) and overall survival (OS), which are the primary evaluation end points in oncology trials. To achieve this goal, we conducted a comparative simulation of 4 generation methods, including CART, RF, BN, and the CTGAN, and the performance of each method was evaluated.</p><p><strong>Methods: </strong>Using multiple clinical trial data sets, 1000 data sets were generated by using each method for each clinical trial data set and evaluated as follows: (1) median survival time (MST) of PFS and OS; (2) hazard ratio distance (HRD), which indicates the similarity between the actual survival function and a synthetic survival function; and (3) visual analysis of Kaplan-Meier (KM) plots. Each method's ability to mimic the statistical properties of real patient data was evaluated from these multiple angles.</p><p><strong>Results: </strong>In most simulation cases, CART demonstrated the high percentages of MSTs for synthetic data falling within the 95% CI range of the MST of the actual data. These percentages ranged from 88.8% to 98.0% for PFS and from 60.8% to 96.1% for OS. In the evaluation of HRD, CART revealed that HRD values were concentrated at approximately 0.9. Conversely, for the other methods, no consistent trend was observed for either PFS or OS. CART demonstrated better similarity than RF, in that CART caused overfitting and RF (a kind of ensemble learning approach) prevented it. In SPD generation, the statistical properties close to the actual data should be the focus, not a well-generalized prediction model. Both the BN and CTGAN methods cannot accurately reflect the statistical properties of the actual data because small data sets are not suitable.</p><p><strong>Conclusions: </strong>As a method for generating SPD for survival data from small data sets, such as clinical trial data, CART demonstrated to be the most effective method compared to RF, BN, and CTGAN. Additionally, it is possible to improve CART-based generation methods by incorporating feature engineering and other methods in future work.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11196245/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141422039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis. 评估与电子健康记录使用相关的医护人员职业倦怠的普遍程度:系统回顾与元分析》(Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis)。
IF 3.1 3区 医学 Q2 MEDICAL INFORMATICS Pub Date : 2024-06-12 DOI: 10.2196/54811
Yuxuan Wu, Mingyue Wu, Changyu Wang, Jie Lin, Jialin Liu, Siru Liu

Background: Burnout among health care professionals is a significant concern, with detrimental effects on health care service quality and patient outcomes. The use of the electronic health record (EHR) system has been identified as a significant contributor to burnout among health care professionals.

Objective: This systematic review and meta-analysis aims to assess the prevalence of burnout among health care professionals associated with the use of the EHR system, thereby providing evidence to improve health information systems and develop strategies to measure and mitigate burnout.

Methods: We conducted a comprehensive search of the PubMed, Embase, and Web of Science databases for English-language peer-reviewed articles published between January 1, 2009, and December 31, 2022. Two independent reviewers applied inclusion and exclusion criteria, and study quality was assessed using the Joanna Briggs Institute checklist and the Newcastle-Ottawa Scale. Meta-analyses were performed using R (version 4.1.3; R Foundation for Statistical Computing), with EndNote X7 (Clarivate) for reference management.

Results: The review included 32 cross-sectional studies and 5 case-control studies with a total of 66,556 participants, mainly physicians and registered nurses. The pooled prevalence of burnout among health care professionals in cross-sectional studies was 40.4% (95% CI 37.5%-43.2%). Case-control studies indicated a higher likelihood of burnout among health care professionals who spent more time on EHR-related tasks outside work (odds ratio 2.43, 95% CI 2.31-2.57).

Conclusions: The findings highlight the association between the increased use of the EHR system and burnout among health care professionals. Potential solutions include optimizing EHR systems, implementing automated dictation or note-taking, employing scribes to reduce documentation burden, and leveraging artificial intelligence to enhance EHR system efficiency and reduce the risk of burnout.

Trial registration: PROSPERO International Prospective Register of Systematic Reviews CRD42021281173; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021281173.

背景:医护专业人员的职业倦怠是一个令人严重关切的问题,会对医护服务质量和患者治疗效果产生不利影响。电子健康记录(EHR)系统的使用被认为是导致医护人员职业倦怠的一个重要因素:本系统综述和荟萃分析旨在评估与使用电子病历系统相关的医护人员职业倦怠的发生率,从而为改进医疗信息系统以及制定衡量和减轻职业倦怠的策略提供证据:我们在 PubMed、Embase 和 Web of Science 数据库中全面检索了 2009 年 1 月 1 日至 2022 年 12 月 31 日期间发表的英语同行评审文章。两位独立审稿人采用了纳入和排除标准,并使用乔安娜-布里格斯研究所的核对表和纽卡斯尔-渥太华量表对研究质量进行了评估。元分析使用 R(4.1.3 版;R 统计计算基金会)进行,参考文献管理使用 EndNote X7 (Clarivate):综述包括 32 项横断面研究和 5 项病例对照研究,共有 66 556 人参与,主要是医生和注册护士。在横断面研究中,医护人员职业倦怠的总体流行率为 40.4%(95% CI 37.5%-43.2%)。病例对照研究表明,在工作之外花费更多时间从事电子病历相关工作的医护人员出现职业倦怠的可能性更高(几率比2.43,95% CI 2.31-2.57):研究结果强调了电子病历系统的使用增加与医护人员职业倦怠之间的关联。潜在的解决方案包括优化电子病历系统、实施自动听写或记笔记、雇用抄写员以减轻文档记录负担,以及利用人工智能提高电子病历系统的效率并降低职业倦怠风险:PROSPERO 国际前瞻性系统综述注册中心 CRD42021281173;https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021281173。
{"title":"Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis.","authors":"Yuxuan Wu, Mingyue Wu, Changyu Wang, Jie Lin, Jialin Liu, Siru Liu","doi":"10.2196/54811","DOIUrl":"10.2196/54811","url":null,"abstract":"<p><strong>Background: </strong>Burnout among health care professionals is a significant concern, with detrimental effects on health care service quality and patient outcomes. The use of the electronic health record (EHR) system has been identified as a significant contributor to burnout among health care professionals.</p><p><strong>Objective: </strong>This systematic review and meta-analysis aims to assess the prevalence of burnout among health care professionals associated with the use of the EHR system, thereby providing evidence to improve health information systems and develop strategies to measure and mitigate burnout.</p><p><strong>Methods: </strong>We conducted a comprehensive search of the PubMed, Embase, and Web of Science databases for English-language peer-reviewed articles published between January 1, 2009, and December 31, 2022. Two independent reviewers applied inclusion and exclusion criteria, and study quality was assessed using the Joanna Briggs Institute checklist and the Newcastle-Ottawa Scale. Meta-analyses were performed using R (version 4.1.3; R Foundation for Statistical Computing), with EndNote X7 (Clarivate) for reference management.</p><p><strong>Results: </strong>The review included 32 cross-sectional studies and 5 case-control studies with a total of 66,556 participants, mainly physicians and registered nurses. The pooled prevalence of burnout among health care professionals in cross-sectional studies was 40.4% (95% CI 37.5%-43.2%). Case-control studies indicated a higher likelihood of burnout among health care professionals who spent more time on EHR-related tasks outside work (odds ratio 2.43, 95% CI 2.31-2.57).</p><p><strong>Conclusions: </strong>The findings highlight the association between the increased use of the EHR system and burnout among health care professionals. Potential solutions include optimizing EHR systems, implementing automated dictation or note-taking, employing scribes to reduce documentation burden, and leveraging artificial intelligence to enhance EHR system efficiency and reduce the risk of burnout.</p><p><strong>Trial registration: </strong>PROSPERO International Prospective Register of Systematic Reviews CRD42021281173; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021281173.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11208837/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141307448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Explainable AI Method for Tinnitus Diagnosis via Neighbor-Augmented Knowledge Graph and Traditional Chinese Medicine: Development and Validation Study. 通过邻接增强知识图谱和传统中医药对耳鸣进行诊断的可解释人工智能方法:开发与验证研究。
IF 3.1 3区 医学 Q1 Health Professions Pub Date : 2024-06-10 DOI: 10.2196/57678
Ziming Yin, Zhongling Kuang, Haopeng Zhang, Yu Guo, Ting Li, Zhengkun Wu, Lihua Wang

Background: Tinnitus diagnosis poses a challenge in otolaryngology owing to an extremely complex pathogenesis, lack of effective objectification methods, and factor-affected diagnosis. There is currently a lack of explainable auxiliary diagnostic tools for tinnitus in clinical practice.

Objective: This study aims to develop a diagnostic model using an explainable artificial intelligence (AI) method to address the issue of low accuracy in tinnitus diagnosis.

Methods: In this study, a knowledge graph-based tinnitus diagnostic method was developed by combining clinical medical knowledge with electronic medical records. Electronic medical record data from 1267 patients were integrated with traditional Chinese clinical medical knowledge to construct a tinnitus knowledge graph. Subsequently, weights were introduced, which measured patient similarity in the knowledge graph based on mutual information values. Finally, a collaborative neighbor algorithm was proposed, which scored patient similarity to obtain the recommended diagnosis. We conducted 2 group experiments and 1 case derivation to explore the effectiveness of our models and compared the models with state-of-the-art graph algorithms and other explainable machine learning models.

Results: The experimental results indicate that the method achieved 99.4% accuracy, 98.5% sensitivity, 99.6% specificity, 98.7% precision, 98.6% F1-score, and 99% area under the receiver operating characteristic curve for the inference of 5 tinnitus subtypes among 253 test patients. Additionally, it demonstrated good interpretability. The topological structure of knowledge graphs provides transparency that can explain the reasons for the similarity between patients.

Conclusions: This method provides doctors with a reliable and explainable diagnostic tool that is expected to improve tinnitus diagnosis accuracy.

背景:耳鸣的发病机制极其复杂,缺乏有效的客观化方法,而且诊断受多种因素影响,因此耳鸣诊断是耳鼻喉科的一项挑战。目前在临床实践中缺乏可解释的耳鸣辅助诊断工具:本研究旨在利用可解释的人工智能(AI)方法开发一种诊断模型,以解决耳鸣诊断准确率低的问题:本研究通过将临床医学知识与电子病历相结合,开发了基于知识图谱的耳鸣诊断方法。将 1267 名患者的电子病历数据与传统中医临床医学知识相结合,构建了耳鸣知识图谱。随后,引入权重,根据互信息值衡量知识图谱中患者的相似度。最后,我们提出了一种协作邻接算法,通过对患者的相似度进行评分来获得推荐诊断。我们进行了 2 次分组实验和 1 次病例推导,以探索模型的有效性,并将模型与最先进的图算法和其他可解释的机器学习模型进行了比较:实验结果表明,该方法在推断253名测试患者的5种耳鸣亚型时,准确率达到99.4%,灵敏度达到98.5%,特异性达到99.6%,精确度达到98.7%,F1分数达到98.6%,接收者操作特征曲线下面积达到99%。此外,它还表现出良好的可解释性。知识图谱的拓扑结构提供了透明度,可以解释患者之间相似性的原因:该方法为医生提供了可靠、可解释的诊断工具,有望提高耳鸣诊断的准确性。
{"title":"Explainable AI Method for Tinnitus Diagnosis via Neighbor-Augmented Knowledge Graph and Traditional Chinese Medicine: Development and Validation Study.","authors":"Ziming Yin, Zhongling Kuang, Haopeng Zhang, Yu Guo, Ting Li, Zhengkun Wu, Lihua Wang","doi":"10.2196/57678","DOIUrl":"10.2196/57678","url":null,"abstract":"<p><strong>Background: </strong>Tinnitus diagnosis poses a challenge in otolaryngology owing to an extremely complex pathogenesis, lack of effective objectification methods, and factor-affected diagnosis. There is currently a lack of explainable auxiliary diagnostic tools for tinnitus in clinical practice.</p><p><strong>Objective: </strong>This study aims to develop a diagnostic model using an explainable artificial intelligence (AI) method to address the issue of low accuracy in tinnitus diagnosis.</p><p><strong>Methods: </strong>In this study, a knowledge graph-based tinnitus diagnostic method was developed by combining clinical medical knowledge with electronic medical records. Electronic medical record data from 1267 patients were integrated with traditional Chinese clinical medical knowledge to construct a tinnitus knowledge graph. Subsequently, weights were introduced, which measured patient similarity in the knowledge graph based on mutual information values. Finally, a collaborative neighbor algorithm was proposed, which scored patient similarity to obtain the recommended diagnosis. We conducted 2 group experiments and 1 case derivation to explore the effectiveness of our models and compared the models with state-of-the-art graph algorithms and other explainable machine learning models.</p><p><strong>Results: </strong>The experimental results indicate that the method achieved 99.4% accuracy, 98.5% sensitivity, 99.6% specificity, 98.7% precision, 98.6% F<sub>1</sub>-score, and 99% area under the receiver operating characteristic curve for the inference of 5 tinnitus subtypes among 253 test patients. Additionally, it demonstrated good interpretability. The topological structure of knowledge graphs provides transparency that can explain the reasons for the similarity between patients.</p><p><strong>Conclusions: </strong>This method provides doctors with a reliable and explainable diagnostic tool that is expected to improve tinnitus diagnosis accuracy.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11196910/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141297332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the Effect of Electronic Health Record Data Quality on Identifying Patients with Type 2 Diabetes. 评估电子健康记录数据质量对识别 2 型糖尿病患者的影响。
IF 3.1 3区 医学 Q2 MEDICAL INFORMATICS Pub Date : 2024-06-08 DOI: 10.2196/56734
Priyanka Dua Sood, Star Liu, Harold Lehmann, Hadi Kharrazi

Background: Increasing and substantial reliance on Electronic health records (EHR) and data types (i.e., diagnosis (Dx), medication (Rx), laboratory (Lx)) demands assessment of its data quality (DQ) as a fundamental approach; especially since there is need to identify appropriate denominator population with chronic conditions, such as Type-2 Diabetes (T2D), using commonly available computable phenotype definitions (phenotype).

Objective: To bridge this gap, our study aims to assess how issues of EHR DQ, and variations and robustness (or lack thereof) in phenotypes may have potential impact in identifying denominator population.

Methods: Approximately 208k patients with T2D were included in our study using retrospective EHR data of Johns Hopkins Medical Institution (JHMI) during 2017-2019. Our assessment included 4 published phenotypes, and 1 definition from a panel of experts at Hopkins. We conducted descriptive analyses of demographics (i.e., age, sex, race, ethnicity), healthcare utilization (inpatient and emergency room visits), and average Charlson Comorbidity score of each phenotype. We then used different methods to induce/simulate DQ issues of completeness, accuracy and timeliness separately across each phenotype. For induced data incompleteness, our model randomly dropped Dx, Rx, and Lx codes independently at increments of 10%; for induced data inaccuracy, our model randomly replaced a Dx or Rx code with another code of the same data type and induced 2% incremental change from -100% to +10% in Lx result values; and lastly, for timeliness, data was modeled for induced incremental shift of date records by 30 days up to a year.

Results: Less than a quarter (23%) of population overlapped across all phenotypes using EHR. The population identified by each phenotype varied across all combination of data types. Induced incompleteness identified fewer patients with each increment, for e.g., at 100% diagnostic incompleteness, Chronic Conditions Data Warehouse (CCW) phenotype identified zero patients as its phenotypic characteristics included only Dx codes. Induced inaccuracy and timeliness similarly demonstrated variations in performance of each phenotype and therefore, resulting in fewer patients being identified with each incremental change.

Conclusions: We utilized EHR data with Dx, Rx, and Lx data types from a large tertiary hospital system to understand the T2D phenotypic differences and performance. We learned how issues of DQ, using induced DQ methods, may impact identification of the denominator populations upon which clinical (e.g., clinical research and trials, population health evaluations) and financial/operational decisions are made. The novel results from our study may inform in shaping a common T2D computable phenotype definition that can be applicable to clinical informatics, managing chronic conditions, and additional hea

背景:对电子健康记录(EHR)和数据类型(即诊断(Dx)、用药(Rx)、化验(Lx))的依赖越来越大,这就要求对其数据质量(DQ)进行评估,并将其作为一项基本方法;尤其是因为需要利用常用的可计算表型定义(表型)来确定患有慢性疾病(如 2 型糖尿病(T2D))的适当分母人群:为了弥补这一差距,我们的研究旨在评估电子病历 DQ 问题以及表型的变化和稳健性(或缺乏稳健性)如何对确定分母人群产生潜在影响:我们的研究利用约翰霍普金斯医疗机构(JHMI)2017-2019年间的回顾性电子病历数据,纳入了约20.8万名T2D患者。我们的评估包括 4 种已发表的表型和 1 种来自霍普金斯大学专家小组的定义。我们对每种表型的人口统计学(即年龄、性别、种族、民族)、医疗保健利用率(住院和急诊就诊)和平均 Charlson 合并症评分进行了描述性分析。然后,我们使用不同的方法分别诱导/模拟每种表型的完整性、准确性和及时性等 DQ 问题。在诱导数据不完整方面,我们的模型以 10% 的增量随机丢弃 Dx、Rx 和 Lx 编码;在诱导数据不准确方面,我们的模型以相同数据类型的另一个编码随机替换 Dx 或 Rx 编码,并诱导 Lx 结果值从 -100% 到 +10% 之间以 2% 的增量变化;最后,在及时性方面,我们对数据进行建模,诱导日期记录以 30 天到一年的增量变化:只有不到四分之一(23%)的人群在使用电子病历的所有表型中出现重叠。在所有数据类型组合中,每种表型所识别的人群各不相同。每增加一个表型,诱导的不完整性识别出的患者人数就会减少,例如,当诊断不完整性达到 100%时,慢性病数据仓库(CCW)表型识别出的患者人数为零,因为其表型特征只包括疾病代码。诱导的不准确性和及时性同样显示了每种表型的性能差异,因此,每次增量变化都会导致识别出的患者数量减少:我们利用一家大型三级医院系统中包含 Dx、Rx 和 Lx 数据类型的电子病历数据来了解 T2D 表型的差异和性能。我们了解了使用诱导 DQ 方法的 DQ 问题如何影响分母人群的识别,而临床(如临床研究和试验、人群健康评估)和财务/运营决策正是基于这些分母人群做出的。我们研究的新结果可能有助于形成共同的 T2D 可计算表型定义,该定义可适用于临床信息学、慢性病管理以及其他医疗保健行业范围内的工作:
{"title":"Assessing the Effect of Electronic Health Record Data Quality on Identifying Patients with Type 2 Diabetes.","authors":"Priyanka Dua Sood, Star Liu, Harold Lehmann, Hadi Kharrazi","doi":"10.2196/56734","DOIUrl":"10.2196/56734","url":null,"abstract":"<p><strong>Background: </strong>Increasing and substantial reliance on Electronic health records (EHR) and data types (i.e., diagnosis (Dx), medication (Rx), laboratory (Lx)) demands assessment of its data quality (DQ) as a fundamental approach; especially since there is need to identify appropriate denominator population with chronic conditions, such as Type-2 Diabetes (T2D), using commonly available computable phenotype definitions (phenotype).</p><p><strong>Objective: </strong>To bridge this gap, our study aims to assess how issues of EHR DQ, and variations and robustness (or lack thereof) in phenotypes may have potential impact in identifying denominator population.</p><p><strong>Methods: </strong>Approximately 208k patients with T2D were included in our study using retrospective EHR data of Johns Hopkins Medical Institution (JHMI) during 2017-2019. Our assessment included 4 published phenotypes, and 1 definition from a panel of experts at Hopkins. We conducted descriptive analyses of demographics (i.e., age, sex, race, ethnicity), healthcare utilization (inpatient and emergency room visits), and average Charlson Comorbidity score of each phenotype. We then used different methods to induce/simulate DQ issues of completeness, accuracy and timeliness separately across each phenotype. For induced data incompleteness, our model randomly dropped Dx, Rx, and Lx codes independently at increments of 10%; for induced data inaccuracy, our model randomly replaced a Dx or Rx code with another code of the same data type and induced 2% incremental change from -100% to +10% in Lx result values; and lastly, for timeliness, data was modeled for induced incremental shift of date records by 30 days up to a year.</p><p><strong>Results: </strong>Less than a quarter (23%) of population overlapped across all phenotypes using EHR. The population identified by each phenotype varied across all combination of data types. Induced incompleteness identified fewer patients with each increment, for e.g., at 100% diagnostic incompleteness, Chronic Conditions Data Warehouse (CCW) phenotype identified zero patients as its phenotypic characteristics included only Dx codes. Induced inaccuracy and timeliness similarly demonstrated variations in performance of each phenotype and therefore, resulting in fewer patients being identified with each incremental change.</p><p><strong>Conclusions: </strong>We utilized EHR data with Dx, Rx, and Lx data types from a large tertiary hospital system to understand the T2D phenotypic differences and performance. We learned how issues of DQ, using induced DQ methods, may impact identification of the denominator populations upon which clinical (e.g., clinical research and trials, population health evaluations) and financial/operational decisions are made. The novel results from our study may inform in shaping a common T2D computable phenotype definition that can be applicable to clinical informatics, managing chronic conditions, and additional hea","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141293999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction: A Multilabel Text Classifier of Cancer Literature at the Publication Level: Methods Study of Medical Text Classification. 更正:出版物级别的癌症文献多标签文本分类器:医学文本分类方法研究》。
IF 3.1 3区 医学 Q1 Health Professions Pub Date : 2024-06-05 DOI: 10.2196/62757
Ying Zhang, Xiaoying Li, Yi Liu, Aihua Li, Xuemei Yang, Xiaoli Tang

[This corrects the article DOI: 10.2196/44892.].

[This corrects the article DOI: 10.2196/44892.].
{"title":"Correction: A Multilabel Text Classifier of Cancer Literature at the Publication Level: Methods Study of Medical Text Classification.","authors":"Ying Zhang, Xiaoying Li, Yi Liu, Aihua Li, Xuemei Yang, Xiaoli Tang","doi":"10.2196/62757","DOIUrl":"10.2196/62757","url":null,"abstract":"<p><p>[This corrects the article DOI: 10.2196/44892.].</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.1,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11187505/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141262088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Machine Learning Application to Classify Patients at Differing Levels of Risk of Opioid Use Disorder: Clinician-Based Validation Study 一种机器学习应用,用于对阿片类药物使用障碍风险程度不同的患者进行分类:基于临床医生的验证研究
IF 3.2 3区 医学 Q1 Health Professions Pub Date : 2024-06-04 DOI: 10.2196/53625
Tewodros Eguale, François Bastardot, Wenyu Song, Daniel Motta-Calderon, Yasmin Elsobky, Angela Rui, Marlika Marceau, Clark Davis, Sandya Ganesan, Ava Alsubai, Michele Matthews, Lynn A Volk, David W Bates, Ronen Rozenblum
Background: Despite restrictive opioid management guidelines, opioid use disorder (OUD) remains a major public health concern. Machine learning (ML) offers a promising avenue for identifying and alerting clinicians about OUD, thus supporting better clinical decision-making regarding treatment. The performance of a ML application to alert clinicians of a patient’s risk of OUD, was evaluated by comparing it to a structured chart review by clinicians. Objective: To assess the clinical validity of an ML-based application designed to identify and alert clinicians of different levels of patients’ OUD risk. Methods: The ML-application generated OUD risk alerts on outpatient data for 649,504 patients from 2 medical centers between 2010–2013. A random sample of 60 patients was selected from each of 3 OUD risk level categories (n=180). An OUD risk classification scheme and standardized data extraction tool were developed to evaluate the validity of the alerts. Clinicians independently conducted a systematic and structured chart review and came to consensus on a patient’s OUD risk level which was then compared to the ML-application’s risk assignments. Results: 78,587 non-cancer patients with at least 1 opioid prescription were identified as: Not High Risk (64.1%), High Risk (21.2%), and Suspected OUD/OUD (14.7%). The sample of 180 patients was representative of the total population in age, sex, and race. The inter-rater reliability between the ML-application and clinicians had a weighted kappa coefficient (95% Cl) of 0.62 (0.53, 0.71), indicating good agreement. Combining the High Risk and Suspected OUD/OUD categories and using the chart review as a ‘gold standard’, the ML application had a corrected sensitivity (95% CI) of 56.6% (48.7%, 64.5%) and the corrected specificity of 94.2% (90.3%, 98.1%). The positive and negative predictive value (95% CI) was 93.3% (88.2%, 96.3%) and 60.0% (50.4%, 68.9%), respectively. Key themes for disagreements between the ML-application and clinician reviews were identified. Conclusions: A systematic comparison was conducted between an ML system and clinicians for OUD risk identification. The ML-application generated clinically valid and useful alerts about patients’ different risk levels of OUD. ML-applications hold promise for identifying patients at differing levels of OUD risk and will likely complement traditional rule-based approaches to generating alerts about opioid safety issues.
背景:尽管有严格的阿片类药物管理指南,但阿片类药物使用障碍(OUD)仍然是一个重大的公共卫生问题。机器学习(ML)为临床医生识别和警示阿片类药物滥用症提供了一个前景广阔的途径,从而支持更好的临床治疗决策。通过与临床医生进行的结构化病历审查进行比较,评估了提醒临床医生注意患者 OUD 风险的 ML 应用程序的性能。目标:评估基于 ML 的应用程序的临床有效性,该应用程序旨在识别并提醒临床医生患者不同程度的 OUD 风险。方法:2010-2013 年间,该 ML 应用程序根据两个医疗中心 649,504 名患者的门诊数据生成了 OUD 风险警报。从 3 个 OUD 风险级别类别中各随机抽取 60 名患者(n=180)。为评估警报的有效性,研究人员开发了 OUD 风险分类方案和标准化数据提取工具。临床医生独立进行系统化和结构化的病历审查,就患者的 OUD 风险级别达成共识,然后将其与 ML 应用程序的风险分配进行比较。结果78,587名至少开过一次阿片类药物处方的非癌症患者被确定为 "非高风险"(64.1%):非高风险(64.1%)、高风险(21.2%)和疑似 OUD/OUD(14.7%)。180 名患者的样本在年龄、性别和种族方面均代表了总人口。ML 应用程序与临床医生之间的加权卡帕系数(95% Cl)为 0.62(0.53,0.71),表明两者之间具有良好的一致性。结合高风险和疑似 OUD/OUD 类别,并将病历审查作为 "金标准",ML 应用程序的校正灵敏度(95% CI)为 56.6%(48.7%,64.5%),校正特异度为 94.2%(90.3%,98.1%)。阳性和阴性预测值(95% CI)分别为 93.3% (88.2%, 96.3%) 和 60.0% (50.4%, 68.9%)。确定了 ML 应用与临床医生审查之间存在分歧的关键主题。结论:在 OUD 风险识别方面,对 ML 系统和临床医生进行了系统比较。多语言应用系统对患者不同的 OUD 风险水平发出了临床有效且有用的警报。ML 应用程序有望识别处于不同 OUD 风险水平的患者,并有可能补充传统的基于规则的方法,生成有关阿片类药物安全问题的警报。
{"title":"A Machine Learning Application to Classify Patients at Differing Levels of Risk of Opioid Use Disorder: Clinician-Based Validation Study","authors":"Tewodros Eguale, François Bastardot, Wenyu Song, Daniel Motta-Calderon, Yasmin Elsobky, Angela Rui, Marlika Marceau, Clark Davis, Sandya Ganesan, Ava Alsubai, Michele Matthews, Lynn A Volk, David W Bates, Ronen Rozenblum","doi":"10.2196/53625","DOIUrl":"https://doi.org/10.2196/53625","url":null,"abstract":"Background: Despite restrictive opioid management guidelines, opioid use disorder (OUD) remains a major public health concern. Machine learning (ML) offers a promising avenue for identifying and alerting clinicians about OUD, thus supporting better clinical decision-making regarding treatment. The performance of a ML application to alert clinicians of a patient’s risk of OUD, was evaluated by comparing it to a structured chart review by clinicians. Objective: To assess the clinical validity of an ML-based application designed to identify and alert clinicians of different levels of patients’ OUD risk. Methods: The ML-application generated OUD risk alerts on outpatient data for 649,504 patients from 2 medical centers between 2010–2013. A random sample of 60 patients was selected from each of 3 OUD risk level categories (n=180). An OUD risk classification scheme and standardized data extraction tool were developed to evaluate the validity of the alerts. Clinicians independently conducted a systematic and structured chart review and came to consensus on a patient’s OUD risk level which was then compared to the ML-application’s risk assignments. Results: 78,587 non-cancer patients with at least 1 opioid prescription were identified as: Not High Risk (64.1%), High Risk (21.2%), and Suspected OUD/OUD (14.7%). The sample of 180 patients was representative of the total population in age, sex, and race. The inter-rater reliability between the ML-application and clinicians had a weighted kappa coefficient (95% Cl) of 0.62 (0.53, 0.71), indicating good agreement. Combining the High Risk and Suspected OUD/OUD categories and using the chart review as a ‘gold standard’, the ML application had a corrected sensitivity (95% CI) of 56.6% (48.7%, 64.5%) and the corrected specificity of 94.2% (90.3%, 98.1%). The positive and negative predictive value (95% CI) was 93.3% (88.2%, 96.3%) and 60.0% (50.4%, 68.9%), respectively. Key themes for disagreements between the ML-application and clinician reviews were identified. Conclusions: A systematic comparison was conducted between an ML system and clinicians for OUD risk identification. The ML-application generated clinically valid and useful alerts about patients’ different risk levels of OUD. ML-applications hold promise for identifying patients at differing levels of OUD risk and will likely complement traditional rule-based approaches to generating alerts about opioid safety issues.","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141253739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Event Analysis for Automated Estimation of Absent and Persistent Medication Alerts: Novel Methodology 通过事件分析自动估计缺席和持续用药警报:新方法
IF 3.2 3区 医学 Q1 Health Professions Pub Date : 2024-06-04 DOI: 10.2196/54428
Janina A Bittmann, Camilo Scherkl, Andreas D Meid, Walter E Haefeli, Hanna M Seidling
Background: Event analysis is a promising option to estimate the acceptance of medication alerts issued by computerized physician order entry systems with integrated clinical decision support systems (CPOE-CDSS), particularly when alerts cannot be interactively confirmed in the CPOE-CDSS due to its system architecture. Medication documentation is then reviewed for documented evidence of alert acceptance, a time-consuming process, especially when performed manually. Objective: We present a new approach of an automated event analysis and apply it to a large dataset generated in a CPOE-CDSS with passive, non-interruptive alerts. Methods: Medication and alert data generated over 3.5 months within the CPOE-CDSS at Heidelberg University Hospital were divided into 24-hour time intervals in which alert display was correlated with associated prescription changes. Alerts were considered as “persistent” if they were displayed in every consecutive 24-hour time interval due to a respective active prescription until patient discharge and as “absent” if they were no longer displayed during continuous prescriptions in the subsequent interval. Results: Overall, 1,670 patient cases with 11,428 alerts were analyzed. Alerts were displayed for a median of three consecutive 24-hour time intervals with alerts for drug-allergy interactions displayed the shortest, and the longest for potentially inappropriate medication for the elderly (PIM). A total of 56.1 % of all alerts (n = 6,413) became absent, and among them, alerts for drug-drug interactions were the most common (80.9 %, n = 1,915) and PIM alerts the least common (39.9 %, n = 199). Conclusions: This new approach to estimate alert acceptance based on event analysis can be flexibly adapted to the automated evaluation of passive, non-interruptive alerts. This enables large datasets of longitudinal patient cases to be processed, and to derive the ratios of persistent and absent alerts, compare and prospectively monitor them.
背景:事件分析是一种很有前途的方法,可用于估算计算机化医嘱输入系统和集成临床决策支持系统(CPOE-CDSS)发出的用药警报的接受程度,尤其是当由于系统架构原因而无法在 CPOE-CDSS 中以交互方式确认警报时。然后,还要对用药文件进行审核,以获取接受警报的文件证据,这是一个耗时的过程,尤其是在手动操作的情况下。目标:我们提出了一种自动事件分析的新方法,并将其应用于 CPOE-CDSS 中生成的具有被动、非中断警报的大型数据集。分析方法海德堡大学医院 CPOE-CDSS 在 3.5 个月内生成的用药和警报数据被划分为 24 小时的时间间隔,其中警报显示与相关处方变更相关联。如果在患者出院前的每个连续 24 小时时间间隔内都有相应的有效处方而显示警报,则视为 "持续 "警报;如果在随后的时间间隔内的连续处方中不再显示警报,则视为 "缺失 "警报。结果:共分析了 1,670 个病人病例和 11,428 个警报。警报显示时间的中位数为连续三个 24 小时的时间间隔,其中药物过敏相互作用的警报显示时间最短,老年人潜在用药不当(PIM)的警报显示时间最长。共有 56.1% 的警报(n = 6,413 个)消失了,其中最常见的是药物间相互作用警报(80.9%,n = 1,915 个),而 PIM 警报最不常见(39.9%,n = 199 个)。结论:这种基于事件分析估计警报接受度的新方法可以灵活地应用于被动、非干扰性警报的自动评估。这样就能处理大量纵向病例数据集,并得出持续警报和缺失警报的比率,对其进行比较和前瞻性监测。
{"title":"Event Analysis for Automated Estimation of Absent and Persistent Medication Alerts: Novel Methodology","authors":"Janina A Bittmann, Camilo Scherkl, Andreas D Meid, Walter E Haefeli, Hanna M Seidling","doi":"10.2196/54428","DOIUrl":"https://doi.org/10.2196/54428","url":null,"abstract":"Background: Event analysis is a promising option to estimate the acceptance of medication alerts issued by computerized physician order entry systems with integrated clinical decision support systems (CPOE-CDSS), particularly when alerts cannot be interactively confirmed in the CPOE-CDSS due to its system architecture. Medication documentation is then reviewed for documented evidence of alert acceptance, a time-consuming process, especially when performed manually. Objective: We present a new approach of an automated event analysis and apply it to a large dataset generated in a CPOE-CDSS with passive, non-interruptive alerts. Methods: Medication and alert data generated over 3.5 months within the CPOE-CDSS at Heidelberg University Hospital were divided into 24-hour time intervals in which alert display was correlated with associated prescription changes. Alerts were considered as “persistent” if they were displayed in every consecutive 24-hour time interval due to a respective active prescription until patient discharge and as “absent” if they were no longer displayed during continuous prescriptions in the subsequent interval. Results: Overall, 1,670 patient cases with 11,428 alerts were analyzed. Alerts were displayed for a median of three consecutive 24-hour time intervals with alerts for drug-allergy interactions displayed the shortest, and the longest for potentially inappropriate medication for the elderly (PIM). A total of 56.1 % of all alerts (n = 6,413) became absent, and among them, alerts for drug-drug interactions were the most common (80.9 %, n = 1,915) and PIM alerts the least common (39.9 %, n = 199). Conclusions: This new approach to estimate alert acceptance based on event analysis can be flexibly adapted to the automated evaluation of passive, non-interruptive alerts. This enables large datasets of longitudinal patient cases to be processed, and to derive the ratios of persistent and absent alerts, compare and prospectively monitor them.","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141253516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Addressing Hospital Overwhelm During the COVID-19 Pandemic by Using a Primary Health Care-Based Integrated Health System: Modeling Study. 在 COVID-19 大流行期间通过使用基于初级保健的综合保健系统解决医院不堪重负的问题:模型研究。
IF 3.2 3区 医学 Q1 Health Professions Pub Date : 2024-06-03 DOI: 10.2196/54355
Jiaoling Huang, Ying Qian, Yuge Yan, Hong Liang, Laijun Zhao

Background: After strict COVID-19-related restrictions were lifted, health systems globally were overwhelmed. Much has been discussed about how health systems could better prepare for future pandemics; however, primary health care (PHC) has been largely ignored.

Objective: We aimed to investigate what combined policies PHC could apply to strengthen the health care system via a bottom-up approach, so as to better respond to a public health emergency.

Methods: We developed a system dynamics model to replicate Shanghai's response when COVID-19-related restrictions were lifted. We then simulated an alternative PHC-based integrated health system and tested the following three interventions: first contact in PHC with telemedicine services, recommendation to secondary care, and return to PHC for recovery.

Results: The simulation results showed that each selected intervention could alleviate hospital overwhelm. Increasing the rate of first contact in PHC with telemedicine increased hospital bed availability by 6% to 12% and reduced the cumulative number of deaths by 35%. More precise recommendations had a limited impact on hospital overwhelm (<1%), but the simulation results showed that underrecommendation (rate: 80%) would result in a 19% increase in cumulative deaths. Increasing the rate of return to PHC from 5% to 20% improved hospital bed availability by 6% to 16% and reduced the cumulative number of deaths by 46%. Moreover, combining all 3 interventions had a multiplier effect; bed availability increased by 683%, and the cumulative number of deaths dropped by 75%.

Conclusions: Rather than focusing on the allocation of medical resources in secondary care, we determined that an optimal PHC-based integrated strategy would be to have a 60% rate of first contact in PHC, a 110% recommendation rate, and a 20% rate of return to PHC. This could increase health system resilience during public health emergencies.

背景:与 COVID-19 相关的严格限制解除后,全球卫生系统不堪重负。人们对医疗系统如何更好地应对未来的大流行病进行了大量讨论;然而,初级卫生保健(PHC)在很大程度上被忽视了:我们旨在研究初级卫生保健可采用哪些综合政策,通过自下而上的方法加强卫生保健系统,从而更好地应对突发公共卫生事件:方法:我们建立了一个系统动力学模型,以复制上海在 COVID-19 相关限制解除后的反应。然后,我们模拟了一个以初级保健中心为基础的替代性综合医疗系统,并测试了以下三种干预措施:初级保健中心与远程医疗服务的首次接触、向二级医疗机构的推荐以及返回初级保健中心进行康复:模拟结果表明,所选的每项干预措施都能缓解医院不堪重负的状况。通过远程医疗提高初级保健中心的首次接触率,可使医院床位增加 6% 至 12%,累计死亡人数减少 35%。更精确的建议对医院不堪重负的影响有限(结论:我们认为,以初级保健中心为基础的最佳综合策略是:初级保健中心的首次接触率达到 60%,建议率达到 110%,返回初级保健中心的比率达到 20%,而不是将重点放在二级保健中心的医疗资源分配上。这可以提高医疗系统在公共卫生突发事件中的应变能力。
{"title":"Addressing Hospital Overwhelm During the COVID-19 Pandemic by Using a Primary Health Care-Based Integrated Health System: Modeling Study.","authors":"Jiaoling Huang, Ying Qian, Yuge Yan, Hong Liang, Laijun Zhao","doi":"10.2196/54355","DOIUrl":"10.2196/54355","url":null,"abstract":"<p><strong>Background: </strong>After strict COVID-19-related restrictions were lifted, health systems globally were overwhelmed. Much has been discussed about how health systems could better prepare for future pandemics; however, primary health care (PHC) has been largely ignored.</p><p><strong>Objective: </strong>We aimed to investigate what combined policies PHC could apply to strengthen the health care system via a bottom-up approach, so as to better respond to a public health emergency.</p><p><strong>Methods: </strong>We developed a system dynamics model to replicate Shanghai's response when COVID-19-related restrictions were lifted. We then simulated an alternative PHC-based integrated health system and tested the following three interventions: first contact in PHC with telemedicine services, recommendation to secondary care, and return to PHC for recovery.</p><p><strong>Results: </strong>The simulation results showed that each selected intervention could alleviate hospital overwhelm. Increasing the rate of first contact in PHC with telemedicine increased hospital bed availability by 6% to 12% and reduced the cumulative number of deaths by 35%. More precise recommendations had a limited impact on hospital overwhelm (<1%), but the simulation results showed that underrecommendation (rate: 80%) would result in a 19% increase in cumulative deaths. Increasing the rate of return to PHC from 5% to 20% improved hospital bed availability by 6% to 16% and reduced the cumulative number of deaths by 46%. Moreover, combining all 3 interventions had a multiplier effect; bed availability increased by 683%, and the cumulative number of deaths dropped by 75%.</p><p><strong>Conclusions: </strong>Rather than focusing on the allocation of medical resources in secondary care, we determined that an optimal PHC-based integrated strategy would be to have a 60% rate of first contact in PHC, a 110% recommendation rate, and a 20% rate of return to PHC. This could increase health system resilience during public health emergencies.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11185287/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141238786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generalization of a Deep Learning Model for Continuous Glucose Monitoring–Based Hypoglycemia Prediction: Algorithm Development and Validation Study 基于连续葡萄糖监测的低血糖预测深度学习模型的泛化:算法开发与验证研究
IF 3.2 3区 医学 Q1 Health Professions Pub Date : 2024-05-24 DOI: 10.2196/56909
Jian Shao, Ying Pan, Wei-Bin Kou, Huyi Feng, Yu Zhao, Kaixin Zhou, Shao Zhong
Background: Predicting hypoglycemia while maintaining low false alarm rate is a challenge for wide adoption of continuous glucose monitoring (CGM) in diabetes management. One small study suggested the long short-term memory (LSTM) network deep learning model had better performance of hypoglycemia prediction than traditional machine learning algorithms in European patients with type 1 diabetes. However, given that many well-recognized deep learning models perform poorly outside the training consideration, whether the LSTM model could be generalized to different populations or patients with other diabetes subtypes are unknown. Objective: The aim of this study is to validate the LSTM hypoglycemia prediction models in more diverse populations and a wide spectrum of patients with different types of diabetes. Methods: We assembled two large datasets of patients with both type 1 diabetes and type 2 diabetes. The primary dataset containing 192 patients from Chinese were used to develop the LSTM, support vector machine (SVM) and random forest (RF) models for hypoglycemia prediction at the prediction horizon of 30 minutes. Hypoglycemia was defined as the mild (54mg/dl <= glucose < 70mg/dl) and severe (< 54mg/dl) hypoglycemic level separately. The validation dataset of 427 patients from European-Americans was used to validate the models and examine their generalizations. The predictive performance of the models was evaluated by sensitivity, specificity and area under the operating curve (AUC). Results: For the difficulty to predict mild hypoglycemia events, the LSTM model always achieved AUC greater than 97% in the primary dataset, with less than 3% AUC reduction in the validation dataset, indicating the model was robust and generalizable across populations. AUC higher than 93% was also achieved when LSTM was applied to both type 1 diabetes and type 2 diabetes in the validation dataset, further strengthening the generalizability of the model. Under different satisfactory levels of sensitivity for mild and severe hypoglycemia prediction, the LSTM model achieved higher specificity than the SVM and RF models, thereby reducing false alarms. Conclusions: Our results demonstrated that the LSTM model was robust for hypoglycemia prediction and generalizable across populations or diabetes subtypes. Given its extra advantage on false alarm reduction, the LSTM model was a strong candidate to be widely implemented by future CGM devices for hypoglycemia prediction.
背景:预测低血糖同时保持较低的误报率是在糖尿病管理中广泛采用连续血糖监测(CGM)所面临的挑战。一项小型研究表明,在欧洲的 1 型糖尿病患者中,长短期记忆(LSTM)网络深度学习模型的低血糖预测性能优于传统的机器学习算法。然而,鉴于许多公认的深度学习模型在训练考量之外表现不佳,LSTM 模型能否推广到不同人群或其他糖尿病亚型患者尚不可知。研究目的本研究旨在验证 LSTM 低血糖预测模型在更多不同人群和不同类型糖尿病患者中的应用。研究方法我们收集了两个大型数据集,分别包含 1 型糖尿病和 2 型糖尿病患者。主要数据集包含 192 名中国患者,用于开发 LSTM、支持向量机 (SVM) 和随机森林 (RF) 模型,在 30 分钟的预测范围内预测低血糖。低血糖分别定义为轻度(54mg/dl <= 血糖 < 70mg/dl)和重度(< 54mg/dl)低血糖。由 427 名欧美患者组成的验证数据集用于验证模型并检查其概括性。模型的预测性能通过灵敏度、特异性和工作曲线下面积(AUC)进行评估。结果显示对于难以预测的轻度低血糖事件,LSTM 模型在主要数据集中的 AUC 始终高于 97%,在验证数据集中的 AUC 降低率低于 3%,这表明该模型具有稳健性和跨人群普适性。当 LSTM 同时应用于验证数据集中的 1 型糖尿病和 2 型糖尿病时,AUC 也高于 93%,进一步增强了模型的普适性。在轻度和重度低血糖预测灵敏度不同的满意度水平下,LSTM 模型的特异性高于 SVM 和 RF 模型,从而减少了误报。结论我们的研究结果表明,LSTM 模型在预测低血糖症方面非常稳健,而且可以在不同人群或糖尿病亚型中通用。鉴于 LSTM 模型在减少误报方面的额外优势,它是未来 CGM 设备广泛应用于低血糖预测的有力候选模型。
{"title":"Generalization of a Deep Learning Model for Continuous Glucose Monitoring–Based Hypoglycemia Prediction: Algorithm Development and Validation Study","authors":"Jian Shao, Ying Pan, Wei-Bin Kou, Huyi Feng, Yu Zhao, Kaixin Zhou, Shao Zhong","doi":"10.2196/56909","DOIUrl":"https://doi.org/10.2196/56909","url":null,"abstract":"Background: Predicting hypoglycemia while maintaining low false alarm rate is a challenge for wide adoption of continuous glucose monitoring (CGM) in diabetes management. One small study suggested the long short-term memory (LSTM) network deep learning model had better performance of hypoglycemia prediction than traditional machine learning algorithms in European patients with type 1 diabetes. However, given that many well-recognized deep learning models perform poorly outside the training consideration, whether the LSTM model could be generalized to different populations or patients with other diabetes subtypes are unknown. Objective: The aim of this study is to validate the LSTM hypoglycemia prediction models in more diverse populations and a wide spectrum of patients with different types of diabetes. Methods: We assembled two large datasets of patients with both type 1 diabetes and type 2 diabetes. The primary dataset containing 192 patients from Chinese were used to develop the LSTM, support vector machine (SVM) and random forest (RF) models for hypoglycemia prediction at the prediction horizon of 30 minutes. Hypoglycemia was defined as the mild (54mg/dl <= glucose < 70mg/dl) and severe (< 54mg/dl) hypoglycemic level separately. The validation dataset of 427 patients from European-Americans was used to validate the models and examine their generalizations. The predictive performance of the models was evaluated by sensitivity, specificity and area under the operating curve (AUC). Results: For the difficulty to predict mild hypoglycemia events, the LSTM model always achieved AUC greater than 97% in the primary dataset, with less than 3% AUC reduction in the validation dataset, indicating the model was robust and generalizable across populations. AUC higher than 93% was also achieved when LSTM was applied to both type 1 diabetes and type 2 diabetes in the validation dataset, further strengthening the generalizability of the model. Under different satisfactory levels of sensitivity for mild and severe hypoglycemia prediction, the LSTM model achieved higher specificity than the SVM and RF models, thereby reducing false alarms. Conclusions: Our results demonstrated that the LSTM model was robust for hypoglycemia prediction and generalizable across populations or diabetes subtypes. Given its extra advantage on false alarm reduction, the LSTM model was a strong candidate to be widely implemented by future CGM devices for hypoglycemia prediction.","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141149458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
JMIR Medical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1