首页 > 最新文献

Applied Clinical Informatics最新文献

英文 中文
Development and validation of the Nursing Information Security Questionnaire. 开发和验证护理信息安全问卷。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-30 DOI: 10.1055/a-2424-2103
Xiaoyun Zhou, Tingting Gao, Xiujuan Jing, Hong Liu, Xuebing Jing

Background Ensuring the security of nursing information holds substantial importance. The awareness of information security among nurses in China is generally inadequate, and there is a lack of standardized evaluation tools for nurse information security in nursing practice. The nursing sector necessitates the establishment of a robust culture surrounding information security. Objective The aim of this study was to construct a self-reporting instrument for evaluating nursing information security. Methods The research team utilized literature analysis and group discussions to draft the item pool. After two rounds of Delphi consultation by 15 experts and pilot testing, the initial questionnaire was formed. Item analysis was carried out on the questionnaire, and the validity and reliability of the instrument were statistically tested by computing the Keiser-Meier-Olkin (KMO) and Bartlett tests, an exploratory factor analysis, a confirmatory factor analysis, convergent and discriminative validity, descriptive statistics, Cronbach's α and test-retest reliability. Results A total of 501 nurses participated in the study, supplemented by the inclusion of five experts who were invited to contribute to the assessment of content validity. Four factors were formed using exploratory factor analysis (n=250), and the cumulative variance contribution rate was found to be 60.10%. The confirmatory factor analysis (n=251) showed the model fit was good. The overall Cronbach's α coefficient of the questionnaire was 0.948, and the test-retest reliability was 0.837. Conclusion Finally, the NIS-Q with 38 items and three dimensions of knowledge, attitude and practice were formed. A promising assessment instrument for gauging the degree of nursing information security was introduced. Further, a foundational platform was established for implementing specific enhancement strategies aimed at advancing nursing information security.

背景 确保护理信息安全具有重要意义。我国护士对信息安全的认识普遍不足,护理实践中缺乏规范的护士信息安全评估工具。护理行业需要建立健全的信息安全文化。目的 本研究旨在构建一个自我报告的护理信息安全评估工具。方法 研究小组利用文献分析和小组讨论起草了项目库。经过 15 位专家两轮德尔菲咨询和试点测试,形成了初步问卷。对问卷进行了项目分析,并通过计算 Keiser-Meier-Olkin (KMO) 和 Bartlett 检验、探索性因子分析、确认性因子分析、收敛效度和区分效度、描述性统计、Cronbach's α 和测试-再测信度对问卷的效度和信度进行了统计检验。结果 共有 501 名护士参与了研究,并邀请了五位专家参与内容效度评估。通过探索性因子分析(n=250)形成了四个因子,累计方差贡献率为 60.10%。确认性因子分析(n=251)显示模型拟合良好。问卷的总体 Cronbach's α 系数为 0.948,测试-再测信度为 0.837。结论 最后,38 个项目和知识、态度和实践三个维度的 NIS-Q 形成。为衡量护理信息安全程度提供了一个有前途的评估工具。此外,还为实施旨在提高护理信息安全的具体改进策略建立了基础平台。
{"title":"Development and validation of the Nursing Information Security Questionnaire.","authors":"Xiaoyun Zhou, Tingting Gao, Xiujuan Jing, Hong Liu, Xuebing Jing","doi":"10.1055/a-2424-2103","DOIUrl":"https://doi.org/10.1055/a-2424-2103","url":null,"abstract":"<p><p>Background Ensuring the security of nursing information holds substantial importance. The awareness of information security among nurses in China is generally inadequate, and there is a lack of standardized evaluation tools for nurse information security in nursing practice. The nursing sector necessitates the establishment of a robust culture surrounding information security. Objective The aim of this study was to construct a self-reporting instrument for evaluating nursing information security. Methods The research team utilized literature analysis and group discussions to draft the item pool. After two rounds of Delphi consultation by 15 experts and pilot testing, the initial questionnaire was formed. Item analysis was carried out on the questionnaire, and the validity and reliability of the instrument were statistically tested by computing the Keiser-Meier-Olkin (KMO) and Bartlett tests, an exploratory factor analysis, a confirmatory factor analysis, convergent and discriminative validity, descriptive statistics, Cronbach's α and test-retest reliability. Results A total of 501 nurses participated in the study, supplemented by the inclusion of five experts who were invited to contribute to the assessment of content validity. Four factors were formed using exploratory factor analysis (n=250), and the cumulative variance contribution rate was found to be 60.10%. The confirmatory factor analysis (n=251) showed the model fit was good. The overall Cronbach's α coefficient of the questionnaire was 0.948, and the test-retest reliability was 0.837. Conclusion Finally, the NIS-Q with 38 items and three dimensions of knowledge, attitude and practice were formed. A promising assessment instrument for gauging the degree of nursing information security was introduced. Further, a foundational platform was established for implementing specific enhancement strategies aimed at advancing nursing information security.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142330582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Epidemiology of Patient Record Duplication. 病历重复的流行病学。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-27 DOI: 10.1055/a-2423-8499
Onur Sahin, Audrey Zhao, Reuben Applegate, Todd Johnson, Elmer V Bernstam

Objective: Duplicate patient records can increase cost and medical errors. We assessed the association between demographic factors, comorbidities, healthcare usage and duplicate electronic health records.

Materials and methods: We analyzed the association between duplicate patient records and multiple demographic variables (race, Hispanic ethnicity, sex and age) as well as Charlson comorbidity index (CCI), number of diagnoses, and number of healthcare encounters. The study population included 3,018,413 patients seen at a large urban academic medical center with at least one recorded diagnosis. Duplication of patient medical records was determined by using a previously validated enterprise Master Person Index.

Results: Unknown or missing demographic data, Black race when compared to White Race (OR 1.35, p < 0.001), Hispanic compared to non-Hispanic ethnicity (OR 1.48, p < 0.001), older age (OR 1.01, p < 0.001), and "Other" sex compared to female sex (OR 4.71, p < 0.001) were associated with higher odds of having a duplicate record. Comorbidities (CCI, OR 1.10, p < 0.001) and more encounters with the health care system (OR 1.01, p < 0.001) were also associated with higher odds of having a duplicate record. In contrast, male sex compared to female sex was associated with lower odds of having a duplicate record (OR 0.88, p < 0.001).

Discussion: The odds of duplications in medical records were higher in Black, Hispanic, older, non-male patients with more healthcare encounters, more comorbidities, and unknown demographic data. Understanding the epidemiology of duplicate records can help guide prevention and mitigation efforts for high-risk populations.

Conclusion: Duplicate records can contribute to disparities in health care outcomes in minority populations.

目的重复病历会增加成本和医疗失误。我们评估了人口统计学因素、合并症、医疗保健使用和重复电子病历之间的关联:我们分析了重复病历与多种人口统计学变量(种族、西班牙裔、性别和年龄)以及夏尔森合并症指数(CCI)、诊断次数和医疗保健就诊次数之间的关联。研究对象包括在一家大型城市学术医疗中心就诊的 3,018,413 名患者,这些患者至少有一项诊断记录。患者医疗记录的重复性是通过使用之前验证过的企业主人指数来确定的:未知或缺失的人口统计学数据、黑人种族与白人种族相比(OR 1.35,p < 0.001)、西班牙裔与非西班牙裔相比(OR 1.48,p < 0.001)、年龄较大(OR 1.01,p < 0.001)以及 "其他 "性别与女性性别相比(OR 4.71,p < 0.001)与重复病历的几率较高有关。合并症(CCI,OR 1.10,p < 0.001)和与医疗系统接触次数较多(OR 1.01,p < 0.001)也与重复病历的几率较高有关。相比之下,与女性相比,男性重复病历的几率较低(OR 0.88,p < 0.001):讨论:在黑人、西班牙裔、年龄较大、就医次数较多、合并症较多且人口统计学数据未知的非男性患者中,医疗记录重复的几率较高。了解重复病历的流行病学有助于指导高危人群的预防和缓解工作:结论:重复病历可能会导致少数群体的医疗结果出现差异。
{"title":"Epidemiology of Patient Record Duplication.","authors":"Onur Sahin, Audrey Zhao, Reuben Applegate, Todd Johnson, Elmer V Bernstam","doi":"10.1055/a-2423-8499","DOIUrl":"https://doi.org/10.1055/a-2423-8499","url":null,"abstract":"<p><strong>Objective: </strong>Duplicate patient records can increase cost and medical errors. We assessed the association between demographic factors, comorbidities, healthcare usage and duplicate electronic health records.</p><p><strong>Materials and methods: </strong>We analyzed the association between duplicate patient records and multiple demographic variables (race, Hispanic ethnicity, sex and age) as well as Charlson comorbidity index (CCI), number of diagnoses, and number of healthcare encounters. The study population included 3,018,413 patients seen at a large urban academic medical center with at least one recorded diagnosis. Duplication of patient medical records was determined by using a previously validated enterprise Master Person Index.</p><p><strong>Results: </strong>Unknown or missing demographic data, Black race when compared to White Race (OR 1.35, p < 0.001), Hispanic compared to non-Hispanic ethnicity (OR 1.48, p < 0.001), older age (OR 1.01, p < 0.001), and \"Other\" sex compared to female sex (OR 4.71, p < 0.001) were associated with higher odds of having a duplicate record. Comorbidities (CCI, OR 1.10, p < 0.001) and more encounters with the health care system (OR 1.01, p < 0.001) were also associated with higher odds of having a duplicate record. In contrast, male sex compared to female sex was associated with lower odds of having a duplicate record (OR 0.88, p < 0.001).</p><p><strong>Discussion: </strong>The odds of duplications in medical records were higher in Black, Hispanic, older, non-male patients with more healthcare encounters, more comorbidities, and unknown demographic data. Understanding the epidemiology of duplicate records can help guide prevention and mitigation efforts for high-risk populations.</p><p><strong>Conclusion: </strong>Duplicate records can contribute to disparities in health care outcomes in minority populations.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142330583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Comprehensive Multi-Functional Approach for Measuring Parkinson's Disease Severity. 测量帕金森病严重程度的多功能综合方法。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-23 DOI: 10.1055/a-2420-0413
Morteza Rahimi, Zeina Al Masry, John Michael Templeton, Sandra Schneider, Christian Poellabauer

Objectives: This research study aims to advance the staging of Parkinson's disease (PD) by incorporating machine learning to assess and include a broader multi-functional spectrum of neurocognitive symptoms in the staging schemes beyond motor-centric assessments. Specifically, we provide a novel framework to modernize and personalize PD staging more objectively by proposing a hybrid feature scoring approach.

Methods: We recruited thirty-seven individuals diagnosed with PD, each of whom completed a series of tablet-based neurocognitive tests assessing motor, memory, speech, executive functions, and tasks ranging in complexity from single to multi-functional. Then, the collected data was used to develop a hybrid feature scoring system to calculate a weighted vector for each function. We evaluated current PD staging schemes and developed a new approach based on the features selected and extracted using Random Forest and Principal Component Analysis.

Results: Our findings indicate a substantial bias in current PD staging systems toward fine-motor skills, i.e., other neurological functions (memory, speech, executive function, etc.) do not map into current PD stages as well as fine-motor skills do. The results demonstrate that a more accurate and personalized assessment of PD severity could be achieved by including a more exhaustive range of neurocognitive functions in the staging systems either by involving multiple functions in a unified staging score or by designing a function-specific staging system.

Conclusions: The proposed hybrid feature score approach provides a comprehensive understanding of PD by highlighting the need for a staging system that covers various neurocognitive functions. This approach could potentially lead to more effective, objective, and personalized treatment strategies. Further, this proposed methodology could be adapted to other neurodegenerative conditions such as Alzheimer's disease or ALS.

研究目的本研究旨在通过结合机器学习来评估帕金森病(PD)的分期,并在分期方案中纳入更广泛的多功能神经认知症状,而不是以运动为中心的评估。具体来说,我们提供了一个新颖的框架,通过提出一种混合特征评分方法,更客观地对帕金森病进行现代化和个性化分期:我们招募了 37 名确诊为帕金森病的患者,每个人都完成了一系列基于平板电脑的神经认知测试,这些测试评估了运动、记忆、言语、执行功能以及从单一功能到多功能的各种复杂任务。然后,我们将收集到的数据用于开发混合特征评分系统,为每项功能计算加权向量。我们评估了当前的帕金森病分期方案,并根据使用随机森林和主成分分析法选择和提取的特征开发了一种新方法:我们的研究结果表明,目前的帕金森病分期系统严重偏向于精细运动技能,即其他神经功能(记忆、语言、执行功能等)并不能像精细运动技能那样映射到目前的帕金森病分期中。研究结果表明,通过将多种神经认知功能纳入统一的分期评分或设计针对特定功能的分期系统,可以在分期系统中纳入更全面的神经认知功能,从而更准确、更个性化地评估帕金森病的严重程度:所提出的混合特征评分方法强调了建立一个涵盖各种神经认知功能的分期系统的必要性,从而提供了对帕金森病的全面认识。这种方法有可能带来更有效、客观和个性化的治疗策略。此外,这种方法还可适用于其他神经退行性疾病,如阿尔茨海默病或渐冻症。
{"title":"A Comprehensive Multi-Functional Approach for Measuring Parkinson's Disease Severity.","authors":"Morteza Rahimi, Zeina Al Masry, John Michael Templeton, Sandra Schneider, Christian Poellabauer","doi":"10.1055/a-2420-0413","DOIUrl":"https://doi.org/10.1055/a-2420-0413","url":null,"abstract":"<p><strong>Objectives: </strong>This research study aims to advance the staging of Parkinson's disease (PD) by incorporating machine learning to assess and include a broader multi-functional spectrum of neurocognitive symptoms in the staging schemes beyond motor-centric assessments. Specifically, we provide a novel framework to modernize and personalize PD staging more objectively by proposing a hybrid feature scoring approach.</p><p><strong>Methods: </strong>We recruited thirty-seven individuals diagnosed with PD, each of whom completed a series of tablet-based neurocognitive tests assessing motor, memory, speech, executive functions, and tasks ranging in complexity from single to multi-functional. Then, the collected data was used to develop a hybrid feature scoring system to calculate a weighted vector for each function. We evaluated current PD staging schemes and developed a new approach based on the features selected and extracted using Random Forest and Principal Component Analysis.</p><p><strong>Results: </strong>Our findings indicate a substantial bias in current PD staging systems toward fine-motor skills, i.e., other neurological functions (memory, speech, executive function, etc.) do not map into current PD stages as well as fine-motor skills do. The results demonstrate that a more accurate and personalized assessment of PD severity could be achieved by including a more exhaustive range of neurocognitive functions in the staging systems either by involving multiple functions in a unified staging score or by designing a function-specific staging system.</p><p><strong>Conclusions: </strong>The proposed hybrid feature score approach provides a comprehensive understanding of PD by highlighting the need for a staging system that covers various neurocognitive functions. This approach could potentially lead to more effective, objective, and personalized treatment strategies. Further, this proposed methodology could be adapted to other neurodegenerative conditions such as Alzheimer's disease or ALS.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142308859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patient–Clinician Diagnostic Concordance upon Hospital Admission 入院时患者与医生诊断的一致性
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-18 DOI: 10.1055/s-0044-1788330
Alyssa Lam, Savanna Plombon, Alison Garber, Pamela Garabedian, Ronen Rozenblum, Jacqueline A. Griffin, Jeffrey L. Schnipper, Stuart R. Lipsitz, David W. Bates, Anuj K. Dalal

Objectives This study aimed to pilot an application-based patient diagnostic questionnaire (PDQ) and assess the concordance of the admission diagnosis reported by the patient and entered by the clinician.

Methods Eligible patients completed the PDQ assessing patients' understanding of and confidence in the diagnosis 24 hours into hospitalization either independently or with assistance. Demographic data, the hospital principal problem upon admission, and International Classification of Diseases 10th Revision (ICD-10) codes were retrieved from the electronic health record (EHR). Two physicians independently rated concordance between patient-reported diagnosis and clinician-entered principal problem as full, partial, or no. Discrepancies were resolved by consensus. Descriptive statistics were used to report demographics for concordant (full) and nonconcordant (partial or no) outcome groups. Multivariable logistic regressions of PDQ questions and a priori selected EHR data as independent variables were conducted to predict nonconcordance.

Results A total of 157 (77.7%) questionnaires were completed by 202 participants; 77 (49.0%), 46 (29.3%), and 34 (21.7%) were rated fully concordant, partially concordant, and not concordant, respectively. Cohen's kappa for agreement on preconsensus ratings by independent reviewers was 0.81 (0.74, 0.88). In multivariable analyses, patient-reported lack of confidence and undifferentiated symptoms (ICD-10 “R-code”) for the principal problem were significantly associated with nonconcordance (partial or no concordance ratings) after adjusting for other PDQ questions (3.43 [1.30, 10.39], p = 0.02) and in a model using selected variables (4.02 [1.80, 9.55], p < 0.01), respectively.

Conclusion About one-half of patient-reported diagnoses were concordant with the clinician-entered diagnosis on admission. An ICD-10 “R-code” entered as the principal problem and patient-reported lack of confidence may predict patient–clinician nonconcordance early during hospitalization via this approach.

目的 本研究旨在试用基于应用程序的患者诊断问卷(PDQ),并评估患者报告的入院诊断与临床医生输入的诊断是否一致。方法 符合条件的患者在住院 24 小时后独立或在他人协助下完成 PDQ,评估患者对诊断的理解和信心。从电子病历(EHR)中检索人口统计学数据、入院时的主要问题以及国际疾病分类第十版(ICD-10)代码。由两名医生独立将患者报告的诊断与临床医生输入的主要问题之间的一致性分为完全一致、部分一致或不一致。不一致之处通过协商一致的方式解决。描述性统计用于报告结果一致组(完全一致)和不一致组(部分一致或不一致)的人口统计学特征。将 PDQ 问题和事先选定的 EHR 数据作为自变量进行多变量逻辑回归,以预测不一致情况。结果 202 名参与者共完成了 157 份(77.7%)问卷;77 份(49.0%)、46 份(29.3%)和 34 份(21.7%)分别被评为完全一致、部分一致和不一致。独立审稿人对预共识评级的一致性科恩卡帕为 0.81(0.74,0.88)。在多变量分析中,在调整其他 PDQ 问题后(3.43 [1.30, 10.39],p = 0.02)以及在使用选定变量的模型中(4.02 [1.80, 9.55],p 结论:约有二分之一的患者报告的诊断与临床医生在入院时输入的诊断一致。作为主要问题输入的 ICD-10 "R 代码 "和患者报告的缺乏信心可能会通过这种方法预测住院早期患者与临床医生的诊断不一致。
{"title":"Patient–Clinician Diagnostic Concordance upon Hospital Admission","authors":"Alyssa Lam, Savanna Plombon, Alison Garber, Pamela Garabedian, Ronen Rozenblum, Jacqueline A. Griffin, Jeffrey L. Schnipper, Stuart R. Lipsitz, David W. Bates, Anuj K. Dalal","doi":"10.1055/s-0044-1788330","DOIUrl":"https://doi.org/10.1055/s-0044-1788330","url":null,"abstract":"<p>\u0000<b>Objectives</b> This study aimed to pilot an application-based patient diagnostic questionnaire (PDQ) and assess the concordance of the admission diagnosis reported by the patient and entered by the clinician.</p> <p>\u0000<b>Methods</b> Eligible patients completed the PDQ assessing patients' understanding of and confidence in the diagnosis 24 hours into hospitalization either independently or with assistance. Demographic data, the hospital principal problem upon admission, and International Classification of Diseases 10th Revision (ICD-10) codes were retrieved from the electronic health record (EHR). Two physicians independently rated concordance between patient-reported diagnosis and clinician-entered principal problem as full, partial, or no. Discrepancies were resolved by consensus. Descriptive statistics were used to report demographics for concordant (full) and nonconcordant (partial or no) outcome groups. Multivariable logistic regressions of PDQ questions and a priori selected EHR data as independent variables were conducted to predict nonconcordance.</p> <p>\u0000<b>Results</b> A total of 157 (77.7%) questionnaires were completed by 202 participants; 77 (49.0%), 46 (29.3%), and 34 (21.7%) were rated fully concordant, partially concordant, and not concordant, respectively. Cohen's kappa for agreement on preconsensus ratings by independent reviewers was 0.81 (0.74, 0.88). In multivariable analyses, patient-reported lack of confidence and undifferentiated symptoms (ICD-10 “R-code”) for the principal problem were significantly associated with nonconcordance (partial or no concordance ratings) after adjusting for other PDQ questions (3.43 [1.30, 10.39], <i>p</i> = 0.02) and in a model using selected variables (4.02 [1.80, 9.55], <i>p</i> < 0.01), respectively.</p> <p>\u0000<b>Conclusion</b> About one-half of patient-reported diagnoses were concordant with the clinician-entered diagnosis on admission. An ICD-10 “R-code” entered as the principal problem and patient-reported lack of confidence may predict patient–clinician nonconcordance early during hospitalization via this approach.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"50 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Imaging Informatics Education in Clinical Informatics Programs: Perspective from Imaging and Clinical Informatics Professionals 临床信息学课程中的影像信息学教育:来自影像和临床信息学专业人士的视角
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-18 DOI: 10.1055/s-0044-1788327
Nathan A. Bumbarger, Alexander J. Towbin, Pamela Garcia-Filion, James Whitfill, Tessa Cook, Les R. Folio

Background Imaging and Clinical Informatics are domains of biomedical informatics. Imaging Informatics topics are often not covered in depth in most Clinical Informatics fellowships. While dedicated Imaging Informatics fellowships exist, they may not have the same rigor as ACGME (Accreditation Council for Graduate Medical Education) accredited Clinical Informatics fellowships and they do not provide a direct path toward subspecialty board certification.

Objectives We compared published curricula and test content between Clinical and Imaging Informatics fellowship programs. We then highlighted differences between training programs and identified overlapping topics and opportunities for additional education for each type of trainee.

Methods Published consensus curricula and topics were extracted for each specialty. Two informaticists compared topics as shared or not shared between specialties. Next, test content outlines were compared for each specialty exam, extracted, and classified as shared or not shared content. A Venn diagram was created to highlight areas unique to each specialty as well as areas of overlap.

Results There were 139 Clinical Informatics topics compared with 97 Imaging Informatics topics. Of the 139 Clinical Informatics topics, 115 (83%) were covered in the Imaging Informatics curriculum. Of the 97 Imaging Informatics topics, 74 (76%) were covered in the Clinical Informatics curriculum. When using test content outline data, 170 out of 397 (43%) Imaging Informatics topics matched to 64 out of 139 (46%) Clinical Informatics topics. We describe examples of overlapping topics and those unique to each program to identify potential areas to expand.

Conclusion Imaging Informatics and Clinical Informatics fellowship programs have some overlap with areas unique to each. Our review may help guide those seeking informatics education and potential certification. As enterprise imaging evolves, these differences may become more important and create knowledge gaps, if not systematically evaluated.

背景 影像信息学和临床信息学是生物医学信息学的两个领域。大多数临床信息学奖学金通常不深入研究影像信息学课题。虽然有专门的影像信息学研究金,但它们可能没有 ACGME(美国医学教育认证委员会)认可的临床信息学研究金那么严格,也不提供获得亚专科委员会认证的直接途径。目标 我们比较了临床信息学和影像信息学研究金项目的公开课程和考试内容。然后,我们强调了培训项目之间的差异,并确定了重叠的主题以及为每类学员提供额外教育的机会。方法 为每个专业提取已发布的共识课程和主题。两名信息学家比较了各专业之间共享或不共享的主题。然后,比较、提取每个专业考试的测试内容大纲,并将其归类为共享或不共享内容。绘制了维恩图,以突出每个专业的独特领域和重叠领域。结果 139 个临床信息学题目与 97 个影像信息学题目进行了比较。在 139 个临床信息学主题中,有 115 个(83%)在影像信息学课程中涉及。在 97 个影像信息学课题中,临床信息学课程涵盖了 74 个(76%)。使用测试内容大纲数据时,397 个成像信息学主题中的 170 个(43%)与 139 个临床信息学主题中的 64 个(46%)相匹配。我们举例说明了重叠的主题和每个课程独有的主题,以确定潜在的扩展领域。结论 影像信息学和临床信息学研究金项目有一些重叠,但也有各自独特的领域。我们的审查可能有助于为寻求信息学教育和潜在认证的人员提供指导。随着企业成像的发展,如果不进行系统评估,这些差异可能会变得更加重要,并造成知识缺口。
{"title":"Imaging Informatics Education in Clinical Informatics Programs: Perspective from Imaging and Clinical Informatics Professionals","authors":"Nathan A. Bumbarger, Alexander J. Towbin, Pamela Garcia-Filion, James Whitfill, Tessa Cook, Les R. Folio","doi":"10.1055/s-0044-1788327","DOIUrl":"https://doi.org/10.1055/s-0044-1788327","url":null,"abstract":"<p>\u0000<b>Background</b> Imaging and Clinical Informatics are domains of biomedical informatics. Imaging Informatics topics are often not covered in depth in most Clinical Informatics fellowships. While dedicated Imaging Informatics fellowships exist, they may not have the same rigor as ACGME (Accreditation Council for Graduate Medical Education) accredited Clinical Informatics fellowships and they do not provide a direct path toward subspecialty board certification.</p> <p>\u0000<b>Objectives</b> We compared published curricula and test content between Clinical and Imaging Informatics fellowship programs. We then highlighted differences between training programs and identified overlapping topics and opportunities for additional education for each type of trainee.</p> <p>\u0000<b>Methods</b> Published consensus curricula and topics were extracted for each specialty. Two informaticists compared topics as shared or not shared between specialties. Next, test content outlines were compared for each specialty exam, extracted, and classified as shared or not shared content. A Venn diagram was created to highlight areas unique to each specialty as well as areas of overlap.</p> <p>\u0000<b>Results</b> There were 139 Clinical Informatics topics compared with 97 Imaging Informatics topics. Of the 139 Clinical Informatics topics, 115 (83%) were covered in the Imaging Informatics curriculum. Of the 97 Imaging Informatics topics, 74 (76%) were covered in the Clinical Informatics curriculum. When using test content outline data, 170 out of 397 (43%) Imaging Informatics topics matched to 64 out of 139 (46%) Clinical Informatics topics. We describe examples of overlapping topics and those unique to each program to identify potential areas to expand.</p> <p>\u0000<b>Conclusion</b> Imaging Informatics and Clinical Informatics fellowship programs have some overlap with areas unique to each. Our review may help guide those seeking informatics education and potential certification. As enterprise imaging evolves, these differences may become more important and create knowledge gaps, if not systematically evaluated.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"31 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Special Issue on Informatics Education: Exploring the Impact of GitHub Copilot on Health Informatics Education. 信息学教育特刊:探索 GitHub Copilot 对健康信息学教育的影响。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-13 DOI: 10.1055/a-2414-7790
Sanja Avramovic,Ivan Avramovic,Janusz Wojtusiak
BACKGROUNDThe use of artificial intelligence-driven code completion tools, particularly the integration of GitHub Copilot with Visual Studio, has potential implications for Health Informatics education, particularly for students learning SQL and Python.OBJECTIVESThis study aims to evaluate the effectiveness of these tools in solving or assisting with the solution of problems found in Health Informatics coursework, ranging from simple to complex.METHODSThe study assesses the performance of GitHub Copilot in generating code for Health Informatics coding assignments from graduate classes, with a focus on the impact of detailed explanations on the tool's effectiveness.RESULTSFindings reveal that GitHub Copilot can generate correct code for straightforward problems. The correctness and effectiveness of solutions decrease with problem complexity, and the tool struggles with the most challenging problems, although performance on complex problems improves with more detailed explanations.CONCLUSIONSThe study underscores the relevance of these tools to programming in Health Informatics education but also highlights the need for critical evaluation by students. It concludes with a call for educators to adapt swiftly to this rapidly evolving technology.
背景人工智能驱动的代码完成工具的使用,特别是 GitHub Copilot 与 Visual Studio 的集成,对健康信息学教育,尤其是对学习 SQL 和 Python 的学生具有潜在的影响。目的本研究旨在评估这些工具在解决或协助解决健康信息学课程作业中发现的问题(从简单到复杂)方面的有效性。方法本研究评估了 GitHub Copilot 在为研究生课程中的健康信息学编码作业生成代码方面的性能,重点关注了详细解释对该工具有效性的影响。该研究强调了这些工具与健康信息学教育中编程的相关性,同时也强调了学生进行批判性评估的必要性。研究最后呼吁教育工作者迅速适应这种快速发展的技术。
{"title":"Special Issue on Informatics Education: Exploring the Impact of GitHub Copilot on Health Informatics Education.","authors":"Sanja Avramovic,Ivan Avramovic,Janusz Wojtusiak","doi":"10.1055/a-2414-7790","DOIUrl":"https://doi.org/10.1055/a-2414-7790","url":null,"abstract":"BACKGROUNDThe use of artificial intelligence-driven code completion tools, particularly the integration of GitHub Copilot with Visual Studio, has potential implications for Health Informatics education, particularly for students learning SQL and Python.OBJECTIVESThis study aims to evaluate the effectiveness of these tools in solving or assisting with the solution of problems found in Health Informatics coursework, ranging from simple to complex.METHODSThe study assesses the performance of GitHub Copilot in generating code for Health Informatics coding assignments from graduate classes, with a focus on the impact of detailed explanations on the tool's effectiveness.RESULTSFindings reveal that GitHub Copilot can generate correct code for straightforward problems. The correctness and effectiveness of solutions decrease with problem complexity, and the tool struggles with the most challenging problems, although performance on complex problems improves with more detailed explanations.CONCLUSIONSThe study underscores the relevance of these tools to programming in Health Informatics education but also highlights the need for critical evaluation by students. It concludes with a call for educators to adapt swiftly to this rapidly evolving technology.","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"32 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142265942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Developing PRISM: A Pragmatic Institutional Survey and Bench Marking Tool to Measure Digital Research Maturity of Cancer Centers 开发 PRISM:衡量癌症中心数字研究成熟度的实用机构调查和基准标记工具
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-11 DOI: 10.1055/s-0044-1788331
Carlos Berenguer Albiñana, Matteo Pallocca, Hayley Fenton, Will Sopwith, Charlie Van Eden, Olof Akre, Annika Auranen, François Bocquet, Marina Borges, Emiliano Calvo, John Corkett, Serena Di Cosimo, Nicola Gentili, Julien Guérin, Sissel Jor, Tomas Kazda, Alenka Kolar, Tim Kuschel, Maria Julia Lostes, Chiara Paratore, Paolo Pedrazzoli, Marko Petrovic, Jarno Raid, Miriam Roche, Christoph Schatz, Joelle Thonnard, Giovanni Tonon, Alberto Traverso, Andrea Wolf, Ahmed H. Zedan, Piers Mahon

Background Multicenter precision oncology real-world evidence requires a substantial long-term investment by hospitals to prepare their data and align on common Clinical Research processes and medical definitions. Our team has developed a self-assessment framework to support hospitals and hospital networks to measure their digital maturity and better plan and coordinate those investments. From that framework, we developed PRISM for Cancer Outcomes: PRagmatic Institutional Survey and benchMarking.

Objectives The primary objective was to develop PRISM as a tool for self-assessment of digital maturity in oncology hospitals and research networks; a secondary objective was to create an initial benchmarking cohort of >25 hospitals using the tool as input for future development.

Methods PRISM is a 25-question semiquantitative self-assessment survey developed iteratively from expert knowledge in oncology real-world study delivery. It covers four digital maturity dimensions: (1) Precision oncology, (2) Clinical digital data, (3) Routine outcomes, and (4) Information governance and delivery. These reflect the four main data types and critical enablers for precision oncology research from routine electronic health records.

Results During piloting with 26 hospitals from 19 European countries, PRISM was found to be easy to use and its semiquantitative questions to be understood in a wide diversity of hospitals. Results within the initial benchmarking cohort aligned well with internal perspectives. We found statistically significant differences in digital maturity, with Precision oncology being the most mature dimension, and Information governance and delivery the least mature.

Conclusion PRISM is a light footprint benchmarking tool to support the planning of large-scale real-world research networks. It can be used to (i) help an individual hospital identify areas most in need of investment and improvement, (ii) help a network of hospitals identify sources of best practice and expertise, and (iii) help research networks plan research. With further testing, policymakers could use PRISM to better plan digital investments around the Cancer Mission and European Digital Health Space.

背景 多中心精准肿瘤学真实世界证据需要医院进行大量的长期投资,以准备数据,并与通用的临床研究流程和医学定义保持一致。我们的团队开发了一个自我评估框架,以支持医院和医院网络衡量其数字化成熟度,并更好地规划和协调这些投资。根据这一框架,我们开发了癌症结果 PRISM:PRISM for Cancer Outcomes: PRagmatic Institutional Survey and benchMarking.目标 首要目标是将 PRISM 开发为肿瘤医院和研究网络自我评估数字化成熟度的工具;次要目标是创建一个由超过 25 家使用该工具的医院组成的初始基准队列,作为未来开发的输入。方法 PRISM 是一项包含 25 个问题的半定量自我评估调查,是根据肿瘤学真实世界研究交付方面的专家知识反复开发而成的。它涵盖四个数字成熟度维度:(1) 精确肿瘤学,(2) 临床数字数据,(3) 常规结果,以及 (4) 信息管理和交付。它们反映了常规电子健康记录中的四种主要数据类型和精准肿瘤学研究的关键推动因素。结果 在对来自 19 个欧洲国家的 26 家医院进行试点期间,发现 PRISM 易于使用,其半定量问题可被各种医院理解。初始基准队列的结果与内部观点非常吻合。我们发现在数字化成熟度方面存在明显的统计学差异,其中精准肿瘤学是最成熟的维度,而信息管理和交付则是最不成熟的维度。结论 PRISM 是一种轻足迹基准工具,用于支持大规模真实世界研究网络的规划。它可用于:(i) 帮助单个医院确定最需要投资和改进的领域;(ii) 帮助医院网络确定最佳实践和专业知识的来源;(iii) 帮助研究网络规划研究。通过进一步测试,政策制定者可以利用 PRISM 更好地规划围绕癌症任务和欧洲数字健康空间的数字投资。
{"title":"Developing PRISM: A Pragmatic Institutional Survey and Bench Marking Tool to Measure Digital Research Maturity of Cancer Centers","authors":"Carlos Berenguer Albiñana, Matteo Pallocca, Hayley Fenton, Will Sopwith, Charlie Van Eden, Olof Akre, Annika Auranen, François Bocquet, Marina Borges, Emiliano Calvo, John Corkett, Serena Di Cosimo, Nicola Gentili, Julien Guérin, Sissel Jor, Tomas Kazda, Alenka Kolar, Tim Kuschel, Maria Julia Lostes, Chiara Paratore, Paolo Pedrazzoli, Marko Petrovic, Jarno Raid, Miriam Roche, Christoph Schatz, Joelle Thonnard, Giovanni Tonon, Alberto Traverso, Andrea Wolf, Ahmed H. Zedan, Piers Mahon","doi":"10.1055/s-0044-1788331","DOIUrl":"https://doi.org/10.1055/s-0044-1788331","url":null,"abstract":"<p>\u0000<b>Background</b> Multicenter precision oncology real-world evidence requires a substantial long-term investment by hospitals to prepare their data and align on common Clinical Research processes and medical definitions. Our team has developed a self-assessment framework to support hospitals and hospital networks to measure their digital maturity and better plan and coordinate those investments. From that framework, we developed PRISM for Cancer Outcomes: <b>PR</b>agmatic <b>I</b>nstitutional <b>S</b>urvey and bench<b>M</b>arking.</p> <p>\u0000<b>Objectives</b> The primary objective was to develop PRISM as a tool for self-assessment of digital maturity in oncology hospitals and research networks; a secondary objective was to create an initial benchmarking cohort of >25 hospitals using the tool as input for future development.</p> <p>\u0000<b>Methods</b> PRISM is a 25-question semiquantitative self-assessment survey developed iteratively from expert knowledge in oncology real-world study delivery. It covers four digital maturity dimensions: (1) Precision oncology, (2) Clinical digital data, (3) Routine outcomes, and (4) Information governance and delivery. These reflect the four main data types and critical enablers for precision oncology research from routine electronic health records.</p> <p>\u0000<b>Results</b> During piloting with 26 hospitals from 19 European countries, PRISM was found to be easy to use and its semiquantitative questions to be understood in a wide diversity of hospitals. Results within the initial benchmarking cohort aligned well with internal perspectives. We found statistically significant differences in digital maturity, with Precision oncology being the most mature dimension, and Information governance and delivery the least mature.</p> <p>\u0000<b>Conclusion</b> PRISM is a light footprint benchmarking tool to support the planning of large-scale real-world research networks. It can be used to (i) help an individual hospital identify areas most in need of investment and improvement, (ii) help a network of hospitals identify sources of best practice and expertise, and (iii) help research networks plan research. With further testing, policymakers could use PRISM to better plan digital investments around the Cancer Mission and European Digital Health Space.</p> ","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"1 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Issue on Teaching and Training Future Health Informaticians:Partnering with Students to Develop a Capstone for a Graduate Health Informatics Program. 关于未来健康信息学家的教学和培训问题:与学生合作开发健康信息学研究生课程的毕业设计。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-10 DOI: 10.1055/a-2412-3535
Rita Jezrawi,Stephanie Zahorka Derka,Elizabeth Warnick,Jasmine Foley,Vritti Patel,Neethu Pavithran,Thérèse Bernier,Nicole Wagner,Neil G Barr,Vincent Maccio,Margaret Leyland,Cynthia Lokker
OBJECTIVETo assess the desirability, feasibility, and sustainability of integrating a project-based capstone course with the course-based curriculum of an interdisciplinary MSc health informatics program guided with a student-partnered steering committee and student-centered approach.METHODSWe conducted an online cross-sectional survey (n=87) and three semi-structured focus groups (n=18) of health informatics students and alumni. Survey data was analyzed descriptively. Focus groups were audio-recorded and transcribed verbatim and then analyzed using a general inductive and classic analysis approach.RESULTSMost students were supportive of including a capstone project but desired an option to work independently or within a group. Students perceived several benefits to capstone courses while concerned over perceived challenges to capstone implementation, evaluation, and managing group processes. Themes identified were: 1) professional development, identity, and career advancement; 2) emulating the real world and learning beyond the classroom, 3) embracing new, full circle learning, 4) anticipated course structure, delivery, and preparation, 5) balancing student choice, interests, and priorities, and 6) concerns over group dynamics, limitations, and support.CONCLUSIONSThis study demonstrates the value of having students as partners at each stage in the process from methods conception to course curriculum design. With the steering committee and the curriculum developer, we codeveloped a student-centered course that integrates foundational digital health-related project knowledge acquisition with an inquiry-based project which can be completed independently or in small groups. This study demonstrates the potential benefits and challenges that health informatics educators may consider when (re)-designing capstone courses.
目的评估将基于项目的顶点课程与基于课程的跨学科健康信息学硕士项目课程整合的可取性、可行性和可持续性,该项目由学生合作的指导委员会和以学生为中心的方法指导。我们对调查数据进行了描述性分析。对焦点小组进行了录音和逐字转录,然后使用一般归纳和经典分析方法进行分析。结果大多数学生支持包含顶点项目,但希望可以选择独立或小组合作。学生们认为顶点课程有多种益处,同时也对顶点课程的实施、评估和小组流程管理方面的挑战表示担忧。确定的主题有1) 专业发展、身份认同和职业晋升;2) 模仿真实世界和课外学习;3) 接受新的、全方位的学习;4) 预期的课程结构、授课和准备;5) 平衡学生的选择、兴趣和优先事项;6) 关注小组动态、限制和支持。我们与指导委员会和课程开发人员共同开发了一门以学生为中心的课程,该课程将数字健康相关项目的基础知识学习与探究式项目相结合,该项目可以独立完成,也可以小组合作完成。本研究展示了健康信息学教育者在(重新)设计顶点课程时可能考虑到的潜在益处和挑战。
{"title":"Issue on Teaching and Training Future Health Informaticians:Partnering with Students to Develop a Capstone for a Graduate Health Informatics Program.","authors":"Rita Jezrawi,Stephanie Zahorka Derka,Elizabeth Warnick,Jasmine Foley,Vritti Patel,Neethu Pavithran,Thérèse Bernier,Nicole Wagner,Neil G Barr,Vincent Maccio,Margaret Leyland,Cynthia Lokker","doi":"10.1055/a-2412-3535","DOIUrl":"https://doi.org/10.1055/a-2412-3535","url":null,"abstract":"OBJECTIVETo assess the desirability, feasibility, and sustainability of integrating a project-based capstone course with the course-based curriculum of an interdisciplinary MSc health informatics program guided with a student-partnered steering committee and student-centered approach.METHODSWe conducted an online cross-sectional survey (n=87) and three semi-structured focus groups (n=18) of health informatics students and alumni. Survey data was analyzed descriptively. Focus groups were audio-recorded and transcribed verbatim and then analyzed using a general inductive and classic analysis approach.RESULTSMost students were supportive of including a capstone project but desired an option to work independently or within a group. Students perceived several benefits to capstone courses while concerned over perceived challenges to capstone implementation, evaluation, and managing group processes. Themes identified were: 1) professional development, identity, and career advancement; 2) emulating the real world and learning beyond the classroom, 3) embracing new, full circle learning, 4) anticipated course structure, delivery, and preparation, 5) balancing student choice, interests, and priorities, and 6) concerns over group dynamics, limitations, and support.CONCLUSIONSThis study demonstrates the value of having students as partners at each stage in the process from methods conception to course curriculum design. With the steering committee and the curriculum developer, we codeveloped a student-centered course that integrates foundational digital health-related project knowledge acquisition with an inquiry-based project which can be completed independently or in small groups. This study demonstrates the potential benefits and challenges that health informatics educators may consider when (re)-designing capstone courses.","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"44 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Suicide Risk Prediction Models with Temporal Clinical Note Features. 利用时态临床笔记特征增强自杀风险预测模型。
IF 2.9 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-09-09 DOI: 10.1055/a-2411-5796
Kevin Krause,Sharon Davis,Zhijun Yin,Katherine Schafer,Trent Rosenbloom,Colin Walsh
OBJECTIVEThe objective of this study was to investigate the impact of enhancing a structured-data-based suicide attempt risk prediction model with temporal Concept Unique Identifiers (CUIs) derived from clinical notes. We aimed to examine how different temporal schemes, model types, and prediction ranges influenced the model's predictive performance. This research sought to improve our understanding of how the integration of temporal information and clinical variable transformation could enhance model predictions.MATERIALS AND METHODSWe identified modeling targets using diagnostic codes for suicide attempts within 30, 90, or 365 days following a temporally grouped visit cluster. Structured data included medications, diagnoses, procedures, and demographics, while unstructured data consisted of terms extracted with regular expressions from clinical notes. We compared models trained only on structured data (controls) to hybrid models trained on both structured and unstructured data. We used two temporalization schemes for clinical notes: fixed 90-day windows and flexible epochs. We trained and assessed random forests and hybrid LSTM neural networks using AUPRC and AUROC, with additional evaluation of sensitivity and PPV at 95% specificity.RESULTSThe training set included 2,364,183 visit clusters with 2,009 30-day suicide attempts, and the testing set contained 471,936 visit clusters with 480 suicide attempts. Models trained with temporal CUIs outperformed those trained with only structured data. The window-temporalized LSTM model achieved the highest AUPRC (0.056 ± 0.013) for the 30-day prediction range. Hybrid models generally showed better performance compared to controls across most metrics.DISCUSSION AND CONCLUSIONThis study demonstrated that incorporating EHR-derived clinical note features enhanced suicide attempt risk prediction models, particularly with window-temporalized LSTM models. Our results underscored the critical value of unstructured data in suicidality prediction, aligning with previous findings. Future research should focus on integrating more sophisticated methods to continue improving prediction accuracy, which will enhance the effectiveness of future intervention.
目的:本研究的目的是探讨利用来自临床笔记的时间概念唯一标识符 (CUI) 增强基于结构化数据的自杀未遂风险预测模型的影响。我们旨在研究不同的时间方案、模型类型和预测范围对模型预测性能的影响。这项研究旨在加深我们对整合时间信息和临床变量转换如何提高模型预测效果的理解。材料与方法 我们使用诊断代码确定了建模目标,这些代码是在按时间分组的就诊群组之后 30、90 或 365 天内的自杀未遂行为。结构化数据包括药物、诊断、手术和人口统计数据,而非结构化数据包括从临床笔记中用正则表达式提取的术语。我们将仅在结构化数据(对照组)上训练的模型与在结构化数据和非结构化数据上训练的混合模型进行了比较。我们对临床笔记采用了两种时间化方案:固定的 90 天窗口和灵活的历时。我们使用 AUPRC 和 AUROC 对随机森林和混合 LSTM 神经网络进行了训练和评估,并在 95% 的特异性水平上对灵敏度和 PPV 进行了额外评估。结果训练集包括 2,364,183 个就诊集群,其中有 2,009 例 30 天自杀未遂,测试集包括 471,936 个就诊集群,其中有 480 例自杀未遂。使用时间 CUI 训练的模型优于仅使用结构化数据训练的模型。窗口时间化 LSTM 模型在 30 天预测范围内的 AUPRC 最高(0.056 ± 0.013)。与对照组相比,混合模型在大多数指标上都表现出更好的性能。 本研究表明,结合 EHR 衍生的临床笔记特征增强了自杀未遂风险预测模型,尤其是窗时化 LSTM 模型。我们的研究结果强调了非结构化数据在自杀倾向预测中的重要价值,这与之前的研究结果一致。未来的研究应侧重于整合更复杂的方法,以继续提高预测的准确性,从而增强未来干预的有效性。
{"title":"Enhancing Suicide Risk Prediction Models with Temporal Clinical Note Features.","authors":"Kevin Krause,Sharon Davis,Zhijun Yin,Katherine Schafer,Trent Rosenbloom,Colin Walsh","doi":"10.1055/a-2411-5796","DOIUrl":"https://doi.org/10.1055/a-2411-5796","url":null,"abstract":"OBJECTIVEThe objective of this study was to investigate the impact of enhancing a structured-data-based suicide attempt risk prediction model with temporal Concept Unique Identifiers (CUIs) derived from clinical notes. We aimed to examine how different temporal schemes, model types, and prediction ranges influenced the model's predictive performance. This research sought to improve our understanding of how the integration of temporal information and clinical variable transformation could enhance model predictions.MATERIALS AND METHODSWe identified modeling targets using diagnostic codes for suicide attempts within 30, 90, or 365 days following a temporally grouped visit cluster. Structured data included medications, diagnoses, procedures, and demographics, while unstructured data consisted of terms extracted with regular expressions from clinical notes. We compared models trained only on structured data (controls) to hybrid models trained on both structured and unstructured data. We used two temporalization schemes for clinical notes: fixed 90-day windows and flexible epochs. We trained and assessed random forests and hybrid LSTM neural networks using AUPRC and AUROC, with additional evaluation of sensitivity and PPV at 95% specificity.RESULTSThe training set included 2,364,183 visit clusters with 2,009 30-day suicide attempts, and the testing set contained 471,936 visit clusters with 480 suicide attempts. Models trained with temporal CUIs outperformed those trained with only structured data. The window-temporalized LSTM model achieved the highest AUPRC (0.056 ± 0.013) for the 30-day prediction range. Hybrid models generally showed better performance compared to controls across most metrics.DISCUSSION AND CONCLUSIONThis study demonstrated that incorporating EHR-derived clinical note features enhanced suicide attempt risk prediction models, particularly with window-temporalized LSTM models. Our results underscored the critical value of unstructured data in suicidality prediction, aligning with previous findings. Future research should focus on integrating more sophisticated methods to continue improving prediction accuracy, which will enhance the effectiveness of future intervention.","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":"4 1","pages":""},"PeriodicalIF":2.9,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Special Issue on Informatics Education: Teaching Data Science through an Interactive, Hands-On Workshop with Clinically-Relevant Case Studies. 信息学教育特刊:通过与临床相关案例研究的互动式动手研讨会教授数据科学。
IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS Pub Date : 2024-08-30 DOI: 10.1055/a-2407-1272
Alvin Dean Jeffery, Patricia Sengstack

Background: In this case report, we describe the development of an innovative workshop to bridge the gap in data science education for practicing clinicians (and particularly nurses). In the workshop, we emphasize the core concepts of machine learning and predictive modeling to increase understanding among clinicians.

Objective: Addressing the limited exposure of healthcare providers to leverage and critique data science methods, this interactive workshop aims to provide clinicians with foundational knowledge in data science, enabling them to contribute effectively to teams focused on improving care quality.

Methods: The workshop focuses on meaningful topics for clinicians, such as model performance evaluation and introduces machine learning through hands-on exercises using free, interactive python notebooks. Clinical case studies on sepsis recognition and opioid overdose death provide relatable contexts for applying data science concepts.

Results: Positive feedback from over 300 participants across various settings highlights the workshop's effectiveness in making complex topics accessible to clinicians.

Conclusions: Our approach prioritizes engaging content delivery and practical application over extensive programming instruction, aligning with adult learning principles. This initiative underscores the importance of equipping clinicians with data science knowledge to navigate today's data-driven healthcare landscape, offering a template for integrating data science education into healthcare informatics programs or continuing professional development.

背景:在本案例报告中,我们介绍了一个创新研讨会的发展情况,该研讨会旨在弥补临床医生(尤其是护士)在数据科学教育方面的差距。在研讨会上,我们强调了机器学习和预测建模的核心概念,以加深临床医生对这些概念的理解:针对医疗服务提供者在利用和评论数据科学方法方面接触有限的问题,本互动研讨会旨在为临床医生提供数据科学方面的基础知识,使他们能够为专注于提高医疗质量的团队做出有效贡献:方法:研讨会重点关注对临床医生有意义的主题,如模型性能评估,并通过使用免费的交互式 python 笔记本进行实践练习来介绍机器学习。有关败血症识别和阿片类药物过量死亡的临床案例研究为应用数据科学概念提供了贴切的背景:来自 300 多名不同场合的参与者的积极反馈凸显了该研讨会在使临床医生了解复杂主题方面的有效性:我们的方法优先考虑引人入胜的内容交付和实际应用,而不是大量的编程指导,符合成人学习原则。这一举措强调了让临床医生掌握数据科学知识以驾驭当今数据驱动的医疗环境的重要性,为将数据科学教育纳入医疗信息学课程或继续职业发展提供了一个模板。
{"title":"Special Issue on Informatics Education: Teaching Data Science through an Interactive, Hands-On Workshop with Clinically-Relevant Case Studies.","authors":"Alvin Dean Jeffery, Patricia Sengstack","doi":"10.1055/a-2407-1272","DOIUrl":"https://doi.org/10.1055/a-2407-1272","url":null,"abstract":"<p><strong>Background: </strong>In this case report, we describe the development of an innovative workshop to bridge the gap in data science education for practicing clinicians (and particularly nurses). In the workshop, we emphasize the core concepts of machine learning and predictive modeling to increase understanding among clinicians.</p><p><strong>Objective: </strong>Addressing the limited exposure of healthcare providers to leverage and critique data science methods, this interactive workshop aims to provide clinicians with foundational knowledge in data science, enabling them to contribute effectively to teams focused on improving care quality.</p><p><strong>Methods: </strong>The workshop focuses on meaningful topics for clinicians, such as model performance evaluation and introduces machine learning through hands-on exercises using free, interactive python notebooks. Clinical case studies on sepsis recognition and opioid overdose death provide relatable contexts for applying data science concepts.</p><p><strong>Results: </strong>Positive feedback from over 300 participants across various settings highlights the workshop's effectiveness in making complex topics accessible to clinicians.</p><p><strong>Conclusions: </strong>Our approach prioritizes engaging content delivery and practical application over extensive programming instruction, aligning with adult learning principles. This initiative underscores the importance of equipping clinicians with data science knowledge to navigate today's data-driven healthcare landscape, offering a template for integrating data science education into healthcare informatics programs or continuing professional development.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142113865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Clinical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1