首页 > 最新文献

International Journal of Medical Informatics最新文献

英文 中文
Machine learning models to further identify advantaged populations that can achieve functional cure of chronic hepatitis B virus infection after receiving Peg-IFN alpha treatment 通过机器学习模型,进一步确定接受 Peg-IFN alpha 治疗后可实现慢性乙型肝炎病毒感染功能性治愈的优势人群。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-22 DOI: 10.1016/j.ijmedinf.2024.105660
Wenting Zhong , Che Wang , Jia Wang , Tianyan Chen

Objective

Functional cure is currently the highest goal of hepatitis B virus(HBV) treatment.Pegylated interferon(Peg-IFN) alpha is an important drug for this purpose,but even in the hepatitis B e antigen(HBeAg)-negative population,there is still a portion of the population respond poorly to it.Therefore,it is important to explore the influencing factors affecting the response rate of Peg-IFN alpha and establish a prediction model to further identify advantaged populations.

Methods

We retrospectively analyzed 382 patients.297 patients were in the training set and 85 patients from another hospital were in the test set.The intersect features were extracted from all variables using the recursive feature elimination(RFE) algorithm, Boruta algorithm, and least absolute shrinkage and selection operator(LASSO) regression algorithm in the training dataset.Then,we employed six machine learning(ML) algorithms-Logistic Regression(LR),Random Forest(RF),Support Vector Machines(SVM),K Nearest Neighbors(KNN),Light Gradient Boosting Machine(LightGBM) and Extreme Gradient Boosting(XGBoost)-to develop the model.Internal 10-fold cross-validation helped determine the best-performing model,which was then tested externally.Model performance was assessed using metrics such as area under the curve(AUC) and other metrics.SHapley Additive exPlanations(SHAP) plots were used to interpret variable significance.

Results

138/382(36.13 %) patients achieved functional cure.HBsAg at baseline,HBsAg decline at week12,non-alcoholic fatty liver disease(NAFLD) and age were identified as significant variables.RF performed the best,with AUC value of 0.988,and maintained good performance in test set.The SHapley Additive exPlanations(SHAP) plot highlighted HBsAg at baseline and HBsAg decline at week 12 are the top two predictors.The web-calculator was designed to predict functional cure more conveniently(https://www.xsmartanalysis.com/model/list/predict/model/html?mid = 17054&symbol = 317ad245Hx628ko3uW51).

Conclusion

We developed a prediction model,which can be used to not only accurately identifies advantageous populations with Peg-IFN alpha,but also determines whether to continue subsequent Peg-IFN alpha.
目的:功能性治愈是目前治疗乙型肝炎病毒(HBV)的最高目标:功能性治愈是目前乙型肝炎病毒(HBV)治疗的最高目标,聚乙二醇干扰素(Peg-IFN)α是实现这一目标的重要药物,但即使在乙型肝炎e抗原(HBeAg)阴性人群中,仍有一部分人对其反应不佳,因此,探讨影响聚乙二醇干扰素α反应率的影响因素并建立预测模型以进一步识别优势人群具有重要意义:我们对 382 名患者进行了回顾性分析。在训练数据集中,我们使用递归特征消除(RFE)算法、Boruta算法和最小绝对收缩和选择算子(LASSO)回归算法从所有变量中提取了交叉特征。然后,我们采用六种机器学习(ML)算法--逻辑回归(LR)、随机森林(RF)、支持向量机(SVM)、K 最近邻(KNN)、轻梯度提升机(LightGBM)和极端梯度提升(XGBoost)--来开发模型。使用曲线下面积(AUC)等指标评估模型性能,并使用SHAPLEY Additive exPlanations(SHAP)图解释变量的显著性:基线时的 HBsAg、第 12 周时的 HBsAg 下降情况、非酒精性脂肪肝和年龄被确定为重要变量。RF 的 AUC 值为 0.988,表现最佳,并在测试集中保持良好表现。SHapley Additive exPlanations(SHAP)图显示,基线时的HBsAg和第12周时的HBsAg下降是最主要的两个预测因子。设计网络计算器是为了更方便地预测功能性治愈(https://www.xsmartanalysis.com/model/list/predict/model/html?mid = 17054&symbol = 317ad245Hx628ko3uW51):我们建立了一个预测模型,该模型不仅可用于准确识别使用 Peg-IFN alpha 的优势人群,还可用于决定是否继续使用 Peg-IFN alpha。
{"title":"Machine learning models to further identify advantaged populations that can achieve functional cure of chronic hepatitis B virus infection after receiving Peg-IFN alpha treatment","authors":"Wenting Zhong ,&nbsp;Che Wang ,&nbsp;Jia Wang ,&nbsp;Tianyan Chen","doi":"10.1016/j.ijmedinf.2024.105660","DOIUrl":"10.1016/j.ijmedinf.2024.105660","url":null,"abstract":"<div><h3>Objective</h3><div>Functional cure is currently the highest goal of hepatitis B virus(HBV) treatment.Pegylated interferon(Peg-IFN) alpha is an important drug for this purpose,but even in the hepatitis B e antigen(HBeAg)-negative population,there is still a portion of the population respond poorly to it.Therefore,it is important to explore the influencing factors affecting the response rate of Peg-IFN alpha and establish a prediction model to further identify advantaged populations.</div></div><div><h3>Methods</h3><div>We retrospectively analyzed 382 patients.297 patients were in the training set and 85 patients from another hospital were in the test set.The intersect features were extracted from all variables using the recursive feature elimination(RFE) algorithm, Boruta algorithm, and least absolute shrinkage and selection operator(LASSO) regression algorithm in the training dataset.Then,we employed six machine learning(ML) algorithms-Logistic Regression(LR),Random Forest(RF),Support Vector Machines(SVM),K Nearest Neighbors(KNN),Light Gradient Boosting Machine(LightGBM) and Extreme Gradient Boosting(XGBoost)-to develop the model.Internal 10-fold cross-validation helped determine the best-performing model,which was then tested externally.Model performance was assessed using metrics such as area under the curve(AUC) and other metrics.SHapley Additive exPlanations(SHAP) plots were used to interpret variable significance.</div></div><div><h3>Results</h3><div>138/382(36.13 %) patients achieved functional cure.HBsAg at baseline,HBsAg decline at week12,non-alcoholic fatty liver disease(NAFLD) and age were identified as significant variables.RF performed the best,with AUC value of 0.988,and maintained good performance in test set.The SHapley Additive exPlanations(SHAP) plot highlighted HBsAg at baseline and HBsAg decline at week 12 are the top two predictors.The web-calculator was designed to predict functional cure more conveniently(<span><span>https://www.xsmartanalysis.com/model/list/predict/model/html?mid</span><svg><path></path></svg></span> = 17054&amp;symbol = 317ad245Hx628ko3uW51).</div></div><div><h3>Conclusion</h3><div>We developed a prediction model,which can be used to not only accurately identifies advantageous populations with Peg-IFN alpha,but also determines whether to continue subsequent Peg-IFN alpha.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"193 ","pages":"Article 105660"},"PeriodicalIF":3.7,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513258","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
OrthoMortPred: Predicting one-year mortality following orthopedic hospitalization OrthoMortPred:预测骨科住院后一年的死亡率。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-18 DOI: 10.1016/j.ijmedinf.2024.105657
Filipe Ricardo Carvalho , Paulo Jorge Gavaia , António Brito Camacho

Objective

Predicting mortality risk following orthopedic surgery is crucial for informed decision-making and patient care. This study aims to develop and validate a machine learning model for predicting one-year mortality risk after orthopedic hospitalization and to create a personalized risk prediction tool for clinical use.

Methods

We analyzed data from 3,132 patients who underwent orthopedic procedures at the Central Lisbon University Hospital Center from 2021 to 2023. Using the LightGBM algorithm, we developed a predictive model incorporating various clinical and administrative variables. We employed SHAP (SHapley Additive exPlanations) values for model interpretation and created a personalized risk prediction tool for individual patient assessment.

Results

Our model achieved an accuracy of 93% and an area under the ROC curve of 0.93 for predicting one-year mortality. Notably, ’EMERGENCY ADMISSION DATE TIME’ emerged as the most influential predictor, followed by age and pre-operative days. The model demonstrated robust performance across different patient subgroups and outperformed traditional statistical methods. The personalized risk prediction tool provides clinicians with real-time, patient-specific risk assessments and insights into contributing factors.

Conclusion

Our study presents a highly accurate model for predicting one-year mortality following orthopedic hospitalization. The significance of ’EMERGENCY ADMISSION DATE TIME’ as the primary predictor highlights the importance of admission timing in patient outcomes. The accompanying personalized risk prediction tool offers a practical means of implementing this model in clinical settings, potentially improving risk stratification and patient care in orthopedic practice.
目的:预测骨科手术后的死亡风险对于知情决策和患者护理至关重要。本研究旨在开发和验证一个机器学习模型,用于预测骨科住院后一年的死亡风险,并创建一个供临床使用的个性化风险预测工具:我们分析了2021年至2023年期间在里斯本中央大学医院中心接受骨科手术的3132名患者的数据。我们使用 LightGBM 算法开发了一个包含各种临床和管理变量的预测模型。我们采用 SHAP(SHapley Additive exPlanations)值来解释模型,并创建了一个个性化的风险预测工具,用于对患者进行个体评估:我们的模型预测一年死亡率的准确率为 93%,ROC 曲线下面积为 0.93。值得注意的是,"急诊入院日期时间 "是最有影响力的预测因素,其次是年龄和术前天数。该模型在不同的患者亚群中表现稳健,优于传统的统计方法。个性化风险预测工具为临床医生提供了实时的、针对特定患者的风险评估,以及对诱因的深入了解:我们的研究提出了一个高度准确的模型,用于预测骨科住院一年后的死亡率。急诊入院日期时间 "作为主要预测因素的重要性凸显了入院时间对患者预后的重要性。随附的个性化风险预测工具提供了在临床环境中实施该模型的实用方法,有可能改善骨科实践中的风险分层和患者护理。
{"title":"OrthoMortPred: Predicting one-year mortality following orthopedic hospitalization","authors":"Filipe Ricardo Carvalho ,&nbsp;Paulo Jorge Gavaia ,&nbsp;António Brito Camacho","doi":"10.1016/j.ijmedinf.2024.105657","DOIUrl":"10.1016/j.ijmedinf.2024.105657","url":null,"abstract":"<div><h3>Objective</h3><div>Predicting mortality risk following orthopedic surgery is crucial for informed decision-making and patient care. This study aims to develop and validate a machine learning model for predicting one-year mortality risk after orthopedic hospitalization and to create a personalized risk prediction tool for clinical use.</div></div><div><h3>Methods</h3><div>We analyzed data from 3,132 patients who underwent orthopedic procedures at the Central Lisbon University Hospital Center from 2021 to 2023. Using the LightGBM algorithm, we developed a predictive model incorporating various clinical and administrative variables. We employed SHAP (SHapley Additive exPlanations) values for model interpretation and created a personalized risk prediction tool for individual patient assessment.</div></div><div><h3>Results</h3><div>Our model achieved an accuracy of 93% and an area under the ROC curve of 0.93 for predicting one-year mortality. Notably, ’EMERGENCY ADMISSION DATE TIME’ emerged as the most influential predictor, followed by age and pre-operative days. The model demonstrated robust performance across different patient subgroups and outperformed traditional statistical methods. The personalized risk prediction tool provides clinicians with real-time, patient-specific risk assessments and insights into contributing factors.</div></div><div><h3>Conclusion</h3><div>Our study presents a highly accurate model for predicting one-year mortality following orthopedic hospitalization. The significance of ’EMERGENCY ADMISSION DATE TIME’ as the primary predictor highlights the importance of admission timing in patient outcomes. The accompanying personalized risk prediction tool offers a practical means of implementing this model in clinical settings, potentially improving risk stratification and patient care in orthopedic practice.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105657"},"PeriodicalIF":3.7,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142481234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Social services and healthcare personnel’s digital competence profiles: A Finnish cross-sectional study 社会服务和医疗保健人员的数字化能力概况:芬兰横断面研究。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-18 DOI: 10.1016/j.ijmedinf.2024.105658
Minna Ylönen , Panu Forsman , Tapio Karvo , Erika Jarva , Teuvo Antikainen , Petri Kulmala , Kristina Mikkonen , Tommi Kärkkäinen , Raija Hämäläinen

Background

Recent research has highlighted the deficiencies and variations in the digital competences of social services and healthcare personnel. Yet there is a shortage of data regarding how the personnel use digital devices and solutions and their attitudes towards digitalisation. Hence, a systematic investigation into digital devices and solutions in healthcare is warranted.

Objectives

This study aimed to analyse the similarities and differences in digital competences and organisational support among healthcare personnel, focusing on using digital applications and services. The primary research question was to investigate what kinds of digital competence profiles are identifiable through social services and healthcare personnel self-assessments.

Methods

The survey was conducted in the Wellbeing Services County of Central Finland at the end of 2023. It utilised validated self-assessment methods and garnered 643 responses from social services and healthcare professionals. Data analysis involved quantitative cluster analysis for grouping participants and qualitative content analysis for describing the clusters.

Results

The study resulted in a final model of seven clusters that presented distinct digital competence profiles with relatively even sizes. These clusters represented the different aspects of digital usage among social services and healthcare professionals. They could be categorised into three overarching profiles: 1) Motivated digital experts, 2) Burdened digital users and 3) Frustrated survivors. Motivated digital experts comprised up almost half of the respondents (45.1%). Still, the findings also facilitated identifying of a small group of Frustrated survivors (7.5%) who represented burdened and stressed digital users.

Conclusions

The results indicate significant variances in digital competence profiles among employees. Social services and healthcare personnel perceive the opportunities and challenges associated with digital applications and services differently. Further detailed research into the disparities between digital competence profiles is necessary, particularly regarding the types of support that benefit different profiles the most.
背景:最近的研究强调了社会服务和医疗保健人员在数字化能力方面的不足和差异。然而,有关这些人员如何使用数字设备和解决方案以及他们对数字化的态度的数据却十分匮乏。因此,有必要对医疗保健领域的数字化设备和解决方案进行系统调查:本研究旨在分析医疗保健人员在数字化能力和组织支持方面的异同,重点关注数字化应用和服务的使用。主要研究问题是调查通过社会服务和医疗保健人员的自我评估,可以识别出哪些类型的数字化能力特征:调查于 2023 年底在芬兰中部的福利服务县进行。调查采用了经过验证的自我评估方法,共收到来自社会服务机构和医疗保健专业人员的 643 份回复。数据分析包括对参与者进行分组的定量聚类分析和描述聚类的定性内容分析:研究最终得出了由七个组群组成的模型,这些组群呈现出不同的数字能力特征,且规模相对均衡。这些聚类代表了社会服务和医疗保健专业人员使用数字技术的不同方面。它们可被归类为三个主要特征:1)积极的数字专家;2)负担沉重的数字用户;3)沮丧的幸存者。积极的数字专家几乎占受访者的一半(45.1%)。不过,研究结果也有助于确定一小部分沮丧的幸存者(7.5%),他们代表了负担沉重、压力巨大的数字用户:结论:研究结果表明,员工在数字化能力方面存在很大差异。社会服务人员和医疗保健人员对与数字应用和服务相关的机遇和挑战的看法各不相同。有必要进一步详细研究数字能力概况之间的差异,特别是对不同概况最有利的支持类型。
{"title":"Social services and healthcare personnel’s digital competence profiles: A Finnish cross-sectional study","authors":"Minna Ylönen ,&nbsp;Panu Forsman ,&nbsp;Tapio Karvo ,&nbsp;Erika Jarva ,&nbsp;Teuvo Antikainen ,&nbsp;Petri Kulmala ,&nbsp;Kristina Mikkonen ,&nbsp;Tommi Kärkkäinen ,&nbsp;Raija Hämäläinen","doi":"10.1016/j.ijmedinf.2024.105658","DOIUrl":"10.1016/j.ijmedinf.2024.105658","url":null,"abstract":"<div><h3>Background</h3><div>Recent research has highlighted the deficiencies and variations in the digital competences of social services and healthcare personnel. Yet there is a shortage of data regarding how the personnel use digital devices and solutions and their attitudes towards digitalisation. Hence, a systematic investigation into digital devices and solutions in healthcare is warranted.</div></div><div><h3>Objectives</h3><div>This study aimed to analyse the similarities and differences in digital competences and organisational support among healthcare personnel, focusing on using digital applications and services. The primary research question was to investigate what kinds of digital competence profiles are identifiable through social services and healthcare personnel self-assessments.</div></div><div><h3>Methods</h3><div>The survey was conducted in the Wellbeing Services County of Central Finland at the end of 2023. It utilised validated self-assessment methods and garnered 643 responses from social services and healthcare professionals. Data analysis involved quantitative cluster analysis for grouping participants and qualitative content analysis for describing the clusters.</div></div><div><h3>Results</h3><div>The study resulted in a final model of seven clusters that presented distinct digital competence profiles with relatively even sizes. These clusters represented the different aspects of digital usage among social services and healthcare professionals. They could be categorised into three overarching profiles: 1) <em>Motivated digital experts</em>, 2) <em>Burdened digital users</em> and 3) <em>Frustrated survivors. Motivated digital experts</em> comprised up almost half of the respondents (45.1%). Still, the findings also facilitated identifying of a small group of <em>Frustrated survivors</em> (7.5%) who represented burdened and stressed digital users.</div></div><div><h3>Conclusions</h3><div>The results indicate significant variances in digital competence profiles among employees. Social services and healthcare personnel perceive the opportunities and challenges associated with digital applications and services differently. Further detailed research into the disparities between digital competence profiles is necessary, particularly regarding the types of support that benefit different profiles the most.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"193 ","pages":"Article 105658"},"PeriodicalIF":3.7,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FedDSS: A data-similarity approach for client selection in horizontal federated learning FedDSS:横向联合学习中客户选择的数据相似性方法
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-16 DOI: 10.1016/j.ijmedinf.2024.105650
Tuong Minh Nguyen , Kim Leng Poh , Shu-Ling Chong , Jan Hau Lee

Background and objective

Federated learning (FL) is an emerging distributed learning framework allowing multiple clients (hospitals, institutions, smart devices, etc.) to collaboratively train a centralized machine learning model without disclosing personal data. It has the potential to address several healthcare challenges, including a lack of training data, data privacy, and security concerns. However, model learning under FL is affected by non-i.i.d. data, leading to severe model divergence and reduced performance due to the varying client's data distributions. To address this problem, we propose FedDSS, Federated Data Similarity Selection, a framework that uses a data-similarity approach to select clients, without compromising client data privacy.

Methods

FedDSS comprises a statistical-based data similarity metric, a N-similar-neighbor network, and a network-based selection strategy. We assessed FedDSS' performance against FedAvg's in i.i.d. and non-i.i.d. settings with two public pediatric sepsis datasets (PICD and MIMICIII). Selection fairness was measured using entropy. Simulations were repeated five times to evaluate average loss, true positive rate (TPR), and entropy.

Results

In i.i.d setting on PICD, FedDSS achieved a higher TPR starting from the 9th round and surpassing 0.6 three rounds earlier than FedAvg. On MIMICIII, FedDSS's loss decreases significantly from the 13th round, with TPR > 0.8 by the 2nd round, two rounds ahead of FedAvg (at the 4th round). In the non-i.i.d. setting, FedDSS achieved TPR > 0.7 by the 4th and > 0.8 by the 7th round, earlier than FedAvg (at the 5th and 11th rounds). In both settings, FedDSS showed reasonable fairness (entropy of 2.2 and 2.1).

Conclusion

We demonstrated that FedDSS contributes to improved learning in FL by achieving faster convergence, reaching the desired TPR with fewer communication rounds, and potentially enhancing sepsis prediction (TPR) over FedAvg.
背景和目标联合学习(FL)是一种新兴的分布式学习框架,允许多个客户端(医院、机构、智能设备等)在不披露个人数据的情况下协作训练一个集中式机器学习模型。它有可能解决一些医疗保健难题,包括缺乏训练数据、数据隐私和安全问题。然而,FL 下的模型学习会受到非 i.i.d. 数据的影响,由于客户数据分布不同,会导致严重的模型发散和性能下降。为了解决这个问题,我们提出了 FedDSS(联合数据相似性选择),这是一个使用数据相似性方法选择客户端的框架,同时不损害客户端数据隐私。方法 FedDSS 包括一个基于统计的数据相似性度量、一个 N 个相似邻居网络和一个基于网络的选择策略。我们用两个公共儿科败血症数据集(PICD 和 MIMICIII)评估了 FedDSS 在 i.i.d. 和非 i.i.d. 设置下与 FedAvg 的性能对比。选择公平性用熵来衡量。结果在 PICD 的 i.i.d 设置中,FedDSS 从第 9 轮开始获得了更高的 TPR,并比 FedAvg 早三轮超过了 0.6。在 MIMICIII 上,FedDSS 的损失从第 13 轮开始大幅减少,到第 2 轮时 TPR 已达 0.8,比 FedAvg(第 4 轮)早两轮。在非 i.i.d. 设置中,FedDSS 在第 4 轮和第 7 轮的 TPR 分别为 0.7 和 0.8,早于 FedAvg(第 5 轮和第 11 轮)。在这两种设置中,FedDSS 都表现出了合理的公平性(熵值分别为 2.2 和 2.1)。结论我们证明,FedDSS 通过实现更快的收敛、以更少的通信轮数达到所需的 TPR,以及与 FedAvg 相比潜在地提高败血症预测(TPR),有助于改善 FL 的学习。
{"title":"FedDSS: A data-similarity approach for client selection in horizontal federated learning","authors":"Tuong Minh Nguyen ,&nbsp;Kim Leng Poh ,&nbsp;Shu-Ling Chong ,&nbsp;Jan Hau Lee","doi":"10.1016/j.ijmedinf.2024.105650","DOIUrl":"10.1016/j.ijmedinf.2024.105650","url":null,"abstract":"<div><h3>Background and objective</h3><div>Federated learning (FL) is an emerging distributed learning framework allowing multiple clients (hospitals, institutions, smart devices, etc.) to collaboratively train a centralized machine learning model without disclosing personal data. It has the potential to address several healthcare challenges, including a lack of training data, data privacy, and security concerns. However, model learning under FL is affected by non-i.i.d. data, leading to severe model divergence and reduced performance due to the varying client's data distributions. To address this problem, we propose FedDSS, Federated Data Similarity Selection, a framework that uses a data-similarity approach to select clients, without compromising client data privacy.</div></div><div><h3>Methods</h3><div>FedDSS comprises a statistical-based data similarity metric, a <em>N</em>-similar-neighbor network, and a network-based selection strategy. We assessed FedDSS' performance against FedAvg's in i.i.d. and non-i.i.d. settings with two public pediatric sepsis datasets (PICD and MIMICIII). Selection fairness was measured using <span><math><mi>e</mi><mi>n</mi><mi>t</mi><mi>r</mi><mi>o</mi><mi>p</mi><mi>y</mi></math></span>. Simulations were repeated five times to evaluate average loss, true positive rate (TPR), and <span><math><mi>e</mi><mi>n</mi><mi>t</mi><mi>r</mi><mi>o</mi><mi>p</mi><mi>y</mi></math></span>.</div></div><div><h3>Results</h3><div>In i.i.d setting on PICD, FedDSS achieved a higher TPR starting from the 9th round and surpassing 0.6 three rounds earlier than FedAvg. On MIMICIII, FedDSS's loss decreases significantly from the 13th round, with TPR &gt; 0.8 by the 2nd round, two rounds ahead of FedAvg (at the 4th round). In the non-i.i.d. setting, FedDSS achieved TPR &gt; 0.7 by the 4th and &gt; 0.8 by the 7th round, earlier than FedAvg (at the 5th and 11th rounds). In both settings, FedDSS showed reasonable fairness (<span><math><mi>e</mi><mi>n</mi><mi>t</mi><mi>r</mi><mi>o</mi><mi>p</mi><mi>y</mi></math></span> of 2.2 and 2.1).</div></div><div><h3>Conclusion</h3><div>We demonstrated that FedDSS contributes to improved learning in FL by achieving faster convergence, reaching the desired TPR with fewer communication rounds, and potentially enhancing sepsis prediction (TPR) over FedAvg.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105650"},"PeriodicalIF":3.7,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142445293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impact of artificial intelligence on the knowledge, attitude, and practice of pharmacists across diverse settings: A cross-sectional study 人工智能对不同环境下药剂师的知识、态度和实践的影响:一项横断面研究。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-16 DOI: 10.1016/j.ijmedinf.2024.105656
Deema Jaber , Hisham E. Hasan , Rana Abutaima , Hana M. Sawan , Samaa Al Tabbah
The pharmacy practice landscape is undergoing a significant transformation with the increasing integration of artificial intelligence (AI). As essential members of the healthcare team, pharmacists’ readiness and willingness to adopt AI technologies is critical. This cross-sectional study explores pharmacists’ knowledge, attitudes, and practices (KAP) regarding AI in various practice settings. Utilizing a descriptive survey methodology, we collected data through a structured questionnaire targeting pharmacists across diverse working environments. Statistical analyses were conducted to calculate KAP scores. Results revealed that 44.8 % of participants possessed a moderate level of knowledge about AI, while 49.1 % expressed positive attitudes toward its potential applications in pharmacy. However, their current practices related to AI were rated as adequate (57.3 %). Notably, a significant association was found between knowledge, attitudes, and practices (p < 0.001). This study provides valuable insights into pharmacists’ readiness to incorporate AI into their practice, emphasizing the need for targeted educational interventions to enhance knowledge and promote positive attitudes. Furthermore, efforts must be directed towards facilitating the integration of AI into pharmacy workflows to fully leverage this transformative technology and improve patient care outcomes.
随着人工智能(AI)的不断融入,药学实践领域正在经历一场重大变革。作为医疗团队的重要成员,药剂师采用人工智能技术的准备程度和意愿至关重要。本横断面研究探讨了药剂师在各种实践环境中对人工智能的认知、态度和实践(KAP)。我们采用描述性调查方法,通过结构化问卷收集数据,对象是不同工作环境中的药剂师。我们进行了统计分析以计算 KAP 分数。结果显示,44.8% 的参与者对人工智能有一定程度的了解,49.1% 的参与者对人工智能在药学领域的潜在应用持积极态度。然而,他们目前与人工智能相关的实践被评为适当(57.3%)。值得注意的是,知识、态度和实践之间存在着明显的关联(p
{"title":"The impact of artificial intelligence on the knowledge, attitude, and practice of pharmacists across diverse settings: A cross-sectional study","authors":"Deema Jaber ,&nbsp;Hisham E. Hasan ,&nbsp;Rana Abutaima ,&nbsp;Hana M. Sawan ,&nbsp;Samaa Al Tabbah","doi":"10.1016/j.ijmedinf.2024.105656","DOIUrl":"10.1016/j.ijmedinf.2024.105656","url":null,"abstract":"<div><div>The pharmacy practice landscape is undergoing a significant transformation with the increasing integration of artificial intelligence (AI). As essential members of the healthcare team, pharmacists’ readiness and willingness to adopt AI technologies is critical. This cross-sectional study explores pharmacists’ knowledge, attitudes, and practices (KAP) regarding AI in various practice settings. Utilizing a descriptive survey methodology, we collected data through a structured questionnaire targeting pharmacists across diverse working environments. Statistical analyses were conducted to calculate KAP scores. Results revealed that 44.8 % of participants possessed a moderate level of knowledge about AI, while 49.1 % expressed positive attitudes toward its potential applications in pharmacy. However, their current practices related to AI were rated as adequate (57.3 %). Notably, a significant association was found between knowledge, attitudes, and practices (<em>p</em> &lt; 0.001). This study provides valuable insights into pharmacists’ readiness to incorporate AI into their practice, emphasizing the need for targeted educational interventions to enhance knowledge and promote positive attitudes. Furthermore, efforts must be directed towards facilitating the integration of AI into pharmacy workflows to fully leverage this transformative technology and improve patient care outcomes.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105656"},"PeriodicalIF":3.7,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142481235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Autocorrelation of daily resting heart rate: A novel metric of postoperative recovery 每日静息心率的自相关性:术后恢复的新指标。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-16 DOI: 10.1016/j.ijmedinf.2024.105655
Michela Carter , Rui Hua , Megan K. O’Brien , J. Benjamin Pitt , Soyang Kwon , Arun Jayaraman , Hassan MK Ghomrawi , Fizan Abdullah

Purpose

Resting heart rate (RHR) is a sensitive indicator of an individual’s physiologic condition. However, its use in clinical practice has been limited due to the wide variation in baseline RHR based on multiple factors, including age, sex, cardiovascular fitness, and comorbidities. The study aims to develop a novel, clinically meaningful metric that is applicable across these conditions, based on day-by-day changes in RHR—the difference in autocorrelation of daily RHR (ACΔ-RHR). We present ACΔ-RHR in the context of monitoring post-discharge recovery for pediatric appendectomy patients.

Methods

Children 3–17 years old who underwent laparoscopic appendectomy for complicated appendicitis from 2019 to 2022 at a tertiary children’s hospital wore a Fitbit for twenty-one postoperative days (POD). Patients without complications were included to describe normative recovery. Using RHR on POD 1–3 as the baseline, autocorrelation of daily RHR was calculated (fixed lag = 1) for POD 3–21. Then, daily ACΔ-RHR was determined by subtracting autocorrelation values between the current and previous day. Means and standard deviations were calculated for daily RHR to estimate on which POD ACΔ-RHR stabilized at 0, representing general RHR stability and recovery from surgery for all patients. Subgroup analyses were performed by age (3–10 years old vs 11–17 years old) and sex.

Results

Thirty-one patients were included (58.1 % 3–10 years old, 41.9 % female, 67.7 % Hispanic). Whereas the mean daily RHR did not demonstrate clear trends, the mean ACΔ-RHR for the cohort first reached 0 on POD 12 and stabilized on POD 14 (95 % confidence interval: POD [11,17]). Subgroup analysis showed that ACΔ-RHR stabilized on POD 9 for age of 3–10 years, POD 12 for age of 11–17 years, POD 12 for females and POD 10 for males.

Conclusions

The ACΔ-RHR is a promising clinical metric that could enhance post-surgical patient monitoring, such as for children following laparoscopic appendectomy for complicated appendicitis.
目的静息心率(RHR)是反映个人生理状况的敏感指标。然而,由于基线 RHR 因年龄、性别、心血管健康状况和合并症等多种因素而存在很大差异,其在临床实践中的应用受到了限制。本研究旨在根据 RHR 的逐日变化--每日 RHR 的自相关性差异(ACΔ-RHR)--开发一种新型的、具有临床意义的指标,该指标适用于所有这些情况。我们在监测小儿阑尾切除术患者出院后恢复情况的背景下介绍了 ACΔ-RHR:方法:2019 年至 2022 年期间,在一家三级儿童医院接受腹腔镜阑尾切除术治疗复杂性阑尾炎的 3-17 岁儿童在术后 21 天(POD)内佩戴了 Fitbit。其中包括无并发症的患者,以描述正常恢复情况。以 POD 1-3 的 RHR 为基线,计算 POD 3-21 的每日 RHR 的自相关性(固定滞后 = 1)。然后,通过减去当天和前一天的自相关值来确定每天的 ACΔ-RHR 值。计算每日 RHR 的平均值和标准偏差,以估计哪个 POD 的 ACΔ-RHR 稳定在 0,这代表所有患者的总体 RHR 稳定和术后恢复情况。按年龄(3-10 岁 vs 11-17 岁)和性别进行了分组分析:共纳入 31 名患者(3-10 岁占 58.1%,女性占 41.9%,西班牙裔占 67.7%)。虽然平均日 RHR 没有显示出明显的趋势,但队列中的平均 ACΔ-RHR 在 POD 12 首次达到 0,并在 POD 14 趋于稳定(95 % 置信区间:POD [11,17])。亚组分析显示,3-10 岁儿童的 ACΔ-RHR 在 POD 9 趋于稳定,11-17 岁儿童的 ACΔ-RHR 在 POD 12 趋于稳定,女性的 ACΔ-RHR 在 POD 12 趋于稳定,男性的 ACΔ-RHR 在 POD 10 趋于稳定:ACΔ-RHR是一种很有前途的临床指标,可加强对手术后患者的监测,例如对腹腔镜阑尾切除术后患复杂性阑尾炎的儿童。
{"title":"Autocorrelation of daily resting heart rate: A novel metric of postoperative recovery","authors":"Michela Carter ,&nbsp;Rui Hua ,&nbsp;Megan K. O’Brien ,&nbsp;J. Benjamin Pitt ,&nbsp;Soyang Kwon ,&nbsp;Arun Jayaraman ,&nbsp;Hassan MK Ghomrawi ,&nbsp;Fizan Abdullah","doi":"10.1016/j.ijmedinf.2024.105655","DOIUrl":"10.1016/j.ijmedinf.2024.105655","url":null,"abstract":"<div><h3>Purpose</h3><div>Resting heart rate (RHR) is a sensitive indicator of an individual’s physiologic condition. However, its use in clinical practice has been limited due to the wide variation in baseline RHR based on multiple factors, including age, sex, cardiovascular fitness, and comorbidities. The study aims to develop a novel, clinically meaningful metric that is applicable across these conditions, based on day-by-day changes in RHR—the difference in autocorrelation of daily RHR (ACΔ-RHR). We present ACΔ-RHR in the context of monitoring post-discharge recovery for pediatric appendectomy patients.</div></div><div><h3>Methods</h3><div>Children 3–17 years old who underwent laparoscopic appendectomy for complicated appendicitis from 2019 to 2022 at a tertiary children’s hospital wore a Fitbit for twenty-one postoperative days (POD). Patients without complications were included to describe normative recovery. Using RHR on POD 1–3 as the baseline, autocorrelation of daily RHR was calculated (fixed lag = 1) for POD 3–21. Then, daily ACΔ-RHR was determined by subtracting autocorrelation values between the current and previous day. Means and standard deviations were calculated for daily RHR to estimate on which POD ACΔ-RHR stabilized at 0, representing general RHR stability and recovery from surgery for all patients. Subgroup analyses were performed by age (3–10 years old vs 11–17 years old) and sex.</div></div><div><h3>Results</h3><div>Thirty-one patients were included (58.1 % 3–10 years old, 41.9 % female, 67.7 % Hispanic). Whereas the mean daily RHR did not demonstrate clear trends, the mean ACΔ-RHR for the cohort first reached 0 on POD 12 and stabilized on POD 14 (95 % confidence interval: POD [11,17]). Subgroup analysis showed that ACΔ-RHR stabilized on POD 9 for age of 3–10 years, POD 12 for age of 11–17 years, POD 12 for females and POD 10 for males.</div></div><div><h3>Conclusions</h3><div>The ACΔ-RHR is a promising clinical metric that could enhance post-surgical patient monitoring, such as for children following laparoscopic appendectomy for complicated appendicitis.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105655"},"PeriodicalIF":3.7,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large language models can support generation of standardized discharge summaries – A retrospective study utilizing ChatGPT-4 and electronic health records 大型语言模型可支持生成标准化出院摘要--一项利用 ChatGPT-4 和电子健康记录进行的回顾性研究。
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-14 DOI: 10.1016/j.ijmedinf.2024.105654
Arne Schwieger , Katrin Angst , Mateo de Bardeci , Achim Burrer , Flurin Cathomas , Stefano Ferrea , Franziska Grätz , Marius Knorr , Golo Kronenberg , Tobias Spiller , David Troi , Erich Seifritz , Samantha Weber , Sebastian Olbrich

Objective

To evaluate whether psychiatric discharge summaries (DS) generated with ChatGPT-4 from electronic health records (EHR) can match the quality of DS written by psychiatric residents.

Methods

At a psychiatric primary care hospital, we compared 20 inpatient DS, written by residents, to those written with ChatGPT-4 from pseudonymized residents’ notes of the patients’ EHRs and a standardized prompt. 8 blinded psychiatry specialists rated both versions on a custom Likert scale from 1 to 5 across 15 quality subcategories. The primary outcome was the overall rating difference between the two groups. The secondary outcomes were the rating differences at the level of individual question, case, and rater.

Results

Human-written DS were rated significantly higher than AI (mean ratings: human 3.78, AI 3.12, p < 0.05). They surpassed AI significantly in 12/15 questions and 16/20 cases and were favored significantly by 7/8 raters. For “low expected correction effort”, human DS were rated as 67 % favorable, 19 % neutral, and 14 % unfavorable, whereas AI-DS were rated as 22 % favorable, 33 % neutral, and 45 % unfavorable. Hallucinations were present in 40 % of AI-DS, with 37.5 % deemed highly clinically relevant. Minor content mistakes were found in 30 % of AI and 10 % of human DS. Raters correctly identified AI-DS with 81 % sensitivity and 75 % specificity.

Discussion

Overall, AI-DS did not match the quality of resident-written DS but performed similarly in 20% of cases and were rated as favorable for “low expected correction effort” in 22% of cases. AI-DS lacked most in content specificity, ability to distill key case information, and coherence but performed adequately in conciseness, adherence to formalities, relevance of included content, and form.

Conclusion

LLM-written DS show potential as templates for physicians to finalize, potentially saving time in the future.
目的评估使用 ChatGPT-4 从电子健康记录(EHR)中生成的精神科出院摘要(DS)的质量是否能与精神科住院医生撰写的出院摘要相媲美:在一家精神科初级保健医院,我们比较了由住院医师撰写的 20 份住院病人出院摘要,以及使用 ChatGPT-4 从患者电子健康记录的化名住院医师笔记和标准化提示中撰写的出院摘要。8 位双盲精神病学专家采用自定义的李克特量表,从 1 到 5 对 15 个质量子类别对两个版本进行评分。主要结果是两组之间的总体评分差异。次要结果是单个问题、病例和评分者的评分差异:结果:人工撰写的数据集的评分明显高于人工智能(平均评分:人工 3.78,人工智能 3.12,p 讨论):总体而言,人工智能答题系统的质量无法与居民撰写的答题系统相提并论,但在 20% 的案例中表现类似,在 22% 的案例中因 "预期修正工作量低 "而被评为良好。人工智能数据集在内容具体性、提炼关键病例信息的能力和连贯性方面最为欠缺,但在简洁性、遵守格式、所含内容的相关性和形式方面表现良好:LLM编写的DS显示出作为模板供医生最终确定的潜力,将来有可能节省时间。
{"title":"Large language models can support generation of standardized discharge summaries – A retrospective study utilizing ChatGPT-4 and electronic health records","authors":"Arne Schwieger ,&nbsp;Katrin Angst ,&nbsp;Mateo de Bardeci ,&nbsp;Achim Burrer ,&nbsp;Flurin Cathomas ,&nbsp;Stefano Ferrea ,&nbsp;Franziska Grätz ,&nbsp;Marius Knorr ,&nbsp;Golo Kronenberg ,&nbsp;Tobias Spiller ,&nbsp;David Troi ,&nbsp;Erich Seifritz ,&nbsp;Samantha Weber ,&nbsp;Sebastian Olbrich","doi":"10.1016/j.ijmedinf.2024.105654","DOIUrl":"10.1016/j.ijmedinf.2024.105654","url":null,"abstract":"<div><h3>Objective</h3><div>To evaluate whether psychiatric discharge summaries (DS) generated with ChatGPT-4 from electronic health records (EHR) can match the quality of DS written by psychiatric residents.</div></div><div><h3>Methods</h3><div>At a psychiatric primary care hospital, we compared 20 inpatient DS, written by residents, to those written with ChatGPT-4 from pseudonymized residents’ notes of the patients’ EHRs and a standardized prompt. 8 blinded psychiatry specialists rated both versions on a custom Likert scale from 1 to 5 across 15 quality subcategories. The primary outcome was the overall rating difference between the two groups. The secondary outcomes were the rating differences at the level of individual question, case, and rater.</div></div><div><h3>Results</h3><div>Human-written DS were rated significantly higher than AI (mean ratings: human 3.78, AI 3.12, p &lt; 0.05). They surpassed AI significantly in 12/15 questions and 16/20 cases and were favored significantly by 7/8 raters. For “low expected correction effort”, human DS were rated as 67 % favorable, 19 % neutral, and 14 % unfavorable, whereas AI-DS were rated as 22 % favorable, 33 % neutral, and 45 % unfavorable. Hallucinations were present in 40 % of AI-DS, with 37.5 % deemed highly clinically relevant. Minor content mistakes were found in 30 % of AI and 10 % of human DS. Raters correctly identified AI-DS with 81 % sensitivity and 75 % specificity.</div></div><div><h3>Discussion</h3><div>Overall, AI-DS did not match the quality of resident-written DS but performed similarly in 20% of cases and were rated as favorable for “low expected correction effort” in 22% of cases. AI-DS lacked most in content specificity, ability to distill key case information, and coherence but performed adequately in conciseness, adherence to formalities, relevance of included content, and form.</div></div><div><h3>Conclusion</h3><div>LLM-written DS show potential as templates for physicians to finalize, potentially saving time in the future.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105654"},"PeriodicalIF":3.7,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142513257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systematic review and proposed framework for sustainable learning healthcare systems 可持续学习型医疗保健系统的系统回顾和拟议框架
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-12 DOI: 10.1016/j.ijmedinf.2024.105652
Olga Golburean , Espen Solbakken Nordheim , Arild Faxvaag , Rune Pedersen , Ove Lintvedt , Luis Marco-Ruiz

Background

The healthcare sector is a complex domain that faces challenges in effectively learning from practices and outcome data. The Learning Health System (LHS) has emerged as a potential framework to improve healthcare by promoting continuous learning. However, its adoption remains limited, often involving only a single clinical department or a part of the LHS cycle. There is a need to gain a better understanding of implementing LHS on a larger scale.

Aim

To identify complete implementations of the LHS for providing recommendations into their implementation strategies, success factors, barriers, and outcomes.

Methods

A systematic review was conducted in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines using PubMed and Scopus databases. Data from the included papers were thematically categorized into four primary areas: (1) Scale of LHS Implementation; (2) Implementation strategies and the factors that facilitated the implementation of LHS; (3) LHS outcomes; and (4) Barriers /challenges related to the LHS implementation.

Results

We identified 1,279 papers, of which 37 were included in the final analysis. Barriers to implementing LHS included interoperability, data integration, electronic health records (EHRs) challenges, organizational culture, leadership, and regulatory hurdles. Most LHS initiatives lacked discussion on long-term economic sustainability models, and only 16 papers provided objective measurements of performance changes. Drawing from the findings of the included studies, this paper offers recommendations for the effective implementation of the LHS.

Conclusion

The establishment of sustainable LHS necessitates several key components. First, there is a need to develop long-term economic sustainability models. Secondly, governance at the national level should promote common Application Programming Interfaces (APIs) across LHS implementations, communication channels to share tacit knowledge, efficient Institutional Review Board, ethical approval processes, and connect various initiatives currently operating independently. Lastly, the success of LHS relies not only on technological infrastructure but also on the active participation of multidisciplinary teams in decision-making and sharing of tacit knowledge.
背景医疗保健行业是一个复杂的领域,在从实践和结果数据中有效学习方面面临挑战。学习型医疗系统(LHS)已成为通过促进持续学习来改善医疗保健的潜在框架。然而,它的应用仍然有限,往往只涉及单个临床科室或 LHS 周期的一部分。方法根据PRISMA(系统综述和荟萃分析的首选报告项目)指南,使用PubMed和Scopus数据库进行系统综述。纳入论文的数据按主题分为四个主要方面:(1) 本地保健系统的实施规模;(2) 实施策略和促进本地保健系统实施的因素;(3) 本地保健系统的结果;以及 (4) 与本地保健系统实施相关的障碍/挑战。实施 LHS 的障碍包括互操作性、数据整合、电子病历 (EHR) 挑战、组织文化、领导力和监管障碍。大多数 LHS 计划缺乏对长期经济可持续性模式的讨论,只有 16 篇论文提供了对绩效变化的客观测量。根据所纳入研究的结果,本文提出了有效实施长效医疗系统的建议。首先,需要制定长期的经济可持续性模式。其次,国家层面的管理应促进长者健康服务实施的通用应用编程接口(API)、分享隐性知识的交流渠道、高效的机构审查委员会、伦理审批流程,并将目前独立运作的各种倡议联系起来。最后,LHS 的成功不仅有赖于技术基础设施,还有赖于多学科团队积极参与决策和共享隐性知识。
{"title":"A systematic review and proposed framework for sustainable learning healthcare systems","authors":"Olga Golburean ,&nbsp;Espen Solbakken Nordheim ,&nbsp;Arild Faxvaag ,&nbsp;Rune Pedersen ,&nbsp;Ove Lintvedt ,&nbsp;Luis Marco-Ruiz","doi":"10.1016/j.ijmedinf.2024.105652","DOIUrl":"10.1016/j.ijmedinf.2024.105652","url":null,"abstract":"<div><h3>Background</h3><div>The healthcare sector is a complex domain that faces challenges in effectively learning from practices and outcome data. The Learning Health System (LHS) has emerged as a potential framework to improve healthcare by promoting continuous learning. However, its adoption remains limited, often involving only a single clinical department or a part of the LHS cycle. There is a need to gain a better understanding of implementing LHS on a larger scale.</div></div><div><h3>Aim</h3><div>To identify complete implementations of the LHS for providing recommendations into their implementation strategies, success factors, barriers, and outcomes.</div></div><div><h3>Methods</h3><div>A systematic review was conducted in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines using PubMed and Scopus databases. Data from the included papers were thematically categorized into four primary areas: (1) Scale of LHS Implementation; (2) Implementation strategies and the factors that facilitated the implementation of LHS; (3) LHS outcomes; and (4) Barriers /challenges related to the LHS implementation.</div></div><div><h3>Results</h3><div>We identified 1,279 papers, of which 37 were included in the final analysis. Barriers to implementing LHS included interoperability, data integration, electronic health records (EHRs) challenges, organizational culture, leadership, and regulatory hurdles. Most LHS initiatives lacked discussion on long-term economic sustainability models, and only 16 papers provided objective measurements of performance changes. Drawing from the findings of the included studies, this paper offers recommendations for the effective implementation of the LHS.</div></div><div><h3>Conclusion</h3><div>The establishment of sustainable LHS necessitates several key components. First, there is a need to develop long-term economic sustainability models. Secondly, governance at the national level should promote common Application Programming Interfaces (APIs) across LHS implementations, communication channels to share tacit knowledge, efficient Institutional Review Board, ethical approval processes, and connect various initiatives currently operating independently. Lastly, the success of LHS relies not only on technological infrastructure but also on the active participation of multidisciplinary teams in decision-making and sharing of tacit knowledge.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105652"},"PeriodicalIF":3.7,"publicationDate":"2024-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142445292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hospital antimicrobial stewardship team perceptions and usability of a computerized clinical decision support system 医院抗菌药物管理团队对计算机化临床决策支持系统的看法和可用性
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-12 DOI: 10.1016/j.ijmedinf.2024.105653
Alexandre Baudet , Marie-Jo Brennstuhl , Alexandre Charmillon , Florence Meyer , Céline Pulcini , Nathalie Thilly , Béatrice Demoré , Arnaud Florentin

Background

Antimicrobial stewardship (AMS) programs aim to optimize antibiotic use through a panel of interventions. The implementation of computerized clinical decision support systems (CDSSs) offers new opportunities for semiautomated antimicrobial review by AMS teams. This study aimed to evaluate the perceived facilitators, barriers and benefits of end-users related to a commercial CDSS recently implemented in a hospital and to assess its usability.

Methods

A mixed-method approach was used among AMS team members nine months after the implementation of the CDSS in a university hospital in northeastern France. A qualitative analysis based on individual semistructured interviews was conducted to collect end-users’ perceptions. A quantitative analysis was performed using the System Usability Scale (SUS).

Results

Eleven AMS team members agreed to participate. The qualitative analysis revealed technical, organizational and human barriers and facilitators of CDSS implementation. Effective collaboration with information technology teams was crucial for ensuring the installation and configuration of the software. CDSS adoption by the AMS team required time, human resources, training, adaptation and a clinical leader. Moreover, the CDSS had to be well designed, user-friendly and provide benefits to AMS activities. The quantitative analysis indicated that the CDSS was a “good” system in terms of perceived ease of use (median SUS score: 77.5/100).

Conclusions

This study shows the value of the studied CDSS to support AMS activities. It reveals barriers, facilitators and benefits to the implementation and adoption of the CDSS. These barriers and facilitators could be considered to facilitate the implementation of the software in other hospitals.
背景抗菌药物监管(AMS)计划旨在通过一系列干预措施优化抗生素的使用。计算机化临床决策支持系统(CDSS)的实施为抗菌药物管理团队进行半自动抗菌药物审查提供了新的机遇。本研究旨在评估最终用户对最近在一家医院实施的商用 CDSS 所感受到的促进因素、障碍和益处,并评估其可用性。方法:在法国东北部的一家大学医院实施 CDSS 九个月后,对 AMS 团队成员采用了混合方法。在个人半结构化访谈的基础上进行了定性分析,以收集最终用户的看法。采用系统可用性量表(SUS)进行了定量分析。定性分析揭示了 CDSS 实施过程中存在的技术、组织和人力方面的障碍和促进因素。与信息技术团队的有效合作对于确保软件的安装和配置至关重要。医疗服务团队采用 CDSS 需要时间、人力资源、培训、调整和临床领导。此外,CDSS 必须设计精良、便于使用,并能为 AMS 的活动带来益处。定量分析结果表明,就易用性而言,CDSS 是一个 "好 "系统(SUS 评分中位数:77.5/100)。它揭示了实施和采用 CDSS 的障碍、促进因素和益处。这些障碍和促进因素可供其他医院在实施该软件时参考。
{"title":"Hospital antimicrobial stewardship team perceptions and usability of a computerized clinical decision support system","authors":"Alexandre Baudet ,&nbsp;Marie-Jo Brennstuhl ,&nbsp;Alexandre Charmillon ,&nbsp;Florence Meyer ,&nbsp;Céline Pulcini ,&nbsp;Nathalie Thilly ,&nbsp;Béatrice Demoré ,&nbsp;Arnaud Florentin","doi":"10.1016/j.ijmedinf.2024.105653","DOIUrl":"10.1016/j.ijmedinf.2024.105653","url":null,"abstract":"<div><h3>Background</h3><div>Antimicrobial stewardship (AMS) programs aim to optimize antibiotic use through a panel of interventions. The implementation of computerized clinical decision support systems (CDSSs) offers new opportunities for semiautomated antimicrobial review by AMS teams. This study aimed to evaluate the perceived facilitators, barriers and benefits of end-users related to a commercial CDSS recently implemented in a hospital and to assess its usability.</div></div><div><h3>Methods</h3><div>A mixed-method approach was used among AMS team members nine months after the implementation of the CDSS in a university hospital in northeastern France. A qualitative analysis based on individual semistructured interviews was conducted to collect end-users’ perceptions. A quantitative analysis was performed using the System Usability Scale (SUS).</div></div><div><h3>Results</h3><div>Eleven AMS team members agreed to participate. The qualitative analysis revealed technical, organizational and human barriers and facilitators of CDSS implementation. Effective collaboration with information technology teams was crucial for ensuring the installation and configuration of the software. CDSS adoption by the AMS team required time, human resources, training, adaptation and a clinical leader. Moreover, the CDSS had to be well designed, user-friendly and provide benefits to AMS activities. The quantitative analysis indicated that the CDSS was a “good” system in terms of perceived ease of use (median SUS score: 77.5/100).</div></div><div><h3>Conclusions</h3><div>This study shows the value of the studied CDSS to support AMS activities. It reveals barriers, facilitators and benefits to the implementation and adoption of the CDSS. These barriers and facilitators could be considered to facilitate the implementation of the software in other hospitals.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105653"},"PeriodicalIF":3.7,"publicationDate":"2024-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142432823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and expert inspections of the user interface for a primary care decision support system 初级保健决策支持系统用户界面的开发和专家检查
IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-10-11 DOI: 10.1016/j.ijmedinf.2024.105651
Michaela Christina Neff , Dania Schütze , Svea Holtz , Susanne Maria Köhler , Jessica Vasseur , Najia Ahmadi , Holger Storf , Jannik Schaaf

Background

General practitioners play a unique key role in diagnosing patients with unclear diseases. Decision support systems in primary care can assist with diagnosis provided that they are efficient and user-friendly.

Objectives

The objective of this study is to develop a high-fidelity prototype of the user interface of a clinical decision support system for primary care, particularly for diagnosis support in unclear diseases, using expert inspections at an early stage of development to ensure a high level of usability.

Methods

The user interface prototype was iteratively developed based on previous research, design principles, and usability guidelines. During the development phase, three usability inspections were carried out by all experts at four-week intervals as heuristic walkthrough. Each inspection consisted of two parts: 1) Task-based inspection 2) Free exploration and evaluation based on usability heuristics. Five domain experts assessed the current status of development.
The tasks in the inspections were based on the task model derived in the requirements analysis: perform data entry, review and discuss results, schedule further diagnostics, refer to specialists and close case.

Results

As a result of this iterative development, a high-fidelity, clickable user interface prototype was created that is able to fulfil all six tasks of our task model. The usability inspections identified a total of 196 usability issues (for all 3 inspections; Part 1: 90 issues, Part 2: 106 issues), ranging in severity from minor to severe. These served the continuous adjustment and improvement of the prototype. All main tasks were completed successfully despite these problems.

Conclusion

Usability inspections through heuristic walkthroughs can support and optimise the development of a user-centred decision support system in order to ensure its suitability for performing relevant tasks.
背景全科医生在诊断不明疾病患者方面发挥着独特的关键作用。本研究的目的是开发一个高保真的基层医疗临床决策支持系统用户界面原型,特别是用于诊断不明确疾病的用户界面原型,在开发的早期阶段使用专家检查以确保高水平的可用性。在开发阶段,所有专家每隔四周进行三次可用性检查,作为启发式演练。每次检查包括两个部分:1)基于任务的检查 2)基于可用性启发式的自由探索和评估。五位领域专家对当前的开发状况进行了评估。检查中的任务是基于需求分析中得出的任务模型:执行数据录入、审查和讨论结果、安排进一步诊断、推荐专家和结案。结果经过反复开发,我们创建了一个高保真、可点击的用户界面原型,它能够完成任务模型中的所有六项任务。可用性检查共发现了 196 个可用性问题(所有 3 次检查;第 1 部分:90 个问题,第 2 部分:106 个问题),严重程度从轻到重不等。这些问题有助于原型的不断调整和改进。结论 通过启发式演练进行可用性检查可以支持和优化以用户为中心的决策支持系统的开发,以确保其适合执行相关任务。
{"title":"Development and expert inspections of the user interface for a primary care decision support system","authors":"Michaela Christina Neff ,&nbsp;Dania Schütze ,&nbsp;Svea Holtz ,&nbsp;Susanne Maria Köhler ,&nbsp;Jessica Vasseur ,&nbsp;Najia Ahmadi ,&nbsp;Holger Storf ,&nbsp;Jannik Schaaf","doi":"10.1016/j.ijmedinf.2024.105651","DOIUrl":"10.1016/j.ijmedinf.2024.105651","url":null,"abstract":"<div><h3>Background</h3><div>General practitioners play a unique key role in diagnosing patients with unclear diseases. Decision support systems in primary care can assist with diagnosis provided that they are efficient and user-friendly.</div></div><div><h3>Objectives</h3><div>The objective of this study is to develop a high-fidelity prototype of the user interface of a clinical decision support system for primary care, particularly for diagnosis support in unclear diseases, using expert inspections at an early stage of development to ensure a high level of usability.</div></div><div><h3>Methods</h3><div>The user interface prototype was iteratively developed based on previous research, design principles, and usability guidelines. During the development phase, three usability inspections were carried out by all experts at four-week intervals as heuristic walkthrough. Each inspection consisted of two parts: 1) Task-based inspection 2) Free exploration and evaluation based on usability heuristics. Five domain experts assessed the current status of development.</div><div>The tasks in the inspections were based on the task model derived in the requirements analysis: perform data entry, review and discuss results, schedule further diagnostics, refer to specialists and close case.</div></div><div><h3>Results</h3><div>As a result of this iterative development, a high-fidelity, clickable user interface prototype was created that is able to fulfil all six tasks of our task model. The usability inspections identified a total of 196 usability issues (for all 3 inspections; Part 1: 90 issues, Part 2: 106 issues), ranging in severity from minor to severe. These served the continuous adjustment and improvement of the prototype. All main tasks were completed successfully despite these problems.</div></div><div><h3>Conclusion</h3><div>Usability inspections through heuristic walkthroughs can support and optimise the development of a user-centred decision support system in order to ensure its suitability for performing relevant tasks.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"192 ","pages":"Article 105651"},"PeriodicalIF":3.7,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Medical Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1