Pub Date : 2024-08-24DOI: 10.1136/bmjhci-2024-101046
Adele Hill, Dylan Morrissey, William Marsh
Introduction: Digital healthcare innovation has yielded many prototype clinical decision support (CDS) systems, however, few are fully adopted into practice, despite successful research outcomes. We aimed to explore the characteristics of implementations in clinical practice to inform future innovation.
Methods: Web of Science, Trip Database, PubMed, NHS Digital and the BMA website were searched for examples of CDS systems in May 2022 and updated in June 2023. Papers were included if they reported on a CDS giving pathway advice to a clinician, adopted into regular clinical practice and had sufficient published information for analysis. Examples were excluded if they were only used in a research setting or intended for patients. Articles found in citation searches were assessed alongside a detailed hand search of the grey literature to gather all available information, including commercial information. Examples were excluded if there was insufficient information for analysis. The normalisation process theory (NPT) framework informed analysis.
Results: 22 implemented CDS projects were included, with 53 related publications or sources of information (40 peer-reviewed publications and 13 alternative sources). NPT framework analysis indicated organisational support was paramount to successful adoption of CDS. Ensuring that workflows were optimised for patient care alongside iterative, mixed-methods implementation was key to engaging clinicians.
Conclusion: Extensive searches revealed few examples of CDS available for analysis, highlighting the implementation gap between research and healthcare innovation. Lessons from included projects include the need for organisational support, an underpinning mixed-methods implementation strategy and an iterative approach to address clinician feedback.
{"title":"What characteristics of clinical decision support system implementations lead to adoption for regular use? A scoping review.","authors":"Adele Hill, Dylan Morrissey, William Marsh","doi":"10.1136/bmjhci-2024-101046","DOIUrl":"10.1136/bmjhci-2024-101046","url":null,"abstract":"<p><strong>Introduction: </strong>Digital healthcare innovation has yielded many prototype clinical decision support (CDS) systems, however, few are fully adopted into practice, despite successful research outcomes. We aimed to explore the characteristics of implementations in clinical practice to inform future innovation.</p><p><strong>Methods: </strong>Web of Science, Trip Database, PubMed, NHS Digital and the BMA website were searched for examples of CDS systems in May 2022 and updated in June 2023. Papers were included if they reported on a CDS giving pathway advice to a clinician, adopted into regular clinical practice and had sufficient published information for analysis. Examples were excluded if they were only used in a research setting or intended for patients. Articles found in citation searches were assessed alongside a detailed hand search of the grey literature to gather all available information, including commercial information. Examples were excluded if there was insufficient information for analysis. The normalisation process theory (NPT) framework informed analysis.</p><p><strong>Results: </strong>22 implemented CDS projects were included, with 53 related publications or sources of information (40 peer-reviewed publications and 13 alternative sources). NPT framework analysis indicated organisational support was paramount to successful adoption of CDS. Ensuring that workflows were optimised for patient care alongside iterative, mixed-methods implementation was key to engaging clinicians.</p><p><strong>Conclusion: </strong>Extensive searches revealed few examples of CDS available for analysis, highlighting the implementation gap between research and healthcare innovation. Lessons from included projects include the need for organisational support, an underpinning mixed-methods implementation strategy and an iterative approach to address clinician feedback.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11344512/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142054904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-19DOI: 10.1136/bmjhci-2024-101096
John Palmer, Areti Manataki, Laura Moss, Aileen Neilson, Tsz-Yan Milly Lo
Objectives: This project aims to determine the feasibility of predicting future critical care bed availability using data-driven computational forecast modelling and routinely collected hospital bed management data.
Methods: In this proof-of-concept, single-centre data informatics feasibility study, regression-based and classification data science techniques were applied retrospectively to prospectively collect routine hospital-wide bed management data to forecast critical care bed capacity. The availability of at least one critical care bed was forecasted using a forecast horizon of 1, 7 and 14 days in advance.
Results: We demonstrated for the first time the feasibility of forecasting critical care bed capacity without requiring detailed patient-level data using only routinely collected hospital bed management data and interpretable models. Predictive performance for bed availability 1 day in the future was better than 14 days (mean absolute error 1.33 vs 1.61 and area under the curve 0.78 vs 0.73, respectively). By analysing feature importance, we demonstrated that the models relied mainly on critical care and temporal data rather than data from other wards in the hospital.
Discussion: Our data-driven forecasting tool only required hospital bed management data to forecast critical care bed availability. This novel approach means no patient-sensitive data are required in the modelling and warrants further work to refine this approach in future bed availability forecast in other hospital wards.
Conclusions: Data-driven critical care bed availability prediction was possible. Further investigations into its utility in multicentre critical care settings or in other clinical settings are warranted.
{"title":"Feasibility of forecasting future critical care bed availability using bed management data.","authors":"John Palmer, Areti Manataki, Laura Moss, Aileen Neilson, Tsz-Yan Milly Lo","doi":"10.1136/bmjhci-2024-101096","DOIUrl":"10.1136/bmjhci-2024-101096","url":null,"abstract":"<p><strong>Objectives: </strong>This project aims to determine the feasibility of predicting future critical care bed availability using data-driven computational forecast modelling and routinely collected hospital bed management data.</p><p><strong>Methods: </strong>In this proof-of-concept, single-centre data informatics feasibility study, regression-based and classification data science techniques were applied retrospectively to prospectively collect routine hospital-wide bed management data to forecast critical care bed capacity. The availability of at least one critical care bed was forecasted using a forecast horizon of 1, 7 and 14 days in advance.</p><p><strong>Results: </strong>We demonstrated for the first time the feasibility of forecasting critical care bed capacity without requiring detailed patient-level data using only routinely collected hospital bed management data and interpretable models. Predictive performance for bed availability 1 day in the future was better than 14 days (mean absolute error 1.33 vs 1.61 and area under the curve 0.78 vs 0.73, respectively). By analysing feature importance, we demonstrated that the models relied mainly on critical care and temporal data rather than data from other wards in the hospital.</p><p><strong>Discussion: </strong>Our data-driven forecasting tool only required hospital bed management data to forecast critical care bed availability. This novel approach means no patient-sensitive data are required in the modelling and warrants further work to refine this approach in future bed availability forecast in other hospital wards.</p><p><strong>Conclusions: </strong>Data-driven critical care bed availability prediction was possible. Further investigations into its utility in multicentre critical care settings or in other clinical settings are warranted.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11337670/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142003529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: The working population encounters unique work-related stressors. Despite these challenges, accessibility to mental healthcare remains limited. Digital technology-enabled mental wellness tools can offer much-needed access to mental healthcare. However, existing literature has given limited attention to their relevance and user engagement, particularly for the working population.
Aim: This study aims to assess user perceptions and feature utilisation of mindline at work, a nationally developed AI-enabled digital platform designed to improve mental wellness in the working population.
Methods: This study adopted a mixed-methods design comprising a survey (n=399) and semistructured interviews (n=40) with office-based working adults. Participants were asked to use mindline at work for 4 weeks. We collected data about utilisation of the platform features, intention for sustained use and perceptions of specific features.
Results: Participants under 5 years of work experience reported lower utilisation of multimedia resources but higher utilisation of emotion self-assessment tools and the AI chatbot compared with their counterparts (p<0.001). The platform received a moderate level of satisfaction (57%) and positive intention for sustained use (58%). Participants regarded mindline at work as an 'essential' safeguard against workplace stress, valuing its secure and non-judgmental space and user anonymity. However, they wanted greater institutional support for office workers' mental wellness to enhance the uptake. The AI chatbot was perceived as useful for self-reflection and problem-solving, despite limited maturity.
Conclusion: Identifying the unique benefits of specific features for different segments of working adults can foster a personalised user experience and promote mental well-being. Increasing workplace awareness is essential for platform adoption.
背景:职业人群会遇到与工作相关的独特压力。尽管存在这些挑战,但获得心理保健的机会仍然有限。借助数字技术的心理健康工具可以提供亟需的心理保健服务。目的:本研究旨在评估用户对 "工作中的心灵热线"(mindline at work)的看法和使用情况,这是一个由国家开发的人工智能数字平台,旨在改善工作人群的心理健康:本研究采用混合方法设计,包括对办公室工作的成年人进行问卷调查(n=399)和半结构式访谈(n=40)。参与者被要求在工作中使用心灵热线 4 周。我们收集了有关平台功能的使用情况、持续使用的意向以及对特定功能的看法等数据:工作经验在 5 年以下的参与者对多媒体资源的使用率较低,但对情绪自我评估工具和人工智能聊天机器人的使用率较高,而工作经验在 5 年以上的参与者对多媒体资源的使用率较低,但对情绪自我评估工具和人工智能聊天机器人的使用率较高。不过,他们希望得到更多机构对上班族心理健康的支持,以提高使用率。尽管人工智能聊天机器人的成熟度有限,但他们认为它有助于自我反思和解决问题:针对不同的上班族群体,确定特定功能的独特益处,可以促进个性化的用户体验,提高心理健康水平。提高工作场所的认识对于平台的采用至关重要。
{"title":"User perceptions and utilisation of features of an AI-enabled workplace digital mental wellness platform 'mindline at work<i>'</i>.","authors":"Sungwon Yoon, Hendra Goh, Xinyi Casuarine Low, Janice Huiqin Weng, Creighton Heaukulani","doi":"10.1136/bmjhci-2024-101045","DOIUrl":"10.1136/bmjhci-2024-101045","url":null,"abstract":"<p><strong>Background: </strong>The working population encounters unique work-related stressors. Despite these challenges, accessibility to mental healthcare remains limited. Digital technology-enabled mental wellness tools can offer much-needed access to mental healthcare. However, existing literature has given limited attention to their relevance and user engagement, particularly for the working population.</p><p><strong>Aim: </strong>This study aims to assess user perceptions and feature utilisation of <i>mindline at work</i>, a nationally developed AI-enabled digital platform designed to improve mental wellness in the working population.</p><p><strong>Methods: </strong>This study adopted a mixed-methods design comprising a survey (n=399) and semistructured interviews (n=40) with office-based working adults. Participants were asked to use <i>mindline at work</i> for 4 weeks. We collected data about utilisation of the platform features, intention for sustained use and perceptions of specific features.</p><p><strong>Results: </strong>Participants under 5 years of work experience reported lower utilisation of multimedia resources but higher utilisation of emotion self-assessment tools and the AI chatbot compared with their counterparts (p<0.001). The platform received a moderate level of satisfaction (57%) and positive intention for sustained use (58%). Participants regarded <i>mindline at work</i> as an 'essential' safeguard against workplace stress, valuing its secure and non-judgmental space and user anonymity. However, they wanted greater institutional support for office workers' mental wellness to enhance the uptake. The AI chatbot was perceived as useful for self-reflection and problem-solving, despite limited maturity.</p><p><strong>Conclusion: </strong>Identifying the unique benefits of specific features for different segments of working adults can foster a personalised user experience and promote mental well-being. Increasing workplace awareness is essential for platform adoption.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11331828/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141995234","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-09DOI: 10.1136/bmjhci-2024-101059
Nathaly Garzón-Orjuela, Agustin Garcia Pereira, Heike Vornhagen, Katarzyna Stasiewicz, Sana Parveen, Doaa Amin, Lukasz Porwol, Mathieu d'Aquin, Claire Collins, Fintan Stanley, Mike O'Callaghan, Akke Vellinga
Objective: Collaborate, Analyse, Research and Audit (CARA) project set out to provide an infrastructure to enable Irish general practitioners (GPs) to use their routinely collected patient management software (PMS) data to better understand their patient population, disease management and prescribing through data dashboards. This paper explains the design and development of the CARA infrastructure.
Methods: The first exemplar dashboard was developed with GPs and focused on antibiotic prescribing to develop and showcase the proposed infrastructure. The data integration process involved extracting, loading and transforming de-identified patient data into data models which connect to the interactive dashboards for GPs to visualise, compare and audit their data.
Results: The architecture of the CARA infrastructure includes two main sections: extract, load and transform process (ELT, de-identified patient data into data models) and a Representational State Transfer Application Programming Interface (REST API) (which provides the security barrier between the data models and their visualisation on the CARA dashboard). CARAconnect was created to facilitate the extraction and de-identification of patient data from the practice database.
Discussion: The CARA infrastructure allows seamless connectivity with and compatibility with the main PMS in Irish general practice and provides a reproducible template to access and visualise patient data. CARA includes two dashboards, a practice overview and a topic-specific dashboard (example focused on antibiotic prescribing), which includes an audit tool, filters (within practice) and between-practice comparisons.
Conclusion: CARA supports evidence-based decision-making by providing GPs with valuable insights through interactive data dashboards to optimise patient care, identify potential areas for improvement and benchmark their performance against other practices.Supplementary file 1. Graphical abstract.
目标:协作、分析、研究和审计(CARA)项目旨在提供一个基础设施,使爱尔兰的全科医生(GPs)能够使用他们日常收集的病人管理软件(PMS)数据,通过数据仪表板更好地了解他们的病人群体、疾病管理和处方情况。本文介绍了 CARA 基础设施的设计和开发过程:第一个示例仪表板是与全科医生共同开发的,重点关注抗生素处方,以开发和展示拟议的基础设施。数据整合过程包括提取、加载和转换去标识化的患者数据到数据模型中,这些数据模型连接到交互式仪表盘,供全科医生可视化、比较和审计其数据:CARA 基础设施的架构包括两个主要部分:提取、加载和转换流程(ELT,将去身份化患者数据转换为数据模型)和表示状态传输应用编程接口(REST API)(为数据模型和 CARA 面板上的可视化数据之间提供安全屏障)。创建 CARAconnect 的目的是为了方便从实践数据库中提取和去标识化患者数据:CARA 基础设施可与爱尔兰全科医生的主要 PMS 系统实现无缝连接和兼容,并提供一个可重复的模板来访问和可视化病人数据。CARA 包括两个仪表盘,一个是实践概览,另一个是特定主题仪表盘(例如,以抗生素处方为例),其中包括审计工具、过滤器(实践内)和实践间比较:CARA支持循证决策,通过交互式数据仪表盘为全科医生提供有价值的见解,以优化患者护理,确定潜在的改进领域,并将其表现与其他诊所进行比较。图表摘要。
{"title":"Design and architecture of the CARA infrastructure for visualising and benchmarking patient data from general practice.","authors":"Nathaly Garzón-Orjuela, Agustin Garcia Pereira, Heike Vornhagen, Katarzyna Stasiewicz, Sana Parveen, Doaa Amin, Lukasz Porwol, Mathieu d'Aquin, Claire Collins, Fintan Stanley, Mike O'Callaghan, Akke Vellinga","doi":"10.1136/bmjhci-2024-101059","DOIUrl":"10.1136/bmjhci-2024-101059","url":null,"abstract":"<p><strong>Objective: </strong>Collaborate, Analyse, Research and Audit (CARA) project set out to provide an infrastructure to enable Irish general practitioners (GPs) to use their routinely collected patient management software (PMS) data to better understand their patient population, disease management and prescribing through data dashboards. This paper explains the design and development of the CARA infrastructure.</p><p><strong>Methods: </strong>The first exemplar dashboard was developed with GPs and focused on antibiotic prescribing to develop and showcase the proposed infrastructure. The data integration process involved extracting, loading and transforming de-identified patient data into data models which connect to the interactive dashboards for GPs to visualise, compare and audit their data.</p><p><strong>Results: </strong>The architecture of the CARA infrastructure includes two main sections: extract, load and transform process (ELT, de-identified patient data into data models) and a Representational State Transfer Application Programming Interface (REST API) (which provides the security barrier between the data models and their visualisation on the CARA dashboard). CARAconnect was created to facilitate the extraction and de-identification of patient data from the practice database.</p><p><strong>Discussion: </strong>The CARA infrastructure allows seamless connectivity with and compatibility with the main PMS in Irish general practice and provides a reproducible template to access and visualise patient data. CARA includes two dashboards, a practice overview and a topic-specific dashboard (example focused on antibiotic prescribing), which includes an audit tool, filters (within practice) and between-practice comparisons.</p><p><strong>Conclusion: </strong>CARA supports evidence-based decision-making by providing GPs with valuable insights through interactive data dashboards to optimise patient care, identify potential areas for improvement and benchmark their performance against other practices.Supplementary file 1. Graphical abstract.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11331940/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141911606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-07DOI: 10.1136/bmjhci-2023-100837
Noleen Fabian, Regine Ynez De Mesa, Carol Tan-Lim, Gillian Sandigan, Johanna Lopez, Arianna Maever Loreche, Leonila Dans, Zharie Benzon, Herbert Zabala, Josephine Sanchez, Nanette Sundiang, Mia Rey, Antonio Dans
Objectives: This study explored attitudes, subjective norms, and perceived behavioural control of participants across urban, rural and remote settings and examined intention-to-use telemedicine (defined in this study as remote patient-clinician consultations) during the COVID-19 pandemic.
Methods: This is a cross-sectional study. 12 focus group discussions were conducted with 60 diverse telemedicine user and non-user participants across 3 study settings. Analysis of responses was done to understand the attitudes, norms and perceived behavioural control of participants. This explored the relationship between the aforementioned factors and intention to use.
Results: Both users and non-users of telemedicine relayed that the benefits of telemedicine include protection from COVID-19 exposure, decreased out-of-pocket expenses and better work-life balance. Both groups also relayed perceived barriers to telemedicine. Users from the urban site relayed that the lack of preferred physicians discouraged use. Users from the rural and remote sites were concerned about spending on resources (ie, compatible smartphones) to access telemedicine. Non-users from all three sites mentioned that they would not try telemedicine if they felt overwhelmed prior to access.
Discussion: First-hand experiences, peer promotions, and maximising resource support instil hope that telemedicine can help people gain more access to healthcare. However, utilisation will remain low if patients feel overwhelmed by the behavioural modifications and material resources needed to access telemedicine. Boosting infrastructure must come with improving confidence and trust among people.
Conclusion: Sustainable access beyond the pandemic requires an understanding of factors that prevent usage. Sufficient investment in infrastructure and other related resources is needed if telemedicine will be used to address inequities in healthcare access, especially in rural and remote areas.
{"title":"Perspectives on telemedicine across urban, rural and remote areas in the Philippines during the COVID-19 pandemic.","authors":"Noleen Fabian, Regine Ynez De Mesa, Carol Tan-Lim, Gillian Sandigan, Johanna Lopez, Arianna Maever Loreche, Leonila Dans, Zharie Benzon, Herbert Zabala, Josephine Sanchez, Nanette Sundiang, Mia Rey, Antonio Dans","doi":"10.1136/bmjhci-2023-100837","DOIUrl":"10.1136/bmjhci-2023-100837","url":null,"abstract":"<p><strong>Objectives: </strong>This study explored attitudes, subjective norms, and perceived behavioural control of participants across urban, rural and remote settings and examined intention-to-use telemedicine (defined in this study as remote patient-clinician consultations) during the COVID-19 pandemic.</p><p><strong>Methods: </strong>This is a cross-sectional study. 12 focus group discussions were conducted with 60 diverse telemedicine user and non-user participants across 3 study settings. Analysis of responses was done to understand the attitudes, norms and perceived behavioural control of participants. This explored the relationship between the aforementioned factors and intention to use.</p><p><strong>Results: </strong>Both users and non-users of telemedicine relayed that the benefits of telemedicine include protection from COVID-19 exposure, decreased out-of-pocket expenses and better work-life balance. Both groups also relayed perceived barriers to telemedicine. Users from the urban site relayed that the lack of preferred physicians discouraged use. Users from the rural and remote sites were concerned about spending on resources (ie, compatible smartphones) to access telemedicine. Non-users from all three sites mentioned that they would not try telemedicine if they felt overwhelmed prior to access.</p><p><strong>Discussion: </strong>First-hand experiences, peer promotions, and maximising resource support instil hope that telemedicine can help people gain more access to healthcare. However, utilisation will remain low if patients feel overwhelmed by the behavioural modifications and material resources needed to access telemedicine. Boosting infrastructure must come with improving confidence and trust among people.</p><p><strong>Conclusion: </strong>Sustainable access beyond the pandemic requires an understanding of factors that prevent usage. Sufficient investment in infrastructure and other related resources is needed if telemedicine will be used to address inequities in healthcare access, especially in rural and remote areas.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11331966/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141905864","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-29DOI: 10.1136/bmjhci-2023-100963
Joshua William Spear, Eleni Pissaridou, Stuart Bowyer, William A Bryant, Daniel Key, John Booth, Anastasia Spiridou, Spiros Denaxas, Rebecca Pope, Andrew M Taylor, Harry Hemingway, Neil J Sebire
Background: Despite the increasing availability of electronic healthcare record (EHR) data and wide availability of plug-and-play machine learning (ML) Application Programming Interfaces, the adoption of data-driven decision-making within routine hospital workflows thus far, has remained limited. Through the lens of deriving clusters of diagnoses by age, this study investigated the type of ML analysis that can be performed using EHR data and how results could be communicated to lay stakeholders.
Methods: Observational EHR data from a tertiary paediatric hospital, containing 61 522 unique patients and 3315 unique ICD-10 diagnosis codes was used, after preprocessing. K-means clustering was applied to identify age distributions of patient diagnoses. The final model was selected using quantitative metrics and expert assessment of the clinical validity of the clusters. Additionally, uncertainty over preprocessing decisions was analysed.
Findings: Four age clusters of diseases were identified, broadly aligning to ages between: 0 and 1; 1 and 5; 5 and 13; 13 and 18. Diagnoses, within the clusters, aligned to existing knowledge regarding the propensity of presentation at different ages, and sequential clusters presented known disease progressions. The results validated similar methodologies within the literature. The impact of uncertainty induced by preprocessing decisions was large at the individual diagnoses but not at a population level. Strategies for mitigating, or communicating, this uncertainty were successfully demonstrated.
Conclusion: Unsupervised ML applied to EHR data identifies clinically relevant age distributions of diagnoses which can augment existing decision making. However, biases within healthcare datasets dramatically impact results if not appropriately mitigated or communicated.
{"title":"Communicating exploratory unsupervised machine learning analysis in age clustering for paediatric disease.","authors":"Joshua William Spear, Eleni Pissaridou, Stuart Bowyer, William A Bryant, Daniel Key, John Booth, Anastasia Spiridou, Spiros Denaxas, Rebecca Pope, Andrew M Taylor, Harry Hemingway, Neil J Sebire","doi":"10.1136/bmjhci-2023-100963","DOIUrl":"10.1136/bmjhci-2023-100963","url":null,"abstract":"<p><strong>Background: </strong>Despite the increasing availability of electronic healthcare record (EHR) data and wide availability of plug-and-play machine learning (ML) Application Programming Interfaces, the adoption of data-driven decision-making within routine hospital workflows thus far, has remained limited. Through the lens of deriving clusters of diagnoses by age, this study investigated the type of ML analysis that can be performed using EHR data and how results could be communicated to lay stakeholders.</p><p><strong>Methods: </strong>Observational EHR data from a tertiary paediatric hospital, containing 61 522 unique patients and 3315 unique ICD-10 diagnosis codes was used, after preprocessing. K-means clustering was applied to identify age distributions of patient diagnoses. The final model was selected using quantitative metrics and expert assessment of the clinical validity of the clusters. Additionally, uncertainty over preprocessing decisions was analysed.</p><p><strong>Findings: </strong>Four age clusters of diseases were identified, broadly aligning to ages between: 0 and 1; 1 and 5; 5 and 13; 13 and 18. Diagnoses, within the clusters, aligned to existing knowledge regarding the propensity of presentation at different ages, and sequential clusters presented known disease progressions. The results validated similar methodologies within the literature. The impact of uncertainty induced by preprocessing decisions was large at the individual diagnoses but not at a population level. Strategies for mitigating, or communicating, this uncertainty were successfully demonstrated.</p><p><strong>Conclusion: </strong>Unsupervised ML applied to EHR data identifies clinically relevant age distributions of diagnoses which can augment existing decision making. However, biases within healthcare datasets dramatically impact results if not appropriately mitigated or communicated.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11288139/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141791877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-23DOI: 10.1136/bmjhci-2023-100952
John T Moon, Nicholas J Lima, Eleanor Froula, Hanzhou Li, Janice Newsome, Hari Trivedi, Zachary Bercu, Judy Wawira Gichoya
In the following narrative review, we discuss the potential role of large language models (LLMs) in medical device innovation, specifically examples using generative pretrained transformer-4. Throughout the biodesign process, LLMs can offer prompt-driven insights, aiding problem identification, knowledge assimilation and decision-making. Intellectual property analysis, regulatory assessment and market analysis emerge as key LLM applications. Through case examples, we underscore LLMs' transformative ability to democratise information access and expertise, facilitating inclusive innovation in medical devices as well as its effectiveness with providing real-time, individualised feedback for innovators of all experience levels. By mitigating entry barriers, LLMs accelerate transformative advancements, fostering collaboration among established and emerging stakeholders.
{"title":"Towards inclusive biodesign and innovation: lowering barriers to entry in medical device development through large language model tools.","authors":"John T Moon, Nicholas J Lima, Eleanor Froula, Hanzhou Li, Janice Newsome, Hari Trivedi, Zachary Bercu, Judy Wawira Gichoya","doi":"10.1136/bmjhci-2023-100952","DOIUrl":"10.1136/bmjhci-2023-100952","url":null,"abstract":"<p><p>In the following narrative review, we discuss the potential role of large language models (LLMs) in medical device innovation, specifically examples using generative pretrained transformer-4. Throughout the biodesign process, LLMs can offer prompt-driven insights, aiding problem identification, knowledge assimilation and decision-making. Intellectual property analysis, regulatory assessment and market analysis emerge as key LLM applications. Through case examples, we underscore LLMs' transformative ability to democratise information access and expertise, facilitating inclusive innovation in medical devices as well as its effectiveness with providing real-time, individualised feedback for innovators of all experience levels. By mitigating entry barriers, LLMs accelerate transformative advancements, fostering collaboration among established and emerging stakeholders.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268064/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141751005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-22DOI: 10.1136/bmjhci-2024-101060
Elisavet Andrikopoulou
{"title":"Why <i>BMJ HCI</i>-the internal fear to find an appropriate academic journal.","authors":"Elisavet Andrikopoulou","doi":"10.1136/bmjhci-2024-101060","DOIUrl":"10.1136/bmjhci-2024-101060","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11268056/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141747430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-20DOI: 10.1136/bmjhci-2023-100985
Shih-Jung Lin, Chin-Yu Sun, Dan-Ni Chen, Yi-No Kang, Nai Ming Lai, Kee-Hsin Chen, Chiehfeng Chen
Background and objectives: Patient-clinician communication and shared decision-making face challenges in the perioperative period. Chatbots have emerged as valuable support tools in perioperative care. A simultaneous and complete comparison of overall benefits and harm of chatbot application is conducted.
Materials: MEDLINE, EMBASE and the Cochrane Library were systematically searched for studies published before May 2023 on the benefits and harm of chatbots used in the perioperative period. The major outcomes assessed were patient satisfaction and knowledge acquisition. Untransformed proportion (PR) with a 95% CI was used for the analysis of continuous data. Risk of bias was assessed using the Cochrane Risk of Bias assessment tool version 2 and the Methodological Index for Non-Randomised Studies.
Results: Eight trials comprising 1073 adults from four countries were included. Most interventions (n = 5, 62.5%) targeted perioperative care in orthopaedics. Most interventions use rule-based chatbots (n = 7, 87.5%). This meta-analysis found that the majority of the participants were satisfied with the use of chatbots (mean proportion=0.73; 95% CI: 0.62 to 0.85), and agreed that they gained knowledge in their perioperative period (mean proportion=0.80; 95% CI: 0.74 to 0.87).
Conclusion: This review demonstrates that perioperative chatbots are well received by the majority of patients with no reports of harm to-date. Chatbots may be considered as an aid in perioperative communication between patients and clinicians and shared decision-making. These findings may be used to guide the healthcare providers, policymakers and researchers for enhancing perioperative care.
{"title":"Perioperative application of chatbots: a systematic review and meta-analysis.","authors":"Shih-Jung Lin, Chin-Yu Sun, Dan-Ni Chen, Yi-No Kang, Nai Ming Lai, Kee-Hsin Chen, Chiehfeng Chen","doi":"10.1136/bmjhci-2023-100985","DOIUrl":"10.1136/bmjhci-2023-100985","url":null,"abstract":"<p><strong>Background and objectives: </strong>Patient-clinician communication and shared decision-making face challenges in the perioperative period. Chatbots have emerged as valuable support tools in perioperative care. A simultaneous and complete comparison of overall benefits and harm of chatbot application is conducted.</p><p><strong>Materials: </strong>MEDLINE, EMBASE and the Cochrane Library were systematically searched for studies published before May 2023 on the benefits and harm of chatbots used in the perioperative period. The major outcomes assessed were patient satisfaction and knowledge acquisition. Untransformed proportion (PR) with a 95% CI was used for the analysis of continuous data. Risk of bias was assessed using the Cochrane Risk of Bias assessment tool version 2 and the Methodological Index for Non-Randomised Studies.</p><p><strong>Results: </strong>Eight trials comprising 1073 adults from four countries were included. Most interventions (n = 5, 62.5%) targeted perioperative care in orthopaedics. Most interventions use rule-based chatbots (n = 7, 87.5%). This meta-analysis found that the majority of the participants were satisfied with the use of chatbots (mean proportion=0.73; 95% CI: 0.62 to 0.85), and agreed that they gained knowledge in their perioperative period (mean proportion=0.80; 95% CI: 0.74 to 0.87).</p><p><strong>Conclusion: </strong>This review demonstrates that perioperative chatbots are well received by the majority of patients with no reports of harm to-date. Chatbots may be considered as an aid in perioperative communication between patients and clinicians and shared decision-making. These findings may be used to guide the healthcare providers, policymakers and researchers for enhancing perioperative care.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11261686/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141733530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-04DOI: 10.1136/bmjhci-2023-101006
Seung Min Chung, Min Cheol Chang
Objectives: We assessed the feasibility of ChatGPT for patients with type 2 diabetes seeking information about exercise.
Methods: In this pilot study, two physicians with expertise in diabetes care and rehabilitative treatment in Republic of Korea discussed and determined the 14 most asked questions on exercise for managing type 2 diabetes by patients in clinical practice. Each question was inputted into ChatGPT (V.4.0), and the answers from ChatGPT were assessed. The Likert scale was calculated for each category of validity (1-4), safety (1-4) and utility (1-4) based on position statements of the American Diabetes Association and American College of Sports Medicine.
Results: Regarding validity, 4 of 14 ChatGPT (28.6%) responses were scored as 3, indicating accurate but incomplete information. The other 10 responses (71.4%) were scored as 4, indicating complete accuracy with complete information. Safety and utility scored 4 (no danger and completely useful) for all 14 ChatGPT responses.
Conclusion: ChatGPT can be used as supplementary educational material for diabetic exercise. However, users should be aware that ChatGPT may provide incomplete answers to some questions on exercise for type 2 diabetes.
{"title":"Assessment of the information provided by ChatGPT regarding exercise for patients with type 2 diabetes: a pilot study.","authors":"Seung Min Chung, Min Cheol Chang","doi":"10.1136/bmjhci-2023-101006","DOIUrl":"10.1136/bmjhci-2023-101006","url":null,"abstract":"<p><strong>Objectives: </strong>We assessed the feasibility of ChatGPT for patients with type 2 diabetes seeking information about exercise.</p><p><strong>Methods: </strong>In this pilot study, two physicians with expertise in diabetes care and rehabilitative treatment in Republic of Korea discussed and determined the 14 most asked questions on exercise for managing type 2 diabetes by patients in clinical practice. Each question was inputted into ChatGPT (V.4.0), and the answers from ChatGPT were assessed. The Likert scale was calculated for each category of validity (1-4), safety (1-4) and utility (1-4) based on position statements of the American Diabetes Association and American College of Sports Medicine.</p><p><strong>Results: </strong>Regarding validity, 4 of 14 ChatGPT (28.6%) responses were scored as 3, indicating accurate but incomplete information. The other 10 responses (71.4%) were scored as 4, indicating complete accuracy with complete information. Safety and utility scored 4 (no danger and completely useful) for all 14 ChatGPT responses.</p><p><strong>Conclusion: </strong>ChatGPT can be used as supplementary educational material for diabetic exercise. However, users should be aware that ChatGPT may provide incomplete answers to some questions on exercise for type 2 diabetes.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11227747/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141533555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}