首页 > 最新文献

BMJ Health & Care Informatics最新文献

英文 中文
Comparative study of ChatGPT and human evaluators on the assessment of medical literature according to recognised reporting standards. ChatGPT和人类评估人员根据公认的报告标准评估医学文献的比较研究。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2023-100830
Richard Hr Roberts, Stephen R Ali, Hayley A Hutchings, Thomas D Dobbs, Iain S Whitaker
Introduction Amid clinicians’ challenges in staying updated with medical research, artificial intelligence (AI) tools like the large language model (LLM) ChatGPT could automate appraisal of research quality, saving time and reducing bias. This study compares the proficiency of ChatGPT3 against human evaluation in scoring abstracts to determine its potential as a tool for evidence synthesis. Methods We compared ChatGPT’s scoring of implant dentistry abstracts with human evaluators using the Consolidated Standards of Reporting Trials for Abstracts reporting standards checklist, yielding an overall compliance score (OCS). Bland-Altman analysis assessed agreement between human and AI-generated OCS percentages. Additional error analysis included mean difference of OCS subscores, Welch’s t-test and Pearson’s correlation coefficient. Results Bland-Altman analysis showed a mean difference of 4.92% (95% CI 0.62%, 0.37%) in OCS between human evaluation and ChatGPT. Error analysis displayed small mean differences in most domains, with the highest in ‘conclusion’ (0.764 (95% CI 0.186, 0.280)) and the lowest in ‘blinding’ (0.034 (95% CI 0.818, 0.895)). The strongest correlations between were in ‘harms’ (r=0.32, p<0.001) and ‘trial registration’ (r=0.34, p=0.002), whereas the weakest were in ‘intervention’ (r=0.02, p<0.001) and ‘objective’ (r=0.06, p<0.001). Conclusion LLMs like ChatGPT can help automate appraisal of medical literature, aiding in the identification of accurately reported research. Possible applications of ChatGPT include integration within medical databases for abstract evaluation. Current limitations include the token limit, restricting its usage to abstracts. As AI technology advances, future versions like GPT4 could offer more reliable, comprehensive evaluations, enhancing the identification of high-quality research and potentially improving patient outcomes.
引言:在临床医生保持医学研究最新进展的挑战中,人工智能(AI)工具,如大型语言模型(LLM)ChatGPT,可以自动评估研究质量,节省时间并减少偏见。这项研究将ChatGPT3的熟练程度与人类对摘要评分的评估进行了比较,以确定其作为证据合成工具的潜力。方法:我们将ChatGPT对种植牙摘要的评分与使用摘要报告标准清单的综合报告试验标准的人类评估者进行了比较,得出总体依从性评分(OCS)。Bland-Altman分析评估了人类和人工智能生成的OCS百分比之间的一致性。额外的误差分析包括OCS分量表的平均差、Welch t检验和Pearson相关系数。结果:Bland-Altman分析显示,人类评估和ChatGPT之间的OCS平均差异为4.92%(95%CI 0.62%,0.37%)。误差分析在大多数领域中显示出较小的平均差异,在“结论”中最高(0.764(95%CI 0.186,0.280),在“致盲”中最低(0.034(95%CI 0.818/0.895))(r=0.32,p结论:像ChatGPT这样的LLM可以帮助自动化医学文献的评估,有助于识别准确报告的研究。ChatGPT的可能应用包括在医学数据库中集成以进行抽象评估。目前的限制包括令牌限制,将其使用限制在摘要上。随着人工智能技术的进步,像GPT4这样的未来版本可能会关闭er更可靠、全面的评估,加强高质量研究的识别,并有可能改善患者的预后。
{"title":"Comparative study of ChatGPT and human evaluators on the assessment of medical literature according to recognised reporting standards.","authors":"Richard Hr Roberts,&nbsp;Stephen R Ali,&nbsp;Hayley A Hutchings,&nbsp;Thomas D Dobbs,&nbsp;Iain S Whitaker","doi":"10.1136/bmjhci-2023-100830","DOIUrl":"10.1136/bmjhci-2023-100830","url":null,"abstract":"Introduction Amid clinicians’ challenges in staying updated with medical research, artificial intelligence (AI) tools like the large language model (LLM) ChatGPT could automate appraisal of research quality, saving time and reducing bias. This study compares the proficiency of ChatGPT3 against human evaluation in scoring abstracts to determine its potential as a tool for evidence synthesis. Methods We compared ChatGPT’s scoring of implant dentistry abstracts with human evaluators using the Consolidated Standards of Reporting Trials for Abstracts reporting standards checklist, yielding an overall compliance score (OCS). Bland-Altman analysis assessed agreement between human and AI-generated OCS percentages. Additional error analysis included mean difference of OCS subscores, Welch’s t-test and Pearson’s correlation coefficient. Results Bland-Altman analysis showed a mean difference of 4.92% (95% CI 0.62%, 0.37%) in OCS between human evaluation and ChatGPT. Error analysis displayed small mean differences in most domains, with the highest in ‘conclusion’ (0.764 (95% CI 0.186, 0.280)) and the lowest in ‘blinding’ (0.034 (95% CI 0.818, 0.895)). The strongest correlations between were in ‘harms’ (r=0.32, p<0.001) and ‘trial registration’ (r=0.34, p=0.002), whereas the weakest were in ‘intervention’ (r=0.02, p<0.001) and ‘objective’ (r=0.06, p<0.001). Conclusion LLMs like ChatGPT can help automate appraisal of medical literature, aiding in the identification of accurately reported research. Possible applications of ChatGPT include integration within medical databases for abstract evaluation. Current limitations include the token limit, restricting its usage to abstracts. As AI technology advances, future versions like GPT4 could offer more reliable, comprehensive evaluations, enhancing the identification of high-quality research and potentially improving patient outcomes.","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10583079/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41190771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Time to treat the climate and nature crisis as one indivisible global health emergency. 是时候将气候和自然危机视为一个不可分割的全球卫生紧急事件了。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2023-100938
Chris Zielinski
{"title":"Time to treat the climate and nature crisis as one indivisible global health emergency.","authors":"Chris Zielinski","doi":"10.1136/bmjhci-2023-100938","DOIUrl":"10.1136/bmjhci-2023-100938","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10603532/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50160603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Signal processing and machine learning algorithm to classify anaesthesia depth. 信号处理和机器学习算法对麻醉深度进行分类。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2023-100823
Oscar Mosquera Dussan, Eduardo Tuta-Quintero, Daniel A Botero-Rosas

Background: Poor assessment of anaesthetic depth (AD) has led to overdosing or underdosing of the anaesthetic agent, which requires continuous monitoring to avoid complications. The evaluation of the central nervous system activity and autonomic nervous system could provide additional information on the monitoring of AD during surgical procedures.

Methods: Observational analytical single-centre study, information on biological signals was collected during a surgical procedure under general anaesthesia for signal preprocessing, processing and postprocessing to feed a pattern classifier and determine AD status of patients. The development of the electroencephalography index was carried out through data processing and algorithm development using MATLAB V.8.1.

Results: A total of 25 men and 35 women were included, with a total time of procedure average of 109.62 min. The results show a high Pearson correlation between the Complexity Brainwave Index and the indices of the entropy module. A greater dispersion is observed in the state entropy and response entropy indices, a partial overlap can also be seen in the boxes associated with deep anaesthesia and general anaesthesia in these indices. A high Pearson correlation might be explained by the coinciding values corresponding to the awake and general anaesthesia states. A high Pearson correlation might be explained by the coinciding values corresponding to the awake and general anaesthesia states.

Conclusion: Biological signal filtering and a machine learning algorithm may be used to classify AD during a surgical procedure. Further studies will be needed to confirm these results and improve the decision-making of anaesthesiologists in general anaesthesia.

背景:对麻醉深度(AD)的评估不佳导致麻醉剂过量或服用不足,这需要持续监测以避免并发症。对中枢神经系统活动和自主神经系统的评估可以为外科手术期间AD的监测提供额外的信息。方法:观察分析单中心研究,在全麻下的手术过程中收集生物信号信息,进行信号预处理、处理和后处理,以提供模式分类器并确定患者的AD状态。使用MATLAB V.8.1通过数据处理和算法开发来开发脑电图指标。结果:共有25名男性和35名男性 包括女性,手术总时间平均为109.62 min.结果显示复杂性脑电波指数与熵模块的指数之间具有高Pearson相关性。在状态熵和反应熵指数中观察到更大的离散性,在这些指数中与深度麻醉和全身麻醉相关的框中也可以看到部分重叠。高Pearson相关性可以通过与清醒和全身麻醉状态相对应的重合值来解释。高Pearson相关性可以通过与清醒和全身麻醉状态相对应的重合值来解释。结论:生物信号滤波和机器学习算法可用于外科手术中的AD分类。需要进一步的研究来证实这些结果,并改善麻醉师在全身麻醉中的决策。
{"title":"Signal processing and machine learning algorithm to classify anaesthesia depth.","authors":"Oscar Mosquera Dussan,&nbsp;Eduardo Tuta-Quintero,&nbsp;Daniel A Botero-Rosas","doi":"10.1136/bmjhci-2023-100823","DOIUrl":"10.1136/bmjhci-2023-100823","url":null,"abstract":"<p><strong>Background: </strong>Poor assessment of anaesthetic depth (AD) has led to overdosing or underdosing of the anaesthetic agent, which requires continuous monitoring to avoid complications. The evaluation of the central nervous system activity and autonomic nervous system could provide additional information on the monitoring of AD during surgical procedures.</p><p><strong>Methods: </strong>Observational analytical single-centre study, information on biological signals was collected during a surgical procedure under general anaesthesia for signal preprocessing, processing and postprocessing to feed a pattern classifier and determine AD status of patients. The development of the electroencephalography index was carried out through data processing and algorithm development using MATLAB V.8.1.</p><p><strong>Results: </strong>A total of 25 men and 35 women were included, with a total time of procedure average of 109.62 min. The results show a high Pearson correlation between the Complexity Brainwave Index and the indices of the entropy module. A greater dispersion is observed in the state entropy and response entropy indices, a partial overlap can also be seen in the boxes associated with deep anaesthesia and general anaesthesia in these indices. A high Pearson correlation might be explained by the coinciding values corresponding to the awake and general anaesthesia states. A high Pearson correlation might be explained by the coinciding values corresponding to the awake and general anaesthesia states.</p><p><strong>Conclusion: </strong>Biological signal filtering and a machine learning algorithm may be used to classify AD during a surgical procedure. Further studies will be needed to confirm these results and improve the decision-making of anaesthesiologists in general anaesthesia.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/ed/86/bmjhci-2023-100823.PMC10551974.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41103815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital health and care: emerging from pandemic times. 数字健康和护理:从疫情时代崛起。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2023-100861
Niels Peek, Mark Sujan, Philip Scott

In 2020, we published an editorial about the massive disruption of health and care services caused by the COVID-19 pandemic and the rapid changes in digital service delivery, artificial intelligence and data sharing that were taking place at the time. Now, 3 years later, we describe how these developments have progressed since, reflect on lessons learnt and consider key challenges and opportunities ahead by reviewing significant developments reported in the literature. As before, the three key areas we consider are digital transformation of services, realising the potential of artificial intelligence and wise data sharing to facilitate learning health systems. We conclude that the field of digital health has rapidly matured during the pandemic, but there are still major sociotechnical, evaluation and trust challenges in the development and deployment of new digital services.

2020年,我们发表了一篇社论,内容涉及新冠肺炎大流行对医疗保健服务造成的巨大破坏,以及当时数字服务提供、人工智能和数据共享的快速变化。现在,3 几年后,我们通过回顾文献中报道的重大发展,描述了自那以来这些发展的进展,反思了所吸取的教训,并考虑了未来的关键挑战和机遇。和以前一样,我们考虑的三个关键领域是服务的数字化转型、实现人工智能的潜力和明智的数据共享,以促进学习型卫生系统。我们得出的结论是,数字健康领域在疫情期间迅速成熟,但在开发和部署新的数字服务方面仍存在重大的社会技术、评估和信任挑战。
{"title":"Digital health and care: emerging from pandemic times.","authors":"Niels Peek,&nbsp;Mark Sujan,&nbsp;Philip Scott","doi":"10.1136/bmjhci-2023-100861","DOIUrl":"10.1136/bmjhci-2023-100861","url":null,"abstract":"<p><p>In 2020, we published an editorial about the massive disruption of health and care services caused by the COVID-19 pandemic and the rapid changes in digital service delivery, artificial intelligence and data sharing that were taking place at the time. Now, 3 years later, we describe how these developments have progressed since, reflect on lessons learnt and consider key challenges and opportunities ahead by reviewing significant developments reported in the literature. As before, the three key areas we consider are digital transformation of services, realising the potential of artificial intelligence and wise data sharing to facilitate learning health systems. We conclude that the field of digital health has rapidly matured during the pandemic, but there are still major sociotechnical, evaluation and trust challenges in the development and deployment of new digital services.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/3f/35/bmjhci-2023-100861.PMC10583078.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41190772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating digital health technologies into complex clinical systems. 将数字健康技术集成到复杂的临床系统中。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2023-100885
Mark Sujan
{"title":"Integrating digital health technologies into complex clinical systems.","authors":"Mark Sujan","doi":"10.1136/bmjhci-2023-100885","DOIUrl":"10.1136/bmjhci-2023-100885","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/ba/18/bmjhci-2023-100885.PMC10583035.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41190773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mapping loneliness through social intelligence analysis: a step towards creating global loneliness map. 通过社会智力分析绘制孤独地图:迈向创建全球孤独地图的一步。
IF 4.1 Q2 Computer Science Pub Date : 2023-10-01 DOI: 10.1136/bmjhci-2022-100728
Hurmat Ali Shah, Mowafa Househ

Objectives: Loneliness is a prevalent global public health concern with complex dynamics requiring further exploration. This study aims to enhance understanding of loneliness dynamics through building towards a global loneliness map using social intelligence analysis.

Settings and design: This paper presents a proof of concept for the global loneliness map, using data collected in October 2022. Twitter posts containing keywords such as 'lonely', 'loneliness', 'alone', 'solitude' and 'isolation' were gathered, resulting in 841 796 tweets from the USA. City-specific data were extracted from these tweets to construct a loneliness map for the country. Sentiment analysis using the valence aware dictionary for sentiment reasoning tool was employed to differentiate metaphorical expressions from meaningful correlations between loneliness and socioeconomic and emotional factors.

Measures and results: The sentiment analysis encompassed the USA dataset and city-wise subsets, identifying negative sentiment tweets. Psychosocial linguistic features of these negative tweets were analysed to reveal significant connections between loneliness, socioeconomic aspects and emotional themes. Word clouds depicted topic variations between positively and negatively toned tweets. A frequency list of correlated topics within broader socioeconomic and emotional categories was generated from negative sentiment tweets. Additionally, a comprehensive table displayed top correlated topics for each city.

Conclusions: Leveraging social media data provide insights into the multifaceted nature of loneliness. Given its subjectivity, loneliness experiences exhibit variability. This study serves as a proof of concept for an extensive global loneliness map, holding implications for global public health strategies and policy development. Understanding loneliness dynamics on a larger scale can facilitate targeted interventions and support.

目标:孤独是一个普遍存在的全球公共卫生问题,其复杂的动态需要进一步探索。本研究旨在通过使用社会智力分析构建全球孤独地图,增强对孤独动态的理解。设置和设计:本文使用2022年10月收集的数据,为全球孤独地图提供了概念验证。收集了包含“孤独”、“孤独”和“孤独”等关键词的推特帖子,共有841条 从这些推文中提取了796条来自美国的特定城市的推文数据,构建了一张全国的孤独地图。情绪分析使用效价感知词典作为情绪推理工具,将孤独与社会经济和情绪因素之间的隐喻性表达与有意义的相关性区分开来。措施和结果:情绪分析包括美国数据集和城市子集,识别负面情绪推文。分析了这些负面推文的心理社会语言学特征,揭示了孤独感、社会经济方面和情感主题之间的显著联系。词云描述了语气积极和消极的推文之间的话题变化。负面情绪推文生成了更广泛的社会经济和情感类别中相关主题的频率列表。此外,一个综合表格显示了每个城市最相关的主题。结论:利用社交媒体数据可以深入了解孤独的多方面本质。鉴于其主观性,孤独体验表现出可变性。这项研究为广泛的全球孤独地图提供了概念证明,对全球公共卫生战略和政策制定具有启示。在更大范围内了解孤独的动态可以促进有针对性的干预和支持。
{"title":"Mapping loneliness through social intelligence analysis: a step towards creating global loneliness map.","authors":"Hurmat Ali Shah,&nbsp;Mowafa Househ","doi":"10.1136/bmjhci-2022-100728","DOIUrl":"10.1136/bmjhci-2022-100728","url":null,"abstract":"<p><strong>Objectives: </strong>Loneliness is a prevalent global public health concern with complex dynamics requiring further exploration. This study aims to enhance understanding of loneliness dynamics through building towards a global loneliness map using social intelligence analysis.</p><p><strong>Settings and design: </strong>This paper presents a proof of concept for the global loneliness map, using data collected in October 2022. Twitter posts containing keywords such as 'lonely', 'loneliness', 'alone', 'solitude' and 'isolation' were gathered, resulting in 841 796 tweets from the USA. City-specific data were extracted from these tweets to construct a loneliness map for the country. Sentiment analysis using the valence aware dictionary for sentiment reasoning tool was employed to differentiate metaphorical expressions from meaningful correlations between loneliness and socioeconomic and emotional factors.</p><p><strong>Measures and results: </strong>The sentiment analysis encompassed the USA dataset and city-wise subsets, identifying negative sentiment tweets. Psychosocial linguistic features of these negative tweets were analysed to reveal significant connections between loneliness, socioeconomic aspects and emotional themes. Word clouds depicted topic variations between positively and negatively toned tweets. A frequency list of correlated topics within broader socioeconomic and emotional categories was generated from negative sentiment tweets. Additionally, a comprehensive table displayed top correlated topics for each city.</p><p><strong>Conclusions: </strong>Leveraging social media data provide insights into the multifaceted nature of loneliness. Given its subjectivity, loneliness experiences exhibit variability. This study serves as a proof of concept for an extensive global loneliness map, holding implications for global public health strategies and policy development. Understanding loneliness dynamics on a larger scale can facilitate targeted interventions and support.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/8a/b3/bmjhci-2022-100728.PMC10583034.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41190774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementer report: ICD-10 code F44.5 review for functional seizure disorder. 实施者报告:功能性癫痫发作障碍ICD-10代码F44.5审查。
IF 4.1 Q2 Computer Science Pub Date : 2023-09-01 DOI: 10.1136/bmjhci-2023-100746
Sana F Ali, Yarden Bornovski, Margaret Gopaul, Daniela Galluzzo, Joseph Goulet, Stephanie Argraves, Ebony Jackson-Shaheed, Kei-Hoi Cheung, Cynthia A Brandt, Hamada Hamid Altalib

Objective: The study aimed to measure the validity of International Classification of Diseases, 10th Edition (ICD-10) code F44.5 for functional seizure disorder (FSD) in the Veterans Affairs Connecticut Healthcare System electronic health record (VA EHR).

Methods: The study used an informatics search tool, a natural language processing algorithm and a chart review to validate FSD coding.

Results: The positive predictive value (PPV) for code F44.5 was calculated to be 44%.

Discussion: ICD-10 introduced a specific code for FSD to improve coding validity. However, results revealed a meager (44%) PPV for code F44.5. Evaluation of the low diagnostic precision of FSD identified inconsistencies in the ICD-10 and VA EHR systems.

Conclusion: Information system improvements may increase the precision of diagnostic coding by clinicians. Specifically, the EHR problem list should include commonly used diagnostic codes and an appropriately curated ICD-10 term list for 'seizure disorder,' and a single ICD code for FSD should be classified under neurology and psychiatry.

目的:本研究旨在测量国际疾病分类第10版(ICD-10)代码F44.5在退伍军人事务康涅狄格州医疗保健系统电子健康记录(VA EHR)中对功能性癫痫(FSD)的有效性。方法:本研究使用信息学搜索工具、自然语言处理算法和图表评审来验证FSD编码。结果:编码F44.5的阳性预测值(PPV)为44%。讨论:ICD-10引入了一种用于FSD的特定编码,以提高编码的有效性。然而,结果显示代码F44.5的PPV很低(44%)。FSD诊断精度低的评估发现ICD-10和VA EHR系统不一致。结论:信息系统的改进可以提高临床医生诊断编码的准确性。具体而言,EHR问题列表应包括常用的诊断代码和适当策划的ICD-10“癫痫发作障碍”术语列表,FSD的单一ICD代码应归类为神经病学和精神病学。
{"title":"Implementer report: ICD-10 code F44.5 review for functional seizure disorder.","authors":"Sana F Ali, Yarden Bornovski, Margaret Gopaul, Daniela Galluzzo, Joseph Goulet, Stephanie Argraves, Ebony Jackson-Shaheed, Kei-Hoi Cheung, Cynthia A Brandt, Hamada Hamid Altalib","doi":"10.1136/bmjhci-2023-100746","DOIUrl":"10.1136/bmjhci-2023-100746","url":null,"abstract":"<p><strong>Objective: </strong>The study aimed to measure the validity of International Classification of Diseases, 10th Edition (ICD-10) code F44.5 for functional seizure disorder (FSD) in the Veterans Affairs Connecticut Healthcare System electronic health record (VA EHR).</p><p><strong>Methods: </strong>The study used an informatics search tool, a natural language processing algorithm and a chart review to validate FSD coding.</p><p><strong>Results: </strong>The positive predictive value (PPV) for code F44.5 was calculated to be 44%.</p><p><strong>Discussion: </strong>ICD-10 introduced a specific code for FSD to improve coding validity. However, results revealed a meager (44%) PPV for code F44.5. Evaluation of the low diagnostic precision of FSD identified inconsistencies in the ICD-10 and VA EHR systems.</p><p><strong>Conclusion: </strong>Information system improvements may increase the precision of diagnostic coding by clinicians. Specifically, the EHR problem list should include commonly used diagnostic codes and an appropriately curated ICD-10 term list for 'seizure disorder,' and a single ICD code for FSD should be classified under neurology and psychiatry.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/82/62/bmjhci-2023-100746.PMC10514602.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41102964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Long short-term memory model identifies ARDS and in-hospital mortality in both non-COVID-19 and COVID-19 cohort. 长短期记忆模型确定了非COVID-19和COVID-19队列中ARDS和住院死亡率。
IF 4.1 Q2 Computer Science Pub Date : 2023-09-01 DOI: 10.1136/bmjhci-2023-100782
Jen-Ting Chen, Rahil Mehrizi, Boudewijn Aasman, Michelle Ng Gong, Parsa Mirhaji

Objective: To identify the risk of acute respiratory distress syndrome (ARDS) and in-hospital mortality using long short-term memory (LSTM) framework in a mechanically ventilated (MV) non-COVID-19 cohort and a COVID-19 cohort.

Methods: We included MV ICU patients between 2017 and 2018 and reviewed patient records for ARDS and death. Using active learning, we enriched this cohort with MV patients from 2016 to 2019 (MV non-COVID-19, n=3905). We collected a second validation cohort of hospitalised patients with COVID-19 in 2020 (COVID+, n=5672). We trained an LSTM model using 132 structured features on the MV non-COVID-19 training cohort and validated on the MV non-COVID-19 validation and COVID-19 cohorts.

Results: Applying LSTM (model score 0.9) on the MV non-COVID-19 validation cohort had a sensitivity of 86% and specificity of 57%. The model identified the risk of ARDS 10 hours before ARDS and 9.4 days before death. The sensitivity (70%) and specificity (84%) of the model on the COVID-19 cohort are lower than MV non-COVID-19 cohort. For the COVID-19 + cohort and MV COVID-19 + patients, the model identified the risk of in-hospital mortality 2.4 days and 1.54 days before death, respectively.

Discussion: Our LSTM algorithm accurately and timely identified the risk of ARDS or death in MV non-COVID-19 and COVID+ patients. By alerting the risk of ARDS or death, we can improve the implementation of evidence-based ARDS management and facilitate goals-of-care discussions in high-risk patients.

Conclusion: Using the LSTM algorithm in hospitalised patients identifies the risk of ARDS or death.

目的:利用长短期记忆(LSTM)框架识别机械通气(MV)非COVID-19队列和COVID-19队列中急性呼吸窘迫综合征(ARDS)的风险和住院死亡率。方法:我们纳入2017年至2018年期间的MV ICU患者,并回顾ARDS和死亡的患者记录。通过主动学习,我们将2016年至2019年的MV患者(MV非covid -19, n=3905)纳入该队列。我们收集了2020年住院的COVID-19患者的第二个验证队列(COVID+, n=5672)。我们在MV非COVID-19训练队列上使用132个结构化特征训练LSTM模型,并在MV非COVID-19验证和COVID-19队列上进行验证。结果:LSTM(模型评分0.9)对MV非covid -19验证队列的敏感性为86%,特异性为57%。该模型在ARDS发生前10小时和死亡前9.4天确定了ARDS的风险。该模型对COVID-19队列的敏感性(70%)和特异性(84%)低于MV非COVID-19队列。对于COVID-19 +队列和MV COVID-19 +患者,该模型分别在死亡前2.4天和1.54天确定了院内死亡风险。讨论:我们的LSTM算法准确、及时地识别了MV非COVID-19和COVID-19 +患者发生ARDS或死亡的风险。通过提醒ARDS或死亡的风险,我们可以改善ARDS循证管理的实施,并促进高危患者的护理目标讨论。结论:应用LSTM算法识别住院患者发生ARDS或死亡的风险。
{"title":"Long short-term memory model identifies ARDS and in-hospital mortality in both non-COVID-19 and COVID-19 cohort.","authors":"Jen-Ting Chen,&nbsp;Rahil Mehrizi,&nbsp;Boudewijn Aasman,&nbsp;Michelle Ng Gong,&nbsp;Parsa Mirhaji","doi":"10.1136/bmjhci-2023-100782","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100782","url":null,"abstract":"<p><strong>Objective: </strong>To identify the risk of acute respiratory distress syndrome (ARDS) and in-hospital mortality using long short-term memory (LSTM) framework in a mechanically ventilated (MV) non-COVID-19 cohort and a COVID-19 cohort.</p><p><strong>Methods: </strong>We included MV ICU patients between 2017 and 2018 and reviewed patient records for ARDS and death. Using active learning, we enriched this cohort with MV patients from 2016 to 2019 (MV non-COVID-19, n=3905). We collected a second validation cohort of hospitalised patients with COVID-19 in 2020 (COVID+, n=5672). We trained an LSTM model using 132 structured features on the MV non-COVID-19 training cohort and validated on the MV non-COVID-19 validation and COVID-19 cohorts.</p><p><strong>Results: </strong>Applying LSTM (model score 0.9) on the MV non-COVID-19 validation cohort had a sensitivity of 86% and specificity of 57%. The model identified the risk of ARDS 10 hours before ARDS and 9.4 days before death. The sensitivity (70%) and specificity (84%) of the model on the COVID-19 cohort are lower than MV non-COVID-19 cohort. For the COVID-19 + cohort and MV COVID-19 + patients, the model identified the risk of in-hospital mortality 2.4 days and 1.54 days before death, respectively.</p><p><strong>Discussion: </strong>Our LSTM algorithm accurately and timely identified the risk of ARDS or death in MV non-COVID-19 and COVID+ patients. By alerting the risk of ARDS or death, we can improve the implementation of evidence-based ARDS management and facilitate goals-of-care discussions in high-risk patients.</p><p><strong>Conclusion: </strong>Using the LSTM algorithm in hospitalised patients identifies the risk of ARDS or death.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/9d/16/bmjhci-2023-100782.PMC10503386.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10336909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Web-based eHealth Clinical Decision Support System as a tool for the treat-to-target management of patients with systemic lupus erythematosus: development and initial usability evaluation. 基于网络的电子健康临床决策支持系统作为系统性红斑狼疮患者治疗目标管理的工具:开发和初步可用性评估。
IF 4.1 Q2 Computer Science Pub Date : 2023-09-01 DOI: 10.1136/bmjhci-2023-100811
Agner Russo Parra Sanchez, Max G Grimberg, Myrthe Hanssen, Moon Aben, Elianne Jairth, Prishent Dhoeme, Michel W P Tsang-A-Sjoe, Alexandre Voskuyl, Hendrik Jan Jansen, Ronald van Vollenhoven

Background: Treat-to-target (T2T) is a therapeutic strategy currently being studied for its application in systemic lupus erythematosus (SLE). Patients and rheumatologists have little support in making the best treatment decision in the context of a T2T strategy, thus, the use of information technology for systematically processing data and supporting information and knowledge may improve routine decision-making practices, helping to deliver value-based care.

Objective: To design and develop an online Clinical Decision Support Systems (CDSS) tool "SLE-T2T", and test its usability for the implementation of a T2T strategy in the management of patients with SLE.

Methods: A prototype of a CDSS was conceived as a web-based application with the task of generating appropriate treatment advice based on entered patients' data. Once developed, a System Usability Score (SUS) questionnaire was implemented to test whether the eHealth tool was user-friendly, comprehensible, easy-to-deliver and workflow-oriented. Data from the participants' comments were synthesised, and the elements in need for improvement were identified.

Results: The beta version web-based system was developed based on the interim usability and acceptance evaluation. 7 participants completed the SUS survey. The median SUS score of SLE-T2T was 79 (scale 0 to 100), categorising the application as 'good' and indicating the need for minor improvements to the design.

Conclusions: SLE-T2T is the first eHealth tool to be designed for the management of SLE patients in a T2T context. The SUS score and unstructured feedback showed high acceptance of this digital instrument for its future use in a clinical trial.

背景:靶向治疗(T2T)是目前正在研究的一种治疗策略,用于系统性红斑狼疮(SLE)。在T2T策略的背景下,患者和风湿病学家在做出最佳治疗决策方面几乎没有得到支持,因此,使用信息技术系统地处理数据并支持信息和知识可能会改善常规决策实践,有助于提供基于价值的护理。目的:设计和开发在线临床决策支持系统(CDSS)工具“SLE-T2T”,并测试其在系统性红斑狼疮患者管理中实施T2T策略的可用性。方法:CDSS的原型被设想为一个基于网络的应用程序,其任务是根据输入的患者数据生成适当的治疗建议。一旦开发完成,就实施了系统可用性评分问卷,以测试电子健康工具是否用户友好、易于理解、易于交付和面向工作流程。综合了参与者评论中的数据,并确定了需要改进的因素。结果:基于中期可用性和可接受性评估,开发了基于网络的测试版系统。7名参与者完成了SUS调查。SLE-T2T的SUS评分中位数为79(0至100分),将该应用归类为“良好”,并表明需要对设计进行微小改进。结论:SLE-T2T是第一个设计用于T2T环境下SLE患者管理的eHealth工具。SUS评分和非结构化反馈显示,该数字仪器在未来的临床试验中得到了高度认可。
{"title":"Web-based eHealth Clinical Decision Support System as a tool for the treat-to-target management of patients with systemic lupus erythematosus: <i>development and initial usability evaluation</i>.","authors":"Agner Russo Parra Sanchez,&nbsp;Max G Grimberg,&nbsp;Myrthe Hanssen,&nbsp;Moon Aben,&nbsp;Elianne Jairth,&nbsp;Prishent Dhoeme,&nbsp;Michel W P Tsang-A-Sjoe,&nbsp;Alexandre Voskuyl,&nbsp;Hendrik Jan Jansen,&nbsp;Ronald van Vollenhoven","doi":"10.1136/bmjhci-2023-100811","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100811","url":null,"abstract":"<p><strong>Background: </strong>Treat-to-target (T2T) is a therapeutic strategy currently being studied for its application in systemic lupus erythematosus (SLE). Patients and rheumatologists have little support in making the best treatment decision in the context of a T2T strategy, thus, the use of information technology for systematically processing data and supporting information and knowledge may improve routine decision-making practices, helping to deliver value-based care.</p><p><strong>Objective: </strong>To design and develop an online Clinical Decision Support Systems (CDSS) tool \"SLE-T2T\", and test its usability for the implementation of a T2T strategy in the management of patients with SLE.</p><p><strong>Methods: </strong>A prototype of a CDSS was conceived as a web-based application with the task of generating appropriate treatment advice based on entered patients' data. Once developed, a System Usability Score (SUS) questionnaire was implemented to test whether the eHealth tool was user-friendly, comprehensible, easy-to-deliver and workflow-oriented. Data from the participants' comments were synthesised, and the elements in need for improvement were identified.</p><p><strong>Results: </strong>The beta version web-based system was developed based on the interim usability and acceptance evaluation. 7 participants completed the SUS survey. The median SUS score of SLE-T2T was 79 (scale 0 to 100), categorising the application as 'good' and indicating the need for minor improvements to the design.</p><p><strong>Conclusions: </strong>SLE-T2T is the first eHealth tool to be designed for the management of SLE patients in a T2T context. The SUS score and unstructured feedback showed high acceptance of this digital instrument for its future use in a clinical trial.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/ba/70/bmjhci-2023-100811.PMC10533702.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41102965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How to organise a datathon for bridging between data science and healthcare? Insights from the Technion-Rambam machine learning in healthcare datathon event. 如何组织一场数据马拉松,架起数据科学与医疗保健之间的桥梁?来自医疗保健数据马拉松活动中的Technion-Rambam机器学习的见解。
IF 4.1 Q2 Computer Science Pub Date : 2023-09-01 DOI: 10.1136/bmjhci-2023-100736
Jonathan Sobel, Ronit Almog, Leo Celi, Michal Yablowitz, Danny Eytan, Joachim Behar
© Author(s) (or their employer(s)) 2023. Reuse permitted under CC BYNC. No commercial reuse. See rights and permissions. Published by BMJ. INTRODUCTION A datathon is a timeconstrained informationbased competition involving data science applied to one or more challenges. Datathons and hackathons differ in their focus, with datathons prioritising data analysis and modelling, while hackathons concentrate on building prototypes. Furthermore, hackathons can encompass a broad range of topics, spanning from software development to hardware design, whereas datathons are more narrowly focused on data analysis. Inperson datathons offer the unique opportunity to learn alongside a community of fellow students and researchers, as well as to directly interact with clinicians and medical professionals. This is in contrast to Kaggle like competitions, which are often selflearning experiences.
{"title":"How to organise a datathon for bridging between data science and healthcare? Insights from the Technion-Rambam machine learning in healthcare datathon event.","authors":"Jonathan Sobel,&nbsp;Ronit Almog,&nbsp;Leo Celi,&nbsp;Michal Yablowitz,&nbsp;Danny Eytan,&nbsp;Joachim Behar","doi":"10.1136/bmjhci-2023-100736","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100736","url":null,"abstract":"© Author(s) (or their employer(s)) 2023. Reuse permitted under CC BYNC. No commercial reuse. See rights and permissions. Published by BMJ. INTRODUCTION A datathon is a timeconstrained informationbased competition involving data science applied to one or more challenges. Datathons and hackathons differ in their focus, with datathons prioritising data analysis and modelling, while hackathons concentrate on building prototypes. Furthermore, hackathons can encompass a broad range of topics, spanning from software development to hardware design, whereas datathons are more narrowly focused on data analysis. Inperson datathons offer the unique opportunity to learn alongside a community of fellow students and researchers, as well as to directly interact with clinicians and medical professionals. This is in contrast to Kaggle like competitions, which are often selflearning experiences.","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/ca/b8/bmjhci-2023-100736.PMC10496710.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10315555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
BMJ Health & Care Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1