首页 > 最新文献

BMJ Health & Care Informatics最新文献

英文 中文
Delivering on NIH data sharing requirements: avoiding Open Data in Appearance Only. 交付NIH数据共享要求:避免仅在外观上开放数据。
IF 4.1 Q2 Computer Science Pub Date : 2023-06-01 DOI: 10.1136/bmjhci-2023-100771
Hope Watson, Jack Gallifant, Yuan Lai, Alexander P Radunsky, Cleva Villanueva, Nicole Martinez, Judy Gichoya, Uyen Kim Huynh, Leo Anthony Celi

Introduction In January, the National Institutes of Health (NIH) implemented a Data Management and Sharing Policy aiming to leverage data collected during NIH-funded research. The COVID-19 pandemic illustrated that this practice is equally vital for augmenting patient research. In addition, data sharing acts as a necessary safeguard against the introduction of analytical biases. While the pandemic provided an opportunity to curtail critical research issues such as reproducibility and validity through data sharing, this did not materialise in practice and became an example of 'Open Data in Appearance Only' (ODIAO). Here, we define ODIAO as the intent of data sharing without the occurrence of actual data sharing (eg, material or digital data transfers).Objective Propose a framework that states the main risks associated with data sharing, systematically present risk mitigation strategies and provide examples through a healthcare lens.Methods This framework was informed by critical aspects of both the Open Data Institute and the NIH's 2023 Data Management and Sharing Policy plan guidelines.Results Through our examination of legal, technical, reputational and commercial categories, we find barriers to data sharing ranging from misinterpretation of General Data Privacy Rule to lack of technical personnel able to execute large data transfers. From this, we deduce that at numerous touchpoints, data sharing is presently too disincentivised to become the norm.Conclusion In order to move towards Open Data, we propose the creation of mechanisms for incentivisation, beginning with recentring data sharing on patient benefits, additional clauses in grant requirements and committees to encourage adherence to data reporting practices.

今年1月,美国国立卫生研究院(NIH)实施了一项数据管理和共享政策,旨在利用在NIH资助的研究期间收集的数据。COVID-19大流行表明,这种做法对于扩大患者研究同样至关重要。此外,数据共享是防止引入分析偏差的必要保障。虽然大流行提供了一个机会,通过数据共享来限制关键的研究问题,如可重复性和有效性,但这在实践中没有实现,并成为“仅限外观开放数据”(ODIAO)的一个例子。在这里,我们将ODIAO定义为没有发生实际数据共享(例如,材料或数字数据传输)的数据共享意图。提出一个框架,说明与数据共享相关的主要风险,系统地提出风险缓解战略,并从医疗保健角度提供实例。该框架由开放数据研究所和NIH的2023数据管理和共享政策计划指南的关键方面提供信息。通过我们对法律、技术、声誉和商业类别的审查,我们发现了数据共享的障碍,从对通用数据隐私规则的误解到缺乏能够执行大数据传输的技术人员。由此,我们推断,在许多接触点上,数据共享目前过于缺乏动力,无法成为常态。为了向开放数据迈进,我们建议建立激励机制,首先将数据共享重新集中在患者利益上,在拨款要求和委员会中增加条款,以鼓励遵守数据报告惯例。
{"title":"Delivering on NIH data sharing requirements: avoiding Open Data in Appearance Only.","authors":"Hope Watson,&nbsp;Jack Gallifant,&nbsp;Yuan Lai,&nbsp;Alexander P Radunsky,&nbsp;Cleva Villanueva,&nbsp;Nicole Martinez,&nbsp;Judy Gichoya,&nbsp;Uyen Kim Huynh,&nbsp;Leo Anthony Celi","doi":"10.1136/bmjhci-2023-100771","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100771","url":null,"abstract":"<p><p><b>Introduction</b> In January, the National Institutes of Health (NIH) implemented a Data Management and Sharing Policy aiming to leverage data collected during NIH-funded research. The COVID-19 pandemic illustrated that this practice is equally vital for augmenting patient research. In addition, data sharing acts as a necessary safeguard against the introduction of analytical biases. While the pandemic provided an opportunity to curtail critical research issues such as reproducibility and validity through data sharing, this did not materialise in practice and became an example of 'Open Data in Appearance Only' (ODIAO). Here, we define ODIAO as the intent of data sharing without the occurrence of actual data sharing (eg, material or digital data transfers).<b>Objective</b> Propose a framework that states the main risks associated with data sharing, systematically present risk mitigation strategies and provide examples through a healthcare lens.<b>Methods</b> This framework was informed by critical aspects of both the Open Data Institute and the NIH's 2023 Data Management and Sharing Policy plan guidelines.<b>Results</b> Through our examination of legal, technical, reputational and commercial categories, we find barriers to data sharing ranging from misinterpretation of General Data Privacy Rule to lack of technical personnel able to execute large data transfers. From this, we deduce that at numerous touchpoints, data sharing is presently too disincentivised to become the norm.<b>Conclusion</b> In order to move towards Open Data, we propose the creation of mechanisms for incentivisation, beginning with recentring data sharing on patient benefits, additional clauses in grant requirements and committees to encourage adherence to data reporting practices.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/7c/4a/bmjhci-2023-100771.PMC10314418.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9740894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Validation framework for the use of AI in healthcare: overview of the new British standard BS30440. 在医疗保健中使用人工智能的验证框架:新英国标准BS30440概述。
IF 4.1 Q2 Computer Science Pub Date : 2023-06-01 DOI: 10.1136/bmjhci-2023-100749
Mark Sujan, Cassius Smith-Frazer, Christina Malamateniou, Joseph Connor, Allison Gardner, Harriet Unsworth, Haider Husain
{"title":"Validation framework for the use of AI in healthcare: overview of the new British standard BS30440.","authors":"Mark Sujan,&nbsp;Cassius Smith-Frazer,&nbsp;Christina Malamateniou,&nbsp;Joseph Connor,&nbsp;Allison Gardner,&nbsp;Harriet Unsworth,&nbsp;Haider Husain","doi":"10.1136/bmjhci-2023-100749","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100749","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/fc/d2/bmjhci-2023-100749.PMC10410839.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9973511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Prevalence of electronic screening for sepsis in National Health Service acute hospitals in England. 英国国民健康服务急症医院败血症电子筛查的普及率。
IF 4.1 Q2 Computer Science Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2023-100743
Kate Honeyford, Amen-Patrick Nwosu, Runa Lazzarino, Anne Kinderlerer, John Welch, Andrew J Brent, Graham Cooke, Peter Ghazal, Shashank Patil, Ceire E Costelloe

Sepsis is a worldwide public health problem. Rapid identification is associated with improved patient outcomes-if followed by timely appropriate treatment.

Objectives: Describe digital sepsis alerts (DSAs) in use in English National Health Service (NHS) acute hospitals.

Methods: A Freedom of Information request surveyed acute NHS Trusts on their adoption of electronic patient records (EPRs) and DSAs.

Results: Of the 99 Trusts that responded, 84 had an EPR. Over 20 different EPR system providers were identified as operational in England. The most common providers were Cerner (21%). System C, Dedalus and Allscripts Sunrise were also relatively common (13%, 10% and 7%, respectively). 70% of NHS Trusts with an EPR responded that they had a DSA; most of these use the National Early Warning Score (NEWS2). There was evidence that the EPR provider was related to the DSA algorithm. We found no evidence that Trusts were using EPRs to introduce data driven algorithms or DSAs able to include, for example, pre-existing conditions that may be known to increase risk.Not all Trusts were willing or able to provide details of their EPR or the underlying algorithm.

Discussion: The majority of NHS Trusts use an EPR of some kind; many use a NEWS2-based DSA in keeping with national guidelines.

Conclusion: Many English NHS Trusts use DSAs; even those using similar triggers vary and many recreate paper systems. Despite the proliferation of machine learning algorithms being developed to support early detection of sepsis, there is little evidence that these are being used to improve personalised sepsis detection.

败血症是一个全球性的公共卫生问题。如果能及时进行适当的治疗,快速识别与改善患者预后有关:描述英国国家医疗服务系统(NHS)急症医院中使用的数字败血症警报(DSA):方法:根据信息自由申请,对英国国家医疗服务系统(NHS)急症医院采用电子病历(EPR)和 DSA 的情况进行调查:结果:在 99 家做出回复的医院中,84 家采用了电子病历系统。在英格兰,有 20 多家不同的电子病历系统提供商在运营。最常见的供应商是 Cerner(21%)。System C、Dedalus 和 Allscripts Sunrise 也比较常见(分别为 13%、10% 和 7%)。70% 拥有 EPR 的 NHS 信托基金会回复称,他们拥有 DSA;其中大部分使用国家预警分数 (NEWS2)。有证据表明,电子病历提供者与 DSA 算法有关。我们没有发现任何证据表明,信托机构正在使用 EPR 来引入数据驱动算法或 DSA,以便将已知可能会增加风险的既存病症等纳入其中:讨论:大多数英国国家医疗服务托管机构都使用某种 EPR;许多托管机构根据国家指导方针使用基于 NEWS2 的 DSA:结论:许多英国国家医疗服务系统信托机构都使用 DSA;即使是使用类似触发器的信托机构也各不相同,许多信托机构都在重新创建纸质系统。尽管支持败血症早期检测的机器学习算法不断涌现,但几乎没有证据表明这些算法被用于改善个性化败血症检测。
{"title":"Prevalence of electronic screening for sepsis in National Health Service acute hospitals in England.","authors":"Kate Honeyford, Amen-Patrick Nwosu, Runa Lazzarino, Anne Kinderlerer, John Welch, Andrew J Brent, Graham Cooke, Peter Ghazal, Shashank Patil, Ceire E Costelloe","doi":"10.1136/bmjhci-2023-100743","DOIUrl":"10.1136/bmjhci-2023-100743","url":null,"abstract":"<p><p>Sepsis is a worldwide public health problem. Rapid identification is associated with improved patient outcomes-if followed by timely appropriate treatment.</p><p><strong>Objectives: </strong>Describe digital sepsis alerts (DSAs) in use in English National Health Service (NHS) acute hospitals.</p><p><strong>Methods: </strong>A Freedom of Information request surveyed acute NHS Trusts on their adoption of electronic patient records (EPRs) and DSAs.</p><p><strong>Results: </strong>Of the 99 Trusts that responded, 84 had an EPR. Over 20 different EPR system providers were identified as operational in England. The most common providers were Cerner (21%). System C, Dedalus and Allscripts Sunrise were also relatively common (13%, 10% and 7%, respectively). 70% of NHS Trusts with an EPR responded that they had a DSA; most of these use the National Early Warning Score (NEWS2). There was evidence that the EPR provider was related to the DSA algorithm. We found no evidence that Trusts were using EPRs to introduce data driven algorithms or DSAs able to include, for example, pre-existing conditions that may be known to increase risk.Not all Trusts were willing or able to provide details of their EPR or the underlying algorithm.</p><p><strong>Discussion: </strong>The majority of NHS Trusts use an EPR of some kind; many use a NEWS2-based DSA in keeping with national guidelines.</p><p><strong>Conclusion: </strong>Many English NHS Trusts use DSAs; even those using similar triggers vary and many recreate paper systems. Despite the proliferation of machine learning algorithms being developed to support early detection of sepsis, there is little evidence that these are being used to improve personalised sepsis detection.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10186434/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9838939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Willingness of diabetes mellitus patients to use mHealth applications and its associated factors for self-care management in a low-income country: an input for digital health implementation. 低收入国家糖尿病患者使用移动健康应用程序的意愿及其相关因素:数字健康实施的投入
IF 4.1 Q2 Computer Science Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2023-100761
Agmasie Damtew Walle, Tigist Andargie Ferede, Adamu Ambachew Shibabaw, Sisay Maru Wubante, Habtamu Alganeh Guadie, Chalachew Msganaw Yehula, Addisalem Workie Demsash

Background: Although mHealth applications are becoming more widely available and used, there is no evidence about why people are willing to use them. Therefore, this study aimed to assess the willingness of patients with diabetes to use mHealth applications and associated factors for self-care management in Ethiopia.

Methods: An institutional cross-sectional study was conducted among 422 patients with diabetes. Data were collected using pretested interviewer-administered questionnaire. Epi Data V.4.6 for entering the data and STATA V.14 for analysing the data were used. A multivariable logistic regression analysis was carried out to identify factors associated with patient's willingness to use mobile health applications.

Results: A total of 398 study participants were included in the study. About 284 (71.4%) 95% CI (66.8% to 75.9%)). Of participants were willing to use mobile health applications. Patients below 30 years of age (adjusted OR, AOR 2.21; 95% CI (1.22 to 4.10)), urban residents (AOR 2.12; 95% CI (1.12 to 3.98)), internet access (AOR 3.91; 95% CI (1.31 to 11.5)), favourable attitude (AOR 5.20; 95% CI (2.60 to 10.40)), perceived ease of use (AOR 2.57; 95% CI (1.34 to 4.85)) and perceived usefulness (AOR 4.67; 95% CI (1.95 to 5.77)) were significantly associated with patients' willingness to use mobile health applications.

Conclusions: Overall, diabetes patients' willingness to use mobile health applications was high. Patients' age, place of residence, internet access, attitude, perceived ease of use and perceived usefulness were significant factors concerning their willingness to use mobile health applications. Considering these factors could provide insight for developing and adopting diabetes management applications on mobile devices in Ethiopia.

背景:尽管移动健康应用程序变得越来越广泛,但没有证据表明人们为什么愿意使用它们。因此,本研究旨在评估埃塞俄比亚糖尿病患者使用移动健康应用程序的意愿和自我保健管理的相关因素。方法:对422例糖尿病患者进行机构横断面研究。数据收集采用预先测试的访谈者管理的问卷。使用Epi Data V.4.6输入数据,使用STATA V.14分析数据。进行多变量logistic回归分析,以确定与患者使用移动医疗应用程序意愿相关的因素。结果:本研究共纳入398名研究参与者。约284 (71.4%)95% CI(66.8%至75.9%))。有一半的参与者愿意使用移动健康应用程序。30岁以下患者(调整OR, AOR 2.21;95% CI(1.22 - 4.10)),城市居民(AOR 2.12;95% CI(1.12 ~ 3.98))、互联网接入(AOR 3.91;95% CI(1.31 ~ 11.5)),积极态度(AOR 5.20;95% CI(2.60 ~ 10.40)),感知易用性(AOR 2.57;95% CI(1.34 ~ 4.85))和感知有用性(AOR 4.67;95% CI(1.95 - 5.77))与患者使用移动医疗应用程序的意愿显著相关。结论:总体而言,糖尿病患者使用移动健康应用的意愿较高。患者的年龄、居住地、互联网接入、态度、感知易用性和感知有用性是影响其使用移动健康应用意愿的重要因素。考虑到这些因素可以为在埃塞俄比亚的移动设备上开发和采用糖尿病管理应用程序提供见解。
{"title":"Willingness of diabetes mellitus patients to use mHealth applications and its associated factors for self-care management in a low-income country: an input for digital health implementation.","authors":"Agmasie Damtew Walle,&nbsp;Tigist Andargie Ferede,&nbsp;Adamu Ambachew Shibabaw,&nbsp;Sisay Maru Wubante,&nbsp;Habtamu Alganeh Guadie,&nbsp;Chalachew Msganaw Yehula,&nbsp;Addisalem Workie Demsash","doi":"10.1136/bmjhci-2023-100761","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100761","url":null,"abstract":"<p><strong>Background: </strong>Although mHealth applications are becoming more widely available and used, there is no evidence about why people are willing to use them. Therefore, this study aimed to assess the willingness of patients with diabetes to use mHealth applications and associated factors for self-care management in Ethiopia.</p><p><strong>Methods: </strong>An institutional cross-sectional study was conducted among 422 patients with diabetes. Data were collected using pretested interviewer-administered questionnaire. Epi Data V.4.6 for entering the data and STATA V.14 for analysing the data were used. A multivariable logistic regression analysis was carried out to identify factors associated with patient's willingness to use mobile health applications.</p><p><strong>Results: </strong>A total of 398 study participants were included in the study. About 284 (71.4%) 95% CI (66.8% to 75.9%)). Of participants were willing to use mobile health applications. Patients below 30 years of age (adjusted OR, AOR 2.21; 95% CI (1.22 to 4.10)), urban residents (AOR 2.12; 95% CI (1.12 to 3.98)), internet access (AOR 3.91; 95% CI (1.31 to 11.5)), favourable attitude (AOR 5.20; 95% CI (2.60 to 10.40)), perceived ease of use (AOR 2.57; 95% CI (1.34 to 4.85)) and perceived usefulness (AOR 4.67; 95% CI (1.95 to 5.77)) were significantly associated with patients' willingness to use mobile health applications.</p><p><strong>Conclusions: </strong>Overall, diabetes patients' willingness to use mobile health applications was high. Patients' age, place of residence, internet access, attitude, perceived ease of use and perceived usefulness were significant factors concerning their willingness to use mobile health applications. Considering these factors could provide insight for developing and adopting diabetes management applications on mobile devices in Ethiopia.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/d8/5b/bmjhci-2023-100761.PMC10230908.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9552780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A natural language processing approach to categorise contributing factors from patient safety event reports. 从患者安全事件报告中对促成因素进行分类的自然语言处理方法。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2022-100731
Azade Tabaie, Srijan Sengupta, Zoe M Pruitt, Allan Fong

Objectives: The objective of this study was to explore the use of natural language processing (NLP) algorithm to categorise contributing factors from patient safety event (PSE). Contributing factors are elements in the healthcare process (eg, communication failures) that instigate an event or allow an event to occur. Contributing factors can be used to further investigate why safety events occurred.

Methods: We used 10 years of self-reported PSE reports from a multihospital healthcare system in the USA. Reports were first selected by event date. We calculated χ2 values for each ngram in the bag-of-words then selected N ngrams with the highest χ2 values. Then, PSE reports were filtered to only include the sentences containing the selected ngrams. Such sentences were called information-rich sentences. We compared two feature extraction techniques from free-text data: (1) baseline bag-of-words features and (2) features from information-rich sentences. Three machine learning algorithms were used to categorise five contributing factors representing sociotechnical errors: communication/hand-off failure, technology issue, policy/procedure issue, distractions/interruptions and lapse/slip. We trained 15 binary classifiers (five contributing factors * three machine learning models). The models' performances were evaluated according to the area under the precision-recall curve (AUPRC), precision, recall, and F1-score.

Results: Applying the information-rich sentence selection algorithm boosted the contributing factor categorisation performance. Comparing the AUPRCs, the proposed NLP approach improved the categorisation performance of two and achieved comparable results with baseline in categorising three contributing factors.

Conclusions: Information-rich sentence selection can be incorporated to extract the sentences in free-text event narratives in which the contributing factor information is embedded.

研究目的本研究旨在探索使用自然语言处理(NLP)算法对患者安全事件(PSE)的诱因进行分类。诱因是指医疗过程中引发事件或导致事件发生的因素(如沟通失败)。诱因可用于进一步调查安全事件发生的原因:我们使用了美国一家多医院医疗系统 10 年来的自我报告 PSE 报告。首先按事件发生日期选择报告。我们计算了词包中每个 ngram 的 χ2 值,然后选出 N 个具有最高 χ2 值的 ngram。然后,对 PSE 报告进行过滤,使其只包含包含所选 ngrams 的句子。这些句子被称为信息丰富的句子。我们比较了自由文本数据中的两种特征提取技术:(1) 基线词袋特征和 (2) 信息丰富句子特征。我们使用了三种机器学习算法对代表社会技术错误的五个促成因素进行分类:沟通/手忙脚乱、技术问题、政策/程序问题、分心/中断和失误/滑倒。我们训练了 15 个二元分类器(五个促成因素 * 三个机器学习模型)。根据精确度-召回曲线下面积(AUPRC)、精确度、召回率和 F1 分数对模型的性能进行了评估:结果:应用信息丰富的句子选择算法提高了诱因分类的性能。比较 AUPRC,建议的 NLP 方法提高了两个因素的分类性能,并在三个因素的分类中取得了与基线相当的结果:结论:可以利用信息丰富的句子选择来提取自由文本事件叙述中包含诱因信息的句子。
{"title":"A natural language processing approach to categorise contributing factors from patient safety event reports.","authors":"Azade Tabaie, Srijan Sengupta, Zoe M Pruitt, Allan Fong","doi":"10.1136/bmjhci-2022-100731","DOIUrl":"10.1136/bmjhci-2022-100731","url":null,"abstract":"<p><strong>Objectives: </strong>The objective of this study was to explore the use of natural language processing (NLP) algorithm to categorise contributing factors from patient safety event (PSE). Contributing factors are elements in the healthcare process (eg, communication failures) that instigate an event or allow an event to occur. Contributing factors can be used to further investigate why safety events occurred.</p><p><strong>Methods: </strong>We used 10 years of self-reported PSE reports from a multihospital healthcare system in the USA. Reports were first selected by event date. We calculated χ<sup>2</sup> values for each ngram in the bag-of-words then selected N ngrams with the highest χ<sup>2</sup> values. Then, PSE reports were filtered to only include the sentences containing the selected ngrams. Such sentences were called information-rich sentences. We compared two feature extraction techniques from free-text data: (1) baseline bag-of-words features and (2) features from information-rich sentences. Three machine learning algorithms were used to categorise five contributing factors representing sociotechnical errors: communication/hand-off failure, technology issue, policy/procedure issue, distractions/interruptions and lapse/slip. We trained 15 binary classifiers (five contributing factors * three machine learning models). The models' performances were evaluated according to the area under the precision-recall curve (AUPRC), precision, recall, and F1-score.</p><p><strong>Results: </strong>Applying the information-rich sentence selection algorithm boosted the contributing factor categorisation performance. Comparing the AUPRCs, the proposed NLP approach improved the categorisation performance of two and achieved comparable results with baseline in categorising three contributing factors.</p><p><strong>Conclusions: </strong>Information-rich sentence selection can be incorporated to extract the sentences in free-text event narratives in which the contributing factor information is embedded.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/9e/ab/bmjhci-2022-100731.PMC10254979.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9963361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Anticipating artificial intelligence in mammography screening: views of Swedish breast radiologists. 乳房 X 射线摄影筛查中的人工智能预测:瑞典乳腺放射科医生的观点。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2022-100712
Charlotte Högberg, Stefan Larsson, Kristina Lång

Objectives: Artificial intelligence (AI) is increasingly tested and integrated into breast cancer screening. Still, there are unresolved issues regarding its possible ethical, social and legal impacts. Furthermore, the perspectives of different actors are lacking. This study investigates the views of breast radiologists on AI-supported mammography screening, with a focus on attitudes, perceived benefits and risks, accountability of AI use, and potential impact on the profession.

Methods: We conducted an online survey of Swedish breast radiologists. As early adopter of breast cancer screening, and digital technologies, Sweden is a particularly interesting case to study. The survey had different themes, including: attitudes and responsibilities pertaining to AI, and AI's impact on the profession. Responses were analysed using descriptive statistics and correlation analyses. Free texts and comments were analysed using an inductive approach.

Results: Overall, respondents (47/105, response rate 44.8%) were highly experienced in breast imaging and had a mixed knowledge of AI. A majority (n=38, 80.8%) were positive/somewhat positive towards integrating AI in mammography screening. Still, many considered there to be potential risks to a high/somewhat high degree (n=16, 34.1%) or were uncertain (n=16, 34.0%). Several important uncertainties were identified, such as defining liable actor(s) when AI is integrated into medical decision-making.

Conclusions: Swedish breast radiologists are largely positive towards integrating AI in mammography screening, but there are significant uncertainties that need to be addressed, especially regarding risks and responsibilities. The results stress the importance of understanding actor-specific and context-specific challenges to responsible implementation of AI in healthcare.

目的:人工智能(AI)越来越多地应用于乳腺癌筛查。然而,有关其可能产生的伦理、社会和法律影响的问题仍未得到解决。此外,还缺乏不同参与者的观点。本研究调查了乳腺放射科医生对人工智能支持的乳腺X光筛查的看法,重点是态度、感知到的益处和风险、人工智能使用的责任以及对行业的潜在影响:我们对瑞典乳腺放射科医生进行了在线调查。作为乳腺癌筛查和数字技术的早期采用者,瑞典是一个特别值得研究的案例。调查有不同的主题,包括:对人工智能的态度和责任,以及人工智能对该行业的影响。我们使用描述性统计和相关性分析对答复进行了分析。自由文本和评论采用归纳法进行分析:总体而言,受访者(47/105,回复率 44.8%)在乳腺成像方面经验丰富,对人工智能的了解程度参差不齐。大多数受访者(38 人,占 80.8%)对将人工智能纳入乳腺 X 光筛查持积极或略为积极的态度。但也有很多人认为潜在风险很高(16 人,34.1%)或不确定(16 人,34.0%)。研究还发现了一些重要的不确定因素,如在将人工智能纳入医疗决策时如何界定责任主体:结论:瑞典乳腺放射医师对将人工智能纳入乳腺 X 射线筛查持积极态度,但仍有许多不确定因素需要解决,尤其是在风险和责任方面。研究结果强调了了解特定行为者和特定环境对负责任地将人工智能应用于医疗保健的挑战的重要性。
{"title":"Anticipating artificial intelligence in mammography screening: views of Swedish breast radiologists.","authors":"Charlotte Högberg, Stefan Larsson, Kristina Lång","doi":"10.1136/bmjhci-2022-100712","DOIUrl":"10.1136/bmjhci-2022-100712","url":null,"abstract":"<p><strong>Objectives: </strong>Artificial intelligence (AI) is increasingly tested and integrated into breast cancer screening. Still, there are unresolved issues regarding its possible ethical, social and legal impacts. Furthermore, the perspectives of different actors are lacking. This study investigates the views of breast radiologists on AI-supported mammography screening, with a focus on attitudes, perceived benefits and risks, accountability of AI use, and potential impact on the profession.</p><p><strong>Methods: </strong>We conducted an online survey of Swedish breast radiologists. As early adopter of breast cancer screening, and digital technologies, Sweden is a particularly interesting case to study. The survey had different themes, including: attitudes and responsibilities pertaining to AI, and AI's impact on the profession. Responses were analysed using descriptive statistics and correlation analyses. Free texts and comments were analysed using an inductive approach.</p><p><strong>Results: </strong>Overall, respondents (47/105, response rate 44.8%) were highly experienced in breast imaging and had a mixed knowledge of AI. A majority (n=38, 80.8%) were positive/somewhat positive towards integrating AI in mammography screening. Still, many considered there to be potential risks to a high/somewhat high degree (n=16, 34.1%) or were uncertain (n=16, 34.0%). Several important uncertainties were identified, such as defining liable actor(s) when AI is integrated into medical decision-making.</p><p><strong>Conclusions: </strong>Swedish breast radiologists are largely positive towards integrating AI in mammography screening, but there are significant uncertainties that need to be addressed, especially regarding risks and responsibilities. The results stress the importance of understanding actor-specific and context-specific challenges to responsible implementation of AI in healthcare.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10230899/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9931811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Clinical decision support systems to improve drug prescription and therapy optimisation in clinical practice: a scoping review. 临床决策支持系统,以改善药物处方和治疗优化在临床实践:范围审查。
IF 4.1 Q2 Computer Science Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2022-100683
Lucrezia Greta Armando, Gianluca Miglio, Pierluigi de Cosmo, Clara Cena

Objective: Clinical decision support systems (CDSSs) can reduce medical errors increasing drug prescription appropriateness. Deepening knowledge of existing CDSSs could increase their use by healthcare professionals in different settings (ie, hospitals, pharmacies, health research centres) of clinical practice. This review aims to identify the characteristics common to effective studies conducted with CDSSs.

Materials and methods: The article sources were Scopus, PubMed, Ovid MEDLINE and Web of Science, queried between January 2017 and January 2022. Inclusion criteria were prospective and retrospective studies that reported original research on CDSSs for clinical practice support; studies should describe a measurable comparison of the intervention or observation conducted with and without the CDSS; article language Italian or English. Reviews and studies with CDSSs used exclusively by patients were excluded. A Microsoft Excel spreadsheet was prepared to extract and summarise data from the included articles.

Results: The search resulted in the identification of 2424 articles. After title and abstract screening, 136 studies remained, 42 of which were included for final evaluation. Most of the studies included rule-based CDSSs that are integrated into existing databases with the main purpose of managing disease-related problems. The majority of the selected studies (25 studies; 59.5%) were successful in supporting clinical practice, with most being pre-post intervention studies and involving the presence of a pharmacist.

Discussion and conclusion: A number of characteristics have been identified that may help the design of studies feasible to demonstrate the effectiveness of CDSSs. Further studies are needed to encourage CDSS use.

目的:临床决策支持系统(cdss)可以减少医疗差错,提高药物处方的适宜性。加深对现有cdss的了解,可以增加医疗保健专业人员在不同环境(即医院、药房、卫生研究中心)的临床实践中使用这些cdss。本综述旨在确定cdss有效研究的共同特征。材料和方法:文章来源为Scopus、PubMed、Ovid MEDLINE和Web of Science,查询时间为2017年1月至2022年1月。纳入标准为前瞻性和回顾性研究,这些研究报告了cdss的原始研究,以支持临床实践;研究应描述使用和不使用CDSS进行的干预或观察的可衡量的比较;文章语言意大利语或英语。排除了仅由患者使用cdss的综述和研究。准备了一个微软Excel电子表格,从纳入的文章中提取和汇总数据。结果:检索结果鉴定出2424篇。在标题和摘要筛选之后,136项研究被保留下来,其中42项被纳入最终评估。大多数研究包括基于规则的cdss,这些cdss被整合到现有数据库中,主要目的是管理与疾病相关的问题。大多数选定的研究(25项研究;59.5%)成功地支持了临床实践,其中大多数是干预前和干预后的研究,并且有药剂师在场。讨论和结论:已经确定了一些特征,这些特征可能有助于设计可行的研究,以证明cdss的有效性。需要进一步的研究来鼓励CDSS的使用。
{"title":"Clinical decision support systems to improve drug prescription and therapy optimisation in clinical practice: a scoping review.","authors":"Lucrezia Greta Armando,&nbsp;Gianluca Miglio,&nbsp;Pierluigi de Cosmo,&nbsp;Clara Cena","doi":"10.1136/bmjhci-2022-100683","DOIUrl":"https://doi.org/10.1136/bmjhci-2022-100683","url":null,"abstract":"<p><strong>Objective: </strong>Clinical decision support systems (CDSSs) can reduce medical errors increasing drug prescription appropriateness. Deepening knowledge of existing CDSSs could increase their use by healthcare professionals in different settings (ie, hospitals, pharmacies, health research centres) of clinical practice. This review aims to identify the characteristics common to effective studies conducted with CDSSs.</p><p><strong>Materials and methods: </strong>The article sources were Scopus, PubMed, Ovid MEDLINE and Web of Science, queried between January 2017 and January 2022. Inclusion criteria were prospective and retrospective studies that reported original research on CDSSs for clinical practice support; studies should describe a measurable comparison of the intervention or observation conducted with and without the CDSS; article language Italian or English. Reviews and studies with CDSSs used exclusively by patients were excluded. A Microsoft Excel spreadsheet was prepared to extract and summarise data from the included articles.</p><p><strong>Results: </strong>The search resulted in the identification of 2424 articles. After title and abstract screening, 136 studies remained, 42 of which were included for final evaluation. Most of the studies included rule-based CDSSs that are integrated into existing databases with the main purpose of managing disease-related problems. The majority of the selected studies (25 studies; 59.5%) were successful in supporting clinical practice, with most being pre-post intervention studies and involving the presence of a pharmacist.</p><p><strong>Discussion and conclusion: </strong>A number of characteristics have been identified that may help the design of studies feasible to demonstrate the effectiveness of CDSSs. Further studies are needed to encourage CDSS use.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/35/60/bmjhci-2022-100683.PMC10163516.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9478867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Applying a user-centred design machine learning toolkit to an autism spectrum disorder use case. 将以用户为中心的设计机器学习工具包应用于自闭症谱系障碍用例。
IF 4.1 Q2 Computer Science Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2023-100765
Joseph M Plasek, Li Zhou
Two BMJ Health & Care Informatics editors’ choice papers present insights based on case studies from real- world data and machine learning models for clinical risk prediction use cases. Seneviratne et al focus on case management to demonstrate how one might implement their
{"title":"Applying a user-centred design machine learning toolkit to an autism spectrum disorder use case.","authors":"Joseph M Plasek,&nbsp;Li Zhou","doi":"10.1136/bmjhci-2023-100765","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100765","url":null,"abstract":"Two BMJ Health & Care Informatics editors’ choice papers present insights based on case studies from real- world data and machine learning models for clinical risk prediction use cases. Seneviratne et al focus on case management to demonstrate how one might implement their","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/ea/94/bmjhci-2023-100765.PMC10174023.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9471895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measures of socioeconomic advantage are not independent predictors of support for healthcare AI: subgroup analysis of a national Australian survey. 社会经济优势的措施不是支持医疗人工智能的独立预测因素:澳大利亚全国调查的亚组分析。
IF 4.1 Q2 Computer Science Pub Date : 2023-05-01 DOI: 10.1136/bmjhci-2022-100714
Emma Kellie Frost, Pauline O'Shaughnessy, David Steel, Annette Braunack-Mayer, Yves Saint James Aquino, Stacy M Carter

Objectives: Applications of artificial intelligence (AI) have the potential to improve aspects of healthcare. However, studies have shown that healthcare AI algorithms also have the potential to perpetuate existing inequities in healthcare, performing less effectively for marginalised populations. Studies on public attitudes towards AI outside of the healthcare field have tended to show higher levels of support for AI among socioeconomically advantaged groups that are less likely to be sufferers of algorithmic harms. We aimed to examine the sociodemographic predictors of support for scenarios related to healthcare AI.Methods: The Australian Values and Attitudes toward AI survey was conducted in March 2020 to assess Australians' attitudes towards AI in healthcare. An innovative weighting methodology involved weighting a non-probability web-based panel against results from a shorter omnibus survey distributed to a representative sample of Australians. We used multinomial logistic regression to examine the relationship between support for AI and a suite of sociodemographic variables in various healthcare scenarios.Results: Where support for AI was predicted by measures of socioeconomic advantage such as education, household income and Socio-Economic Indexes for Areas index, the same variables were not predictors of support for the healthcare AI scenarios presented. Variables associated with support for healthcare AI included being male, having computer science or programming experience and being aged between 18 and 34 years. Other Australian studies suggest that these groups may have a higher level of perceived familiarity with AI.Conclusion: Our findings suggest that while support for AI in general is predicted by indicators of social advantage, these same indicators do not predict support for healthcare AI.

目标:人工智能(AI)的应用具有改善医疗保健方面的潜力。然而,研究表明,医疗保健人工智能算法也有可能使医疗保健领域现有的不平等现象永久化,对边缘人群的效果较差。关于医疗保健领域以外的公众对人工智能的态度的研究往往表明,社会经济优势群体对人工智能的支持程度更高,这些群体不太可能受到算法危害的影响。我们的目的是研究支持与医疗人工智能相关的场景的社会人口学预测因素。方法:于2020年3月进行“澳大利亚人对人工智能的价值观和态度”调查,评估澳大利亚人对人工智能在医疗保健中的态度。一种创新的加权方法涉及将基于网络的非概率小组与分发给具有代表性的澳大利亚人样本的较短综合调查的结果进行加权。我们使用多项逻辑回归来检验各种医疗方案中对人工智能的支持与一系列社会人口变量之间的关系。结果:虽然对人工智能的支持是通过社会经济优势(如教育、家庭收入和地区社会经济指数)来预测的,但这些变量并不能预测对所提出的医疗人工智能方案的支持。与支持医疗人工智能相关的变量包括男性、具有计算机科学或编程经验、年龄在18至34岁之间。澳大利亚的其他研究表明,这些群体可能对人工智能的熟悉程度更高。结论:我们的研究结果表明,虽然对人工智能的总体支持可以通过社会优势指标来预测,但这些指标并不能预测对医疗保健人工智能的支持。
{"title":"Measures of socioeconomic advantage are not independent predictors of support for healthcare AI: subgroup analysis of a national Australian survey.","authors":"Emma Kellie Frost,&nbsp;Pauline O'Shaughnessy,&nbsp;David Steel,&nbsp;Annette Braunack-Mayer,&nbsp;Yves Saint James Aquino,&nbsp;Stacy M Carter","doi":"10.1136/bmjhci-2022-100714","DOIUrl":"https://doi.org/10.1136/bmjhci-2022-100714","url":null,"abstract":"<p><p><b>Objectives:</b> Applications of artificial intelligence (AI) have the potential to improve aspects of healthcare. However, studies have shown that healthcare AI algorithms also have the potential to perpetuate existing inequities in healthcare, performing less effectively for marginalised populations. Studies on public attitudes towards AI outside of the healthcare field have tended to show higher levels of support for AI among socioeconomically advantaged groups that are less likely to be sufferers of algorithmic harms. We aimed to examine the sociodemographic predictors of support for scenarios related to healthcare AI.<b>Methods:</b> The Australian Values and Attitudes toward AI survey was conducted in March 2020 to assess Australians' attitudes towards AI in healthcare. An innovative weighting methodology involved weighting a non-probability web-based panel against results from a shorter omnibus survey distributed to a representative sample of Australians. We used multinomial logistic regression to examine the relationship between support for AI and a suite of sociodemographic variables in various healthcare scenarios.<b>Results:</b> Where support for AI was predicted by measures of socioeconomic advantage such as education, household income and Socio-Economic Indexes for Areas index, the same variables were not predictors of support for the healthcare AI scenarios presented. Variables associated with support for healthcare AI included being male, having computer science or programming experience and being aged between 18 and 34 years. Other Australian studies suggest that these groups may have a higher level of perceived familiarity with AI.<b>Conclusion:</b> Our findings suggest that while support for AI in general is predicted by indicators of social advantage, these same indicators do not predict support for healthcare AI.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/81/ed/bmjhci-2022-100714.PMC10254623.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9602134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analysis of 'One in a Million' primary care consultation conversations using natural language processing. 使用自然语言处理的“百万分之一”初级保健咨询对话分析。
IF 4.1 Q2 Computer Science Pub Date : 2023-04-01 DOI: 10.1136/bmjhci-2022-100659
Yvette Pyne, Yik Ming Wong, Haishuo Fang, Edwin Simpson

Background: Modern patient electronic health records form a core part of primary care; they contain both clinical codes and free text entered by the clinician. Natural language processing (NLP) could be employed to generate these records through 'listening' to a consultation conversation.

Objectives: This study develops and assesses several text classifiers for identifying clinical codes for primary care consultations based on the doctor-patient conversation. We evaluate the possibility of training classifiers using medical code descriptions, and the benefits of processing transcribed speech from patients as well as doctors. The study also highlights steps for improving future classifiers.

Methods: Using verbatim transcripts of 239 primary care consultation conversations (the 'One in a Million' dataset) and novel additional datasets for distant supervision, we trained NLP classifiers (naïve Bayes, support vector machine, nearest centroid, a conventional BERT classifier and few-shot BERT approaches) to identify the International Classification of Primary Care-2 clinical codes associated with each consultation.

Results: Of all models tested, a fine-tuned BERT classifier was the best performer. Distant supervision improved the model's performance (F1 score over 16 classes) from 0.45 with conventional supervision with 191 labelled transcripts to 0.51. Incorporating patients' speech in addition to clinician's speech increased the BERT classifier's performance from 0.45 to 0.55 F1 (p=0.01, paired bootstrap test).

Conclusions: Our findings demonstrate that NLP classifiers can be trained to identify clinical area(s) being discussed in a primary care consultation from audio transcriptions; this could represent an important step towards a smart digital assistant in the consultation room.

背景:现代患者电子病历是初级保健的核心部分;它们包含临床代码和临床医生输入的免费文本。自然语言处理(NLP)可以通过“聆听”咨询对话来生成这些记录。目的:本研究开发和评估了几个文本分类器,用于识别基于医患对话的初级保健咨询的临床代码。我们评估了使用医疗代码描述训练分类器的可能性,以及处理来自患者和医生的转录语音的好处。该研究还强调了改进未来分类器的步骤。方法:使用239个初级保健咨询对话的逐字记录(“百万分之一”数据集)和用于远程监督的新型额外数据集,我们训练了NLP分类器(naïve贝叶斯、支持向量机、最近质心、传统BERT分类器和几次BERT方法)来识别与每次咨询相关的国际初级保健分类-2临床代码。结果:在所有测试的模型中,经过微调的BERT分类器表现最好。远程监督将模型的性能(超过16个类别的F1分数)从191个标记转录本的常规监督的0.45提高到0.51。除了临床医生的语音外,合并患者的语音使BERT分类器的性能从0.45 F1提高到0.55 F1 (p=0.01,配对引导检验)。结论:我们的研究结果表明,NLP分类器可以通过训练来识别初级保健咨询中讨论的临床领域;这可能是向诊室智能数字助理迈出的重要一步。
{"title":"Analysis of 'One in a Million' primary care consultation conversations using natural language processing.","authors":"Yvette Pyne,&nbsp;Yik Ming Wong,&nbsp;Haishuo Fang,&nbsp;Edwin Simpson","doi":"10.1136/bmjhci-2022-100659","DOIUrl":"https://doi.org/10.1136/bmjhci-2022-100659","url":null,"abstract":"<p><strong>Background: </strong>Modern patient electronic health records form a core part of primary care; they contain both clinical codes and free text entered by the clinician. Natural language processing (NLP) could be employed to generate these records through 'listening' to a consultation conversation.</p><p><strong>Objectives: </strong>This study develops and assesses several text classifiers for identifying clinical codes for primary care consultations based on the doctor-patient conversation. We evaluate the possibility of training classifiers using medical code descriptions, and the benefits of processing transcribed speech from patients as well as doctors. The study also highlights steps for improving future classifiers.</p><p><strong>Methods: </strong>Using verbatim transcripts of 239 primary care consultation conversations (the 'One in a Million' dataset) and novel additional datasets for distant supervision, we trained NLP classifiers (naïve Bayes, support vector machine, nearest centroid, a conventional BERT classifier and few-shot BERT approaches) to identify the International Classification of Primary Care-2 clinical codes associated with each consultation.</p><p><strong>Results: </strong>Of all models tested, a fine-tuned BERT classifier was the best performer. Distant supervision improved the model's performance (F1 score over 16 classes) from 0.45 with conventional supervision with 191 labelled transcripts to 0.51. Incorporating patients' speech in addition to clinician's speech increased the BERT classifier's performance from 0.45 to 0.55 F1 (p=0.01, paired bootstrap test).</p><p><strong>Conclusions: </strong>Our findings demonstrate that NLP classifiers can be trained to identify clinical area(s) being discussed in a primary care consultation from audio transcriptions; this could represent an important step towards a smart digital assistant in the consultation room.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"30 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10151863/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9409976","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
BMJ Health & Care Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1