首页 > 最新文献

BMJ Health & Care Informatics最新文献

英文 中文
Correction: Development of a scoring system to quantify errors from semantic characteristics in incident reports. 纠正:开发一个评分系统,从事件报告的语义特征中量化错误。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-23 DOI: 10.1136/bmjhci-2023-100935.corr1
{"title":"Correction: Development of a scoring system to quantify errors from semantic characteristics in incident reports.","authors":"","doi":"10.1136/bmjhci-2023-100935.corr1","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100935.corr1","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142884984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Wearable equipment-based telemedical management via multiparameter monitoring on cardiovascular outcomes in elderly patients with chronic coronary heart disease: an open-labelled, randomised, controlled trial. 基于可穿戴设备的远程医疗管理,通过多参数监测改善老年慢性冠心病患者的心血管预后:一项开放标签、随机对照试验。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-10 DOI: 10.1136/bmjhci-2024-101135
Tingting Lu, Ruihua Cao, Yujia Wang, Xiaoxuan Kong, Huiquan Wang, Guanghua Sun, Shan Gao, Yabin Wang, Yuan Yuan, Xiaoying Shen, Li Fan, Jun Ren, Feng Cao

Background: The prevalence of chronic coronary heart diseases (CHDs) increases with age in the elderly, which represents one of the top-ranked causes of death and disease burden.

Methods: This study aimed to investigate the management efficiency of telemedicine based on the remote multiparameter monitoring in elderly patients with CHD. A total of 1248 elderly patients diagnosed with CHD were enrolled. The subjects were randomly divided into two groups, wearable equipment-based telemedical management (WTM) group and traditional follow-up management (TFM) group. Face-to-face clinical interview at least once every 2 months was required in TFM group to collect the medical records. Patients in WTM group were provided with wearable equipment to complete remote monitoring, real-time alerts and health intervention via virtual consultations and remote medication recommendations.

Results: The mean age of patients in WTM group and TFM group was 71.1 (68.0-82.0) years and 71.0 (68.0-81.0) years, respectively‏. After a 12-month management, patients in WTM group presented a lower occurrence of hospitalisation (HR 0.59, 95% CI=0.47 to 0.73, p<0.0001) and major adverse cardiac events (HR 0.60, 95% CI=0.44 to 0.82, p=0.0012) compared with patients in TFM group.

Conclusion: The multiparameter telemedical management could help with the out-of-hospital management and reduce the incidence of rehospitalisation in elderly patients with CHD.

背景:慢性冠心病(CHDs)的患病率随着年龄的增长而增加,是老年人死亡和疾病负担的主要原因之一。方法:探讨基于远程多参数监测的远程医疗对老年冠心病患者的管理效果。共纳入1248例诊断为冠心病的老年患者。将受试者随机分为基于可穿戴设备的远程医疗管理(WTM)组和传统随访管理(TFM)组。TFM组至少每2个月进行一次面对面的临床访谈,收集病历。WTM组患者配备可穿戴设备,通过虚拟会诊和远程用药建议完成远程监测、实时报警和健康干预。结果:WTM组和TFM组患者的平均年龄分别为71.1(68.0 ~ 82.0)岁和71.0(68.0 ~ 81.0)岁。经过12个月的管理,WTM组患者住院率较低(HR 0.59, 95% CI=0.47 ~ 0.73)。结论:多参数远程医疗管理有助于老年冠心病患者的院外管理,降低再住院率。
{"title":"Wearable equipment-based telemedical management via multiparameter monitoring on cardiovascular outcomes in elderly patients with chronic coronary heart disease: an open-labelled, randomised, controlled trial.","authors":"Tingting Lu, Ruihua Cao, Yujia Wang, Xiaoxuan Kong, Huiquan Wang, Guanghua Sun, Shan Gao, Yabin Wang, Yuan Yuan, Xiaoying Shen, Li Fan, Jun Ren, Feng Cao","doi":"10.1136/bmjhci-2024-101135","DOIUrl":"10.1136/bmjhci-2024-101135","url":null,"abstract":"<p><strong>Background: </strong>The prevalence of chronic coronary heart diseases (CHDs) increases with age in the elderly, which represents one of the top-ranked causes of death and disease burden.</p><p><strong>Methods: </strong>This study aimed to investigate the management efficiency of telemedicine based on the remote multiparameter monitoring in elderly patients with CHD. A total of 1248 elderly patients diagnosed with CHD were enrolled. The subjects were randomly divided into two groups, wearable equipment-based telemedical management (WTM) group and traditional follow-up management (TFM) group. Face-to-face clinical interview at least once every 2 months was required in TFM group to collect the medical records. Patients in WTM group were provided with wearable equipment to complete remote monitoring, real-time alerts and health intervention via virtual consultations and remote medication recommendations.</p><p><strong>Results: </strong>The mean age of patients in WTM group and TFM group was 71.1 (68.0-82.0) years and 71.0 (68.0-81.0) years, respectively‏. After a 12-month management, patients in WTM group presented a lower occurrence of hospitalisation (HR 0.59, 95% CI=0.47 to 0.73, p<0.0001) and major adverse cardiac events (HR 0.60, 95% CI=0.44 to 0.82, p=0.0012) compared with patients in TFM group.</p><p><strong>Conclusion: </strong>The multiparameter telemedical management could help with the out-of-hospital management and reduce the incidence of rehospitalisation in elderly patients with CHD.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11647296/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142823849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Artificial intelligence after the bedside: co-design of AI-based clinical informatics workflows to routinely analyse patient-reported experience measures in hospitals. 床边后的人工智能:共同设计基于人工智能的临床信息学工作流程,以常规分析医院中患者报告的体验措施。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-09 DOI: 10.1136/bmjhci-2024-101124
Oliver J Canfell, Wilkin Chan, Jason D Pole, Teyl Engstrom, Tim Saul, Jacqueline Daly, Clair Sullivan

Objective: To co-design artificial intelligence (AI)-based clinical informatics workflows to routinely analyse patient-reported experience measures (PREMs) in hospitals.

Methods: The context was public hospitals (n=114) and health services (n=16) in a large state in Australia serving a population of ~5 million. We conducted a participatory action research study with multidisciplinary healthcare professionals, managers, data analysts, consumer representatives and industry professionals (n=16) across three phases: (1) defining the problem, (2) current workflow and co-designing a future workflow and (3) developing proof-of-concept AI-based workflows. Co-designed workflows were deductively mapped to a validated feasibility framework to inform future clinical piloting. Qualitative data underwent inductive thematic analysis.

Results: Between 2020 and 2022 (n=16 health services), 175 282 PREMs inpatient surveys received 23 982 open-ended responses (mean response rate, 13.7%). Existing PREMs workflows were problematic due to overwhelming data volume, analytical limitations, poor integration with health service workflows and inequitable resource distribution. Three potential semiautomated, AI-based (unsupervised machine learning) workflows were developed to address the identified problems: (1) no code (simple reports, no analytics), (2) low code (PowerBI dashboard, descriptive analytics) and (3) high code (Power BI dashboard, descriptive analytics, clinical unit-level interactive reporting).

Discussion: The manual analysis of free-text PREMs data is laborious and difficult at scale. Automating analysis with AI could sharpen the focus on consumer input and accelerate quality improvement cycles in hospitals. Future research should investigate how AI-based workflows impact healthcare quality and safety.

Conclusion: AI-based clinical informatics workflows to routinely analyse free-text PREMs data were co-designed with multidisciplinary end-users and are ready for clinical piloting.

目的:共同设计基于人工智能(AI)的临床信息学工作流程,以常规分析医院的患者报告体验措施(PREMs)。方法:研究对象为澳大利亚某大州的公立医院(n=114)和卫生服务机构(n=16),服务人口约500万。我们与多学科医疗保健专业人员、管理人员、数据分析师、消费者代表和行业专业人员(n=16)进行了一项参与式行动研究,分为三个阶段:(1)定义问题,(2)当前工作流和共同设计未来工作流,(3)开发基于人工智能的概念验证工作流。共同设计的工作流程被演绎映射到一个经过验证的可行性框架,为未来的临床试验提供信息。定性数据进行归纳性专题分析。结果:在2020年至2022年期间(n=16个卫生服务机构),175 282个PREMs住院调查收到23 982个开放式答复(平均回复率为13.7%)。现有PREMs工作流程存在问题,原因是数据量过大、分析受限、与卫生服务工作流程整合不足以及资源分配不公平。开发了三种潜在的半自动化,基于人工智能(无监督机器学习)的工作流程来解决已确定的问题:(1)无代码(简单报告,无分析),(2)低代码(PowerBI仪表板,描述性分析)和(3)高代码(PowerBI仪表板,描述性分析,临床单位级交互式报告)。讨论:自由文本PREMs数据的手工分析在规模上是费力和困难的。使用人工智能进行自动化分析可以使人们更加关注消费者的投入,并加快医院的质量改进周期。未来的研究应该调查基于人工智能的工作流程如何影响医疗质量和安全。结论:基于人工智能的临床信息学工作流程常规分析自由文本PREMs数据是与多学科最终用户共同设计的,并已准备好进行临床试验。
{"title":"Artificial intelligence after the bedside: co-design of AI-based clinical informatics workflows to routinely analyse patient-reported experience measures in hospitals.","authors":"Oliver J Canfell, Wilkin Chan, Jason D Pole, Teyl Engstrom, Tim Saul, Jacqueline Daly, Clair Sullivan","doi":"10.1136/bmjhci-2024-101124","DOIUrl":"10.1136/bmjhci-2024-101124","url":null,"abstract":"<p><strong>Objective: </strong>To co-design artificial intelligence (AI)-based clinical informatics workflows to routinely analyse patient-reported experience measures (PREMs) in hospitals.</p><p><strong>Methods: </strong>The context was public hospitals (n=114) and health services (n=16) in a large state in Australia serving a population of ~5 million. We conducted a participatory action research study with multidisciplinary healthcare professionals, managers, data analysts, consumer representatives and industry professionals (n=16) across three phases: (1) defining the problem, (2) current workflow and co-designing a future workflow and (3) developing proof-of-concept AI-based workflows. Co-designed workflows were deductively mapped to a validated feasibility framework to inform future clinical piloting. Qualitative data underwent inductive thematic analysis.</p><p><strong>Results: </strong>Between 2020 and 2022 (n=16 health services), 175 282 PREMs inpatient surveys received 23 982 open-ended responses (mean response rate, 13.7%). Existing PREMs workflows were problematic due to overwhelming data volume, analytical limitations, poor integration with health service workflows and inequitable resource distribution. Three potential semiautomated, AI-based (unsupervised machine learning) workflows were developed to address the identified problems: (1) no code (simple reports, no analytics), (2) low code (PowerBI dashboard, descriptive analytics) and (3) high code (Power BI dashboard, descriptive analytics, clinical unit-level interactive reporting).</p><p><strong>Discussion: </strong>The manual analysis of free-text PREMs data is laborious and difficult at scale. Automating analysis with AI could sharpen the focus on consumer input and accelerate quality improvement cycles in hospitals. Future research should investigate how AI-based workflows impact healthcare quality and safety.</p><p><strong>Conclusion: </strong>AI-based clinical informatics workflows to routinely analyse free-text PREMs data were co-designed with multidisciplinary end-users and are ready for clinical piloting.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11628959/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142799317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effectiveness of chatbot-based interventions on mental well-being of the general population in Asia: protocol for a systematic review and meta-analysis of randomised controlled trials. 基于聊天机器人的干预对亚洲普通人群心理健康的有效性:随机对照试验的系统回顾和荟萃分析方案。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-07 DOI: 10.1136/bmjhci-2024-101148
Wilson Leung, Simon Ching Lam, Fowie Ng, Calvin Chi Kong Yip, Chi-Keung Chan

Introduction: In Asian countries, stigma against psychiatric disorders and shortage of manpower are the two major challenges that hinder people from receiving treatments. Chatbots can surely help people surpass the stigmatising and manpower shortage challenges. Since a comprehensive review in the Asian context is lacking, this systematic review will evaluate the effects of chatbot interventions on the mental well-being of the general population in Asia.

Methods and analysis: Four electronic databases (PubMed, CINAHL, PsycINFO and MEDLINE) will be searched until December 2024. Randomised controlled trials with English/Chinese full text available will be included. Random-effect models will be used for meta-analyses. The risk of bias (RoB) and certainty of evidence across studies will be assessed using the Cochrane RoB2 and Grading of Recommendation Assessment, Development and Evaluation tools, respectively.

Ethics and dissemination: This study will not require ethical approval. The findings will be disseminated through peer-reviewed publications.

Funding: School Research Grant of the Tung Wah College (2023-04-52-SRG230401) PROSPERO REGISTRATION NUMBER: CRD42024546316.

在亚洲国家,对精神疾病的污名化和人力短缺是阻碍人们接受治疗的两大挑战。聊天机器人肯定可以帮助人们克服污名化和人力短缺的挑战。由于缺乏亚洲背景下的全面审查,本系统审查将评估聊天机器人干预对亚洲普通人群心理健康的影响。方法与分析:检索四个电子数据库(PubMed, CINAHL, PsycINFO和MEDLINE)至2024年12月。纳入随机对照试验,并提供中英文全文。随机效应模型将用于meta分析。各研究的偏倚风险(RoB)和证据确定性将分别使用Cochrane RoB2和分级推荐评估、发展和评估工具进行评估。伦理和传播:本研究不需要伦理批准。研究结果将通过同行评议的出版物进行传播。基金资助:东华书院校级研究资助(2023-04-52-SRG230401)普洛斯普洛斯注册号:CRD42024546316。
{"title":"Effectiveness of chatbot-based interventions on mental well-being of the general population in Asia: protocol for a systematic review and meta-analysis of randomised controlled trials.","authors":"Wilson Leung, Simon Ching Lam, Fowie Ng, Calvin Chi Kong Yip, Chi-Keung Chan","doi":"10.1136/bmjhci-2024-101148","DOIUrl":"10.1136/bmjhci-2024-101148","url":null,"abstract":"<p><strong>Introduction: </strong>In Asian countries, stigma against psychiatric disorders and shortage of manpower are the two major challenges that hinder people from receiving treatments. Chatbots can surely help people surpass the stigmatising and manpower shortage challenges. Since a comprehensive review in the Asian context is lacking, this systematic review will evaluate the effects of chatbot interventions on the mental well-being of the general population in Asia.</p><p><strong>Methods and analysis: </strong>Four electronic databases (PubMed, CINAHL, PsycINFO and MEDLINE) will be searched until December 2024. Randomised controlled trials with English/Chinese full text available will be included. Random-effect models will be used for meta-analyses. The risk of bias (RoB) and certainty of evidence across studies will be assessed using the Cochrane RoB2 and Grading of Recommendation Assessment, Development and Evaluation tools, respectively.</p><p><strong>Ethics and dissemination: </strong>This study will not require ethical approval. The findings will be disseminated through peer-reviewed publications.</p><p><strong>Funding: </strong>School Research Grant of the Tung Wah College (2023-04-52-SRG230401) PROSPERO REGISTRATION NUMBER: CRD42024546316.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11628986/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142791087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accuracy of radiologists and radiology residents in detection of paediatric appendicular fractures with and without artificial intelligence. 使用和不使用人工智能的放射科医师和住院医师检测小儿阑尾骨折的准确性。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-05 DOI: 10.1136/bmjhci-2024-101091
Praveen M Yogendra, Adriel Guang Wei Goh, Sze Ying Yee, Freda Jawan, Kelvin Kay Nguan Koh, Timothy Shao Ern Tan, Tian Kai Woon, Phey Ming Yeap, Min On Tan

Objectives: We aim to evaluate the accuracy of radiologists and radiology residents in the detection of paediatric appendicular fractures with and without the help of a commercially available fracture detection artificial intelligence (AI) solution in the hopes of showing potential clinical benefits in a general hospital setting.

Methods: This was a retrospective study involving three associate consultants (AC) and three senior residents (SR) in radiology, who acted as readers. One reader from each human group interpreted the radiographs with the aid of AI. Cases were categorised into concordant and discordant cases between each interpreting group. Discordant cases were further evaluated by three independent subspecialty radiology consultants to determine the final diagnosis. A total of 500 anonymised paediatric patient cases (aged 2-15 years) who presented to a tertiary general hospital with a Children's emergency were retrospectively collected. Main outcome measures include the presence of fracture, accuracy of readers with and without AI, and total time taken to interpret the radiographs.

Results: The AI solution alone showed the highest accuracy (area under the receiver operating characteristic curve 0.97; AC: 95% CI -0.055 to 0.320, p=0; SR: 95% CI 0.244 to 0.598, p=0). The two readers aided with AI had higher area under curves compared with readers without AI support (AC: 95% CI -0.303 to 0.465, p=0; SR: 95% CI -0.154 to 0.331, p=0). These differences were statistically significant.

Conclusion: Our study demonstrates excellent results in the detection of paediatric appendicular fractures using a commercially available AI solution. There is potential for the AI solution to function autonomously.

目的:我们旨在评估放射科医生和放射科住院医师在使用和不使用市售骨折检测人工智能(AI)解决方案的情况下检测儿科阑尾骨折的准确性,以期在综合医院环境中显示潜在的临床效益。方法:本研究是一项回顾性研究,涉及三名放射学副顾问(AC)和三名高级住院医师(SR),他们作为读者。每组一名读者在人工智能的帮助下解读x光片。在每个口译组之间将案例分为和谐案例和不和谐案例。不一致的病例由三位独立的亚专科放射学顾问进一步评估,以确定最终诊断。回顾性收集了一家三级综合医院因儿童急诊就诊的500例匿名儿童患者(2-15岁)。主要的结果测量包括骨折的存在,使用和不使用人工智能阅读器的准确性,以及解释x线片所花费的总时间。结果:单独使用人工智能溶液准确度最高(受试者工作特征曲线下面积0.97;AC: 95% CI -0.055 ~ 0.320, p=0;SR: 95% CI 0.244 ~ 0.598, p=0)。与没有人工智能支持的读者相比,有人工智能辅助的两名读者的曲线下面积更高(AC: 95% CI -0.303至0.465,p=0;SR: 95% CI -0.154 ~ 0.331, p=0)。这些差异具有统计学意义。结论:我们的研究表明,使用市售的人工智能解决方案在检测儿科阑尾骨折方面取得了良好的效果。人工智能解决方案有可能实现自主功能。
{"title":"Accuracy of radiologists and radiology residents in detection of paediatric appendicular fractures with and without artificial intelligence.","authors":"Praveen M Yogendra, Adriel Guang Wei Goh, Sze Ying Yee, Freda Jawan, Kelvin Kay Nguan Koh, Timothy Shao Ern Tan, Tian Kai Woon, Phey Ming Yeap, Min On Tan","doi":"10.1136/bmjhci-2024-101091","DOIUrl":"10.1136/bmjhci-2024-101091","url":null,"abstract":"<p><strong>Objectives: </strong>We aim to evaluate the accuracy of radiologists and radiology residents in the detection of paediatric appendicular fractures with and without the help of a commercially available fracture detection artificial intelligence (AI) solution in the hopes of showing potential clinical benefits in a general hospital setting.</p><p><strong>Methods: </strong>This was a retrospective study involving three associate consultants (AC) and three senior residents (SR) in radiology, who acted as readers. One reader from each human group interpreted the radiographs with the aid of AI. Cases were categorised into concordant and discordant cases between each interpreting group. Discordant cases were further evaluated by three independent subspecialty radiology consultants to determine the final diagnosis. A total of 500 anonymised paediatric patient cases (aged 2-15 years) who presented to a tertiary general hospital with a Children's emergency were retrospectively collected. Main outcome measures include the presence of fracture, accuracy of readers with and without AI, and total time taken to interpret the radiographs.</p><p><strong>Results: </strong>The AI solution alone showed the highest accuracy (area under the receiver operating characteristic curve 0.97; AC: 95% CI -0.055 to 0.320, p=0; SR: 95% CI 0.244 to 0.598, p=0). The two readers aided with AI had higher area under curves compared with readers without AI support (AC: 95% CI -0.303 to 0.465, p=0; SR: 95% CI -0.154 to 0.331, p=0). These differences were statistically significant.</p><p><strong>Conclusion: </strong>Our study demonstrates excellent results in the detection of paediatric appendicular fractures using a commercially available AI solution. There is potential for the AI solution to function autonomously.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624698/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142784004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strategies for creation of data reserve and stress testing of medical AI products. 医疗人工智能产品数据储备创建和压力测试策略。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-04 DOI: 10.1136/bmjhci-2024-101184
Huai Chen, Yanmei Tie, Xinhua Cao, Geoffrey S Young, Xiaoyin Xu

With the fast development of artificial intelligence (AI) and its applications in medicine, it is often said that the time for intelligent medicine is arriving, if not already have arrived. While there is no doubt that AI-centred intelligent medicine will transform current healthcare, it is necessary to test and re-test medical AI (MAI) products before they are implemented in the real world. From the perspective of ensuring safety, accuracy and efficiency, it is imperative that MAIs undergo stress tests in a systematic and comprehensive manner where stress tests subject MAIs to workloads and environments beyond tests carried out by their developers. In such stress tests, potential bottlenecks or failures of MAIs may be identified and fed back to developers to optimise the products. To avoid bias and ensure fairness, stress tests should be prepared and administered by an independent body.

随着人工智能(AI)的快速发展及其在医学上的应用,人们常说智能医学的时代即将到来,如果不是已经到来的话。毫无疑问,以人工智能为中心的智能医疗将改变当前的医疗保健,但在将医疗人工智能(MAI)产品应用于现实世界之前,有必要对其进行测试和重新测试。从确保安全性、准确性和效率的角度来看,必须以系统和全面的方式对MAIs进行压力测试,其中压力测试将MAIs置于其开发人员进行的测试之外的工作负载和环境中。在这种压力测试中,可以识别MAIs的潜在瓶颈或故障,并将其反馈给开发人员以优化产品。为避免偏见并确保公平,压力测试应由独立机构准备和管理。
{"title":"Strategies for creation of data reserve and stress testing of medical AI products.","authors":"Huai Chen, Yanmei Tie, Xinhua Cao, Geoffrey S Young, Xiaoyin Xu","doi":"10.1136/bmjhci-2024-101184","DOIUrl":"10.1136/bmjhci-2024-101184","url":null,"abstract":"<p><p>With the fast development of artificial intelligence (AI) and its applications in medicine, it is often said that the time for intelligent medicine is arriving, if not already have arrived. While there is no doubt that AI-centred intelligent medicine will transform current healthcare, it is necessary to test and re-test medical AI (MAI) products before they are implemented in the real world. From the perspective of ensuring safety, accuracy and efficiency, it is imperative that MAIs undergo stress tests in a systematic and comprehensive manner where stress tests subject MAIs to workloads and environments beyond tests carried out by their developers. In such stress tests, potential bottlenecks or failures of MAIs may be identified and fed back to developers to optimise the products. To avoid bias and ensure fairness, stress tests should be prepared and administered by an independent body.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624794/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142779256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance of machine learning versus the national early warning score for predicting patient deterioration risk: a single-site study of emergency admissions. 机器学习性能与预测患者恶化风险的国家预警评分:一项急诊入院的单点研究。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-12-04 DOI: 10.1136/bmjhci-2024-101088
Matthew Watson, Stelios Boulitsakis Logothetis, Darren Green, Mark Holland, Pinkie Chambers, Noura Al Moubayed

Objectives: Increasing operational pressures on emergency departments (ED) make it imperative to quickly and accurately identify patients requiring urgent clinical intervention. The widespread adoption of electronic health records (EHR) makes rich feature patient data sets more readily available. These large data stores lend themselves to use in modern machine learning (ML) models. This paper investigates the use of transformer-based models to identify critical deterioration in unplanned ED admissions, using free-text fields, such as triage notes, and tabular data, including early warning scores (EWS).

Design: A retrospective ML study.

Setting: A large ED in a UK university teaching hospital.

Methods: We extracted rich feature sets of routine clinical data from the EHR and systematically measured the performance of tree- and transformer-based models for predicting patient mortality or admission to critical care within 24 hours of presentation to ED. We compared our proposed models to the National EWS (NEWS).

Results: Models were trained on 174 393 admission records. We found that models including free-text triage notes outperform structured tabular data models, achieving an average precision of 0.92, compared with 0.75 for tree-based models and 0.12 for NEWS.

Conclusions: Our findings suggests that machine learning models using free-text data have the potential to improve clinical decision-making in the ED; our techniques significantly reduce alert rate while detecting most high-risk patients missed by NEWS.

目的:急诊科(ED)日益增加的业务压力使得快速准确地识别需要紧急临床干预的患者势在必行。电子健康记录(EHR)的广泛采用使丰富的特征患者数据集更容易获得。这些大型数据存储可以用于现代机器学习(ML)模型。本文研究了使用基于变压器的模型来识别计划外急诊科入院的严重恶化,使用自由文本字段,如分类说明和表格数据,包括早期预警评分(EWS)。设计:回顾性ML研究。环境:英国大学教学医院的大型急诊科。方法:我们从EHR中提取了丰富的常规临床数据特征集,并系统地测量了基于树和变压器的模型的性能,用于预测患者在ED就诊后24小时内的死亡率或重症监护入院。我们将我们提出的模型与国家EWS (NEWS)进行了比较。结果:对174 393份入院记录进行了模型训练。我们发现,包含自由文本分类说明的模型优于结构化表格数据模型,平均精度为0.92,而基于树的模型为0.75,NEWS为0.12。结论:我们的研究结果表明,使用自由文本数据的机器学习模型有可能改善急诊科的临床决策;我们的技术显著降低了警觉率,同时发现了NEWS遗漏的大多数高危患者。
{"title":"Performance of machine learning versus the national early warning score for predicting patient deterioration risk: a single-site study of emergency admissions.","authors":"Matthew Watson, Stelios Boulitsakis Logothetis, Darren Green, Mark Holland, Pinkie Chambers, Noura Al Moubayed","doi":"10.1136/bmjhci-2024-101088","DOIUrl":"10.1136/bmjhci-2024-101088","url":null,"abstract":"<p><strong>Objectives: </strong>Increasing operational pressures on emergency departments (ED) make it imperative to quickly and accurately identify patients requiring urgent clinical intervention. The widespread adoption of electronic health records (EHR) makes rich feature patient data sets more readily available. These large data stores lend themselves to use in modern machine learning (ML) models. This paper investigates the use of transformer-based models to identify critical deterioration in unplanned ED admissions, using free-text fields, such as triage notes, and tabular data, including early warning scores (EWS).</p><p><strong>Design: </strong>A retrospective ML study.</p><p><strong>Setting: </strong>A large ED in a UK university teaching hospital.</p><p><strong>Methods: </strong>We extracted rich feature sets of routine clinical data from the EHR and systematically measured the performance of tree- and transformer-based models for predicting patient mortality or admission to critical care within 24 hours of presentation to ED. We compared our proposed models to the National EWS (NEWS).</p><p><strong>Results: </strong>Models were trained on 174 393 admission records. We found that models including free-text triage notes outperform structured tabular data models, achieving an average precision of 0.92, compared with 0.75 for tree-based models and 0.12 for NEWS.</p><p><strong>Conclusions: </strong>Our findings suggests that machine learning models using free-text data have the potential to improve clinical decision-making in the ED; our techniques significantly reduce alert rate while detecting most high-risk patients missed by NEWS.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624723/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142779253","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Scaling equitable artificial intelligence in healthcare with machine learning operations. 利用机器学习操作,在医疗保健领域推广公平的人工智能。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-11-04 DOI: 10.1136/bmjhci-2024-101101
Madelena Y Ng, Alexey Youssef, Malvika Pillai, Vaibhavi Shah, Tina Hernandez-Boussard
{"title":"Scaling equitable artificial intelligence in healthcare with machine learning operations.","authors":"Madelena Y Ng, Alexey Youssef, Malvika Pillai, Vaibhavi Shah, Tina Hernandez-Boussard","doi":"10.1136/bmjhci-2024-101101","DOIUrl":"10.1136/bmjhci-2024-101101","url":null,"abstract":"","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11535661/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142574867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding prescribing errors for system optimisation: the technology-related error mechanism classification. 了解处方错误以优化系统:与技术相关的错误机制分类。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-11-02 DOI: 10.1136/bmjhci-2023-100974
Magdalena Z Raban, Alison Merchant, Erin Fitzpatrick, Melissa T Baysari, Ling Li, Peter Gates, Johanna I Westbrook

Objectives: Technology-related prescribing errors curtail the positive impacts of computerised provider order entry (CPOE) on medication safety. Understanding how technology-related errors (TREs) occur can inform CPOE optimisation. Previously, we developed a classification of the underlying mechanisms of TREs using prescribing error data from two adult hospitals. Our objective was to update the classification using paediatric prescribing error data and to assess the reliability with which reviewers could independently apply the classification.

Materials and methods: Using data on 1696 prescribing errors identified by chart review in 2016 and 2017 at a tertiary paediatric hospital, we identified errors that were technology-related. These errors were investigated to classify their underlying mechanisms using our previously developed classification, and new categories were added based on the data. A two-step process was used to identify and classify TREs involving a review of the error in the CPOE and simulating the error in the CPOE testing environment.

Results: The technology-related error mechanism (TREM) classification comprises six mechanism categories, one contributing factor and 19 subcategories. The categories are as follows: (1) incorrect system configuration or system malfunction, (2) opening or using the wrong patient record, (3) selection errors, (4) construction errors, (5) editing errors, (6) errors that occur when using workflows that differ from a paper-based system (7) contributing factor: use of hybrid systems.

Conclusion: TREs remain a critical issue for CPOE. The updated TREM classification provides a systematic means of assessing and monitoring TREs to inform and prioritise system improvements and has now been updated for the paediatric setting.

目标:与技术相关的处方错误会削弱计算机化医嘱输入 (CPOE) 对用药安全的积极影响。了解与技术相关的错误 (TRE) 是如何发生的,可以为 CPOE 的优化提供依据。此前,我们利用两家成人医院的处方错误数据,对 TRE 的基本机制进行了分类。我们的目标是利用儿科处方错误数据更新该分类,并评估审查员独立应用该分类的可靠性:利用一家三级儿科医院 2016 年和 2017 年通过病历审查发现的 1696 例处方错误数据,我们确定了与技术相关的错误。我们对这些错误进行了调查,并使用之前开发的分类方法对其基本机制进行了分类,还根据数据增加了新的类别。对技术相关错误的识别和分类采用了两步法,包括审查 CPOE 中的错误和在 CPOE 测试环境中模拟错误:技术相关错误机制(TREM)分类包括六个机制类别、一个促成因素和 19 个子类别。这些类别如下(1) 错误的系统配置或系统故障,(2) 打开或使用错误的病历,(3) 选择错误,(4) 构建错误,(5) 编辑错误,(6) 使用不同于纸质系统的工作流程时发生的错误,(7) 促成因素:使用混合系统:TRE 仍是 CPOE 的一个关键问题。更新后的 TREM 分类提供了评估和监控 TRE 的系统方法,可为系统改进提供信息并确定优先次序,现在已针对儿科环境进行了更新。
{"title":"Understanding prescribing errors for system optimisation: the technology-related error mechanism classification.","authors":"Magdalena Z Raban, Alison Merchant, Erin Fitzpatrick, Melissa T Baysari, Ling Li, Peter Gates, Johanna I Westbrook","doi":"10.1136/bmjhci-2023-100974","DOIUrl":"10.1136/bmjhci-2023-100974","url":null,"abstract":"<p><strong>Objectives: </strong>Technology-related prescribing errors curtail the positive impacts of computerised provider order entry (CPOE) on medication safety. Understanding how technology-related errors (TREs) occur can inform CPOE optimisation. Previously, we developed a classification of the underlying mechanisms of TREs using prescribing error data from two adult hospitals. Our objective was to update the classification using paediatric prescribing error data and to assess the reliability with which reviewers could independently apply the classification.</p><p><strong>Materials and methods: </strong>Using data on 1696 prescribing errors identified by chart review in 2016 and 2017 at a tertiary paediatric hospital, we identified errors that were technology-related. These errors were investigated to classify their underlying mechanisms using our previously developed classification, and new categories were added based on the data. A two-step process was used to identify and classify TREs involving a review of the error in the CPOE and simulating the error in the CPOE testing environment.</p><p><strong>Results: </strong>The technology-related error mechanism (TREM) classification comprises six mechanism categories, one contributing factor and 19 subcategories. The categories are as follows: (1) incorrect system configuration or system malfunction, (2) opening or using the wrong patient record, (3) selection errors, (4) construction errors, (5) editing errors, (6) errors that occur when using workflows that differ from a paper-based system (7) contributing factor: use of hybrid systems.</p><p><strong>Conclusion: </strong>TREs remain a critical issue for CPOE. The updated TREM classification provides a systematic means of assessing and monitoring TREs to inform and prioritise system improvements and has now been updated for the paediatric setting.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11535662/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142563912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Detection of hypertension from pharyngeal images using deep learning algorithm in primary care settings in Japan. 日本基层医疗机构利用深度学习算法从咽部图像检测高血压。
IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-10-23 DOI: 10.1136/bmjhci-2023-100824
Hiroshi Yoshihara, Yusuke Tsugawa, Memori Fukuda, Sho Okiyama, Takeo Nakayama

Background: The early detection of hypertension using simple visual images in a way that does not require physical interaction or additional devices may improve quality of care in the era of telemedicine. Pharyngeal images include vascular morphological information and may therefore be useful for identifying hypertension.

Objectives: This study sought to develop a deep learning-based artificial intelligence algorithm for identifying hypertension from pharyngeal images.

Methods: We conducted a secondary analysis of data from a clinical trial, in which demographic information, vital signs and pharyngeal images were obtained from patients with influenza-like symptoms in multiple primary care clinics in Japan. A deep learning-based algorithm that included a multi-instance convolutional neural network was trained to detect hypertension from pharyngeal images and demographic information. The classification performance was measured by area under the receiver operating characteristic curve. Importance heatmaps of the convolutional neural network were also examined to interpret the algorithm.

Results: This study included 7710 patients from 64 clinics. The training dataset comprised 6171 patients from 51 clinics (460 positive cases), and the test dataset comprised 1539 patients from 13 clinics (130 positive cases). Our algorithm achieved an area under the receiver operating characteristic curve of 0.922 (95% CI, 0.904 to 0.940), significantly improving over the baseline prediction model incorporating only demographic information, which scored 0.887 (95% CI, 0.862 to 0.911). Our algorithm had consistent classification performance across all age and sex subgroups. Importance heatmaps revealed that the algorithm focused on the posterior pharyngeal wall area, where blood vessels are mainly located.

Conclusions: The results indicate that a deep learning-based algorithm can detect hypertension with high accuracy using pharyngeal images.

背景:在远程医疗时代,利用简单的视觉图像进行高血压的早期检测,无需身体互动或额外设备,可提高医疗质量。咽部图像包括血管形态信息,因此可能有助于识别高血压:本研究试图开发一种基于深度学习的人工智能算法,用于从咽部图像中识别高血压:我们对一项临床试验的数据进行了二次分析,该试验从日本多家初级保健诊所的流感样症状患者那里获得了人口统计学信息、生命体征和咽部图像。我们训练了一种基于深度学习的算法,其中包括一个多实例卷积神经网络,用于从咽部图像和人口统计学信息中检测高血压。分类性能通过接收者工作特征曲线下面积进行测量。此外,还研究了卷积神经网络的重要性热图,以解释该算法:这项研究包括来自 64 家诊所的 7710 名患者。训练数据集包括 51 家诊所的 6171 名患者(460 个阳性病例),测试数据集包括 13 家诊所的 1539 名患者(130 个阳性病例)。我们的算法的接收者操作特征曲线下面积为 0.922(95% CI,0.904 至 0.940),明显优于仅包含人口统计学信息的基线预测模型,后者的得分为 0.887(95% CI,0.862 至 0.911)。在所有年龄和性别分组中,我们的算法都具有一致的分类性能。重要性热图显示,该算法侧重于咽后壁区域,而血管主要位于该区域:结果表明,基于深度学习的算法可以利用咽部图像高精度地检测出高血压。
{"title":"Detection of hypertension from pharyngeal images using deep learning algorithm in primary care settings in Japan.","authors":"Hiroshi Yoshihara, Yusuke Tsugawa, Memori Fukuda, Sho Okiyama, Takeo Nakayama","doi":"10.1136/bmjhci-2023-100824","DOIUrl":"https://doi.org/10.1136/bmjhci-2023-100824","url":null,"abstract":"<p><strong>Background: </strong>The early detection of hypertension using simple visual images in a way that does not require physical interaction or additional devices may improve quality of care in the era of telemedicine. Pharyngeal images include vascular morphological information and may therefore be useful for identifying hypertension.</p><p><strong>Objectives: </strong>This study sought to develop a deep learning-based artificial intelligence algorithm for identifying hypertension from pharyngeal images.</p><p><strong>Methods: </strong>We conducted a secondary analysis of data from a clinical trial, in which demographic information, vital signs and pharyngeal images were obtained from patients with influenza-like symptoms in multiple primary care clinics in Japan. A deep learning-based algorithm that included a multi-instance convolutional neural network was trained to detect hypertension from pharyngeal images and demographic information. The classification performance was measured by area under the receiver operating characteristic curve. Importance heatmaps of the convolutional neural network were also examined to interpret the algorithm.</p><p><strong>Results: </strong>This study included 7710 patients from 64 clinics. The training dataset comprised 6171 patients from 51 clinics (460 positive cases), and the test dataset comprised 1539 patients from 13 clinics (130 positive cases). Our algorithm achieved an area under the receiver operating characteristic curve of 0.922 (95% CI, 0.904 to 0.940), significantly improving over the baseline prediction model incorporating only demographic information, which scored 0.887 (95% CI, 0.862 to 0.911). Our algorithm had consistent classification performance across all age and sex subgroups. Importance heatmaps revealed that the algorithm focused on the posterior pharyngeal wall area, where blood vessels are mainly located.</p><p><strong>Conclusions: </strong>The results indicate that a deep learning-based algorithm can detect hypertension with high accuracy using pharyngeal images.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"31 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11499848/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142494834","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
BMJ Health & Care Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1