首页 > 最新文献

Mayo Clinic Proceedings. Digital health最新文献

英文 中文
Developing a Research Center for Artificial Intelligence in Medicine
Pub Date : 2024-12-01 DOI: 10.1016/j.mcpdig.2024.07.005
Curtis P. Langlotz MD, PhD , Johanna Kim MPH, MBA , Nigam Shah MBBS, PhD , Matthew P. Lungren MD, MPH , David B. Larson MD, MBA , Somalee Datta PhD , Fei Fei Li PhD , Ruth O’Hara PhD , Thomas J. Montine MD, PhD , Robert A. Harrington MD , Garry E. Gold MD, MS
Artificial intelligence (AI) and machine learning (ML) are driving innovation in biosciences and are already affecting key elements of medical scholarship and clinical care. Many schools of medicine are capitalizing on the promise of these new technologies by establishing academic units to catalyze and grow research and innovation in AI/ML. At Stanford University, we have developed a successful model for an AI/ML research center with support from academic leaders, clinical departments, extramural grants, and industry partners. The Center for Artificial Intelligence in Medicine and Imaging uses the following 4 key tactics to support AI/ML research: project-based learning opportunities that build interdisciplinary collaboration; internal grant programs that catalyze extramural funding; infrastructure that facilitates the rapid creation of large multimodal AI-ready clinical data sets; and educational and open data programs that engage the broader research community. The center is based on the premise that foundational and applied research are not in tension but instead are complementary. Solving important biomedical problems with AI/ML requires high-quality foundational team science that incorporates the knowledge and expertise of clinicians, clinician scientists, computer scientists, and data scientists. As AI/ML becomes an essential component of research and clinical care, multidisciplinary centers of excellence in AI/ML will become a key part of the scholarly portfolio of academic medical centers and will provide a foundation for the responsible, ethical, and fair implementation of AI/ML systems.
{"title":"Developing a Research Center for Artificial Intelligence in Medicine","authors":"Curtis P. Langlotz MD, PhD ,&nbsp;Johanna Kim MPH, MBA ,&nbsp;Nigam Shah MBBS, PhD ,&nbsp;Matthew P. Lungren MD, MPH ,&nbsp;David B. Larson MD, MBA ,&nbsp;Somalee Datta PhD ,&nbsp;Fei Fei Li PhD ,&nbsp;Ruth O’Hara PhD ,&nbsp;Thomas J. Montine MD, PhD ,&nbsp;Robert A. Harrington MD ,&nbsp;Garry E. Gold MD, MS","doi":"10.1016/j.mcpdig.2024.07.005","DOIUrl":"10.1016/j.mcpdig.2024.07.005","url":null,"abstract":"<div><div>Artificial intelligence (AI) and machine learning (ML) are driving innovation in biosciences and are already affecting key elements of medical scholarship and clinical care. Many schools of medicine are capitalizing on the promise of these new technologies by establishing academic units to catalyze and grow research and innovation in AI/ML. At Stanford University, we have developed a successful model for an AI/ML research center with support from academic leaders, clinical departments, extramural grants, and industry partners. The Center for Artificial Intelligence in Medicine and Imaging uses the following 4 key tactics to support AI/ML research: project-based learning opportunities that build interdisciplinary collaboration; internal grant programs that catalyze extramural funding; infrastructure that facilitates the rapid creation of large multimodal AI-ready clinical data sets; and educational and open data programs that engage the broader research community. The center is based on the premise that foundational and applied research are not in tension but instead are complementary. Solving important biomedical problems with AI/ML requires high-quality foundational team science that incorporates the knowledge and expertise of clinicians, clinician scientists, computer scientists, and data scientists. As AI/ML becomes an essential component of research and clinical care, multidisciplinary centers of excellence in AI/ML will become a key part of the scholarly portfolio of academic medical centers and will provide a foundation for the responsible, ethical, and fair implementation of AI/ML systems.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 677-686"},"PeriodicalIF":0.0,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142744031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strategic Considerations for Selecting Artificial Intelligence Solutions for Institutional Integration: A Single-Center Experience 为机构整合选择人工智能解决方案的战略考虑因素:单个中心的经验
Pub Date : 2024-11-05 DOI: 10.1016/j.mcpdig.2024.10.004
Janice L. Pascoe BRMP , Luqing Lu MS , Matthew M. Moore MFA , Daniel J. Blezek PhD , Annie E. Ovalle BS , Jane A. Linderbaum APRN, CNP , Matthew R. Callstrom MD, PhD , Eric E. Williamson MD
Artificial intelligence (AI) promises to revolutionize health care. Early identification of disease, appropriate test selection, and automation of repetitive tasks are expected to optimize cost-effective care delivery. However, pragmatic selection and integration of AI algorithms to enable this transformation remain challenging. Health care leaders must navigate complex decisions regarding AI deployment, considering factors such as cost of implementation, benefits to patients and providers, and institutional readiness for adoption. A successful strategy needs to align AI adoption with institutional priorities, select appropriate algorithms to be purchased or internally developed, and ensure adequate support and infrastructure. Further, successful deployment requires algorithm validation and workflow integration to ensure efficacy and usability. User-centric design principles and usability testing are critical for AI adoption, ensuring seamless integration into clinical workflows. Once deployed, continuous improvement processes and ongoing algorithm support ensure continuous benefits to the clinical practice. Vigilant planning and execution are necessary to navigate the complexities of AI implementation in the health care environment. By applying the framework outlined in this article, institutions can navigate the ever-evolving and complex environment of AI in health care to maximize the benefits of these innovative technologies.
人工智能(AI)有望彻底改变医疗保健。疾病的早期识别、适当的测试选择以及重复性任务的自动化有望优化具有成本效益的医疗服务。然而,如何务实地选择和整合人工智能算法以实现这一变革仍然充满挑战。医疗保健领导者必须在人工智能部署方面做出复杂的决策,考虑实施成本、对患者和医疗服务提供者的益处以及机构对采用人工智能的准备程度等因素。成功的战略需要将人工智能的采用与机构的优先事项相结合,选择合适的算法进行购买或内部开发,并确保有足够的支持和基础设施。此外,成功的部署需要算法验证和工作流程整合,以确保有效性和可用性。以用户为中心的设计原则和可用性测试对采用人工智能至关重要,可确保无缝集成到临床工作流程中。一旦部署,持续改进流程和不断的算法支持可确保临床实践持续获益。要在复杂的医疗环境中实施人工智能,就必须进行严密的规划和执行。通过应用本文概述的框架,医疗机构可以驾驭人工智能在医疗保健领域不断发展的复杂环境,最大限度地发挥这些创新技术的优势。
{"title":"Strategic Considerations for Selecting Artificial Intelligence Solutions for Institutional Integration: A Single-Center Experience","authors":"Janice L. Pascoe BRMP ,&nbsp;Luqing Lu MS ,&nbsp;Matthew M. Moore MFA ,&nbsp;Daniel J. Blezek PhD ,&nbsp;Annie E. Ovalle BS ,&nbsp;Jane A. Linderbaum APRN, CNP ,&nbsp;Matthew R. Callstrom MD, PhD ,&nbsp;Eric E. Williamson MD","doi":"10.1016/j.mcpdig.2024.10.004","DOIUrl":"10.1016/j.mcpdig.2024.10.004","url":null,"abstract":"<div><div>Artificial intelligence (AI) promises to revolutionize health care. Early identification of disease, appropriate test selection, and automation of repetitive tasks are expected to optimize cost-effective care delivery. However, pragmatic selection and integration of AI algorithms to enable this transformation remain challenging. Health care leaders must navigate complex decisions regarding AI deployment, considering factors such as cost of implementation, benefits to patients and providers, and institutional readiness for adoption. A successful strategy needs to align AI adoption with institutional priorities, select appropriate algorithms to be purchased or internally developed, and ensure adequate support and infrastructure. Further, successful deployment requires algorithm validation and workflow integration to ensure efficacy and usability. User-centric design principles and usability testing are critical for AI adoption, ensuring seamless integration into clinical workflows. Once deployed, continuous improvement processes and ongoing algorithm support ensure continuous benefits to the clinical practice. Vigilant planning and execution are necessary to navigate the complexities of AI implementation in the health care environment. By applying the framework outlined in this article, institutions can navigate the ever-evolving and complex environment of AI in health care to maximize the benefits of these innovative technologies.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 665-676"},"PeriodicalIF":0.0,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142721288","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reviewers for Mayo Clinic Proceedings: Digital Health (2024) 梅奥诊所论文集》审稿人:数字健康(2024)
Pub Date : 2024-10-31 DOI: 10.1016/j.mcpdig.2024.10.005
{"title":"Reviewers for Mayo Clinic Proceedings: Digital Health (2024)","authors":"","doi":"10.1016/j.mcpdig.2024.10.005","DOIUrl":"10.1016/j.mcpdig.2024.10.005","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 645-646"},"PeriodicalIF":0.0,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142704497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Blueprint for Clinical-Driven Medical Device Development: The Feverkidstool Application to Identify Children With Serious Bacterial Infection 临床驱动的医疗设备开发蓝图:识别严重细菌感染儿童的 Feverkidstool 应用程序
Pub Date : 2024-10-30 DOI: 10.1016/j.mcpdig.2024.10.003
Evelien B. van Kempen MD , Sanne E.W. Vrijlandt MD , Kelly van der Geest MSc , Sophie Lotgering MSc , Tom A. Hueting PhD , Rianne Oostenbrink MD, PhD
Clinical decision rules (CDRs) integrated into applications enhance diagnostic and treatment prediction support for clinicians, necessitating Confirmité Europeenne (CE)-mark certification to enter the European market. We describe the development of a CDR as a medical device, focusing on challenges from a physician’s perspective exemplified by the Feverkidstool (FKT), a validated CDR for febrile children. We pursued a local process, aligned with the CE-marking process, to develop the FKT as in-house developed device. We aimed to provide a blueprint for colleagues. Medical device development, conforming the medical device regulation and performed by a multidisciplinary team, encompassed 5 stages: market scan, design, production, verification and validation and conformity assessment. Regulatory processes were continuously updated. The market scan identified a need for the FKT compared with existing applications. A prototype was designed in stage 2, further adjusted and improved based on the qualitative and quantitative results of stages 2-4. Lastly, stage 5 confirmed FKT’s performance and safety. Medical device development presents challenges for physicians, requiring collaboration for technical, regulatory, and financial expertise. Multidisciplinary teamwork also poses challenges, including uncertainties regarding responsibility and timelines. After CE certification, adapting to evolving needs and ensuring data privacy highlights the ongoing nature of medical device development.
集成到应用程序中的临床决策规则(CDR)为临床医生提供了更多诊断和治疗预测支持,因此必须获得欧洲认证(CE)标志认证才能进入欧洲市场。我们介绍了作为医疗设备的 CDR 的开发过程,重点从医生的角度分析了 Feverkidstool (FKT) 所面临的挑战,FKT 是经过验证的发热儿童 CDR。我们采用了与 CE 标识流程相一致的本地流程,将 FKT 开发为自主研发的设备。我们的目标是为同行提供一个蓝图。医疗器械开发符合医疗器械法规,由一个多学科团队完成,包括 5 个阶段:市场扫描、设计、生产、验证和确认以及合格评估。监管流程不断更新。与现有应用相比,市场扫描确定了对 FKT 的需求。在第 2 阶段设计了原型,并根据第 2-4 阶段的定性和定量结果进一步调整和改进。最后,第五阶段确认了 FKT 的性能和安全性。医疗设备的开发给医生带来了挑战,需要技术、监管和财务专业知识方面的合作。多学科团队合作也带来了挑战,包括责任和时间表方面的不确定性。获得 CE 认证后,如何适应不断变化的需求并确保数据隐私突出了医疗设备开发的持续性。
{"title":"A Blueprint for Clinical-Driven Medical Device Development: The Feverkidstool Application to Identify Children With Serious Bacterial Infection","authors":"Evelien B. van Kempen MD ,&nbsp;Sanne E.W. Vrijlandt MD ,&nbsp;Kelly van der Geest MSc ,&nbsp;Sophie Lotgering MSc ,&nbsp;Tom A. Hueting PhD ,&nbsp;Rianne Oostenbrink MD, PhD","doi":"10.1016/j.mcpdig.2024.10.003","DOIUrl":"10.1016/j.mcpdig.2024.10.003","url":null,"abstract":"<div><div>Clinical decision rules (CDRs) integrated into applications enhance diagnostic and treatment prediction support for clinicians, necessitating Confirmité Europeenne (CE)-mark certification to enter the European market. We describe the development of a CDR as a medical device, focusing on challenges from a physician’s perspective exemplified by the Feverkidstool (FKT), a validated CDR for febrile children. We pursued a local process, aligned with the CE-marking process, to develop the FKT as in-house developed device. We aimed to provide a blueprint for colleagues. Medical device development, conforming the medical device regulation and performed by a multidisciplinary team, encompassed 5 stages: market scan, design, production, verification and validation and conformity assessment. Regulatory processes were continuously updated. The market scan identified a need for the FKT compared with existing applications. A prototype was designed in stage 2, further adjusted and improved based on the qualitative and quantitative results of stages 2-4. Lastly, stage 5 confirmed FKT’s performance and safety. Medical device development presents challenges for physicians, requiring collaboration for technical, regulatory, and financial expertise. Multidisciplinary teamwork also poses challenges, including uncertainties regarding responsibility and timelines. After CE certification, adapting to evolving needs and ensuring data privacy highlights the ongoing nature of medical device development.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 656-664"},"PeriodicalIF":0.0,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142703869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cost-Effectiveness of Artificial Intelligence-Enabled Electrocardiograms for Early Detection of Low Ejection Fraction: A Secondary Analysis of the Electrocardiogram Artificial Intelligence-Guided Screening for Low Ejection Fraction Trial 人工智能心电图早期检测低射血分数的成本效益:心电图人工智能辅助筛查低射血分数试验二次分析
Pub Date : 2024-10-26 DOI: 10.1016/j.mcpdig.2024.10.001
Viengneesee Thao PhD, MS , Ye Zhu MD, MPH, PhD , Andrew S. Tseng MD, MPH , Jonathan W. Inselman MS , Bijan J. Borah PhD , Rozalina G. McCoy MD, MS , Zachi I. Attia PhD , Francisco Lopez-Jimenez MD, MBA , Patricia A. Pellikka MD , David R. Rushlow MD, MBOE , Paul A. Friedman MD , Peter A. Noseworthy MD, MBA , Xiaoxi Yao MPH, MS, PhD

Objective

To investigate the cost-effectiveness of using artificial intelligence (AI) to screen for low ejection fraction (EF) in routine clinical practice using a pragmatic randomized controlled trial (RCT).

Patients and Methods

In a post hoc analysis of the electrocardiogram (ECG) AI-guided screening for low ejection fraction trial, we developed a decision analytic model for patients aged 18 years and older without previously diagnosed heart failure and underwent a clinically indicated ECG between August 5, 2019, and March 31, 2020. In the previously published RCT, the intervention arm underwent an AI-guided targeted screening program for low EF with a workflow embedded into routine clinical practice—AI was applied to the ECG to identify patients at high-risk and recommended clinicians to order an ECG and the control arm received usual care without the screening program. We used results from the RCT for rates of low EF diagnosis and a lifetime Markov model to project the long-term outcomes. Quality-adjusted life years (QALYs), costs of intervention and treatment, disease event costs, incremental cost-effectiveness ratio (ICER), and cost for the number needed to screen. Multiple scenario and sensitivity analyses were performed.

Results

Compared with usual care, AI-integrated ECG was cost effective, with an incremental cost-effectiveness ratio of $27,858/QALY. The program remained cost effective even with a change in patient age and follow-up time duration, although the specific ICER values varied for these parameters. The program was more cost effective in outpatient settings (ICER $1651/QALY) than in inpatient or emergency room settings.

Conclusion

Implementing AI-guided targeted screening for low EF in routine clinical practice was cost effective.
患者和方法在心电图(ECG)人工智能指导的低射血分数筛查试验的事后分析中,我们为年龄在18岁及18岁以上、既往未确诊心力衰竭且在2019年8月5日至2020年3月31日期间接受了有临床指征的心电图检查的患者开发了一个决策分析模型。在之前发表的 RCT 中,干预组接受了人工智能指导的低 EF 靶向筛查计划,并将工作流程嵌入到常规临床实践中--人工智能应用于心电图以识别高风险患者,并建议临床医生进行心电图检查;对照组接受常规护理,不接受筛查计划。我们利用 RCT 的低 EF 诊断率结果和终身马尔可夫模型来预测长期结果。结果显示了质量调整生命年 (QALY)、干预和治疗成本、疾病事件成本、增量成本效益比 (ICER) 以及筛查所需人数的成本。结果与常规护理相比,人工智能整合心电图具有成本效益,增量成本效益比为 27,858 美元/QALY。即使患者年龄和随访时间发生变化,该方案仍具有成本效益,尽管这些参数的具体 ICER 值有所不同。结论在常规临床实践中实施人工智能指导的低 EF 目标筛查具有成本效益。
{"title":"Cost-Effectiveness of Artificial Intelligence-Enabled Electrocardiograms for Early Detection of Low Ejection Fraction: A Secondary Analysis of the Electrocardiogram Artificial Intelligence-Guided Screening for Low Ejection Fraction Trial","authors":"Viengneesee Thao PhD, MS ,&nbsp;Ye Zhu MD, MPH, PhD ,&nbsp;Andrew S. Tseng MD, MPH ,&nbsp;Jonathan W. Inselman MS ,&nbsp;Bijan J. Borah PhD ,&nbsp;Rozalina G. McCoy MD, MS ,&nbsp;Zachi I. Attia PhD ,&nbsp;Francisco Lopez-Jimenez MD, MBA ,&nbsp;Patricia A. Pellikka MD ,&nbsp;David R. Rushlow MD, MBOE ,&nbsp;Paul A. Friedman MD ,&nbsp;Peter A. Noseworthy MD, MBA ,&nbsp;Xiaoxi Yao MPH, MS, PhD","doi":"10.1016/j.mcpdig.2024.10.001","DOIUrl":"10.1016/j.mcpdig.2024.10.001","url":null,"abstract":"<div><h3>Objective</h3><div>To investigate the cost-effectiveness of using artificial intelligence (AI) to screen for low ejection fraction (EF) in routine clinical practice using a pragmatic randomized controlled trial (RCT).</div></div><div><h3>Patients and Methods</h3><div>In a post hoc analysis of the electrocardiogram (ECG) AI-guided screening for low ejection fraction trial, we developed a decision analytic model for patients aged 18 years and older without previously diagnosed heart failure and underwent a clinically indicated ECG between August 5, 2019, and March 31, 2020. In the previously published RCT, the intervention arm underwent an AI-guided targeted screening program for low EF with a workflow embedded into routine clinical practice—AI was applied to the ECG to identify patients at high-risk and recommended clinicians to order an ECG and the control arm received usual care without the screening program. We used results from the RCT for rates of low EF diagnosis and a lifetime Markov model to project the long-term outcomes. Quality-adjusted life years (QALYs), costs of intervention and treatment, disease event costs, incremental cost-effectiveness ratio (ICER), and cost for the number needed to screen. Multiple scenario and sensitivity analyses were performed.</div></div><div><h3>Results</h3><div>Compared with usual care, AI-integrated ECG was cost effective, with an incremental cost-effectiveness ratio of $27,858/QALY. The program remained cost effective even with a change in patient age and follow-up time duration, although the specific ICER values varied for these parameters. The program was more cost effective in outpatient settings (ICER $1651/QALY) than in inpatient or emergency room settings.</div></div><div><h3>Conclusion</h3><div>Implementing AI-guided targeted screening for low EF in routine clinical practice was cost effective.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 620-631"},"PeriodicalIF":0.0,"publicationDate":"2024-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142650837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-World Assessment of the Efficacy of Computer-Assisted Diagnosis in Colonoscopy: A Single Institution Cohort Study in Singapore 结肠镜检查中计算机辅助诊断功效的真实世界评估:新加坡单一机构队列研究
Pub Date : 2024-10-26 DOI: 10.1016/j.mcpdig.2024.10.002
Gabrielle E. Koh MBBS , Brittany Ng MBBS , Ronja M.B. Lagström MSc , Fung-Joon Foo FRCS , Shuen-Ern Chin MBBS , Fang-Ting Wan MBBS , Juinn Huar Kam FRCS , Baldwin Yeung PhD, FRCS , Clarence Kwan MRCP , Cesare Hassan MD, PhD , Ismail Gögenur MD, DMSc , Frederick H. Koh FRCS, PhD

Objective

To review the efficacy and accuracy of the GI Genius Intelligent Endoscopy Module Computer-Assisted Diagnosis (CADx) program in colonic adenoma detection and real-time polyp characterization.

Patients and Methods

Colonoscopy remains the gold standard in colonic screening and evaluation. The incorporation of artificial intelligence (AI) technology therefore allows for optimized endoscopic performance. However, validation of most CADx programs with real-world data remains scarce. This prospective cohort study was conducted within a single Singaporean institution between April 1, 2023 and December 31, 2023. Videos of all AI-enabled colonoscopies were reviewed with polyp-by-polyp analysis performed. Real-time polyp characterization predictions after sustained polyp detection were compared against final histology results to assess the accuracy of the CADx system at colonic adenoma identification.

Results

A total of 808 videos of CADx colonoscopies were reviewed. Out of the 781 polypectomies performed, 543 (69.5%) and 222 (28.4%) were adenomas and non-adenomas on final histology, respectively. Overall, GI Genius correctly characterized adenomas with 89.4% sensitivity, 61.7% specificity, a positive predictive value of 85.4%, a negative predictive value of 69.8%, and 81.5% accuracy. The negative predictive value for rectosigmoid lesions (80.3%) was notably higher than for colonic lesions (54.2%), attributed to the increased prevalence of hyperplastic rectosigmoid polyps (11.4%) vs other colonic regions (5.4%).

Conclusion

Computer-Assisted Diagnosis is therefore a promising adjunct in colonoscopy with substantial clinical implications. Accurate identification of low-risk non-adenomatous polyps encourages the adoption of “resect-and-discard” strategies. However, further calibration of AI systems is needed before the acceptance of such strategies as the new standard of care.
患者和方法 结肠镜检查仍然是结肠筛查和评估的黄金标准。因此,人工智能(AI)技术的应用可以优化内窥镜检查的效果。然而,大多数 CADx 程序在实际数据中的验证仍然很少。这项前瞻性队列研究是在 2023 年 4 月 1 日至 2023 年 12 月 31 日期间在新加坡一家机构内进行的。研究人员观看了所有人工智能结肠镜检查的视频,并逐个息肉进行分析。将持续息肉检测后的实时息肉特征预测与最终组织学结果进行比较,以评估 CADx 系统识别结肠腺瘤的准确性。在进行的 781 例息肉切除术中,最终组织学结果为腺瘤和非腺瘤的分别为 543 例(69.5%)和 222 例(28.4%)。总体而言,消化道天才能正确定性腺瘤,灵敏度为 89.4%,特异性为 61.7%,阳性预测值为 85.4%,阴性预测值为 69.8%,准确率为 81.5%。直肠乙状结肠病变的阴性预测值(80.3%)明显高于结肠病变(54.2%),这是因为增生性直肠乙状结肠息肉的发病率(11.4%)高于其他结肠区域(5.4%)。对低风险非腺瘤性息肉的准确识别有助于采用 "切除-丢弃 "策略。不过,在将这种策略作为新的治疗标准之前,还需要对人工智能系统进行进一步校准。
{"title":"Real-World Assessment of the Efficacy of Computer-Assisted Diagnosis in Colonoscopy: A Single Institution Cohort Study in Singapore","authors":"Gabrielle E. Koh MBBS ,&nbsp;Brittany Ng MBBS ,&nbsp;Ronja M.B. Lagström MSc ,&nbsp;Fung-Joon Foo FRCS ,&nbsp;Shuen-Ern Chin MBBS ,&nbsp;Fang-Ting Wan MBBS ,&nbsp;Juinn Huar Kam FRCS ,&nbsp;Baldwin Yeung PhD, FRCS ,&nbsp;Clarence Kwan MRCP ,&nbsp;Cesare Hassan MD, PhD ,&nbsp;Ismail Gögenur MD, DMSc ,&nbsp;Frederick H. Koh FRCS, PhD","doi":"10.1016/j.mcpdig.2024.10.002","DOIUrl":"10.1016/j.mcpdig.2024.10.002","url":null,"abstract":"<div><h3>Objective</h3><div>To review the efficacy and accuracy of the GI Genius Intelligent Endoscopy Module Computer-Assisted Diagnosis (CADx) program in colonic adenoma detection and real-time polyp characterization.</div></div><div><h3>Patients and Methods</h3><div>Colonoscopy remains the gold standard in colonic screening and evaluation. The incorporation of artificial intelligence (AI) technology therefore allows for optimized endoscopic performance. However, validation of most CADx programs with real-world data remains scarce. This prospective cohort study was conducted within a single Singaporean institution between April 1, 2023 and December 31, 2023. Videos of all AI-enabled colonoscopies were reviewed with polyp-by-polyp analysis performed. Real-time polyp characterization predictions after sustained polyp detection were compared against final histology results to assess the accuracy of the CADx system at colonic adenoma identification.</div></div><div><h3>Results</h3><div>A total of 808 videos of CADx colonoscopies were reviewed. Out of the 781 polypectomies performed, 543 (69.5%) and 222 (28.4%) were adenomas and non-adenomas on final histology, respectively. Overall, GI Genius correctly characterized adenomas with 89.4% sensitivity, 61.7% specificity, a positive predictive value of 85.4%, a negative predictive value of 69.8%, and 81.5% accuracy. The negative predictive value for rectosigmoid lesions (80.3%) was notably higher than for colonic lesions (54.2%), attributed to the increased prevalence of hyperplastic rectosigmoid polyps (11.4%) vs other colonic regions (5.4%).</div></div><div><h3>Conclusion</h3><div>Computer-Assisted Diagnosis is therefore a promising adjunct in colonoscopy with substantial clinical implications. Accurate identification of low-risk non-adenomatous polyps encourages the adoption of “resect-and-discard” strategies. However, further calibration of AI systems is needed before the acceptance of such strategies as the new standard of care.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 647-655"},"PeriodicalIF":0.0,"publicationDate":"2024-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142704499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating Large Language Model–Supported Instructions for Medication Use: First Steps Toward a Comprehensive Model 评估大语言模型支持的用药指导:迈向综合模式的第一步
Pub Date : 2024-10-19 DOI: 10.1016/j.mcpdig.2024.09.006
Zilma Silveira Nogueira Reis MD, PhD , Adriana Silvina Pagano MA, PhD , Isaias Jose Ramos de Oliveira MSc , Cristiane dos Santos Dias MD, PhD , Eura Martins Lage MD, PhD , Erico Franco Mineiro PhD , Glaucia Miranda Varella Pereira PhD , Igor de Carvalho Gomes MSc , Vinicius Araujo Basilio MS , Ricardo João Cruz-Correia PhD , Davi dos Reis de Jesus BCS , Antônio Pereira de Souza Júnior MS , Leonardo Chaves Dutra da Rocha PhD

Objective

To assess the support of large language models (LLMs) in generating clearer and more personalized medication instructions to enhance e-prescription.

Patients and Methods

We established patient-centered guidelines for adequate, acceptable, and personalized directions to enhance e-prescription. A dataset comprising 104 outpatient scenarios, with an array of medications, administration routes, and patient conditions, was developed following the Brazilian national e-prescribing standard. Three prompts were submitted to a closed-source LLM. The first prompt involved a generic command, the second one was calibrated for content enhancement and personalization, and the third one requested bias mitigation. The third prompt was submitted to an open-source LLM. Outputs were assessed using automated metrics and human evaluation. We conducted the study between March 1, 2024 and September 10, 2024.

Results

Adequacy scores of our closed-source LLM’s output showed the third prompt outperforming the first and second one. Full and partial acceptability was achieved in 94.3% of texts with the third prompt. Personalization was rated highly, especially with the second and third prompts. The 2 LLMs showed similar adequacy results. Lack of scientific evidence and factual errors were infrequent and unrelated to a particular prompt or LLM. The frequency of hallucinations was different for each LLM and concerned prescriptions issued upon symptom manifestation and medications requiring dosage adjustment or involving intermittent use. Gender bias was found in our closed-source LLM’s output for the first and second prompts, with the third one being bias-free. The second LLM’s output was bias-free.

Conclusion

This study demonstrates the potential of LLM-supported generation to produce prescription directions and improve communication between health professionals and patients within the e-prescribing system.
目的评估大型语言模型(LLM)在生成更清晰、更个性化的用药指导以提高电子处方水平方面的支持情况。我们根据巴西国家电子处方标准开发了一个数据集,其中包括 104 个门诊场景,涉及一系列药物、给药途径和患者状况。向封闭源 LLM 提交了三个提示。第一个提示涉及一个通用命令,第二个提示经过内容增强和个性化校准,第三个提示要求减少偏差。第三个提示提交给了开源 LLM。我们使用自动度量和人工评估对输出结果进行了评估。我们在 2024 年 3 月 1 日至 2024 年 9 月 10 日期间进行了这项研究。结果闭源 LLM 输出的适当性评分显示,第三条提示优于第一条和第二条提示。94.3%的文本在使用第三条提示时达到了完全或部分可接受性。个性化评分很高,尤其是第二和第三个提示。两份法律文件的适当性结果相似。缺乏科学证据和事实错误并不常见,而且与特定的提示或 LLM 无关。出现幻觉的频率在每个 LLM 中都有所不同,涉及到症状表现时开具的处方以及需要调整剂量或间歇性使用的药物。在我们的封闭源 LLM 中,第一个和第二个提示的输出存在性别偏差,第三个提示则没有性别偏差。结论这项研究表明,在电子处方系统中,LLM 支持生成处方指示并改善医疗专业人员与患者之间的沟通具有潜力。
{"title":"Evaluating Large Language Model–Supported Instructions for Medication Use: First Steps Toward a Comprehensive Model","authors":"Zilma Silveira Nogueira Reis MD, PhD ,&nbsp;Adriana Silvina Pagano MA, PhD ,&nbsp;Isaias Jose Ramos de Oliveira MSc ,&nbsp;Cristiane dos Santos Dias MD, PhD ,&nbsp;Eura Martins Lage MD, PhD ,&nbsp;Erico Franco Mineiro PhD ,&nbsp;Glaucia Miranda Varella Pereira PhD ,&nbsp;Igor de Carvalho Gomes MSc ,&nbsp;Vinicius Araujo Basilio MS ,&nbsp;Ricardo João Cruz-Correia PhD ,&nbsp;Davi dos Reis de Jesus BCS ,&nbsp;Antônio Pereira de Souza Júnior MS ,&nbsp;Leonardo Chaves Dutra da Rocha PhD","doi":"10.1016/j.mcpdig.2024.09.006","DOIUrl":"10.1016/j.mcpdig.2024.09.006","url":null,"abstract":"<div><h3>Objective</h3><div>To assess the support of large language models (LLMs) in generating clearer and more personalized medication instructions to enhance e-prescription.</div></div><div><h3>Patients and Methods</h3><div>We established patient-centered guidelines for adequate, acceptable, and personalized directions to enhance e-prescription. A dataset comprising 104 outpatient scenarios, with an array of medications, administration routes, and patient conditions, was developed following the Brazilian national e-prescribing standard. Three prompts were submitted to a closed-source LLM. The first prompt involved a generic command, the second one was calibrated for content enhancement and personalization, and the third one requested bias mitigation. The third prompt was submitted to an open-source LLM. Outputs were assessed using automated metrics and human evaluation. We conducted the study between March 1, 2024 and September 10, 2024.</div></div><div><h3>Results</h3><div>Adequacy scores of our closed-source LLM’s output showed the third prompt outperforming the first and second one. Full and partial acceptability was achieved in 94.3% of texts with the third prompt. Personalization was rated highly, especially with the second and third prompts. The 2 LLMs showed similar adequacy results. Lack of scientific evidence and factual errors were infrequent and unrelated to a particular prompt or LLM. The frequency of hallucinations was different for each LLM and concerned prescriptions issued upon symptom manifestation and medications requiring dosage adjustment or involving intermittent use. Gender bias was found in our closed-source LLM’s output for the first and second prompts, with the third one being bias-free. The second LLM’s output was bias-free.</div></div><div><h3>Conclusion</h3><div>This study demonstrates the potential of LLM-supported generation to produce prescription directions and improve communication between health professionals and patients within the e-prescribing system.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 632-644"},"PeriodicalIF":0.0,"publicationDate":"2024-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142704498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of Federated Learning in Cardiology: Key Challenges and Potential Solutions 联合学习在心脏病学中的应用:关键挑战与潜在解决方案
Pub Date : 2024-10-11 DOI: 10.1016/j.mcpdig.2024.09.005
Md Saifur Rahman PhD , Chandan Karmarkar PhD , Sheikh Mohammed Shariful Islam MBBS, PhD
{"title":"Application of Federated Learning in Cardiology: Key Challenges and Potential Solutions","authors":"Md Saifur Rahman PhD ,&nbsp;Chandan Karmarkar PhD ,&nbsp;Sheikh Mohammed Shariful Islam MBBS, PhD","doi":"10.1016/j.mcpdig.2024.09.005","DOIUrl":"10.1016/j.mcpdig.2024.09.005","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 590-595"},"PeriodicalIF":0.0,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552432","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessments of Generative Artificial Intelligence as Clinical Decision Support Ought to be Incorporated Into Randomized Controlled Trials of Electronic Alerts for Acute Kidney Injury 急性肾损伤电子警报的随机对照试验中应纳入对作为临床决策支持的生成性人工智能的评估
Pub Date : 2024-10-10 DOI: 10.1016/j.mcpdig.2024.09.004
Donal J. Sexton MD, PhD , Conor Judge MB, PhD
{"title":"Assessments of Generative Artificial Intelligence as Clinical Decision Support Ought to be Incorporated Into Randomized Controlled Trials of Electronic Alerts for Acute Kidney Injury","authors":"Donal J. Sexton MD, PhD ,&nbsp;Conor Judge MB, PhD","doi":"10.1016/j.mcpdig.2024.09.004","DOIUrl":"10.1016/j.mcpdig.2024.09.004","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 606-610"},"PeriodicalIF":0.0,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142592645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning Model for Predicting Neurodevelopmental Outcome in Very Preterm Infants Using Cerebral Ultrasound 利用脑超声波预测极早产儿神经发育结果的深度学习模型
Pub Date : 2024-10-09 DOI: 10.1016/j.mcpdig.2024.09.003
Tahani M. Ahmad MD, ABR , Alessandro Guida PhD , Sam Stewart PhD , Noah Barrett MSc , Michael J. Vincer MD , Jehier K. Afifi MD, MSc

Objective

To develop deep learning (DL) models applied to neonatal cranial ultrasound (CUS) and clinical variables to predict neurodevelopmental impairment (NDI) in very preterm infants (VPIs) at 3 years of corrected age.

Patients and Methods

This is a retrospective study of a cohort of VPI (220-306 weeks’ gestation) born between 2004 and 2016 in Nova Scotia, Canada. Clinical data at hospital discharge and CUS images at 3 time points were used to develop DL models using elastic net (EN) and convolutional neural network (CNN). The models’ performances were compared using precision recall area under the curve (PR-AUC) and area under the receiver operation characteristic curve (ROC-AUC) with their 95% ci.

Results

Of 665 eligible VPIs, 619 (93%) infants with 4184 CUS images were included. The CNN model combining CUS and clinical variables reported better performance (PR-AUC, 0.75; 95% CI, 072-0.79; ROC-AUC, 0.71; 95% CI, 0.67-0.74) in the prediction of positive NDI outcome compared with the traditional models based solely on clinical predictors (PR-AUC, 0.60; 95% CI, 0.52-0.68; ROC-AUC, 0.72; 95% CI, 0.68-0.75). When analyzed by the CUS plane and acquisition time point, the model using the anterior coronal plane at 6 weeks of age provided the highest predictive accuracy (PR-AUC, 0.81; 95% CI, 0.77-0.91; ROC-AUC, 0.78; 95% CI, 0.66-0.87).

Conclusion

We developed and internally validated a DL prognostic model using CUS and clinical predictors to predict NDI in VPIs at 3 years of age. Early and accurate identification of infants at risk for NDI enables referral to targeted interventions, which improves functional outcomes.
目的开发应用于新生儿头颅超声(CUS)和临床变量的深度学习(DL)模型,以预测极早产儿(VPI)在 3 岁矫正年龄时的神经发育障碍(NDI)。患者和方法这是一项回顾性研究,研究对象是 2004 年至 2016 年期间在加拿大新斯科舍省出生的一组 VPI(妊娠 220-306 周)。出院时的临床数据和 3 个时间点的 CUS 图像被用于使用弹性网(EN)和卷积神经网络(CNN)开发 DL 模型。使用精确召回曲线下面积(PR-AUC)和接收者操作特征曲线下面积(ROC-AUC)及其 95% ci 比较了模型的性能。与仅基于临床预测因子的传统模型(PR-AUC,0.60;95% CI,0.52-0.68;ROC-AUC,0.72;95% CI,0.68-0.75)相比,结合 CUS 和临床变量的 CNN 模型在预测 NDI 阳性结果方面表现更好(PR-AUC,0.75;95% CI,072-0.79;ROC-AUC,0.71;95% CI,0.67-0.74)。当按 CUS 平面和采集时间点进行分析时,6 周龄时使用前冠状面的模型具有最高的预测准确性(PR-AUC,0.81;95% CI,0.77-0.91;ROC-AUC,0.78;95% CI,0.66-0.87)。早期准确识别有 NDI 风险的婴儿可转诊接受有针对性的干预,从而改善功能预后。
{"title":"Deep Learning Model for Predicting Neurodevelopmental Outcome in Very Preterm Infants Using Cerebral Ultrasound","authors":"Tahani M. Ahmad MD, ABR ,&nbsp;Alessandro Guida PhD ,&nbsp;Sam Stewart PhD ,&nbsp;Noah Barrett MSc ,&nbsp;Michael J. Vincer MD ,&nbsp;Jehier K. Afifi MD, MSc","doi":"10.1016/j.mcpdig.2024.09.003","DOIUrl":"10.1016/j.mcpdig.2024.09.003","url":null,"abstract":"<div><h3>Objective</h3><div>To develop deep learning (DL) models applied to neonatal cranial ultrasound (CUS) and clinical variables to predict neurodevelopmental impairment (NDI) in very preterm infants (VPIs) at 3 years of corrected age.</div></div><div><h3>Patients and Methods</h3><div>This is a retrospective study of a cohort of VPI (22<sup>0</sup>-30<sup>6</sup> weeks’ gestation) born between 2004 and 2016 in Nova Scotia, Canada. Clinical data at hospital discharge and CUS images at 3 time points were used to develop DL models using elastic net (EN) and convolutional neural network (CNN). The models’ performances were compared using precision recall area under the curve (PR-AUC) and area under the receiver operation characteristic curve (ROC-AUC) with their 95% ci.</div></div><div><h3>Results</h3><div>Of 665 eligible VPIs, 619 (93%) infants with 4184 CUS images were included. The CNN model combining CUS and clinical variables reported better performance (PR-AUC, 0.75; 95% CI, 072-0.79; ROC-AUC, 0.71; 95% CI, 0.67-0.74) in the prediction of positive NDI outcome compared with the traditional models based solely on clinical predictors (PR-AUC, 0.60; 95% CI, 0.52-0.68; ROC-AUC, 0.72; 95% CI, 0.68-0.75). When analyzed by the CUS plane and acquisition time point, the model using the anterior coronal plane at 6 weeks of age provided the highest predictive accuracy (PR-AUC, 0.81; 95% CI, 0.77-0.91; ROC-AUC, 0.78; 95% CI, 0.66-0.87).</div></div><div><h3>Conclusion</h3><div>We developed and internally validated a DL prognostic model using CUS and clinical predictors to predict NDI in VPIs at 3 years of age. Early and accurate identification of infants at risk for NDI enables referral to targeted interventions, which improves functional outcomes.</div></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 4","pages":"Pages 596-605"},"PeriodicalIF":0.0,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Mayo Clinic Proceedings. Digital health
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1