High-quality expert annotations enhance artificial intelligence model accuracy for osteosarcoma X-ray diagnosis

IF 4.5 2区 医学 Q1 ONCOLOGY Cancer Science Pub Date : 2024-09-02 DOI:10.1111/cas.16330
Joe Hasei, Ryuichi Nakahara, Yujiro Otsuka, Yusuke Nakamura, Tamiya Hironari, Naoaki Kahara, Shinji Miwa, Shusa Ohshika, Shunji Nishimura, Kunihiro Ikuta, Shuhei Osaki, Aki Yoshida, Tomohiro Fujiwara, Eiji Nakata, Toshiyuki Kunisada, Toshifumi Ozaki
{"title":"High-quality expert annotations enhance artificial intelligence model accuracy for osteosarcoma X-ray diagnosis","authors":"Joe Hasei,&nbsp;Ryuichi Nakahara,&nbsp;Yujiro Otsuka,&nbsp;Yusuke Nakamura,&nbsp;Tamiya Hironari,&nbsp;Naoaki Kahara,&nbsp;Shinji Miwa,&nbsp;Shusa Ohshika,&nbsp;Shunji Nishimura,&nbsp;Kunihiro Ikuta,&nbsp;Shuhei Osaki,&nbsp;Aki Yoshida,&nbsp;Tomohiro Fujiwara,&nbsp;Eiji Nakata,&nbsp;Toshiyuki Kunisada,&nbsp;Toshifumi Ozaki","doi":"10.1111/cas.16330","DOIUrl":null,"url":null,"abstract":"<p>Primary malignant bone tumors, such as osteosarcoma, significantly affect the pediatric and young adult populations, necessitating early diagnosis for effective treatment. This study developed a high-performance artificial intelligence (AI) model to detect osteosarcoma from X-ray images using highly accurate annotated data to improve diagnostic accuracy at initial consultations. Traditional models trained on unannotated data have shown limited success, with sensitivities of approximately 60%–70%. In contrast, our model used a data-centric approach with annotations from an experienced oncologist, achieving a sensitivity of 95.52%, specificity of 96.21%, and an area under the curve of 0.989. The model was trained using 468 X-ray images from 31 osteosarcoma cases and 378 normal knee images with a strategy to maximize diversity in the training and validation sets. It was evaluated using an independent dataset of 268 osteosarcoma and 554 normal knee images to ensure generalizability. By applying the U-net architecture and advanced image processing techniques such as renormalization and affine transformations, our AI model outperforms existing models, reducing missed diagnoses and enhancing patient outcomes by facilitating earlier treatment. This study highlights the importance of high-quality training data and advocates a shift towards data-centric AI development in medical imaging. These insights can be extended to other rare cancers and diseases, underscoring the potential of AI in transforming diagnostic processes in oncology. The integration of this AI model into clinical workflows could support physicians in early osteosarcoma detection, thereby improving diagnostic accuracy and patient care.</p>","PeriodicalId":9580,"journal":{"name":"Cancer Science","volume":"115 11","pages":"3695-3704"},"PeriodicalIF":4.5000,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11531945/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cancer Science","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/cas.16330","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Primary malignant bone tumors, such as osteosarcoma, significantly affect the pediatric and young adult populations, necessitating early diagnosis for effective treatment. This study developed a high-performance artificial intelligence (AI) model to detect osteosarcoma from X-ray images using highly accurate annotated data to improve diagnostic accuracy at initial consultations. Traditional models trained on unannotated data have shown limited success, with sensitivities of approximately 60%–70%. In contrast, our model used a data-centric approach with annotations from an experienced oncologist, achieving a sensitivity of 95.52%, specificity of 96.21%, and an area under the curve of 0.989. The model was trained using 468 X-ray images from 31 osteosarcoma cases and 378 normal knee images with a strategy to maximize diversity in the training and validation sets. It was evaluated using an independent dataset of 268 osteosarcoma and 554 normal knee images to ensure generalizability. By applying the U-net architecture and advanced image processing techniques such as renormalization and affine transformations, our AI model outperforms existing models, reducing missed diagnoses and enhancing patient outcomes by facilitating earlier treatment. This study highlights the importance of high-quality training data and advocates a shift towards data-centric AI development in medical imaging. These insights can be extended to other rare cancers and diseases, underscoring the potential of AI in transforming diagnostic processes in oncology. The integration of this AI model into clinical workflows could support physicians in early osteosarcoma detection, thereby improving diagnostic accuracy and patient care.

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
高质量的专家注释提高了骨肉瘤 X 射线诊断人工智能模型的准确性。
骨肉瘤等原发性恶性骨肿瘤严重影响着儿童和青少年群体,必须及早诊断才能有效治疗。本研究开发了一种高性能人工智能(AI)模型,利用高精度的注释数据从 X 光图像中检测骨肉瘤,以提高初诊诊断的准确性。在无标注数据基础上训练的传统模型成功率有限,灵敏度约为 60%-70%。相比之下,我们的模型采用以数据为中心的方法,由经验丰富的肿瘤专家提供注释,灵敏度达到 95.52%,特异度达到 96.21%,曲线下面积达到 0.989。该模型使用来自 31 个骨肉瘤病例的 468 张 X 光图像和 378 张正常膝关节图像进行训练,其策略是最大限度地提高训练集和验证集的多样性。为了确保模型的普适性,还使用了包含 268 张骨肉瘤和 554 张正常膝关节图像的独立数据集对其进行了评估。通过应用 U-net 架构和先进的图像处理技术(如重归一化和仿射变换),我们的人工智能模型优于现有模型,减少了漏诊,并通过促进早期治疗提高了患者预后。这项研究强调了高质量训练数据的重要性,并倡导在医学影像领域转向以数据为中心的人工智能发展。这些见解可扩展到其他罕见癌症和疾病,凸显了人工智能在改变肿瘤诊断流程方面的潜力。将这一人工智能模型整合到临床工作流程中,可以帮助医生进行早期骨肉瘤检测,从而提高诊断准确性,改善患者护理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Cancer Science
Cancer Science 医学-肿瘤学
自引率
3.50%
发文量
406
审稿时长
2 months
期刊介绍: Cancer Science (formerly Japanese Journal of Cancer Research) is a monthly publication of the Japanese Cancer Association. First published in 1907, the Journal continues to publish original articles, editorials, and letters to the editor, describing original research in the fields of basic, translational and clinical cancer research. The Journal also accepts reports and case reports. Cancer Science aims to present highly significant and timely findings that have a significant clinical impact on oncologists or that may alter the disease concept of a tumor. The Journal will not publish case reports that describe a rare tumor or condition without new findings to be added to previous reports; combination of different tumors without new suggestive findings for oncological research; remarkable effect of already known treatments without suggestive data to explain the exceptional result. Review articles may also be published.
期刊最新文献
Issue Information In this issue Issue Information In this issue Real-world genome profiling in Japanese patients with pancreatic ductal adenocarcinoma focusing on HRD implications
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1