Yuqian Chen, Zhen Hua, Fan Lin, Tiantian Zheng, Heng Zhou, Shijie Zhang, Jing Gao, Zhongyi Wang, Huafei Shao, Wenjuan Li, Fengjie Liu, Simin Wang, Yan Zhang, Feng Zhao, Hao Liu, Haizhu Xie, Heng Ma, Haicheng Zhang, Ning Mao
{"title":"通过多过程深度学习系统使用对比增强乳房x线照相术的多种信息检测和分类乳腺病变:一项多中心研究。","authors":"Yuqian Chen, Zhen Hua, Fan Lin, Tiantian Zheng, Heng Zhou, Shijie Zhang, Jing Gao, Zhongyi Wang, Huafei Shao, Wenjuan Li, Fengjie Liu, Simin Wang, Yan Zhang, Feng Zhao, Hao Liu, Haizhu Xie, Heng Ma, Haicheng Zhang, Ning Mao","doi":"10.21147/j.issn.1000-9604.2023.04.07","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Accurate detection and classification of breast lesions in early stage is crucial to timely formulate effective treatments for patients. We aim to develop a fully automatic system to detect and classify breast lesions using multiple contrast-enhanced mammography (CEM) images.</p><p><strong>Methods: </strong>In this study, a total of 1,903 females who underwent CEM examination from three hospitals were enrolled as the training set, internal testing set, pooled external testing set and prospective testing set. Here we developed a CEM-based multiprocess detection and classification system (MDCS) to perform the task of detection and classification of breast lesions. In this system, we introduced an innovative auxiliary feature fusion (AFF) algorithm that could intelligently incorporates multiple types of information from CEM images. The average free-response receiver operating characteristic score (AFROC-Score) was presented to validate system's detection performance, and the performance of classification was evaluated by area under the receiver operating characteristic curve (AUC). Furthermore, we assessed the diagnostic value of MDCS through visual analysis of disputed cases, comparing its performance and efficiency with that of radiologists and exploring whether it could augment radiologists' performance.</p><p><strong>Results: </strong>On the pooled external and prospective testing sets, MDCS always maintained a high standalone performance, with AFROC-Scores of 0.953 and 0.963 for detection task, and AUCs for classification were 0.909 [95% confidence interval (95% CI): 0.822-0.996] and 0.912 (95% CI: 0.840-0.985), respectively. It also achieved higher sensitivity than all senior radiologists and higher specificity than all junior radiologists on pooled external and prospective testing sets. Moreover, MDCS performed superior diagnostic efficiency with an average reading time of 5 seconds, compared to the radiologists' average reading time of 3.2 min. The average performance of all radiologists was also improved to varying degrees with MDCS assistance.</p><p><strong>Conclusions: </strong>MDCS demonstrated excellent performance in the detection and classification of breast lesions, and greatly enhanced the overall performance of radiologists.</p>","PeriodicalId":9830,"journal":{"name":"Chinese journal of cancer research = Chung-kuo yen cheng yen chiu","volume":"35 4","pages":"408-423"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10485921/pdf/cjcr-35-4-408.pdf","citationCount":"0","resultStr":"{\"title\":\"Detection and classification of breast lesions using multiple information on contrast-enhanced mammography by a multiprocess deep-learning system: A multicenter study.\",\"authors\":\"Yuqian Chen, Zhen Hua, Fan Lin, Tiantian Zheng, Heng Zhou, Shijie Zhang, Jing Gao, Zhongyi Wang, Huafei Shao, Wenjuan Li, Fengjie Liu, Simin Wang, Yan Zhang, Feng Zhao, Hao Liu, Haizhu Xie, Heng Ma, Haicheng Zhang, Ning Mao\",\"doi\":\"10.21147/j.issn.1000-9604.2023.04.07\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Accurate detection and classification of breast lesions in early stage is crucial to timely formulate effective treatments for patients. We aim to develop a fully automatic system to detect and classify breast lesions using multiple contrast-enhanced mammography (CEM) images.</p><p><strong>Methods: </strong>In this study, a total of 1,903 females who underwent CEM examination from three hospitals were enrolled as the training set, internal testing set, pooled external testing set and prospective testing set. Here we developed a CEM-based multiprocess detection and classification system (MDCS) to perform the task of detection and classification of breast lesions. In this system, we introduced an innovative auxiliary feature fusion (AFF) algorithm that could intelligently incorporates multiple types of information from CEM images. The average free-response receiver operating characteristic score (AFROC-Score) was presented to validate system's detection performance, and the performance of classification was evaluated by area under the receiver operating characteristic curve (AUC). Furthermore, we assessed the diagnostic value of MDCS through visual analysis of disputed cases, comparing its performance and efficiency with that of radiologists and exploring whether it could augment radiologists' performance.</p><p><strong>Results: </strong>On the pooled external and prospective testing sets, MDCS always maintained a high standalone performance, with AFROC-Scores of 0.953 and 0.963 for detection task, and AUCs for classification were 0.909 [95% confidence interval (95% CI): 0.822-0.996] and 0.912 (95% CI: 0.840-0.985), respectively. It also achieved higher sensitivity than all senior radiologists and higher specificity than all junior radiologists on pooled external and prospective testing sets. Moreover, MDCS performed superior diagnostic efficiency with an average reading time of 5 seconds, compared to the radiologists' average reading time of 3.2 min. The average performance of all radiologists was also improved to varying degrees with MDCS assistance.</p><p><strong>Conclusions: </strong>MDCS demonstrated excellent performance in the detection and classification of breast lesions, and greatly enhanced the overall performance of radiologists.</p>\",\"PeriodicalId\":9830,\"journal\":{\"name\":\"Chinese journal of cancer research = Chung-kuo yen cheng yen chiu\",\"volume\":\"35 4\",\"pages\":\"408-423\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10485921/pdf/cjcr-35-4-408.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chinese journal of cancer research = Chung-kuo yen cheng yen chiu\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.21147/j.issn.1000-9604.2023.04.07\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese journal of cancer research = Chung-kuo yen cheng yen chiu","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21147/j.issn.1000-9604.2023.04.07","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Detection and classification of breast lesions using multiple information on contrast-enhanced mammography by a multiprocess deep-learning system: A multicenter study.
Objective: Accurate detection and classification of breast lesions in early stage is crucial to timely formulate effective treatments for patients. We aim to develop a fully automatic system to detect and classify breast lesions using multiple contrast-enhanced mammography (CEM) images.
Methods: In this study, a total of 1,903 females who underwent CEM examination from three hospitals were enrolled as the training set, internal testing set, pooled external testing set and prospective testing set. Here we developed a CEM-based multiprocess detection and classification system (MDCS) to perform the task of detection and classification of breast lesions. In this system, we introduced an innovative auxiliary feature fusion (AFF) algorithm that could intelligently incorporates multiple types of information from CEM images. The average free-response receiver operating characteristic score (AFROC-Score) was presented to validate system's detection performance, and the performance of classification was evaluated by area under the receiver operating characteristic curve (AUC). Furthermore, we assessed the diagnostic value of MDCS through visual analysis of disputed cases, comparing its performance and efficiency with that of radiologists and exploring whether it could augment radiologists' performance.
Results: On the pooled external and prospective testing sets, MDCS always maintained a high standalone performance, with AFROC-Scores of 0.953 and 0.963 for detection task, and AUCs for classification were 0.909 [95% confidence interval (95% CI): 0.822-0.996] and 0.912 (95% CI: 0.840-0.985), respectively. It also achieved higher sensitivity than all senior radiologists and higher specificity than all junior radiologists on pooled external and prospective testing sets. Moreover, MDCS performed superior diagnostic efficiency with an average reading time of 5 seconds, compared to the radiologists' average reading time of 3.2 min. The average performance of all radiologists was also improved to varying degrees with MDCS assistance.
Conclusions: MDCS demonstrated excellent performance in the detection and classification of breast lesions, and greatly enhanced the overall performance of radiologists.