Carlos E O Dos Santos, Daniele Malaman, Ivan D Arciniegas Sanmartin, Ari B S Leão, Gabriel S Leão, Júlio C Pereira-Lima
{"title":"人工智能在结直肠病变表征中的表现。","authors":"Carlos E O Dos Santos, Daniele Malaman, Ivan D Arciniegas Sanmartin, Ari B S Leão, Gabriel S Leão, Júlio C Pereira-Lima","doi":"10.4103/sjg.sjg_316_22","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR).</p><p><strong>Methods: </strong>A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated.</p><p><strong>Results: </strong>A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%.</p><p><strong>Conclusions: </strong>The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.</p>","PeriodicalId":48881,"journal":{"name":"Saudi Journal of Gastroenterology","volume":"29 4","pages":"219-224"},"PeriodicalIF":1.9000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/85/72/SJG-29-219.PMC10445495.pdf","citationCount":"2","resultStr":"{\"title\":\"Performance of artificial intelligence in the characterization of colorectal lesions.\",\"authors\":\"Carlos E O Dos Santos, Daniele Malaman, Ivan D Arciniegas Sanmartin, Ari B S Leão, Gabriel S Leão, Júlio C Pereira-Lima\",\"doi\":\"10.4103/sjg.sjg_316_22\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR).</p><p><strong>Methods: </strong>A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated.</p><p><strong>Results: </strong>A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%.</p><p><strong>Conclusions: </strong>The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.</p>\",\"PeriodicalId\":48881,\"journal\":{\"name\":\"Saudi Journal of Gastroenterology\",\"volume\":\"29 4\",\"pages\":\"219-224\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2023-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/85/72/SJG-29-219.PMC10445495.pdf\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Saudi Journal of Gastroenterology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.4103/sjg.sjg_316_22\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"GASTROENTEROLOGY & HEPATOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Saudi Journal of Gastroenterology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.4103/sjg.sjg_316_22","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
Performance of artificial intelligence in the characterization of colorectal lesions.
Background: Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR).
Methods: A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated.
Results: A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%.
Conclusions: The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.
期刊介绍:
The Saudi Journal of Gastroenterology (SJG) is an open access peer-reviewed publication. Authors are invited to submit articles in the field of gastroenterology, hepatology and nutrition, with a wide spectrum of coverage including basic science, epidemiology, diagnostics, therapeutics, public health, and standards of health care in relation to the concerned specialty. Review articles are usually by invitation. However review articles of current interest and a high standard of scientific value could also be considered for publication.