Exploratory study on the enhancement of O-RADS application effectiveness for novice ultrasonographers via deep learning.

Abstract

Purpose: The study aimed to create a deep convolutional neural network (DCNN) model based on ConvNeXt-Tiny to identify classic benign lesions (CBL) from other lesions (OL) within the Ovarian-Adnexal Reporting and Data System (O-RADS), enhancing the system's utility for novice ultrasonographers.

Methods: Two sets of sonographic images of pathologically confirmed adnexal lesions were retrospectively collected [development dataset (DD) and independent test dataset (ITD)]. The ConvNeXt-Tiny model, optimized through transfer learning, was trained on the DD using the original images directly and after automatic lesion segmentation by a U-Net model. Models derived from both training paradigms were validated on the ITD for sensitivity, specificity, accuracy, and area under the curve (AUC). Two novice ultrasonographers were assessed in O-RADS with and without assistance from the model for Application Effectiveness.

Results: The ConvNeXt-Tiny model trained on original images scored AUCs of 0.978 for DD and 0.955 for ITD, while the U-Net segmented image model achieved 0.967 for DD and 0.923 for ITD; neither showed significant differences. When assessing the malignancy of lesions using O-RADS 4 and 5, the diagnostic performances of two novice ultrasonographers and senior ultrasonographer, as well as model-assisted classifications, showed no significant differences, except for one novice's low accuracy. This approach reduced classification time by 62 and 64 min. The kappa values with senior doctors' classifications rose from 0.776 and 0.761 to 0.914 and 0.903, respectively.

Conclusion: The ConvNeXt-Tiny model demonstrated excellent and stable performance in distinguishing CBL from OL within O-RADS. The diagnostic performance of novice ultrasonographers using O-RADS is essentially equivalent to that of senior ultrasonographer, and the assistance of the model can enhance their classification efficiency and consistency with the results of senior ultrasonographer.