The educational game SonoQz improves diagnostic performance in ultrasound assessment of ovarian tumors

Abstract

Introduction

Our objective was to determine whether the educational game SonoQz can improve diagnostic performance in ultrasound assessment of ovarian tumors.

Material and Methods

The SonoQz mobile application was developed as an educational tool for medical doctors to practice ultrasound assessment, based on still images of ovarian tumors. The game comprises images from 324 ovarian tumors, examined by an ultrasound expert prior to surgery. A training phase, where the participants assessed at least 200 cases in the SonoQz app, was preceded by a pretraining test, and followed by a posttraining test. Two equal tests (A and B), each consisting of 20 cases, were used as pre- and posttraining tests. Half the users took test A first, B second, and the remaining took the tests in the opposite order. Users were asked to classify the tumors (1) according to International Ovarian Tumor Analysis (IOTA) Simple Rules, (2) as benign or malignant, and (3) suggest a specific histological diagnosis. Logistic mixed models with fixed effects for pre- and posttraining tests, and crossed random effects for participants and cases, were used to determine any improvement in test scores, sensitivity, and specificity.

Results

Fifty-eight doctors from 19 medical centers participated. Comparing the pre- and posttraining test, the median of correctly classified cases, in Simple Rules assessment increased from 72% to 83%, p < 0.001; in classifying the lesion as benign or malignant tumors from 86% to 95%, p < 0.001; and in making a specific diagnosis from 43% to 63%, p < 0.001. When classifying tumors as benign or malignant, at an unchanged level of sensitivity (98% vs. 97%, p = 0.157), the specificity increased from 70% to 89%, p < 0.001.

Conclusions

Our results indicate that the educational game SonoQz is an effective tool that may improve diagnostic performance in assessing ovarian tumors, specifically by reducing the number of false positives while maintaining high sensitivity.