Erica Smedberg, Måns Åkerlund, Mikael Andersson Franko, Elisabeth Epstein
{"title":"教育游戏 SonoQz 提高了卵巢肿瘤超声评估的诊断性能。","authors":"Erica Smedberg, Måns Åkerlund, Mikael Andersson Franko, Elisabeth Epstein","doi":"10.1111/aogs.14906","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Introduction</h3>\n \n <p>Our objective was to determine whether the educational game SonoQz can improve diagnostic performance in ultrasound assessment of ovarian tumors.</p>\n </section>\n \n <section>\n \n <h3> Material and Methods</h3>\n \n <p>The SonoQz mobile application was developed as an educational tool for medical doctors to practice ultrasound assessment, based on still images of ovarian tumors. The game comprises images from 324 ovarian tumors, examined by an ultrasound expert prior to surgery. A training phase, where the participants assessed at least 200 cases in the SonoQz app, was preceded by a pretraining test, and followed by a posttraining test. Two equal tests (A and B), each consisting of 20 cases, were used as pre- and posttraining tests. Half the users took test A first, B second, and the remaining took the tests in the opposite order. Users were asked to classify the tumors (1) according to International Ovarian Tumor Analysis (IOTA) Simple Rules, (2) as benign or malignant, and (3) suggest a specific histological diagnosis. Logistic mixed models with fixed effects for pre- and posttraining tests, and crossed random effects for participants and cases, were used to determine any improvement in test scores, sensitivity, and specificity.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Fifty-eight doctors from 19 medical centers participated. Comparing the pre- and posttraining test, the median of correctly classified cases, in Simple Rules assessment increased from 72% to 83%, <i>p</i> < 0.001; in classifying the lesion as benign or malignant tumors from 86% to 95%, <i>p</i> < 0.001; and in making a specific diagnosis from 43% to 63%, <i>p</i> < 0.001. When classifying tumors as benign or malignant, at an unchanged level of sensitivity (98% vs. 97%, <i>p</i> = 0.157), the specificity increased from 70% to 89%, <i>p</i> < 0.001.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>Our results indicate that the educational game SonoQz is an effective tool that may improve diagnostic performance in assessing ovarian tumors, specifically by reducing the number of false positives while maintaining high sensitivity.</p>\n </section>\n </div>","PeriodicalId":6990,"journal":{"name":"Acta Obstetricia et Gynecologica Scandinavica","volume":"103 10","pages":"2053-2060"},"PeriodicalIF":3.5000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/aogs.14906","citationCount":"0","resultStr":"{\"title\":\"The educational game SonoQz improves diagnostic performance in ultrasound assessment of ovarian tumors\",\"authors\":\"Erica Smedberg, Måns Åkerlund, Mikael Andersson Franko, Elisabeth Epstein\",\"doi\":\"10.1111/aogs.14906\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Introduction</h3>\\n \\n <p>Our objective was to determine whether the educational game SonoQz can improve diagnostic performance in ultrasound assessment of ovarian tumors.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Material and Methods</h3>\\n \\n <p>The SonoQz mobile application was developed as an educational tool for medical doctors to practice ultrasound assessment, based on still images of ovarian tumors. The game comprises images from 324 ovarian tumors, examined by an ultrasound expert prior to surgery. A training phase, where the participants assessed at least 200 cases in the SonoQz app, was preceded by a pretraining test, and followed by a posttraining test. Two equal tests (A and B), each consisting of 20 cases, were used as pre- and posttraining tests. Half the users took test A first, B second, and the remaining took the tests in the opposite order. Users were asked to classify the tumors (1) according to International Ovarian Tumor Analysis (IOTA) Simple Rules, (2) as benign or malignant, and (3) suggest a specific histological diagnosis. Logistic mixed models with fixed effects for pre- and posttraining tests, and crossed random effects for participants and cases, were used to determine any improvement in test scores, sensitivity, and specificity.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>Fifty-eight doctors from 19 medical centers participated. Comparing the pre- and posttraining test, the median of correctly classified cases, in Simple Rules assessment increased from 72% to 83%, <i>p</i> < 0.001; in classifying the lesion as benign or malignant tumors from 86% to 95%, <i>p</i> < 0.001; and in making a specific diagnosis from 43% to 63%, <i>p</i> < 0.001. When classifying tumors as benign or malignant, at an unchanged level of sensitivity (98% vs. 97%, <i>p</i> = 0.157), the specificity increased from 70% to 89%, <i>p</i> < 0.001.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusions</h3>\\n \\n <p>Our results indicate that the educational game SonoQz is an effective tool that may improve diagnostic performance in assessing ovarian tumors, specifically by reducing the number of false positives while maintaining high sensitivity.</p>\\n </section>\\n </div>\",\"PeriodicalId\":6990,\"journal\":{\"name\":\"Acta Obstetricia et Gynecologica Scandinavica\",\"volume\":\"103 10\",\"pages\":\"2053-2060\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/aogs.14906\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Acta Obstetricia et Gynecologica Scandinavica\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/aogs.14906\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"OBSTETRICS & GYNECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Acta Obstetricia et Gynecologica Scandinavica","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/aogs.14906","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
The educational game SonoQz improves diagnostic performance in ultrasound assessment of ovarian tumors
Introduction
Our objective was to determine whether the educational game SonoQz can improve diagnostic performance in ultrasound assessment of ovarian tumors.
Material and Methods
The SonoQz mobile application was developed as an educational tool for medical doctors to practice ultrasound assessment, based on still images of ovarian tumors. The game comprises images from 324 ovarian tumors, examined by an ultrasound expert prior to surgery. A training phase, where the participants assessed at least 200 cases in the SonoQz app, was preceded by a pretraining test, and followed by a posttraining test. Two equal tests (A and B), each consisting of 20 cases, were used as pre- and posttraining tests. Half the users took test A first, B second, and the remaining took the tests in the opposite order. Users were asked to classify the tumors (1) according to International Ovarian Tumor Analysis (IOTA) Simple Rules, (2) as benign or malignant, and (3) suggest a specific histological diagnosis. Logistic mixed models with fixed effects for pre- and posttraining tests, and crossed random effects for participants and cases, were used to determine any improvement in test scores, sensitivity, and specificity.
Results
Fifty-eight doctors from 19 medical centers participated. Comparing the pre- and posttraining test, the median of correctly classified cases, in Simple Rules assessment increased from 72% to 83%, p < 0.001; in classifying the lesion as benign or malignant tumors from 86% to 95%, p < 0.001; and in making a specific diagnosis from 43% to 63%, p < 0.001. When classifying tumors as benign or malignant, at an unchanged level of sensitivity (98% vs. 97%, p = 0.157), the specificity increased from 70% to 89%, p < 0.001.
Conclusions
Our results indicate that the educational game SonoQz is an effective tool that may improve diagnostic performance in assessing ovarian tumors, specifically by reducing the number of false positives while maintaining high sensitivity.
期刊介绍:
Published monthly, Acta Obstetricia et Gynecologica Scandinavica is an international journal dedicated to providing the very latest information on the results of both clinical, basic and translational research work related to all aspects of women’s health from around the globe. The journal regularly publishes commentaries, reviews, and original articles on a wide variety of topics including: gynecology, pregnancy, birth, female urology, gynecologic oncology, fertility and reproductive biology.