Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation.
Jessie J J Gommers,Sarah D Verboom,Katya M Duvivier,Jan-Kees van Rooden,A Fleur van Raamt,Janneke B Houwers,Dick B Naafs,Lucien E M Duijm,Craig K Abbey,Michael A Webster,Mireille J M Broeders,Ioannis Sechopoulos
求助PDF
{"title":"Enhancing Radiologist Reading Performance by Ordering Screening Mammograms Based on Characteristics That Promote Visual Adaptation.","authors":"Jessie J J Gommers,Sarah D Verboom,Katya M Duvivier,Jan-Kees van Rooden,A Fleur van Raamt,Janneke B Houwers,Dick B Naafs,Lucien E M Duijm,Craig K Abbey,Michael A Webster,Mireille J M Broeders,Ioannis Sechopoulos","doi":"10.1148/radiol.240237","DOIUrl":null,"url":null,"abstract":"Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as \"looking similar\"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; P = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], P = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], P = .78), and a reduced reading time (24.3 vs 27.9 seconds, P < .001), fixation count (47 vs 52, P < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, P < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; P = .70), specificity (84% [820 of 975], P = .37), sensitivity (80% [784 of 975], P = .79), fixation count (54, P = .05), or fixation time in malignant regions (4.6 seconds, P > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, P = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Grimm in this issue.","PeriodicalId":20896,"journal":{"name":"Radiology","volume":"8 1","pages":"e240237"},"PeriodicalIF":12.1000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1148/radiol.240237","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
引用
批量引用
Abstract
Background Mammographic background characteristics may stimulate human visual adaptation, allowing radiologists to detect abnormalities more effectively. However, it is unclear whether density, or another image characteristic, drives visual adaptation. Purpose To investigate whether screening performance improves when screening mammography examinations are ordered for batch reading according to mammographic characteristics that may promote visual adaptation. Materials and Methods This retrospective multireader multicase study was performed with mammograms obtained between September 2016 and May 2019. The screening examinations, each consisting of four mammograms, were interpreted by 13 radiologists in three distinct orders: randomly, by increasing volumetric breast density (VBD), and based on a self-supervised learning (SSL) encoding (examinations automatically grouped as "looking similar"). An eye tracker recorded radiologists' eye movements during interpretation. The area under the receiver operating characteristic curve (AUC), sensitivity, and specificity of random-ordered readings were compared with those of VBD- and SSL-ordered readings using mixed-model analysis of variance. Reading time, fixation metrics, and perceived density were compared using Wilcoxon signed-rank tests. Results Mammography examinations (75 with breast cancer, 75 without breast cancer) from 150 women (median age, 55 years [IQR, 50-63]) were read. The examinations ordered by increasing VBD versus randomly had an increased AUC (0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; P = .009), without evidence of a difference in specificity (89% [871 of 975] vs 86% [837 of 975], P = .04) and sensitivity (both 81% [794 of 975 vs 788 of 975], P = .78), and a reduced reading time (24.3 vs 27.9 seconds, P < .001), fixation count (47 vs 52, P < .001), and fixation time in malignant regions (3.7 vs 4.6 seconds, P < .001). For SSL-ordered readings, there was no evidence of differences in AUC (0.92 [95% CI: 0.89, 0.95]; P = .70), specificity (84% [820 of 975], P = .37), sensitivity (80% [784 of 975], P = .79), fixation count (54, P = .05), or fixation time in malignant regions (4.6 seconds, P > .99) compared with random-ordered readings. Reading times were significantly higher for SSL-ordered readings compared with random-ordered readings (28.4 seconds, P = .02). Conclusion Screening mammography examinations ordered from low to high VBD improved screening performance while reducing reading and fixation times. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Grimm in this issue.
根据促进视觉适应性的特征订购筛查乳腺 X 光片,提高放射医师的阅片性能。
背景 乳腺造影的背景特征可能会刺激人类的视觉适应,从而使放射医师更有效地发现异常。然而,目前还不清楚是密度还是其他图像特征促进了视觉适应。目的 研究根据乳腺 X 线造影特征进行批量阅片是否会提高筛查效率,因为乳腺 X 线造影特征可能会促进视觉适应。材料与方法 本项回顾性多阅片机多病例研究是针对 2016 年 9 月至 2019 年 5 月期间获得的乳腺 X 光片进行的。筛查检查每项包括四张乳腺 X 光照片,由 13 名放射科医生按照三种不同的顺序进行解读:随机解读、根据乳腺体积密度(VBD)的增加解读以及根据自我监督学习(SSL)编码(自动将检查归类为 "看起来相似 "的检查)解读。眼动跟踪器记录了放射科医生在判读过程中的眼球运动。使用混合模型方差分析比较了随机排序读片与VBD和SSL排序读片的接收者工作特征曲线下面积(AUC)、灵敏度和特异性。使用 Wilcoxon 符号秩检验比较了读取时间、固定指标和感知密度。结果 对 150 名妇女(中位年龄 55 岁 [IQR,50-63])的乳腺 X 光检查(75 名患有乳腺癌,75 名未患乳腺癌)进行了读片。通过增加 VBD 订购的检查与随机订购的检查相比,AUC 有所提高(0.93 [95% CI: 0.91, 0.96] vs 0.92 [95% CI: 0.89, 0.95]; P = .009),但特异性(89% [871 of 975] vs 86% [837 of 975],P = .04)和灵敏度(均为 81% [975 例中的 794 例 vs 975 例中的 788 例],P = .78),阅读时间(24.3 秒 vs 27.9 秒,P < .001)、固定次数(47 vs 52,P < .001)和恶性区域的固定时间(3.7 秒 vs 4.6 秒,P < .001)均有所减少。对于 SSL 排序读数,与随机排序读数相比,在 AUC(0.92 [95% CI:0.89, 0.95];P = .70)、特异性(84% [820 of 975],P = .37)、灵敏度(80% [784 of 975],P = .79)、固定计数(54,P = .05)或恶性区域固定时间(4.6 秒,P > .99)方面没有证据表明存在差异。与随机排序读片相比,SSL 排序读片的读片时间明显较长(28.4 秒,P = .02)。结论 从低 VBD 到高 VBD 排序的乳腺 X 光筛查提高了筛查性能,同时减少了读片和定影时间。RSNA, 2024 这篇文章有补充材料。另请参阅本期 Grimm 的社论。
本文章由计算机程序翻译,如有差异,请以英文原文为准。