Development of 18F-Fluoromisonidazole Hypoxia PET/CT Diagnostic Interpretation Criteria and Validation of Interreader Reliability, Reproducibility, and Performance
Rick Wray, Audrey Mauguen, Laure Michaud, Doris Leithner, Randy Yeh, Nadeem Riaz, Rosna Mirtcheva, Eric Sherman, Richard Wong, John Humm, Nancy Lee, Heiko Schöder
{"title":"Development of 18F-Fluoromisonidazole Hypoxia PET/CT Diagnostic Interpretation Criteria and Validation of Interreader Reliability, Reproducibility, and Performance","authors":"Rick Wray, Audrey Mauguen, Laure Michaud, Doris Leithner, Randy Yeh, Nadeem Riaz, Rosna Mirtcheva, Eric Sherman, Richard Wong, John Humm, Nancy Lee, Heiko Schöder","doi":"10.2967/jnumed.124.267775","DOIUrl":null,"url":null,"abstract":"<p>Tumor hypoxia, an integral biomarker to guide radiotherapy, can be imaged with <sup>18</sup>F-fluoromisonidazole (<sup>18</sup>F-FMISO) hypoxia PET. One major obstacle to its broader application is the lack of standardized interpretation criteria. We sought to develop and validate practical interpretation criteria and a dedicated training protocol for nuclear medicine physicians to interpret <sup>18</sup>F-FMISO hypoxia PET. <strong>Methods:</strong> We randomly selected 123 patients with human papillomavirus–positive oropharyngeal cancer enrolled in a phase II trial who underwent 123 <sup>18</sup>F-FDG PET/CT and 134 <sup>18</sup>F-FMISO PET/CT scans. Four independent nuclear medicine physicians with no <sup>18</sup>F-FMISO experience read the scans. Interpretation by a fifth nuclear medicine physician with over 2 decades of <sup>18</sup>F-FMISO experience was the reference standard. Performance was evaluated after initial instruction and subsequent dedicated training. Scans were considered positive for hypoxia by visual assessment if <sup>18</sup>F-FMISO uptake was greater than floor-of-mouth uptake. Additionally, SUV<sub>max</sub> was determined to evaluate whether quantitative assessment using tumor-to-background ratios could be helpful to define hypoxia positivity. <strong>Results:</strong> Visual assessment produced a mean sensitivity and specificity of 77.3% and 80.9%, with fair interreader agreement (κ = 0.34), after initial instruction. After dedicated training, mean sensitivity and specificity improved to 97.6% and 86.9%, with almost perfect agreement (κ = 0.86). Quantitative assessment with an estimated best SUV<sub>max</sub> ratio threshold of more than 1.2 to define hypoxia positivity produced a mean sensitivity and specificity of 56.8% and 95.9%, respectively, with substantial interreader agreement (κ = 0.66), after initial instruction. After dedicated training, mean sensitivity improved to 89.6% whereas mean specificity remained high at 95.3%, with near-perfect interreader agreement (κ = 0.86). <strong>Conclusion:</strong> Nuclear medicine physicians without <sup>18</sup>F-FMISO hypoxia PET reading experience demonstrate much improved interreader agreement with dedicated training using specific interpretation criteria.</p>","PeriodicalId":22820,"journal":{"name":"The Journal of Nuclear Medicine","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of Nuclear Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2967/jnumed.124.267775","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Tumor hypoxia, an integral biomarker to guide radiotherapy, can be imaged with 18F-fluoromisonidazole (18F-FMISO) hypoxia PET. One major obstacle to its broader application is the lack of standardized interpretation criteria. We sought to develop and validate practical interpretation criteria and a dedicated training protocol for nuclear medicine physicians to interpret 18F-FMISO hypoxia PET. Methods: We randomly selected 123 patients with human papillomavirus–positive oropharyngeal cancer enrolled in a phase II trial who underwent 123 18F-FDG PET/CT and 134 18F-FMISO PET/CT scans. Four independent nuclear medicine physicians with no 18F-FMISO experience read the scans. Interpretation by a fifth nuclear medicine physician with over 2 decades of 18F-FMISO experience was the reference standard. Performance was evaluated after initial instruction and subsequent dedicated training. Scans were considered positive for hypoxia by visual assessment if 18F-FMISO uptake was greater than floor-of-mouth uptake. Additionally, SUVmax was determined to evaluate whether quantitative assessment using tumor-to-background ratios could be helpful to define hypoxia positivity. Results: Visual assessment produced a mean sensitivity and specificity of 77.3% and 80.9%, with fair interreader agreement (κ = 0.34), after initial instruction. After dedicated training, mean sensitivity and specificity improved to 97.6% and 86.9%, with almost perfect agreement (κ = 0.86). Quantitative assessment with an estimated best SUVmax ratio threshold of more than 1.2 to define hypoxia positivity produced a mean sensitivity and specificity of 56.8% and 95.9%, respectively, with substantial interreader agreement (κ = 0.66), after initial instruction. After dedicated training, mean sensitivity improved to 89.6% whereas mean specificity remained high at 95.3%, with near-perfect interreader agreement (κ = 0.86). Conclusion: Nuclear medicine physicians without 18F-FMISO hypoxia PET reading experience demonstrate much improved interreader agreement with dedicated training using specific interpretation criteria.