{"title":"A Multi-Pronged Evaluation For Image Normalization Techniques","authors":"Tianqing Li, Leihao Wei, William Hsu","doi":"10.1109/ISBI48211.2021.9434007","DOIUrl":null,"url":null,"abstract":"While quantitative image features (radiomic) can be employed as informative indicators of disease progression, they are sensitive to variations in acquisition and reconstruction. Prior studies have demonstrated the ability to normalize heterogeneous scans using per-pixel metrics (e.g., mean squared error) and qualitative reader studies. However, the generalizability of these techniques and the impact of normalization on downstream tasks (e.g., classification) have been understudied. We present a multi-pronged evaluation by assessing image normalization techniques using 1) per-pixel image quality and perceptual metrics, 2) variability in radiomic features, and 3) task performance differences using a machine learning (ML) model. We evaluated a previously reported 3D generative adversarial network-based (GAN) approach, investigating its performance on low-dose computed tomography (CT) scans acquired at a different institution with varying dose levels and reconstruction kernels. While the 3D GAN achieved superior metric results, its impact on quantitative image features and downstream task performance did not result in universal improvement. These results suggest a more complicated relationship between CT acquisition and reconstruction parameters and their effect on radiomic features and ML model performance, which are not fully captured using per-pixel metrics alone. Our approach provides a more comprehensive picture of the effect of normalization.","PeriodicalId":372939,"journal":{"name":"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISBI48211.2021.9434007","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
While quantitative image features (radiomic) can be employed as informative indicators of disease progression, they are sensitive to variations in acquisition and reconstruction. Prior studies have demonstrated the ability to normalize heterogeneous scans using per-pixel metrics (e.g., mean squared error) and qualitative reader studies. However, the generalizability of these techniques and the impact of normalization on downstream tasks (e.g., classification) have been understudied. We present a multi-pronged evaluation by assessing image normalization techniques using 1) per-pixel image quality and perceptual metrics, 2) variability in radiomic features, and 3) task performance differences using a machine learning (ML) model. We evaluated a previously reported 3D generative adversarial network-based (GAN) approach, investigating its performance on low-dose computed tomography (CT) scans acquired at a different institution with varying dose levels and reconstruction kernels. While the 3D GAN achieved superior metric results, its impact on quantitative image features and downstream task performance did not result in universal improvement. These results suggest a more complicated relationship between CT acquisition and reconstruction parameters and their effect on radiomic features and ML model performance, which are not fully captured using per-pixel metrics alone. Our approach provides a more comprehensive picture of the effect of normalization.