Taebin Kim, Yao Li, Benjamin C Calhoun, Aatish Thennavan, Lisa A Carey, W Fraser Symmans, Melissa A Troester, Charles M Perou, J S Marron
{"title":"Stain SAN: simultaneous augmentation and normalization for histopathology images.","authors":"Taebin Kim, Yao Li, Benjamin C Calhoun, Aatish Thennavan, Lisa A Carey, W Fraser Symmans, Melissa A Troester, Charles M Perou, J S Marron","doi":"10.1117/1.JMI.11.4.044006","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>We address the need for effective stain domain adaptation methods in histopathology to enhance the performance of downstream computational tasks, particularly classification. Existing methods exhibit varying strengths and weaknesses, prompting the exploration of a different approach. The focus is on improving stain color consistency, expanding the stain domain scope, and minimizing the domain gap between image batches.</p><p><strong>Approach: </strong>We introduce a new domain adaptation method, Stain simultaneous augmentation and normalization (SAN), designed to adjust the distribution of stain colors to align with a target distribution. Stain SAN combines the merits of established methods, such as stain normalization, stain augmentation, and stain mix-up, while mitigating their inherent limitations. Stain SAN adapts stain domains by resampling stain color matrices from a well-structured target distribution.</p><p><strong>Results: </strong>Experimental evaluations of cross-dataset clinical estrogen receptor status classification demonstrate the efficacy of Stain SAN and its superior performance compared with existing stain adaptation methods. In one case, the area under the curve (AUC) increased by 11.4%. Overall, our results clearly show the improvements made over the history of the development of these methods culminating with substantial enhancement provided by Stain SAN. Furthermore, we show that Stain SAN achieves results comparable with the state-of-the-art generative adversarial network-based approach without requiring separate training for stain adaptation or access to the target domain during training. Stain SAN's performance is on par with HistAuGAN, proving its effectiveness and computational efficiency.</p><p><strong>Conclusions: </strong>Stain SAN emerges as a promising solution, addressing the potential shortcomings of contemporary stain adaptation methods. Its effectiveness is underscored by notable improvements in the context of clinical estrogen receptor status classification, where it achieves the best AUC performance. The findings endorse Stain SAN as a robust approach for stain domain adaptation in histopathology images, with implications for advancing computational tasks in the field.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"11 4","pages":"044006"},"PeriodicalIF":1.9000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11342968/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Imaging","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1117/1.JMI.11.4.044006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/23 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: We address the need for effective stain domain adaptation methods in histopathology to enhance the performance of downstream computational tasks, particularly classification. Existing methods exhibit varying strengths and weaknesses, prompting the exploration of a different approach. The focus is on improving stain color consistency, expanding the stain domain scope, and minimizing the domain gap between image batches.
Approach: We introduce a new domain adaptation method, Stain simultaneous augmentation and normalization (SAN), designed to adjust the distribution of stain colors to align with a target distribution. Stain SAN combines the merits of established methods, such as stain normalization, stain augmentation, and stain mix-up, while mitigating their inherent limitations. Stain SAN adapts stain domains by resampling stain color matrices from a well-structured target distribution.
Results: Experimental evaluations of cross-dataset clinical estrogen receptor status classification demonstrate the efficacy of Stain SAN and its superior performance compared with existing stain adaptation methods. In one case, the area under the curve (AUC) increased by 11.4%. Overall, our results clearly show the improvements made over the history of the development of these methods culminating with substantial enhancement provided by Stain SAN. Furthermore, we show that Stain SAN achieves results comparable with the state-of-the-art generative adversarial network-based approach without requiring separate training for stain adaptation or access to the target domain during training. Stain SAN's performance is on par with HistAuGAN, proving its effectiveness and computational efficiency.
Conclusions: Stain SAN emerges as a promising solution, addressing the potential shortcomings of contemporary stain adaptation methods. Its effectiveness is underscored by notable improvements in the context of clinical estrogen receptor status classification, where it achieves the best AUC performance. The findings endorse Stain SAN as a robust approach for stain domain adaptation in histopathology images, with implications for advancing computational tasks in the field.
目的:我们需要组织病理学中有效的染色域适应方法,以提高下游计算任务(尤其是分类)的性能。现有方法表现出不同的优缺点,促使我们探索不同的方法。重点在于提高染色剂颜色的一致性、扩大染色剂领域范围以及尽量缩小图像批次之间的领域差距:我们引入了一种新的领域适应方法--染色同步增强和归一化(SAN),旨在调整染色颜色的分布,使其与目标分布相一致。染色同步增强和归一化结合了染色归一化、染色增强和染色混合等既有方法的优点,同时又减少了它们固有的局限性。Stain SAN 通过从结构良好的目标分布中重新采样染色剂颜色矩阵来调整染色剂域:结果:对跨数据集临床雌激素受体状态分类的实验评估证明了 Stain SAN 的功效以及与现有染色适应方法相比的卓越性能。在一个案例中,曲线下面积(AUC)增加了 11.4%。总之,我们的研究结果清楚地表明,这些方法在发展过程中不断改进,最终由 Stain SAN 实现了大幅提升。此外,我们还表明,Stain SAN 所取得的结果可与最先进的基于生成式对抗网络的方法相媲美,而无需对染色适应进行单独训练,也无需在训练期间访问目标域。Stain SAN 的性能与 HistAuGAN 相当,证明了其有效性和计算效率:Stain SAN 是一种很有前途的解决方案,它解决了当代染色适应方法的潜在缺陷。在临床雌激素受体状态分类方面,Stain SAN 取得了最佳的 AUC 性能,其显著的改进凸显了它的有效性。研究结果证明,Stain SAN 是组织病理学图像染色域适应的一种稳健方法,对推进该领域的计算任务具有重要意义。
期刊介绍:
JMI covers fundamental and translational research, as well as applications, focused on medical imaging, which continue to yield physical and biomedical advancements in the early detection, diagnostics, and therapy of disease as well as in the understanding of normal. The scope of JMI includes: Imaging physics, Tomographic reconstruction algorithms (such as those in CT and MRI), Image processing and deep learning, Computer-aided diagnosis and quantitative image analysis, Visualization and modeling, Picture archiving and communications systems (PACS), Image perception and observer performance, Technology assessment, Ultrasonic imaging, Image-guided procedures, Digital pathology, Biomedical applications of biomedical imaging. JMI allows for the peer-reviewed communication and archiving of scientific developments, translational and clinical applications, reviews, and recommendations for the field.