{"title":"Computational Synthesis of Histological Stains: A Step Toward Virtual Enhanced Digital Pathology","authors":"Massimo Salvi, Nicola Michielli, Lorenzo Salamone, Alessandro Mogetta, Alessandro Gambella, Luca Molinaro, Mauro Papotti, Filippo Molinari","doi":"10.1002/ima.23165","DOIUrl":null,"url":null,"abstract":"<p>Histological staining plays a crucial role in anatomic pathology for the analysis of biological tissues and the formulation of diagnostic reports. Traditional methods like hematoxylin and eosin (H&E) primarily offer morphological information but lack insight into functional details, such as the expression of biomarkers indicative of cellular activity. To overcome this limitation, we propose a computational approach to synthesize virtual immunohistochemical (IHC) stains from H&E input, transferring imaging features across staining domains. Our approach comprises two stages: (i) a multi-stage registration framework ensuring precise alignment of cellular and subcellular structures between the source H&E and target IHC stains, and (ii) a deep learning-based generative model which incorporates functional attributes from the target IHC stain by learning cell-to-cell mappings from paired training data. We evaluated our approach of virtual restaining H&E slides to simulate IHC staining for phospho-histone H3, on inguinal lymph node and bladder tissues. Blind pathologist assessments and quantitative metrics validated the diagnostic quality of the synthetic slides. Notably, mitotic counts derived from synthetic images exhibited a strong correlation with physical staining. Moreover, global and stain-specific metrics confirmed the high quality of the synthetic IHC images generated by our approach. This methodology represents an important advance in automated functional restaining, achieved through robust registration and a model trained on precisely paired H&E and IHC data to transfer functions cell-by-cell. Our approach forms the basis for multiparameter histology analysis and comprehensive cohort staining using only digitized H&E slides.</p>","PeriodicalId":14027,"journal":{"name":"International Journal of Imaging Systems and Technology","volume":"34 5","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ima.23165","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Imaging Systems and Technology","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ima.23165","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Histological staining plays a crucial role in anatomic pathology for the analysis of biological tissues and the formulation of diagnostic reports. Traditional methods like hematoxylin and eosin (H&E) primarily offer morphological information but lack insight into functional details, such as the expression of biomarkers indicative of cellular activity. To overcome this limitation, we propose a computational approach to synthesize virtual immunohistochemical (IHC) stains from H&E input, transferring imaging features across staining domains. Our approach comprises two stages: (i) a multi-stage registration framework ensuring precise alignment of cellular and subcellular structures between the source H&E and target IHC stains, and (ii) a deep learning-based generative model which incorporates functional attributes from the target IHC stain by learning cell-to-cell mappings from paired training data. We evaluated our approach of virtual restaining H&E slides to simulate IHC staining for phospho-histone H3, on inguinal lymph node and bladder tissues. Blind pathologist assessments and quantitative metrics validated the diagnostic quality of the synthetic slides. Notably, mitotic counts derived from synthetic images exhibited a strong correlation with physical staining. Moreover, global and stain-specific metrics confirmed the high quality of the synthetic IHC images generated by our approach. This methodology represents an important advance in automated functional restaining, achieved through robust registration and a model trained on precisely paired H&E and IHC data to transfer functions cell-by-cell. Our approach forms the basis for multiparameter histology analysis and comprehensive cohort staining using only digitized H&E slides.
期刊介绍:
The International Journal of Imaging Systems and Technology (IMA) is a forum for the exchange of ideas and results relevant to imaging systems, including imaging physics and informatics. The journal covers all imaging modalities in humans and animals.
IMA accepts technically sound and scientifically rigorous research in the interdisciplinary field of imaging, including relevant algorithmic research and hardware and software development, and their applications relevant to medical research. The journal provides a platform to publish original research in structural and functional imaging.
The journal is also open to imaging studies of the human body and on animals that describe novel diagnostic imaging and analyses methods. Technical, theoretical, and clinical research in both normal and clinical populations is encouraged. Submissions describing methods, software, databases, replication studies as well as negative results are also considered.
The scope of the journal includes, but is not limited to, the following in the context of biomedical research:
Imaging and neuro-imaging modalities: structural MRI, functional MRI, PET, SPECT, CT, ultrasound, EEG, MEG, NIRS etc.;
Neuromodulation and brain stimulation techniques such as TMS and tDCS;
Software and hardware for imaging, especially related to human and animal health;
Image segmentation in normal and clinical populations;
Pattern analysis and classification using machine learning techniques;
Computational modeling and analysis;
Brain connectivity and connectomics;
Systems-level characterization of brain function;
Neural networks and neurorobotics;
Computer vision, based on human/animal physiology;
Brain-computer interface (BCI) technology;
Big data, databasing and data mining.