Deep Learning-Based Medical Image Fusion Using Integrated Joint Slope Analysis with Probabilistic Parametric Steered Image Filter

Abstract

Medical image fusion plays a significant role in medical diagnosis applications. Although the conventional approaches have produced moderate visual analysis, still there is a scope to improve the performance parameters and reduce the computational complexity. Thus, this article implemented the hybrid fusion method by using the novel implementation of joint slope analysis (JSA), probabilistic parametric steered image filtration (PPSIF), and deep learning convolutional neural networks (DLCNNs)-based SR Fusion Net. Here, JSA decomposes the images to estimate edge-based slopes and develops the edge-preserving approximate layers from the multi-modal medical images. Further, PPSIF is used to generate the feature fusion with base layer-based weight maps. Then, the SR Fusion Net is used to generate the spatial and texture feature-based weight maps. Finally, optimal fusion rule is applied on the detail layers generated from the base layer and approximate layer, which resulted in the fused outcome. The proposed method is capable of performing the fusion operation between various modalities of images, such as MRI-CT, MRI-PET, and MRI-SPECT combinations by using two different architectures. The simulation results show that the proposed method resulted in better subjective and objective performance as compared to state of art approaches.