An Integrated Dictionary-Learning Entropy-Based Medical Image Fusion Framework

Using of Laplacian Re-decomposition image fusion algorithm for glioma grading with SWI, ADC, and FLAIR images

Introduction: Based on the tumor’s growth potential and aggressiveness, glioma is most often classified into low or high-grade groups. Traditionally, tissue sampling is used to determine the glioma grade. The aim of this study is to evaluate the efficiency of the Laplacian Re-decomposition (LRD) medical image fusion algorithm for glioma grading by advanced magnetic resonance imaging (MRI) images and introduce the best image combination for glioma grading.

Material and methods: Sixty-one patients (17 low-grade and 44 high-grade) underwent Susceptibility-weighted image (SWI), apparent diffusion coefficient (ADC) map, and Fluid attenuated inversion recovery (FLAIR) MRI imaging. To fuse different MRI image, LRD medical image fusion algorithm was used. To evaluate the effectiveness of LRD in the classification of glioma grade, we compared the parameters of the receiver operating characteristic curve (ROC).

Results: The average Relative Signal Contrast (RSC) of SWI and ADC maps in high-grade glioma are significantly lower than RSCs in low-grade glioma. No significant difference was detected between low and high-grade glioma on FLAIR images. In our study, the area under the curve (AUC) for low and high-grade glioma differentiation on SWI and ADC maps were calculated at 0.871 and 0.833, respectively.

Conclusions: By fusing SWI and ADC map with LRD medical image fusion algorithm, we can increase AUC for low and high-grade glioma separation to 0.978. Our work has led us to conclude that, by fusing SWI and ADC map with LRD medical image fusion algorithm, we reach the highest diagnostic accuracy for low and high-grade glioma differentiation and we can use LRD medical fusion algorithm for glioma grading.

Preliminary study of multiple b-value diffusion-weighted images and T1 post enhancement magnetic resonance imaging images fusion with Laplacian Re-decomposition (LRD) medical fusion algorithm for glioma grading

•

LRD medical image fusion algorithm can be used for glioma grading.

•

We can use the LRD fusion algorithm with MRI image for glioma grading.

•

Fusing of DWI (b50) and T₁ enhancement (T₁Gd) by LRD, have highest diagnostic value for glioma grading.

Background

Grade of brain tumor is thought to be the most significant and crucial component in treatment management. Recent development in medical imaging techniques have led to the introduce non-invasive methods for brain tumor grading such as different magnetic resonance imaging (MRI) protocols. Combination of different MRI protocols with fusion algorithms for tumor grading is used to increase diagnostic improvement. This paper investigated the efficiency of the Laplacian Re-decomposition (LRD) fusion algorithms for glioma grading.

Procedures

In this study, 69 patients were examined with MRI. The T1 post enhancement (T1Gd) and diffusion-weighted images (DWI) were obtained. To evaluated LRD performance for glioma grading, we compared the parameters of the receiver operating characteristic (ROC) curves.

Findings

We found that the average Relative Signal Contrast (RSC) for high-grade gliomas is greater than RSCs for low-grade gliomas in T1Gd images and all fused images. No significant difference in RSCs of DWI images was observed between low-grade and high-grade gliomas. However, a significant RSCs difference was detected between grade III and IV in the T1Gd, b50, and all fussed images.

Conclusions

This research suggests that T1Gd images are an appropriate imaging protocol for separating low-grade and high-grade gliomas. According to the findings of this study, we may use the LRD fusion algorithm to increase the diagnostic value of T1Gd and DWI picture for grades III and IV glioma distinction. In conclusion, this article has emphasized the significance of the LRD fusion algorithm as a tool for differentiating grade III and IV gliomas.

Multi-Modality Medical Image Fusion Using Convolutional Neural Network and Contrast Pyramid

Medical image fusion techniques can fuse medical images from different morphologies to make the medical diagnosis more reliable and accurate, which play an increasingly important role in many clinical applications. To obtain a fused image with high visual quality and clear structure details, this paper proposes a convolutional neural network (CNN) based medical image fusion algorithm. The proposed algorithm uses the trained Siamese convolutional network to fuse the pixel activity information of source images to realize the generation of weight map. Meanwhile, a contrast pyramid is implemented to decompose the source image. According to different spatial frequency bands and a weighted fusion operator, source images are integrated. The results of comparative experiments show that the proposed fusion algorithm can effectively preserve the detailed structure information of source images and achieve good human visual effects.

Three-Layer Image Representation by an Enhanced Illumination-Based Image Fusion Method

The recently developed multiscale-based fusion methods can be improved with two approaches: an advanced image decomposition scheme and an advanced fusion rule. In this paper, three-layer image decomposition, enhanced illumination fusion rule-based method is proposed. The proposed method includes three steps. First, each input image is decomposed into its corresponding smooth, texture, and edge layers using defined local extrema and low-pass filters in the spatial domain. Second, three different strategies are applied as fusion rules for the three-layer representation. To preserve the illumination closely related to tumors, the illumination is corrected by applying a higher contrast to the decomposed image details, including the texture and edge inputs, such as those found in grayscale CT and MRI images. The final fused image is created by the addition of the normalized smooth, texture, and edge image layers. The experiments demonstrate that the proposed method performs better than the existing state-of-the-art fusion methods.

A New Dictionary Construction Based Multimodal Medical Image Fusion Framework

Training a good dictionary is the key to a successful image fusion method of sparse representation based models. In this paper, we propose a novel dictionary learning scheme for medical image fusion. First, we reinforce the weak information of images by extracting and adding their multi-layer details to generate the informative patches. Meanwhile, we introduce a simple and effective multi-scale sampling to implement a multi-scale representation of patches while reducing the computational cost. Second, we design a neighborhood energy metric and a multi-scale spatial frequency metric for clustering the image patches with a similar brightness and detail information into each respective patch group. Then, we train the energy sub-dictionary and detail sub-dictionary, respectively by K-SVD. Finally, we combine the sub-dictionaries to construct a final, complete, compact and informative dictionary. As a main contribution, the proposed online dictionary learning can not only obtain an informative as well as compact dictionary, but can also address the defects, such as superfluous patch issues and low computation efficiency, in traditional dictionary learning algorithms. The experimental results show that our algorithm is superior to some state-of-the-art dictionary learning based techniques in both subjective visual effects and objective evaluation criteria.

A Novel Multi-Exposure Image Fusion Method Based on Adaptive Patch Structure

Multi-exposure image fusion methods are often applied to the fusion of low-dynamic images that are taken from the same scene at different exposure levels. The fused images not only contain more color and detailed information, but also demonstrate the same real visual effects as the observation by the human eye. This paper proposes a novel multi-exposure image fusion (MEF) method based on adaptive patch structure. The proposed algorithm combines image cartoon-texture decomposition, image patch structure decomposition, and the structural similarity index to improve the local contrast of the image. Moreover, the proposed method can capture more detailed information of source images and produce more vivid high-dynamic-range (HDR) images. Specifically, image texture entropy values are used to evaluate image local information for adaptive selection of image patch size. The intermediate fused image is obtained by the proposed structure patch decomposition algorithm. Finally, the intermediate fused image is optimized by using the structural similarity index to obtain the final fused HDR image. The results of comparative experiments show that the proposed method can obtain high-quality HDR images with better visual effects and more detailed information.