Abstract
Background: Medical image fusion is very important for the diagnosis and treatment of diseases. In recent years, there have been a number of different multi-modal medical image fusion algorithms that can provide delicate contexts for disease diagnosis more clearly and more conveniently. Recently, nuclear norm minimization and deep learning have been used effectively in image processing.
Methods: A multi-modality medical image fusion method using a rolling guidance filter (RGF) with a convolutional neural network (CNN) based feature mapping and nuclear norm minimization (NNM) is proposed. At first, we decompose medical images to base layer components and detail layer components by using RGF. In the next step, we get the basic fused image through the pretrained CNN model. The CNN model with pre-training is used to obtain the significant characteristics of the base layer components. And we can compute the activity level measurement from the regional energy of CNN-based fusion maps. Then, a detail fused image is gained by NNM. That is, we use NNM to fuse the detail layer components. At last, the basic and detail fused images are integrated into the fused result.
Results: From the comparison with the most advanced fusion algorithms, the results of experiments indicate that this fusion algorithm has the best effect in visual evaluation and objective standard.
Conclusion: The fusion algorithm using RGF and CNN-based feature mapping, combined with NNM, can improve fusion effects and suppress artifacts and blocking effects in the fused results.
Keywords: Medical image fusion, rolling guidance filter, nuclear norm minimization, shared similarity patches, convolutional neural network, deep learning.
Graphical Abstract
Call for Papers in Thematic Issues
Intelligent Information Retrieval for Multispectral and Hyperspectral Imaging
Multispectral and hyperspectral imaging is an interdisciplinary research area, widely focuses on spectral, spatial, and temporal data. It offers a plethora of opportunities to efficiently analyze the vast area of the earth's surface. However, there are numerous factors such as dimensionality and size of the hyperspectral data, lesser training samples, ...read more
Machine and Deep Learning in Medical Image Diagnosis
Medical Image Processing regards a set of methodologies that have been developed over recent years with the purpose of improving medical image quality, improving medical data visualization, understanding, and assisting medical diagnosis, and so on. The application of machine and deep learning methods in sensing and imaging can potentially have ...read more
Quantum Machine Learning for Medical Data and Imaging
Quantum computing has promised a significant speedup in certain computationally intensive tasks that are intractable on classical computers. Researchers in quantum machine learning, such as those working in computer vision, image processing, biomedical analysis, and related topics, may play an important role in comprehending and working on complicated medical data, ...read more
32
1