Multi-modal image fusion for multispectral super-resolution in microscopy

Neel Dey; Shijie Li; Katharina Bermond; Rainer Heintzmann; Christine A. Curcio; Thomas Ach; Guido Gerig

doi:10.1117/12.2512598

15 March 2019 Multi-modal image fusion for multispectral super-resolution in microscopy

Neel Dey, Shijie Li, Katharina Bermond, Rainer Heintzmann, Christine A. Curcio, Thomas Ach, Guido Gerig

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 109490D (2019) https://doi.org/10.1117/12.2512598
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Spectral imaging is a ubiquitous tool in modern biochemistry. Despite acquiring dozens to thousands of spectral channels, existing technology cannot capture spectral images at the same spatial resolution as structural microscopy. Due to partial voluming and low light exposure, spectral images are often difficult to interpret and analyze. This highlights a need to upsample the low-resolution spectral image by using spatial information contained in the high-resolution image, thereby creating a fused representation with high specificity both spatially and spectrally. In this paper, we propose a framework for the fusion of co-registered structural and spectral microscopy images to create super-resolved representations of spectral images. As a first application, we super-resolve spectral images of ex-vivo retinal tissue imaged with confocal laser scanning microscopy, by using spatial information from structured illumination microscopy. Second, we super-resolve mass spectroscopic images of mouse brain tissue, by using spatial information from high-resolution histology images. We present a systematic validation of model assumptions crucial towards maintaining the original nature of spectra and the applicability of super-resolution. Goodness-of-fit for spectral predictions are evaluated through functional R² values, and the spatial quality of the super-resolved images are evaluated using normalized mutual information.

Citation Download Citation

Neel Dey, Shijie Li, Katharina Bermond, Rainer Heintzmann, Christine A. Curcio, Thomas Ach, and Guido Gerig "Multi-modal image fusion for multispectral super-resolution in microscopy", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109490D (15 March 2019); https://doi.org/10.1117/12.2512598

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available