Correlative three-dimensional fluorescence and refractive index tomography : bridging the gap between molecular specificity and quantitative bioimaging

Optical diffraction tomography (ODT) provides label-free three-dimensional (3D) refractive index (RI) measurement of biological samples. However, due to the nature of the RI values of biological specimens, ODT has limited access to molecular specific information. Here, we present an optical setup combining ODT with three-channel 3D fluorescence microscopy, to enhance the molecular specificity of the 3D RI measurement. The 3D RI distribution and 3D deconvoluted fluorescence images of HeLa cells and NIH-3T3 cells are measured, and the cross-correlative analysis between RI and fluorescence of live cells are presented. References and links 1. D. J. Stephens and V. J. Allan, "Light microscopy techniques for live cell Imaging," Science 300, 82-86 (2003). 2. E. Wolf, "Three-dimensional structure determination of semi-transparent objects from holographic data," Optics Communications 1, 153-156 (1969). 3. K. Kim, J. Yoon, S. Shin, S. Lee, S.-A. Yang, and Y. Park, "Optical diffraction tomography techniques for the study of cell pathophysiology," Journal of Biomedical Photonics & Engineering 2, 020201 (2016). 4. G. Popescu, Quantitative phase imaging of cells and tissues, McGraw-Hill biophotonics (McGraw-Hill, New York, 2011). 5. K. Lee, K. Kim, J. Jung, J. H. Heo, S. Cho, S. Lee, G. Chang, Y. J. Jo, H. Park, and Y. K. Park, "Quantitative phase imaging techniques for the study of cell pathophysiology: from principles to applications," Sensors 13, 4170-4191 (2013). 6. D. Kim, S. Lee, M. Lee, J. Oh, S.-A. Yang, and Y. Park, "Refractive index as an intrinsic imaging contrast for 3-D label-free live cell imaging," bioRxiv, 106328 (2017). 7. V. Lauer, "New approach to optical diffraction tomography yielding a vector equation of diffraction tomography and a novel tomographic microscope," Journal of Microscopy 205, 165-176 (2002). 8. M. Habaza, B. Gilboa, Y. Roichman, and N. T. Shaked, "Tomographic phase microscopy with 180 rotation of live cells in suspension by holographic optical tweezers," Optics letters 40, 1881-1884 (2015). 9. R. Horstmeyer, J. Chung, X. Ou, G. Zheng, and C. Yang, "Diffraction tomography with Fourier ptychography," Optica 3, 827-835 (2016). 10. P. P. Laissue, R. A. Alghamdi, P. Tomancak, E. G. Reynaud, and H. Shroff, "Assessing phototoxicity in live fluorescence imaging," Nature Methods 14, 657-661 (2017). 11. R. Barer, "Determination of dry mass, thickness, solid and water concentration in living cells," Nature 172, 1097-1098 (1953). 12. G. Popescu, Y. Park, N. Lue, C. Best-Popescu, L. Deflores, R. R. Dasari, M. S. Feld, and K. Badizadegan, "Optical imaging of cell mass and growth dynamics," Am J Physiol Cell Physiol 295, C538-544 (2008). 13. Y. Cotte, F. Toy, P. Jourdain, N. Pavillon, D. Boss, P. Magistretti, P. Marquet, and C. Depeursinge, "Marker-free phase nanoscopy," Nat. Photon. 7, 113117 (2013). 14. S. A. Yang, J. Yoon, K. Kim, and Y. Park, "Measurements of Morphological and Biophysical Alterations in Individual Neuron Cells Associated with Early Neurotoxic Effects in Parkinson's Disease," Cytometry Part A 91, 510-518 (2017). 15. S. Lee, H. Park, K. Kim, Y. Sohn, S. Jang, and Y. Park, "Refractive index tomograms and dynamic membrane fluctuations of red blood cells from patients with diabetes mellitus," Sci. Rep. 7, 1039 (2017). 16. H. Park, S. Lee, M. Ji, K. Kim, Y. Son, S. Jang, and Y. Park, "Measuring cell surface area and deformability of individual human red blood cells over blood storage using quantitative phase imaging," Sci. Rep. 6, 34257 (2016). 17. J. Hur, K. Kim, S. Lee, H. Park, and Y. Park, "Melittin-induced alterations in morphology and deformability of human red blood cells using quantitative phase imaging techniques," Sci Rep 7, 9306 (2017). 18. H. Park, S. H. Hong, K. Kim, S. H. Cho, W. J. Lee, Y. Kim, S. E. Lee, and Y. Park, "Characterizations of individual mouse red blood cells parasitized by Babesia microti using 3-D holographic microscopy," Sci. Rep. 5, 10827 (2015). 19. R. Chandramohanadas, Y. Park, L. Lui, A. Li, D. Quinn, K. Liew, M. Diez-Silva, Y. Sung, M. Dao, C. T. Lim, P. R. Preiser, and S. Suresh, "Biophysics of malarial parasite exit from infected erythrocytes," PLoS One 6, e20869 (2011). 20. J. Yoon, K. Kim, H. Park, C. Choi, S. Jang, and Y. Park, "Label-free characterization of white blood cells by measuring 3D refractive index maps," Biomed. Opt. Express 6, 3865-3875 (2015). 21. T. Kim, R. Zhou, M. Mir, S. D. Babacan, P. S. Carney, L. L. Goddard, and G. Popescu, "White-light diffraction tomography of unlabelled live cells," Nature Photonics 8, 256-263 (2014). 22. D. Kim, N. Oh, K. Kim, S. Lee, C.-G. Pack, J.-H. Park, and Y. Park, "Label-free high-resolution 3-D imaging of gold nanoparticles inside live cells using optical diffraction tomography," Methods (2017). . CC-BY 4.0 International license peer-reviewed) is the author/funder. It is made available under a The copyright holder for this preprint (which was not . http://dx.doi.org/10.1101/186734 doi: bioRxiv preprint first posted online Sep. 9, 2017;


Introduction
The three-dimensional (3D) imaging of biological cells and tissues has been an invaluable tool for investigating subcellular organelles and various biological mechanisms [1].Among them, optical diffraction tomography (ODT) or holotomography (HT) has emerged as an effective live-cell imaging technique [2,3].ODT reconstructs the 3D refractive index (RI) distribution of a sample.Because RI is an intrinsic optical property of materials, ODT enables the 3D imaging of live cells and tissues without using any exogenous labeling agents or preparation steps [4][5][6][7][8][9].This is important because the use of fluorescence proteins, quantum dots, or dye molecules inevitably introduces unwanted effects such as phototoxicity or photobleaching, and in some cases cells should be fixed for measurements [10].Furthermore, since the RI value of most biological specimen is linearly proportional to protein concentration [11,12], ODT provides quantitative information including protein concentration and dry mass.For these reasons, there are growing numbers of biological and medical studies employing ODT to investigate the physiology of various samples [3] including neuron cells [13,14], red blood cells [15][16][17], parasites in host cells [18,19], immune cells [20], bacteria [13,21], gold nanoparticles in live cells [22], embryos [23], live cells in a microfluidic channel [24][25][26], and blood cells in vivo [27].
While the measured 3D RI distribution provides the label-free analysis of cells and subcellular organelles, ODT offers limited molecular specificity.For instance, ODT can measure the protein concentration and dry mass of eukaryotic cells containing a variety of proteins, because most proteins have similar RI increment values [28].However, since the RI value itself does not provide molecular specific information which can be used to identify proteins and subcellular organelles, it is difficult to distinguish a specific protein inside each intracellular component based on the measured RI distribution.
Recently, several approaches have been proposed to enhance the molecular specificity of ODT.For example, the RI dispersion of samples was utilized [29].In addition, the segmentation with RI values has provided molecular specific information of distinct materials such as lipid droplets [30], polystyrene beads [20], and gold nanoparticles inside cells [22].More recently, multimodal approaches have been demonstrated.Combining structured illumination microscopy (SIM) [31,32] with ODT was demonstrated for addressing sub-diffraction-resolution molecular imaging [33].In addition, an integrated setup for fluorescence microscopy and ODT with a sample rotation scheme showed enhanced molecular specificity and an isotropic spatial resolution for 3D RI tomography [34].
In this paper, we present a method combining ODT with three-channel 3D fluorescence microscopy.Exploiting a Mach-Zehnder interferometry equipped with a dynamic micromirror device (DMD), 3D RI maps of a sample is measured with high speed and precision.Epi-fluorescence microscopy system is integrated into this system in order to simultaneously measured multi-channel 3D fluorescence image of the sample.To demonstrate the capability of the method, both the 3D RI tomograms and 3D fluorescence images were measured for HeLa cells and NIH-3T3 cells.Our results show that the RI values of cell nuclei could be either higher or lower than surrounding cytoplasm, depending on cell types.

Optical setup
The setup consists of ODT and epi-fluorescence microscopy in the same optical imaging system (Fig. 1).In order to measure the 3D RI distribution of a cell, ODT employing Mach-Zehnder interferometry was used [Fig.1(a)].A 532-nm diode-pumped solid-state laser beam (MSL-S-532-10mW, CNI laser, China) was coupled into a 22 fiber coupler (FUSED-12-532-3.5,OZoptics, Canada), and was split into two arms: a sample and a reference arm.The sample illumination beam was reflected by a DMD (DLP6500FYE, Texas Instruments, USA.The DMD diffracted the beam into several orders, among which the firstorder diffracted beam was collected by a tube lens and a condenser lens [Numerical aperture (NA) = 0.7, 60] to impinge onto the sample.The diffracted beam scattered by the sample was collected by an objective lens (NA = 0.8, 60) and a tube lens, and interfered with the reference beam to generate a spatially modulated hologram at a camera plane.For tomographic reconstruction, the illumination beam was circularly scanned with plane waves with 49 different azimuthal angles.To control the incident angle of the illumination beam, the DMD displays a 4-bit-depth amplitude grating pattern, in which a spatial groove corresponds to the spatial frequency of the tilted illumination beam.Each gray-scale amplitude grating pattern was generated by time-multiplexing four binary patterns, e.g., the Lee holograms [35,36].By displaying the four binary patterns sequentially during the camera exposure, unwanted diffraction patterns from the binary patterns were eliminated by time-multiplexed averaging [37].A high-speed DMD and camera were employed, and tomogram acquisition was executed within 0.4 sec.
3D fluorescence imaging was performed using the same optical setup [Fig.1(b)].Epifluorescence geometry was used for the excitation of the fluorescence probes and the measurements of emission signals.In order to excite fluorescence probes inside a sample, a multi-wavelength light-emitting diode (LED) source (center wavelength: B = 385 nm, G = 470 nm, R = 565 nm) was coupled to the optical setup using a three-channel dichroic mirror (Semrock FF409/493/596-Di01).During the fluorescence image acquisition, the DMD was turned off to avoid camera saturation and potential photobleaching by the laser beam.

Optical diffraction tomography algorithm
Figures 2(a)(e) show the procedure for 3D RI tomogram reconstruction using ODT.The ODT algorithm is an optical analogy to X-ray computed tomography.The 2D optical fields of a sample (NIH-3T3 cell) are retrieved from spatially modulated interferograms I(x, y) obtained with various illumination angles [Fig.2(a)].From the recorded interferograms, complex 2-D optical fields, consisting of both the amplitude |U| and the phase images U of the sample were retrieved by a field retrieval algorithm [38,39].Then from the multiple 2D optical fields, ODT reconstructs a 3D RI tomogram of the sample n(x, y, z) by inversely solving light diffraction at a weakly scattering sample [2], as shown in Fig. 2(d).For the purpose of visualization, pseudo coloring was applied based on the RI values [40].Because of the limited NAs for the condenser and objective lenses, a fraction of the light diffracted from the sample is not collected, resulting in missing information in the reconstruction.To address this issue, known as the missing cone problem, an iterative approach with the non-negativity constraint was used as a regularization algorithm [41].The detailed information for the ODT system and the tomogram reconstruction algorithms can be found elsewhere [40,42].In order to enhance the image contrast and the spatial resolution of the fluorescence images, 3D deconvolution was performed using commercial software (Huygens Professional, Scientific Volume Imaging b.v., the Netherlands), which exploits the iterative classic maximum likelihood estimation.The measured axial stacks of each fluorescence channel were deconvoluted using theoretical 3D point spread functions of the optical setup, which were calculated from optical parameters including the wavelength of the emission signals and the numerical aperture of the objective lens.As shown in Fig. 2(g), the deconvoluted fluorescence images show high image contrast compared to the raw epi-fluorescence images in Fig. 2(f).Then, the three-channel deconvoluted fluorescence images were merged in three-dimensions.The obtained fluorescence images of the sample in three channels were then merged into a single combined fluorescence image [Fig.2(h)], which can also be correlated with the independently measured 3D RI tomogram of the same sample [Fig.2(i)].
HeLa cells and NIH-3T3 cells were transfected with DNA plasmids (mCherry-C1 and GFP-Tubulin) using Lipofectamine LTX DNA Transfection Reagent (#15338-100) in a 12-well dish first and then the cells were subcultured in a culture dish (Tomodish, Tomocube Inc., Republic of Korea).The cells were stained with Hoechst (0.1 g/ml) and washed with fresh growth medium prior to imaging.

Combined 3D RI and 3D fluorescence images
Figure 3 presents the combined 3D RI and deconvoluted fluorescence images of HeLa cells and an NIH-3T3 cell.The 3D RI distribution of cells clearly shows both the overall cellular morphology and the subcellular structures including the nucleus, nucleoli, and intracellular vesicles.The three-channel deconvoluted fluorescence images provide high molecular specific images, presenting nuclei (blue), tubulin (green), and actin (red) inside the cells separately.In Fig. 3, individual cytoskeleton structures are not distinguishable, which might have resulted from the movements of live cells.
Since ODT and 3D deconvolution fluorescence microscopy employ the same optics setup, the 3D RI distribution and fluorescence images of cells are well-matched, which enables the identification of each subcellular component from the labelfree 3D RI distribution of the samples.For instance, the blue-channel fluorescence images clearly exhibit interior nucleus cells, which can also be identified by a visual inspection of the 3D RI distribution of cells.

Cross-correlative analysis of 3D RI and 3D fluorescence images
The present technique provides the cross-correlative analysis of 3D RI and 3D deconvoluted fluorescence images which enables localization of the 3D RI values of each subcellular region.The reconstructed 3D RI distributions of HeLa cells and an NIH-3T3 cell in Figs.4(a)(b) and Figs.4(d)(e), respectively, visually outline their internal structures including nucleus regions, nucleoli, and cytoplasmic regions inside the cells, while it can only be confirmed by comparing with the 3D deconvoluted fluorescence images in Fig. 4(c) and 4(f).Here, the nucleus regions stained with Hoechst can be identified in the blue channel, while cytoplasmic regions where most tubulin networks are located can be found in the green channel.From the measured 3D RI and 3D deconvoluted fluorescence images, the 3D RI distributions of each nucleus and cytoplasmic region were measured separately.In the 3D deconvoluted fluorescence images, the nucleus and cytoplasmic regions of each cell were segmented by voxels which had fluorescence signals higher than the background values in the blue and green channel fluorescence images, respectively.Then, the segmented subcellular regions in the 3D fluorescence images were employed as filtering masks in the RI tomograms of the cells, which provide the 3D RI distribution of each subcellular region.
To demonstrate the potential of the correlative images, we compared the RI values of the nucleus of the HeLa and the NIH-3T3 cell.In the HeLa cell, the overall values of the nucleus were smaller than that of the cytoplasm.Although the RI values of the nucleolus are compatible to that of the cytoplasm, the RI values of the nucleoplasm including chromatin are significantly smaller than the average RI value of the cytoplasm.However, the NIH-3T3 cell shows that the RI values of nucleoplasm are compatible to that of the cytoplasm, while the RI value of the nucleoli is higher than the average value of the nucleoplasm.

RI value of the nucleoplasm
To further analyze the RI value of the nucleus, the RI histograms of the nucleus and cytoplasmic regions in HeLa cells (n = 4) and NIH-3T3 cells (n = 6) are shown in Fig. 5(a) and 5(b), respectively.As shown in the cases of individual cell images (Fig. 4), the RI values of the nucleoplasm and nucleus of most of the HeLa cells are lower the average values of cytoplasm, whereas those of the NIH 3T3 cells are higher than that of cytoplasm.Previously, a body of papers reported that the RI values of nuclei are lower than the surrounding cytoplasm [34,[43][44][45], whereas several other papers provide results indicating the RI values of the nuclei are higher than the cytoplasm [46][47][48].This series of papers in two groups seem to contact with each other.However, our results show that RI values of nuclei can be lower or higher than surrounding cytoplasm.The results clearly show that whether RI values of nuclei is higher or lower than the surrounding cytoplasm can be affected by the types of cell.
Furthermore, the high-resolution measurements of 3D RI and 3D fluorescence images also indicate that even in nuclei significant spatial variation in RI values occurs, as shown in Fig. 4. In particular, the chromatin structures exhibit higher RI values than the nucleoplasm in both the NIH-3T3 and Hela cells.

Discussion and Conclusion
Here, we present a method for measuring both the 3D RI distribution and three-channel 3D fluorescence image of live cells.Employing a combined optical setup for ODT and epi-fluorescence microscopy, 3D RI tomograms and three-channel 3D deconvoluted fluorescence images of biological cells were measured with high spatial resolution.Since both microscopic imaging modalities share the same optical setup, the present approach enables direct measurement and precise analysis for correlative imaging.Like PET/CT provides both the morphological and molecule specific imaging in medical diagnosis, the present method is an optical analogy which provides both morphological and molecular imaging of biological cells.To demonstrate the capability of the method, both 3D RI tomograms and 3D fluorescence images of HeLa cells and NIH-3T3 cells were obtained.Our results clearly demonstrate that the use of both 3D RI and fluorescence images provide comprehend and also complementary information about cell physiology.In addition, our results show that the RI values of cell nuclei can be either higher or lower than the surrounding cytoplasm, depending on the cell types.
As the experimental results show, the addition of 3D fluorescence images provides molecular specific information about the live cells, together with the morphological, biophysical, and biomechanical properties that ODT provides.Furthermore, the ability to measure three-channel 3D fluorescence information can provide useful information when correlated with RI tomograms of the cell.These two different modalities are complementary to each other, and will allow various biological studies where the systematic investigation of subcellular structures and their dynamics are critical.
This new instrument has several potential applications, one of which we explain here; tracking and imaging subcellular organelles such as mitochondria or chromatins for a long period of time.An initial measurement using 3D fluorescence imaging enables the localization of specific subcellular structures exploiting molecular specificity.Then, consecutive measurements using dynamic 3D RI tomograms of live cells can allow tracking and imaging these target organelles over an extended time period with minimal exposure to the issues of phototoxicity and photodamaging.Furthermore, the ability to obtain fast timelapse measurements (up to 100 tomograms per second) using ODT makes it possible to visualize biologically important dynamics which cannot be accessed by fluorescence imaging techniques [49].
The present instrument can be further improved to enhance acquisition speed.Currently, it takes approximately 1 second to acquire a single-channel fluorescence image at one axial position.Consequently, the total acquisition time for three-channel fluorescence images axially scanned with a step size of 469 nm and a scanning distance of 15 m would take 100 seconds, which might be an issue for fast dynamics measurements.The use of a sensitive and fast image sensor such as a scientific CMOS sensor would further enhance acquisition speed.In addition, the present method can also be combined with optical manipulation.By doing so, specific parts of live cells can be identified first with ODT and 3D fluorescence images, which are then optically controlled for other purposes [50,51].

Figure 2 .
Figure 2. A schematic diagram of the ODT reconstruction (a-e) and correlative microscopy with 3D fluorescence imaging (f-h).(a) Raw holograms of an NIH-3T3 cell obtained with various illumination angles.(b) Amplitude and (c) phase map of the complex optical fields of the cell.(d) The cross-sectional slices and (e) the 3D rendered map of the reconstructed 3D RI distribution of the sample.(f) Axially stacked three-channel epi-fluorescence images of the same cell.(g) The fluorescence images of the cell after 3D deconvolution.(h) The fluorescence image merged with three-channel deconvoluted fluorescence images.(i) The 3D rendered map of the 3D RI distribution and three-channel fluorescence images for correlative analysis.Scale bar indicates 20 m.

2. 3
3D fluorescence image acquisition To acquire 3D fluorescence images, the sample stage was scanned along the axial direction with a step size of 469 nm and a scanning distance of 15 m.At each axial position, the LED source switched the excitation wavelength of the LED, and measured multi-channel emission signals sequentially.Typically, the camera was exposed for 1 s to acquire a single-channel fluorescence image at one axial position.Figures 2(f)(h) show the procedures for the 3D multichannel fluorescence microscopy.The same NIH-3T3 cell used in Figs.2(a)(e) was imaged using the 3D fluorescence imaging mode.The nucleus, mitochondria, and actin are labeled with DAPI, green fluorescence proteins (GFP-Mito), and mCherry-C1, respectively, and excited with three LED sources with different spectra (center wavelengths are 385 nm, 470 nm, and 565 nm), respectively.Figure 2(f) shows the acquired 2D fluorescence images of the sample at the focal position of z = 2 m, 0 m, and -2 m.

Figure 3 .
Figure 3. (a, c) The 3D rendered map of the 3D RI distribution and (b, d) 3D deconvoluted three-channel fluorescence image of a HeLa cell and an NIH-3T3 cell, respectively.Scale bar indicates 20 m.

Figure 4 .
Figure 4. Cross-correlative analysis of 3D RI and 3D fluorescence images of (a-c) a HeLa cell and (d-f) an NIH-3T3 cell.(a, e) The cross-sectional slices and (b, f) the 3D rendered map of reconstructed 3D RI distribution of the samples.Scale bar indicates 20 m.(c, g) The 3D deconvoluted fluorescence images of the samples stained with Hoechst (blue) and GFP-tubulin (green).

Figure 5 .
Figure 5. Histograms of RI values in the nucleus and cytoplasm of HeLa cells (a) and NIH-3T3 cells (b) (n = 4 for HeLa cells, n = 6 for NIH-3T3 cells)