Phase-space measurement for depth-resolved memory-effect imaging

: Random scattering of light by a turbid layer prevents conventional imaging of objects hidden behind it. Angular correlations in the scattered light, created by the so-called optical memory effect, have been shown to enable computational image retrieval of hidden sources. However, basic memory-effect imaging contains no spatial ( x ) information, as only angular ( k -space) measurements are made. Here, we use windowed Fourier transforms to record scattered-light images in the full { x , k } phase space. The result is the ability to discriminate size and depth of individual sources that are hidden behind a thin scattering layer.


Introduction
The scattering of light by optically inhomogeneous random media is encountered in many imaging contexts, such as clouds and fog in photography, atmospheric turbulence in astronomy, and biological tissue in microscopy.Typically, scattering ruins image quality, degrading the correspondence of the spatial distribution of detected light with that of its source.Progress in adaptive optics, wavefront shaping, and computational imaging has led to methods of reestablishing correspondence, both optically and digitally [1][2][3][4][5][6][7].Methods to overcome scattering rely on understanding of the scattering process to varying degrees.At one extreme, knowledge of the medium can be leveraged to undo the effect of scattering, for example through inversion of the transmission matrix [8], phase conjugation [9], or nonlinear instability [10,11].However, in cases where microstructural knowledge is unobtainable or measurement is impractical, correlative or statistical properties of the scattered light may still be sufficient to enable image recovery [12].
Light scattered by random media retains information about the illuminating source in the form of correlations.One remarkable example is the optical memory effect [13,14] in which the angular spectrum of the scattered light co-varies with the angle of incident light, a correlation which persists even into the multiply scattered regime.The memory effect has enabled imaging through scattering by optical phase correction with wavefront shaping [15,16], as well as by computational image retrieval with iterative algorithms adapted from classic techniques in astronomy [17,18].A limitation of image retrieval studies based on memory-effect correlations alone is that the recovered images have been functions of illumination angle only.As such, pixels are intensities associated with angles of incidence relative to the scattering surface, and this data alone does not specify where in space the light originates.The problem has a simple analogy to that of perspective in photography, in which each pixel collects parallel rays of a given direction.In such photographs, the human viewer can interpret relative size and distance based on the content of the image, such as location of the horizon, but the image acquisition itself cannot separate these factors.Here, we supplement the intensity image retrieved from memory-effect correlations with phase-space measurement [19] of spatio-angular correlations to discriminate axial depth, analogous to taking photographs from multiple viewing angles, to obtain the distance and size of the source.

Phase-space measurement of scattered light
As shown in Fig. 1, we construct an {x,k} phase-space microscope using a spatial light modulator (SLM).As a simple lens at the f-f Fourier condition would transform all position coordinates {x} to angular coordinates {k}, we use amplitude modulation on the SLM to produce windowed (local) Fourier transforms of the field in the microscope focal plane (Fig. 1a).More specifically an amplitude mask on the SLM blocks light outside of a transmission window (details can be found in Ref [19].).The field within the modulated region is optically Fourier transformed by a 2f lens, and the intensity in the Fourier plane (k-space) is imaged by a CCD sensor (7.4 μm pixel size, 4 MP, Photometrics CoolSNAP K4).A second CCD sensor placed in a 4f image plane of the SLM permits imaging of the spatial (x-space) distribution of intensity within the windowed region.As a demonstration of a square-windowed Fourier transform, a collimated laser beam produces the image of the window on the x-space sensor and the corresponding far-field intensity of a plane wave on the k-space sensor (Fig. 1b).After inserting a ground glass diffuser (120-grit, Thorlabs DG20-120) in the focal plane, we observed scattering of the beam as coherent speckle in k-space (Fig. 1c).Phase variation due to the diffuser randomizes the correspondence between the x-space and k-space intensities.Without microstructural knowledge of the diffuser, the k-space intensity cannot be predicted from the x-space intensity alone, and without compensation or processing, the random distortion of the wavefront prevents direct imaging.

Correlations in scattered light
To demonstrate memory-effect correlations between neighboring source points, we focused a laser through a long working distance, 0.7 NA objective to a focus 1mm behind the diffuser, creating a point source which we then translated laterally on a manual stage.Lateral translation produced a corresponding shift in the k-space speckle (Fig. 2(a)).We compared the cross-correlation of the shifted and reference speckle with the results of numerical simulation of wave scattering by a simulated diffuser (Fig. 2(b)).Theoretically, the normalized crosscorrelation of the speckle produced by incident illumination differing by an angle, k depends on the magnitude of the difference, k Δ , and the thickness of the scattering medium, In our simulation, we used an idealized scattering layer with L = 0; correspondingly, the simulated speckle remained fully correlated (C = 1) along the line Experimentally, we found that C declined to 80% over a source translation distance of 300μm, corresponding to an angular shift of 0.5μm −1 .Thus, the random speckle remains strongly correlated between source points separated by hundreds of microns, though subject to noise from speckle degradation.Shiftinvariance of the speckle with respect to source position implies that the k-space intensity, I k , of scattered light from a planar, incoherent source can be represented as a convolution of the source shape, O, with the intensity pattern of coherent speckle from an individual point source, S, so that k I O S = ⊗ .As was noted, however, this convolution occurs in k-space, which mixes the independent factors of lateral position and axial depth.Correlations that depend on propagation distance, and therefore axial depth alone, can be detected in phase space.Whereas memory-effect correlations originate in the scattering process itself, correlations arising from the spatial coherence of the incident light prior to scattering may be retained in the scattered light.To demonstrate preservation and detection of spatial coherence in the scattered light, we scanned the phase-space window over the surface of the diffuser.For a fixed position of the source, lateral translation of the window produced a shift in the average k-space distribution, revealing partial spatial coherence retained through scattering (Fig. 2(c)).
Spatial coherence can be represented formally by the equal-time, two-point correlation of the complex field, ( ) ( ) ( ) , where J is the mutual intensity and denotes an ensemble average over the statistical field, E(r), defined over the spatial coordinate, r [20].
Our phase-space measurement does not sample the mutual intensity directly but rather measures its equivalent representation in phase space, the optical Wigner distribution function (WDF), , which has the form of a Fourier transform of J over the transverse spatial variable ξ centered on x.A primary advantage of working in phase space is that parameterization in spatial and angular coordinates, {x,k}, makes phase space a natural setting for describing and analyzing spatio-angular correlations.
In fact, the scanning window used here samples a filtered version of the WDF, due to the finite extent of the aperture, known as the spatial spectrogram.The spectrogram, P S , can be derived from the WDF by filtering with an appropriate phase-space kernel [22]


, where H is the WDF of the window function.
Implicit in this convolution is a tradeoff between spatial and angular resolution which depends on the shape of the window.Window size determines both the spatial and angular width of the filter kernel, H.In particular, the finite spatial width of the window limits angular resolution in k-space measurement, and limited k-space resolution can lead to blurring of small, distant objects which require fine angular discrimination.With the square window, the limit on object lateral resolution is o x z D λ Δ > , which for an axial depth z ~1mm and window size D = 64μm limits image recovery to planar sources of sizes >  10μm.We simulated the phase space of the scattered light by calculating P for the field at the diffuser surface.In the absence of scattering, P S of the freely propagating field is a sheared line with a slope determined by the axial distance of the source to the focal plane.In both simulation and the experimental data, we found scattering leads to vertical (k-axis) line broadening, but the slope of the average P S is unchanged, reflecting the depth of the point source behind the scattering layer (Fig. 2(d)).

Image retrieval from angular correlations
To demonstrate image retrieval of incoherent samples at different depths, we created an incoherent source in the shape of a letter by imaging a lamp-illuminated "P" or "U", separately measured in independent experiments, to planes at ~1.4mm and ~1mm, respectively, behind the surface of the diffuser (Fig. 1(a)).Individual images taken by the CCD sensor displayed complex k-space intensity, I k , resulting from convolution of the source shape with random speckle from the diffuser (Fig. 3(a)).By moving the phase-space window to a non-overlapping region of the diffuser, we obtained statistically independent speckle.We combined images from up to 15  Fourier domain, this method is conceptually identical to the speckle interferometry developed by Labeyrie for stellar imaging through atmospheric turbulence [23].
Through the Weiner-Khinchin theorem, the power spectral density of the source distribution,

2
O  , can be obtained from the Fourier transform of O O * .In order to specify the source distribution, the Fourier modulus, O  , requires missing phase information.The phase can be recovered computationally through Fienup-type retrieval algorithms which enable iterative reconstruction of phase from the Fourier modulus and satisfaction of constraints, typically that intensity is real-valued and non-negative [24].We computationally recovered the source distribution from the average autocorrelation by an iterative phase retrieval procedure slightly modified from that of Bertolotti, et al. [17] (Fig. 3(c)).
Comparison of the retrieved images with images directly obtained of the source letters showed good agreement of shape and relative contrast (Fig. 3(d)).However, the quantitative size of the retrieved image cannot be determined without knowledge of source distance.

Depth and size measurement of hidden source
From the fitted slope, a, we calculated the source distance from the diffuser as ( ) The calculated values (0.9 mm and 1.

Conclusion
Phase-space measurement of scattered light provides simultaneous spatial and angular resolution, which is the essential feature for resolving spatio-angular correlations for depth and size calibration.In the experiments above, the spatial dependence of the angular spectrum resulted from the spatial coherence of the incident light.Each non-overlapping region of the diffuser was an identically distributed and statistically independent scattering configuration, which permitted us to form averages and recover an image from the data acquired in a single phase-space measurement.The statistics of scattering media need not be spatially homogeneous, and one potentially interesting application of this technique would be in performing image recovery in media of spatially varying scattering statistics.
Although we considered image recovery of only individual planar sources, the ability to resolve depth raises the possibility of separating source planes in a composite setting.Solving the 3-dimensional problem will likely require new computational tools, in particular computational methods operating in phase space.

Fig. 1 .
Fig. 1.Experimental setup and phase-space measurement of scattered light.(a) Schematic of experimental setup.A ground glass diffuser is illuminated by a coherent laser beam for speckle imaging or, in image retrieval experiments, by the incoherent, de-magnified image of an individual cutout shape ("P" or "U") illuminated by a bandpass-filtered lamp.The diffuser surface is imaged by a microscope objective (obj: 50x, 0.9 NA) and tube lens (TL: f = 120 mm) onto a LCOS spatial light modulator (SLM, Holoeye LCR-2500) configured for amplitude modulation.The field reflected from the SLM is imaged onto the x-space CCD sensor and optically Fourier transformed onto the k-space CCD.Pol: linear polarizer.PBS: polarizing beam splitter.(b) Top: x-space CCD image of the 64 μm-wide square window illuminated with a collimated laser.Bottom: k-space CCD image showing the far-field intensity of the square window.(c) Top: x-space image of a windowed region of the scattered light from the diffuser.Bottom: k-space image of the far-field random speckle produced by the scattered light.

Fig. 2 .
Fig. 2. Correlations in scattered light.(a) Composite speckle images from a point source moved between two positions (red and green) laterally separated by 200μm.(b) Grayscale values from simulated cross-correlation along the vertical axis (k-axis) as a function of source position (x oaxis).Blue circles show the cross-correlation peaks measured in experiment.(c) Composite average speckle images from the square window moved between two positions (red and green) on the diffuser surface separated by 500μm.(d) Red and blue pseudo-colored grayscale values from the simulated average spectrogram distribution, ( ) , S P x k , as a function of angle along the vertical axis (k-axis) and window position (x s -axis) for z 1 = 1mm (blue) and z 2 = 1.4mm (red).Thin lines are P S for unscattered, fully spatially coherent light.Experimental data for z ≈1mm are plotted as blue circles with bars representing the angular spread of the measured distribution.
window positions to estimate the ensemble-averaged autocorrelation, shows that the ensembleaveraged autocorrelation of speckle, S S * , acts as a linear filter on the object autocorrelation, O O * , to produce the average autocorrelation of k-space intensity, k k I I * .Though S is random for each individual image, S S * is a sharply peaked function that allows for direct estimation of O O * through measuring k k I I * .When described in the

Fig. 3 .
Fig. 3. Image retrieval from angular correlations.(a) Top and bottom: CCD image of k-space intensity, I k , of scattered light for two different source shapes at different distances.(b) k k I I * of CCD images, as in (a), taken over non-overlapping scattering regions.(c) Computationally recovered images from autocorrelations in (b).(d) Ground-truth images taken of sources.

Fig. 4 .
Fig. 4. Phase-space measurement of spatio-angular correlations.(a) x-space image of incoherent source hidden behind the diffuser and outline of phase-space window at four positions.(b) Pseudo-colored CCD images taken through windows in (a) of two different sources ("P", red, top panels; "U", blue, bottom panels) at two different distances.Dashed white line is the k x -axis.(c-d) P S of scattered light acquired by scanning the phase-space window along one spatial axis (x).The vertical axis is the line profile of intensity (k x ) measured from CCD images (dashed line in (b)), and the horizontal axis is the position of the window.(e) Position of peak of the angular spectra along the k x -axis in and (d) with linear fits to determine slopes.Error bars are the experimentally measured uncertainty of the peak contributed by variability of the diffuser.
3 mm) match well the known source displacements (1 mm and 1.4 mm).In turn, the source distance, z, allows calibration of the angular image data.Converting angular pixel size, k p , to spatial pixel size, x p , according to p image allows a direct comparison of the size of the source with that of the image retrieved from its scattered light (Fig.5).

Fig. 5 .
Fig. 5. Depth and size of hidden source.(a) Image taken directly of "P"-(top) and "U"-(bottom) shaped source for comparison with recovered image.(b) Recovered image data from Fig. 3(c) with pixel size calibration by source depth measured in Fig. 4(e).(c) Line profiles taken through the images as shown in (a) and (b).