Method of multiple references for 3 D imaging with Fourier transform interferometry

This letter presents an improved phase referencing technique, called Method of Multiple References, for optical profilometry. Based on a lookup table, the method eliminates several major drawbacks of singlereference Fourier Transform Interferometry by enabling surface error correction for steep slopes and step discontinuities, and by allowing mapping of multiple discrete objects using a single image set. The algorithm is tested using a fiber optic coupler-based FTI system and shown to have RMS surface error less than 0.03mm. ©2010 Optical Society of America OCIS codes: (110.2350) Fiber optics imaging, (110.2650) Fringe analysis, (110.3175) Interferometric imaging, (110.6880) Three-dimensional image acquisition. References and links 1. F. Chen, G. Brown, and M. M. Song, “Overview of three-dimensional shape measurement using optical methods,” Opt. Eng. 39(1), 10–22 (2000). 2. T. L. Pennington, H. Xiao, R. May, and A. Wang, “Miniaturized 3-D surface profilometer using a fiber optic coupler,” Opt. Laser Technol. 33(5), 313–320 (2001). 3. M. Takeda, and K. Mutoh, “Fourier transform profilometry for the automatic measurement of 3-D object shapes,” Appl. Opt. 22(24), 3977–3982 (1983). 4. T. Judge, “A review of phase unwrapping techniques in fringe analysis,” Opt. Lasers Eng. 21(4), 199–239 (1994). 5. T. L. Pennington, “Miniaturized 3-D Mapping System Using a Fiber Optic Coupler as a Young's Double Pinhole Interferometer,” PhD, Electrical Engineering, Virginia Tech, Blacksburg (2000). 6. D. C. Ghiglia, G. A. Mastin, and L. A. Romero, “Cellular-automata method for phase unwrapping,” J. Opt. Soc. Am. A 4(1), 267–280 (1987). 7. J. M. Huntley, “Noise-immune phase unwrapping algorithm,” Appl. Opt. 28(16), 3268–3270 (1989). 8. H. E. Cline, W. E. Lorensen, and A. S. Holik, “Automatic moire contouring,” Appl. Opt. 23(10), 1454–1459 (1984). 9. H. O. Saldner, and J. M. Huntley, “Profilometry using temporal phase unwrapping and a spatial light modulatorbased fringe projector,” Opt. Eng. 36(2), 610–615 (1997). 10. K. Itoh, “Analysis of the phase unwrapping algorithm,” Appl. Opt. 21(14), 2470 (1982). 11. W. W. Macy, Jr., “Two-dimensional fringe-pattern analysis,” Appl. Opt. 22(23), 3898–3901 (1983).


Introduction
Fourier Transform Interferometry (FTI) is a powerful technique for non-contact surface profilometry that offers high resolution using only one or two images [1].An interference fringe pattern, often generated with a fiber optic coupler [2], is projected onto an object, and the FTI algorithm converts the spatially-varying phase of the projected interferogram into a continuous 3D surface map [3].
Phase unwrapping plays a critical role in the surface reconstruction process and has therefore attracted a great deal of attention [4].In past work, a single reference fringe was used to measure absolute interferogram phase [3,5].Others have acknowledged the problem of error propagation and have developed a variety of solutions to handle point errors when unwrapping from a single reference [6,7].Unfortunately, these techniques are unable to handle discontinuities that extend the entire length of the surface.
In this letter, a new technique is proposed that allows the specification of an arbitrary reference fringe.This Method of Multiple References (MoMR) removes the limitations associated with fixed-fringe referencing, enabling imaging of multiple discrete surfaces, eliminating limitations on object placement, and providing a means for surface error correction.Unlike temporal or phase shifting techniques [8,9], MoMR realizes these improvements using the simplified fiber coupler-based system geometry shown in Fig. 1.FTI begins with the projection of interference fringes on an unknown surface (Fig. 1).The intensity of each interferogram row is a sinusoid with spatially varying phase φ(x,z).This phase is governed by the geometry of the system, including the illumination wavelength λ, pinhole spacing 2a, projection angle β, and the pinhole-to-surface distance d P [2].

Motivation: FTI referencing and limitations
( ) sin cos 4 ( , ) sin ( ) cos The phase is extracted from a 2D image by taking the row-by-row fast Fourier transform (FFT), using a single-sideband filter and inverse FFT to extract the complex envelope c(x) [3].From Eq. ( 2), it is clear that the extracted phase is bounded by +/−π, requiring an unwrapping step to convert it to a continuously increasing function.There exists a variety of well-proven phase unwrapping techniques [10,11], but in practice, the result is un-referenced.There is no inherent indication of the location of the φ = N•2π point corresponding to the N th order fringe.
The nonlinear dependence of φ(x,z) requires knowledge of the absolute phase to reconstruct a surface map z(x) [3,9].Traditionally, the zero-order fringe (φ = 0) is used as a reference for the final surface reconstruction step [3].This fringe represents the set of points that are equidistant from the dual-pinhole source.It is easy to find using a second reference image, containing fringes produced at a different wavelength [5].Such use of a single, fixed reference fringe carries two major limitations: (a) inability to map multiple discontinuous surfaces, and (b) error propagation.Both problems are solved through the use of MoMR.

Method of multiple references (MoMR)
MoMR is a simple technique that remedies both of the major fixed-reference FTI limitations.As in zero-order referencing, two images are collected at different illumination wavelengths, λ 1 and λ 2 [5].MoMR, however, does not focus on a single fringe.Instead, it provides a means to uniquely identify the order of any fringe, projected on an unknown surface, so it may be used as a reference.In this way, the fringe pattern contains multiple references: any fringe peak could be used to determine absolute phase from the unwrapped phase map.

Initial Calibration
FTI calibration involves imaging sets of fringes projected onto an optically flat target.During system calibration, the exact horizontal pixel location of every fringe peak in the image is determined for each row using a localized curve fitting technique.These row-by-row peak positions are then averaged to compute a single horizontal peak location x 0 for each vertical fringe.The entire calibration process is repeated at 19 different target heights over the range of ∆z = 25mm.From this one-time calibration, a lookup table (illustrated in Fig. 2) is created that enables identification of any fringe in subsequent unknown surface images.
Fringe order is uniquely determined by two key parameters measured during calibration: (a) the position of the peak in the main image x 0 (λ 1 ), and (b) the difference between its locations at the two projection wavelengths 0 . Each fringe has a unique combination of x 0 (λ 1 ) and ∆x 0 that differentiates it from the other fringes.

Application during Imaging
The determination of fringe order, which is performed automatically using the MoMR lookup table, allows any fringe to be used as the reference.Images of fringes projected on an unknown surface are collected, and an arbitrary N th fringe is selected as the reference.The MoMR algorithm computes x 0 (λ 1 ) and ∆x 0 for the selected fringe and compares their values to the lookup table in Fig. 2 to determine the fringe order N. Next, the algorithm shifts the unwrapped phase φ U (x,y) to equal N•2π at pixel x 0 by applying a phase shift φ S (y) to each row.

Multi-surface imaging
Every image row to be processed must contain a reference point.Using traditional fixedfringe referencing, this necessitates placement of the object directly under a pre-determined location.Irregularly shaped surfaces must be carefully oriented so that information is not lost at the upper and lower boundaries of the object.Multiple objects are impossible to image with a fixed reference because at most, the reference fringe is projected on only one surface (Fig. 3a).Use of MoMR, eliminates these problems by allowing selection of multiple reference fringes based on surface geometry and placement.
The multi-surface capability of MoMR is demonstrated by imaging three small limestone particles, roughly 1-2cm in size (Fig. 3b), placed on a black matte background for contrastbased windowing.Had they been placed on a reflective background, the edges of each particle would present un-recoverable features for fixed-reference FTI (in prior work, the target was embedded in the mat itself [3]).Three reference fringes are used in the processing, one for each of the discrete surfaces.A boundary definition step is used to remove steep slope errors at the edges of the particles, leaving the majority of their surfaces well-mapped.

Surface error correction
Applying a reference fringe is akin to unwrapping outward from the reference point in both directions.During phase unwrapping, errors that occur in the surface reconstruction tend to propagate away from the reference point along the rows in which they occur.In this way, single point errors in the phase map can ruin large areas of otherwise good data (this effect is evident in Fig. 6).
The majority of surface errors are caused by two specific conditions, both related to the FTI filtering step: steep slopes and step discontinuities.Steep slope errors can be understood by considering the instantaneous spatial frequency of a single interferogram row f(x), which is derived from Eq. ( 1) under the assumption that d P >> x, z.From Eq. ( 4), it is clear the fringe frequency at each point along a data row is modulated by the surface slope at that point, dz/dx.Steep slopes generate a wider bandwidth signal, which is attenuated by the FTI filter and therefore has reduced SNR (Fig. 4), contributing to noise-induced errors in the surface map.
A step discontinuity is a special case in which dz/dx is nearly infinite.The maximum discontinuity ∆z max occurs at a phase jump of ∆φ/∆x > 2π over ∆x = 1 pixel.This is shown in Eq. ( 5), where S mm = 28.2pixels/mm is the horizontal scale of the system.This type of error is not noise-induced.Instead, large step discontinuities simply cause the FTI algorithm to lose track of the correct phase, assigning an incorrect fringe order after the discontinuity.Results from this first processing step illustrate the limitations of fixed-fringe referencing (Fig. 6a).The region in the neighborhood of the reference fringe is reconstructed properly, but the steep slope and step discontinuity cause errors that propagate to the left and right sides of the image.The row-to-row variations on the left side are typical of noise-limited steep slope errors in which dz/dx is near the edge of the filter passband.The ∆z = −6mm step on the right side of the image is not recognized because it exceeds ∆z max = 2.1mm [Eq.( 5)].
Error correction is performed by re-processing the same data set using two additional reference fringes, N 1 = −23 and N 2 = 19, located in the left (upper) and right (lower) regions, respectively.The resulting corrected surface map (Fig. 6b) shows that, although the FTI system cannot reconstruct steep slopes or step discontinuities, the MoMR correction technique can prevent these features from obscuring otherwise accurate surface data in other regions.To confirm the accuracy of the technique, measurements of the target are taken using a micrometer with 10µm resolution and compared to the surface map in each region (Table 1).

Conclusion
The Method of Multiple References is a novel technique for processing of optical surface profilometry data designed to augment a well-established technology: Fourier Transform Interferometry.It represents an improvement over conventional fringe referencing techniques and a significant departure from prior strategies for error mitigation through phase unwrapping.MoMR is compatible with any FTI system geometry, allowing the system to be scaled for potential applications including inspection of particles, MEMS devices, turbine components, microelectronic circuit boards, and many others.

Fig. 1 .
Fig. 1.(a) Schematic of fiber the coupler-based Fourier Transform Interferometry setup used in this demonstration.(b) Image of fringes projected onto a flat calibration target.

Fig. 2 .
Fig. 2. Graphical representation of lookup table for MoMR, based on data taken from calibration of the fiber optic coupler-based FTI system in Fig. 1.The value of x0(λ1) varies as the surface height is changed, but the peak difference ∆x0 remains relatively constant.Nominal fringe orders, assigned during calibration, are listed above each data line.

Fig. 3 .
Fig. 3. (a) Interferogram projection on a multi-surface image.A single fixed reference fringe and its resulting limited mapping area are shown, as are the multiple alternate references allowed by MoMR.(b) Contour map demonstrating multi-surface reconstruction.Limestone particles (same as (a)) are bounded and profiled using 3 reference fringes.
$15.00 USD Received 25 Mar 2010; revised 3 Jun 2010; accepted 28 Jun 2010; published 2 Aug 2010 (C) 2010 OSA on the target are collected, and processed using the N 0 = −5 fringe in the center of the target as the primary reference.

Fig. 6 .
Fig. 6.(a) Uncorrected surface profile after initial processing with reference fringe located in center region (equivalent to fixed fringe referencing).(b) Surface profile after MoMR correction.The areas to the left of the steep slope (upper) and right of the step discontinuity (lower) are now correctly represented.