Variational image decomposition for estimation of fringe orientation and density from electronic speckle pattern interferometry fringe patterns with greatly variable density
Introduction
Fringe orientation and density are important properties of fringes for directing electronic speckle pattern interferometry (ESPI) fringes processing such as image filtering [1], [2], [3] and skeleton extraction [4]. Obviously, errors in estimation of fringe orientation or density will affect noise reduction and as a consequence the accuracy of the fringe analysis. Therefore, the computations of fringe orientation and density form very critical steps and are of fundamental importance.
In the past few years, there have been various methods proposed for the estimation of fringe orientation and density. For fringe orientation, these mainly include the gradient-based method (GM) [5], the plane-fit method (PM) [6], and the fast Fourier transform method (FFTM) [7]. For fringe density, these mainly include the accumulate-differences method (ADM) [8], the continuous wavelet transform (CWT) [9], and the isotropic adaptive bandpass filter (IDBF) [10]. It is worth mentioning that the estimation of fringe density is usually more difficult than that of fringe orientation. All these methods have significant advantages and disadvantages. The GM [5] is popularly used for its efficiency, but its accuracy can easily be lowered by speckle noise. The PM [6] can get accurate orientations in spite of high noise, but it is strict with the size of the calculating window. The FFTM [7] can give desired results of fringe orientation even in the regions with low or high fringe density and in noisy and poor contrast conditions, but it requires long computation times. The ADM [8] performs well in the presence of noise. The main drawback of this method is that, it cannot give satisfactory results if the quality of an image is poor [7]. The CWT [9] is suitable for fringe density estimation. The main drawbacks of this method are the required long computation times, computation complexity and low accuracy results [10]. The IDBF [10] works remarkably well for obtaining local fringe density map, but it depends on many parameters.
Although there have been various methods for the estimation of fringe orientation and density, according to our own experience in this area, it is still difficult to obtain desired estimation results for ESPI fringe patterns with greatly variable density as shown in the following. Fig. 1(a) is a computer-simulated ESPI fringe pattern with the size of 512×512 pixels, and Fig. 1(b) is an experimentally obtained one with the size of 400×400 pixels. Obviously, the fringe density of the two ESPI fringe patterns varies greatly. It is well known that the estimation results obtained by the above-mentioned methods greatly depend on the parameters in each method. When applying the above-mentioned methods for Fig. 1, we need to laboriously find a good balance between low density fringes and high density fringes through the fine tuning of input parameters, which is difficult and sometimes impossible as shown later. Therefore, the estimation of orientation and density for this case is still a challenging problem faced in this area. For the estimation of this type of orientation and density, the input parameters applied in high density regions should be different from that in low density regions. It is thus natural and reasonable to highly expect that low density fringes and high density fringes can be described separately and processed individually.
Recently the variational image decomposition (VID) technique is becoming an active area of research in image processing and attracts more and more attention. The basic idea of the methods is that they decompose an image into different components representing different information, and each component is modeled by a different function space. Then the functional is established by combining corresponding norms over the irrespective spaces. Each component can be obtained by minimizing the functional. In the past few years, there have been various image decomposition models proposed. In [11], Rudin et al. have proposed the earliest Rudin–Osher–Fatemi image decomposition model, which split an image f into two components , such that u represents a cartoon or geometric component of f, while v represents the oscillatory component of f. In [12], Meyer has proposed the model, which use the total variation (TV) of an image to model u and the norm G to model v. Also, other decomposition models such as model [13], model [14] and so on were proposed. Particularly, in [15], [16], [17], Zhu et al. have proposed the variational image decomposition for optical fringe filtering and automatic background removing.
Most of the above-mentioned image decomposition models have been studied extensively as a useful tool for noise removal and background removing. However, the purpose of our paper is greatly different from the previous ones. In this paper, we focus on the estimation of orientation and density with greatly variable density, which is still a challenging problem faced in this area. As far as we know, this is the first attempt to introduce the variational image decomposition (VID) to propose an effective method for obtaining the orientation and density for this kind of fringe. The basic idea of our method is that we decompose an ESPI fringe pattern f into two images: one image u only includes low density fringes and the other image v high density fringes. Through the VID, the original ESPI fringe pattern with greatly variable density is transformed into two fringe images with uniform density. For the two decomposed fringe images u and v, it is easy to estimate the orientation and density separately. We further get the orientation and density of u and v by the existing effective methods. The whole fringe orientation and density of the original ESPI fringe pattern can be obtained by the simple combination of the corresponding results of u and v. For clarity, the rest of the paper is organized as follows. In Section 2, we describe our proposed method in detail for estimation of fringe orientation and density from electronic speckle pattern interferometry fringe patterns with greatly variable density. We present the experimental results and discussions in Section 3 and summarize the paper in Section 4.
Section snippets
The description of our method
In this section, we describe our proposed method in detail for obtaining fringe orientation and density from ESPI fringe patterns with greatly variable density. Our method consists of three steps. Firstly, we propose an effective VID model to decompose an ESPI fringe with greatly variable density into two images: one only includes low density fringes and the other high density fringes. Secondly, we estimate the fringe orientation and density of the two decomposed images by the existing methods
Experiments and discussion
In this section, for verifying our method, we test the proposed method in Fig. 1 and compare with widely used the gradient-based method (GM) [5], the accumulate-differences method (ADM) [8] and the fast Fourier transform method (FFTM) [7]. The estimation results of the four methods are relative to the parameters in each method. We strove to be impartial while comparing. The parameters in the GM, ADM and FFTM are chosen based on the better performance by trial and the suggestions given by the
Conclusion
In conclusion, as far as we know, we firstly introduce the variational image decomposition (VID) technique to estimate the fringe orientation and density. As described above it is still difficult for the existing methods to obtain desired estimation results for ESPI fringe patterns with greatly variable density. Therefore, the estimation of fringe orientation and density for this case is a challenging problem faced in this area. Here we provide a novel way to effectively estimate the fringe
Acknowledgment
The authors would like to thank the editors and the anonymous reviewers. This work is supported by the National Natural Science Foundation of China (NNSFC) (grant 61177007).
References (24)
Applications of windowed fourier fringe analysis in optical measurementa review
Opt Lasers Eng
(2015)- et al.
Comparison on performance of some representative and recent filtering methods in electronic speckle pattern interferometry
Opt Lasers Eng
(2012) - et al.
The new second-order single oriented partial differential equations for optical interferometry fringes with high density
Opt Lasers Eng
(2013) - et al.
An algorithm for estimating both fringe orientation and fringe density
Opt Commun
(2007) - et al.
Nonlinear total variation based noise removal algorithms
Physica D: Nonlinear Phenom
(1992) - et al.
Image decomposition model 2 for dynamic thermal measurements of the printed circuit board with a chip by ESPI
Opt Laser Technol
(2014) - et al.
Phase retrieval from single frame projection fringe pattern with variational image decomposition
Opt Lasers Eng
(2014) Robust smoothing of gridded data in one and higher dimensions with missing values
Comput Stat Data Anal
(2010)- et al.
Oriented couple gradient vector fields for skeletonization of gray-scale optical fringe patterns with high density
Appl Opt
(2010) - et al.
Fringe-orientation estimation by use of a Gaussian gradient filter and neighboring-direction averaging
Appl Opt
(1999)
Spin filtering with curve windows for interferometric fringe patterns
Appl Opt
Estimation of fringe orientation for optical fringe patterns with poor quality based on Fourier transform
Appl Opt
Cited by (14)
DeepDensity: Convolutional neural network based estimation of local fringe pattern density
2021, Optics and Lasers in EngineeringCitation Excerpt :The accumulated differences approach [45] provides a simple and direct fringe density estimation, however it was primarily aimed at calculating the fringe orientation hence the LFD map is estimated roughly. This method was advanced by the variational image decomposition preprocessing [46], but still the mechanism of the LFD map calculation stayed the same and cannot be considered as a very accurate one. More precise approach proposed for calculating the local fringe density in the noisy wrapped phase maps was based on the Fourier transform [38].
Enhancing single-shot fringe pattern phase demodulation using advanced variational image decomposition
2019, Journal of Optics (United Kingdom)Biological phase sample study using variational Hilbert imaging technique
2019, Progress in Biomedical Optics and Imaging - Proceedings of SPIE