Skip to main content
Log in

On-line restoration for turbulence degraded video in nuclear power plant reactors

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This article deals with video inspection of nuclear plant reactor after fuel reloading. During these underwater inspections, the fuel assemblies’ heat generates turbulence effect that sensitively degrades the video quality. An on-line restoration algorithm is proposed here. It consists of two steps. A temporal infinite impulse response filter is first used to get a stabilized but blurry video. A second spatial Wiener deconvolution filter is then used to estimate the video which would have been observed without turbulence. This second filter is based on a probabilistic model of the turbulence impact on the observed video. An on-line prototype, based on this algorithm and its straightforward extension to a moving camera (translation), has been successfully tested on several power plants.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Frakes, D.H., Monaco, J.W., Smith, M.J.T: Suppression of atmospheric turbulence in video using an adaptive control grid interpolation approach. In: IEEE Conference Proceedings on Acoustics, Speech and Signal Processing vol. 3, pp. 1881–1884 (2001)

  2. Gepshtein, S., Shtainma, A., Fishbain, B., Yaroslavski, L.P.: Restoration of atmospheric turbulent video containing real motion using rank filtering and elastic image registration. In: Proceedings of European Signal Processing Conference, vol. 1, pp. 477–480 (2004)

  3. Gilles, J.: Restoration algorithm and system performance evaluation for active imaging systems. In: Proceedings SPIE Security and Defense (2007)

  4. Gilles, J., Dagobert, T., De Franchis, C.: Atmospheric turbulence restoration by diffeomorphic image registration and blind deconvolution. In: ACIVS 2008, LNCS 5259, pp. 400–409 (2008)

  5. Mao, Y., Gilles, J.: Non rigid geometric distortions correction—application to atmospheric turbulence stabilization. Inverse Probl. Imaging J. 6(3), 531–546 (2012)

    Google Scholar 

  6. Zhu, X., Milanfar, P.: Removing atmospheric turbulence via space-invariant deconvolution. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 157–170 (2013)

    Google Scholar 

  7. Paul, N., de Chillaz, A.: Processing of image data comprising effect of turbulence in a liquid medium. In: EDF Patent Published with Number WO/2012/101355 (2012, August 2nd) Under French Priority FR 2 971 075 (2011, January 28th)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nicolas Paul.

Appendices

Annex 1: Extension to a translating camera

In practical situation, the camera often translates above the fuel assembly (see example in Fig. 6). In such case, the temporal filter described in Sect. 3.1 no longer works and has to be adapted. Since the camera remains parallel to a flat observed scene, the correct weighted average of the successive frames is given by:

$$\begin{aligned} \mathbf{I}_\alpha \left( \mathbf{x},n \right) =\frac{1-\alpha }{1-\alpha ^{N_\mathbf{x} }}\sum _{k=0}^{n-1} {\alpha ^{k}} \mathbf{I}\left( {\mathbf{x}+\delta _{n/{n-k}} ,n-k} \right) , \end{aligned}$$
(19)

where

  • \(N_\mathbf{x}\) is the number of past images containing pixel x,

  • \(\delta _{n/n-k} \) is the two-dimensional shift between the current original image \(\mathbf{I} ( \mathbf{x},n)\) and the past original image \(\mathbf{I} ( \mathbf{x},n\!-\!k)\),

  • \(\mathbf{I} ( {\mathbf{x}+\delta _{n/{n-k}} ,n-k})\) is the image resulting from the translation of the original image \(n-k\) (with \(\mathbf{I} ( {\mathbf{x}+\delta _{n/{n-k}} ,n-k})=0\) if \(\mathbf{x}+\delta _{n/{n-k}} \) is out of the image bounds).

As in Sect. 3, \(I_\alpha (\mathbf{x},n)\) in Eq. (19) can be computed recursively, using the two following steps:

$$\begin{aligned} \mathbf{I}_{f} \left( \mathbf{x},n \right)&= \alpha \mathbf{I}_{f} \left( {\mathbf{x}+\delta _{n/{n-1}} ,n-1} \right) +\left( {1-\alpha } \right) \mathbf{I}\left( \mathbf{x},n \right) ,\nonumber \\\end{aligned}$$
(20)
$$\begin{aligned} \mathbf{I}_\alpha \left( \mathbf{x},n \right)&= \frac{1}{1-\alpha ^{N_x }}\mathbf{I}_{f} \left( \mathbf{x},n \right) \end{aligned}$$
(21)

Any classical method can be used to calculate the shift \(\delta _{n/n-1} \) between the current original image I(x,\(n\)) and the previous original image I(x,\(n-1\)). In our prototype, \(\delta _{n/n-1} \) is the two-dimensional vector which maximizes the intercorrelation between I(x,\(n\)) and I(x,\(n-1\)). Once \(\delta _{n/n-1} \) has been calculated, \(\mathbf{I}_\alpha ( {\mathbf{x},n})\) is obtained with operations (20) and (21). Finally, \(\mathbf{I}_\alpha ( {\mathbf{x},n})\) is the input for the spatial deconvolution filter described in Sect. 3.2 (the spatial filter is the same as in the fix camera case). An example of restoration performance in the case of a moving camera is provided in Fig. 6

Annex 2: Impact of the turbulence pdf model

The spatial deconvolution filter described in Sect. 3.2 is mainly based on our assumptions on the turbulence pdf. In Figs. 7 and 8, the Laplacian model we selected (Sect. 2.1) is compared to a Gaussian isotropic model and a Cauchy isotropic model:

$$\begin{aligned} h_{\mathrm{Gauss}} \left( \mathbf{u} \right)&= \frac{1}{\pi \sigma ^{2}}\exp \left\{ {-\frac{\parallel \mathbf{u}\parallel ^{2}}{\sigma ^{2}}} \right\} ,\end{aligned}$$
(22)
$$\begin{aligned} h_{\mathrm{Cauchy}} \left( \mathbf{u} \right)&= \frac{1}{2\pi \sigma ^{2}}\left( {1+\frac{\parallel \mathbf{u}\parallel ^{2}}{\sigma ^{2}}} \right) ^{-\frac{3}{2}}. \end{aligned}$$
(23)

For each model, \(\sigma \) is manually optimized to provide the best restoration quality. Both the Cauchy and the Laplace model outperform the Gaussian model. The Cauchy model and the Laplace model have quite similar performances with a slight advantage for the Laplace model which provides more contrasts.

Fig. 7
figure 7

Image extractions from original sequences (up), temporal filter output after 4 s (middle left) and spatial filter output for different hypothesis on the turbulence pdf : Laplacian (middle-right), Cauchy (bottom-left) and Gaussian (bottom right)

Fig. 8
figure 8

Image extractions from original sequences (up), temporal filter output after 2 s (middle left) and spatial filter output for different hypothesis on the turbulence pdf : Laplacian (middle-right), Cauchy (bottom-left) and Gaussian (bottom right)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Paul, N., de Chillaz, A. & Collette, JL. On-line restoration for turbulence degraded video in nuclear power plant reactors. SIViP 9, 601–610 (2015). https://doi.org/10.1007/s11760-013-0497-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0497-3

Keywords

Navigation