Abstract
Images acquired by optical remote sensing often suffer from noise, due to low-light conditions and long distances from the object. Noise introduces undesirable effects such as artifacts, unrealistic edges, unseen lines and corners, blurred objects and disturbed background scenes, and decreasing the performance of visual and computational analysis.
The great majority of denoising methods only focus on single noise type, and mostly assume additive Gaussian white noise. However, in practice, according to the different sources of noise during the capturing process, the real image noise may be composed of noises from several different distributions, i.e., Poisson distribution from shot noise and dark current, Gaussian distribution from readout noise, etc. Thus, it is hard to model complex noise with a single noise model, which therefore limits the practical performance of image denoiser for real captured images. To address this problem, we propose a deep residual network with parameter estimation to model and remove mixed noises of remote sensing data, with no noise type and noise level information.
In this chapter, a deep convolutional neural network based framework is proposed to implement both noise estimation and noise removing. The framework is composed of noise estimator module and denoiser module. The noise estimator module is used to estimate the noise distribution characteristics of the input image, which are used to synthesize the noisy dataset for the training of the denoiser module. After training, the denoiser module can then denoise the input image specifically for that noise characteristic of the input image. Besides, we use some advanced designment to improve the performance of the network like residual learning, skip connections, and perceptual loss. Our model works for both given noise types and others without taking into account in training process, and for the latter case we test the model on the noise mixed with different types, i.e., shot noise, Gaussian noise, salt and pepper noise, speckle noise, dark current, and quantization noise, covering most of the common noise types in practical situation. The estimated noise distribution according to the proposed estimator is compared with the ground truth to validate the performance of the estimator. We also compare the proposed method with the existing denoising methods, including both the traditional algorithm (i.e., BM3D (Dabov et al., IEEE Trans Image Process 16:2080–2095, 2007)) and the deep neural network (i.e., DnCNN (Zhang et al., IEEE Trans Image Process 26:3142–3155, 2017)). Experimental results showed that our method outperforms these state-of-the-art methods in both PSNR (peak signal to noise ratio) and SSIM (structural similarity index).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Yu, C., Qiu, Q., Zhao, Y., Chen, X.: Satellite image classification using morphological component analysis of texture and cartoon layers. IEEE Geosci. Remote Sens. Lett. 10(5), 1109–1113 (2013)
Li, H., Zhang, L.: A hybrid automatic endmember extraction algorithm based on a local window. IEEE Trans. Geosci. Remote Sens. 49(11), 4223–4238 (2011)
Martínez-López, J., Carreño, M.F., Palazón-Ferrando, J.A., Martínez-Fernández, J., Esteve, M.A.: Remote sensing of plant communities as a tool for assessing the condition of semiarid Mediterranean saline wetlands in agricultural catchments. Int. J. Appl. Earth Obs. Geoinf. 26, 193–204 (2014)
Misra, A., Kartikeyan, B., Garg, S.: Noise Removal Techniques for Microwave Remote Sensing Radar Data and its Evaluation. AIRCC Publishing Corporation (2013)
Song, Q., Wang, Y., Yan, X., Gu, H.: Remote sensing images stripe noise removal by double sparse regulation and region separation. Remote Sens. 10(7), 998 (2018)
Xie, J., Xu, L., Chen, E.: Image denoising and inpainting with deep neural networks. In: Proc. Advances in Neural Inf. Process. Syst., pp. 350–358 (2012)
Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a gaussian denoiser: residual learning of deep cnn for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)
Mao, X., Shen, C., Yang, Y.B.: Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In: Advances in neural information processing systems, pp. 2802–2810 (2016)
Osher, S., Burger, M., Goldfarb, D., Xu, J., Yin, W.: An iterative regularization method for total variation-based image restoration. Multiscale Model. Sim. 4(2), 460–489 (2005)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D. 60(1–4), 259–268 (1992)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.O.: Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)
Chatterjee, P., Milanfar, P.: Clustering-based denoising with locally learned dictionaries. IEEE Trans. Image Process. 18(7), 1438–1451 (2009)
Yuan, Q., Zhang, L., Shen, H.: Hyperspectral image denoising employing a spectral–spatial adaptive total variation model. IEEE Trans. Geosci. Remote Sens. 50(10), 3660–3677 (2012)
Burger, H.C., Schuler, C.J., Harmeling, S.: Image denoising: can plain neural networks compete with BM3D? In: Proc. IEEE Conf. Comp. Vis. Patt. Recogn., pp. 2392–2399 (2012)
Zhang, J., Zhong, P., Chen, Y., Li, S.: $ L_ {1/2} $-regularized deconvolution network for the representation and restoration of optical remote sensing images. IEEE Trans. Geosci. Remote Sens. 52(5), 2617–2627 (2014)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference for Learning Representations (2015)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Machine Learn. Res. 15(1), 1929–1958 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 (2016)
Johnson, J., Alahi, A., Fei-Fei, L.: Perceptual losses for real-time style transfer and super-resolution. In: European Conference on Computer Vision, pp. 694–711. Springer, Cham (2016)
Acknowledgments
This work was partially supported by NSFC Projects 61671236, and National Science Foundation for Young Scholar of Jiangsu Province, China (Grant No. BK20160634), and Fundamental Research Funds for the Central Universities, China (Grant No. 0210-14380067).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, M., Zhao, S., Cao, X., Yue, T., Hu, X. (2020). Remote Sensing Image Mixed Noise Denoising with Noise Parameter Estimation. In: Urbach, H., Yu, Q. (eds) 5th International Symposium of Space Optical Instruments and Applications. ISSOIA 2018. Springer Proceedings in Physics, vol 232. Springer, Cham. https://doi.org/10.1007/978-3-030-27300-2_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-27300-2_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27299-9
Online ISBN: 978-3-030-27300-2
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)