Skip to main content
SpringerLink
Log in

A Cloud Removal Algorithm to Generate Cloud and Cloud Shadow Free Images Using Information Cloning

  • Research Article
  • Published:
Journal of the Indian Society of Remote Sensing Aims and scope Submit manuscript

Abstract

One of the main problems of optical remote sensing is clouds and cloud shadows caused by specific atmospheric conditions during data acquisition. These features limit the usage of acquired images and increase the difficulty in data analysis, such as normalized difference vegetation index values, misclassification, and atmospheric correction. Accurate detection and reliable cloning of cloud and cloud shadow features in satellite images are very useful processes for optical remote sensing applications. In this study, an automated cloud removal algorithm to generate cloud and cloud shadow free images from multitemporal Landsat-8 images is introduced. Cloud and cloud shadow areas are classified by using process-based rule set developed by using spectral and spatial features after applying simple linear iterative clustering superpixel segmentation algorithm to the image to find cloud pixel groups easily and correctly. Segmentation-based cloud detection method gives better results than pixel-based for detection of cloud and cloud shadow patches. After detection of clouds and cloud shadows, cloud-free images are created by cloning cloudless regions from multitemporal dataset. Spectral and structural consistency are preserved by considering spectral features and seasonal effects while cloning process. Statistical similarity tests are applied to find best cloud-free image to use for cloning process. Cloning results are tested with the structural similarity index metric to evaluate the performance of cloning algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012). SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11), 2274–2282.

    Article  Google Scholar 

  • Arvidson, T., Gasch, J., & Goward, S. N. (2001). Landsat 7’s long-term acquisition plan—An innovative approach to building a global imagery archive. Remote Sensing of Environment, 78(1–2), 13–26.

    Article  Google Scholar 

  • Benabdelkader, S., & Melgani, F. (2008). Contextual spatiospectral postreconstruction of cloud-contaminated images. IEEE Geoscience and Remote Sensing Letters, 5(2), 204–208.

    Article  Google Scholar 

  • Chun, F., Jian-wen, M., Qin, D., & Xue, C. (2004). An improved method for cloud removal in ASTER data change detection. In Proceedings of IEEE international geoscience and remote sensing symposium, 2004. IGARSS’04, IEEE (Vol. 5, pp. 3387–3389).

  • Gabarda, S., & Cristóbal, G. (2007). Cloud covering denoising through image fusion. Image and Vision Computing, 25(5), 523–530.

    Article  Google Scholar 

  • Gundersen, E. (2013). Cloudless Atlas with Landsat. https://www.mapbox.com/blog/cloudless-atlas-with-landsat/. Accessed 4 Nov 2016.

  • Hancher, M. (2016). Only clear skies on Google Maps and Earth. Google Official. https://googleblog.blogspot.com.tr/2013/06/only-clear-skies-on-google-maps-and.html. Accessed 6 June 2014.

  • Helmer, E., & Ruefenacht, B. (2005). Cloud-free satellite image mosaics with regression trees and histogram matching. Photogrammetric Engineering and Remote Sensing, 71(9), 1079–1089.

    Article  Google Scholar 

  • Irish, R. R. (2000). Landsat 7 automatic cloud cover assessment. In Proceedings of SPIE—The international society for optical engineering (p. 348).

  • Jiao, Q., Luo, W., Liu, X., & Zhang, B. (2007). Information reconstruction in the cloud removing area based on multi-temporal CHRIS images. In Y. Wang, J. Li, B. Lei, & J. Yang (Eds.), Proceedings of SPIE, MIPPR 2007: Remote sensing and GIS data processing and applications; and innovative multispectral technology and applications, International Symposium on Multispectral Image Processing and Pattern Recognition, 2007. (Vol. 6790, p. 679029). Wuhan, China: SPIE. https://doi.org/10.1117/12.750462.

  • Kalkan, K., & Maktav, D. (2016). Segmentation based cloud and cloud shadow detection in satellite imagery. Journal of Aeronautics and Space Technologies, 10(1), 45–54.

    Google Scholar 

  • Lin, C.-H., Tsai, P.-H., Lai, K.-H., & Chen, J.-Y. (2013). Cloud removal from multitemporal satellite images using information cloning. IEEE Transactions on Geoscience and Remote Sensing, 51(1), 232–241.

    Article  Google Scholar 

  • Lorenzi, L., Melgani, F., & Mercier, G. (2011). Inpainting strategies for reconstruction of missing data in VHR images. IEEE Geoscience and Remote Sensing Letters, 8(5), 914–918.

    Article  Google Scholar 

  • Loyd, C. (2012). Cloudless atlas. https://www.flickr.com/photos/vruba/. Accessed 2 Nov 2016.

  • Maalouf, A., Carre, P., Augereau, B., & Fernandez-Maloigne, C. (2009). A Bandelet-based inpainting technique for clouds removal from remotely sensed images. IEEE Transactions on Geoscience and Remote Sensing, 47(7), 2363–2371.

    Article  Google Scholar 

  • MathWorks, I. (2014). Corr2, 2-D correlation coefficient. MATLAB Image Processing Toolbox. http://www.mathworks.com/help/images/ref/corr2.html. Accessed 2 Nov 2016.

  • Melgani, F. (2006). Contextual reconstruction of cloud-contaminated multitemporal multispectral images. IEEE Transactions on Geoscience and Remote Sensing, 44(2), 442–455.

    Article  Google Scholar 

  • Rakwatin, P., Takeuchi, W., & Yasuoka, Y. (2009). Restoration of Aqua MODIS band 6 using histogram matching and local least squares fitting. IEEE Transactions on Geoscience and Remote Sensing, 47(2), 613–627.

    Article  Google Scholar 

  • Roy, D. P., Ju, J., Lewis, P., Schaaf, C., Gao, F., Hansen, M., et al. (2008). Multi-temporal MODIS–Landsat data fusion for relative radiometric normalization, gap filling, and prediction of Landsat data. Remote Sensing of Environment, 112(6), 3112–3130.

    Article  Google Scholar 

  • Tseng, D.-C., Tseng, H.-T., & Chien, C.-L. (2008). Automatic cloud removal from multi-temporal SPOT images. Applied Mathematics and Computation, 205(2), 584–600.

    Article  Google Scholar 

  • USGS. (2004). SLC-off gap-filled products gap-fill algorithm methodology. http://landsat.usgs.gov/documents/L7SLCGapFilledMethod.pdf. Accessed 4 Nov 2016.

  • Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612.

    Article  Google Scholar 

  • Wang, Z., Jin, J., Liang, J., Yan, K., & Peng, Q. (2005). A new cloud removal algorithm for multi-spectral images. In L. Zhang, J. Zhang, & M. Liao (Eds.), Proceedings of SPIE, MIPPR 2005: SAR and multispectral image processing (vol. 6043, p. 60430W). Wuhan, China: SPIE. https://doi.org/10.1117/12.654869.

  • Wang, B., Ono, A., Muramatsu, K., Fujiwara, N., Bin, W., Atsuo, O. N. O., et al. (1999). Automated detection and removal of clouds and their shadows from Landsat TM images. IEICE Transactions on Information and Systems, 82(2), 453–460.

    Google Scholar 

  • Zhang, C., Li, W., & Travis, D. J. (2009). Restoration of clouded pixels in multispectral remotely sensed imagery with cokriging. International Journal of Remote Sensing, 30(9), 2173–2195.

    Article  Google Scholar 

  • Zhang, X., Qin, F., & Qin, Y. (2010). Study on the thick cloud removal method based on multi-temporal remote sensing images. In 2010 international conference on multimedia technology, IEEE (pp. 1–3).

  • Zhu, Z., & Woodcock, C. E. (2012). Object-based cloud and cloud shadow detection in Landsat imagery. Remote Sensing of Environment, 118, 83–94.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. TÜBİTAK Space Technologies Research Institute, ODTU, 06800, Ankara, Turkey

    Kaan Kalkan

  2. Geomatics Engineering Department, Istanbul Technical University, 34469, Maslak, Istanbul, Turkey

    M. Derya Maktav

Authors
  1. Kaan Kalkan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Derya Maktav
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kaan Kalkan.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalkan, K., Maktav, M.D. A Cloud Removal Algorithm to Generate Cloud and Cloud Shadow Free Images Using Information Cloning. J Indian Soc Remote Sens 46, 1255–1264 (2018). https://doi.org/10.1007/s12524-018-0806-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12524-018-0806-y

Keywords

Search

Navigation