skip to main content
10.1145/3316615.3316712acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicscaConference Proceedingsconference-collections
research-article

A review of Convolutional Neural Networks in Remote Sensing Image

Published:19 February 2019Publication History

ABSTRACT

Effectively analysis of remote-sensing images is very important in many practical applications, such as urban planning, geospatial object detection, military monitoring, vegetation mapping and precision agriculture. Recently, convolutional neural network based deep learning algorithm has achieved a series of breakthrough research results in the fields of objective detection, image semantic segmentation and image classification, etc. Their powerful feature learning capabilities have attracted more attention and have important research value. In this article, firstly we have summarized the basic structure and several classical convolutional neural network architectures. Secondly, the recent research problems on convolutional neural network are discussed. Later, we summarized the latest research results in convolutional neural network based remote sensing fields. Finally, the conclusion has made on the basis of current issue on convolutional neural networks and the future development direction.

References

  1. NASA: What Is a Satellite? NASA Knows! 2014. (Grades 5-8)Google ScholarGoogle Scholar
  2. L.P. Zhang, L.F. Zhang, B. Du. 2016. Deep learning for remote sensing data: A technical tutorial on the state of the art. IEEE Geoscience and Remote Sensing magazine. 4, 2(June. 2016), 22--40.Google ScholarGoogle Scholar
  3. L.P. Zhang, G.-S.X., T.F. Wu, L. Lin and X.C. Tai. 2016. Deep Learning for Remote Sensing Image Understanding. Journal of Sensors. 2016, 1--2.Google ScholarGoogle Scholar
  4. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard and L. D. Jackel. 1989. Backpropagation applied to handwritten zip code recognition. Neural Computation. 1, 4(Winter. 1989), 541--551. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. G.E. Hinton, S. Osindero, Y.W. Teh. 2006. A fast learning algorithm for deep belief nets. Neural Computation. 18, 7(July. 2006), 1527--1554. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. H. LEE, R. GROSSE, R. RANGANATH, Y. N. Andrew. 2009. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. The 26th Annual International Conference on Machine Learning (Montreal, Quebec, Canada, June 14-18, 2009). ACM, New York, NY, 609--616. DOI= https://dl.acm.org/citation.cfm?doid=1553374.1553453 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S.Q. Ren, K.M. He, R. Girshick, J. Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis & Machine Intelligence. 39, 6(Jun. 2017), 1137--1149. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. W.W. Sun and R.S. Wang. 2018. Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. 15, 3(Jun. 2018), 474--478.Google ScholarGoogle Scholar
  9. M. Matsugu, K. Mori, Y. Mitari, Y. Kaneda. 2003. Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Networks. 16, 5(Jun. 2003), 555--559. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Krizhevsky, I. Sutskever, and G. Hinton. 2012. Imagenet classification with deep convolutional neural networks. Neural Information Processing Systems (NIPS). Harrahs and Harveys, 1097--1105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Szegedy, W. Liu, Y.Q. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich. 2015. Going deeper with convolutions. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Boston, MA, July 7-12, 2015). IEEE, 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  12. K. Simonyan, A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. Proceedings of ICLR (San Diego, CA, May 7-9, 2015). IEEE, 1--14. DOI= https://arxiv.org/abs/1409.1556Google ScholarGoogle Scholar
  13. C. Robert. 2014. Machine Learning: A Probabilistic Perspective. CHANCE. 27, 2(Apr. 2014), 62--63.Google ScholarGoogle Scholar
  14. G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, R.R. Salakhutdinov. 2012. Improving neural networks and by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580. DOI= https://arxiv.org/abs/1207.0580Google ScholarGoogle Scholar
  15. L. Wan, M. Zeiler, S.X. Zhang, Y.L. Cun, R. Fergus. 2013. Regularization of neural networks using dropconnect. Proceedings of the 30th International Conference on Machine Learning (PMLR) (Atlanta, GA, USA, June 16-21, 2013). ACM, New York, NY, 1058--1066. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M.J. Afridi, A. Ross, E.M. Shapiro. 2018. On automated source selection for transfer learning in convolutional neural networks. Pattern Recognition. 73(Jan. 2018), 65--75.Google ScholarGoogle Scholar
  17. S. Ioffe, C. Szegedy. 2015.Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167.Google ScholarGoogle Scholar
  18. E. Maggiori, Y. Tarabalka, G. Charpiat, P. Alliez. 2017. Convolutional neural networks for large-scale remote-sensing image classification. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING. 55, 2(Oct. 2016), 645--657.Google ScholarGoogle Scholar
  19. L.H. Zhong, L.N. Hu, H. Zhou. 2019. Deep learning based multi-temporal crop classification. Remote Sensing of Environment. 221(Feb. 2019), 430--443.Google ScholarGoogle Scholar
  20. C. Zhang, I.S., X. Pan, H.P. Li, A. Gardiner, J. Hare, P. M. Atkinson. 2019. Joint Deep Learning for land cover and land use classification. Remote Sensing of Environment. 221(Feb. 2019), 173--187.Google ScholarGoogle Scholar
  21. S. Hashimoto, Y. Sugimoto, K. Hamamoto, N. Ishihama. 2018. Ship Classification from SAR Images Based on Deep Learning. Intelligent Systems and Applications. (Nov. 2018) 18--34.Google ScholarGoogle Scholar
  22. M. A. Shafaey, M.A.-M. Salem, H. M. Ebied, M. N. Al-Berry, M. F. Tolba. 2018. Deep Learning for Satellite Image Classification. Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018 (Cairo, Egypt, September 1-3, 2018). 383--391.Google ScholarGoogle Scholar
  23. W. Hu, Y.Y. Huang, L. Wei, F. Zhang, H.C. Li. 2015. Deep Convolutional Neural Networks for Hyperspectral Image Classification. Journal of Sensors. 2015, 1--12.Google ScholarGoogle ScholarCross RefCross Ref
  24. N. Kussul, M. Lavreniuk, S. Skakun, A. Shelestov. 2017. Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS.14, 5(Mar. 2017), 778--782.Google ScholarGoogle Scholar
  25. F.H. Huang, Y. Yu, T.H. Feng. 2019. Hyperspectral remote sensing image change detection based on tensor and deep learning. Journal of Visual Communication and Image Representation. 58(Jan. 2019), 233--244.Google ScholarGoogle Scholar
  26. Y.L. Du, W. Song, Q. He, D.M. Huang, L. Antonio, S. Chen. 2019. Deep Learning with Multi-scale Feature Fusion in Remote Sensing for Automatic Oceanic Eddy Detection. Information Fusion. 49(Sep. 2019), 89--99.Google ScholarGoogle Scholar
  27. Y.Y. Xu, L. Wu, Z. Xie, Z.L. Chen. 2018. Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters. Remote Sensing. 10, 1 (Jan. 2018), 144--161.Google ScholarGoogle ScholarCross RefCross Ref
  28. J.Y. Ma, W. Yu, P.W. Liang, C. Li, J.J. Jiang. 2019. Fusion GAN: A generative adversarial network for infrared and visible image fusion. Information Fusion. 48(Aug. 2019), 11--26.Google ScholarGoogle Scholar

Index Terms

  1. A review of Convolutional Neural Networks in Remote Sensing Image

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICSCA '19: Proceedings of the 2019 8th International Conference on Software and Computer Applications
      February 2019
      611 pages
      ISBN:9781450365734
      DOI:10.1145/3316615

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 February 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader