ABSTRACT
Effectively analysis of remote-sensing images is very important in many practical applications, such as urban planning, geospatial object detection, military monitoring, vegetation mapping and precision agriculture. Recently, convolutional neural network based deep learning algorithm has achieved a series of breakthrough research results in the fields of objective detection, image semantic segmentation and image classification, etc. Their powerful feature learning capabilities have attracted more attention and have important research value. In this article, firstly we have summarized the basic structure and several classical convolutional neural network architectures. Secondly, the recent research problems on convolutional neural network are discussed. Later, we summarized the latest research results in convolutional neural network based remote sensing fields. Finally, the conclusion has made on the basis of current issue on convolutional neural networks and the future development direction.
- NASA: What Is a Satellite? NASA Knows! 2014. (Grades 5-8)Google Scholar
- L.P. Zhang, L.F. Zhang, B. Du. 2016. Deep learning for remote sensing data: A technical tutorial on the state of the art. IEEE Geoscience and Remote Sensing magazine. 4, 2(June. 2016), 22--40.Google Scholar
- L.P. Zhang, G.-S.X., T.F. Wu, L. Lin and X.C. Tai. 2016. Deep Learning for Remote Sensing Image Understanding. Journal of Sensors. 2016, 1--2.Google Scholar
- Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard and L. D. Jackel. 1989. Backpropagation applied to handwritten zip code recognition. Neural Computation. 1, 4(Winter. 1989), 541--551. Google ScholarDigital Library
- G.E. Hinton, S. Osindero, Y.W. Teh. 2006. A fast learning algorithm for deep belief nets. Neural Computation. 18, 7(July. 2006), 1527--1554. Google ScholarDigital Library
- H. LEE, R. GROSSE, R. RANGANATH, Y. N. Andrew. 2009. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. The 26th Annual International Conference on Machine Learning (Montreal, Quebec, Canada, June 14-18, 2009). ACM, New York, NY, 609--616. DOI= https://dl.acm.org/citation.cfm?doid=1553374.1553453 Google ScholarDigital Library
- S.Q. Ren, K.M. He, R. Girshick, J. Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis & Machine Intelligence. 39, 6(Jun. 2017), 1137--1149. Google ScholarDigital Library
- W.W. Sun and R.S. Wang. 2018. Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. 15, 3(Jun. 2018), 474--478.Google Scholar
- M. Matsugu, K. Mori, Y. Mitari, Y. Kaneda. 2003. Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Networks. 16, 5(Jun. 2003), 555--559. Google ScholarDigital Library
- A. Krizhevsky, I. Sutskever, and G. Hinton. 2012. Imagenet classification with deep convolutional neural networks. Neural Information Processing Systems (NIPS). Harrahs and Harveys, 1097--1105. Google ScholarDigital Library
- C. Szegedy, W. Liu, Y.Q. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich. 2015. Going deeper with convolutions. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Boston, MA, July 7-12, 2015). IEEE, 1--9.Google ScholarCross Ref
- K. Simonyan, A. Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. Proceedings of ICLR (San Diego, CA, May 7-9, 2015). IEEE, 1--14. DOI= https://arxiv.org/abs/1409.1556Google Scholar
- C. Robert. 2014. Machine Learning: A Probabilistic Perspective. CHANCE. 27, 2(Apr. 2014), 62--63.Google Scholar
- G.E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, R.R. Salakhutdinov. 2012. Improving neural networks and by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580. DOI= https://arxiv.org/abs/1207.0580Google Scholar
- L. Wan, M. Zeiler, S.X. Zhang, Y.L. Cun, R. Fergus. 2013. Regularization of neural networks using dropconnect. Proceedings of the 30th International Conference on Machine Learning (PMLR) (Atlanta, GA, USA, June 16-21, 2013). ACM, New York, NY, 1058--1066. Google ScholarDigital Library
- M.J. Afridi, A. Ross, E.M. Shapiro. 2018. On automated source selection for transfer learning in convolutional neural networks. Pattern Recognition. 73(Jan. 2018), 65--75.Google Scholar
- S. Ioffe, C. Szegedy. 2015.Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167.Google Scholar
- E. Maggiori, Y. Tarabalka, G. Charpiat, P. Alliez. 2017. Convolutional neural networks for large-scale remote-sensing image classification. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING. 55, 2(Oct. 2016), 645--657.Google Scholar
- L.H. Zhong, L.N. Hu, H. Zhou. 2019. Deep learning based multi-temporal crop classification. Remote Sensing of Environment. 221(Feb. 2019), 430--443.Google Scholar
- C. Zhang, I.S., X. Pan, H.P. Li, A. Gardiner, J. Hare, P. M. Atkinson. 2019. Joint Deep Learning for land cover and land use classification. Remote Sensing of Environment. 221(Feb. 2019), 173--187.Google Scholar
- S. Hashimoto, Y. Sugimoto, K. Hamamoto, N. Ishihama. 2018. Ship Classification from SAR Images Based on Deep Learning. Intelligent Systems and Applications. (Nov. 2018) 18--34.Google Scholar
- M. A. Shafaey, M.A.-M. Salem, H. M. Ebied, M. N. Al-Berry, M. F. Tolba. 2018. Deep Learning for Satellite Image Classification. Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018 (Cairo, Egypt, September 1-3, 2018). 383--391.Google Scholar
- W. Hu, Y.Y. Huang, L. Wei, F. Zhang, H.C. Li. 2015. Deep Convolutional Neural Networks for Hyperspectral Image Classification. Journal of Sensors. 2015, 1--12.Google ScholarCross Ref
- N. Kussul, M. Lavreniuk, S. Skakun, A. Shelestov. 2017. Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS.14, 5(Mar. 2017), 778--782.Google Scholar
- F.H. Huang, Y. Yu, T.H. Feng. 2019. Hyperspectral remote sensing image change detection based on tensor and deep learning. Journal of Visual Communication and Image Representation. 58(Jan. 2019), 233--244.Google Scholar
- Y.L. Du, W. Song, Q. He, D.M. Huang, L. Antonio, S. Chen. 2019. Deep Learning with Multi-scale Feature Fusion in Remote Sensing for Automatic Oceanic Eddy Detection. Information Fusion. 49(Sep. 2019), 89--99.Google Scholar
- Y.Y. Xu, L. Wu, Z. Xie, Z.L. Chen. 2018. Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters. Remote Sensing. 10, 1 (Jan. 2018), 144--161.Google ScholarCross Ref
- J.Y. Ma, W. Yu, P.W. Liang, C. Li, J.J. Jiang. 2019. Fusion GAN: A generative adversarial network for infrared and visible image fusion. Information Fusion. 48(Aug. 2019), 11--26.Google Scholar
Index Terms
- A review of Convolutional Neural Networks in Remote Sensing Image
Recommendations
Research on improved wavelet convolutional wavelet neural networks
AbstractConvolutional neural network (CNN) is recognized as state of the art of deep learning algorithm, which has a good ability on the image classification and recognition. The problems of CNN are as follows: the precision, accuracy and efficiency of ...
Deep ResNet Based Remote Sensing Image Super-Resolution Reconstruction in Discrete Wavelet Domain
AbstractWe present a single-image super-resolution (SR) method for Remote Sensing Image based on deep learning within Discrete Wavelet Domain in this paper. Our method is inspired Residual Learning. Firstly, an input image is decomposed by single level 2D ...
Multi-Source News Recommender System Based on Convolutional Neural Networks
ICIIP '18: Proceedings of the 3rd International Conference on Intelligent Information ProcessingThe recommender system can help users solve the problem of information overload and find the item which the user requires efficiently. In this paper, we combine the text and image in a given user's browsing news article and classify the article through ...
Comments