Skip to main content
SpringerLink
Log in

Object detection in remote sensing images based on deep transfer learning

  • 1177: Advances in Deep Learning for Multimodal Fusion and Alignment
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Object detection is a basic part in remote sensing image processing. At present, it is more common to conduct the topic based on deep learning, however the volume of remote sensing images has become a limitation. In order to solve the problem of small sample of remote sensing image, transfer learning is combined with deep learning in the research. First, the detection problem is caused by insufficient data, such as over-fitting, which is solved by model-based transfer learning. The structure of models and parameters obtained based on natural images are transferred to the detection task in remote sensing target domain. In addition, it is usually assumed that the distribution of training data and the testing data are the same in detection, but this is not the case. Therefore, how to improve the robustness of training models and widen the scope of application should be taken into consideration. In the research, Domain Adaptation Faster R-CNN (DA Faster R-CNN) algorithm is proposed for detecting aircraft in remote sensing images. Two domain adaptation structures are designed and selected as the criterion of similarity measurement between domains. Adversarial training is applied to alleviate the domain shift. Finally, the effectiveness of the algorithm is certified in the low brightness experiment. DA Faster R-CNN detection algorithm improves the accuracy of the original algorithm for low quality images. It is worth noting that the DA Faster R-CNN algorithm is a kind of unsupervised transfer learning method for remote sensing object detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Acharya A (2014) Template matching based object detection using HOG feature pyramid[J]. Computer Science:689–694

  2. Bin P, Jianhao T, Qi Z et al (2017) Cascade convolutional neural network based on transfer-learning for aircraft detection on high-resolution remote sensing images[J]. Journal of Sensors:1–14

  3. Chen J, Liu X, Liu C, et al (2018) A Modified Convolutional Neural Network with Transfer Learning for Road Extraction from Remote Sensing Imagery[C]. Chinese Automation Congress (CAC)

  4. Dan Z, Sang N, He Y, Sun S (2014) An improved LBP transfer learning for remote sensing object recognition[J]. Optik - International Journal for Light and Electron Optics 125(1):482–485

    Article  Google Scholar 

  5. Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by Backpropagation[C]. 32nd international conference on machine learning. ICML 2:1180–1189

    Google Scholar 

  6. Girshick R (2015) Fast R-CNN[J]. IEEE International Conference on Computer Vision (ICCV):2380–7504

  7. Girshick R, Donahue J, Darrelland T (2014) Rich feature hierarchies for accurate object detection and semantic segmentation [C]. IEEE Conference on Computer Vision and Pattern Recognition:1–21

  8. Guo Y, Jia X, Paull D (2017) A domain-transfer support vector machine for multi-temporal remote sensing imagery classification[C]. Geoscience & Remote Sensing Symposium, IEEE

    Book  Google Scholar 

  9. Huang F, Zhang X, Xu J, et al. (2019) Multimodal learning of social image representation by exploiting social relations[J]. IEEE transactions on cybernetics

    Google Scholar 

  10. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks[C]. International Conference on Neural Information Processing Systems:1097–1105

  11. Lang H, Wu S, Xu Y (2018) Ship classification in SAR images improved by AIS knowledge transfer[J]. IEEE Geosci Remote Sens Lett 15:439–443

    Article  Google Scholar 

  12. Li Z, Yang C, Xing X (2015) Object detection based on template matching by using enhanced global-best ABC[C]. Control & Decision Conference

  13. Li X, Zhang L, Du B et al (2017) Iterative reweighting heterogeneous transfer learning framework for supervised remote sensing image classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10(5):2022–2035

    Article  Google Scholar 

  14. Li A, Lu Z, Wang L et al (2017) Zero-shot scene classification for high spatial resolution remote sensing images[J]. IEEE Trans Geosci Remote Sens:1–11

  15. Liu W, Anguelov D, Erhan D (2016) SSD: single shot MultiBox detector[J]. European Conference on Computer Vision:21–37

  16. Pan SJ, Yang Q (2010) A survey on transfer learning[J]. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  17. Persello C, Bruzzone L (2012) Active learning for domain adaptation in the supervised classification of remote sensing images[J]. IEEE Trans Geosci Remote Sens 50(11):4468–4483

    Article  Google Scholar 

  18. Redmon J, Divvala S, Girshick R (2016) You only look once: unified, real-time object detection[J]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition:779–788

  19. Ren S, He K, Girshick R (2017) Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  20. Wen J, Weng J, Tong C, Ren C, Zhou Z (2019) Sparse Signal Recovery with Minimization of 1-Norm Minus 2-Norm. IEEE Trans. Vehicular Technology 68(7):6847–6854

    Article  Google Scholar 

  21. Wen J, Li L, Tang X (2019) Wai ho mow: an efficient optimal algorithm for the successive minima problem. IEEE trans. Communications 67(2):1424–1436

    Google Scholar 

  22. Xia J, Yokoya N, Iwasaki A (2017) Ensemble of transfer component analysis for domain adaptation in hyperspectral remote sensing image classification[C]. IGARSS 2017–2017 IEEE International Geoscience and Remote Sensing Symposium. IEEE:4762–4765.

  23. Xia GS, Bai X, Ding J, et al. (2017) DOTA: A Large-scale Dataset for Object Detection in Aerial Images[C]. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 3974–3983

  24. Xiao Q, Hu X, Song G, et al. (2010) Object detection based on contour learning and template matching[C]. Intelligent Control & Automation

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Harbin Engineering University, Harbin, China

    Jinyong Chen & Jianguo Sun

  2. College of Information and Communication Engineering, Harbin Engineering University, Harbin, China

    Yuqian Li & Changbo Hou

Authors
  1. Jinyong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianguo Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuqian Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Changbo Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Changbo Hou.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, J., Sun, J., Li, Y. et al. Object detection in remote sensing images based on deep transfer learning. Multimed Tools Appl 81, 12093–12109 (2022). https://doi.org/10.1007/s11042-021-10833-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10833-z

Keywords

Search

Navigation