Abstract
Drones are increasingly being used to provide support to inspection tasks in many industrial sectors and civil applications. The procedure is usually completed off-line by the final user, once the flight mission terminated and the video streaming and conjoint data gathered by the drone were examined. The procedure can be improved with real-time operation and automated object detection features. With this purpose, this paper describes a cloud-based architecture which enables real-time video streaming and bundled object detection in a remote control center, taking advantage of the availability of high-speed cellular networks for communications. The architecture, which is ready to handle different types of drones, is instantiated for a specific use case, the inspection of a telecommunication tower. For this use case, the specific object detection strategy is detailed. Results show that the approach is viable and enables to redesign the traditional inspection procedures with drones, in a step forward between manual operation and full automation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: TensorFlow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467 (2016)
Bhola, R., Krishna, N.H., Ramesh, K., Senthilnath, J., Anand, G.: Detection of the power lines in UAV remote sensed images using spectral-spatial methods. J. Environ. Manag. 206, 1233–1242 (2018)
Dai, J., Li, Y., He, K., Sun, J.: R-FCN: object detection via region-based fully convolutional networks. CoRR abs/1605.06409 (2016)
De Smedt, F., Hulens, D., Goedeme, T.: On-board real-time tracking of pedestrians on a UAV. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2015
Girshick, R.B., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. CoRR abs/1311.2524 (2013)
Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: MobileNets: efficient convolutional neural networks for mobile vision applications. CoRR abs/1704.04861 (2017)
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., Murphy, K.: Speed/accuracy trade-offs for modern convolutional object detectors. CoRR abs/1611.10012 (2016)
Kanistras, K., Martins, G., Rutherford, M.J., Valavanis, K.P.: Survey of Unmanned Aerial Vehicles (UAVs) for traffic monitoring. In: Valavanis, K.P., Vachtsevanos, G.J. (eds.) Handbook of Unmanned Aerial Vehicles, pp. 2643–2666. Springer, Dordrecht (2015). https://doi.org/10.1007/978-90-481-9707-1_122
Kim, N., Bodunkov, N.: Automated decision making in road traffic monitoring by on-board unmanned aerial vehicle system. In: Favorskaya, M.N., Jain, L.C. (eds.) Computer Vision in Control Systems-3. ISRL, vol. 135, pp. 149–175. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-67516-9_6
Kumar, R., Sawhney, H., Samarasekera, S., Hsu, S., Tao, H., Guo, Y., Hanna, K., Pope, A., Wildes, R., Hirvonen, D., et al.: Aerial video surveillance and exploitation. Proc. IEEE 89(10), 1518–1539 (2001)
Lee, J., Wang, J., Crandall, D., Šabanović, S., Fox, G.: Real-time, cloud-based object detection for unmanned aerial vehicles. In: IEEE International Conference on Robotic Computing (IRC), pp. 36–43. IEEE (2017)
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C., Berg, A.C.: SSD: single shot multibox detector. CoRR abs/1512.02325 (2015)
Ma, Y., Wu, X., Yu, G., Xu, Y., Wang, Y.: Pedestrian detection and tracking from low-resolution unmanned aerial vehicle thermal imagery. Sensors 16(4), 446 (2016)
Metni, N., Hamel, T.: A UAV for bridge inspection: visual servoing control law with orientation limits. Autom. Constr. 17(1), 3–10 (2007)
Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection. CoRR abs/1506.02640 (2015)
Ren, S., He, K., Girshick, R.B., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. CoRR abs/1506.01497 (2015)
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9, June 2015
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. CoRR abs/1512.00567 (2015)
Acknowledgements
This work was supported in part by Universidad Politécnica de Madrid Project RP1509550C02, and by the Spanish Ministry of Economy and Competitiveness under Grants TEC2014-57022-C2-1-R and TEC2014-55146-R.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Vaquero-Melchor, D., Campaña, I., Bernardos, A.M., Bergesio, L., Besada, J.A. (2018). A Distributed Drone-Oriented Architecture for In-Flight Object Detection. In: de Cos Juez, F., et al. Hybrid Artificial Intelligent Systems. HAIS 2018. Lecture Notes in Computer Science(), vol 10870. Springer, Cham. https://doi.org/10.1007/978-3-319-92639-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-92639-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92638-4
Online ISBN: 978-3-319-92639-1
eBook Packages: Computer ScienceComputer Science (R0)