Skip to main content

Advertisement

SpringerLink
Log in

Deep vision-based surveillance system to prevent train–elephant collisions

  • Application of soft computing
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Animal conservation is imperative, and technology can certainly assist in different ways. The extinction of endangered species like tigers and elephants has boosted the necessity for such efforts. Human–elephant collision (HEC) has been an active area of research for years. Apart from deforestation, the roads and rail tracks laid down through forest areas intervene a lot in wildlife. Collisions and tragedies are every day, especially in green belts in India and other Asian countries. Therefore, it is crucial to develop vision-based, automated, warning-generating systems to identify the animal/elephant near-site. In the proposed work, different deep learning-based models are proposed to identify elephants in image/video. Several convolutional neural network (CNN)-based models and three transfer learning (TL)-based models, i.e., ResNet50, MobileNet, Inception V3, have been experimented with and tuned for elephant detection. All the models are tested on a synthesized dataset having about 4200 images built using two public datasets, i.e., ELPephant and RailSem19. Two accurate CNN and transfer learning-based models are presented in detail. These highly accurate and precise models can alarm the trains and generate warning signals on site. The proposed CNN and inception network demonstrated high accuracy of 99.53% and 99.91%, respectively, and are remarkable in identifying elephants and hence preventing HEC. The same model can be trained for other animals for their preservation in similar scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Ardovini A, Cinque L, Sangineto E (2008) Identifying elephant photos by multi-curve matching. Pattern Recogn 41(6):1867–1877

    Article  Google Scholar 

  • Backs JAJ, Nychka JA, Clair CS (2017) Warning systems triggered by trains could reduce collisions with wildlife. Ecol Eng 106:563–569

    Article  Google Scholar 

  • Beery S, Van Horn G, Perona P (2018) Recognition in terra incognita. In: Proceedings of the European conference on computer vision (ECCV), pp 456–473

  • Bíl M, Andrášik R, Duľa M, Sedoník J (2019) On reliable identification of factors influencing wildlife-vehicle collisions along roads. J Environ Manage 237:297–304

    Article  Google Scholar 

  • Burghardt T, Ćalić J (2006) Analysing animal behaviour in wildlife videos using face detection and tracking. IEE Proc vis Image Signal Process 153(3):305–312

    Article  Google Scholar 

  • Chen G, Han TX, He Z, Kays R, Forrester T (2014) Deep convolutional neural network-based species recognition for wild animal monitoring. In: 2014 IEEE international conference on image processing (ICIP). pp 858–862. IEEE

  • Chythanya K, Madhavi K, Ramesh G (2020) A Machine learning enabled IoT device to combat elephant mortality on railway tracks. In: Springer Proceedings of 2nd international conference on innovative data communication technologies and applications (ICIDCA 2020)-Sept. 2020. In press

  • Devost E, Lai S, Casajus N, Berteaux D (2019) Fox Mask: a new automated tool for animal detection in camera trap images. BioRxiv, p 640037

  • Dhanaraj JSA, Kumar Sangaiah A (2018) Elephant detection using boundary sense deep learning (BSDL) architecture. J Exp Theor Artif Intell, pp 1–16

  • Farah R, Langlois JP, Bilodeau GA (2011) Rat: robust animal tracking. In: 2011 IEEE international symposium on robotic and sensors environments (ROSE), pp 65–70. IEEE

  • Gadekallu TR, Rajput DS, Reddy MPK, Lakshmanna K, Bhattacharya S, Singh S, Jolfaei A, Alazab M (2020) A novel PCA–whale optimization-based deep neural network model for classification of tomato plant diseases using GPU. J Real-Time Image Process, pp 1–14

  • Gadekallu TR, Alazab M, Kaluri R, Maddikunta PKR, Bhattacharya S, Lakshmanna K, Parimala M (2021) Hand gesture classification using a novel CNN-crow search algorithm. Complex Intell Syst, pp 1–14

  • Gupta S, Kumar M, Garg A (2019) Improved object recognition results using SIFT and ORB feature detector. Multimed Tools Appl 78(23):34157–34171

    Article  Google Scholar 

  • Hannuna SL, Campbell NW, Gibson DP (2005) Segmenting quadruped gait patterns from wildlife video

  • Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

  • Iwendi C, Srivastava G, Khan S, Maddikunta PKR (2020) Cyberbullying detection solutions based on deep learning architectures. Multimed Syst, pp 1–14

  • Jayakumar R, Swaminathan R, Harikumar S, Banupriya N, Saranya S (2020) Animal detection using deep learning algorithm. J Crit Rev 7(1):434–439

    Google Scholar 

  • Kellenberger B, Marcos D, Tuia D (2018a) Detecting mammals in UAV images: best practices to address a substantially imbalanced dataset with deep learning. Remote Sens Environ 216:139–153

    Article  Google Scholar 

  • Kellenberger B, Marcos D, Lobry S, Tuia D (2019) Half a percent of labels is enough: efficient animal detection in UAV imagery using deep CNNs and active learning. IEEE Trans Geosci Remote Sens 57(12):9524–9533

    Article  Google Scholar 

  • Kellenberger B, Volpi M, Tuia D (2017) Fast animal detection in UAV images using convolutional neural networks. In: 2017 IEEE international geoscience and remote sensing symposium (IGARSS) (pp 866–869). IEEE

  • Kellenberger B, Marcos D, Tuia D (2018) Best practices to train deep models on imbalanced datasets—a case study on animal detection in aerial imagery. In: Joint European conference on machine learning and knowledge discovery in databases. pp 630–634. Springer, Cham

  • Koik BT, Ibrahim H (2012) A literature survey on animal detection methods in digital images. Int J Future Comput Commun 1(1):24

    Article  Google Scholar 

  • Korschens M, Denzler J (2019) Elpephants: a fine-grained dataset for elephant re-identification. In: Proceedings of the IEEE international conference on computer vision workshops, pp 0–0

  • Kumar M, Gupta S, Gao XZ, Singh A (2019a) Plant species recognition using morphological features and adaptive boosting methodology. IEEE Access 7:163912–163918

    Article  Google Scholar 

  • Kumar S, Baline HV, Sivakumar T, Potluri VP (2019b) detection of wild elephants using image processing on raspberry PI3. Int J Comput Sci Mobile Comput 8(2):104–115

    Google Scholar 

  • Langbein J (2011) Monitoring reported deer road casualties and related accidents in England to 2010. Research Report 2011/3. The Deer Initiative, Wrexham, UK

  • Mammeri A, Zhou D, Boukerche A, Almulla M (2014) An efficient animal detection system for smart cars using cascaded classifiers. In: 2014 IEEE international conference on communications (ICC), pp 1854–1859. IEEE

  • Mandal RK, Bhutia DD (2018) A proposed artificial neural network (ANN) model using geophone sensors to detect elephants near the railway tracks. Advanced computational and communication paradigms. Springer, Singapore, pp 1–6

    Google Scholar 

  • Marais JC (2018) Automated elephant detection and classification from aerial infrared and colour images using deep learning (Doctoral dissertation, Stellenbosch: Stellenbosch University)

  • Mönck HJ, Jörg A, von Falkenhausen T, Tanke J, Wild B, Dormagen D, Piotrowski J, Winklmayr C, Bierbach D, Landgraf T (2018) BioTracker: an open-source computer vision framework for visual animal tracking. arXiv preprint arXiv:1803.07985

  • Morse G, Liu T, Gilchrist A, Halliday N, Heavisides J, Hopper D, McKay S, Nowell R, Pitman S, Woods M (2014) Analysis of the risk from animals on the line – Issue 2. Report. Rail Safety and Standards Board, London, UK

  • Naude J, Joubert D (2019). The aerial elephant dataset: a new public benchmark for aerial object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 48–55

  • Norouzzadeh MS, Nguyen A, Kosmala M, Swanson A, Palmer MS, Packer C, Clune J (2018) Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning. Proc Natl Acad Sci 115(25):E5716–E5725

    Article  Google Scholar 

  • Patman J, Michael SC, Lutnesky MM, Palaniappan K (2018) Biosense: real-time object tracking for animal movement and behavior research. In 2018 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), pp 1–8. IEEE

  • Praczyk T (2020) Neural collision avoidance system for biomimetic autonomous underwater vehicle. Soft Comput 24(2):1315–1333

    Article  Google Scholar 

  • Raja MAA, Ramya MK, Kousalya MB, Jeeva MS (2018) Prevention of wild animals from accidents using image detection and edge algorithm. PREVENTION, 5(11)

  • Ramanan D, Forsyth DA (2003) Using temporal coherence to build models of animals. p 338. IEEE

  • Ravikumar S, Vinod D, Ramesh G, Pulari SR, Mathi S (2020) A layered approach to detect elephants in live surveillance video streams using convolution neural networks. J Intell Fuzzy Syst 38(5):6291–6298

    Article  Google Scholar 

  • Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 7263–7271

  • Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst 28:91–99

    Google Scholar 

  • Rey N, Volpi M, Joost S, Tuia D (2017) Detecting animals in African Savanna with UAVs and the crowds. Remote Sens Environ 200:341–351

    Article  Google Scholar 

  • Schneider S, Taylor GW, Linquist S, Kremer SC (2019) Past, present and future approaches using computer vision for animal re-identification from camera trap data. Methods Ecol Evol 10(4):461–470

    Article  Google Scholar 

  • Sharkawy AN, Koustoumpardis PN, Aspragathos N (2020) Human–robot collisions detection for safe human–robot interaction using one multi-input–output neural network. Soft Comput 24(9):6687–6719

    Article  Google Scholar 

  • Sharma SU, Shah DJ (2016) A practical animal detection and collision avoidance system using computer vision technique. IEEE Access 5:347–358

    Article  Google Scholar 

  • Shukla P, Dua I, Raman B, Mittal A (2017) A computer vision framework for detecting and preventing human-elephant collisions. In: Proceedings of the IEEE international conference on computer vision workshops, pp 2883–2890

  • Sugumar SJ, Jayaparvathy R (2014) An improved real time image detection system for elephant intrusion along the forest border areas. Sci World J

  • Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818–2826

  • Tanwar M, Shekhawat NS, Panwar S (2017) A survey on algorithms on animal detection. Int J Future Revolut Comput Sci Commun Engineering. 3(6):33–35

    Google Scholar 

  • Tweed D, Calway A (2002) Tracking multiple animals in wildlife footage. In: Object recognition supported by user interaction for service robots, vol 2, pp 24–27, IEEE

  • Venkataraman AB, Saandeep R, Baskaran N, Roy M, Madhivanan A, Sukumar R (2005) Using satellite telemetry to mitigate Elephant–human conflict: an experiment in northern West Bengal, India. Current Science, pp 1827–1831

  • Vermeulen C, Lejeune P, Lisein J, Sawadogo P, Bouché P (2013) Unmanned aerial survey of elephants. PLoS ONE 8(2):e54700

    Article  Google Scholar 

  • Zendel O, Murschitz M, Zeilinger M, Steininger D, Abbasi S, Beleznai C (2019) Railsem19: a dataset for semantic rail scene understanding. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 0–0

  • Zeppelzauer M (2013) Automated detection of elephants in wildlife video. EURASIP J Image Video Process 2013(1):46

    Article  Google Scholar 

  • Zeppelzauer M, Stoeger AS (2015) Establishing the fundamentals for an elephant early warning and monitoring system. BMC Res Notes 8(1):409

    Article  Google Scholar 

  • Zotin AG, Proskurin AV (2019) Animal detection using a series of images under complex shooting conditions. Int Arch Photogramm Remote Sens Spat Inf Sci

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering and IT, COAET, Punjab Agricultural University, Ludhiana, India

    Surbhi Gupta

  2. Department of CSE, IK Gujral Punjab Technical University, Mohali, India

    Neeraj Mohan

  3. Department of CSE, Gokaraju Rangaraju Institute of Engineering and Technology, Hyderabad, India

    Padmalaya Nayak, Krishna Chythanya Nagaraju & Madhavi Karanam

Authors
  1. Surbhi Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neeraj Mohan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Padmalaya Nayak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Krishna Chythanya Nagaraju
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Madhavi Karanam
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the review of literature, the study of methodologies, design, and implementation of the proposed method. Implementation, Material preparation, literature review, and analysis were performed by Surbhi Gupta, Neeraj Mohan, Madhavi Karanam, and Krishna Chythanya. Dr. Padmalaya Nayak has contributed to the second draft of the manuscript. She has added literature related to the problem undertaken. She helped in redrawing Fig. 3 and added Fig. 5 for the overall improvement of the manuscript. All authors commented on previous versions of the manuscript and helped in draft of second version. All authors have thoroughly read, commented, and approved the final manuscript.

Corresponding author

Correspondence to Surbhi Gupta.

Ethics declarations

Conflict of interest

There is no conflict of interest by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 3025 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gupta, S., Mohan, N., Nayak, P. et al. Deep vision-based surveillance system to prevent train–elephant collisions. Soft Comput 26, 4005–4018 (2022). https://doi.org/10.1007/s00500-021-06493-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-021-06493-8

Keywords

Search

Navigation