The security of civilians and high-profile officials is of the utmost importance and is often challenging during continuous surveillance carried out by security professionals. Humans have limitations like attention span, distraction, and memory of events which are vulnerabilities of any security system. An automated model that can perform intelligent real-time weapon detection is essential to ensure that such vulnerabilities are prevented from creeping into the system. This will continuously monitor the specified area and alert the security personnel in case of security breaches like the presence of unauthorized armed people. The objective of the proposed system is to detect the presence of a weapon, identify the type of weapon, and capture the image of the attackers which will be useful for further investigation. A custom weapons dataset has been constructed, consisting of five different weapons, such as an axe, knife, pistol, rifle, and sword. Using this dataset, the proposed system is employed and compared with the faster Region Based Convolution Neural Network (R-CNN) and YOLOv4. The YOLOv4 model provided a 96.04% mAP score and frames per second (FPS) of 19 on GPU (GEFORCE MX250) with an average accuracy of 73%. The R-CNN model provided an average accuracy of 71%. The result of the proposed system shows that the YOLOv4 model achieves a higher mAP score on GPU (GEFORCE MX250) for weapon detection in surveillance video cameras.
Citation: K.P. Vijayakumar, K. Pradeep, A. Balasundaram, A. Dhande. R-CNN and YOLOV4 based Deep Learning Model for intelligent detection of weaponries in real time video[J]. Mathematical Biosciences and Engineering, 2023, 20(12): 21611-21625. doi: 10.3934/mbe.2023956
The security of civilians and high-profile officials is of the utmost importance and is often challenging during continuous surveillance carried out by security professionals. Humans have limitations like attention span, distraction, and memory of events which are vulnerabilities of any security system. An automated model that can perform intelligent real-time weapon detection is essential to ensure that such vulnerabilities are prevented from creeping into the system. This will continuously monitor the specified area and alert the security personnel in case of security breaches like the presence of unauthorized armed people. The objective of the proposed system is to detect the presence of a weapon, identify the type of weapon, and capture the image of the attackers which will be useful for further investigation. A custom weapons dataset has been constructed, consisting of five different weapons, such as an axe, knife, pistol, rifle, and sword. Using this dataset, the proposed system is employed and compared with the faster Region Based Convolution Neural Network (R-CNN) and YOLOv4. The YOLOv4 model provided a 96.04% mAP score and frames per second (FPS) of 19 on GPU (GEFORCE MX250) with an average accuracy of 73%. The R-CNN model provided an average accuracy of 71%. The result of the proposed system shows that the YOLOv4 model achieves a higher mAP score on GPU (GEFORCE MX250) for weapon detection in surveillance video cameras.
| [1] | G. Raturi, P. Rani, S. Madan and S. Dosanjh, ADoCW: An automated method for detection of concealed weapon, in Proc. International Conference on Image Information Processing (ICIIP), Shimla, India, (2019), 181–186. https://dx.doi.org/10.1109/ICIIP47207.2019.8985972 |
| [2] |
J. Salido, V. Lomas, J. Ruiz-Santaquiteria, O. Deniz, Automatic handgun detection with deep learning in video surveillance images, Appl. Sci., 11 (2021), 1–17. http://dx.doi.org/10.3390/app11136085 doi: 10.3390/app11136085
|
| [3] | J. Lim, M. I. Al Jobayer, V. M. Baskaran, J. M. Lim, K. Wong, et al., Gun detection in surveillance videos using deep neural networks, in Proc. APSIPA ASC, Lanzhou, China, (2019), 1998–2002. http://dx.doi.org/10.1109/APSIPAASC47483.2019.9023182 |
| [4] | J. Yuan, C. Guo, A deep learning method for detection of dangerous equipment, in Proc. ICIST, Cordoba, Granada, and Seville, Spain, (2018), 159–164.http://dx.doi.org/10.1109/ICIST.2018.8426165 |
| [5] | G. K. Verma, A. Dhillon, A handheld gun detection using faster R-CNN deep learning, in Proc. ICCT, Allahabad, India, (2017), 84–88. http://dx.doi.org/10.1145/3154979.3154988 |
| [6] | A. Warsi, M. Abdullah, M. N. Husen, M. Yahya, Automatic handgun and Knife detection algorithms: A review, in Proc. IMCOM, Taichung, Taiwan, (2020), 1–9. http://dx.doi.org/10.1109/IMCOM48794.2020.9001725 |
| [7] |
R. Olmos, S. Tabik, F. Herrera, Automatic handgun detection alarm in videos using deep learning, Neurocomputing, 275 (2018), 66–72. https://doi.org/10.1016/j.neucom.2017.05.012 doi: 10.1016/j.neucom.2017.05.012
|
| [8] |
M. Zahrawi, K. Shaalan, Improving video surveillance systems in banks using deep learning technique, Sci. Rep., 13 (2023), 1–16. https://doi.org/10.1038/s41598-023-35190-9 doi: 10.1038/s41598-023-35190-9
|
| [9] |
L. Alzubaidi, J. Zhang, A. J. Humaidi, A. AI-Dujaili, Y. Duan, et al., Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions, J. Big Data, 8 (2021), 1–74. https://doi.org/10.1186/s40537-021-00444-8 doi: 10.1186/s40537-021-00444-8
|
| [10] |
M. T. Bhatti, M. G. Khan, M. Aslam, M. J. Fiaz, Weapon detection in real-time CCTV videos using deep learning, IEEE Access, 9 (2021), 34366–34382. https://doi.org/10.1109/ACCESS.2021.3059170 doi: 10.1109/ACCESS.2021.3059170
|
| [11] | A. Jain, Aishwarya, G. Garg, Gun detection with model and type recognition using Haar Cascade classifier, in Proc. ICSSIT, Tirunelveli, India, (2020), 419–423. https://doi.org/10.1109/ICSSIT48917.2020.9214211 |
| [12] |
S. Gosain, A. Sonare, S. Wakodkar, Concealed weapon detection using image processing and machine learning, IJRASET J. Res. Appl. Sci. Eng. Technol., 9 (2021), 1–13. https://doi.org/10.22214/ijraset.2021.39506 doi: 10.22214/ijraset.2021.39506
|
| [13] | A. Singh, T. Anand, S. Sharma, P. Singh, IoT based weapons detection system for surveillance and security using YOLOV4, in Proc. ICCES, Coimbatre, India, (2021), 488–493. https://doi.org/10.1109/ICCES51350.2021.9489224 |
| [14] | H. Jain, A. Vikram, Mohana, A. Kashyap, A. Jain, Weapon detection using artificial intelligence and deep learning for security applications, in Proc. ICESC, Coimbatore, India, (2020), 193–198. https://doi.org/10.1109/ICESC48915.2020.9155832 |
| [15] |
N. Sanam, P. Bishwajeet, E. V. Doris, C. Rodriguez, M. R. Anjum, Weapon detection using YOLO V3 for smart surveillance system, Hindawi Math. Problems Eng., 2021 (2021), 1–9. https://doi.org/10.1155/2021/9975700 doi: 10.1155/2021/9975700
|
| [16] | A. W. Altaher, S. K. Abbas, Image processing analysis of sigmoidal Hadamard wavelet with PCA to detect hidden object, TELKOMNIKA Telecomm. Comput. Electron. Control, 18 (2020), 1–8. http://doi.org/10.12928/telkomnika.v18i3.13541 |
| [17] | Z. Y. Xue, R. S. Blum, Concealed weapon detection using color image fusion, in Proc. ICIF, Cairns, QLD, Australia, (2003), 622–627. https://doi.org/10.1109/ICIF.2003.177504 |
| [18] |
B. R. Abidi, Y. Zheng, A. V. Gribok, M. A. Abidi, Improving weapon detection in single energy X-ray images through Pseudocoloring, IEEE Transact. Syst. Man Cybern. Part C Appl. Rev., 36 (2006), 784–796. https://doi.org/10.1109/TSMCC.2005.855523 doi: 10.1109/TSMCC.2005.855523
|
| [19] |
P. Yadav, N. Gupta, P. K. Sharma, A comprehensive study towards high-level approaches for weapon detection using classical machine learning and deep learning methods, Expert Syst. Appl., 212 (2022), 1–20. https://doi.org/10.1016/j.eswa.2022.118698 doi: 10.1016/j.eswa.2022.118698
|
| [20] | D. M. Sheen, T. E. Hall, R. H. Severtsen, D. L. McMakin, B. K. Hatchell, et al., Active wideband 350GHz imaging system for concealed-weapon detection, in Proc. International Society for Optical Engineering (SPIE) Defense, Security and Sensing 2009, Orlando, Florida, United States, 7309 (2009). https://doi.org/10.1117/12.817927 |
| [21] |
A. Castillo, S. Tabik, F. Pérez, R. Olmos, F. Herrera, Brightness guided preprocessing for automatic cold steel weapon detection in surveillance videos with deep learning, Neurocomputing, 330 (2019), 151–161. https://doi.org/10.1016/j.neucom.2018.10.076 doi: 10.1016/j.neucom.2018.10.076
|
| [22] |
M. M. Fernandez-Carrobles, O. Deniz, F. Maroto, Gun and Knife detection based on faster R-CNN for video surveillance, Pattern Recogn. Image Anal., 11868 (2019), 441–452. https://doi.org/10.1007/978-3-030-31321-0_38 doi: 10.1007/978-3-030-31321-0_38
|
| [23] |
C. Zhong, S. Cheng, M. Kasoar, R. Arcucci, Reduced-order digital twin and latent data assimilation for global wildfire prediction, Nat. Hazards Earth Syst. Sci., 23 (2023), 1755–1768. https://doi.org/10.5194/nhess-23-1755-2023 doi: 10.5194/nhess-23-1755-2023
|
| [24] |
S. Cheng, Y. Jin, S. P. Harrison, C. Quilodrán-Casas, I. C. Prentice, Guo Y-K, et al., Parameter flexible wildfire prediction using machine learning techniques: Forward and inverse modelling, Remote Sensing, 14133228 (2022), 1–24. https://doi.org/10.3390/rs14133228 doi: 10.3390/rs14133228
|
| [25] | Z. Y. Xia, K. Ma, S. B. Cheng, T. Blackburn, Z. L. Peng, K. W. Zhu, et al., Accurate identification and measurement of the precipitate area by two-stage deep neural networks in novel chromium-based alloys, Phys. Chem. Chem. Phys., 25 (2023), 15970–15987. |
| [26] | R. Girshick, Fast R-CNN, in Proc. IEEE ICCV, Santiago, Chile, (2015), pp. 1440–1448. https://doi.org/10.1109/ICCV.2015.169 |
Figures(11) / Tables(7)
K.P. Vijayakumar, K. Pradeep, A. Balasundaram, A. Dhande. R-CNN and YOLOV4 based Deep Learning Model for intelligent detection of weaponries in real time video[J]. Mathematical Biosciences and Engineering, 2023, 20(12): 21611-21625. doi: 10.3934/mbe.2023956
DownLoad: