Skip to main content
SpringerLink
Log in

Intelligent Video Monitoring System with the Functionality of Online Recognition of People’s Behavior and Interactions Between People

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10752))

Included in the following conference series:

Abstract

The intelligent video monitoring system SAVA has been implemented as a prototype at the 9th Technology Readiness Level. The source of data are video cameras located in the public space that provide HD video streaming. The aim of the study is to present an overview of the SAVA system enabling identification and classification in the real time of such behaviors as: walking, running, sitting down, jumping, lying, getting up, bending, squatting, waving, and kicking. It also can identify interactions between persons, such as: greeting, passing, hugging, pushing, and fighting. The system has module-based architecture and is combined of the following modules: acquisition, compression, path detection, path analysis, motion description, action recognition. The effect of the modules operation is a recognized behavior or interaction. The system achieves a classification correctness level of 80% when there are more than ten classes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aggarwal, J., Ryoo, M.: Human activity analysis: a review. ACM Comput. Surv. 43(3), 16:1–16:43 (2011)

    Article  Google Scholar 

  2. Bąk, A., Kulbacki, M., Segen, J., Świątkowski, D., Wereszczyński, K.: Recent developments on 2D pose estimation from monocular images. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.-P. (eds.) ACIIDS 2016. LNCS (LNAI), vol. 9622, pp. 437–446. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49390-8_43

    Chapter  Google Scholar 

  3. Barhm, M.S., Qwasmi, N., Qureshi, F.Z., el-Khatib, K.: Negotiating privacy preferences in video surveillance systems. In: Mehrotra, K.G., Mohan, C.K., Oh, J.C., Varshney, P.K., Ali, M. (eds.) IEA/AIE 2011. LNCS (LNAI), vol. 6704, pp. 511–521. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21827-9_52

    Chapter  Google Scholar 

  4. Castiglione, A., Cepparulo, M., De Santis, A., Palmieri, F.: Towards a lawfully secure and privacy preserving video surveillance system. In: Buccafurri, F., Semeraro, G. (eds.) EC-Web 2010. LNBIP, vol. 61, pp. 73–84. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15208-5_7

    Chapter  Google Scholar 

  5. Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst. Appl. 39(12), 10873–10888 (2012)

    Article  Google Scholar 

  6. Chapman, B., Jost, G., Van Der Pas, R.: Using OpenMP: Portable Shared Memory Parallel Programming, vol. 10. MIT press, Cambridge (2008)

    Google Scholar 

  7. Chaquet, J.M., Carmona, E.J., Fernández-Caballero, A.: A survey of video datasets for human action and activity recognition. Comput. Vis. Image Underst. 117(6), 633–659 (2013)

    Article  Google Scholar 

  8. Cortes, C., Vapnik, V.: Support vector machine. Mach. Learn. 20(3), 273–297 (1995)

    MATH  Google Scholar 

  9. Dagum, L., Menon, R.: Openmp: an industry standard api for shared-memory programming. IEEE Comput. Sci. Eng. 5(1), 46–55 (1998)

    Article  Google Scholar 

  10. Gavrila, D.: The visual analysis of human movement: a survey. Comput. Vis. Image Underst. 73(1), 82–98 (1999)

    Article  MATH  Google Scholar 

  11. Gudyś, A., Rosner, J., Segen, J., Wojciechowski, K., Kulbacki, M.: Tracking people in video sequences by clustering feature motion paths. In: Chmielewski, L.J., Kozera, R., Shin, B.-S., Wojciechowski, K. (eds.) ICCVG 2014. LNCS, vol. 8671, pp. 236–245. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11331-9_29

    Google Scholar 

  12. Gudyś, A., Wereszczyński, K., Segen, J., Kulbacki, M., Drabik, A.: Camera calibration and navigation in networks of rotating cameras. In: Nguyen, N.T., Trawiński, B., Kosala, R. (eds.) ACIIDS 2015. LNCS (LNAI), vol. 9012, pp. 237–247. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15705-4_23

    Google Scholar 

  13. Herath, S., Harandi, M., Porikli, F.: Going deeper into action recognition: a survey. Image Vis. Comput. 60, 4–21 (2017)

    Article  Google Scholar 

  14. Jolliffe, I.T.: Principal component analysis and factor analysis. Principal Component Analysis. Springer Series in Statistics, pp. 115–128. Springer, New York (1986). https://doi.org/10.1007/978-1-4757-1904-8_7

    Chapter  Google Scholar 

  15. Kantorov, V., Laptev, I.: Efficient feature extraction, encoding and classification for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2593–2600 (2014)

    Google Scholar 

  16. Koppula, H.S., Saxena, A.: Anticipating human activities using object affordances for reactive robotic response. IEEE Trans. Pattern Anal. Mach. Intell. 38(1), 14–29 (2016)

    Article  Google Scholar 

  17. Kuehne, H., Jhuang, H., Stiefelhagen, R., Serre, T.: Hmdb51: a large video database for human motion recognition. In: Nagel, W., Kröner, D., Resch, M. (eds.) High Performance Computing in Science and Engineering, vol. 12, pp. 571–582. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-33374-3_41

    Google Scholar 

  18. Kulbacki, M., Segen, J., Wereszczyński, K., Gudyś, A.: VMASS: massive dataset of multi-camera video for learning, classification and recognition of human actions. In: Nguyen, N.T., Attachoo, B., Trawiński, B., Somboonviwat, K. (eds.) ACIIDS 2014. LNCS (LNAI), vol. 8398, pp. 565–574. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-05458-2_58

    Chapter  Google Scholar 

  19. Kulbacki, M., Wereszczyński, K., Segen, J., Sachajko, M., Bąk, A.: Video editor for annotating human actions and object trajectories. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.-P. (eds.) ACIIDS 2016. LNCS (LNAI), vol. 9622, pp. 447–457. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49390-8_44

    Chapter  Google Scholar 

  20. Mathur, G., Bundele, M.: Research on intelligent video surveillance techniques for suspicious activity detection critical review. In: 2016 International Conference on Recent Advances and Innovations in Engineering (ICRAIE), pp. 1–8. IEEE (2016)

    Google Scholar 

  21. Meinel, L., Findeisen, M., Hes, M., Apitzsch, A., Hirtz, G.: Automated real-time surveillance for ambient assisted living using an omnidirectional camera. In: 2014 IEEE International Conference on Consumer Electronics (ICCE), pp. 396–399. IEEE (2014)

    Google Scholar 

  22. Negin, F., Bremond, F.: Human action recognition in videos: a survey. Technical report, INRIA Technical Report, Sophia Antipolis, France (2016)

    Google Scholar 

  23. Onofri, L., Soda, P., Pechenizkiy, M., Iannello, G.: A survey on using domain and contextual knowledge for human activity recognition in video streams. Expert Syst. Appl. 63, 97–111 (2016)

    Article  Google Scholar 

  24. Padilla-López, J.R., Chaaraoui, A.A., Flórez-Revuelta, F.: Visual privacy protection methods: a survey. Expert Syst. Appl. 42(9), 4177–4195 (2015)

    Article  Google Scholar 

  25. Pal, S., Abhayaratne, C.: Video-based activity level recognition for assisted living using motion features. In: Proceedings of the 9th International Conference on Distributed Smart Cameras, pp. 62–67. ACM (2015)

    Google Scholar 

  26. Poppe, R.: A survey on vision-based human action recognition. Image Vis. Comput. 28(6), 976–990 (2010)

    Article  Google Scholar 

  27. Rafferty, J., Nugent, C.D., Liu, J., Chen, L.: From activity recognition to intention recognition for assisted living within smart homes. IEEE Trans. Hum. Mach. Syst. 47(3), 368–379 (2017)

    Article  Google Scholar 

  28. Rajpoot, Q.M., Jensen, C.D.: Security and privacy in video surveillance: requirements and challenges. In: Cuppens-Boulahia, N., Cuppens, F., Jajodia, S., Abou El Kalam, A., Sans, T. (eds.) SEC 2014. IAICT, vol. 428, pp. 169–184. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-55415-5_14

    Chapter  Google Scholar 

  29. Ramirez-Amaro, K., Beetz, M., Cheng, G.: Transferring skills to humanoid robots by extracting semantic representations from observations of human activities. Artif. Intell. 247, 95–118 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  30. Rezazadegan, F., Shirazi, S., Upcroft, B., Milford, M.: Action recognition: from static datasets to moving robots. arXiv preprint arXiv:1701.04925 (2017)

  31. Segen, J., Pingali, S.G.: A camera-based system for tracking people in real time. In: Proceedings of the 13th International Conference on Pattern Recognition 1996, vol. 3, pp. 63–67. IEEE (1996)

    Google Scholar 

  32. Shi, F., Laganière, R., Petriu, E.: Local part model for action recognition. Image Vis. Comput. 46(C), 18–28 (2016)

    Article  Google Scholar 

  33. Shi, F., Laganiere, R., Petriu, E.: Gradient boundary histograms for action recognition. In: 2015 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1107–1114. IEEE (2015)

    Google Scholar 

  34. Soomro, K., Zamir, A.R., Shah, M.: Ucf101: a dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402 (2012)

  35. Staniszewski, M., Kloszczyk, M., Segen, J., Wereszczyński, K., Drabik, A., Kulbacki, M.: Recent developments in tracking objects in a video sequence. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.-P. (eds.) ACIIDS 2016. LNCS (LNAI), vol. 9622, pp. 427–436. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49390-8_42

    Chapter  Google Scholar 

  36. Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Dense trajectories and motion boundary descriptors for action recognition. Int. J. Comput. Vis. 103(1), 60–79 (2013)

    Article  MathSciNet  Google Scholar 

  37. Wang, X.: Intelligent multi-camera video surveillance: a review. Pattern Recogn. Lett. 34(1), 3–19 (2013)

    Article  Google Scholar 

  38. Wereszczyński, K., Michalczuk, A., Segen, J., Pawlyta, M., Bąk, A., Nowacki, J.P., Kulbacki, M.: Optical flow based face anonymization in video sequences. In: Nguyen, N.T., Tojo, S., Nguyen, L.M., Trawiński, B. (eds.) ACIIDS 2017. LNCS (LNAI), vol. 10192, pp. 623–631. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54430-4_60

    Chapter  Google Scholar 

  39. Wojciechowski, S., Kulbacki, M., Segen, J., Wyciślok, R., Bąk, A., Wereszczyński, K., Wojciechowski, K.: Selected space-time based methods for action recognition. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.-P. (eds.) ACIIDS 2016. LNCS (LNAI), vol. 9622, pp. 417–426. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-662-49390-8_41

    Chapter  Google Scholar 

  40. Wu, D., Sharma, N., Blumenstein, M.: Recent advances in video-based human action recognition using deep learning: a review. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 2865–2872. IEEE (2017)

    Google Scholar 

  41. Xu, Y., Gong, J., Xiong, L., Xu, Z., Wang, J., Shi, Y.Q.: A privacy-preserving content-based image retrieval method in cloud environment. J. Vis. Commun. Image Represent. 43, 164–172 (2017)

    Article  Google Scholar 

  42. Yu, C., Zheng, X., Zhao, Y., Liu, G., Li, N.: Review of intelligent video surveillance technology research. In: 2011 International Conference on Electronic and Mechanical Engineering and Information Technology (EMEIT), vol. 1, pp. 230–233. IEEE (2011)

    Google Scholar 

  43. Zhang, P., Thomas, T., Emmanuel, S.: Privacy enabled video surveillance using a two state markov tracking algorithm. Multimedia Syst. 18(2), 175–199 (2012)

    Article  Google Scholar 

Download references

Acknowledgments

The project SAVA has been supported by the National Centre for Research and Development (project UOD-DEM-1-183/001 “Intelligent video analysis system for behavior and event recognition in surveillance networks”). We would like to express our gratitude to all the project participants.

Author information

Authors and Affiliations

  1. Polish-Japanese Academy of Information Technology, Koszykowa 86, 02-008, Warsaw, Poland

    Marek Kulbacki, Jakub Segen, Sławomir Wojciechowski, Kamil Wereszczyński, Jerzy Paweł Nowacki, Aldona Drabik & Konrad Wojciechowski

Authors
  1. Marek Kulbacki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jakub Segen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sławomir Wojciechowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kamil Wereszczyński
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jerzy Paweł Nowacki
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Aldona Drabik
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Konrad Wojciechowski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marek Kulbacki .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

  2. Quang Binh University, Dong Hoi City, Vietnam

    Duong Hung Hoang

  3. National University of Kaohsiung, Kaohsiung, Taiwan

    Tzung-Pei Hong

  4. Rutgers University, Piscataway, New Jersey, USA

    Hoang Pham

  5. Wrocław University of Science and Technology, Wrocław, Poland

    Bogdan Trawiński

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kulbacki, M. et al. (2018). Intelligent Video Monitoring System with the Functionality of Online Recognition of People’s Behavior and Interactions Between People. In: Nguyen, N., Hoang, D., Hong, TP., Pham, H., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2018. Lecture Notes in Computer Science(), vol 10752. Springer, Cham. https://doi.org/10.1007/978-3-319-75420-8_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-75420-8_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-75419-2

  • Online ISBN: 978-3-319-75420-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation