Skip to main content

Advertisement

Log in

An optimized video synopsis algorithm and its distributed processing model

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Video synopsis is one of the popular research topics in the field of digital video and has broad application prospects. Current research of it focuses on the methods of generating video synopsis or studying to utilize optimization algorithms such as fuzzy theory, minimum sparse reconstruction, and genetic algorithm to optimize its computing steps. This paper mainly studies the object-based video synopsis technology in distributed environment. We propose an effective video synopsis algorithm and a distributed processing model to accelerate the computing speed of video synopsis. The algorithm is proposed for studies of surveillance videos, which focuses on several key algorithmic steps, for instance, initialization of original video resources, background modeling, moving object detecting, and nonlinear rearrangement. These steps can be performed in parallel. In order to obtain good video synopsis effect and fast computing speed, some optimization methods are applied to these steps. With the aim of employing much more computing resources, we propose a distributed processing model, which splits the original video file into multiple segments and distributes them to different computing nodes to improve the computing performance by leveraging the multi-core and multi-thread capabilities of CPU. Experimental results show that the proposed distributed model can significantly improve the computing speed of video synopsis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Angadi S, Naik V (2014) Entropy based fuzzy c means clustering and key frame extraction for sports video summarization. In: Proceedings of 2014 fifth international conference on signal and image processing, pp 271–279

  • Chao G-C, Tsai Y-P, Jeng S-K (2010) Augmented 3-d keyframe extraction for surveillance videos. IEEE Trans Circuits Syst Video Technol 20(11):1395–1408

    Article  Google Scholar 

  • Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  Google Scholar 

  • Dogra DP, Ahmed A, Bhaskar H (2015) Smart video summarization using mealy machine-based trajectory modelling for surveillance applications. Multimed Tools Appl. doi:10.1007/s11042-015-2576-7

    Google Scholar 

  • Esposito C, Ficco M, Palmieri F, Castiglione A (2013) Interconnecting federated clouds by using publish-subscribe service. Clust Comput 16(4):887–903

    Article  Google Scholar 

  • Esposito C, Ficco M, Palmieri F, Castiglione A (2015) Smart cloud storage service selection based on fuzzy logic, theory of evidence and game theory. IEEE Trans Comput. doi:10.1109/TC.2015.2389952

    Google Scholar 

  • Fu W, Wang J, Gui L, Lu H, Ma S (2014) Online video synopsis of structured motion. Neurocomputing 135:155–162

    Article  Google Scholar 

  • Hsia C-H, Chiang J-S, Hsieh C-F (2015) Low-complexity range tree for video synopsis system. Multimed Tools Appl. doi:10.1007/s11042-015-2714-2

    Google Scholar 

  • Li T, Mei T, Kweon I-S, Hua X-S (2008) Videom: multi-video synopsis. In: Proceedings of IEEE international conference on data mining workshops, pp 854–861

  • Li Z, Ishwar P, Konrad J (2009) Video condensation by ribbon carving. IEEE Trans Image Process 18(11):2572–2583

    Article  MathSciNet  Google Scholar 

  • Li J, Wang Q, Wang C, Cao N, Ren K, Lou W (2010) Fuzzy keyword search over encrypted data in cloud computing. In: Proceedings of 2010 IEEE INFOCOM, pp 1–5

  • Li J, Chen X, Li M, Li J, Lee PPC, Lou W (2014a) Secure deduplication with efficient and reliable convergent key management. IEEE Trans Parallel Distrib Syst 25(6):1615–1625

    Article  Google Scholar 

  • Li J, Huang X, Li J, Chen X, Xiang Y (2014b) Securely outsourcing attribute-based encryption with checkability. IEEE Trans Parallel Distrib Syst 25(8):2201–2210

    Article  Google Scholar 

  • Lin W-W, Qi D-Y, Li Y-J, Wang Z-Y, Zhang Z-L (2006) Independent tasks scheduling on tree-based grid computing platforms. Ruan Jian Xue Bao (J Softw) 17(11):2352–2361

    MATH  Google Scholar 

  • Lin W-W, Liu B, Zhu L-C, Qi D-Y (2013) Csp-based resource allocation model and algorithms for energy-efficient cloud computing. Tongxin Xuebao/J Commun 34(12):33–41

    Google Scholar 

  • Lin W, Liang C, Wang JZ, Buyya R (2014) Bandwidth-aware divisible task scheduling for cloud computing. Softw Pract Exp 44(2):163–174

    Article  Google Scholar 

  • Luque-Baena RM, Lpez-Rubio E, Dom-nguez E, Palomo EJ, Jerez JM (2015) A self-organizing map to improve vehicle detection in flow monitoring systems. Soft Comput. doi:10.1007/s00500-014-1575-3

  • Mei S, Guan G, Wang Z, Wan S, He M, Feng DD (2015) Video summarization via minimum sparse reconstruction. Pattern Recognit 48(2):522–533

    Article  Google Scholar 

  • Nie Y, Xiao C, Sun H, Li P (2013) Compact video synopsis via global spatiotemporal optimization. IEEE Trans Vis Comput Graph 19(10):1664–1676

    Article  Google Scholar 

  • Pournazari M, Mahmoudi F, Moghadam AME (2014) Video summarization based on a fuzzy based incremental clustering. Int J Electr Comput Eng 4(4):593–602

    Google Scholar 

  • Pritch Y, Rav-Acha A, Gutman A, Peleg S (2007) Webcam synopsis: peeking around the world. In: Proceedings of IEEE 11th international conference on computer vision, pp 1–8

  • Pritch Y, Rav-Acha A, Peleg S (2008) Nonchronological video synopsis and indexing. IEEE Trans Pattern Anal Mach Intell 30(11):1971–1984

    Article  Google Scholar 

  • Pritch Y, Ratovitch S, Hendel A, Peleg S (2009) Clustered synopsis of surveillance video. In: Proceedings of the sixth IEEE international conference on advanced video and signal based surveillance, pp 195–200

  • Rav-Acha A, Pritch Y, Peleg S (2006) Making a long video short: Dynamic video synopsis. In: Proceedings of 2006 IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 435–441

  • Shen VRL, Tseng H-Y, Hsu C-H (2014) Automatic video shot boundary detection of news stream using a high-level fuzzy petri net. In: Proceedings of 2014 IEEE international conference on systems, man and cybernetics, pp 1342–1347

  • Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, vol 2, pp 246–252

  • Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal Mach Intell 22(8):747–757

    Article  Google Scholar 

  • Truong BT, Venkatesh S (2007) Video abstraction: a systematic review and classification. ACM Trans Multimed Comput Commun Appl 3(1):1–37

    Article  Google Scholar 

  • Wang S, Yang J, Zhao Y, Cai A, Li SZ (2011) A surveillance video analysis and storage scheme for scalable synopsis browsing. In: Proceedings of 2011 IEEE international conference on computer vision workshops, pp 1947–1954

  • Wang S, Xu W, Wang C, Wang B (2013) A framework for surveillance video fast browsing based on object flags. In: The Era of interactive media. Springer, New York, pp 411–421

  • Xu L, Liu H, Yan X, Liao S, Zhang X (2015) Optimization method for trajectory combination in surveillance video synopsis based on genetic algorithm. J Ambient Intell Humaniz Comput. doi:10.1007/s12652-015-0278-7

  • Ye G, Liao W, Dong J, Zeng D, Zhong H (2015) A surveillance video index and browsing system based on object flags and video synopsis. In: MultiMedia modeling. Springer International Publishing, Berlin, pp 311–314

  • Zhang P, Wang L, Huang W, Xie L, Chen G (2015) Multiple pedestrian tracking based on couple-states Markov chain with semantic topic learning for video surveillance. Soft Comput 19(1):85–97

    Article  Google Scholar 

  • Zhu X, Loy CC, Gong S (2013) Video synopsis by heterogeneous multi-source correlation. In: Proceedings of 2013 IEEE international conference on computer vision, pp 81–88

Download references

Acknowledgments

We want to thank the helpful comments and suggestions from the anonymous reviewers. This work is partially supported by the National Natural Science Foundation of China (Grant Nos. 61402183 and 61272382), Guangdong Natural Science Foundation (Grant No. S2012030006242), Guangdong Provincial Scientific and Technological Projects (Grant Nos. 2013B090500030, 2013B010401024, 2013B090200021, 2013B010401005, 2014A010103022 and 2014A010103008), Guangzhou Scientific and Technological Projects (Grant Nos. 2013Y2-00065, 2014Y2-00133 and 2013J4300056).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Longxin Lin.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, L., Lin, W., Xiao, W. et al. An optimized video synopsis algorithm and its distributed processing model. Soft Comput 21, 935–947 (2017). https://doi.org/10.1007/s00500-015-1823-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-015-1823-1

Keywords

Navigation