Automatic Shot Change Detection Algorithm Using Multi-stage Clustering for MPEG-Compressed Videos

doi:10.1006/jvci.2001.0469

Journal of Visual Communication and Image Representation

Volume 12, Issue 3, September 2001, Pages 364-385

https://doi.org/10.1006/jvci.2001.0469 Get rights and content

Abstract

Automatic shot change detection has been recognized as an important research issue for video classification. This paper proposes an automatic clustering-based algorithm for shot change detection in MPEG-compressed videos with a small number of user-defined parameters. For accurate detection of abrupt and gradual shot changes, the proper selection and extraction of features are important. We first propose a fast edge image extraction scheme in the DCT domain on the basis of AC prediction. Then, by using the features extracted from the edge images and DC images, a two-stage clustering-based algorithm is proposed for shot change detection. In the first stage, the algorithm detects abrupt shot changes by employing two-means clustering on the 2-D feature space of histogram and pixel differences between two neighboring DC frames. In the next stage, it subsequently explores gradual shot changes between two adjacent abrupt shot changes by performing a two-step clustering scheme, which uses multiple features such as an edge energy diagram and several frame difference measures. Simulation results show that the proposed algorithm is fast and accurate.

References (23)

R. Brunelli et al.
A survey of the automatic indexing of video data
J. Visual Commun. Image Rep.
(1999)
H.J. Zhang et al.
An integrated system for content-based video retrieval and browsing
Pattern Recognit.
(1997)
B. S. Manjunath and Y. Deng, Issues for image/video digital libraries, in Proc. IEEE ISCAS, Monterey, CA, May 1998, pp....
H.J. Zhang et al.
Automatic partitioning of full motion video
ACM Multimedia Systems
(1993)
K. Shen and E. J. Delp, A fast algorithm for video parsing using MPEG compressed sequences, in Proc. IEEE ICIP,...
J. Feng, K. Lo, and H. Mehrpour, Scene change detection algorithm for MPEG video sequence, in Proc. IEEE ICIP,...
J. Boreczky and L. Rowe, Comparison of video shot boundary detection techniques, in Proc. SPIE Storage and Retrieval...
Y. Nakajima, K. Ujihara, and A. Yoneyama, Universal scene change detection on MPEG coded data domain, in Proc. SPIE...
S.-C. Pei et al.
Efficient MPEG compressed video analysis using macroblock type information
IEEE Trans. Multimedia
(1999)
M. R. Naphade, R. Mehrotra, A. M. Ferman, J. Warnick, T. S. Huang, and A. M. Tekalp, A high-performance shot boundary...

R. Zabih, J. Miller, and K. Mai, A feature-based algorithm for detecting and classifying scene breaks, in Proc. ACM...

Cited by (14)

Dominant sets based movie scene detection
2012, Signal Processing
Citation Excerpt :
For content-based organization of video or movie, in general, this type of digital data should be decomposed into a hierarchical temporal structure. Shot-based segmentation might be one of these choices to contribute to solve the shot detection problem as presented in literature [1–9]. However, shot-based segmentation might not provide a proper solution in some application domains and semantically meaningful higher-level segmentations, such as video scenes, are preferred.
Multimedia indexing and retrieval has become a challenging topic in organizing huge amount of multimedia data. This problem is not a trivial task for large visual databases; hence, segmentation into low- and high-level temporal video segments might improve the realization of this task. In this paper, we introduce a weighted undirected graph-based movie scene detection approach to detect semantically meaningful temporal video segments. The method is based on the idea of finding the dominant scene of the video according to the selected low-level feature. The proposed method starts from obtaining the most reliable solution first and exploit each solution in the subsequent steps recursively. The dominant movie scene boundary, which can be the highest probability to be the correct one, is determined and this scene boundary information is also exploited in the subsequent steps. We handle two partitioning strategies to determine the boundaries of the remaining scenes. One is a tree-based strategy and the other is an order-based strategy. The proposed dominant sets based movie scene detection method is compared with the graph-based video scene detection methods presented in literature.
Video scene detection using graph-based representations
2010, Signal Processing: Image Communication
Citation Excerpt :
An unsharp masking filtering of 1-D signals is proposed for video scene detection. A similar approach was applied to shot detection problem by Song and Ra [4]. An unsupervised clustering technique is used for classifying the patterns in a multi-dimensional space into two classes: Scene boundary (SB) and no scene boundary (NSB).
One of the fundamental steps in organizing videos is to parse it in smaller descriptive parts. One way of realizing this step is to obtain shot or scene information. One or more consecutive semantically correlated shots sharing the same content construct video scenes. On the other hand, video scenes are different from the shots in the sense of their boundary definitions; video scenes have semantic boundaries and shots are defined with physical boundaries. In this paper, we concentrate on developing a fast, as well as well-performed video scene detection method. Our graph partition based video scene boundary detection approach, in which multiple features extracted from the video, determines the video scene boundaries through an unsupervised clustering procedure. For each video shot to shot comparison feature, a one-dimensional signal is constructed by graph partitions obtained from the similarity matrix in a temporal interval. After each one-dimensional signal is filtered, an unsupervised clustering is conducted for finding video scene boundaries. We adopt two different graph-based approaches in a single framework in order to find video scene boundaries. The proposed graph-based video scene boundary detection method is evaluated and compared with the graph-based video scene detection method presented in literature.
Video genre identification using clustering-based shot detection algorithm
2019, Signal, Image and Video Processing
A video hard cut detection using multifractal features
2019, Multimedia Tools and Applications
Abrupt transition detection using grey scale features
2019, Journal of Advanced Research in Dynamical and Control Systems
Object level frame comparison for video shot detection with orthogonal polynomials model
2012, IEEE Proceedings of the INternational Conference On Emerging Trends in Science Engineering and Technology: Recent Advancements on Science and Engineering Innovation, INCOSET 2012

View all citing articles on Scopus

View full text

Regular ArticleAutomatic Shot Change Detection Algorithm Using Multi-stage Clustering for MPEG-Compressed Videos

Abstract

J. Visual Commun. Image Rep.

Pattern Recognit.

Automatic partitioning of full motion video

ACM Multimedia Systems

Efficient MPEG compressed video analysis using macroblock type information

IEEE Trans. Multimedia

Regular Article
Automatic Shot Change Detection Algorithm Using Multi-stage Clustering for MPEG-Compressed Videos