Skip to main content
SpringerLink
Log in

Automatic video logo detection and removal

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Most commercial television channels use video logos, which can be considered a form of visible watermark, as a declaration of intellectual property ownership. They are also used as a symbol of authorization to rebroadcast when original logos are used in conjunction with newer logos. An unfortunate side effect of such logos is the concomitant decrease in viewing pleasure. In this paper, we use the temporal correlation of video frames to detect and remove video logos. In the video-logo-detection part, as an initial step, the logo boundary box is first located by using a distance threshold of video frames and is further refined by employing a comparison of edge lengths. Second, our proposed Bayesian classifier framework locates fragments of logos called logo-lets. In this framework, we systematically integrate the prior knowledge about the location of the video logos and their intrinsic local features to achieve a robust detection result. In our logo-removal part, after the logo region is marked, a matching technique is used to find the best replacement patch for the marked region within that video shot. This technique is found to be useful for small logos. Furthermore, we extend the image inpainting technique to videos. Unlike the use of 2D gradients in the image inpainting technique, we inpaint the logo region of video frames by using 3D gradients exploiting the temporal correlations in video. The advantage of this algorithm is that the inpainted regions are consistent with the surrounding texture and hence the result is perceptually pleasing. We present the results of our implementation and demonstrate the utility of our method for logo removal.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Belogay, E., Cabrelli, C., Molter, U., Shonkwiler, R.: Calculating the Hausdorff distance between curves. Inf. Process. Lett. 64, 17–22 (1997)

    Article  Google Scholar 

  2. Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of ACM Siggraph, pp. 417–424 (2000)

  3. Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous texture and structure image inpainting. IEEE Trans. Image Process. 12(8), 882–889 (2003)

    Article  Google Scholar 

  4. Bornard, R., Lecan, E., Laborelli, L., Chenot, J.: Missing data correction in still images and image sequences. In: Proceedings of ACM Multimedia. Juan Les Pins, France, pp. 355–361 (2002)

  5. Chan, T.F., Shen, J.H.: Non-texture inpainting by curvature-driven diffusions. J. Vis. Commun. Image Represent. 12(4), 436–449 (2001)

    Article  Google Scholar 

  6. Chan, T.F., Shen, J.H.: Mathematical models for local deterministic inpaintings. SIAM J. Appl. Math. 62(3), 1019–1043 (2001)

    Article  Google Scholar 

  7. Chan, T.F., Shen, J.H.: On the role of the BV image model in image restoration. Am. Math. Soc. Contemp. Math. 330, 25–41 (2003)

    Google Scholar 

  8. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern-classification. Wiley, New York 2000

  9. Holland, R.J., Hanjalic, A.: Logo recognition in video stills by string matching. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 2003), Barcelona (2003)

  10. Huang, C.H., Wu, J.L.: Inpainting attacks against visible watermarking schemes. Proc. SPIE 4314, 376–384 (2001)

    Article  Google Scholar 

  11. Huang, C.H., Wu, J.L.: Attacking visible watermarking schemes. IEEE Trans. Multimedia 6(1), 16–30 (2004)

    Article  Google Scholar 

  12. Huttenlocher, D., Klanderman, G., Rucklidge, W.: Comparing image using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15(9), 850–863 (1998)

    Article  Google Scholar 

  13. Huttenlocher, P., Lilien, H., Olsen, F.: Approximate Hausdorff matching using eigenspaces. In: Proceedings of the ARPA Image Understanding Workshop, pp. 1181–1186 (1996)

  14. Kang, S.H., Chan, T.F., Soatto, S.: Landmark based inpainting from multiple views. In: Proceedings of the International Symposium on 3D Data Processing Visualization and Transmission (3DPVT) (2002)

  15. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003)

    Article  Google Scholar 

  16. Meng, J., Chang, S.F.: Embedding visible video watermarking in the compressed domain. In: Proceedings of the IEEE International Conference on Image Processing (ICIP 1998), Chicago, pp. 474–477 (1998)

  17. Mitchell, T.M.: Machine Learning. New York: McGraw-Hill 1997

  18. Mohanty, S.P., Kankanhalli, M.S., Ramakrishnan, K.R.: A DCT domain visible watermarking technique for images. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2000), New York, pp. 1029–1032 (2000)

  19. Oliveira, M.M., Bowen, B., McKenna, R., Chang, Y.S.: Fast digital image inpainting. In: Proceedings of the International Conference on Visualization, Imaging and Image Processing (VIIP 2001), pp. 261–266 (2001)

  20. Olsen, F.: A probabilistic formulation for Hausdorff matching. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 1998), pp. 150–156 (1998)

  21. Papageorgiou, P., Oren, M., Poggio, T.: A general framework for object detection. In: Proceedings of the International Conference on Computer Vision (ICCV 1998), Mumbai, India, pp. 555–562 (1998)

  22. Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1), 23–38 (1998)

    Article  Google Scholar 

  23. Rowley, H.A., Baluja, S., Kanade, T.: Rotation invariant neural network-based face detection. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 1998), pp. 38–44 (1998)

  24. Seiden, S., Dillencourt, M., Irani, S.: Logo detection in document images. In: Proceedings of the International Conference on Imaging Science, Systems, and Technology, pp. 446–449 (1997)

  25. Shen, J.H.: Inpainting and the fundamental problem of image processing. SIAM News 36(5) (2003)

  26. Sheng, J.: Graphical item recognition using neural networks. Ph.D Thesis, Universita degli Studi Di Firenze (1998)

  27. Shih, T.K., Lu, L.C., Chang, R.C.: Multi-resolution image inpainting. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2003), Baltimore, MD (2003)

  28. Soffer, A., Samet, H.: Using negative shape features for logo similarity matching. In: Proceedings of the 14th International Conference on Pattern Recognition (ICPR 1998), Brisbane, Australia, pp. 571–573 (1998)

  29. Sonka, M., Hlavac, V., Boyle, R.: Image processing, analysis, and machine vision, 2nd edn. London: Brooks/Cole, Chapman & Hall 1999

  30. Wang, J., Kankanhalli, M.S., Mulhem, P., Abdulredha, H.H.: Face detection using DCT coefficients in MPEG video. In: Proceedings of the International Workshop on Advanced Imaging Technology (IWAIT 2002), pp. 66–70 (2002)

  31. Yan, W.Q., Kankanhalli, M.S.: Erasing video logos based on image inpainting. In: Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2002), Lausanne, Switzerland pp. 521–524 (2002)

Download references

Author information

Authors and Affiliations

  1. School of Computing, National University of Singapore, Singapore

    Wei-Qi Yan & Mohan S. Kankanhalli

  2. J. Wang Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, The Netherlands

    Jun Wang

Authors
  1. Wei-Qi Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohan S. Kankanhalli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohan S. Kankanhalli.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yan, WQ., Wang, J. & Kankanhalli, M.S. Automatic video logo detection and removal. Multimedia Systems 10, 379–391 (2005). https://doi.org/10.1007/s00530-005-0167-6

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-005-0167-6

Keywords

Search

Navigation