Skip to main content
SpringerLink
Log in

Finding a needle in a haystack: an interactive video archive explorer for professional video searchers

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Professional video searchers typically have to search for particular video fragments in a vast video archive that contains many hours of video data. Without having the right video archive exploration tools, this is a difficult and time consuming task that induces hours of video skimming. We propose the video archive explorer, a video exploration tool that provides visual representations of automatically detected concepts to facilitate individual and collaborative video search tasks. This video archive explorer is developed by employing a user-centred methodology, which ensures that the tool is more likely to fit to the end user needs. A qualitative evaluation with professional video searchers shows that the combination of automatic video indexing, interactive visualisations and user-centred design can result in an increased usability, user satisfaction and productivity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://www.videolan.org/vlc/

  2. http://windows.microsoft.com/nl-NL/windows/products/windows-media-player

References

  1. Adcock J, Cooper M, Pickens J (2008) Experiments in interactive video search by addition and subtraction. In: Proceedings of the 2008 international conference on content-based image and video retrieval, CIVR ’08, pp 465–474. ACM, New York, NY, USA

    Chapter  Google Scholar 

  2. Arnowitz J, Arent M, Berger N (2006) Effective prototyping for software makers (the Morgan Kaufmann series in interactive technologies). Morgan Kaufmann, San Francisco, CA, USA

    Google Scholar 

  3. Beyer H, Holtzblatt K (1998) Contextual design: defining customer-centered systems. Morgan Kaufmann. ISBN: 1-55680-411-1

  4. Boreczky J, Girgensohn A (2000) Gene Golovchinsky, and Shingo Uchihashi. An interactive comic book presentation for exploring video. In: CHI ’00: proceedings of the SIGCHI conference on human factors in computing systems, pp 185–192. ACM, New York, NY, USA

    Chapter  Google Scholar 

  5. Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan Kaufmann

  6. Cheng K-Y, Luo S-J, Chen B-Y, Chu H-H (2009) Smartplayer: user-centric video fast-forwarding. In: CHI ’09: proceedings of the 27th international conference on human factors in computing systems, pp 789–798. ACM, New York, NY, USA

    Chapter  Google Scholar 

  7. Christel MG (2008) Supporting video library exploratory search: when storyboards are not enough. In: CIVR ’08: proceedings of the 2008 international conference on content-based image and video retrieval, pp 447–456. ACM, New York, NY, USA

    Chapter  Google Scholar 

  8. Christel MG, Smith MA, Taylor CR, Winkler DB (1998) Evolving video skims into useful multimedia abstractions. In: CHI ’98: proceedings of the SIGCHI conference on human factors in computing systems, pp 171–178. ACM Press/Addison-Wesley, New York, NY, USA

    Chapter  Google Scholar 

  9. Cilella S (2011) Did you ever know that you’re my hero?: the power of storytelling. Interactions 18:62–66

    Article  Google Scholar 

  10. Dragicevic P, Ramos G, Bibliowitcz J, Nowrouzezahrai D, Balakrishnan R, Singh K (2008) Video browsing by direct manipulation. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, CHI ’08, pp 237–246. ACM, USA, New York, NY

    Chapter  Google Scholar 

  11. Grün C, Gerken J, Jetter H-C, König WA, Reiterer H (2005) Mediovis—a user-centred library metadata browser. In: ECDL 2005: proceedings of the 9th European conference on research and advanced technology for digital libraries 2005, pp 174–185. Springer

  12. Haesen M, Coninx K, Van den Bergh J, Luyten K (2008) Muicser: a process framework for multi-disciplinary user-centred software engineering processes. In: HCSE ’08: second conference on human-centered software engineering, pp 150–165

  13. Haesen M, Meskens J, Luyten K, Coninx K (2010) Draw me a storyboard: incorporating principles and techniques of comics to ease communication and artefact creation in user-centred design. In: In Proc. of BCS conference on human computer interaction

  14. Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST ’05: proceedings of the 18th annual ACM symposium on user interface software and technology, pp 115–118. ACM, New York, NY, USA

    Chapter  Google Scholar 

  15. Haubold A, Kender JR (2007) Vast mm: multimedia browser for presentation video. In: CIVR ’07: proceedings of the 6th ACM international conference on image and video retrieval, pp 41–48. ACM, New York, NY, USA

    Chapter  Google Scholar 

  16. Hauptmann AG, Christel MG, Yan R (2008) Video retrieval based on semantic concepts. Proc IEEE 96(4):602–622

    Article  Google Scholar 

  17. Hauptmann E, Baron RV, Chen MY, Christel M, Mummert L, Schlosser S, Sun X, Valdes V, Yang J (2008) Informedia trecvid2008: exploring new frontiers. In: Trecvid 2008

  18. Heilig M, Demarmels M, König WA, Gerken J, Rexhausen S, Jetter H-C, Reiterer H (2008) Mediovis: visual information seeking in digital libraries. In: Proceedings of the working conference on advanced visual interfaces, AVI ’08, pp 490–491. ACM, New York, NY, USA

    Chapter  Google Scholar 

  19. Hürst W, Götz G, Jarvers P (2004) Advanced user interfaces for dynamic video browsing. In: Proceedings of the 12th annual ACM international conference on multimedia, MULTIMEDIA ’04, pp 742–743. ACM, New York, NY, USA

    Chapter  Google Scholar 

  20. International Standards Organization (1999) ISO 13407. Human centred design process for interactive systems. Geneva, Swiss

  21. Kankanhalli MS, Rui Y (2008) Application potential of multimedia information retrieval. Proc IEEE 96(4):712–720

    Article  Google Scholar 

  22. Karrer T, Weiss M, Lee E, Borchers J (2008) Dragon: a direct manipulation interface for frame-accurate in-scene video navigation. In: CHI ’08: proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, pp 247–250. ACM, New York, NY, USA

    Chapter  Google Scholar 

  23. Masui T, Kashiwagi K, Borden IV GR (1995) Elastic graphical interfaces to precise data manipulation. In: Conference companion on human factors in computing systems, CHI ’95, pp 143–144. ACM, New York, NY, USA

    Chapter  Google Scholar 

  24. Meskens J, Luyten K, Coninx K (2010) D-macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology, UIST ’10, pp 129–138. ACM, New York, NY, USA

    Chapter  Google Scholar 

  25. Morris MR (2007) Interfaces for collaborative exploratory web search: motivations and directions for multi-user design. In: ACM SIGCHI 2007 workshop on exploratory search and HCI: designing and evaluating interfaces to support exploratory search interaction, pp 9–12

  26. Patton J (2008) Consider multiple solutions. IEEE Softw 25:72–73

    Article  Google Scholar 

  27. Pham PT, Moens M-F, Tuytelaars T (2010) Cross-media alignment of names and faces. IEEE Trans Multimedia 12(1):13–27

    Article  Google Scholar 

  28. Pham PT, Moens M-F, Tuytelaars T (2010) Naming persons in news video with label propagation. In: International workshop on visual content identification and search (VCIDS), pp 1528–1533

  29. Plaisant C, Milash B, Rose A, Widoff S, Shneiderman B (1996) Lifelines: visualizing personal histories. In: CHI ’96: proceedings of the SIGCHI conference on human factors in computing systems, pp 221–ff. ACM, New York, NY, USA

    Google Scholar 

  30. Poulisse G-J, Moens M-F, Dekens T, Deschacht K (2010) News story segmentation in multiple modalities. Multimed Tools Appl 48:3–22

    Article  Google Scholar 

  31. Redmond-Pyle D, Moore A (1995) Graphical user interface design and evaluation. Prentice Hall, London

    MATH  Google Scholar 

  32. Smeaton A, Lee H, Foley C, McGivney S (2007) Collaborative video searching on a tabletop. Multimed Syst 12:375–391. doi:10.1007/s00530-006-0064-7

    Article  Google Scholar 

  33. Smeaton AF, Over P, Kraaij W (2006) Evaluation campaigns and trecvid. In: Proceedings of the 8th ACM international workshop on multimedia information retrieval, MIR ’06, pp 321–330. ACM, New York, NY, USA

    Chapter  Google Scholar 

  34. Snoek CGM, Worring M, de Rooij O, van de Sande KEA, Yan R, Hauptmann AG (2008) VideOlympics: real-time evaluation of multimedia retrieval systems. IEEE Multimed 15(1):86–91

    Article  Google Scholar 

  35. Tang A, Greenberg S, Fels S (2008) Exploring video streams using slit-tear visualizations. In: AVI ’08: proceedings of the working conference on advanced visual interfaces, pp 191–198. ACM, New York, NY, USA

    Chapter  Google Scholar 

  36. Twidale MB, Nichols DM, Paice CD (1997) Browsing is a collaborative process. Inf Process Manag 33:761–783

    Article  Google Scholar 

  37. Uchihashi S, Foote J, Girgensohn A, Boreczky J (1999) Video manga: generating semantically meaningful video summaries. In: MULTIMEDIA ’99: proceedings of the seventh ACM international conference on multimedia (part 1), pp 383–392. ACM, New York, NY, USA

    Chapter  Google Scholar 

  38. University of Konstanz HCI Group, Mediovis—project description. http://hci.uni-konstanz.de/index.php?a=research&b=projects&c=16314278&lang=en#description

  39. Wang S, Jing F, He J, Du Q, Zhang L (2007) Igroup: presenting web image search results in semantic clusters. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’07, pp 587–596. ACM, New York, NY, USA

    Chapter  Google Scholar 

  40. Wassink I, Kulyk O, van Dijk EMAG, van der Veer GC, van der Vet PE (2008) Applying a user-centred approach to interactive visualization design. In: Trends in interactive visualization. Springer, London. ISBN: 978-1-84800-268-5

    Google Scholar 

  41. Worring M, Snoek CGM, de Rooij O, Nguyen GP, Smeulders AWM (2007) The MediaMill semantic video search engine. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing. Invited paper, pages –. Honolulu, Hawaii, USA

  42. Zhang HJ, Tan SY, Smoliar SW, Yihong G (1995) Automatic parsing and indexing of news video. Multimed Syst 2:256–266. doi:10.1007/BF01225243

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the IWT Project AMASS+ + (SBO-060051). We would like to thank all members of the AMASS+ + user committee for their feedback about the results discussed during the half-yearly user committee meetings. Special thanks to the Flemish broadcasting company VRT to contribute to the user studies. Grateful acknowledgement is given to Koen Deschacht, Wim De Smet, Scott Martens, Ineke Schuurman, Vincent Vandeghinste, Frank Van Eynde and Luc Van Gool. Furthermore, we would like to thank Jimmy Cleuren for his contribution to the high-fidelity prototypes and Karel Robert for the graphic design of the user interface.

Author information

Authors and Affiliations

  1. Expertise Centre for Digital Media, Hasselt University – tUL – IBBT, Wetenschapspark 2, 3590, Diepenbeek, Belgium

    Mieke Haesen, Jan Meskens, Kris Luyten & Karin Coninx

  2. ESAT/PSI, K.U. Leuven, Kasteelpark Arenberg 10 – Bus 02441, 3001, Heverlee, Belgium

    Jan Hendrik Becker & Tinne Tuytelaars

  3. Department of Computer Science, K.U. Leuven, Celestijnenlaan 200A, 3001, Heverlee, Belgium

    Gert-Jan Poulisse, Phi The Pham & Marie-Francine Moens

Authors
  1. Mieke Haesen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jan Meskens
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kris Luyten
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karin Coninx
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jan Hendrik Becker
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tinne Tuytelaars
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Gert-Jan Poulisse
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Phi The Pham
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Marie-Francine Moens
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mieke Haesen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Haesen, M., Meskens, J., Luyten, K. et al. Finding a needle in a haystack: an interactive video archive explorer for professional video searchers. Multimed Tools Appl 63, 331–356 (2013). https://doi.org/10.1007/s11042-011-0809-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0809-y

Keywords

Search

Navigation