Skip to main content
SpringerLink
Log in

Symbiosis between the TRECVid benchmark and video libraries at the Netherlands Institute for Sound and Vision

  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

Audiovisual archives are investing in large-scale digitization efforts of their analogue holdings and, in parallel, ingesting an ever-increasing amount of born-digital files in their digital storage facilities. Digitization opens up new access paradigms and boosted re-use of audiovisual content. Query-log analyses show the shortcomings of manual annotation, therefore archives are complementing these annotations by developing novel search engines that automatically extract information from both audio and the visual tracks. Over the past few years, the TRECVid benchmark has developed a novel relationship with the Netherlands Institute of Sound and Vision (NISV) which goes beyond the NISV just providing data and use cases to TRECVid. Prototype and demonstrator systems developed as part of TRECVid are set to become a key driver in improving the quality of search engines at the NISV and will ultimately help other audiovisual archives to offer more efficient and more fine-grained access to their collections. This paper reports the experiences of NISV in leveraging the activities of the TRECVid benchmark.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. MuNCH is part of NWO’s CATCH (Continuous Access To Cultural Heritage) program.

  2. http://www.axes-project.eu/.

  3. http://www.vidivideo.info/.

  4. http://www.videolympics.org.

  5. www.comscore.com, 2009 US Online Video Viewing Sets Record.

  6. http://pubs.opengroup.org/architecture/togaf8-doc/arch/.

  7. http://www.axes-project.eu.

  8. http://www.commit-nl.nl.

  9. http://mmm2012.org/vbshowdown/.

References

  1. Armitage, L.H., Enser, P.G.B.: Information Need in the Visual Document Domain: Report on Project RDD/G/235 to the British Library Research and Innovation Centre. School of Information Management, University of Brighton (1996)

  2. Christel, M.G.: Establishing the utility of non-text search for news video retrieval with real world users. In: Proceedings of the 15th International Conference on Multimedia, MULTIMEDIA ’07, pp. 707–716. ACM, New York, NY, USA (2007)

  3. De Jong, A.: Users, producers and other tags. Trends and developments in metadata creation, Lecture at the FIAT/IFTA conference, Lisbon, Portugal, Oct, 2007

  4. de Rooij, O., Snoek, C.G., Worring, M.: Balancing thread based navigation for targeted video search. In: Proceedings of the 2008 International Conference on Content-Based Image and Video Retrieval, CIVR ’08, pp. 485–494. ACM, New York, NY, USA (2008)

  5. Enser, P.G.B., Sandom, C.J.: Retrieval of archival moving imagery—CBIR outside the frame. In: Lew, M.S., Sebe, N., Eakins, J.P. (eds.) Proceedings of the Image and Video Retrieval, International Conference, CIVR 2002, London, UK, July 18–19, 2002, vol. 2383 of Lecture Notes in Computer Science. Springer, Berlin (2002)

  6. Halvey, M.J., Keane, M.T.: Analysis of online video search and sharing. In: Proceedings of the Eighteenth Conference on Hypertext and Hypermedia. HT ’07, pp. 217–226. ACM, New York, NY, USA (2007)

  7. Hertzum, M.: Requests for information from a film archive: A case study of multimedia retrieval. J. Doc. 59(2), 168–186 (2003)

    Article  Google Scholar 

  8. Hollink, L., Schreiber, G., Huurnink, B., Van Liempt, M., de Rijke, M., Smeulders, A., Oomen, J., De Jong, A.: A multidisciplinary approach to unlocking television broadcast archives. Interdiscip. Sci. Rev. 34 2(3), 253–267 (2009)

    Google Scholar 

  9. Huurnink, B., Hollink, L., van den Heuvel, W., de Rijke, M.: Search behavior of media professionals at an audiovisual archive: A transaction log analysis. J. Am. Soc. Inf. Sci. Technol. 61(6), 1180–1197 (2010)

    Google Scholar 

  10. Huurnink, B., Snoek, C.G.M., de Rijke, M., Smeulders, A.W.M.: Today’s and tomorrow’s retrieval practice in the audiovisual archive. In: Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR ’10, pp. 18–25. ACM, New York, NY, USA (2010)

  11. Huurnink, B., Snoek, C.G.M., de Rijke, M., Smeulders, A.W.M.: Content-based analysis improves audiovisual archive retrieval. IEEE Trans. Multimed. 14(4), 1166–1178 (2012)

    Article  Google Scholar 

  12. Jackson, J.: Video search still a tough nut to crack. Computer World, May (2010)

  13. McCarty, W.: Beyond retrieval? Computer science and the humanities, November 2007. Keynote lecture for the CATCH Midterm Event, Den Haag, The Netherlands

  14. Oomen, J., Smeulders, H.: D2.1 first analysis of metadata in the cultural heritage domain (project deliverable MultiMatch project) (2006)

  15. Pu, H.-T.: An analysis of failed queries for web image retrieval. J. Inf. Sci. 34(3), 275–289 (2008)

    Google Scholar 

  16. Rowe, B.R., Wood, D.W., Link, A.N., Simoni, D.A.: Economic Impact Assessment of NISTs Text REtrieval Conference (TREC) Program. Technical Report Project Number 0211875, RTI, International, June 2010

  17. Shatford, S.: Analyzing the subject of a picture: A theoretical approach. Cat. Classif. Q. 6(3), 39–61 (1986)

    Article  Google Scholar 

  18. Smeaton, A.F., Over, P., Doherty, A.R.: Video shot boundary detection: Seven years of TRECVid activity. Comput. Vis. Image Underst. 114, 411–418 (2010)

    Article  Google Scholar 

  19. Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and TRECVid. In: MIR ’06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330. ACM, New York, NY, USA (2006)

  20. Smeaton, A.F., Over, P., Kraaij, W.: High-level feature detection from video in TRECVid: A 5-year retrospective of achievements. In: Divakaran, A. (ed.) Multimedia Content Analysis, Theory and Applications, pp. 151–174. Springer, Berlin (2009)

    Google Scholar 

  21. Snoek, C., Worring, M., Geusebroek, J.-M., Koelma, D., Seinstra, F.: On the surplus value of semantic video analysis beyond the key frame. In: International Conference on Multimedia and Expo, 2005. ICME 2005. IEEE. Amsterdam, The Netherlands, p. 4, July 2005.

  22. Snoek, C.G., Freiburg, B., Oomen, J., Ordelman, R.: Crowdsourcing rock n’ roll multimedia retrieval. In: Proceedings of the International Conference on Multimedia, MM ’10, pp. 1535–1538. ACM, New York, NY, USA (2010)

  23. Snoek, C.G.M., Smeulders, A.W.M.: Visual-concept search solved? IEEE Comput. 43(6), 76–78 (2010)

    Article  Google Scholar 

  24. Snoek, C.G.M., van de Sande, K.E.A., Koelma, D.C., Smeulders, A.W.M.: Any hope for cross-domain concept detection in Internet video. In: The TRECVid Workshop, National Institute of Standards and Technology, Gaithersburg, MD, USA, November 2010

  25. Snoek, C.G.M., Worring, M.: Concept-based video retrieval. Found. Trends Inf. Retr. 4(2), 215–322 (2009)

    Google Scholar 

  26. Strassel, S., Morris, A., Fiscus, J., Caruso, C., Lee, H., Over, P., Fiumara, J., Shaw, B., Antonishek, B., Michel, M.: Creating HAVIC: heterogeneous audio visual Internet collection. In: Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Istanbul, Turkey, May 2012 European Language, Resources Association (ELRA).

  27. Thornley, C.V., Johnson, A.C., Smeaton, A.F., Lee, H.: The scholarly impact of TRECVid (2003–2009). J. Am. Soc. Inf. Sci. Technol. 62(4), 613–627 (2011)

    Article  Google Scholar 

  28. Tjondronegoro, D., Spink, A., Jansen, B.J.: A study and comparison of multimedia web searching: 1997–2006. J. Am. Soc. Inf. Sci. Technol. 60(9), 1756–1768 (2009)

    Google Scholar 

  29. UNESCO. United Nations Educational, Scientific, and Cultural Organization: International Appeal for the Preservation of the World Audiovisual Heritage, April 2005 (last accessed January 2012)

  30. van den Heuvel, W.: Expert search for radio and television: A case study amongst Dutch broadcast professionals. In: Proceedings of the 8th International Interactive Conference on Interactive TV and Video, EuroITV ’10, pp. 47–50. ACM, New York, NY, USA (ACM)

  31. van Velzen, E.: Must archives become IT organisations?. Lecture presented at FIAT-IFTA World Conference. Dublin, Ireland (2010)

  32. Webster, D.: IP traffic to quadruple by 2015, June 2011. http://blogs.cisco.com/sp/ip-traffic-to-quadruple-by-2015

  33. Zhang, Y., Subirats, I., Salaba, A., Nicolai, C., Zeng, M., Hillmann, D., Zumer, M., Neal, D.: FRBR implementation and user research. Proc. Am. Soc. Inf. Sci. Technol. 47(1), 1–3 (2010)

    MATH  Google Scholar 

Download references

Acknowledgments

J. Oomen is supported by the AGORA project of the NWO CATCH programme. A. Smeaton would like to acknowledge support of Science Foundation Ireland through grant number 07/CE/I1147.

Author information

Authors and Affiliations

  1. Netherlands Institute for Sound and Vision, Amsterdam, The Netherlands

    Johan Oomen

  2. National Institute of Standards and Technology, Gaithersburg, MD, 20899-8940, USA

    Paul Over

  3. TNO and the Institute for Computing and Information Sciences, Radboud University Nijmegen, Nijmegen, The Netherlands

    Wessel Kraaij

  4. CLARITY: Centre for Sensor Web Technologies, Dublin City University, Glasnevin, Dublin 9, Ireland

    Alan F. Smeaton

Authors
  1. Johan Oomen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul Over
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wessel Kraaij
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alan F. Smeaton
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alan F. Smeaton.

Additional information

Certain commercial entities, equipment, or materials may be identified in this document in order to describe an experimental procedure or concept adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards, nor is it intended to imply that the entities, materials, or equipment are necessarily the best available for the purpose.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Oomen, J., Over, P., Kraaij, W. et al. Symbiosis between the TRECVid benchmark and video libraries at the Netherlands Institute for Sound and Vision. Int J Digit Libr 13, 91–104 (2013). https://doi.org/10.1007/s00799-012-0102-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-012-0102-3

Keywords

Search

Navigation