skip to main content
10.1145/2393347.2396510acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Semantic awareness for automatic image interpretation

Published:29 October 2012Publication History

ABSTRACT

This thesis aims at developing methods to make digital devices more automatic and intuitive while focusing on image-related applications. We learn associations between image characteristics and keywords with a statistical framework based on large databases of annotated images. Such associations are widely exploitable and we demonstrate two main applications: semantic image enhancement and automatic color naming. Both applications show convincing results and suggest that the framework can be extended to other areas.

References

  1. XKCD color survey, http://blog.xkcd.com/2010/05/ 03/color-survey-results/, last checked apr. 2012.Google ScholarGoogle Scholar
  2. L. Cieplinski. MPEG-7 Color Descriptors and Their Applications. In Computer Analysis of Images and Patterns, volume 2124, pages 11--20, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. D. Cohen-Or, O. Sorkine, R. Gal, T. Leyvand, and Y.-Q. Xu. Color harmonization. ACM Trans. Graphics, 25(3):624--630, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Cusano, F. Gasparini, and R. Schettini. Image annotation for adaptive enhancement of uncalibrated color images. In Lecture Notes in Computer Science, volume 3736, pages 216--225, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. J. Davidoff, I. Davies, and D. Roberson. Colour categories in a stone-age tribe. Nature, 398:203--204, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  6. J. Frank J. Massey. The Kolmogorov-Smirnov Test for Goodness of Fit. In American Statistical Association, volume 46, pages 68--78, 1951.Google ScholarGoogle ScholarCross RefCross Ref
  7. M. J. Huiskes and M. S. Lew. The MIR flickr retrieval evaluation. In ACM MIR, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Hummel. Image Enhancement by Histogram Transformation. CGIP, 6(2):184--195, 1977.Google ScholarGoogle Scholar
  9. A. Lindner, N. Bonnier, and S. Süsstrunk. A large-scale multi-lingual color thesaurus. In CIC (to appear), 2012.Google ScholarGoogle Scholar
  10. A. Lindner, N. Bonnier, and S. Süsstrunk. What is the color of chocolate? - extracting color values of semantic expressions. In CGIV, 2012.Google ScholarGoogle Scholar
  11. A. Lindner, A. Shaji, N. Bonnier, and S. Süsstrunk. Joint statistical analysis of images and keywords with applications in semantic image enhancement. ACM MM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. N. Moroney. Unconstrained web-based color naming experiment. In Color Imaging VIII: Processing, Hardcopy, and Applications, volume 5008, pages 36--46. EI, 2003.Google ScholarGoogle Scholar
  13. S. Moser and M. Schroeder. Usage of DSC meta tags in a general automatic image enhancement system. In EI, volume 4669, pages 259--267, San Jose, CA, USA, January 2002.Google ScholarGoogle Scholar
  14. D. Mylonas, L. MacDonald, and S. Wuerger. Towards an Online Color Naming Model. In CIC, pages 140--144, 2010.Google ScholarGoogle Scholar
  15. R. L. Plackett. Karl pearson and the chi-squared test. International Statistical Review, 51(1):59--72, 1983.Google ScholarGoogle ScholarCross RefCross Ref
  16. E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley. Color transfer between images. IEEE Computer Graphics and Applications, 21(5):2--9, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. C. Sauvaget and V. Boyer. Harmonic colorization using proportion contrast. In AFRIGRAPH, pages 63--69, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. D. Sekulovski, G. Geleijnse, B. Kater, J. Korst, S. Pauws, and R. Clout. Enriching text with images and colored light. In EI, volume 6820, 2008.Google ScholarGoogle Scholar
  19. J. van de Weijer, C. Schmid, J. Verbeek, and D. Larlus. Learning color names for real-world applications. TIP, 18(7):1512--1523, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. F. Wilcoxon. Individual comparisons by ranking methods. Biometrics Bulletin, 1(6):80--83, 1945.Google ScholarGoogle ScholarCross RefCross Ref
  21. I. H. Witten, E. Frank, and M. A. Hall. Data Mining: Practical Machine Learning Tools and Techniques, volume 3. Morgan Kaufmann, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. S. Zhuo and T. Sim. Defocus map estimation from a single image. Pattern Recognition, 44(9):1852--1858, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Semantic awareness for automatic image interpretation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MM '12: Proceedings of the 20th ACM international conference on Multimedia
        October 2012
        1584 pages
        ISBN:9781450310895
        DOI:10.1145/2393347

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 October 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate995of4,171submissions,24%

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader