skip to main content
10.1145/2207676.2207741acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Semantic interaction for visual text analytics

Authors Info & Claims
Published:05 May 2012Publication History

ABSTRACT

Visual analytics emphasizes sensemaking of large, complex datasets through interactively exploring visualizations generated by statistical models. For example, dimensionality reduction methods use various similarity metrics to visualize textual document collections in a spatial metaphor, where similarities between documents are approximately represented through their relative spatial distances to each other in a 2D layout. This metaphor is designed to mimic analysts' mental models of the document collection and support their analytic processes, such as clustering similar documents together. However, in current methods, users must interact with such visualizations using controls external to the visual metaphor, such as sliders, menus, or text fields, to directly control underlying model parameters that they do not understand and that do not relate to their analytic process occurring within the visual metaphor. In this paper, we present the opportunity for a new design space for visual analytic interaction, called semantic interaction, which seeks to enable analysts to spatially interact with such models directly within the visual metaphor using interactions that derive from their analytic process, such as searching, highlighting, annotating, and repositioning documents. Further, we demonstrate how semantic interactions can be implemented using machine learning techniques in a visual analytic tool, called ForceSPIRE, for interactive analysis of textual data within a spatial visualization. Analysts can express their expert domain knowledge about the documents by simply moving them, which guides the underlying model to improve the overall layout, taking the user's feedback into account.

Skip Supplemental Material Section

Supplemental Material

paperfile1970-3.mov

mov

18.2 MB

References

  1. Alias-i. 2008. LingPipe 4.0.1. City, 2008.Google ScholarGoogle Scholar
  2. i2 Analyst's Notebook. City.Google ScholarGoogle Scholar
  3. Alsakran, J., Chen, Y., Zhao, Y., Yang, J. and Luo, D. STREAMIT: Dynamic visualization and interactive exploration of text streams. In Proceedings of the IEEE Pacific Visualization Symposium, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Andrews, C., Endert, A. and North, C. Space to Think: Large, High-Resolution Displays for Sensemaking. In Proceedings of the CHI '10, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Callahan, S. P., Freire, J., Santos, E., Scheidegger, C. E., C, Silva, u. T. and Vo, H. T. VisTrails: visualization meets data management. In Proceedings of the SIGMOD international conference on Management of data (Chicago, IL, USA, 2006). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Cowley, P., Haack, J., Littlefield, R. and Hampson, E. Glass box: capturing, archiving, and retrieving workstation activities. In Proceedings of the workshop on Continuous archival and retrival of personal experences (Santa Barbara, California, USA, 2006). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dou, W., Jeong, D. H., Stukes, F., Ribarsky, W., Lipford, H. R. and Chang, R. Recovering Reasoning Processes from User Interactions. IEEE Computer Graphics and Applications, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Endert, A., Andrews, C., Fink, G. A. and North, C. Professional Analysts using a Large, High-Resolution Display. In Proceedings of the IEEE VAST Extended Abstract (2009).Google ScholarGoogle Scholar
  9. Endert, A., Han, C., Maiti, D., House, L., Leman, S. C. and North, C. Observation-level Interaction with Statistical Models for Visual Analytics. IEEE VAST, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  10. Frank M. Shipman, I. and Marshall, C. C. Formality Considered Harmful: Experiences, Emerging Themes, and Directions on the Use of Formal Representations inInteractive Systems. ACM CSCW, 8, 4, 1999, 333--352. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Fruchterman, T. M. J. and Reingold, E. M. Graph drawing by force-directed placement. Software: Practice and Experience, 21, 11 1991, 1129--1164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Gotz, D. Interactive Visual Synthesis of Analytic Knowledge. IEEE VAST, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  13. Heer, J. prefuse manual, 2006.Google ScholarGoogle Scholar
  14. Heer, J., Mackinlay, J., Stolte, C. and Agrawala, M. Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation. IEEE Transactions on Visualization and Computer Graphics, 14, 6, 2008, 1189--1196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jeong, D. H., Ziemkiewicz, C., Fisher, B., Ribarsky, W. and Chang, R. iPCA: An Interactive System for PCAbased Visual Analytics. Computer Graphics Forum, 28, 2009, 767--774. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Karen A Statistical Interpretation of Term Specificity and its Application in Retrieval. Journal of Documentation, 28, 1972, 11--21.Google ScholarGoogle Scholar
  17. Marshall, C. C., Frank M. Shipman, I. and Coombs, J. H. VIKI: spatial hypertext supporting emergent structure. In Proceedings of the European conference on Hypermedia technology (Edinburgh, Scotland, 1994). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Olsen, K. A., Korfhage, R. R., Sochats, K. M., Spring, M. B. and Williams, J. G. Visualization of a document collection: the vibe system. Information Process Management, 29, 1 1993, 69--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Pirolli, P. and Card, S. Sensemaking Processes of Intelligence Analysts and Possible Leverage Points as Identified Though Cognitive Task Analysis Proceedings of the International Conference on Intelligence Analysis, 2005, 6.Google ScholarGoogle Scholar
  20. Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., O'Connell, T., Laskowski, S., Chien, L., Tat, A., Wright, W., Gorg, C., Zhicheng, L., Parekh, N., Singhal, K. and Stasko, J. Evaluating Visual Analytics at the 2007 VAST Symposium Contest. Computer Graphics and Applications, IEEE, 28, 2 2008, 12--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Shrinivasan, Y. B. and Wijk, J. J. v. Supporting the analytical reasoning process in information visualization. In Proceedings of the CHI '08 (Florence, Italy, 2008). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Skupin, A. A Cartographic Approach to Visualizing Conference Abstracts. IEEE Computer Graphics and Applications, pp. 50--58, January/February, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Thomas, J. J., Cook, K. A., National, V. and Analytics, C. Illuminating the path. IEEE Computer Society, 2005.Google ScholarGoogle Scholar
  24. Torres, R. S., Silva, C. G., Medeiros, C. B. and Rocha, H. V. Visual structures for image browsing. In Proceedings of the conference on Information and knowledge management (New Orleans, LA, USA, 2003). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Wise, J. A., Thomas, J. J., Pennock, K., Lantrip, D., Pottier, M., Schur, A. and Crow, V. Visualizing the nonvisual: spatial analysis and interaction with information for text documents. Morgan Kaufmann Publishers, 1999.Google ScholarGoogle Scholar
  26. Wright, W., Schroh, D., Proulx, P., Skaburskis, A. and Cort, B. The Sandbox for analysis: concepts and methods. In Proceedings of the CHI '06 (New York, NY, 2006). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Yi, J. S., Melton, R., Stasko, J. and Jacko, J. A. Dust & magnet: multivariate information visualization using a magnet metaphor. Information Visualization, 4, 4, 2005, 239--256. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Semantic interaction for visual text analytics

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      May 2012
      3276 pages
      ISBN:9781450310154
      DOI:10.1145/2207676

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 5 May 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader