Jean Scholtz
Catherine Plaisant
ABSTRACT
We describe the evolution of the IEEE Visual Analytics Science and Technology (VAST) Challenge from its origin in 2006 to present (2012). The VAST Challenge has provided an opportunity for visual analytics researchers to test their innovative thoughts on approaching problems in a wide range of subject domains against realistic datasets and problem scenarios. Over time, the Challenge has changed to correspond to the needs of researchers and users. We describe those changes and the impacts they have had on topics selected, data and questions offered, submissions received, and the Challenge format.
- K. Cook, G. Grinstein, M. Whiting, M. Cooper, P. Havig, K. Liggett, B. Nebesh, and C. Paul. VAST Challenge 2012: Visual Analytics for Big Data, In Proc. VAST 2012, (Seattle, 14--19 Oct 2012).Google Scholar
Digital Library
- L. Costello, G. Grinstein, C. Plaisant, and J. Scholtz. Advancing user-centered evaluation of visual analytic environments through contests. Information Visualization, 8:230--238, 2009. Google ScholarDigital Library
- The DARPA Grand Challenge 2005. http://en.wikipedia.org/wiki/DARPA_Grand_Challenge. Accessed Oct. 30th, 2012.Google Scholar
- The DARPA Red Balloon Challenge. http://archive.darpa.mil/networkchallenge/. Accessed Oct. 30, 2012.Google Scholar
- The DARPA Urban Challenge. http://archive.darpa.mil/grandchallenge/. Accessed Oct. 30th, 2012.Google Scholar
- G. Grinstein, T. O'Connell, S. Laskowski, C. Plaisant, J. Scholtz, and M. Whiting. VAST 2006 Contest: A Tale of Alderwood, In Proc. VAST 2006, IEEE Computer Society Press, (2006), 215--216.Google Scholar
- Image Group Fingerprint Overview, http://www.nist.gov/itl/iad/ig/fingerprint.cfm. Accessed Oct. 30th, 2012.Google Scholar
- Text REtrival Conference (TREC).. http://trec.nist.gov/. Accessed Oct. 30th, 2012.Google Scholar
- National Science Foundation Science and Engineering Visualization Contest. http://www.nsf.gov/news/special_reports/scivis/challenge.jsp. Accessed Oct. 30th, 2012.Google Scholar
- Netflix Recommender Systems Contest. http://www.netflixprize.com//index. Accessed Oct. 30th, 2012.Google Scholar
- NIST Facial Recognition, http://www.nist.gov/itl/iad/ig/face.cfm. Accessed Oct. 30th, 2012.Google Scholar
- C. Plaisant. The Challenge of Information Visualiation Evaluation, In IEEE Proceedings of AVI, 2004. Google ScholarDigital Library
- J. Redish, Expanding Usability Evaluation to Test Complex Systems. Journal of Usability Studies. 2, 3 (May 2007), 102--111.Google Scholar
- J. Scholtz, Developing Qualitative Metrics for Visual Analytic Environments. In Proceedings of BELIV '10, 1--7. Google ScholarDigital Library
- Scientific Evaluations Methods for Visual Analytics Science and Technology (SEMVAST) www.cs.umd.edu/hcil/semvastGoogle Scholar
- Visual Analytics Benchmark Repository. http://hcil.cs.umd.edu/localphp/hcil/vast/archive/Google Scholar
- M. Whiting, J. Haack, and C. Varley. Creating realistic, scenario-based synthetic data for test and evaluation of information analytics software. In Proc. BELIV '08. ACM, (2008), 1--9. Google ScholarDigital Library
- M. Whiting, C. North, A. Endert, J. Scholtz, J. Haack, C. Varley, J. Thomas. VAST contest dataset use in education. In Proc. IEEE VAST 2009 Symposium (2009), 115--122.Google ScholarCross Ref
Index Terms
- A reflection on seven years of the VAST challenge
Recommendations
VAST Challenge 2012: Visual analytics for big data
VAST '12: Proceedings of the 2012 IEEE Conference on Visual Analytics Science and Technology (VAST)The 2012 Visual Analytics Science and Technology (VAST) Challenge posed two challenge problems for participants to solve using a combination of visual analytics software and their own analytic reasoning abilities. Challenge 1 (C1) involved visualizing ...
VAST Challenge 2012: Interactively finding anomalies in geo-temporal multivariate data
VAST '12: Proceedings of the 2012 IEEE Conference on Visual Analytics Science and Technology (VAST)In this paper we describe the tool we developed to solve the VAST 2012 Challenge. We present how an expert can online analyze huge amounts of multivariate data in space and time. The visual components and the interaction between the system and the user ...
Interactive spatio-temporal cluster analysis of VAST challenge 2008 datasets
VAKD '09: Proceedings of the ACM SIGKDD Workshop on Visual Analytics and Knowledge Discovery: Integrating Automated Analysis with Interactive ExplorationWe describe a visual analytics method supporting the analysis of two different types of spatio-temporal data, point events and trajectories of moving agents. The method combines clustering with interactive visual displays, in particular, map and space-...
Comments