Abstract
This article presents the results of the evaluation study of the Augmented Representation of Cultural Objects (ARCO) system which provides software and interface tools to museum curators for the development of virtual museum exhibitions for the World Wide Web or for information kiosks. The aim of the current research is to investigate how a virtual museum system is coping with the demands of museum curators, to examine the needs of virtual museum visitors, and to provide a set of criteria and guidelines for defining effective evaluation of such systems. Evaluation methods such as heuristic evaluation and walkthroughs were employed in the study in order to assess various components and interfaces of the system.
- ARCO Evaluation Report. 2004. Assessment and Evaluation report on the ARCO system and its components. Retrieved July, 1, 2007: http://www.arco-web.org/TextVersion/Documents/Deliverables/Arco-D16-R-1.0-170904.pdfGoogle Scholar
- Arnold, D. and G. Geser. 2007. Research Agenda for the Applications of ICT to Cultural Heritage. Epoch Publication. Budapest: Archaeolingua.Google Scholar
- Billinghurst, M., Kato, H., and I. Poupyrev. 2001. The Magic-Book---Moving Seamlessly between Reality and Virtuality. IEEE Computer Graphics and Applications 21 (3): 2--4. Google ScholarDigital Library
- Borun, M. and R. Korn, eds. 1999. Introduction to Museum Evaluation. Committee on Audience Research and Evaluation, American Association of Museums, Professional Practice Series, Washington, DC: AAM.Google Scholar
- Catarci, T. 2000. What Happened when Database Researchers Met Usability. Information Systems, 25 (3): 177--212. Google ScholarDigital Library
- CIDOC Multimedia Working Group. 1997. Multimedia Evaluation Criteria. (Chair: J. Trant). Retrieved July, I, 2007: http://www.archimuse.com/papers/cidoc/cidoc.mmwg.eval.crit.htmlGoogle Scholar
- Di Bias, N., Guermand, M. P., Orsini, C., and P. Paolini. 2002. Evaluating the Features of Museum Websites (The Bologna Report). Retrieved July, 1, 2007: http://www.archimuse.com/mw2002/papers/diblas/diblas.htmlGoogle Scholar
- Di Blas, N., Garzotto, F., Guermand, M. P., and F. Nicolucci. 2003. A Methodology for Evaluating Archaeological Web Sites. In K. Fischer Ausserer, W. Börner, M. Goriany and L. Karlhuber-Vöckl (Eds.), Proceedings of CAA (Computer Applications and Quantitative Methods in Archaeology) (pp. 200--203). BAR International: British Archaeological Series.Google Scholar
- Dumas, J. F., and J. C. Redish. 1999. A practical guide to usability testing. Portland, Intellect Ltd. Google ScholarDigital Library
- Economou, M. 2002. XII: Assessment of Projects by User Evaluation. In Guide to Good Practice in Digital Representation and Management of Cultural Heritage Material' by the National Initiative for a Networked Cultural Heritage, USA. Retrieved January 22, 2006 on the World Wide Web: http://www.nvu.edu/its/humanities/ninchguide/Google Scholar
- Greenbaum, J., and M. Kyng, eds. 1991. Design at Work: Cooperative Design of Computer Systems. Hillsdale, NJ: Lawrence Erlbaum. Google ScholarDigital Library
- Guest G., Bunce A. and L. Johnson. 2006. How Many Interviews Are Enough? An Experiment with Data Saturation and Variability. Field Methods 18: 59.Google ScholarCross Ref
- Hein, G. E. 1998. Learning in the museum. London: Routledge.Google Scholar
- Hooper-Greenhill, E. 2000. Changing Values in the Art Museum: Rethinking Communication and Learning. International Journal of Heritage Studies 6(1): 9--31.Google ScholarCross Ref
- Hoptman, G. H. 1992. The Virtual Museum and Related Epistemological Concerns. Sociomedia. Multimedia, Hypermedia and the Social Construction of Knowledge: 141--159.Google Scholar
- IBM a, User-Centered Design principles. Retrieved July, 1, 2007: http://www-03.ibm.com/easy/page/13Google Scholar
- IBM b, Design basics. Retrieved July, 1, 2007: http://www-03.ibm.com/easy/page/6Google Scholar
- ICOM/CIDOC. Multimedia Working Group. 1996. Introduction to Multimedia in Museums. Retrieved July, 1, 2007: http://www.willpowerinfo.myby.co.uk/cidoc/introtomultimediamuseums.pdfGoogle Scholar
- ISO (International Organization for Standardization) 1998. ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs).Google Scholar
- Jones, J., and M. Christal. 2002. The Future of Virtual Museums: On-Line, Immersive, 3D Environments. Created Realities Group white paper. Retrieved July, 1, 2007: http://created-realities.com/pdf/Virtual_Museums.pdfGoogle Scholar
- Karasimos, A. and Isard, A. 2004 'Multilingual evaluation for a natural language generation system;, Proceedings of Lanugage Resources and Evaluation (LREC) 2004Google Scholar
- Karat, C., Campbell, R. & Fiegel, T. 1992. Comparison of Empirical Testing and Walkthrough Methods in User Interface Evaluation. In Proceedings of ACM CHI '92. Monterey, CA, May 3--7, 397--404, ACM publ. Google ScholarDigital Library
- Karoulis A., Sylaiou S., White M. 2006a. Combinatory Usability Evaluation of an Educational Virtual Museum Interface. In Proceedings of the 6th IEEE International Conference on Advanced Learning Technologies (ICALT2006), Kerkrade, The Netherlands, July 2006: 340--342. Google ScholarDigital Library
- Karoulis, A., Sylaiou, S., and M. White, 2006b. Usability evaluation of a virtual museum interface. Journal Informatica. 17(3): 363--380. Google ScholarDigital Library
- Liarokapis, F., Sylaiou, S., Basu, A., Mourkoussis, N., White, M., Lister, P. F. 2004. An Interactive Visualisation Interface for Virtual Museums. In Proceedings of the 5th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, Brussels, Belgium, December 2004: 47--56. Google ScholarDigital Library
- Lewis, C., Polson P., Wharton C., and J. Rieman. 1990. Testing walkthrough methodology for theory-based design of walkup-and-use interfaces. In Chew, J. and Whiteside, J. (Eds.), Proceedings ACM CHI '90 Conference Seattle (Special issue of the SIGCHI Bulletin): 235--242. Google ScholarDigital Library
- Liarokapis, F., Sylaiou, S., Basu, A., Mourkoussis, N., White, M., and P. F. Lister. 2004. An Interactive Visualisation Interface for Virtual Museums. In Fellner, D. and Spencer S. (Eds), Proceedings of the 5th International Symposium on Virtual Reality, Archaeology and Cultural Heritage: 47--56. Google ScholarDigital Library
- Lord, G. D., Lord, B. and J. S. Nicks. 1989a. The Cost of Collecting. Museums Journal, 89(2): 32--33.Google Scholar
- Lord, G. D., Lord, B. and J. S. Nicks. 1989b. The Cost of Collecting. Collection Management in UK Museums - A Report commissioned by the Office of Arts and Libraries. London: HMSO.Google Scholar
- Mazzoleni, P., Bertino E., Ferrari E. and S. Valtolina. 2004. CiVeDi: Customized Virtual Environment for Database Interaction. ACM Sigmod Record, 33(3): 15--20. Google ScholarDigital Library
- Monopoli, M and Nicholas, D. 2001. 'A user evaluation of subject based information gateways: A case study ADAM' Aslib Proceedings Vol 53 (1) January 2001: 39--52.Google Scholar
- Mourkoussis, N., White M., Patel M., Chmielewski J. and K. Walczak. 2003. AMS - Metadata for Cultural Exhibitions using Virtual Reality. In Sutton, S., Greenberg, J., and Tennis, J. (Eds.), Proceedings of Dublin Core Conference (DC2003). Seattle, Washington, USA 2003. Retrieved July, 1, 2007: http://purl.oclc.org/dc2003/03mourkoussis.pdf Google ScholarDigital Library
- Namioka, A. and D. Schuler, eds. 1993. Participatory design. Principles and practices. Hillsdale NJ: Lawrence Erlbaum. Google ScholarDigital Library
- Nicks, J. 1999. Collections Management. In Lord, G. D. and Lord, B. (Eds) The Manual of Museum Planning. London: The Stationery Office, 2nd edition: 109--139.Google Scholar
- Nielsen, J. 1993. Usability Engineering, New York, NY: Academic Press Inc. Google ScholarDigital Library
- Norman, D. A. and S. W. Draper, eds. 1986. User Centered System Design. Hillsdale, NJ: Lawrence Erlbaum.Google ScholarDigital Library
- Pearce, S. M. 1992. Museums, Objects and Collections: A Cultural Study. Leicester and London: Leicester University Press.Google Scholar
- Preece, J., Roger, Y., Sharp, H., Beyon, D., Holland, S., and Carey, I., (1994). Human Computer Interaction. Wokingham, UK: Addison Wesley. Google ScholarDigital Library
- Preece, J., Rogers, Y., and H. Sharp. 2002. Interaction Design: Beyond Human-Computer Interaction. New York: John Wiley and Sons Inc. Google ScholarDigital Library
- Romney, A. K., Weller, S. C and W. H. Batchelder. 1986. Culture as consensus: A theory of culture and informant accuracy. American Anthropologist, 88: 313--338.Google ScholarCross Ref
- Ryan, G., and H. R. Bernard. 2003. Techniques to identify themes. Field Methods 15: 85--109.Google ScholarCross Ref
- Scali, G., Segbert M. and B. Morganti. 2002. Multimedia applications for innovation in cultural heritage: 25 European trial projects and their accompanying measure TRIS. In 68th IFLA Council and General Conference August 18--24, 2002. Retrieved July, 1, 2007: http://www.ifla.org/IV/ifla68/papers/044--123e.pdfGoogle Scholar
- Signore, O. 2005. A Comprehensive Model for Web Sites Quality. In Proceedings of the Seventh IEEE International Symposium on Web Site Evolution, Budapest, Hungary: 30--36. Retrieved July, 1, 2007: http://www.weblab.isti.cnr.it/papers/restricted/wse2005.pdf) Google ScholarDigital Library
- Sylaiou S., Almosawi A., Mania K., White M. 2004. Preliminary Evaluation of the Augmented Representation of Cultural Objects System. In Proceedings of the 10th International Conference on Virtual Systems and Multimedia, Hybrid Realities-Digital Partners, Explorations in Art, Heritage, Science and the Human Factor (VSMM04), November 2004, Softopia, Ogaki City, Japan: 426--431.Google Scholar
- Treinen, H. 1996. Ausstellungen und Kommunikationstheorie. In Haus der Geschichte der Bundesrepublik Deutschland (Hrsg.), Museen und ihre Besucher, Berlin: Argon.Google Scholar
- Tsapatori M. 2003. ORION Research Roadmap, Evaluation and Assessment, Object Rich Information Network (ORION), Deliverable 8. Retrieved July, 1, 2007: http://www.orionnet.org/Admin/LibraryLoc/file28.pdfGoogle Scholar
- Vergo, P. (ed.) 1989. The New Museology. London: Reaktion Books.Google Scholar
- Virtual Showcases. 2004. Evaluation Report. Retrieved July, 1, 2007: http://www.virtualshowcases.com/Technical/Deliverables.aspGoogle Scholar
- Wang, Y., L. M. Aroyo, N. Stash, and L. Rutledge, 2007. 'Interactive User modelling for personalized access to museum collections: The Rijksmuseum case study' in C. Conati, K. McCoy, and G. Paliouras (Eds) User Modeling 2007, Vol. 4511/2007, Berlin / Heidelberg: Springer-Verlag: 385--389. Google ScholarDigital Library
- White M., Mourkoussis, N., Darcy, J., Petridis, P., Liarokapis, F., Lister, P. F., Walczak, K., Wojciechowski, R., Cellary, W., Chmielewski, J., Stawniak, M., Wiza, W., Patel, M., Stevenson, J., Manley, J., Giorgini, F., Sayd, P., and F. Gaspard. 2004. ARCO---An Architecture for Digitization, Management and Presentation of Virtual Exhibitions. In Proceedings of the 22nd International Conference on Computer Graphics (CGI '2004), Hersonissos, Crete, June 2004, Los Alamitos, California: IEEE Computer Society: 622--625. Google ScholarDigital Library
- Wojciechowski, R., Walczak, K., White, M. and W. Cellary. 2004. Building Virtual and Augmented Reality Museum Exhibitions. In Spencer S. N. (ed.), Proceedings of the Web3D 2004 Symposium -the 9th International Conference on 3D Web Technology, ACM SIGGRAPH, Monterey, California (USA): 135--144. Google ScholarDigital Library
- Wolf, R. L. 1980. A naturalistic view of evaluation. Museum News, 58(1): 39--45.Google Scholar
Index Terms
- The evaluation of ARCO: a lesson in curatorial competence and intuition with new technology
Recommendations
Digital Humanism and a Quantitative Analysis of Users Behavior in Virtual Exhibitions during the Pandemic Context
AbstractThe paper highlights the importance of promoting and valorizing cultural heritage collections from cultural institutions, such as art galleries, libraries, archives, and museums, using the most recent I&CTs (Information and Communication ...
“Tangible Culture” --Designing virtual exhibitions on multi-touch devices
16th International Conference on Electronic Publishing --ELPUB 2012 --Social Shaping of Digital Publishing: Exploring the Interplay between Culture and TechnologyCultural heritage institutions such as galleries, museums and libraries increasingly use digital media to present artifacts to their audience and enable them to immerse themselves in a cultural virtual world. With the application eXhibition:editor3D ...
Virtual Museum Exhibitions
Virtual exhibitions let visitors interact with numerous artifacts cost-effectively.
Comments