Three Types of Multimedia Interactions — and Beyond

Abstract

To understand the impact of these interactive multimedia it is first necessary to get an overview of their structure and characteristics. Interactivity is an invitation to engage in interactions, but these interactions will take place in some medium. In the following we shall present three such media based on their anchoring in the psychological constitution of the individual. They mediate interactions based on bodily actions, images and symbols. As the media may contain different sorts of units and their arrangement, this will lead us to some considerations concerning syntactic properties. Four types of syntax will be sufficient to catch the significant differences in the ordering of the content of multimedia. This also leads to a division or dichotomy in the medium for images. In return we will treat the medium for actions (interactions) as a special dimension. Interactivity as a feature of our environment means a certain measure of freedom on behalf of the user, and this might create problems in relation to the intended paths through the multimedia presentation. We shall comment on the question of narrative coherence and embark upon a further analysis of the medium for images and symbols (language) respectively, showing that they really are two autonomous substrata even if the symbolic medium may dominate. In connection with the question of syntax it will be demonstrated that interactions come in two different forms. By considering modern computer-based artworks it is possible to add a third form. After this we have three media, four types of syntax and three forms of interaction.

The term “interactive multimedia” (IMM) is currently enjoying enormous popularity, not only in the computing and educational communities, but also among the general public. Despite the hyperbole in the marketplace, there seems to be little doubt that IMM technology will combine with the burgeoning electronic networks (the so-called information superhighway, or Infobahn) to deeply affect the way that humans learn, work, communicate and even relax into the next century.

Rob Philips and Nick Jenkins in Philips (1997, p. 7)