Skip to main content
SpringerLink
Log in

Grasping, communicating, understanding: Connecting reality and virtuality

  • Published:
AI & SOCIETY Aims and scope Submit manuscript

Abstract

Several simulation projects in the area of production and logistics indicated that, although we have sophisticated input and output devices for computer supported modelling, physical models still play an important role for cognition and communication. We therefore introduce the concept of a Graspable User Interface that aims at combining two model worlds, the one inside the computer and a corresponding physical one in the outside world. Sensored user hands will couple physical objects of the real world with virtual objects, thus allowing fairly unrestricted manipulation and expression. In this way modelling with real physical objects can create an abstract virtual model. Some applications of this concept are presented. A further perspective for a new action oriented communication and learning with artifacts is envisioned.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bion, W. R. (1962). Learning from Experience. Heinemann, London.

    Google Scholar 

  • Böhle, F. (1995). Qualifizierung für erfahrungsgeleitetes Arbeiten — neue Anforderungen an die berufliche Bildung. In: Dybowski, G./Pütz, H./Rauner, F.(Hrsg.): Berufsbil-dung und Organisationsentwicklung. Perspektiven, Modelle, Grundlagen. Schrif-tenreihe Berufliche Bildung — Wandel von Arbeit und Technik. 122–133, Donat, Bremen.

    Google Scholar 

  • Böhle, F. and Milkau, B. (1988). Vom Handrad zum Bildschirm. Campus, München.

    Google Scholar 

  • Brauer, V. (1994). Feature-basierte Erkennung dynamischer Gesten mit einem Datenhand-schuh. Diplomarbeit, Universität Bremen.

    Google Scholar 

  • Bruns, F. W. (1990). Künstliche Intelligenz in der Technik. Carl Hanser, München.

    Google Scholar 

  • Bruns, F. W. (1993). Zur Rückgewinnung von Sinnlichkeit — Eine neue Form des Um-gangs mit Rechnern. Technische Rundschau Heft 29/30, S. 14–18.

    Google Scholar 

  • Bruns, F. W. (1996). Sinnlichkeit in der Technikgestaltung und —handhabung — Ein konstruktiver Ansatz. In C. Schachtner (Hrsg): Technik und Subjektiviät. Frankfurt/M: Suhrkamp (in print)

    Google Scholar 

  • Bruns, F. W., Busekros, L., and Heimbucher, A. (1995). Joint Project: Simulating Work and Technology — Development, Implementation and Application of Computer-Based Systems for Planing, Simulation and Animation in Manufacturing. In F. Rauner (Ed.): Qualification for Computer-Integrated Manufacturing. 188–193, Springer, Berlin.

    Google Scholar 

  • Bruns, F. W., Heimbucher, A., and Müller, D. (1993). Ansätze einer erfahrungs-orien-tierten Gestal-tung von Rechnersystemen für die Produktion. artec-Paper 21, Bremen.

  • Fitzmaurice, G. W., Ishii, H., and Buxton, W. (1995). Bricks: Laying the Foundations for Graspable User Interfaces. CHI ’95 Mosaic of Creativity, 442–449.

  • Isdale, J. (1993). What is Virtual Reality — a home-brew Introduction. Isdale Engineering.

  • Iwasaki, Y., Vescovi, M., and Fikes, R. (1994). A Causal Functional Representation Language with Behaviour-Based Semantics. Knowledge Systems Laboratory, Stanford University, KSL-94-10.

  • Kang, S. B. and Ikeuchi, K. (1994). Grasp Recognition and Manipulative Motion Characteri-zation from Human Hand Motion Sequences. Proc. of IEEE Int. Conf. on Robo-tics and Automation, San Diego, Cal., 2, 1759–1764

    Google Scholar 

  • Kuipers, B. (1994). Qualitative Reasoning. Modelling and Simulation with Incomplete Knowledge. The MIT Press, Cambridge, Massachusetts.

    Google Scholar 

  • MacKenzie, C. and Iberall, T. (1994). The Grasping Hand. Elsevier, Amsterdam.

    Google Scholar 

  • Müller, D. (1993). Application Framework für die Entwicklung interaktiver Anwendungen mit multisensorischen Benutzungsschnittstellen. artec-Paper 22, Bremen.

  • Murakami, T. Nakajima, N. (1994). Direct and Intuitive Input Device for 3-D Shape Deformation. Human Factors in Computer Systems, CHI ’94, Boston, 465-470.

  • Piaget, J. (1959). La formation du symbole chez l’enfant. Imitation, jeu et rêve — Image et representation. Neuchâtel.

  • Popitz, H. (1989). Epochen der Technikgeschichte — Technisches Handeln mit der Hand. Tübingen, 40—73.

  • Resnick, M. (1993). Behaviour Construction Kits. Communications of the ACM. 36 (7), 64–71.

    Article  Google Scholar 

  • Skelton, R. M. (1995). Bion’s Use of Modern Logic. Int. J. Psycho-Anal. 76, 389–397.

    Google Scholar 

  • Wellner, P., Mackay, W., and Gold, R. (1993). Computer-Augmented Environments: Back to the Real World. Communications of the ACM, 36, 7, 24ff.

Download references

Author information

Authors and Affiliations

  1. Forschungszentrum Arbeit und Technik (artec), Universität Bremen, Bremen, Germany

    Willi Bruns

Authors
  1. Willi Bruns
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bruns, W. Grasping, communicating, understanding: Connecting reality and virtuality. AI & Soc 10, 6–14 (1996). https://doi.org/10.1007/BF02716750

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02716750

Keywords

Search

Navigation