Speech + Posture: A Method for Interaction with Multiple and Large Interactive Displays

Abstract: Multiple or Large displays play an important role in collaboration scenarios, because they can provide more display space. However, they are challenging concerning effective manipulating and managing the display contents, particularly when the displays are beyond the users' reachable region and operational limit region. In this work, we explore a particular interactive input combination for multiple or large displays, the Speech + Posture interactive input mode. We integrate postures to point to target display areas and phonetic keywords to designate display contents. This method makes interactive input commands concise and explicit, and it can support interaction with multiple or large interactive displays effectively.

Keywords: Speech, Posture, Input Modalities, Multiple Displays, Multimodal Interaction

DOI: 10.54941/ahfe100950

Cite this paper:

​