Abstract
This work introduces and discusses the implementation details of a novel concept for a home entertainment system together with an affordable controlling interface that uses point & click interactions in order to create, mix and manipulate media screens within the same projection-based display. Scenarios for single and multiple viewers are discussed with users being able to create, reposition, resize, and control their own-defined media screens. The standard and familiar WIMP interaction techniques are transferred from PCs to home entertainment using a motion-sensing remote controller. An optional system feature is described for the automatic configuration of such media screens by analyzing the home environment using computer vision techniques. Observations from initial user studies are reported with regards to the perceived usefulness and acceptability of the proposed system. The main benefit introduced by this work is that of a large entertainment display that becomes shared and personalized while it is being adapted and fit into the home environment.
Similar content being viewed by others
References
Ahlborn BA, Thompson D, Kreylos O, Hamann B, Staadt OG (2005) A practical system for laser pointer interaction on large displays. In: Proceedings of the ACM symposium on Virtual reality software and technology, VRST 2005 (Monterey, CA, USA), 106–109. ACM, New York, USA. doi:10.1145/1101616.1101637
Bernhaupt R, Obrist M, Weiss A, Beck E, Tscheligi M (2007) Trends in the Living Room and Beyond. In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 146–155, Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_16
Bernhaupt R, Obrist M, Weiss A, Beck E, Tscheligi M (2008) Trends in the living room and beyond: results from ethnographic studies using creative and playful probing, Computers in Entertainment 6(1): 1–23. ACM, New York, USA. doi:10.1145/1350843.1350848
Bi X, Shi Y, Chen X, Xiang P (2005) uPen: laser-based, personalized, multi-user interaction on large displays. In: Proceedings of the 13th annual ACM international conference on Multimedia, MULTIMEDIA 2005 (Hilton, Singapore), 1049–1050. ACM, New York, USA. doi:10.1145/1101149.1101370
Bolt RA (1980) Put-that-there: Voice and gesture at the graphics interface. In: Proceedings of the 7th annual conference on Computer graphics and interactive techniques, SIGGRAPH 1980 (Seattle, Washington, United States), 262–270. ACM, New York, USA. doi:10.1145/800250.807503
Cao X, Balakrishnan R (2004) VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. In: Proceedings of the 16th annual ACM symposium on User interface software and technology, UIST 2004 (Vancouver, Canada), 173–182. ACM, New York, USA. doi:10.1145/964696.964716
Cotting D, Gross M (2006) Interactive environment-aware display bubbles. In: Proceedings of the 19th annual ACM symposium on User interface software and technology, UIST 2006 (Montreux, Switzerland), 245–254. ACM, New York, USA. doi:10.1145/1166253.1166291
Crow FC (1984) Summed-area tables for texture mapping. In: Proceedings of the 11th annual conference on Computer graphics and interactive techniques, SIGGRAPH ‘84, 207–212, ACM, New York, USA. doi:10.1145/800031.808600
Cui Y, Chipchase J, Jung Y (2007) Personal TV: a qualitative study of mobile TV users. In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 195–204, Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_21
Eronen L (2003) User Centered Research for Interactive Television. In: Proceedings of the 1st Conference on Interactive Television, EuroITV 2003 (April 2–4, Brighton, UK), 5–12
Forlines C, Balakrishnan R, Beardsley P, van Baar J, Raskar R (2005) Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23–26, 2005). UIST ‘05. ACM, New York, NY, 73–82. doi:10.1145/1095034.1095046
Freeman WT, Weissman CD (1995) Television control by hand gestures. In: IEEE International Workkshop on Automatic Face and Gesture Recognition
Khan A, Fitzmaurice G, Almeida D, Burtnyk N, Kurtenbach G (2004) A remote control interface for large displays. In: Proceedings of the 17th annual ACM symposium on User interface software and technology, UIST 2004, 127–136. ACM, New York, USA. doi:10.1145/1029632.1029655
Lee JC (2008) Hacking the Nintendo Wii remote. IEEE Pervasive Computing 7(3):39–45
Lee JC, Hudson SE, Summet JW, Dietz PH (2005) Moveable interactive projected displays using projector based tracking. In Proceedings of the 18th Annual ACM Symposium on User interface Software and Technology (Seattle, WA, USA, October 23–26, 2005). UIST ‘05. ACM, New York, NY, 63–72. doi:10.1145/1095034.1095045
Levin A, Fergus R, Durand F, Freeman WT (2007) Image and depth from a conventional camera with a coded aperture. ACM Trans Graph 26(3):70. doi:10.1145/1276377.1276464
Malik S, Ranjan A, Balakrishnan R (2005) Interacting with large displays from a distance with vision-tracked multi-finger gestural input. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST 2005 (Seattle, WA, USA), 43–52. ACM, New York, USA. doi:10.1145/1095034.1095042
McArthur V, Castellucci SJ, MacKenzie IS (2009) An empirical comparison of “wiimote” gun attachments for pointing tasks. In: Proceedings of the 1st ACM SIGCHI Symposium on Engineering interactive Computing Systems (Pittsburgh, PA, USA, July 15–17, 2009). EICS ‘09. ACM, New York, NY, 203–208. doi:10.1145/1570433.1570471
Myers BA, Bhatnagar R, Nichols J, Peck CH, Kong D, Miller R, Long AC (2002) Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings of the SIGCHI conference on Human factors in computing systems, CHI 2002 (Minneapolis, Minnesota, USA), 33–40. ACM, New York, USA. doi:10.1145/503376.503383
Natapov D, Castellucci SJ, MacKenzie IS (2009) ISO 9241–9 evaluation of video game controllers. In: Proceedings of Graphics interface 2009 (Kelowna, British Columbia, Canada, May 25–27, 2009). ACM International Conference Proceeding Series, vol. 324. Canadian Information Processing Society, Toronto, Ont., Canada, 223–230
Oksman V, Noppari E, Tammela A, Makinen M, Ollikainen V (2007) Mobile TV in everyday life contexts: Individual Entertainment or Shared Experiences? In: Proceedings of the 5th Conference on Interactive Television, EuroITV 2007, 215–225. Springer Berlin/Heidelberg. doi:10.1007/978-3-540-72559-6_23
Pinhanez C (2001) Using a steerable projector and a camera to transform surfaces into interactive displays. In: CHI ‘01 extended abstracts on Human factors in computing systems (Seattle, Washington), 369–370. ACMPress, New York, USA. doi:10.1145/634067.634285
Pratt WK (2001) Digital image processing, 3rd edn. Wiley, New York
Rehm M, Bee N, Andre E (2008) Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions. In: Proceedings of the 22nd British HCI Group Annual Conference on HCI 2008 (Liverpool, United Kingdom), 13–22. British Computer Society
Schlomer T, Poppinga B, Henze N, Boll S (2008) Gesture recognition with a Wii controller. In: Proceedings of the 2nd international conference on Tangible and embedded interaction, TEI 2008, 11-14. ACM Press, New York, USA. doi:10.1145/1347390.1347395
Shoemaker G, Tang A, Booth KS (2007) Shadow reaching: a new perspective on interaction for large displays. In: Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07–10, 2007). UIST ‘07. ACM, New York, NY, 53–56. doi:10.1145/1294211.1294221
Vatavu RD, Pentiuc SG (2008) Interactive coffee tables: Interfacing TV within an Intuitive, Fun and Shared Experience. In: Proceedings of the 6th European Interactive TV Conference, EuroITV 2008 (Salzburg, Austria, July 2008), LNCS 5066, pp. 183–187. Springer Berlin/Heidelberg. doi:10.1007/978-3-540-69478-6_24
Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST 2005 (Seattle, WA, USA), 33–42. ACM Press, New York, USA. doi:10.1145/1095034.1095041
Wilson A, Shafer S (2003) XWand: UI for intelligent spaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05–10, 2003). CHI ‘03. ACM, New York, NY, 545–552. doi:10.1145/642611.642706
Yang R, Gotz D, Hensley J, Towles H, Brown MS (2001) PixelFlex: a reconfigurable multi-projector display system. In: Proceedings of the conference on Visualization, VIS 2001 (San Diego, California), 167–174. IEEE Computer Society
Acknowledgments
This paper was supported by the project Progress and development through post-doctoral research and innovation in engineering and applied sciences– PRiDE - Contract no. POSDRU/89/1.5/S/57083, project co-funded from European Social Fund through Sectorial Operational Program Human Resources 2007-2013.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Vatavu, RD. Point & click mediated interactions for large home entertainment displays. Multimed Tools Appl 59, 113–128 (2012). https://doi.org/10.1007/s11042-010-0698-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0698-5