ABSTRACT
Displays are a ubiquitous part of our everyday life. Digital, as well as paper-based displays, are used on various occasions to present us with different information. While users cannot interact with many of these displays yet, they could benefit from making them interactive. Research shows that thermal cameras can be exploited to make surfaces interactive by sensing touchpoints based on the heat signature and residue. However, most of the research done uses a stationary setup. This work proposes HeatGoggles, a wearable gadget detecting touch input on arbitrary surfaces using thermal imaging. We report on its design, prototypical implementation, and first evaluation. We show that it can be used on non-touch-enabled displays as well as other traditional information displays.
- Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is anyone looking? mitigating shoulder surfing on public displays through awareness and protection. In Proceedings of the international symposium on pervasive displays. 1–6.Google ScholarDigital Library
- JF Canny. 1987. A computational approach to edge detection, Readings in computer vision: issues, problems, principles, and paradigms. IEEE Trans. Pattern (1987).Google ScholarDigital Library
- Christine Dierk, Molly Jane Pearce Nicholas, and Eric Paulos. 2018. AlterWear: Battery-Free Wearable Displays for Opportunistic Interactions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173794Google ScholarDigital Library
- Richard O Duda and Peter E Hart. 1971. Use of the Hough transformation to detect lines and curves in pictures. Technical Report. Sri International Menlo Park Ca Artificial Intelligence Center.Google Scholar
- Chris Harris, Mike Stephens, 1988. A combined corner and edge detector. In Alvey vision conference, Vol. 15. Citeseer, 10–5244.Google Scholar
- Uta Hinrichs and Sheelagh Carpendale. 2011. Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3023–3032.Google ScholarDigital Library
- Eric Larson, Gabe Cohn, Sidhant Gupta, Xiaofeng Ren, Beverly Harrison, Dieter Fox, and Shwetak Patel. 2011. HeatWave: Thermal Imaging for Surface User Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 2565–2574. https://doi.org/10.1145/1978942.1979317Google ScholarDigital Library
- Markus Lochtefeld, Walther Jensen, and Çaglar Genç. 2021. Prototyping of Transparent and Flexible Electrochromic Displays. In 20th International Conference on Mobile and Ubiquitous Multimedia (Leuven, Belgium) (MUM 2021). Association for Computing Machinery, New York, NY, USA, 179–181. https://doi.org/10.1145/3490632.3497750Google ScholarDigital Library
- Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the 18th ACM International Conference on Multimedia (Firenze, Italy) (MM ’10). ACM, New York, NY, USA, 1285–1294. https://doi.org/10.1145/1873951.1874203Google ScholarDigital Library
- Sarah Prange, Ahmed Shams, Robin Piening, Yomna Abdelrahman, and Florian Alt. 2021. PriView– Exploring Visualisations to Support Users’ Privacy Awareness. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445067Google ScholarDigital Library
- Alireza Sahami Shirazi, Yomna Abdelrahman, Niels Henze, Stefan Schneegass, Mohammadreza Khalilbeigi, and Albrecht Schmidt. 2014. Exploiting Thermal Reflection for Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3483–3492. https://doi.org/10.1145/2556288.2557208Google ScholarDigital Library
- Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 841–850.Google ScholarDigital Library
Index Terms
- HeatGoggles: Enabling Ubiquitous Touch Input through Head-Mounted Devices using Thermal Imaging
Recommendations
Expanding touch input vocabulary by using consecutive distant taps
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn recent years, touch screens have emerged and matured as the main input interface for mobile and tablet computers calling for extended touch input possibilities. In this paper, we explore the use of consecutive distant taps to expand the touch screen ...
Touch-sensing input devices
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing SystemsWe can touch things, and our senses tell us when our hands are touching something. But most computer input devices cannot detect when the user touches or releases the device or some portion of the device. Thus, adding touch sensors to input devices offers ...
B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe present B2B-Swipe, a single-finger swipe gesture for a rectangular smartwatch that starts at a bezel and ends at a bezel to enrich input vocabulary. There are 16 possible B2B-Swipes because a rectangular smartwatch has four bezels. Moreover, B2B-...
Comments