skip to main content
10.1145/3568444.3570597acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
poster

HeatGoggles: Enabling Ubiquitous Touch Input through Head-Mounted Devices using Thermal Imaging

Published:29 December 2022Publication History

ABSTRACT

Displays are a ubiquitous part of our everyday life. Digital, as well as paper-based displays, are used on various occasions to present us with different information. While users cannot interact with many of these displays yet, they could benefit from making them interactive. Research shows that thermal cameras can be exploited to make surfaces interactive by sensing touchpoints based on the heat signature and residue. However, most of the research done uses a stationary setup. This work proposes HeatGoggles, a wearable gadget detecting touch input on arbitrary surfaces using thermal imaging. We report on its design, prototypical implementation, and first evaluation. We show that it can be used on non-touch-enabled displays as well as other traditional information displays.

References

  1. Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is anyone looking? mitigating shoulder surfing on public displays through awareness and protection. In Proceedings of the international symposium on pervasive displays. 1–6.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. JF Canny. 1987. A computational approach to edge detection, Readings in computer vision: issues, problems, principles, and paradigms. IEEE Trans. Pattern (1987).Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Christine Dierk, Molly Jane Pearce Nicholas, and Eric Paulos. 2018. AlterWear: Battery-Free Wearable Displays for Opportunistic Interactions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173794Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Richard O Duda and Peter E Hart. 1971. Use of the Hough transformation to detect lines and curves in pictures. Technical Report. Sri International Menlo Park Ca Artificial Intelligence Center.Google ScholarGoogle Scholar
  5. Chris Harris, Mike Stephens, 1988. A combined corner and edge detector. In Alvey vision conference, Vol. 15. Citeseer, 10–5244.Google ScholarGoogle Scholar
  6. Uta Hinrichs and Sheelagh Carpendale. 2011. Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3023–3032.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Eric Larson, Gabe Cohn, Sidhant Gupta, Xiaofeng Ren, Beverly Harrison, Dieter Fox, and Shwetak Patel. 2011. HeatWave: Thermal Imaging for Surface User Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 2565–2574. https://doi.org/10.1145/1978942.1979317Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Markus Lochtefeld, Walther Jensen, and Çaglar Genç. 2021. Prototyping of Transparent and Flexible Electrochromic Displays. In 20th International Conference on Mobile and Ubiquitous Multimedia (Leuven, Belgium) (MUM 2021). Association for Computing Machinery, New York, NY, USA, 179–181. https://doi.org/10.1145/3490632.3497750Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. 2010. Requirements and Design Space for Interactive Public Displays. In Proceedings of the 18th ACM International Conference on Multimedia (Firenze, Italy) (MM ’10). ACM, New York, NY, USA, 1285–1294. https://doi.org/10.1145/1873951.1874203Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Sarah Prange, Ahmed Shams, Robin Piening, Yomna Abdelrahman, and Florian Alt. 2021. PriView– Exploring Visualisations to Support Users’ Privacy Awareness. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445067Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Alireza Sahami Shirazi, Yomna Abdelrahman, Niels Henze, Stefan Schneegass, Mohammadreza Khalilbeigi, and Albrecht Schmidt. 2014. Exploiting Thermal Reflection for Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3483–3492. https://doi.org/10.1145/2556288.2557208Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: revealing mid-air gestures on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 841–850.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. HeatGoggles: Enabling Ubiquitous Touch Input through Head-Mounted Devices using Thermal Imaging

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia
      November 2022
      315 pages
      ISBN:9781450398206
      DOI:10.1145/3568444

      Copyright © 2022 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 December 2022

      Check for updates

      Qualifiers

      • poster
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate190of465submissions,41%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format