skip to main content
10.1145/3379503.3403540acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article
Open Access

VibroComm: Using Commodity Gyroscopes for Vibroacoustic Data Reception

Published:05 October 2020Publication History

ABSTRACT

Inertial Measurement Units (IMUs) with gyroscopic sensors are standard in today's mobile devices. We show that these sensors can be co-opted for vibroacoustic data reception. Our approach, called VibroComm, requires direct physical contact to a transmitting (i.e., vibrating) surface. This makes interactions targeted and explicit in nature, making it well suited for contexts with many targets or requiring and intent. It also offers an orthogonal dimension of physical security to wireless technologies like Blue-tooth and NFC. Using our implementation, we achieve a transfer rate over 2000 bits/sec with less than 5% packet loss – an order of magnitude faster than prior IMU-based approaches at a quarter of the loss rate, opening new, powerful and practical use cases that could be enabled on mobile devices with a simple software update.

Skip Supplemental Material Section

Supplemental Material

a5-xiao-supplement.mp4

References

  1. Karan Ahuja, Sujeath Pareddy, Robert Xiao, Mayank Goel, and Chris Harrison. 2019. LightAnchors: Appropriating Point Lights for Spatially-Anchored Augmented Reality Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA, 189–196. DOI: https://doi.org/10.1145/3332165.3347884Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Asio Ltd. "Chirp". https://chirp.ioGoogle ScholarGoogle Scholar
  3. AT&T. Bio-acoustic Data Transfer: Key Transmission through Bone Conduction. https://www.att.com/gen/press-room?pid=22683.Google ScholarGoogle Scholar
  4. Bellamy, J. C. Digital Telephony, 3rd Edition. Chapter 6.1 Digital Modulation, pp. 279-308.Google ScholarGoogle Scholar
  5. Claude Berrou, Alain Glavieux, and Punya Thitimajshima. 1993. Near Shannon limit error-correcting coding and decoding: Turbo-codes. Communications, 1993. ICC '93 Geneva. Technical Program, Conference Record, IEEE International Conference on, Geneva. DOI: https://doi.org/10.1109/ICC.1993.397441Google ScholarGoogle ScholarCross RefCross Ref
  6. Bosch SensorTec. BHI160 datasheet. https://www.mouser.com/datasheet/2/783/BST-BHI160B-DS000-01-Datasheet-1220916.pdfGoogle ScholarGoogle Scholar
  7. Tim WC Brown, Thomas Diakos, and Johann A. Briffa. 2013. Evaluating the eavesdropping range of varying magnetic field strengths in NFC standards. In Proceedings of the 7th European Conference on Antennas and Propagation (EuCAP ’13), IEEE.Google ScholarGoogle Scholar
  8. de Castro Lopo, E. libsamplerate (software). http://www.mega-nerd.com/SRC/index.htmlGoogle ScholarGoogle Scholar
  9. de Freitas, Adrian A., Michael Nebeling, Xiang “Anthony” Chen, Junrui Yang, Akshaye Shreenithi Kirupa Karthikeyan Ranithangam, and Anind K. Dey. 2016. Snap-To-It: A User-Inspired Platform for Opportunistic Device Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 5909–5920. DOI: https://doi.org/10.1145/2858036.2858177Google ScholarGoogle Scholar
  10. Luke Deshotels. 2014. Inaudible sound as a covert channel in mobile devices. In 8th {USENIX} Workshop on Offensive Technologies ({WOOT} 14).Google ScholarGoogle Scholar
  11. Thomas P. Diakos, Johann A. Briffa, Tim WC Brown, and Stephan Wesemeyer. 2013. Eavesdropping near-field contactless payments: a quantitative analysis. The Journal of Engineering 2013, no. 10 (2013): 48-54.Google ScholarGoogle ScholarCross RefCross Ref
  12. Taesik Gong, Hyunsung Cho, Bowon Lee, and Sung-Ju Lee. 2019. Knocker: Vibroacoustic-based Object Recognition with Smartphones. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 82 (September 2019), 21 pages. DOI: https://doi.org/10.1145/3351240Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert, and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’14). Association for Computing Machinery, New York, NY, USA, 231–242. DOI: https://doi.org/10.1145/2632048.2632053Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: enhancing finger interaction on touch surfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST ’11). Association for Computing Machinery, New York, NY, USA, 627–636. DOI: https://doi.org/10.1145/2047196.2047279Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Tobias Hesselmann, Niels Henze, and Susanne Boll. 2010. FlashLight: optical communication between mobile phones and interactive tabletops. In ACM International Conference on Interactive Tabletops and Surfaces (ITS ’10). Association for Computing Machinery, New York, NY, USA, 135–138. DOI: https://doi.org/10.1145/1936652.1936679Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Inhwan Hwang, Jungchan Cho, and Songhwai Oh. 2012. Privacy-aware communication for smartphones using vibration. In Proceedings of the 18th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA ’12). IEEE. DOI: https://doi.org/10.1109/RTCSA.2012.43Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. InvenSense. MPU6500 Datasheet. https://www.invensense.com/wp-content/uploads/2015/02/MPU-6500-Datasheet2.pdfGoogle ScholarGoogle Scholar
  18. InvenSense, Inc. MPU-6500 Register Map And Descriptions Revision 2.1. September 16, 2013. https://www.invensense.com/wp-content/uploads/2015/02/MPU-6500-Register-Map2.pdfGoogle ScholarGoogle Scholar
  19. Ville Kaajakari. 2009. Practical mems: Design of microsystems, accelerometers, gyroscopes, RF MEMS, optical MEMS, and microfluidic systems. Las Vegas, NV: Small Gear Publishing .Google ScholarGoogle Scholar
  20. Younghyun Kim, Woo Suk Lee, Vijay Raghunathan, Niraj K. Jha, and Anand Raghunathan. 2015. Vibration-based secure side channel for medical devices. In Proceedings of the 52nd Annual Design Automation Conference (DAC ’15). Association for Computing Machinery, New York, NY, USA, Article 32, 1–6. DOI: https://doi.org/10.1145/2744769.2744928Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). Association for Computing Machinery, New York, NY, USA, 321–333. DOI: https://doi.org/10.1145/2984511.2984582Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Dong Ma, Yuezhong Wu, Ming Ding, Mahbub Hassan, and Wen Hu. 2020. Skin-MIMO: Vibration-based MIMO Communication over Human Skin. arXiv preprint arXiv:2001.11574.Google ScholarGoogle Scholar
  23. Denys J.C. Matthies, Marian Haescher, Suranga Nanayakkara, and Gerald Bieber. 2018. Step Detection for Rollator Users with Smartwatches. In Proceedings of the Symposium on Spatial User Interaction (SUI ’18). Association for Computing Machinery, New York, NY, USA, 163–167. DOI: https://doi.org/10.1145/3267782.3267784Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Rajalakshmi Nandakumar, Krishna Kant Chintalapudi, Venkat Padmanabhan, and Ramarathnam Venkatesan. 2013. Dhwani: secure peer-to-peer acoustic NFC. In Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM (SIGCOMM ’13). Association for Computing Machinery, New York, NY, USA, 63–74. DOI: https://doi.org/10.1145/2486001.2486037Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Saki Nishihara, Naoki Shinmen, Tadashi Ebihara, Koichi Mizutani, and Naoto Wakatsuki. 2017. Design of secure near-field communication for smartphones using sound and vibration. In Proceedings of the 6th Global Conference on Consumer Electronics (GCCE ’17). IEEE. DOI: https://doi.org/10.1109/GCCE.2017.8229356Google ScholarGoogle ScholarCross RefCross Ref
  26. Aditya Shekhar Nittala, Xing-Dong Yang, Scott Bateman, Ehud Sharlin, and Saul Greenberg. 2015. PhoneEar: interactions for mobile devices that hear high-frequency sound-encoded data. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’15). Association for Computing Machinery, New York, NY, USA, 174–179. DOI: https://doi.org/10.1145/2774225.2775082Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nirupam Roy, and Romit Roy Choudhury. 2016. Ripple II: faster communication through physical vibration. In Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation (NSDI'16). USENIX Association, Berkeley, CA, USA, 671-684.Google ScholarGoogle Scholar
  28. Nirupam Roy, Mahanth Gowda, and Romit Roy Choudhury. 2015. Ripple: communicating through physical vibration. In Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation (NSDI'15). USENIX Association, Berkeley, CA, USA, 265-278.Google ScholarGoogle Scholar
  29. Joe Seeger, Martin Lim, and Steve Nasiri. Development of High-Performance, High-Volume consumer MEMS Gyroscopes (whitepaper). InvenSense, Inc. Sunnyvale, CA, USA.Google ScholarGoogle Scholar
  30. STMicroelectronics. LSM6DSL datasheet. http://www.st.com/content/ccc/resource/technical/docment/datasheet/ee/23/a0/dc/1d/68/45/52/DM00237456.pdf/files/DM00237456.pdf/jcr:content/translations/en.DM00237456.pdfGoogle ScholarGoogle Scholar
  31. Robert Xiao, Scott Hudson, and Chris Harrison. 2016. CapCam: Enabling Rapid, Ad-Hoc, Position-Tracked Interactions Between Devices. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS ’16). Association for Computing Machinery, New York, NY, USA, 169–178. DOI: https://doi.org/10.1145/2992154.2992182Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Chouchang Jack Yang and Alanson P. Sample. 2017. EM-Comm: Touch-based Communication via Modulated Electromagnetic Emissions. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 118 (September 2017), 24 pages. DOI: https://doi.org/10.1145/3130984Google ScholarGoogle Scholar
  33. Yang Zhang, Gierad Laput, and Chris Harrison. 2018. Vibrosight: Long-Range Vibrometry for Smart Environment Sensing. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA. DOI: https://doi.org/10.1145/3242587.3242608Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Lin Zhong, Dania El-Daye, Brett Kaufman, Nick Tobaoda, Tamer Mohamed, and Michael Liebschner. 2007. OsteoConduct: wireless body-area communication based on bone conduction. In Proceedings of the ICST 2nd international conference on Body area networks (BodyNets ’07). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, Article 9, 1–8.Google ScholarGoogle ScholarCross RefCross Ref

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services
    October 2020
    418 pages
    ISBN:9781450375160
    DOI:10.1145/3379503

    Copyright © 2020 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 5 October 2020

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate202of906submissions,22%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format