ABSTRACT
Inertial Measurement Units (IMUs) with gyroscopic sensors are standard in today's mobile devices. We show that these sensors can be co-opted for vibroacoustic data reception. Our approach, called VibroComm, requires direct physical contact to a transmitting (i.e., vibrating) surface. This makes interactions targeted and explicit in nature, making it well suited for contexts with many targets or requiring and intent. It also offers an orthogonal dimension of physical security to wireless technologies like Blue-tooth and NFC. Using our implementation, we achieve a transfer rate over 2000 bits/sec with less than 5% packet loss – an order of magnitude faster than prior IMU-based approaches at a quarter of the loss rate, opening new, powerful and practical use cases that could be enabled on mobile devices with a simple software update.
Supplemental Material
- Karan Ahuja, Sujeath Pareddy, Robert Xiao, Mayank Goel, and Chris Harrison. 2019. LightAnchors: Appropriating Point Lights for Spatially-Anchored Augmented Reality Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19). Association for Computing Machinery, New York, NY, USA, 189–196. DOI: https://doi.org/10.1145/3332165.3347884Google ScholarDigital Library
- Asio Ltd. "Chirp". https://chirp.ioGoogle Scholar
- AT&T. Bio-acoustic Data Transfer: Key Transmission through Bone Conduction. https://www.att.com/gen/press-room?pid=22683.Google Scholar
- Bellamy, J. C. Digital Telephony, 3rd Edition. Chapter 6.1 Digital Modulation, pp. 279-308.Google Scholar
- Claude Berrou, Alain Glavieux, and Punya Thitimajshima. 1993. Near Shannon limit error-correcting coding and decoding: Turbo-codes. Communications, 1993. ICC '93 Geneva. Technical Program, Conference Record, IEEE International Conference on, Geneva. DOI: https://doi.org/10.1109/ICC.1993.397441Google ScholarCross Ref
- Bosch SensorTec. BHI160 datasheet. https://www.mouser.com/datasheet/2/783/BST-BHI160B-DS000-01-Datasheet-1220916.pdfGoogle Scholar
- Tim WC Brown, Thomas Diakos, and Johann A. Briffa. 2013. Evaluating the eavesdropping range of varying magnetic field strengths in NFC standards. In Proceedings of the 7th European Conference on Antennas and Propagation (EuCAP ’13), IEEE.Google Scholar
- de Castro Lopo, E. libsamplerate (software). http://www.mega-nerd.com/SRC/index.htmlGoogle Scholar
- de Freitas, Adrian A., Michael Nebeling, Xiang “Anthony” Chen, Junrui Yang, Akshaye Shreenithi Kirupa Karthikeyan Ranithangam, and Anind K. Dey. 2016. Snap-To-It: A User-Inspired Platform for Opportunistic Device Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 5909–5920. DOI: https://doi.org/10.1145/2858036.2858177Google Scholar
- Luke Deshotels. 2014. Inaudible sound as a covert channel in mobile devices. In 8th {USENIX} Workshop on Offensive Technologies ({WOOT} 14).Google Scholar
- Thomas P. Diakos, Johann A. Briffa, Tim WC Brown, and Stephan Wesemeyer. 2013. Eavesdropping near-field contactless payments: a quantitative analysis. The Journal of Engineering 2013, no. 10 (2013): 48-54.Google ScholarCross Ref
- Taesik Gong, Hyunsung Cho, Bowon Lee, and Sung-Ju Lee. 2019. Knocker: Vibroacoustic-based Object Recognition with Smartphones. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 82 (September 2019), 21 pages. DOI: https://doi.org/10.1145/3351240Google ScholarDigital Library
- Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert, and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’14). Association for Computing Machinery, New York, NY, USA, 231–242. DOI: https://doi.org/10.1145/2632048.2632053Google ScholarDigital Library
- Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: enhancing finger interaction on touch surfaces. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST ’11). Association for Computing Machinery, New York, NY, USA, 627–636. DOI: https://doi.org/10.1145/2047196.2047279Google ScholarDigital Library
- Tobias Hesselmann, Niels Henze, and Susanne Boll. 2010. FlashLight: optical communication between mobile phones and interactive tabletops. In ACM International Conference on Interactive Tabletops and Surfaces (ITS ’10). Association for Computing Machinery, New York, NY, USA, 135–138. DOI: https://doi.org/10.1145/1936652.1936679Google ScholarDigital Library
- Inhwan Hwang, Jungchan Cho, and Songhwai Oh. 2012. Privacy-aware communication for smartphones using vibration. In Proceedings of the 18th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA ’12). IEEE. DOI: https://doi.org/10.1109/RTCSA.2012.43Google ScholarDigital Library
- InvenSense. MPU6500 Datasheet. https://www.invensense.com/wp-content/uploads/2015/02/MPU-6500-Datasheet2.pdfGoogle Scholar
- InvenSense, Inc. MPU-6500 Register Map And Descriptions Revision 2.1. September 16, 2013. https://www.invensense.com/wp-content/uploads/2015/02/MPU-6500-Register-Map2.pdfGoogle Scholar
- Ville Kaajakari. 2009. Practical mems: Design of microsystems, accelerometers, gyroscopes, RF MEMS, optical MEMS, and microfluidic systems. Las Vegas, NV: Small Gear Publishing .Google Scholar
- Younghyun Kim, Woo Suk Lee, Vijay Raghunathan, Niraj K. Jha, and Anand Raghunathan. 2015. Vibration-based secure side channel for medical devices. In Proceedings of the 52nd Annual Design Automation Conference (DAC ’15). Association for Computing Machinery, New York, NY, USA, Article 32, 1–6. DOI: https://doi.org/10.1145/2744769.2744928Google ScholarDigital Library
- Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). Association for Computing Machinery, New York, NY, USA, 321–333. DOI: https://doi.org/10.1145/2984511.2984582Google ScholarDigital Library
- Dong Ma, Yuezhong Wu, Ming Ding, Mahbub Hassan, and Wen Hu. 2020. Skin-MIMO: Vibration-based MIMO Communication over Human Skin. arXiv preprint arXiv:2001.11574.Google Scholar
- Denys J.C. Matthies, Marian Haescher, Suranga Nanayakkara, and Gerald Bieber. 2018. Step Detection for Rollator Users with Smartwatches. In Proceedings of the Symposium on Spatial User Interaction (SUI ’18). Association for Computing Machinery, New York, NY, USA, 163–167. DOI: https://doi.org/10.1145/3267782.3267784Google ScholarDigital Library
- Rajalakshmi Nandakumar, Krishna Kant Chintalapudi, Venkat Padmanabhan, and Ramarathnam Venkatesan. 2013. Dhwani: secure peer-to-peer acoustic NFC. In Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM (SIGCOMM ’13). Association for Computing Machinery, New York, NY, USA, 63–74. DOI: https://doi.org/10.1145/2486001.2486037Google ScholarDigital Library
- Saki Nishihara, Naoki Shinmen, Tadashi Ebihara, Koichi Mizutani, and Naoto Wakatsuki. 2017. Design of secure near-field communication for smartphones using sound and vibration. In Proceedings of the 6th Global Conference on Consumer Electronics (GCCE ’17). IEEE. DOI: https://doi.org/10.1109/GCCE.2017.8229356Google ScholarCross Ref
- Aditya Shekhar Nittala, Xing-Dong Yang, Scott Bateman, Ehud Sharlin, and Saul Greenberg. 2015. PhoneEar: interactions for mobile devices that hear high-frequency sound-encoded data. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’15). Association for Computing Machinery, New York, NY, USA, 174–179. DOI: https://doi.org/10.1145/2774225.2775082Google ScholarDigital Library
- Nirupam Roy, and Romit Roy Choudhury. 2016. Ripple II: faster communication through physical vibration. In Proceedings of the 13th Usenix Conference on Networked Systems Design and Implementation (NSDI'16). USENIX Association, Berkeley, CA, USA, 671-684.Google Scholar
- Nirupam Roy, Mahanth Gowda, and Romit Roy Choudhury. 2015. Ripple: communicating through physical vibration. In Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation (NSDI'15). USENIX Association, Berkeley, CA, USA, 265-278.Google Scholar
- Joe Seeger, Martin Lim, and Steve Nasiri. Development of High-Performance, High-Volume consumer MEMS Gyroscopes (whitepaper). InvenSense, Inc. Sunnyvale, CA, USA.Google Scholar
- STMicroelectronics. LSM6DSL datasheet. http://www.st.com/content/ccc/resource/technical/docment/datasheet/ee/23/a0/dc/1d/68/45/52/DM00237456.pdf/files/DM00237456.pdf/jcr:content/translations/en.DM00237456.pdfGoogle Scholar
- Robert Xiao, Scott Hudson, and Chris Harrison. 2016. CapCam: Enabling Rapid, Ad-Hoc, Position-Tracked Interactions Between Devices. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS ’16). Association for Computing Machinery, New York, NY, USA, 169–178. DOI: https://doi.org/10.1145/2992154.2992182Google ScholarDigital Library
- Chouchang Jack Yang and Alanson P. Sample. 2017. EM-Comm: Touch-based Communication via Modulated Electromagnetic Emissions. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 118 (September 2017), 24 pages. DOI: https://doi.org/10.1145/3130984Google Scholar
- Yang Zhang, Gierad Laput, and Chris Harrison. 2018. Vibrosight: Long-Range Vibrometry for Smart Environment Sensing. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, New York, NY, USA. DOI: https://doi.org/10.1145/3242587.3242608Google ScholarDigital Library
- Lin Zhong, Dania El-Daye, Brett Kaufman, Nick Tobaoda, Tamer Mohamed, and Michael Liebschner. 2007. OsteoConduct: wireless body-area communication based on bone conduction. In Proceedings of the ICST 2nd international conference on Body area networks (BodyNets ’07). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, Article 9, 1–8.Google ScholarCross Ref
Recommendations
A method for tracking on-body sensor positions utilizing prior knowledge
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationIn this research, we aim at estimating the positions and directions of on-body mobile devices such as smartphones with accelerometers and gyroscopes. We propose a method utilizing prior knowledge of positions and directions of sensors. We model the ...
Assessing the Accuracy of an Algorithm for the Estimation of Spatial Gait Parameters Using Inertial Measurement Units: Application to Healthy Subject and Hemiparetic Stroke Survivor
MOCO '17: Proceedings of the 4th International Conference on Movement ComputingWe have reviewed and assessed the reliability of a dead reckoning and drift correction algorithm for the estimation of spatial gait parameters using Inertial Measurement Units (IMUs). In particular, we are interested in obtaining accurate stride lengths ...
Modeling human gait using a Kalman filter to measure walking distance
WH '11: Proceedings of the 2nd Conference on Wireless HealthIn this demo, we present a novel method to estimate joint angles and distance traveled by a human while walking. Understanding the kinematics of the human leg gives the velocities associated with forward human motion. Gyroscopes and accelerometers ...
Comments