Xuyu Wang
Skip Abstract Section
Abstract
Vital sign (e.g., respiration rate) monitoring has become increasingly more important because it offers useful clues about medical conditions such as sleep disorders. There is a compelling need for technologies that enable contact-free and easy deployment of vital sign monitoring over an extended period of time for healthcare. In this article, we present a SonarBeat system to leverage a phase-based active sonar to monitor respiration rates with smartphones. We provide a sonar phase analysis and discuss the technical challenges for respiration rate estimation utilizing an inaudible sound signal. Moreover, we design and implement the SonarBeat system, with components including signal generation, data extraction, received signal preprocessing, and breathing rate estimation with Android smartphones. Our extensive experimental results validate the superior performance of SonarBeat in different indoor environment settings.
- Heba Abdelnasser, Khaled A. Harras, and Moustafa Youssef. 2015. Ubibreathe: A ubiquitous non-invasive WiFi-based breathing estimator. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’15). 277--286.Google Scholar
- Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart homes that monitor breathing and heart rate. In the ACM CHI Conference on Human Factors in Computing Systems (CHI’15). 837--846.Google Scholar
- Heba Aly and Moustafa Youssef. 2016. Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones. In the IEEE International Conference on Computer Communications (INFOCOM’16). 1--9.Google Scholar
- Inci M. Baytas, Kaixiang Lin, Fei Wang, Anil K. Jain, and Jiayu Zhou. 2016. PhenoTree: Interactive visual analytics for hierarchical phenotyping from large-scale electronic health records. IEEE Trans. Multimedia 18, 11 (Nov. 2016), 2257--2270.Google Scholar
- Edgar A. Bernal, Xitong Yang, Qun Li, Jayant Kumar, Sriganesh Madhvanath, Palghat Ramesh, and Raja Bala. 2018. Deep temporal multimodal fusion for medical procedure monitoring using wearable sensors. IEEE Trans. Multimedia 20, 1 (2018), 107--118.Google ScholarDigital Library
- Sergio Cicalo, Matteo Mazzotti, Simone Moretti, Velio Tralli, and Marco Chiani. 2016. Multiple video delivery in m-health emergency applications. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 1988--2001.Google Scholar
- Charalampos A. Dimoulas. 2016. Audiovisual spatial-audio analysis by means of sound localization and imaging: A multimedia healthcare framework in abdominal sound mapping. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 1969--1976.Google Scholar
- Amy Droitcour, Victor Lubecke, Jenshan Lin, and Olga Boric-Lubecke. 2001. A microwave radio for Doppler radar sensing of vital signs. In Proc. 2001 IEEE MTT-S International Microwave Symposium Digest (Cat. No. 01CH37157). 175--178.Google Scholar
- Amy D. Droitcour, Olga Boric-Lubecke, and Gregory T. A. Kovacs. 2009. Signal-to-noise ratio in Doppler radar system for heart and respiratory rate measurements. IEEE Trans. Microw. Theory Technol. 57, 10 (Oct. 2009), 2498--2507.Google Scholar
- Biying Fu, Jakob Karolus, Tobias Grosse-Puppendahl, Jonathan Hermann, and Arjan Kuijper. 2015. Opportunities for activity recognition using ultrasound doppler sensing on unmodified mobile phones. In Proc. 2nd International Workshop on Sensor-Based Activity Recognition and Interaction. ACM, 8:1--8:10.Google ScholarDigital Library
- Pedro Henriquez, Bogdan J. Matuszewski, Yasmina Andreu-Cabedo, Luca Bastiani, Sara Colantonio, Giuseppe Coppini, Mario D’Acunto, Riccardo Favilla, Danila Germanese, Daniela Giorgi, et al. 2017. Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization. IEEE Trans. Multimedia 19, 7 (July 2017), 1467--1481.Google Scholar
- Carl E. Hunt and Fern R. Hauck. 2006. Sudden infant death syndrome. Can. Med. Assoc. J 174, 13 (April 2006), 1309--1310.Google Scholar
- S. M. Riazul Islam, Daehan Kwak, M. D. Humaun Kabir, Mahmud Hossain, and Kyung-Sup Kwak. 2015. The Internet of Things for health care: A comprehensive survey. IEEE Access 3 (June 2015), 678--708.Google Scholar
- Fan Li, Huijie Chen, Xiaoyu Song, Qian Zhang, Youqi Li, and Yu Wang. 2017. CondioSense: High-quality context-aware service for audio sensing system via active sonar. Personal Ubiquitous Comput. 22, 1 (Feb. 2017), 17--29.Google Scholar
- Jian Liu, Yan Wang, Yinging Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015a. Tracking vital signs during sleep leveraging off-the-shelf WiFi. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’15). 267--276.Google Scholar
- Jian Liu, Yan Wang, Gorkem Kar, Yingying Chen, Jie Yang, and Marco Gruteser. 2015b. Snooping keystrokes with mm-level audio ranging on a single phone. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’15). ACM, 142--154.Google Scholar
- V. M. Lubecke, O. Boric-Lubecke, G. Awater, P. W. Ong, P. Gammel, R. H. Yan, and J. C. Lin. 2000. Remote sensing of vital signs with telecommunications signals. In Proc. World Congress on Medical Physics and Biomedical Engineering (WC’00).Google Scholar
- Victor Lubecke, Olga Boric-Lubecke, and Eric Beck. 2002. A compact low-cost add-on module for Doppler radar sensing of vital signs using a wireless communications terminal. In Proc. 2002 IEEE MTT-S International Microwave Symposium Digest (Cat. No. 02CH37278). 1767--1770.Google Scholar
- Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision acoustic motion tracking. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’16). ACM, New York, NY, 491--492.Google Scholar
- L. Robert Mogue and Boerje Rantala. 1988. Capnometers. J. Clin. Monit. 4, 2 (April 1988), 115--121.Google Scholar
- Frank Mokaya, Roland Lucas, Hae Young Noh, and Pei Zhang. 2016. Burnout: A wearable system for unobtrusive skeletal muscle fatigue estimation. In the 15th International Conference on Information Processing in Sensor Networks (IPSN’16). IEEE, 1--12.Google Scholar
- Seong-Eun Moon and Jong-Seok Lee. 2017. Implicit analysis of perceptual multimedia experience based on physiological response: A review. IEEE Trans. Multimedia 19, 2 (Feb. 2017), 340--353.Google Scholar
- Henning Müeller and Devrim Unay. 2017. Retrieval from and understanding of large-scale multi-modal medical datasets: A review. IEEE Trans. Multimedia 19, 9 (Sept. 2017), 2093--2104.Google Scholar
- Rajalakshmi Nandakumar, Krishna Kant Chintalapudi, Venkat Padmanabhan, and Ramarathnam Venkatesan. 2013. Dhwani: Secure peer-to-peer acoustic NFC. ACM SIGCOMM Comput. Commun. Rev. 43, 4 (2013), 63--74.Google ScholarDigital Library
- Rajalakshmi Nandakumar and Shyamnath Gollakota. 2017. Unleashing the power of active sonar. IEEE Pervasive Comput. 16, 1 (2017), 11--15.Google ScholarDigital Library
- Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys’15). ACM, 45--57.Google ScholarDigital Library
- Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In the ACM CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, 1515--1525.Google Scholar
- Phuc Nguyen, Xinyu Zhang, Ann Halbower, and Tam Vu. 2016. Continuous and fine-grained breathing volume monitoring from afar using wireless signals. In the IEEE International Conference on Computer Communications (INFOCOM’16). 1--9.Google Scholar
- Chen Qiu and Matt W. Mutka. 2017. Silent whistle: Effective indoor positioning with assistance from acoustic sensing on smartphones. In the 18th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM’17). IEEE, 1--6.Google Scholar
- Yanzhi Ren, Chen Wang, Jie Yang, and Yingying Chen. 2015. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In the IEEE International Conference on Computer Communications (INFOCOM’15). 1194--1202.Google Scholar
- Wenjie Ruan, Quan Z. Sheng, Lei Yang, Tao Gu, Peipei Xu, and Longfei Shangguan. 2016. AudioGest: Enabling fine-grained hand gesture detection by decoding echo signal. In the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’16). ACM, 474--485.Google ScholarDigital Library
- Jussi Salmi and Andreas F. Molisch. 2011. Propagation parameter estimation, modeling and measurements for ultrawideband mimo radar. IEEE Trans. Microw. Theory Technol. 59, 11 (Nov. 2011), 4257--4267.Google Scholar
- Nastaran H. Shariati and Edmond Zahedi. 2005. Comparison of selected parametric models for analysis of the photoplethysmographic signal. In Proc. 1st IEEE Conf. Comput., Commun. Signal Process. 169--172.Google Scholar
- Dan Stowell, Dimitrios Giannoulis, Emmanouil Benetos, Mathieu Lagrange, and Mark D. Plumbley. 2015. Detection and classification of acoustic scenes and events. IEEE Trans. Multimedia 17, 10 (Oct. 2015), 1733--1746.Google ScholarCross Ref
- Junjue Wang, Kaichen Zhao, Xinyu Zhang, and Chunyi Peng. 2014. Ubiquitous keyboard for small mobile devices: Harnessing multipath fading for fine-grained keystroke localization. In the 12th International Conference on Mobile Systems, Applications, and Services (MobiSys’14). ACM, 14--27.Google ScholarDigital Library
- Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’16). ACM, New York, NY, 82--94.Google Scholar
- Xuyu Wang, Runze Huang, and Shiwen Mao. 2017a. SonarBeat: Sonar phase for breathing beat monitoring with smartphones. In the 26th International Conference on Computer Communication and Networks (ICCCN’17). 1--8.Google Scholar
- Xuyu Wang, Chao Yang, and Shiwen Mao. 2017b. PhaseBeat: Exploiting CSI phase data for vital sign monitoring with commodity WiFi devices. In the 37th IEEE International Conference on Distributed Computing Systems (ICDCS’17). 1--10.Google Scholar
- Xuyu Wang, Chao Yang, and Shiwen Mao. 2017c. TensorBeat: Tensor decomposition for monitoring multi-person breathing beats with commodity WiFi. ACM Trans. Intell. Sys. Technol. 9, 1 (Sept. 2017), 8:1--8:27.Google ScholarDigital Library
- Xuyu Wang, Choa Yang, and Shiwen Mao. 2020. On CSI-based vital sign monitoring using commodity WiFi. ACM Trans. Comput. Healthcare 1, 3 (April 2020), 12:1--12:27.Google Scholar
- Teng Wei and Xinyu Zhang. 2015. mTrack: High-precision passive tracking using millimeter wave radios. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’15). ACM, 117--129.Google Scholar
- Cheng Yang, Gene Cheung, and Vladimir Stankovic. 2017. Estimating heart rate and rhythm via 3D motion tracking in depth video. IEEE Trans. Multimedia 19, 7 (July 2017), 1625--1636.Google Scholar
- Zhicheng Yang, Parth H. Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2016. Monitoring vital signs using millimeter wave. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’16). 211--220.Google Scholar
- Xingliang Yuan, Xinyu Wang, Cong Wang, Jian Weng, and Kui Ren. 2016. Enabling secure and fast indexing for privacy-assured healthcare monitoring via compressive sensing. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 2002--2014.Google ScholarCross Ref
- Sangki Yun, Yi-Chao Chen, and Lili Qiu. 2015. Turning a mobile device into a mouse in the air. In the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys’15). 15--29.Google ScholarDigital Library
- Bing Zhou, Mohammed Elbadry, Ruipeng Gao, and Fan Ye. 2017. BatMapper: Acoustic sensing based indoor floor plan construction using smartphones. In the 15th International Conference on Mobile Systems, Applications, and Services (MobiSys’17). ACM, 42--55.Google Scholar
Index Terms
- Smartphone Sonar-Based Contact-Free Respiration Rate Monitoring
Recommendations
A realisation of ethical concerns with smartphone personal health monitoring apps
Special Issue on EthicompThe pervasiveness of smartphones has facilitated a new way in which owners of devices can monitor their health using applications (apps) that are installed on their smartphones. Smartphone personal health monitoring (SPHM) collects and stores health ...
Identifying diverse usage behaviors of smartphone apps
IMC '11: Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conferenceSmartphone users are increasingly shifting to using apps as "gateways" to Internet services rather than traditional web browsers. App marketplaces for iOS, Android, and Windows Phone platforms have made it attractive for developers to deploy apps and ...
A noninvasive heartbeat, respiration, and body movement monitoring system for neonates
Long-term monitoring of heart rate, respiratory rate, and body movement in neonates would be useful for preventing illnesses, such as respiratory disorders. However, currently, there is no noninvasive monitoring system available for neonates. Therefore, ...
Comments