Xiangyu Yin
ABSTRACT
Remote monitoring and evaluation of pulmonary diseases via tele-medicine are important to disease diagnosis and management, but current telemedicine solutions have limited capability of objectively examining the airway's internal physiological conditions that are crucial to pulmonary disease evaluation. Existing solutions based on smartphone sensing are also limited to externally monitoring breath rates, respiratory events, or lung function. In this paper, we present PTEase, a new system design that addresses these limitations and uses commodity smartphones to examine the airway's internal physiological conditions. PTEase uses active acoustic sensing to measure the internal changes of lower airway caliber, and then leverages machine learning to analyze the sensory data for pulmonary disease evaluation. We implemented PTEase as a smartphone app, and verified its measurement error in lab-controlled settings as <10%. Clinical studies further showed that PTEase reaches 75% accuracy on disease prediction and 11%-15% errors in estimating lung function indices. Given that such accuracy is comparable with that in clinical practice using spirometry, PTEase can be reliably used as an assistive telemedicine tool for disease evaluation and monitoring.
- 2022. MIR SmartOne. https://www.mirsmartone.comGoogle Scholar
- Abbas K Abbas, Konrad Heimann, Katrin Jergus, Thorsten Orlikowsky, and Steffen Leonhardt. 2011. Neonatal non-contact respiratory monitoring based on real-time infrared thermography. Biomedical engineering online 10, 1 (2011), 1--17.Google Scholar
- Katayoun Bahadori, Mary M Doyle-Waters, Carlo Marra, Larry Lynd, Kadria Alasaly, John Swiston, and Js Mark FitzGerald. 2009. Economic burden of asthma: a systematic review. BMC pulmonary medicine 9, 1 (2009), 1--16.Google Scholar
- Peter J Barnes, Stanley J Szefler, Helen K Reddel, and Bradley E Chipps. 2019. Symptoms and perception of airway obstruction in asthmatic patients: clinical implications for use of reliever medications. Journal of Allergy and Clinical Immunology 144, 5 (2019), 1180--1186.Google ScholarCross Ref
- Louis M Bell, Robert Grundmeier, Russell Localio, Joseph Zorc, Alexander G Fiks, Xuemei Zhang, Tyra Bryant Stephens, Marguerite Swietlik, and James P Guevara. 2010. Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics 125, 4 (2010), e770--e777.Google ScholarCross Ref
- Cristine E Berry, Meilan K Han, Bruce Thompson, Andrew H Limper, Fernando J Martinez, Marvin I Schwarz, Frank C Sciurba, Gerald J Criner, and Robert A Wise. 2015. Older adults with chronic lung disease report less limitation compared with younger adults with similar lung function impairment. Annals of the American Thoracic Society 12, 1 (2015), 21--26.Google ScholarCross Ref
- Eamann Breatnach, Gypsy C Abbott, and Robert G Fraser. 1984. Dimensions of the normal human trachea. American Journal of Roentgenology 142, 5 (1984), 903--906.Google ScholarCross Ref
- K Brown, C Aun, E Jackson, A Mackersie, D Hatch, and J Stocks. 1998. Validation of respiratory inductive plethysmography using the Qualitative Diagnostic Calibration method in anaesthetized infants. European Respiratory Journal 12, 4 (1998), 935--943.Google ScholarCross Ref
- David G Chapman, Cindy Thamrin, and Gregory G King. 2020. Perception of Symptoms as the Next Frontier for Personalized Medicine. The Journal of Allergy and Clinical Immunology: In Practice 8, 8 (2020), 2651--2652.Google ScholarCross Ref
- Zhe Chen, Tianyue Zheng, Chao Cai, and Jun Luo. 2021. MoVi-Fi: Motion-robust vital signs waveform recovery via deep interpreted RF sensing. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 392--405.Google ScholarDigital Library
- Kevin A Cook, Brian D Modena, and Ronald A Simon. 2016. Improvement in asthma control using a minimally burdensome and proactive smartphone application. The Journal of Allergy and Clinical Immunology: In Practice 4, 4 (2016), 730--737.Google ScholarCross Ref
- Robert O Crapo. 1994. Pulmonary-function testing. New England Journal of Medicine 331, 1 (1994), 25--30.Google ScholarCross Ref
- Koundinya Desiraju and Anurag Agrawal. 2016. Impulse oscillometry: the state-of-art for lung function testing. Lung India: official organ of Indian Chest Society 33, 4 (2016), 410.Google Scholar
- Christopher M Evans, Kyubo Kim, Michael J Tuvim, and Burton F Dickey. 2009. Mucus hypersecretion in asthma: causes and effects. Current opinion in pulmonary medicine 15, 1 (2009), 4.Google Scholar
- David A Fedele, J Graham Thomas, Andrew McConville, Elizabeth L McQuaid, Sara Voorhees, David M Janicke, Mutasim Abu-Hasan, Xiaofei Chi, and Matthew J Gurka. 2021. Using mobile Health to improve asthma self-Management in early Adolescence: a pilot randomized controlled trial. Journal of Adolescent Health 69, 6 (2021), 1032--1040.Google ScholarCross Ref
- Emma Fettes, Mollie Riley, Stephanie Brotherston, Claire Doughty, Benjamin Griffiths, Aidan Laverty, and Paul Aurora. 2022. "You're on mute!" Does pediatric CF home spirometry require physiologist supervision? Pediatric Pulmonology 57, 1 (2022), 278--284.Google ScholarCross Ref
- James E Fish and Stephen P Peters. 1999. Airway remodeling and persistent airway obstruction in asthma. Journal of Allergy and Clinical Immunology 104, 3 (1999), 509--516.Google ScholarCross Ref
- Erick Forno, Neethu Abraham, Daniel G Winger, Christian Rosas-Salazar, Geoffrey Kurland, and Daniel J Weiner. 2018. Perception of pulmonary function in children with asthma and cystic fibrosis. Pediatric allergy, immunology, and pulmonology 31, 3 (2018), 139--145.Google Scholar
- Jeffrey J Fredberg. 1981. Acoustic determinants of respiratory system properties. Annals of biomedical engineering 9, 5 (1981), 463--473.Google ScholarCross Ref
- Frederick LGR Gerzon, Quirijn Jöbsis, Michiel AGE Bannier, Bjorn Winkens, and Edward Dompeling. 2020. Discrepancy between lung function measurements at home and in the hospital in children with asthma and CF. Journal of Clinical Medicine 9, 6 (2020), 1617.Google ScholarCross Ref
- Mayank Goel, Elliot Saba, Maia Stiber, Eric Whitmire, Josh Fromm, Eric C Larson, Gaetano Borriello, and Shwetak N Patel. 2016. Spirocall: Measuring lung function over a phone call. In Proceedings of the 2016 CHI conference on human factors in computing systems. 5675--5685.Google ScholarDigital Library
- Timothy H Harries and Patrick White. 2021. Spotlight on primary care management of COPD: electronic health records., 1479973120985594 pages.Google Scholar
- V Hoffstein and JJ Fredberg. 1991. The acoustic reflection technique for non-invasive assessment of upper airway area. European Respiratory Journal 4, 5 (1991), 602--611.Google ScholarCross Ref
- Mark Holt, Ben Yule, Dylan Jackson, Mary Zhu, and Neema Moraveji. 2018. Ambulatory monitoring of respiratory effort using a clothing-adhered biosensor. In 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 1--6.Google ScholarDigital Library
- Chen-Yu Hsu, Aayush Ahuja, Shichao Yue, Rumen Hristov, Zachary Kabelac, and Dina Katabi. 2017. Zero-effort in-home sleep and insomnia monitoring using radio signals. Proceedings of the ACM on Interactive, mobile, wearable and ubiquitous technologies 1, 3 (2017), 1--18.Google ScholarDigital Library
- Kana Ram Jat. 2013. Spirometry in children. Primary Care Respiratory Journal 22, 2 (2013), 221--229.Google ScholarCross Ref
- Ibrahim Kamal. 2001. Normal standard curve for acoustic pharyngometry. Otolaryngology-Head and Neck Surgery 124, 3 (2001), 323--330.Google ScholarCross Ref
- Eric C Larson, Mayank Goel, Gaetano Boriello, Sonya Heltshe, Margaret Rosenfeld, and Shwetak N Patel. 2012. SpiroSmart: using a microphone to measure lung function on a mobile phone. In Proceedings of the 2012 ACM Conference on ubiquitous computing. 280--289.Google ScholarDigital Library
- Gregory F Lewis, Rodolfo G Gatto, and Stephen W Porges. 2011. A novel method for extracting respiration rate and relative tidal volume from infrared thermography. Psychophysiology 48, 7 (2011), 877--887.Google ScholarCross Ref
- Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking vital signs during sleep leveraging off-the-shelf wifi. In Proceedings of the 16th ACM international symposium on mobile ad hoc networking and computing. 267--276.Google ScholarDigital Library
- Mario Morais-Almeida, Miguel Barbosa, and Claudia Sousa. 2022. Telemedicine in the Management of Chronic Obstructive Respiratory Diseases: An Overview. Exon Publications (2022), 131--144.Google Scholar
- Meinard Müller. 2007. Dynamic time warping. Information retrieval for music and motion (2007), 69--84.Google ScholarDigital Library
- Sherry L Murphy, Kenneth D Kochanek, Jiaquan Xu, and Elizabeth Arias. 2021. Mortality in the United States. NCHS data brief No. 427 (2021).Google Scholar
- Yunyoung Nam, Youngsun Kong, Bersain Reyes, Natasa Reljin, and Ki H Chon. 2016. Monitoring of heart and breathing rates using dual cameras on a smart-phone. PloS one 11, 3 (2016), e0151013.Google ScholarCross Ref
- Rajalakshmi Nandakumar, Shyamnath Gollakota, and Jacob E Sunshine. 2019. Opioid overdose detection using smartphones. Science translational medicine 11, 474 (2019), eaau8914.Google Scholar
- Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In Proceedings of the 13th annual international conference on mobile systems, applications, and services. 45--57.Google ScholarDigital Library
- Phuc Nguyen, Xinyu Zhang, Ann Halbower, and Tam Vu. 2016. Continuous and fine-grained breathing volume monitoring from afar using wireless signals. In IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications. IEEE, 1--9.Google ScholarDigital Library
- Imre Noth, Vincent Cottin, Nazia Chaudhuri, Tamera J Corte, Kerri A Johannson, Marlies Wijsenbeek, Stephane Jouneau, Andreas Michael, Manuel Quaresma, Klaus B Rohr, et al. 2021. Home spirometry in patients with idiopathic pulmonary fibrosis: data from the INMARK trial. European Respiratory Journal 58, 1 (2021).Google ScholarCross Ref
- Sean B O'Loghlen, Linda Levesque, Thomas Fisher, Yvonne DeWit, Marlo White-head, Teresa To, and M Diane Lougheed. 2020. Health services utilization is increased in poor perceivers of bronchoconstriction and hyperinflation in asthma. The Journal of Allergy and Clinical Immunology: In Practice 8, 8 (2020), 2643--2650.Google ScholarCross Ref
- Ellie Oostveen, D MacLeod, H Lorino, R Farre, Z Hantos, K Desager, F Marchal, et al. 2003. The forced oscillation technique in clinical practice: methodology, recommendations and future developments. European respiratory journal 22, 6 (2003), 1026--1041.Google Scholar
- Alex Paynter, Umer Khan, Sonya L Heltshe, Christopher H Goss, Noah Lechtzin, and Nicole Mayer Hamblett. 2022. A comparison of clinic and home spirometry as longtudinal outcomes in cystic fibrosis. Journal of Cystic Fibrosis 21, 1 (2022), 78--83.Google ScholarCross Ref
- Philip H Quanjer, Sanja Stanojevic, Tim J Cole, Xaver Baur, Graham L Hall, Bruce H Culver, Paul L Enright, John L Hankinson, Mary SM Ip, Jinping Zheng, et al. 2012. Multi-ethnic reference values for spirometry for the 3--95-yr age range: the global lung function 2012 equations.Google Scholar
- Tauhidur Rahman, Alexander T Adams, Mi Zhang, Erin Cherry, Bobby Zhou, Huaishu Peng, and Tanzeem Choudhury. 2014. Bodybeat: A mobile system for sensing non-speech body sounds. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services. 2--13.Google ScholarDigital Library
- Rachelle R Ramsey, Jill M Plevinsky, Lauren Milgrim, Kevin A Hommel, Karen M McDowell, Jeffrey Shepard, and Theresa W Guilbert. 2021. Feasibility and preliminary validity of mobile spirometry in pediatric asthma. The Journal of Allergy and Clinical Immunology: In Practice 9, 10 (2021), 3821--3823.Google ScholarCross Ref
- Helen K Reddel, Leonard B Bacharier, Eric D Bateman, Christopher E Brightling, Guy G Brusselle, Roland Buhl, Alvaro A Cruz, Liesbeth Duijts, Jeffrey M Drazen, J Mark FitzGerald, et al. 2022. Global Initiative for Asthma Strategy 2021: executive summary and rationale for key changes. American Journal of Respiratory and Critical Care Medicine 205, 1 (2022), 17--35.Google ScholarCross Ref
- MICHAEL D Revow, SANDRA J England, HA Stogryn, and DONNA L Wilkes. 1987. Comparison of calibration methods for respiratory inductive plethysmography in infants. Journal of Applied Physiology 63, 5 (1987), 1853--1861.Google ScholarCross Ref
- Nicola Rieke, Jonny Hancox, Wenqi Li, Fausto Milletari, Holger R Roth, Shadi Albarqouni, Spyridon Bakas, Mathieu N Galtier, Bennett A Landman, Klaus Maier-Hein, et al. 2020. The future of digital health with federated learning. NPJ digital medicine 3, 1 (2020), 119.Google Scholar
- M Scarpetta, M Spadavecchia, G Andria, MA Ragolia, and N Giaquinto. 2022. Accurate simultaneous measurement of heartbeat and respiratory intervals using a smartphone. Journal of Instrumentation 17, 07 (2022), P07020.Google ScholarCross Ref
- Antonius Schneider, Lena Gindner, Lisa Tilemann, Tjard Schermer, Geert-Jan Dinant, Franz Joachim Meyer, and Joachim Szecsenyi. 2009. Diagnostic accuracy of spirometry in primary care. BMC pulmonary medicine 9, 1 (2009), 1--10.Google Scholar
- Amirhossein Shahshahani, Carl Laverdiere, Sharmistha Bhadra, and Zeljko Zilic. 2018. Ultrasound sensors for diaphragm motion tracking: An application in non-invasive respiratory monitoring. Sensors 18, 8 (2018), 2617.Google ScholarCross Ref
- Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. 2020. SpiroSonic: monitoring human lung function via acoustic sensing on commodity smartphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.Google ScholarDigital Library
- R Thurnheer. 1999. Pharyngeal cross-sectional area and compliance in normal males and females. Respiration; international review of thoracic diseases 66, 4 (1999), 382.Google Scholar
- Yu-Chih Tung, Duc Bui, and Kang G Shin. 2018. Cross-platform support for rapid development of mobile acoustic sensing applications. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 455--467.Google ScholarDigital Library
- Shuai Wang, Bo Kang, Jinlu Ma, Xianjun Zeng, Mingming Xiao, Jia Guo, Mengjiao Cai, Jingyi Yang, Yaodong Li, Xiangfei Meng, et al. 2021. A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19). European radiology 31, 8 (2021), 6096--6104.Google Scholar
- Jerry A Ware and Kehti Aki. 1969. Continuous and discrete inverse-scattering problems in a stratified elastic medium. I. Plane waves at normal incidence. The journal of the Acoustical Society of America 45, 4 (1969), 911--921.Google ScholarCross Ref
- DE Weston. 1953. The theory of the propagation of plane sound waves in tubes. Proceedings of the Physical Society. Section B 66, 8 (1953), 695.Google Scholar
- Marlies S Wijsenbeek, Catharina C Moor, Kerri A Johannson, Peter D Jackson, Yet H Khor, Yasuhiro Kondoh, Sujeet K Rajan, Gabriela C Tabaj, Brenda E Varela, Pieter van der Wal, et al. 2022. Home monitoring in interstitial lung diseases. The Lancet Respiratory Medicine (2022).Google Scholar
- Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. 2019. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST) 10, 2 (2019), 1--19.Google ScholarDigital Library
- Meng-Chieh Yu, Jia-Ling Liou, Shuenn-Wen Kuo, Ming-Sui Lee, and Yi-Ping Hung. 2012. Noncontact respiratory measurement of volume change using depth camera. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 2371--2374.Google Scholar
- Shichao Yue, Hao He, Hao Wang, Hariharan Rahul, and Dina Katabi. 2018. Extracting multi-person respiration from entangled RF signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--22.Google ScholarDigital Library
- Ping Zhou, Liu Yang, and Yao-Xiong Huang. 2019. A smart phone based handheld wireless spirometer with functions and precision comparable to laboratory spirometers. Sensors 19, 11 (2019), 2487.Google ScholarCross Ref
- Fatma Zubaydi, Assim Sagahyroon, Fadi Aloul, Hasan Mir, and Bassam Mahboub. 2020. Using Mobiles to Monitor Respiratory Diseases. In Informatics, Vol. 7. MDPI, 56.Google Scholar
Index Terms
- PTEase: Objective Airway Examination for Pulmonary Telemedicine using Commodity Smartphones
Recommendations
Out-Clinic Pulmonary Disease Evaluation via Acoustic Sensing and Multi-Task Learning on Commodity Smartphones
SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor SystemsPulmonary diseases, such as asthma and Chronic Obstructive Pulmonary Disease (COPD), constitute a major public health challenge. The disease symptoms, including airway obstruction and inflammation, usually result in changes in airway mechanical ...
Teleconsultation of coronary angiograms using smartphones and an audio/video conferencing application
OBJECTIVE: To examine the feasibility and accuracy of teleconsultation of coronary angiograms using iPhone 4 and FaceTime.METHODS: The study was conducted in two stages. Coronary angiograms of 100 patients with single-vessel disease were retrospectively ...
Ocular symptom detection using smartphones
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: AdjunctIt is often said that "the eyes are the windows to the soul". Although this usually metaphorically refers to a person's emotional state, there is literal truth in this statement with reference to a person's biological state. The eyes are dynamic and ...
Comments