skip to main content
10.1145/2750858.2804272acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Non-obstructive room-level locating system in home environments using activity fingerprints from smartwatch

Published:07 September 2015Publication History

ABSTRACT

Many smart home applications, such as monitoring for the elderly and home automation, require location information for individual occupants. Several techniques have been proposed for tracking occupants in a home environment. However, the current techniques do not provide a seamless in-home locating system owing to the occupants' device-free movement and the lack of cost-effective infrastructure for home location tracking. In this paper, we propose a home occupant tracking system that uses a smartphone and an off-the-shelf smartwatch without additional infrastructure. In our system, activity fingerprints are automatically generated from the microphone and the inertial sensors of the smartwatch, and location information is periodically obtained from the smartphone. We designed a hidden Markov model using the relationship between home activities and the room's location. Extensive experiments showed that our system tracks the location of users with 87% accuracy, even when there is no manual training for activities.

References

  1. J. Rekimoto, T. Miyaki, and T. Ishizawa. 2007. Lifetag: Wi-Fi-based continuous location logging for life pattern analysis. In Proceedings of the 3rd International Conference on Location- and Context-Awareness, 35--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. I. Anderson, J. Maitland, S. Sherwood, L. Barkhuus, M. Chalmers, M. Hall, B. Brown, and H. Muller. 2007. Shakra: Tracking and sharing daily activity levels with unaugmented mobile phones. Mobile Netw Appl 12, 2--3: 185--199. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. A. R. Kaushik and B. G. Celler. 2007. Characterization of PIR detector for monitoring occupancy patterns and functional health status of elderly people living alone at home. Technol Health Care 15, 4: 273--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. Sánchez, M. Jiménez, F. Rosique, B. Álvarez, and A. Iborra. 2011. A framework for developing home automation systems: from requirements to code. J Syst Software 84, 6: 1008--1021. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. S. Lee, D. Ahn, S. Lee, R. Ha, and H. Cha. 2014. Personalized energy auditor: Estimating personal electricity usage. In The 11th IEEE International Conference on Pervasive Computing and Communications (PerCom 2014), 44--49.Google ScholarGoogle Scholar
  6. V. L. Erickson, M. A. Carreira-Perpinan, and A. E. Cerpa. 2011. OBSERVE: Occupancy-based system for efficient reduction of HVAC energy. In Proceedings IPSN 2011, 258--269.Google ScholarGoogle Scholar
  7. A. Kamthe, L. Jiang, M. Dudys, and A. Cerpa. 2009. Scopes: Smart cameras object position estimation system. Wireless Sensor Networks 279--295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Ranjan, Y. Yao, and K. Whitehouse. 2013. An RF doormat for tracking people's room locations. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 797--800. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. T. W. Hnat, E. Griffiths, R. Dawson, and K. Whitehouse. 2012. Doorjamb: Unobtrusive room-level tracking of people in homes using doorway sensors. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems, 309--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Wilson and N. Patwari. 2011. See-through walls: Motion tracking using variance-based radio tomography networks. IEEE Trans Mobile Comput 10, 5: 612--621. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. E. K. Choe, S. Consolvo, J. Jung, B. Harrison, and J. A. Kientz. 2011. Living in a glass house: A survey of private moments in the home. In Proceedings of the 13th International Conference on Ubiquitous Computing, 41--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. B. Song, H. Choi, and H. S. Lee. 2008. Surveillance tracking system using passive infrared motion sensors in wireless sensor network. In Proceedings of International Conference on Information Networking (ICOIN 2008), 1--5.Google ScholarGoogle Scholar
  13. U. Steinhoff and B. Schiele. 2009. Dead reckoning from the pocket---an experimental study. In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PERCOM 2009), 162--170.Google ScholarGoogle Scholar
  14. Y. Kim, Y. Chon, and H. Cha. 2012. Smartphone-based collaborative and autonomous radio fingerprinting. IEEE Trans Syst Man Cy C 42, 1: 112--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Hardegger, et al. 2012. ActionSLAM: Using location-related actions as landmarks in pedestrian SLAM. In Proceedings of International Conference on Indoor Positioning and Indoor Navigation (IPIN 2012), 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  16. M. Hardegger, G. Tröster, D. Roggen. Improved ActionSLAM for long-term indoor tracking with wearable motion sensors. 2013. In Proceedings of the 17th Annual International Symposium on Wearable Computers, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. O. Woodman and R. Harle. 2008. Pedestrian localisation for indoor environments. In Proceedings of the 10th ACM international conference on Ubiquitous computing (Ubicomp 2008), 114--123. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. T. W. Hnat, V. Srinivasan, J. Lu, T. I. Sookoor, R. Dawson, J. Stankovic, and K. Whitehouse. 2011. The hitchhiker's guide to successful residential sensing deployments. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems (Sensys '11), 232--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. E. Foxlin. 2005. Pedestrian tracking with shoemounted inertial sensors. IEEE Comput Graph 25, 6: 38--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Fitbit, Inc. Fitbit Force. Retrieved July 14, 2015 from http://www.fitbit.com/Google ScholarGoogle Scholar
  21. Samsung, Inc. Samsung Galaxy Gear. Retrieved July 14, 2015 from http://www.samsung.com/nl/consumer/mobile-phone/wearable/galaxy-gear/SM-V7000ZKAPHNGoogle ScholarGoogle Scholar
  22. Sony, Inc. Sony Smartwatch2. Retrieved July 14, 2015 from http://www.sonymobile.com/global-en/products/accessories/smartwatch-2-sw2/Google ScholarGoogle Scholar
  23. LG, Inc. LG G-watch. Retrieved July 14, 2015 from http://www.lg.com/global/gwatch/index.html#mainGoogle ScholarGoogle Scholar
  24. P. Bahl and V. N. Padmanabhan. 2000. RADAR: an in building RF-based user location and tracking system. In Proceedings INFOCOM 2000, 775--784.Google ScholarGoogle Scholar
  25. S. Nattapong and V. K. Prashant. 2008. On clustering RSS fingerprints for improving scalability of performance prediction of indoor positioning systems. In Proceedings of the First ACM International Workshop on Mobile Entity Localization and Tracking in GPS-less Environments, September 19--19, 2008, San Francisco, California, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. A. LaMarca, Y. Chawathe, S. Consolvo, J. Hightower, I. Smith, J. Scott, T. Sohn, J. Howard, J. Hughes, F. Potter, J. Tabert, P. Powledge, G. Borriello, and B. Schilit. 2005. Place Lab: Device positioning using radio beacons in the wild. In Proceedings of the third International Conference on Pervasive Computing, 116--133. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. A. Anshul Rai, K. K. Chintalapudi, P. Venkat, and R. Sen. 2012. Zee: Zero-effort crowdsourcing for indoor localization. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking (MobiCom), 369--378. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Martin Azizyan, Ionut Constandache, and Romit Roy Choudhury. 2009. SurroundSense: Mobile phone localization via ambience fingerprinting. In Proceedings of the 15th Annual International Conference on Mobile Computing and Networking, 261--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. L. Bao and S. Intille. 2004. Activity recognition from user-annotated acceleration data. In Proceedings of Pervasive Computing, 1--17.Google ScholarGoogle Scholar
  30. J. Lester, T. Choudhury, and G. Borriello. 2006. A practical approach to recognizing physical activities. In Proceedings of Pervasive Computing, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. K. Yatani and K. N. Truong. 2012. BodyScope: a wearable acoustic sensor for activity recognition. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (Ubicomp 2012), 341--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. S. Lee, B. Kim, H. Kim, R. Ha, and H. Cha. 2011. Inertial sensor-based indoor pedestrian localization with minimum IEEE 802.15.4a configuration. IEEE Trans Industrial Informatics 7, 3: 455--466.Google ScholarGoogle ScholarCross RefCross Ref
  33. M. Mladenov and M. Mock. 2009. A step counter service for Java-enabled devices using a built-in accelerometer. In Proceedings of the International Workshop on Context-Aware Middleware and Services (CAMS 2009), 1--5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. N. Ravi, N. Dandekar, P. Mysore, and M. L. Littman. 2005. Activity recognition from accelerometer data. AAAI 5: 1541--1546. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Z. Fang, et al. 2001. Comparison of different implementations of MFCC. J Comput Sci Technol 16, 6: 582--589. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. H. Abdi. 2007. Discriminant correspondence analysis. In Encyclopedia of Measurement and Statistics. Sage, Thousand Oaks, CA, 270--275.Google ScholarGoogle Scholar
  37. J. B. MacQueen. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of Berkeley Symposium on Mathematical Statistics and Probability, 1, 281--297.Google ScholarGoogle Scholar
  38. D. Rogers and T. Tanimoto. 1960. A computer program for classifying plants. Science 21: 1115--1118.Google ScholarGoogle ScholarCross RefCross Ref
  39. A. Viterbi. 1967. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans Inf Theory 13, 2: 260--269. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Non-obstructive room-level locating system in home environments using activity fingerprints from smartwatch

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing
        September 2015
        1302 pages
        ISBN:9781450335744
        DOI:10.1145/2750858

        Copyright © 2015 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 7 September 2015

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        UbiComp '15 Paper Acceptance Rate101of394submissions,26%Overall Acceptance Rate764of2,912submissions,26%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader