Abstract
Activity recognition has attracted increasing attention as a number of related research areas such as pervasive computing, intelligent environments and robotics converge on this critical issue. It is also driven by growing real-world application needs in such areas as ambient assisted living and security surveillance. This chapter aims to provide an overview on existing approaches, current practices and future trends on activity recognition. It is intended to provide the necessary material to inform relevant research communities of the latest developments in this field in addition to providing a reference for researchers and system developers who are working towards the design and development of activity-based context aware applications. The chapter first reviews the existing approaches and algorithms that have been used for activity recognition in a number of related areas. It then describes the practice and lifecycle of the ontology-based approach to activity recognition that has recently been under vigorous investigation. Finally the chapter presents emerging research on activity recognition by outlining various issues and directions the field will take.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Weiser M., (1991), The computer for the twenty-first century, Scientific American, Vol. 265, No. 3, pp. 94-104.
Nugent C.D., (2008), Experiences in the Development of a Smart Lab, The International Journal of Biomedical Engineering and Technology, Vol. 2, No. 4, pp. 319-331
Ivano Y. and Bobick A., (2000), Recognition of Visual Activities and Interactions by Stochastic Parsing, IEEE Trans Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 852-872.
Stauffer C. and Grimson W.E., (2000), Learning Patterns of Activity Using Real-Time Tracking IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 747-757.
Bodor R., Jackson B., and Papanikolopoulos N., (2003), Vision based human tracking and activity recognition, In Proceedings of the 11th Mediterranean Conference on Control and Automation.
Fiore L., Fehr D., Bodor R., Drenner A., Somasundaram G., and Papanikolopoulos N., (2008), Multi-Camera Human Activity Monitoring, Journal of Intelligent and Robotic Systems, Vol. 52, No. 1, pp. 5-43.
Bao L. and Intille S., (2004), Activity recognition from userannotated acceleration data, In Proc. Pervasive, LNCS3001, pp. 1-17.
Huynh D.T.G., (2008), Human Activity Recognition with Wearable Sensors, PhD thesis, TU Darmstadt.
Patterson DJ., Fox D., Kautz H., and Philipose M., (2005), Fine-grained activity recognition by aggregating abstract object usage, In Proc. of IEEE International Symposium on Wearable Computers, pp. 44-51.
Lee SW. and Mase K., (2002), Activity and location recognition using wearable sensors, IEEE Pervasive Computing, Vol. 1, No. 3, pp. 24-32.
Parkka J., Ermes M., Korpipaa P., Mantyjarvi J., Peltola J., and Korhonen I., (2006), Activity classification using realistic data from wearable sensors, IEEE Transactions on Information Technology in Biomedicine, Vol. 10, No. 1, pp. 119-128.
Philipose M., Fishkin K.P., Perkowitz M., Patterson D.J., Hahnel D., Fox D., and Kautz H., (2004), Inferring Activities from Interactions with Objects, IEEE Pervasive Computing: Mobile and Ubiquitous Systems, Vol. 3, No. 4, pp. 50-57.
Chan M., Estéve D., Escriba C., and Campo E., (2008), A review of smart homes-Present state and future challenges, Computer Methods and Programs in Biomedicine, Vol. 91, No. 1, pp. 55-81.
Helal S., Mann W., El-Zabadani H., King J., Kaddoura Y., and Jansen E., (2005), The gator tech smart house: a programmable pervasive space, IEEE Computer, Vol. 38, No. 3, pp. 64-74.
Ward J.A., Lukowicz, Troter P., and Starner T.G., (2006), Activity recognition of assembly tasks using body-worn microphones and accelerometers, IEEE Trans.Pattern Analysis and Machine Intelligence, Vol. 28, No. 10, pp. 1553-1567.
Boger J., Poupart P., Hoey J., Boutilier C., and Mihailidis A., (2005), A Decision-Theoretic Approach to Task Assistance for Persons with Dementia, In Proc. of the International Joint Conference on Artificial Intelligence (IJCAI’05), pp. 1293-1299.
Wang S., Pentney W., Popescu A.M., Choudhury T., and Philipose M., (2007), Common Sense Based Joint Training of Human Activity Recognizers, In Proc. International Joint Conference on Artificial Intelligence.
Albrecht D.W. and Zukerman I., (1998), Bayesian Models for Keyhole Plan Recognition in an Adventure Game, User Modelling and User-Adapted Interaction, Vol. 8, pp. 5-47.
Tapia E.M. and Intille, S., (2007), Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor, In International Symposium on Wearable Computers (ISWC).
Huynh T. and Schiele B., (2006), Unsupervised Discovery of Structure in Activity Data using Multiple Eigenspaces, In 2nd International Workshop on Location- and Context-Awareness (LoCA), LNCS Vol. 3987.
Liao L., Fox D., and Kautz H., Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields. The International Journalof Robotics Research, 26(1):119, 2007.
Kautz H., (1991), A Formal Theory of Plan Recognition and its Implementation, Reasoning About Plans, Allen J., Pelavin R. and Tenenberg J. eds., Morgan Kaufmann, San Mateo, C.A., pp. 69-125.
Wobke W., (2002), Two Logical Theories of Plan Recognition, Journal of Logic Computation, Vol. 12, No. 3, pp. 371-412.
Bouchard B. and Giroux S., (2006), A Smart Home Agent for Plan Recognition of Cognitivelyimpaired Patients, Journal of Computers, Vol. 1, No. 5, pp. 53-62.
Chen L., Nugent C., Mulvenna M., Finlay D., Hong X., Poland, M., (2008), A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home, International Journal of Assistive Robotics and Mechatronics, Vol. 9, No. 4, pp. 20-34.
Chen D., Yang J., and Wactlar, H.D., (2004), Towards automatic analysis of social interaction patterns in a nursing home environment from video, in Proc. 6th ACM SIGMM Int. Workshop Multimedia Inf. Retrieval, pp. 283-290.
Hakeem A. and Shah, M., (2004), Ontology and Taxonomy Collaborated Framework for Meeting Classification, In Proc. Int. Conf. Pattern Recognition, pp. 219-222.
Georis B., Maziere M., Bremond F., and Thonnat M., (2004), A video interpretation platform applied to bank agency monitoring, in Proc. 2nd Workshop Intell. Distributed Surveillance System, pp. 46-50.
Hobbs J., Nevatia R., and Bolles B., (2004), An Ontology for Video Event Representation, In IEEE Workshop on Event Detection and Recognition.
Francois A.R.J., Nevatia R., Hobbs J., and Bolles R.C., (2005), VERL: An Ontology Framework for Representing and Annotating Video Events, IEEE MultiMedia, Vol. 12, No. 4, pp. 76-86.
Akdemir U., Turaga P., Chellappa, R., (2008), An ontology based approach for activity recognition from video, Proceeding of the 16th ACM international conference on Multimedia, pp. 709-712.
Yamada N., Sakamoto K., Kunito G., Isoda Y., Yamazaki K., and Tanaka S., (2007), Applying Ontology and Probabilistic Model to Human Activity Recognition from Surrounding Things, IPSJ Digital Courier, Vol. 3, pp. 506-517.
Latfi F., Lefebvre B., and Descheneaux C., (2007), Ontology-Based Management of the Telehealth Smart Home, Dedicated to Elderly in Loss of Cognitive Autonomy, CEUR Workshop Proceedings, Vol. 258, (online) available: http://ftp.informatik.rwthaachen. de/Publications/CEUR-WS/Vol-258/paper42.pdf.
Michael K., Schmidt A., and Lauer R., (2007), Ontology-Centred Design of an Ambient Middleware for Assisted Living: The Case of SOPRANO, In Proc. of the 30th Annual German Conference on Artificial Intelligence.
Chen L., Nugent C.D., Mulvenna M., Finlay D., and Hong X., (2009), Semantic Smart Homes: Towards Knowledge Rich Assisted Living Environments, Studies in Computational Intelligence, Vol. 189, pp. 279-296.
James A.B., (2008), Activities of daily living and instrumental activities of daily living, In: Crepeau EB, Cohn ES, Schell BB, editors. Willard and Spackman’s Occupational Therapy. Philadelphia: Lippincott, Williams and Wilkins, pp. 538-578.
WHO, World Health Organization, International classification of functioning, disability and health (ICF), http://www.who.int/classifications/icf/en/
Wyatt D., Philipose, M., and Choudhury T., (2005), Unsupervised activity recognition using automatically mined common sense, in: Proc. of AAAI 2005.
Tapia M.E., Choudhury T., and Philipose M., (2006), Building Reliable Activity Models using Hierarchical Shrinkage and Mined Ontology, Proceedings of the 4th International Conference on Pervasive Computing, pp. 17-32.
OWL and RDF specifications, http://www.w3.org/
Horrocks I., Sattler U., and Tobies S., (1999), Practical reasoning for expressive description logics, Lecture Notes in Artificial Intelligence, No. 1705, pp. 161-180.
Wu T.Y., Lian C.C., and Hsu J.Y., Joint recognition of multiple concurrent activities using factorial conditional random fields, in: Proc. AAAIWorkshop Plan, Activity, and Intent Recognition, California, 2007.
Hu D.H. and Yang Q., Cigar: concurrent and interleaving goal and activity recognition, in: Proc. AAAI, Chicago, Illinois, USA, 2008.
Modayil J., Bai T., Kautz H., Improving the recognition of interleaved activities, Proceedings of the 10th international conference on Ubiquitous computing, UbiComp; Vol. 344, pp. 40-43, 2008.
Gu T.,Wu Z., Tao X.P., Pung H.K., and Lu J., epSICAR: An Emerging Patterns based Approach to Sequential, Interleaved and Concurrent Activity Recognition. In Proc. of the 7th Annual IEEE International Conference on Pervasive Computing and Communications (Percom ‘09), pp. 1-9, 2009.
Gong S. and Xiang T., Recognition of group activities using dynamic probabilistic networks, in: Proc.of ICCV 2003, Nice, France, 2003, pp. 742–749.
Nguyen N., Bui H., and Venkatesh S., Recognising behaviour of multpile people with hierarchical probabilistic and statistical data association, in: Proc of the 17th British Machine Vision Conference (BMVC 2006), Edinburgh, Scotland, 2006.
Oliver N., Rosario B., and Pentland A., A bayesian computer vision system for modeling human interactions, in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, 2000, pp. 831–843.
Choudhury T. and Basu S., Modeling conversational dynamics as a mixedmemory markov process, in: Advances in Neural Information Processing Systems 17, MIT Press, Cambridge, MA, 2005, pp. 281–288.
Oliver N., Gargb A., and Horvitz E., Layered representations for learning and inferring office activity from multiple sensory channels, in: Computer Vision and Image Understanding, November 2004, pp. 163–180.
Du Y., Chen F., Xu W., and Li Y., Recognizing interaction activities using dynamic bayesian network, in: Proc. of ICPR 2006, Hong Kong, China, 2006.
Wyatt D., Choudhury T., Bilmes J., and Kautz H., A privacy sensitive approach to modeling multi-person conversations, in: Proc. IJCAI, India, 2007.
Lian, C. and Hsu, J., Chatting activity recognition in social occasions using factorial conditional random fields with iterative classification, in: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (2008), Chicago, Illinois, 2008.
Lin Z. and Fu L., Multi-user preference model and service provision in a smart home environment, in: Proc. of IEEE International Conference on Automation Science and Engineering (CASE 2007), 2007.
Wang L., Gu T., Tao X., and Lu J., Sensor-Based Human Activity Recognition in a Multi-user Scenario, AmI 2009, LNCS 5859, pp. 78–87, 2009.
Singla G., Cook D., and Schmitter-Edgecombe M., Recognizing independent and joint activities among multiple residents in smart environments. Ambient Intelligence and Humanized Computing Journal, 1(1):57–63, 2010.
Nugent C.D., Finlay D.D., Davies R., Wang H.Y., Zheng H., Hallberg J., Synnes K., and Mulvenna M.D., homeML - An open standard for the exchange of data within smart environments, Proceedings of 5th International Conference on Smart homes and health Telematics, Lecture Notes in Computer Science (Vol. 4541), pp. 121–129, 2007.
Chen L. and Nugent C.D., (2009), Semantic Data Management for Situation-aware Assistance in Ambient Assisted Living, the proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services (iiWAS2009), ACM ISBN 978-1- 60558-660-1, pp. 296–303.
Biswas, J., Tolstikov, A., Phyo Wai, A., Baumgarten, M., Nugent, C., Chen, L., Donnelly, M., Replicating Sensor Environments for Ambient Assisted Living: A Step Towards Scaled Deployment, accepted for International Conference on Smart homes and health Telematics (ICOST2010), 2010.
Chen L., Nugent C.D., (2009), Ontology-based activity recognition in intelligent pervasive environments, International Journal of Web Information Systems, Vol. 5, No. 4, pp. 410–430.
Patel S., Lorincz K., Hughes R., Huggins N., Bonato, Monitoring Motor Fluctuations in Patients With Parkinson’s Disease Using Wearable Sensors, IEEE Transaction on Information Technologies in Biomedicine, Vol. 13, No. 6, Nov. 2009.
Patel S.N., Reynolds M.S., and Abowd G.D., Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing. Proc. of the 6th International Conference on Pervasive Computing (Pervasive 2008), pp. 1–18, Sydney, Australia, 2008.
Fogarty J., Au C., and Hudson S.E., Sensing from the Basement: A Feasibility Study of Unobtrusive and Low-Cost Home Activity Recognition, UIST’06, 91–100.
Yin J., Yang Q., and Pan J., Sensor-based abnormal human-activity detection. IEEE Trans. Knowl. Data Eng., 20(8):1082–1090, 2008.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Atlantis Press
About this chapter
Cite this chapter
Chen, L., Khalil, I. (2011). Activity Recognition: Approaches, Practices and Trends. In: Chen, L., Nugent, C., Biswas, J., Hoey, J. (eds) Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, vol 4. Atlantis Press. https://doi.org/10.2991/978-94-91216-05-3_1
Download citation
DOI: https://doi.org/10.2991/978-94-91216-05-3_1
Published:
Publisher Name: Atlantis Press
Print ISBN: 978-90-78677-42-0
Online ISBN: 978-94-91216-05-3
eBook Packages: Computer ScienceComputer Science (R0)