Skip to main content
SpringerLink
Log in

A Virtual Assistive Companion for Older Adults: Design Implications for a Real-World Application

  • Conference paper
  • First Online:
Proceedings of SAI Intelligent Systems Conference (IntelliSys) 2016 (IntelliSys 2016)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 15))

Included in the following conference series:

Abstract

Socially intelligent virtual agents are a promising solution to the increasing challenges of eldercare. This article describes an autonomous conversational agent system, simulating human-like affective behaviour to act as a daily life companion for older adults living at home. We present results from a user-centred design study that informed the design of the companion. The interaction with the user is based on a multimodal interface including automatic speech recognition, text-to-speech, and a graphical touch-based user interface. The companion offers support to older adults by locating objects, offering reminders, and guidance with household activities. It also supports emergency detection and handling. We present the companion’s architecture and key components as well as the affective interaction paradigm and its implementation in the multimodal user interface. We conducted an exploratory evaluation study where the companion was introduced in 20 homes of older adults (aged 65+) in two EU countries. For a total duration of 12 weeks, various scenarios were tested, covering different types of interactions and tasks that occur in daily life. Qualitative and quantitative data on acceptance, perceived usability, and usefulness yield rich information on how agents perform in real-world settings and which factors influence their success in this context. We reflect on the results of the evaluation study in terms of lessons learned and discuss future opportunities for fellow researchers who are striving to bring virtual agents out of the laboratories into successful real world applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bickmore, T.W., Schulman, D., Sidner, C.L.: A reusable framework for health counseling dialogue systems based on a behavioral medicine ontology. J. Biomed. Inform. 44(2), 183–197 (2011)

    Article  Google Scholar 

  2. Bickmore, T., Gruber, A., Picard, R.W.: Establishing the computer-patient working alliance in automated health behavior change interventions. Patient Educ. Couns. 59(1), 21–30 (2005)

    Article  Google Scholar 

  3. Lisetti, C., Yasavur, U., de Leon, C., Amini, R., Rishe, N., Visser, U.: Building an on-demand avatar-based health intervention for behavior change. In: Proceedings of the Twenty-Fifth International Florida Intelligence Research Society Conference, pp. 175–180 (2012)

    Google Scholar 

  4. de Rosis, F., Novielli, N., Carofiglio, V., Cavalluzzi, A., De Carolis, B.: User modeling and adaptation in health promotion dialogs with an animated character. J. Biomed. Inform. 39(5), 514–531 (2006)

    Article  Google Scholar 

  5. Schulman, D.: Embodied Agents for Long-Term Interaction. Northeastern University, Boston (2013)

    Google Scholar 

  6. Bickmore, T.W., Picard, R.W.: Establishing and maintaining long-term human-computer relationships. ACM Trans. Comput. Hum. Interact. 12, 293–327 (2005)

    Article  Google Scholar 

  7. Bickmore, T.W.: Relational agents: effecting change through human-computer relationships. Massachusetts Institute of Technology (2003)

    Google Scholar 

  8. Cassell, J.: More than just another pretty face: embodied conversational interface agents. Commun. ACM 43, 70–78 (2000)

    Article  Google Scholar 

  9. Kramer, M., Yaghoubzadeh, R., Kopp, S., Pitsch, K.: A conversational virtual human as autonomous assistant for elderly and cognitively impaired users? Social acceptability and design considerations. In: Lecture Notes in Informatics (2013)

    Google Scholar 

  10. Yaghoubzadeh, R., Kramer, M., Pitsch, K., Kopp, S.: Virtual agents as daily assistants for elderly or cognitively impaired people. In: Proceedings of the 13th International Conference Intelligent Virtual Agents, vol. 8108, p. 91 (2013)

    Google Scholar 

  11. Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, results and implications. In: Proceedings of CHI 1999 Extended Abstracts on Human Factors in Computing Systems, p. 242 (1999)

    Google Scholar 

  12. Nijholt, A.: Disappearing computers, social actors and embodied agents. In: Proceedings of the International Conference on Cyberworlds, pp. 128–134 (2003)

    Google Scholar 

  13. Kelley, J.F.: An iterative design methodology for user-friendly natural language office information applications. ACM Trans. Inf. Syst. 2(1), 26–41 (1984)

    Article  Google Scholar 

  14. Vardoulakis, L.P., Ring, L., Barry, B., Sidner, C.L., Bickmore, T.: Designing relational agents as long term social companions for older adults. In: Proceedings of the 12th International Conference on Intelligent Virtual Agents, vol. 7502, pp. 289–302 (2012)

    Google Scholar 

  15. Sakai, Y., Nonaka, Y., Yasuda, K., Nakano, Y.I.: Listener agent for elderly people with dementia. In: 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 199–200 (2012)

    Google Scholar 

  16. Ring, L., Barry, B., Totzke, K., Bickmore, T.: Addressing loneliness and isolation in older adults. In: Affective Computing and Intelligent Intreraction (2013)

    Google Scholar 

  17. Bickmore, T.W., Silliman, R.A., Nelson, K., Cheng, D.M., Winter, M., Henault, L., Paasche-Orlow, M.K.: A randomized controlled trial of an automated exercise coach for older adults. J. Am. Geriatr. Soc. 61(10), 1676–1683 (2013)

    Article  Google Scholar 

  18. Bickmore, T.W., Caruso, L., Clough-Gorr, K., Heeren, T.: ‘It’s just like you talk to a friend’ relational agents for older adults. Interact. Comput. 17(6), 711–735 (2005)

    Article  Google Scholar 

  19. Campbell, R.H., Grimshaw, M.N., Green, G.M.: Relational agents: a critical review. Open Virtual Real. J. 1(1), 1–7 (2009)

    Article  Google Scholar 

  20. Kasap, Z., Ben Moussa, M., Chaudhuri, P., Magnenat-Thalmann, N.: Making them remember—emotional virtual characters with memory. IEEE Comput. Graph. Appl. 29(2), 20–29 (2009)

    Article  Google Scholar 

  21. Kasap, Z., Magnenat-Thalmann, N.: Building long-term relationships with virtual and robotic characters: the role of remembering. Vis. Comput. 28(1), 87–97 (2012)

    Article  Google Scholar 

  22. Ring, L., Shi, L., Totzke, K., Bickmore, T.: Social support agents for older adults: longitudinal affective computing in the home. J. Multimodal User Interfaces 9, 79–88 (2015)

    Article  Google Scholar 

  23. Tsiourti, C., Ben Moussa, M., Joly, E., Wings, C., Wac, K.: Virtual assistive companions for older adults: qualitative field study and design implications. In: Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (2014)

    Google Scholar 

  24. Cassell, J., Bickmore, T., Campbell, L., Vilhjálmsson, H., Yan, H.: Human conversation as a system framework: designing embodied conversational agents, pp. 29–63 (2001)

    Google Scholar 

  25. Khoshhal, K., Aliakbarpour, H., Quintas, J., Drews, P., Dias, J.: Probabilistic LMA-based classification of human behaviour understanding using power spectrum technique. In: Proceedings of the 2010 13th International Conference Information Fusion, pp. 1–7 (2010)

    Google Scholar 

  26. Den Uyl, M.J., Van Kuilenburg, H.: The FaceReader: Online facial expression recognition. In: Proceedings of measuring behavior. pp. 589–590 (2005)

    Google Scholar 

  27. Van Kuilenburg, H., Wiering, M., Den Uyl, M.: A model based method for automatic facial expression recognition. In: Proceedings of the 16th European Conference on Machine Learning. pp. 194–205. Springer, Heidelberg (2005)

    Google Scholar 

  28. Ekman, P., Keltner, D.: Universal facial expressions of emotion. Calif. Ment. Health Res. Dig. 8(4), 151–158 (1970)

    Google Scholar 

  29. Aldoma, A., Tombari, F., Di Stefano, L., Vincze, M.: A global hypotheses verification method for 3D object recognition. In: ECCV, pp. 511–524 (2012)

    Google Scholar 

  30. Rusu, R.B., Cousins, S.: 3D is here: point cloud library. In: IEEE International Conference on Robotics and Automation, pp. 1–4 (2011)

    Google Scholar 

  31. Verberne, F.M.F., Ham, J., Ponnada, A., Midden, C.J.H.: Trusting digital chameleons: the effect of mimicry by a virtual social agent on user trust. In: Berkovsky, S., Freyne, J. (eds.) Persuasive Technology, vol. 7822, pp. 234–245. Springer, Berlin (2013)

    Chapter  Google Scholar 

  32. Austin, J.T., Vancouver, J.B.: Goal constructs in psychology: structure, process, and content. Psychol. Bull. 120(3), 338–375 (1996)

    Article  Google Scholar 

  33. Traum, D., Larsson, S.: The information state approach to dialogue management. In: Current and New Directions in Discourse and Dialogue, pp. 325–353 (2003)

    Google Scholar 

  34. Ben Moussa, M., Magnenat-Thalmann, N.: Toward socially responsible agents: integrating attachment and learning in emotional decision-making. Comput. Anim. Virtual Worlds 24(3–4), 327–334 (2013)

    Article  Google Scholar 

  35. Roseman, I.J.: Appraisal in the emotion system: coherence in strategies for coping. Emot. Rev. 5(2), 141–149 (2013)

    Article  Google Scholar 

  36. Scherer, K.R.: Emotions are emergent processes: they require a dynamic computational architecture. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364(1535), 3459–3474 (2009)

    Article  Google Scholar 

  37. Colby, B.N., Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Contemp. Sociol. 18(6), 957 (1989)

    Article  Google Scholar 

  38. SmartBody. http://smartbody.ict.usc.edu/

  39. T.W. Group: Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL Group. Psychol. Med. 28(3), 551–558 (1998)

    Article  Google Scholar 

  40. Brooke, J.: SUS: a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  41. Lewis, C.: Using the “Thinking Aloud” Method in Cognitive Interface Design. IBM T.J. Watson Research Center, Yorktown Heights (1982)

    Google Scholar 

  42. Wölfel, M., McDonough, J.: Distant Speech Recognition. Wiley, Hoboken (2009)

    Book  Google Scholar 

  43. Lim, M.Y.: Memory models for intelligent social companions. In: Human-Computer Interaction: The Agency Perspective, pp. 241–262. Springer (2012)

    Google Scholar 

Download references

Acknowledgment

This work was supported by the European research projects Miraculous Life (Grant No. 616421) and CaMeLi (Grant No. 010000-2012-16). We express our gratitude to all the study participants.

Author information

Authors and Affiliations

  1. Institute of Services Science, University of Geneva, Geneva, Switzerland

    Christiana Tsiourti, Maher Ben Moussa & Dimitri Konstantas

  2. Laboratory of Automatics and Systems, Instituto Pedro Nunes, Coimbra, Portugal

    João Quintas

  3. Noldus Information Technology, Wageningen, The Netherlands

    Ben Loke

  4. Zuyderland Medisch Centrum, Sittard, The Netherlands

    Inge Jochem

  5. Association Valorisation Vieillissement (VIVA), Petit-Lancy, Switzerland

    Joana Albuquerque Lopes

Authors
  1. Christiana Tsiourti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maher Ben Moussa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. João Quintas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ben Loke
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Inge Jochem
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joana Albuquerque Lopes
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Dimitri Konstantas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christiana Tsiourti .

Editor information

Editors and Affiliations

  1. Faculty of Computing and Engineering, School of Computing and Mathematics, University of Ulster at Jordanstown, Newtownabbey, United Kingdom

    Yaxin Bi

  2. The Science and Information (SAI) Organization, Bradford, West Yorkshire, United Kingdom

    Supriya Kapoor

  3. The Science and Information (SAI) Organization, Bradford, West Yorkshire, United Kingdom

    Rahul Bhatia

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Tsiourti, C. et al. (2018). A Virtual Assistive Companion for Older Adults: Design Implications for a Real-World Application. In: Bi, Y., Kapoor, S., Bhatia, R. (eds) Proceedings of SAI Intelligent Systems Conference (IntelliSys) 2016. IntelliSys 2016. Lecture Notes in Networks and Systems, vol 15. Springer, Cham. https://doi.org/10.1007/978-3-319-56994-9_69

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56994-9_69

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56993-2

  • Online ISBN: 978-3-319-56994-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation