Alan Lindsay
ABSTRACT
Social robotics has recently focused on developing AI agents that recognise and respond to human emotions. The use of plan-based approaches is promising, especially in domains where collecting data in advance is challenging (e.g., medical domains). We have designed and developed a system that implements a social robot to help children cope with painful and distressing medical procedures in a clinical setting. Our approach uses automated planning as a core component for action selection in order to generate plans that include physical, sensory, and social actions for the robot to use when interacting with humans. A key capability of our system is that the robot’s behaviour adapts based on the affective state of the child patient. The robot must operate in a challenging physical and social environment where appropriate and safe interaction with children, parents/caregivers, and healthcare professionals is crucial. In this paper, we present our system, examine some of the key challenges of the scenario, and describe how they are addressed by our system. We provide an overview of some of the lab-based trials that we have conducted. The system is currently undergoing usability studies at two hospitals, with the intention of moving onto clinical trials.
- Carole Adam, Wafa Johal, Damien Pellier, Humbert Fiorino, and Sylvie Pesty. 2016. Social Human-Robot Interaction: A New Cognitive and Affective Interaction-Oriented Architecture. In Social Robotics, Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He (Eds.). Springer International Publishing, Cham, 253–263.Google Scholar
- S Ali, R Manaloor, K Ma, M Sivakumar, B Vandermeer, T Beran, S Scott, T Graham, S Curtis, H Jou, 2019. LO63: humanoid robot-based distraction to reduce pain and distress during venipuncture in the pediatric emergency department: a randomized controlled trial. Canadian Journal of Emergency Medicine (2019).Google Scholar
- Aida Amirova, Nazerke Rakhymbayeva, Elmira Yadollahi, Anara Sandygulova, and Wafa Johal. 2021. 10 Years of Human-NAO Interaction Research: A Scoping Review. Frontiers in Robotics and AI 8 (11 2021).Google Scholar
- Tadas Baltrusaitis, Amir Zadeh, Yao Chong Lim, and Louis Philippe Morency. 2018. OpenFace 2.0: Facial behavior analysis toolkit. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 (2018), 59–66. https://doi.org/10.1109/FG.2018.00019Google ScholarDigital Library
- Christine T Chambers, Anna Taddio, Lindsay S Uman, C Meghan McMurtry, and HELPinKIDS Team. 2009. Psychological interventions for reducing pain and distress during routine childhood immunizations: a systematic review. Clinical therapeutics 31 (2009), S77–S103.Google ScholarCross Ref
- Meia Chita-Tegmark and Matthias Scheutz. 2021. Assistive Robots for the Social Management of Health: A Framework for Robot Design and Human–Robot Interaction Research. International Journal of Social Robotics 13 (4 2021), 197–217. Issue 2. https://doi.org/10.1007/s12369-020-00634-zGoogle ScholarCross Ref
- Julia Dawe, Craig Sutherland, Alex Barco, and Elizabeth Broadbent. 2019. Can social robots help children in healthcare contexts? A scoping review. BMJ Paediatrics Open 3, 1 (2019), e000371. https://doi.org/10.1136/bmjpo-2018-000371Google ScholarCross Ref
- Jiankang Deng, Jia Guo, Yuxiang Zhou, Jinke Yu, Irene Kotsia, and Stefanos Zafeiriou. 2019. RetinaFace: Single-stage Dense Face Localisation in the Wild. https://doi.org/10.48550/ARXIV.1905.00641Google ScholarCross Ref
- D. Feil-Seifer and M.J. Mataric. 2005. Socially Assistive Robotics. In Proceedings of the International Conference on Rehabilitation Robotics.Google Scholar
- Mary Ellen Foster, Samina Ali, Sasha Litwin, Jennifer Parker, Ronald P. A. Petrick, David Harris Smith, Jennifer Stinson, and Frauke Zeller. 2020. Using AI-Enhanced Social Robots to Improve Children’s Healthcare Experiences. In Social Robotics.Google Scholar
- Mary Ellen Foster, Patricia Candelaria, Lauren J. Dwyer, Summer Hudson, Alan Lindsay, Fareha Nishat, Mykelle Pacquing, Ronald P. A. Petrick, Andrés Alberto Ramírez-Duque, Jennifer Stinson, Frauke Zeller, and Samina Ali. 2023. Co-Design of a Social Robot for Distraction in the Paediatric Emergency Department. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (Stockholm, Sweden) (HRI ’23). Association for Computing Machinery, New York, NY, USA, 461–465. https://doi.org/10.1145/3568294.3580127Google ScholarDigital Library
- Maria Fox, Derek Long, and Daniele Magazzeni. 2017. Explainable planning. arXiv preprint arXiv:1709.10256 (2017).Google Scholar
- Pablo Gomez Esteban, Paul E Baxter, Tony Belpaeme, Erik Billing, Haibin Cai, Hoang-Long Cao, Mark Coeckelbergh, Cristina Costescu, Daniel David, Albert De Beir, Yinfeng Fang, Zhaojie Ju, James Kennedy, 2017. How to Build a Supervised Autonomous System for Robot-Enhanced Therapy for Children with Autism Spectrum Disorder. Paladyn Journal of Behavioral Robotics 8, 1 (2017), 18–38. https://doi.org/10.1515/pjbr-2017-0002Google ScholarCross Ref
- Xiaojie Guo, Siyuan Li, Jinke Yu, Jiawan Zhang, Jiayi Ma, Lin Ma, Wei Liu, and Haibin Ling. 2019. PFLD: A Practical Facial Landmark Detector. https://doi.org/10.48550/ARXIV.1902.10859Google ScholarCross Ref
- Anna Henschel, Guy Laban, and Emily S. Cross. 2021. What Makes a Robot Social? A Review of Social Robots from Science Fiction to a Home or Hospital Near You. Current Robotics Reports 2 (3 2021), 9–19. Issue 1. https://doi.org/10.1007/s43154-020-00035-0Google ScholarCross Ref
- Lindsay A. Jibb, Kathryn A. Birnie, Paul C. Nathan, Tanya N. Beran, Vanessa Hum, J. Charles Victor, and Jennifer N. Stinson. 2018. Using the MEDiPORT humanoid robot to reduce procedural pain and distress in children with cancer: A pilot randomized controlled trial. Pediatric Blood & Cancer 65, 9 (2018), e27242. https://doi.org/10.1002/pbc.27242Google ScholarCross Ref
- Wafa Johal. 2020. Research Trends in Social Robots for Learning. Current Robotics Reports 1 (9 2020), 75–83. Issue 3. https://doi.org/10.1007/s43154-020-00008-3Google ScholarCross Ref
- Filippos Kominis and Hector Geffner. 2017. Multiagent online planning with nested beliefs and dialogue. In Proceedings of the International Conference on Automated Planning and Scheduling.Google ScholarCross Ref
- Mike E.U. Ligthart, Mark A. Neerincx, and Koen V. Hindriks. 2022. Memory-Based Personalization for Fostering a Long-Term Child-Robot Relationship. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction(HRI ’22). 80–89. https://doi.org/10.5555/3523760.3523775Google ScholarDigital Library
- Alan Lindsay. 2023. On Using Action Inheritance and Modularity in PDDL Domain Modelling. In Proceedings of the International Conference on Automated Planning and Scheduling.Google ScholarDigital Library
- Alan Lindsay, Andrés Alberto Ramírez-Duque, Ronald P. A. Petrick, and Mary Ellen. Foster. 2022. A Socially Assistive Robot using Automated Planning in a Paediatric Clinical Setting. In Proceedings of the AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction (AI-HRI).Google Scholar
- Clara J Moerman, Loek van der Heide, and Marcel Heerink. 2018. Social robots to support children’s well-being under medical treatment: A systematic state-of-the-art review. Journal of Child Health Care 23 (Nov 2018), 596–612. https://doi.org/10.1177/1367493518803031Google ScholarCross Ref
- Christian Muise, Sheila McIlraith, and Christopher Beck. 2012. Improved non-deterministic planning by exploiting state relevance. In Proceedings of the International Conference on Automated Planning and Scheduling. 172–180.Google ScholarCross Ref
- NVIDIA. 2022. NVIDIA DeepStream SDK. https://developer.nvidia.com/deepstream-sdkGoogle Scholar
- Ioannis Papaioannou, Christian Dondrup, and Oliver Lemon. 2018. Human-robot interaction requires more than slot filling-multi-threaded dialogue for collaborative tasks and social conversation. In FAIM/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction. 61–64.Google ScholarCross Ref
- Paola Pennisi, Alessandro Tonacci, Gennaro Tartarisco, Lucia Billeci, Liliana Ruta, Sebastiano Gangemi, and Giovanni Pioggia. 2016. Autism and social robotics: A systematic review. Autism Research (2016).Google Scholar
- Ronald Petrick and Mary Ellen Foster. 2020. Knowledge engineering and planning for social human–robot interaction: A case study. In Knowledge Engineering Tools and Techniques for AI Planning.Google Scholar
- Ronald PA Petrick and Mary Ellen Foster. 2013. Planning for Social Interaction in a Robot Bartender Domain.. In Proceedings of the International Conference on Automated Planning and Scheduling.Google ScholarCross Ref
- Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y Ng. 2009. ROS: an open-source Robot Operating System. In ICRA Workshop on Open Source Software.Google Scholar
- Silvia Rossi, Marwa Larafa, and Martina Ruocco. 2020. Emotional and Behavioural Distraction by a Social Robot for Children Anxiety Reduction During Vaccination. International Journal of Social Robotics 12, 3 (Jan 2020), 765–777. https://doi.org/10.1007/s12369-019-00616-wGoogle ScholarCross Ref
- Valerio Sanelli, Michael Cashmore, Daniele Magazzeni, and Luca Iocchi. 2017. Short-Term Human-Robot Interaction through Conditional Planning and Execution. In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS). 540–548.Google ScholarCross Ref
- Brian Scassellati, Laura Boccanfuso, Chien-Ming Huang, Marilena Mademtzi, Meiying Qin, Nicole Salomons, Pamela Ventola, and Frederick Shic. 2018. Improving social skills in children with ASD using a long-term, in-home social robot. Science Robotics 3, 21 (2018), eaat7544.Google Scholar
- Matthijs H. J. Smakman, Koen Smit, Lotte Buser, Tom Monshouwer, Nigel van Putten, Thymen Trip, Coen Schoof, Daniel F. Preciado, Elly A. Konijn, Esther M. van der Roest, and Wouter M. Tiel Groenestege. 2021. Mitigating Children’s Pain and Anxiety during Blood Draw Using Social Robots. Electronics 10, 10 (May 2021), 1211. https://doi.org/10.3390/electronics10101211Google ScholarCross Ref
- Bonnie J Stevens, Laura K Abbott, Janet Yamada, Denise Harrison, Jennifer Stinson, Anna Taddio, Melanie Barwick, Margot Latimer, Shannon D Scott, Judith Rashotte, 2011. Epidemiology and management of painful procedures in children in Canadian hospitals. Cmaj (2011).Google Scholar
- Adriana Tapus, Cristian Tapus, and Maja J Mataric. 2009. The use of socially assistive robots in the design of intelligent cognitive therapies for people with dementia. In Proceedings of the IEEE International Conference on Rehabilitation Robotics.Google ScholarCross Ref
- Margaret J Trost, Grace Chrysilla, Jeffrey I Gold, and Maja Matarić. 2020. Socially-Assistive Robots Using Empathy to Reduce Pain and Distress during Peripheral IV Placement in Children. Pain research & management (2020).Google Scholar
- Margaret J Trost, Adam R Ford, Lynn Kysh, Jeffrey I Gold, and Maja Matarić. 2019. Socially assistive robots for helping pediatric distress and pain: a review of current evidence and recommendations for future research and practice. The Clinical journal of pain (2019).Google ScholarCross Ref
- K. Wada, T. Shibata, T. Saito, and K. Tanie. 2004. Effects of robot-assisted activity for elderly people and nurses at a day service center. Proc. IEEE (2004).Google Scholar
- Jules Waldhart, Mamoun Gharbi, and Rachid Alami. 2016. A novel software combining task and motion planning for human-robot interaction. In 2016 AAAI Fall Symposium Series.Google Scholar
- Jun Wang, Yinglu Liu, Yinglu Hu, Hailin Shi, and Tao Mei. 2021. FaceX-Zoo: A PyTorch Toolbox for Face Recognition. Proceedings of the 29th ACM international conference on Multimedia.Google ScholarDigital Library
Index Terms
- A Socially Assistive Robot using Automated Planning in a Paediatric Clinical Setting
Recommendations
Using AI Planning for Managing Affective States in Social Robotics
HRI '24: Companion of the 2024 ACM/IEEE International Conference on Human-Robot InteractionSocial robotics has recently focused on developing AI agents that recognise and respond to human emotions. The use of plan-based approaches is promising, especially in domains where collecting data in advance is challenging (e.g., medical domains). ...
Designing a socially assistive robot for pediatric care
IDC '15: Proceedings of the 14th International Conference on Interaction Design and ChildrenWe present the design of the Huggable robot that can playfully interact with children and provide socio-emotional support for them in pediatric care context. Our design takes into consideration that many young patients are nervous, intimidated, and are ...
Perceptions of Cognitive and Affective Empathetic Statements by Socially Assistive Robots
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot InteractionCommunicating empathy is important for building relationships in numerous contexts. Consequently, the failure of robots to be perceived as empathetic by human users could be detrimental to developing effective human-robot interaction. Work on ...
Comments