skip to main content
research-article

Toward an Understanding of Trust Repair in Human-Robot Interaction: Current Research and Future Directions

Published:16 November 2018Publication History
Skip Abstract Section

Abstract

Gone are the days of robots solely operating in isolation, without direct interaction with people. Rather, robots are increasingly being deployed in environments and roles that require complex social interaction with humans. The implementation of human-robot teams continues to increase as technology develops in tandem with the state of human-robot interaction (HRI) research. Trust, a major component of human interaction, is an important facet of HRI. However, the ideas of trust repair and trust violations are understudied in the HRI literature. Trust repair is the activity of rebuilding trust after one party breaks the trust of another. These trust breaks are referred to as trust violations. Just as with humans, trust violations with robots are inevitable; as a result, a clear understanding of the process of HRI trust repair must be developed in order to ensure that a human-robot team can continue to perform well after a trust violation. Previous research on human-automation trust and human-human trust can serve as starting places for exploring trust repair in HRI. Although existing models of human-automation and human-human trust are helpful, they do not account for some of the complexities of building and maintaining trust in unique relationships between humans and robots. The purpose of this article is to provide a foundation for exploring human-robot trust repair by drawing upon prior work in the human-robot, human-automation, and human-human trust literature, concluding with recommendations for advancing this body of work.

References

  1. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There's software used across the country to predict future criminals. And It's Biased Against Blacks. (May 2016). Retrieved Nov 15th, 2016 from https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing.Google ScholarGoogle Scholar
  2. Ronald C. Arkin, Patrick Ulam, and Alan R. Wagner. 2012. Moral decision making in autonomous systems: Enforcement, moral emotions, dignity, trust, and deception. Proc. IEEE. 100 (2012), 571--589.Google ScholarGoogle ScholarCross RefCross Ref
  3. Kenneth Arrow. 1974. The Limits of Organization. Norton, New York.Google ScholarGoogle Scholar
  4. Wilma A. Bainbridge, Justin Hart, Elizabeth S. Kim, and Brian Scassellati. 2008. The effect of presence on human-robot interaction. In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication. IEEE, Piscataway, NJ, 701--706.Google ScholarGoogle ScholarCross RefCross Ref
  5. Wilma A. Bainbridge, Shunichi Nozawa, Ryohei Ueda, Kei Okada, and Masayuki Inaba. 2011. Robot sensor data as a means to measure human reactions to an interaction. In 2011 11th International Conference on Humanoid Robots (IEEE-RAS), 452--457.Google ScholarGoogle ScholarCross RefCross Ref
  6. Bernard Barber. 1983. The Logic and Limits of Trust. Rutgers University Press, New Brunswick, NJ.Google ScholarGoogle Scholar
  7. Christoph Bartneck, Tomohiro Suzuki, Takayuki Kanda, and Tatsuya Nomura. 2007. The influence of people's culture and prior experiences with Aibo on their attitude towards robots. AI 8 Society, 21(1-2). 217--230. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Deborah Billings, Kristin E. Schaefer, Jessie Y. C. Chen, and Peter A. Hancock. 2012. Human-robot interaction: Developing trust in robots. In Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 109--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Michael W. Boyce, Jessie Y. C. Chen, and Anthony R. Selkowitz. 2015. Effects of agent transparency on operator trust. In Proceedings of the 10th Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts, ACM, New York, NY, 179--180. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Maja Hojer Bruun, Signe Hanghøj, and Cathrine Hasse. 2015. Studying social robots in practiced places. Techné: Research in Philosophy and Technology.Google ScholarGoogle Scholar
  11. Janis A. Cannon-Bowers and Clint Bowers. 2011. Team development and functioning. In APA Handbook of Industrial and Organizational Psychology, Vol 1: Building and Developing the Organization. APA Handbooks in Psychology. American Psychological Association, Washington, DC, 597--650.Google ScholarGoogle Scholar
  12. Justine Cassell. 2000. Embodied Conversational Agents. MIT Press, Cambridge, MA.Google ScholarGoogle Scholar
  13. Janne Chung and Gary S. Monroe. 2003. Exploring social desirability bias. Journal of Business Ethics 44, 4 (June 2003), 291--302.Google ScholarGoogle ScholarCross RefCross Ref
  14. Mark Coeckelbergh. 2012. Can we trust robots? Ethics Inf. Technol. 14, 1 (2012), 53--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Lauri L. Couch, Jeffrey M. Adams, and Warren H. Jones. 1996. The assessment of trust orientation. Journal of Personality Assessment 67, 2 (1996), 305--323.Google ScholarGoogle ScholarCross RefCross Ref
  16. Kerstin Dautenhahn, Bernard Ogden, and Tom Quick. 2002. From embodied to socially embedded agents: Implications for interaction-aware robots. Cogn. Syst. Res. 3, 3 (2002), 397--428. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Robyn M. Dawes. 1994. House of Cards: Psychology and Psychotherapy Built on Myth. Free Press, New York, NY.Google ScholarGoogle Scholar
  18. Munjal Desai, Poornima Kaniarasu, Mikhail Medvedev, Aaron Steinfeld, and Holly Yanco. 2013. Impact of robot failures and feedback on real-time trust. In Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction. IEEE Press, Piscataway, NJ, 251--258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Munjal Desai, Mikhail Medvedev, Marynel Vázquez, Sean McSheehy, Sofia Gadea-Omelchenko, Christian Bruggeman, Aaron Steinfeld, and Holly Yanco. 2012. Effects of changing reliability on trust of robot systems. In Proceedings of the 7th Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Munjal Desai, Kristen Stubbs, Aaron Steinfeld, and Holly Yanco. 2009. Creating trustworthy robots: Lessons and inspirations from automated systems. In Proceedings of the AISB Convention: New Frontiers in Human-Robot Interaction. SSAISB, Edinburgh, Scotland.Google ScholarGoogle Scholar
  21. Pieter T. M. Desmet, David De Cremer, and Eric van Dijk. 2011. In money we trust? The use of financial compensations to repair trust in the aftermath of distributive harm. Organizational Behavior and Human Decision Processes 114, 2 (March 2011), 75--86.Google ScholarGoogle ScholarCross RefCross Ref
  22. Morton Deutsch. 1960. Trust, trustworthiness, and the F scale. The Journal of Abnormal and Social Psychology 61, 1 (1960), 138--140.Google ScholarGoogle ScholarCross RefCross Ref
  23. Ewart J. de Visser, Frank Krueger, Patrick McKnight, Steven Scheid, Melissa Smith, Stephanie Chalk, and Raja Parasuraman. 2012. The world is not enough: Trust in cognitive agents. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Washington, DC, 263--267.Google ScholarGoogle ScholarCross RefCross Ref
  24. Peter de Vries, Cees Midden, and Don Bouwhuis. 2003. The effects of errors on system trust, self-confidence, and the allocation of control in route planning. Int. J. Hum-Comput. Stud. 58, 6 (June 2003), 719--735. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mary T. Dzindolet, Scott A. Peterson, Regina A. Pomranky, Linda G. Pierce, and Hall P. Beck. 2003. The role of trust in automation reliance. Int. J. Hum-Comput. Int. 58, 6 (2003), 697--718. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Mica R. Endsley. 1995. Toward a theory of situation awareness in dynamic systems. Hum. Factors. 37, 1 (1995), 32--64.Google ScholarGoogle ScholarCross RefCross Ref
  27. Mica R. Endsley and Esin O. Kiris. 1995. The out-of-the-loop performance problem and level of control in automation. Hum. Factors. 37, 2 (1995), 381--394.Google ScholarGoogle ScholarCross RefCross Ref
  28. Nicholas Epley, Adam Waytz, and John T. Cacioppo. 2007. On seeing human: A three-factor theory of anthropomorphism. Psychol. Rev. 114, 4 (2007), 864--886.Google ScholarGoogle ScholarCross RefCross Ref
  29. David Feil-Seifer and Maja J. Mataric. 2005. Defining socially assistive robotics. In 9th International Conference on Rehabilitation Robotics. IEEE, Piscataway, NJ, 465--468.Google ScholarGoogle Scholar
  30. Eli J. Finkel, Caryl E. Rusbult, Madoka Kumashiro, and Peggy A. Hannon. 2002. Dealing with betrayal in close relationships: Does commitment promote forgiveness? J. Pers. Soc. Psychol. 82, 6 (2002), 956--974.Google ScholarGoogle ScholarCross RefCross Ref
  31. Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (woebot): A randomized controlled trial. JMIR Mhealth 4, 2 (2017).Google ScholarGoogle Scholar
  32. Terrence Fong, Illah Nourbakhsh, and Kerstin Dautenhahn. 2003a. A survey of socially interactive robots. Robot. Auton. Syst. 42, 3 (2003), 143--166.Google ScholarGoogle ScholarCross RefCross Ref
  33. Terrence Fong and Charles Thorpe. 2002. Robot as partner: Vehicle teleoperation with collaborative control. In Proceedings from the 2002 NRL Workshop on Multi-Robot Systems. Springer, Berlin, 195--202.Google ScholarGoogle ScholarCross RefCross Ref
  34. Terrence Fong, Charles Thorpe, and Charles Baur. (2003b). Collaboration, dialogue, human-robot interaction. In Springer Tracts in Advanced Robotics. Springer, Berlin, 255--266.Google ScholarGoogle Scholar
  35. Amos Freedy, Eward de Visser, Gershon Weltman, and Nicole Coeyman. 2007. Measurement of trust in human-robot collaboration. In Collaborative Technologies and Systems. IEEE, Piscataway, NJ, 106--114.Google ScholarGoogle Scholar
  36. Diego Gambetta. 1988. Trust: Making and Breaking Cooperative Relations. Basil Blackwell, Oxford, UK.Google ScholarGoogle Scholar
  37. General Data Protection Regulation. 2017. Council of the European Union 2016/95/46/EC71Google ScholarGoogle Scholar
  38. Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast, and Robin Duffy. 2007. Creating rapport with virtual agents. In Intelligent Virtual Agents. Lecture Notes in Computer Science, vol. 4722. Springer, Berlin, 125--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Victoria Groom, Vasant Srinivasan, Cindy L. Bethel, Robin Murphy, Lorin Dole, and Clifford Nass. 2011. Responses to robot social roles and social role framing. In International Conference on Collaboration Technologies and Systems (CTS'11). 194--203.Google ScholarGoogle ScholarCross RefCross Ref
  40. Jennifer Goetz, Sara Kiesler, and Aaron Powers. 2003. Matching robot appearance and behavior to tasks to improve human-robot cooperation. In 12th International Workshop on Robot and Human Interactive Communication. IEEE, Piscataway, NJ, 55--60.Google ScholarGoogle ScholarCross RefCross Ref
  41. Peter A. Hancock, Deborah R. Billings, and Kristen E. Schaefer. 2011a. Can you trust your robot? Ergon. Design. 19, 3 (2011), 24--29.Google ScholarGoogle ScholarCross RefCross Ref
  42. Peter A. Hancock, Deborah R. Billings, Kristen E. Schaefer, Jessie Y. C. Chen, Ewart de Visser, and Raja Parasuraman. 2011b. A meta-analysis of factors affecting trust in human-robot interaction. Hum. Factors. 53, 5 (2011), 517--527.Google ScholarGoogle ScholarCross RefCross Ref
  43. Peter A. Hancock, Gabriella M. Hancock, and Joel S. Warm. 2009. Individuation: The N = 1 revolution. Theor. Issues. Ergon. 10, 5 (2009), 481--488.Google ScholarGoogle ScholarCross RefCross Ref
  44. Michael P. Haselhuhn, Maurice E. Schweitzer, and Alison M. Wood. 2010. How implicit beliefs influence trust recovery. Psychological Science 21, 5 (May 2010), 645--648.Google ScholarGoogle ScholarCross RefCross Ref
  45. Marcel Heerink, Ben Krose, Vanessa Evers, and Bob Wielinga. 2006. The influence of a robot's social abilities on acceptance by elderly users. In Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN 2006).Google ScholarGoogle ScholarCross RefCross Ref
  46. Hee Rin Lee and Selma Šabanović. 2014. Culturally variable preferences for robot design and use in South Korea, Turkey, and the United States. In Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Piscataway, NJ. 17--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Rob High. 2012. The era of cognitive systems: An inside look at IBM Watson and how it works. Retrieved from: http://www.redbooks.ibm.com/redpapers/pdfs/redp4955.pdf.Google ScholarGoogle Scholar
  48. Kevin A. Hoff and Masooda Bashir. 2015. Trust in automation integrating empirical evidence on factors that influence trust. Hum. Factors. 57, 3 (2015), 407--434.Google ScholarGoogle ScholarCross RefCross Ref
  49. Robert R. Hoffman, Matthew Johnson, Jeffrey M. Bradshaw, and Al Underbrink. 2013. Trust in automation. IEEE Intel. Syst. 28, 1 (2013), 84--88. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Kaoru Inoue, Kazuyoshi Wada, and Yuko Ito. 2008. Effective application of paro: Seal type robots for disabled people in according to ideas of occupational therapists. In International Conference on Computers for Handicapped Persons. Springer, Berlin, 1321--1324. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Jiun-Yin Jian, Ann M. Bisantz, and Colin G. Drury. 2000. Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4, 1 (2000), 53--71.Google ScholarGoogle ScholarCross RefCross Ref
  52. Cynthia Johnson-George and Walter C. Swap. 1982. Measurement of specific interpersonal trust: Construction and validation of a scale to assess trust in a specific other. Journal of Personality and Social Psychology 43, 6 (1982), 1306--1317.Google ScholarGoogle ScholarCross RefCross Ref
  53. Sara Kiesler and Jennifer Goetz. 2002. Mental models of robotic assistants. In Proceedings of the 2002 CHI Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 576--577. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Peter H. Kim, Cecily D. Cooper, Kurt T. Dirks, and Donald L. Ferrin. 2013. Repairing trust with individuals vs. groups. Org. Behav. Hum. Dec. 120 (2013), 1--14.Google ScholarGoogle ScholarCross RefCross Ref
  55. Peter H. Kim, Kurt T. Dirks, Cecily D. Cooper, and Donald L. Ferrin. 2006. When more blame is better than less: The implications of internal vs. External Attributions for the Repair of Trust After a Competence vs. Integrity-Based Violation. Org. Behav. Hum. Dec. 99, 1 (2006), 49--65.Google ScholarGoogle ScholarCross RefCross Ref
  56. Peter H. Kim, Donald L. Ferrin, Cecily D. Cooper, and Kurt T. Dirks. 2004. Removing the shadow of suspicion: The effects of apology versus denial for repairing competence versus integrity-based trust violations. J. Appl. Psychol. 89, 1 (2004), 104--118.Google ScholarGoogle ScholarCross RefCross Ref
  57. Nicole Krämer, Stefan Kopp, Christian Becker-Asano, and Nicole Sommer. 2013. Smile and the world will smile with you—The effects of a virtual agent's smile on users” evaluation and behavior. Int. J. Hum-Comput. St. 71, 3 (2013), 335--349. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Katherine J. Kuchenbecker, Jamie Gewirtz, William McMahan, Dorsey Standish, Paul Martin, Jonathan Bohren, Pierre J. Mendoza, and David I. Lee. 2010. VerroTouch: High-frequency acceleration feedback for telerobotic surgery. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, Berlin, 189--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Adrienne Lafrance. 2016. What is a robot? The question is more complicated than it seems. (March 2016). Retrieved November 18th, 2016 from http://www.theatlantic.com/technology/archive/2016/03/what-is-a-human/473166/.Google ScholarGoogle Scholar
  60. Jeremy D. Larson. 2016. Letter of recommendation: Hasbro Joy for All. (March 2016). Retrieved November 18th, 2016 from http://www.nytimes.com/2016/03/27/magazine/letter-of-recommendation-hasbro-joy-for-all.html?_r=0Google ScholarGoogle Scholar
  61. John D. Lee and Neville Moray. 1992. Trust, control strategies, and allocation of function in human-machine systems. Ergonomics 35, 10 (1992), 1243--1270.Google ScholarGoogle ScholarCross RefCross Ref
  62. John D. Lee and Katrina A. See. 2004. Trust in automation: Designing for appropriate reliance. Hum. Factors. 46 (2004), 50--80.Google ScholarGoogle ScholarCross RefCross Ref
  63. Sau-lai Lee, Ive Y. M. Lau, Sara Kiesler, and Chi-Yue Chiu. 2005. Human mental models of humanoid robots. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. IEEE, Piscataway, NJ, 2767--2772.Google ScholarGoogle Scholar
  64. Roy J. Lewicki and Edward C. Tomlinson. 2003. The Effects of Reputation and Post Violation Communication on Trust and Distrust. Social Science Research Network, Rochester, NY. Retrieved on June 23, 2017 from https://papers.ssrn.com/abstract=400941.Google ScholarGoogle Scholar
  65. Roy J. Lewicki. 2007. Trust, trust development, and trust repair. In The Handbook of Conflict Resolution: Theory and Practice. Jossey-Bass, San Francisco, CA, 92--119.Google ScholarGoogle Scholar
  66. Roy J. Lewicki, Daniel J. McAllister, and Robert J. Bies. 1998. Trust and distrust: New relationships and realities. Acad. Manage. Rev. 23, 3 (1998), 438--458.Google ScholarGoogle ScholarCross RefCross Ref
  67. Alexandru Litoiu, Daniel Ullman, Jason Kim, and Brian Scassellati. 2015. Evidence that robots trigger a cheating detector in humans. In Proceedings of the 10th ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 165--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Robert B. Lount, Chen-Bo Zhong, Niro Sivanathan, and J. Keith Murnighan. 2008. Getting off on the wrong foot: The timing of a breach and the restoration of trust. Personality and Social Psychology Bulletin 34, 12 (December 2008), 1601--1612.Google ScholarGoogle ScholarCross RefCross Ref
  69. Niklas Luhmann. 1979. Trust and Power. Wiley, Chichester, England.Google ScholarGoogle Scholar
  70. Maria Madsen and Shirley Gregor. 2000. Measuring human-computer trust. In 11th Australasian Conference on Information Systems. Citeseer, 6--8.Google ScholarGoogle Scholar
  71. Bertram F. Malle, Matthias Scheutz, and Joseph L. Austerweil. 2017. Networks of social and moral norms in human and robot agents. In A World with Robots. Springer International Publishing. 3--17.Google ScholarGoogle Scholar
  72. Bertram F. Malle, Matthias Scheutz, Thomas Arnold, John Voiklis, and Corey Cusimano. 2015. Sacrifice one for the good of many? People apply different moral norms to human and robot agents. In Proceedings of the 10th Annual ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 117--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Kaitlyn Marinaccio, Spencer Kohn, Raja Parasuraman, and Ewart de Visser. 2015. A framework for rebuilding trust in social automation across health-care domains. In Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care. Sage Publications, Washington, DC, 201--205.Google ScholarGoogle ScholarCross RefCross Ref
  74. Roger C. Mayer, James H. Davis, and F. David Schoorman. 1995. An integrative model of organizational trust. Acad. Manage. Rev. 20 (1995), 709--734.Google ScholarGoogle ScholarCross RefCross Ref
  75. Bill McEvily and Marco Tortoriello. 2011. Measuring trust in organisational research: Review and recommendations. Journal of Trust Research 1, 1 (April 2011), 23--63.Google ScholarGoogle ScholarCross RefCross Ref
  76. Glen D. Mellinger. 1956. Interpersonal trust as a factor in communication. The Journal of Abnormal and Social Psychology 52, 3 (1956), 304--309.Google ScholarGoogle ScholarCross RefCross Ref
  77. Debra Meyerson, Karl E. Weick, and Roderick M. Kramer. 1996. Swift trust and temporary groups. In Trust in Organizations: Frontiers of Theory and Research. Roderick M. Kramer and Tom R. Tyler (Eds.), Sage Publications, Thousand Oaks, CA, 166--195.Google ScholarGoogle Scholar
  78. Masahiro Mori, Karl F. MacDorman, and Norri Kageki. 2012. The uncanny valley. IEEE Robot. Autom. Mag. 19, 2 (2012), 98--100.Google ScholarGoogle ScholarCross RefCross Ref
  79. Robin R. Murphy. 2004. Human-robot interaction in rescue robotics. IEEE Trans. Syst. Man. Cy. C. 34, 2 (2004), 138--153. Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Illah R. Nourbakhsh, Katia Sycara, Mary Koes, Mark Yong, Michael Lewis, and Steve Burion. 2005. Human-robot teaming for search and rescue. IEEE Pervasive Comput. 4 (2005), 72--79. Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Linda Onnasch, Christopher D. Wickens, Huiyang Li, and Dietrich Manzey. 2014. Human performance consequences of stages and levels of automation: an integrated meta-analysis. Hum. Factors. 56 (2014), 476--488.Google ScholarGoogle ScholarCross RefCross Ref
  82. Scott J. Ososky. 2013. Influence of Task-Role Mental Models on Human Interpretation of Robot Motion Behavior. Ph.D. Dissertation. University of Central Florida, Orlando, FL.Google ScholarGoogle Scholar
  83. Scott J. Ososky, Tracy Sanders, Florian Jentsch, Peter Hancock, and Jessie Y. C. Chen. 2014. Determinants of system transparency and its influence on trust in and reliance on unmanned robotic systems. In SPIE Proceedings 9084. SPIE, Bellingham, Washington.Google ScholarGoogle Scholar
  84. Raja Parasuraman and Christopher A. Miller. 2004. Trust and etiquette in high-criticality automated systems. Commun. ACM, 47, 4 (2004), 51--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Raja Parasuraman, Robert Molloy, and Indramani L. Singh. 1993. Performance consequences of automation-induced complacency. Int. J. Aviat. Psychol. 3, 1 (1993), 1--23.Google ScholarGoogle ScholarCross RefCross Ref
  86. Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use, misuse, disuse, abuse. Hum. Factors. 39, 2 (1997), 230--253.Google ScholarGoogle ScholarCross RefCross Ref
  87. Tomislav Pejsa, Sean Andrist, Michael Gleicher, and Bilge Mutlu. 2015. Gaze and attention management for embodied conversational agents. ACM Trans. Interact. Intell. Syst. 5, 1 (March 2015), 3:1--3:34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Elizabeth Phillips, Kristin Schaefer, Deborah R. Billings, Florian Jentsch, and Peter A. Hancock. 2015. Human-animal teams as an analog for future human-robot teams: Influencing design and fostering trust. J. Hum. Robot. Interact. 5, 1 (2015), 100--125. Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. Helmut Prendinger and Mitsuru Ishizuka. 2013. Introducing the cast for social computing: Life-like characters. In Helmut Prendinger and Mitsuru Ishizuka (Eds.), Life-Like Characters: Tools, Affective Functions, and Applications. Springer Science 8 Business Media, 3--16.Google ScholarGoogle Scholar
  90. Tom Quick and Kerstin Dautenhahn. 1999. Making embodiment measureable. (June 1999). Retrieved November 10th, 2016 from http://supergoodtech.com/tomquick/phd/kogwis/.Google ScholarGoogle Scholar
  91. G. Jagannath Raju, George C. Verghese, and Thomas B. Sheridan. 1989. Design issues in 2-port network models of bilateral remote manipulation. In Proceedings of the 1989 IEEE International Conference on Robotics and Automation. IEEE, Piscataway, NJ: 1316--1321.Google ScholarGoogle Scholar
  92. Patrick P. L. Rau, Ye Li, and Dingjun Li. 2009. Effects of communication style and culture on ability to accept recommendations from robots. Computers in Human Behavior 25, 2 (2009), 587--595. Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. James Reason. 1990. Human Error. Cambridge University Press, Cambridge, England.Google ScholarGoogle Scholar
  94. John K. Rempel, John G. Holmes, and Mark P. Zanna. 1985. Trust in close relationships. J. Pers. Soc. Psychol. 49, 1 (1985), 95--112.Google ScholarGoogle ScholarCross RefCross Ref
  95. Paul Robinette, Ayanna M. Howard, and Alan R. Wagner. 2015. Timing is key for robot trust repair. In Proceedings of the 2015 International Conference on Social Robotics. Springer International Publishing, New York, NY, 574--583.Google ScholarGoogle Scholar
  96. Paul Robinette, Wenchen Li, Robert Allen, Ayanna M. Howard, and Alan R. Wagner. 2016. Overtrust of robots in emergency evacuation scenarios. In Proceedings of the 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2016). ACM, New York, NY, 101--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. Jennifer M. Ross, James L. Szalma, Peter A. Hancock, John S. Barnett, Grant Taylor. 2008. The effect of automation reliability on user automation trust and reliance in a search-and-rescue scenario. In Proceedings of the 2008 Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Washington, DC, 1340--1344.Google ScholarGoogle ScholarCross RefCross Ref
  98. Julian B. Rotter. 1967. A new scale for the measurement of interpersonal trust. J. Pers. 35 (1967), 651--656.Google ScholarGoogle ScholarCross RefCross Ref
  99. Denise M. Rousseau, Sim B. Sitkin, Ronald Burt, and Colin Camerer. 1998. Not so different after all: A cross-discipline view of trust. Acad. Man. Rev. 23 (1998), 393--404.Google ScholarGoogle ScholarCross RefCross Ref
  100. Ericka Rovira, Kathleen McGarry, and Raja Parasuraman. 2007. Effects of imperfect automation on decision making in a simulated command and control task. Human Factors, 49, 76--87.Google ScholarGoogle ScholarCross RefCross Ref
  101. Caryl E. Rusbult and John M. Martz. 1995. Remaining in an abusive relationship: An investment model analysis of nonvoluntary dependence. Acad. Man. Rev. 21 (1995), 558--571.Google ScholarGoogle Scholar
  102. Maha Salem and Kerstin Dautenhahn. 2015. Evaluating trust and safety in HRI: Practical issues and ethical challenges. The Emerging Policy and Ethics of Human-Robot Interaction.Google ScholarGoogle Scholar
  103. Maha Salem, Gabriella Lakatos, Farshid Amirabdollahian, and Kerstin Dautenhahn. 2015. Towards safe and trustworthy social robots: Ethical challenges and practical issues. In International Conference on Social Robotics (ICSR).Google ScholarGoogle ScholarCross RefCross Ref
  104. David Sally. 1995. Conversation and cooperation in social dilemmas: A meta-analysis of experiments from 1958 to 1992. Rationality and Society 7, 1 (January 1995), 58--92.Google ScholarGoogle ScholarCross RefCross Ref
  105. Tracy Sanders, Kristin E. Oleson, Deborah R. Billings, Jessie Y. C. Chen, and Peter A. Hancock. 2011. A model of human-robot trust: Theoretical model development. In Proceedings of the 2011 Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Washington, DC, 1432--1436.Google ScholarGoogle Scholar
  106. Jessica Sartori, Barbara D. Adams, Sonya Waldherr, and Kenneth Lee. 2007. Trust violation scenarios. DRDC Toronto No. CR-2007-176. DRDC Toronto Research Centre, Toronto, Canada.Google ScholarGoogle Scholar
  107. Kristin E. Schaefer, Jeffrey K. Adams, Jacquelyn G. Cook, Angela Bardwell-Owens, and Peter A. Hancock. 2015. The future of robotic design: trends from the history of media representations. Ergonomics in Design 23, 1 (2015), 13--19.Google ScholarGoogle ScholarCross RefCross Ref
  108. Kristin E. Schaefer. 2016. Measuring trust in human robot interactions: Development of the “trust perception scale-HRI”. In Robust Intelligence and Trust in Autonomous Systems. Springer, New York, NY, 191--218.Google ScholarGoogle Scholar
  109. Kristin E. Schaefer, Tracy L. Sanders, Ryan E. Yordon, Deborah R. Billings, and Peter A. Hancock. 2012. Classification of robot form: Factors predicting perceived trustworthiness. In Proceedings of the 2012 Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Washington, DC, 1548--1552.Google ScholarGoogle Scholar
  110. Maurice E. Schweitzer, John C. Hershey, and Eric T. Bradlow. 2006. Promises and lies: Restoring violated trust. Organ. Behav. Hum. Dec. 101 (2006), 1--19.Google ScholarGoogle ScholarCross RefCross Ref
  111. Elaine Short, Justin Hart, Michelle Vu, and Brian Scassellati. 2010. No fair!!: An interaction with a cheating robot. In Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 219--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Valerie K. Sims, Matthew G. Chin, David Sushil, Daniel J. Barber, Tatiana Ballion, Bryan R. Clark, Keith A. Garfield, Michael J. Dolezal, Randall Shumaker, and Neal Finkelstein. 2005. Anthropomorphism of robotic forms: A response to affordances? In Proceedings of the 2005 Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Washington, DC, 602--605.Google ScholarGoogle ScholarCross RefCross Ref
  113. Nick Statt. 2016, March 9. Hilton and IBM built a Watson-powered concierge. The Verge. Retrieved from: https://www.theverge.com/2016/3/9/11180418/hilton-ibm-connie-robot-watson-hotel-conciergeGoogle ScholarGoogle Scholar
  114. Leila Takayama, Wendy Ju, and Clifford Nass. 2008. Beyond dirty, dangerous and dull: What everyday people think robots should do. In Proceedings of the 3rd ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. Adriana Tapus, Maja J. Mataric, and Brian Scassellati. 2007. Socially assistive robotics. IEEE Robot. Autom. Mag. 14, 1 (March 2007), 35 DOI:http://dx.doi.org/hal-00770113Google ScholarGoogle ScholarCross RefCross Ref
  116. Edward C. Tomlinson, Brian R. Dineen and Roy J. Lewicki. 2004. The road to reconciliation: Antecedents of victim willingness to reconcile following a broken promise. J. Manage. 30, 2 (April 2004), 165--187.Google ScholarGoogle Scholar
  117. Cristen Torrey, Susan R. Fussell, and Sara Kiesler. 2013. How a robot should give advice. In Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE Press, Piscataway, NJ, 275--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. Jocelyne Troccaz, Michael Peshkin, and Brian Davies. 1997. The use of localizers, robots, and synergistic devices in CAS. In Lecture Notes in Computer Science, vol. 1205. Springer, Berlin (1997), 727--736. Google ScholarGoogle ScholarDigital LibraryDigital Library
  119. Daniel Ullman, Iolanda Leite, Jonathan Phillips, Julia Kim-Cohen, and Brian Scassellati. 2014. Smart human, smarter robot: How cheating affects perceptions of social agency. In Proceedings of the 36th Annual Conference of the Cognitive Science Society (CogSci2014).Google ScholarGoogle Scholar
  120. Daniel Ullman and Bertram F. Malle. 2017. Human-robot trust: Just a button press away. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 309--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  121. Frank M. F. Verberne, Jaap Ham, and Cees J. H. Midden. 2012. Trust in smart systems sharing driving goals and giving information to increase trustworthiness and acceptability of smart systems in cars. Hum. Factors. 54, 5 (May 2012), 799--810.Google ScholarGoogle ScholarCross RefCross Ref
  122. Alan R. Wagner and Ronald C. Arkin. 2011a. Acting deceptively: Providing robots with the capacity for deception. Int. J. Soc. Robot. 3, 1 (Jan. 2011), 5--26.Google ScholarGoogle ScholarCross RefCross Ref
  123. Alan R. Wagner and Ronald C. Arkin. 2011b. Recognizing situations that demand trust. In Proceedings of the 20th International Symposium on Robot and Human Interactive Communication (RO-MAN 2011). IEEE, Piscataway, NJ, 7--14.Google ScholarGoogle Scholar
  124. Lin Wang, Pei-Luen Patrick Rau, Vanessa Evers, and Pamela Hinds. 2009. Responsiveness to robots: Effects of ingroup orientation and communication style on HRI in China. In Proceedings of the 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Piscataway, NJ. 247--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  125. Lin Wang, Pei-Luen Patrick Rau, Vanessa Evers, Benjamin Krisper, and Pamela Hinds. 2010. When in Rome: The role of culture and context in adherence to robot recommendations. In Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Piscataway, NJ. 359--366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  126. Ning Wang, David V. Pynadath, and Susan G. Hill. 2016a. Trust calibration within a human-robot team: Comparing automatically generated explanations. In Proceedings of the 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, Piscataway, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  127. Ning Wang, David V. Pynadath, and Susan G. Hill. 2016b. The impact of POMDP-generated explanations on trust and performance in human-robot teams. In Proceedings of the 2016 International Conference on Autonomous Agents 8 Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. Lawrence R. Wheeless and Janis Grotz. 1977. The measurement of trust and its relationship to self-disclosure. Human Communication Research 3, 3 (1977), 250--257.Google ScholarGoogle ScholarCross RefCross Ref
  129. Jessica Wildman. 2011. Cultural Differences in Forgiveness Fatalism, Trust Violations, and Trust Repair Efforts in Interpersonal Collaboration. Doctoral dissertation. University of Central Florida, Orlando, FL.Google ScholarGoogle Scholar
  130. Jessica L. Wildman, Marissa L. Shuffler, Elizabeth H. Lazzara, Stephen M. Fiore, Shawn C. Burke, Eduardo E. Salas, and Sena Garven. 2012. Trust development in swift starting action teams: A multilevel framework. Group Organ. Manage. 37, 2 (March 2012), 137--170.Google ScholarGoogle ScholarCross RefCross Ref
  131. Rosemarie E. Yagoda and Douglas J. Gillan. 2012. You want me to trust a ROBOT? The development of a human-robot interaction trust scale. Int. J. Soc. Robot. 4, 3 (August 2012), 235--248.Google ScholarGoogle ScholarCross RefCross Ref
  132. Michelle Yeh and Christopher D. Wickens. 2000. Attention and Trust Biases in the Design of Augmented Reality Displays. Savoy Aviation Research Laboratory Technical Report ARL-00-3/FED-LAB-00-1. Illinois University at Urbana-Champaign, Champaign, IL.Google ScholarGoogle Scholar

Index Terms

  1. Toward an Understanding of Trust Repair in Human-Robot Interaction: Current Research and Future Directions

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Interactive Intelligent Systems
          ACM Transactions on Interactive Intelligent Systems  Volume 8, Issue 4
          December 2018
          159 pages
          ISSN:2160-6455
          EISSN:2160-6463
          DOI:10.1145/3292532
          Issue’s Table of Contents

          Copyright © 2018 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 16 November 2018
          • Accepted: 1 December 2017
          • Revised: 1 November 2017
          • Received: 1 November 2016
          Published in tiis Volume 8, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format