Skip to main content
SpringerLink
Log in

An Eye Tracking Analysis of Conversational Violations in Dyadic and Collaborative Interaction

  • Conference paper
  • First Online:
Book cover Augmented Cognition (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13310))

Included in the following conference series:

  • 1176 Accesses

Abstract

Linguistic principles are crucial in maintaining reliable and transparent communication for dyadic interactions. However, violating these principles might result in unwieldy and problematic communications. We use gaze as a medium to explore how visual attention and task performance changes when conversational violations occur. We conducted an eye-tracking study (N = 17) measuring changes in visual patterns in response to social communication errors, specifically Grice’s Maxims violations. Our study investigates how social-communicative errors influence task performance and gaze during dyadic and collaborative social interactions. The results suggest participants’ visual exploration patterns shift towards the violator when the maxim of Relation is violated in a task instruction. Gaze stays mainly within the task area after receiving instructions with Quantity, Quality, and Manner violations. Moreover, it takes longer to respond to task instructions that include Quantity and Quality violations, than the Manner and Relation violations. Finally, our qualitative analysis revealed participants’ adaptive and non-adaptive strategies in response to the Quality violation. Our findings contribute to the design space of human performance in dyadic and collaborative interactions, with future work implications exploring human performance in joint system-human interactions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Grice, H.P.: Logic and conversation. In: Cole, P., Morgan, J.L. (eds.) Speech Acts, pp. 41–58 (1975)

    Google Scholar 

  2. Jacquet, B., Baratgin, J., Jamet, F.: The Gricean maxims of quantity and of relation in the turing test. In: The Proceedings of the 11th International Conference on Human System Interaction (HSI), pp. 332–338. IEEE (2018)

    Google Scholar 

  3. Jacquet, B., Hullin, A., Baratgin, J., Jamet, F.: The impact of the Gricean maxims of quality, quantity and manner in chatbots. In: Proceedings of the International Conference on Information and Digital Technologies (IDT), pp. 180–189. IEEE (2019)

    Google Scholar 

  4. Knepper, R. A., Tellex, S., Li, A., Roy, N., Rus, D.: Single assembly robot in search of human partner: versatile grounded language generation. In: Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 167–168. IEEE (2013)

    Google Scholar 

  5. Briggs, G., Scheutz, M.: Multi-modal belief updates in multi-robot human-robot dialogue interactions. In: Proceedings of the AISB/IACAP Symposium on Linguistic and Cognitive Approaches to Dialogue Agents (LaCATODA), pp. 67–72 (2012)

    Google Scholar 

  6. En, L.Q., Lan, S.S.: The applicability of Gricean maxims in social robotics polite dialogue. In: Proceedings of the 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 195–196. IEEE (2011)

    Google Scholar 

  7. Kleinke, S.: Speaker activity and Grice’s maxims of conversation at the interface of pragmatics and cognitive linguistics. J. Pragmat. 42(12), 3345–3366 (2010)

    Article  Google Scholar 

  8. Saygin, A.P., ÇiçSekli, I.: Pragmatics in human-computer conversations. J. Pragmat. 34(3), 227–258 (2002)

    Google Scholar 

  9. Zhao, T., Zhao, R., Meng, Z., Cassell, J.: Leveraging recurrent neural networks for multimodal recognition of social norm violation in dialog. arXiv preprint:1610.03112 (2016)

    Google Scholar 

  10. Jokinen, K.: Conversational gaze modelling in first encounter robot dialogues. In: Proceedings of the LREC Workshop on Language and Body in Real Life and Multimodal Corpora. European Language Resources Association (ELRA) (2018)

    Google Scholar 

  11. Admoni, H., Scassellati, B.: Social eye gaze in human-robot interaction: a review. J. Hum.-Robot Interact. 6(1), 25–63 (2017)

    Article  Google Scholar 

  12. Mutlu, B., Kanda, T., Forlizzi, J., Hodgins, J., Ishiguro, H.: Conversational gaze mechanisms for humanlike robots. ACM Trans. Interact. Intell. Syst. (TiiS) 1(2), 1–33 (2012)

    Article  Google Scholar 

  13. Broz, F., Kose-Bagci, H., Nehaniv, C.L., Dautenhahn, K., Hatfield, U.K.: Towards automated human-robot mutual gaze. In: Proceedings of ACHI, the International Conference on Advances in Computer-Human Interactions, pp. 222–227 (2011)

    Google Scholar 

  14. Broz, F., Lehmann, H., Nehaniv, C.L., Dautenhahn, K.: Mutual gaze, personality, and familiarity: dual eye-tracking during conversation. In IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, pp. 858–864. IEEE (2012)

    Google Scholar 

  15. Kassel, J.F., Rohs, M.: Talk to me intelligibly: investigating an answer space to match the user’s language in visual analysis. In: Proceedings of the Designing Interactive Systems Conference, pp. 1517–1529 (2019)

    Google Scholar 

  16. Xiao, Z., et al.: Tell me about yourself: using an AI-powered chatbot to conduct conversational surveys. arXiv preprint:1905.10700 (2019)

    Google Scholar 

  17. Gnewuch, U., Morana, S., Maedche, A.: Towards designing cooperative and social conversational agents for customer service. In: Proceedings of the 38th International Conference on Information Systems (ICIS) (2017)

    Google Scholar 

  18. White, R.: Adapting Grice’s maxims in the teaching of writing. ELT J. 55(1), 62–69 (2001)

    Article  Google Scholar 

  19. Attardo, S.: The violation of Grice’s maxims in jokes. In: Proceedings of the Annual Meeting of the Berkeley Linguistics Society, vol. 16, no. 1, pp. 355–362 (1990)

    Google Scholar 

  20. Nordmeyer, A.E., Frank, M.C.: Early understanding of pragmatic principles in children’s judgments of negative sentences. Lang. Learn. Dev. 14(4), 262–278 (2018)

    Article  Google Scholar 

  21. Gweon, H., Shafto, P., Schulz, L.: Development of children’s sensitivity to overinformativeness in learning and teaching. Dev. Psychol. 54(11), 2113 (2018)

    Article  Google Scholar 

  22. Okanda, M., Asada, K., Moriguchi, Y., Itakura, S.: Understanding violations of Gricean maxims in preschoolers and adults. Front. Psychol. 6, 901 (2015). https://doi.org/10.3389/fpsyg.2015.00901

    Article  Google Scholar 

  23. Siegal, M., Iozzi, L., Surian, L.: Bilingualism and conversational understanding in young children. Cognition 110(1), 115–122 (2009)

    Article  Google Scholar 

  24. Antoniou, K., Taguchi, N.: Multilingual pragmatics: implicature comprehension in adult L2 learners and multilingual children. In: Taguchi, N. (ed.) The Routledge Handbook of Pragmatics and Second Language Acquisition. Routledge, Abingdon (2019)

    Google Scholar 

  25. Gillis, R.L., Nilsen, E.S.: Children’s use of information quality to establish speaker preferences. Dev. Psychol. 49(3), 480–490 (2013). https://doi.org/10.1037/a0029479

    Article  Google Scholar 

  26. Ferrier, S., Dunham, P., Dunham, F.: The confused robot: Two-olds’ responses to breakdowns in conversation. Soc. Dev. 9(3), 337–347 (2000)

    Google Scholar 

  27. Surian, L., Tedoldi, M., Siegal, M.: Sensitivity to conversational maxims in deaf and hearing children. J. Child Lang. 37(4), 929–943 (2010)

    Article  Google Scholar 

  28. Eskritt, M., Whalen, J., Lee, K.: Preschoolers can recognize violations of the Gricean maxims. Br. J. Dev. Psychol. 26(3), 435–443 (2008). https://doi.org/10.1348/026151007X253260

    Article  Google Scholar 

  29. Hemforth, B., et al.: Language specific preferences in anaphor resolution: exposure or Gricean maxims? In: Proceedings of the 32nd Annual Conference of the Cognitive Science Society, pp. 2218–2223 (2010)

    Google Scholar 

  30. Engelhardt, P.E., Bailey, K.G., Ferreira, F.: Do speakers and listeners observe the Gricean maxim of quantity? J. Mem. Lang. 54(4), 554–573 (2006)

    Article  Google Scholar 

  31. Davies, C., Katsos, N.: Are speakers and listeners ’only moderately Gricean’? An empirical response to Engelhardt et al. (2006). J. Pragmat. 49(1), 78–106 (2013)

    Google Scholar 

  32. Vogel, A., Bodoia, M., Potts, C., Jurafsky, D.: Emergence of Gricean maxims from multi-agent decision theory. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1072–1081 (2013)

    Google Scholar 

  33. Zuckerman, M., DePaulo, B.M., Rosenthal, R.: Verbal and nonverbal communication of deception. In: Berkowitz, L. (ed.) Advances in Experimental Social Psychology, vol. 14, pp. 1–59. Academic Press (1981)

    Google Scholar 

  34. Edwards, C.C.: Detecting deception in conversation: a comparative analysis of communication theories. Thesis report. Texas Tech University (1997)

    Google Scholar 

  35. Buller, D.B., Burgoon, J.K.: Interpersonal deception theory. Commun. Theory 6(3), 203–242 (1996)

    Article  Google Scholar 

  36. Martin, M.M., Rubin, R.B.: Development of a communication flexibility measure. South. J. Commun. 59(2), 171–178 (1994)

    Article  Google Scholar 

  37. Bilmes, J.: Ethnomethodology, culture, and implicature: toward an empirical pragmatics. Pragmatics 3(4), 387–409 (1993)

    Google Scholar 

  38. Danziger, E.: On trying and lying: cultural configurations of Grice’s maxim of quality. Intercult. Pragmat. 7(2), 199–219 (2010)

    Article  Google Scholar 

  39. Dewaele, J.M.: Interpreting Grice’s maxim of quantity: interindividual and situational variation in discourse styles of non-native speakers. In: Cognition in Language Use: Selected Papers from the 7th International Pragmatics Conference, vol. 1, pp. 85–99 (2001)

    Google Scholar 

  40. Surian, L.: Are children with autism deaf to Gricean maxims? Cogn. Neuropsychiatry 1(1), 55–72 (1996)

    Article  Google Scholar 

  41. Yeung, L.N., Levine, T.R., Nishiyama, K.: Information manipulation theory and perceptions of deception in Hong Kong. Commun. Rep. 12(1), 1–11 (1999)

    Article  Google Scholar 

  42. McCornack, S.A., Levine, T.R., Solowczuk, K.A., Torres, H.I., Campbell, D.M.: When the alteration of information is viewed as deception: an empirical test of information manipulation theory. Commun. Monogr. 59, 17–29 (1992)

    Article  Google Scholar 

  43. Gosling, S.D., Rentfrow, P.J., Swann, W.B., Jr.: A very brief measure of the big five personality domains. J. Res. Pers. 37, 504–528 (2003)

    Article  Google Scholar 

  44. Braun, V., Clarke, V.: What can “thematic analysis" offer health and wellbeing researchers? Int. J. Qual. Stud. Health Well Being 9(1), 26152 (2014)

    Article  Google Scholar 

Download references

Acknowledgement

This work was partially supported by TUBITAK (The Scientific and Technological Research Council of Turkey) Grant No 117E021.

Author information

Authors and Affiliations

  1. Department of Cognitive Science, Middle East Technical University, Ankara, Turkey

    Bengisu Cagiltay & Cengiz Acarturk

  2. Department of Cognitive Science, Jagiellonian University, Kraków, Poland

    Cengiz Acarturk

Authors
  1. Bengisu Cagiltay
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cengiz Acarturk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cengiz Acarturk .

Editor information

Editors and Affiliations

  1. Soar Technology Inc., Orlando, FL, USA

    Dylan D. Schmorrow

  2. Katmai Government Services, Orlando, FL, USA

    Cali M. Fidopiastis

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cagiltay, B., Acarturk, C. (2022). An Eye Tracking Analysis of Conversational Violations in Dyadic and Collaborative Interaction. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2022. Lecture Notes in Computer Science(), vol 13310. Springer, Cham. https://doi.org/10.1007/978-3-031-05457-0_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05457-0_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05456-3

  • Online ISBN: 978-3-031-05457-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation