Skip to main content
SpringerLink
Log in

How Semantic Processing of Words Evokes Changes in Pupil

  • Conference paper
  • First Online:
Symbiotic Interaction (Symbiotic 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8820))

Included in the following conference series:

Abstract

This paper investigates the relationship between semantic processing of words and modifications in pupil size. Variations in pupil diameter reflect cognitive processing, as has been widely demonstrated in literature. We designed an experiment in which semantic association between words was manipulated in order to disclose potential differences in cognitive processing. Moreover, we measured the concurrent pupil diameter changes. Results showed faster pupil dilation in trials in which words were semantically associated. As changes in pupil diameter do not occur under voluntary control, they could reflect processing of preconscious information. We believe that a better symbiotic relationship between humans and machines is achievable once systems are able to make us aware of these “involuntary” changes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91(2), 276 (1982)

    Article  Google Scholar 

  2. Hess, E.H., Polt, J.M.: Pupil size as related to interest value of visual stimuli. Science 132(3423), 349–350 (1960)

    Article  Google Scholar 

  3. Aboyoun, D.C., Dabbs, J.M.: The Hess pupil dilation findings: sex or novelty? Soc. Behav. Pers. Int. J. 26(4), 415–419 (1998)

    Article  Google Scholar 

  4. Vȯ, M.L.H., Jacobs, A.M., Kuchinke, L., Hofmann, M., Conrad, M., Schacht, A., Hutzler, F.: The coupling of emotion and cognition in the eye: Introducing the pupil old/new effect. Psychophysiology 45, 130–140 (2008)

    Article  Google Scholar 

  5. Kang, M.J., Hsu, M., Krajbich, I.M., Loewenstein, G., McClure, S.M., Wang, J.T.Y., Camerer, C.F.: The wick in the candle of learning epistemic curiosity activates reward circuitry and enhances memory. Psychol. Sci. 20(8), 963–973 (2009)

    Article  Google Scholar 

  6. Beatty, J., Kahneman, D.: Pupillary changes in two memory tasks. Psychon. Sci. 5(10), 371–372 (1966)

    Article  Google Scholar 

  7. Iqbal, S.T., Zheng, X.S., Bailey, B.P.: Task-evoked pupillary response to mental workload in human-computer interaction. In: CHI’04 Extended Abstracts on Human Factors in Computing Systems, pp. 1477–1480. ACM, April 2004

    Google Scholar 

  8. Van Orden, K.F., Jung, T.P., Makeig, S.: Combined eye activity measures accurately estimate changes in sustained visual task performance. Biol. Psychol. 52(3), 221–240 (2000)

    Article  Google Scholar 

  9. Hess, E.H., Polt, J.M.: Pupil size in relation to mental activity during simple problem-solving. Science 143(3611), 1190–1192 (1964)

    Article  Google Scholar 

  10. Ahern, S., Beatty, J.: Pupillary responses during information processing vary with Scholastic Aptitude Test scores. Science 205, 1289–1292 (1979)

    Article  Google Scholar 

  11. Hyönä, J., Tommola, J., Alaja, A.M.: Pupil dilation as a measure of processing load in simultaneous interpretation and other language tasks. Q. J. Exp. Psychol. 48(3), 598–612 (1995)

    Article  Google Scholar 

  12. Just, M.A., Carpenter, P.A.: The intensity dimension of thought: pupillometric indices of sentence processing. Can. J. Exp. Psychol./Rev. canadienne de psychologie expérimentale 47(2), 310 (1993)

    Article  Google Scholar 

  13. Kahneman, D., Beatty, J.: Pupil diameter and load on memory. Science 154(3756), 1583–1585 (1966)

    Article  Google Scholar 

  14. Porter, G., Troscianko, T., Gilchrist, I.D.: Effort during visual search and counting: insights from pupillometry. Q. J. Exp. Psychol. 60, 211–229 (2007)

    Article  Google Scholar 

  15. Van Gerven, P.W., Paas, F., Van Merriënboer, J.J., Schmidt, H.G.: Memory load and the cognitive pupillary response in aging. Psychophysiology 41(2), 167–174 (2004)

    Article  Google Scholar 

  16. Janisse, M.P., Bradley, M.T.: Deception information and the pupillary response. Percept. Mot. Skills 50(3), 748–750 (1980)

    Article  Google Scholar 

  17. Lubow, R.E., Fein, O.: Pupillary size in response to a visual guilty knowledge test: New Technique for detection of deception. J. Exp. Psychol. Appl. 2(2), 164–177 (1996)

    Article  Google Scholar 

  18. Dionisio, D.P., Granholm, E., Hillix, W.A., Perrine, W.F.: Differentiation of deception using pupillary responses as an index of cognitive processing. Psychophysiology 38(2), 205–211 (2001)

    Article  Google Scholar 

  19. Jacucci, G., Spagnolli, A., Freeman, J., Gamberini, L.: Symbiotic interaction: a critical definition and comparison to other human-computer paradigms. In: Jacucci, G., Gamberini, L., Freeman, J., Spagnolli, A. (eds.) Symbiotic 2014. LNCS, vol. 8820, pp. 3–20. Springer, Heidelberg (2014)

    Google Scholar 

  20. Licklider, J.C.R.: Man-computer symbiosis. Hum. Factors Electron. IRE Trans. 1, 4–11 (1960)

    Article  Google Scholar 

  21. Spagnolli, A., Guardigli, E., Orso, V., Varotto, A., Gamberini, L.: Measuring user acceptance of wearable symbiotic devices: validation study across application scenarios. In: Jacucci, G., Gamberini, L., Freeman, J., Spagnolli, A. (eds.) Symbiotic 2014. LNCS, vol. 8820, pp. 87–98. Springer, Heidelberg (2014)

    Google Scholar 

  22. Negri, P, Gamberini, L, Cutini, S.: A Review of the Research on Subliminal Techniques for Implicit Interaction in Symbiotic Systems. In: Jacucci, G., Gamberini, L., Freeman, J., Spagnolli, A. (eds.) Symbiotic 2014. LNCS, vol. 8820, pp. 47–60. Springer, Heidelberg (2014)

    Google Scholar 

  23. Barral, O., Aranyi, G., Kouider, S., Lindsay, A., Prins, H., Ahmed, I., Jacucci, G., Negri, P., Gamberini, L., Pizzi, D., Cavazza, M.: Covert persuasive technologies: bringing subliminal cues to human-computer interaction. In: Persuasive Technology, pp. 1–12. Springer International Publishing (2014)

    Google Scholar 

  24. Aranyi, G., Kouider, S., Lindsay, A., Prins, H., Ahmed, I., Jacucci, G., Negri, P., Gamberini, L., Pizzi, D., Cavazza, M.: Subliminal cueing of selection behavior in a virtual environment. Presence: Teleoperators Virtual Environ. 23(1), 33–50 (2014)

    Article  Google Scholar 

  25. Beatty, J., Lucero-Wagoner, B.: The pupillary system. Handb. Psychophysiol. 2, 142–162 (2000)

    Google Scholar 

  26. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)

    Google Scholar 

  27. Laeng, B., Sirois, S., Gredebäck, G.: Pupillometry a window to the preconscious? Perspect. Psychol. Sci. 7(1), 18–27 (2012)

    Article  Google Scholar 

  28. Whipple, B., Ogden, G., Komisaruk, B.R.: Physiological correlates of imagery-induced orgasm in women. Arch. Sex. Behav. 21(2), 121–133 (1992)

    Article  Google Scholar 

  29. Loewenfeld, I.: The Pupil: Anatomy, Physiology, and Clinical Applications. Detroit MI Wayne State University Press, Detroit (1993)

    Google Scholar 

  30. Hutchison, K.A., Balota, D.A., Neely, J.H., Cortese, M.J., Cohen-Shikora, E.R., Tse, C.S., Yap, M.J., Bengson, J.J., Niemeyer, D., Buchanan, E.: The semantic priming project. Behav. Res. Methods 45(4), 1099–1114 (2013)

    Article  Google Scholar 

  31. Kahneman, D.: Attention and Effort. Prentice-Hall, Englewood Cliffs (1973)

    Google Scholar 

  32. Luck, S.J., Hillyard, S.A.: Electrophysiological correlates of feature analysis during visual search. Psychophysiology 31(3), 291–308 (1994)

    Article  Google Scholar 

  33. Woodman, G.F., Luck, S.J.: Dissociations among attention, perception, and awareness during object-substitution masking. Psychol. Sci. 14(6), 605–611 (2003)

    Article  Google Scholar 

  34. Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval, pp. 1–6. Cambridge University Press, Cambridge (2008)

    Google Scholar 

  35. Athukorala, K., Hoggan, E., Lehti, A., Ruotsalo, T., Jacucci, G.: Informationseeking behaviors of computer scientists: challenges for electronic literature search tools. Proc. Am. Soc. Inf. Sci. Technol. 50(1), 1–11 (2013)

    Article  Google Scholar 

  36. Oliveira, F.T., Aula, A., Russell, D.M.: Discriminating the relevance of web search results with measures of pupil size. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2209–2212. ACM (2009)

    Google Scholar 

Download references

Acknowledgements

This research was supported by the European Project MINDSEE, Symbiotic Mind Computer Interaction for Information Seeking (Number: 611570; Call: FP7-ICT-2013-10 Information and Communication Technologies).

Author information

Authors and Affiliations

  1. Human Inspired Technology Research Centre (HIT), University of Padova, Padua, Italy

    Patrik Pluchino, Luciano Gamberini & Filippo Minelle

  2. Helsinki Institute for Information Technology (HIIT), Department of Computer Science, University of Helsinki, Helsinki, Finland

    Oswald Barral

Authors
  1. Patrik Pluchino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luciano Gamberini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oswald Barral
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Filippo Minelle
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patrik Pluchino .

Editor information

Editors and Affiliations

  1. Department of Computer Science, Helsinki Institute for Information Technology HIIT, University of Helsinki, Helsinki, Finland

    Giulio Jacucci

  2. University of Padua, Padua, Italy

    Luciano Gamberini

  3. Department of Psychology, Goldsmiths - University of London, London, United Kingdom

    Jonathan Freeman

  4. University of Padua, Padua, Italy

    Anna Spagnolli

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Pluchino, P., Gamberini, L., Barral, O., Minelle, F. (2014). How Semantic Processing of Words Evokes Changes in Pupil. In: Jacucci, G., Gamberini, L., Freeman, J., Spagnolli, A. (eds) Symbiotic Interaction. Symbiotic 2015. Lecture Notes in Computer Science(), vol 8820. Springer, Cham. https://doi.org/10.1007/978-3-319-13500-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13500-7_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13499-4

  • Online ISBN: 978-3-319-13500-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation