Skip to main content
SpringerLink
Log in

Perceptual Representations in L1, L2 and L3 Comprehension: Delayed Sentence–Picture Verification

  • Published:
Journal of Psycholinguistic Research Aims and scope Submit manuscript

Abstract

We used delayed sentence–picture verification tasks to investigate multilingual perceptual representations. In experiment 1, participants listened to sentences with implied shapes. After a 10-min interval, they judged whether pictures had been mentioned in the preceding sentences or not. Results in experiment 1 showed significant match effect in L1, but not in high proficient L2 or low proficient L3. In experiment 2, Participants listened to one language block, then immediately judged one picture block, totally three language–picture blocks. Results in experiment 2 were parallel to results in experiment 1. Our study supports the view of distributed conception: L2 and L3 are associated with less perceptual symbols than L1, indicating great impact of acquisition styles on perceptual representations. Our results show little impact of language proficiency levels on perceptual representations in delayed tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Ahlberg, D. K., Bischo, H., Kaup, B., Bryant, D., & Strozyk, J. V. (2017). Grounded cognition: Comparing language × space interactions in first language and second language. Applied Psycholinguistics,39, 437–459.

    Google Scholar 

  • Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology,59, 617–645.

    PubMed  Google Scholar 

  • Baumeister, J. C., Foroni, F., Conrad, M., Rumiati, R. I., & Winkielman, P. (2017). Embodiment and emotional memory in first vs. second language. Frontiers in Psychology,8, 394.

    PubMed  PubMed Central  Google Scholar 

  • Bechtold, L., Ghio, M., Lange, J., & Bellebaum, C. (2018). Event-related desynchronization of mu and beta oscillations during the processing of novel tool names. Brain and Language,177–178, 44–55.

    PubMed  Google Scholar 

  • Bergen, B., Lau, T.-T. C., Narayan, S., Stojanovic, D., & Wheeler, K. (2010). Body part representations in verbal semantics. Memory & Cognition,38, 969–981.

    Google Scholar 

  • Birba, A., García-Cordero, I., Kozono, G., Legaz, A., Ibáñez, A., Sedeño, L., et al. (2017). Losing ground: Frontostriatal atrophy disrupts language embodiment in Parkinson’s and Huntington’s disease. Neuroscience and Biobehavioral Reviews,80, 673–687.

    PubMed  Google Scholar 

  • Buccino, G., Colagè, I., Gobbi, N., & Bonaccorso, G. (2016). Grounding meaning in experience: A broad perspective on embodied language. Neuroscience and Biobehavioral Review,69, 69–78.

    Google Scholar 

  • Buccino, G., Dalla Volta, R., Arabia, G., Morelli, M., Chiriaco, C., Lupo, A., et al. (2017). Processing graspable object images and their nouns is impaired in Parkinson’s disease patients. Cortex,100, 32–39.

    PubMed  Google Scholar 

  • Caldwell-Harris, C. L. (2015). Emotionality differences between a native and foreign language: Implications for everyday life. Current Directions in Psychological Science,24, 214–219.

    Google Scholar 

  • Cotelli, M., Manenti, R., Brambilla, M., & Borroni, B. (2018). The role of the motor system in action naming in patients with neurodegenerative extra-pyramidal syndromes. Cortex,100, 191–214.

    PubMed  Google Scholar 

  • Davis, J. D., Winkielman, P., & Coulson, S. (2015). Facial action and emotional language: ERP evidence that blocking facial feedback selectively impairs sentence comprehension. Journal of Cognitive Neuroscience,27, 2269–2280.

    PubMed  Google Scholar 

  • De Grauwe, S., Willems, R. M., Rueschemeyer, S. A., Lemhöfer, K., & Schriefers, E. (2014). Embodied language in first- and second-language speakers: Neural correlates of processing motor verbs. Neuropsychologia,56, 334–349.

    PubMed  Google Scholar 

  • De Groot, A. M. B. (1992). Determinants of word translation. Journal of Experimental Psychology. Learning, Memory, and Cognition,18, 1001–1018.

    Google Scholar 

  • Dijkstra, T., & Van Heuven, W. (2002). The architecture of the bilingual word recognition system: From identification to decision. Bilingualism: Language and Cognition,5, 175–197.

    Google Scholar 

  • Dudschig, C., de la Vega, I., & Kaup, B. (2014). Embodiment and second-language: Automatic activation of motor responses during processing spatially associated L2 words and emotion L2 words in a vertical Stroop paradigm. Brain and Language,132, 14–21.

    PubMed  Google Scholar 

  • Fernandino, L., Conant, L. L., Binder, J. R., Blindauer, K., Hiner, B., Spangler, K., et al. (2013). Where is the action? Action sentence processing in Parkinson’s disease. Neuropsychologia,51, 1510–1517.

    PubMed  PubMed Central  Google Scholar 

  • Finkbeiner, M., Forster, K., Nicol, J., & Nakamura, K. (2004). The role of polysemy in masked semantic and translation priming. Journal of Memory and Language,51, 1–22.

    Google Scholar 

  • Fino, E., Menegatti, M., Avenanti, A., & Rubini, M. (2016). Enjoying vs. smiling: Facial muscular activation in response to emotional language. Biological Psychology,118, 126–135.

    PubMed  Google Scholar 

  • Fischer, M. H., & Zwaan, R. A. (2008). Grounding cognition in perception and action. Quarterly Journal of Experimental Psychology,61, 825–857.

    Google Scholar 

  • Foroni, F. (2015). Do we embody second language? Evidence for ‘partial’ simulation during processing of a second language. Brain and Cognition,99, 8–16.

    PubMed  Google Scholar 

  • García-Gámez, A. B., & Macizo, P. (2018). Learning nouns and verbs in a foreign language: The role of gestures. Applied Psycholinguistics,40, 473–507.

    Google Scholar 

  • Gijssels, T., Ivry, R. B., & Casasanto, D. (2018). tDCS to premotor cortex changes action verb understanding: Complementary effects of inhibitory and excitatory stimulation. Scientific Reports,8, 11452.

    PubMed  PubMed Central  Google Scholar 

  • Glenberg, A. M., & Gallese, V. (2012). Action-based language: A theory of language acquisition, comprehension, and production. Cortex,48, 905–922.

    PubMed  Google Scholar 

  • Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatopic representation of action words in human motor and premotor cortex. Neuron,41, 301–307.

    PubMed  Google Scholar 

  • Horchak, O. V., Giger, J. C., Cabral, M., & Pochwatko, G. (2014). From demonstration to theory in embodied language comprehension: A review. Cognitive Systems Research,29–30, 66–85.

    Google Scholar 

  • Hsu, C. T., Jacobs, A. M., & Conrad, M. (2015). Can Harry Potter still put a spell on us in a second language? An fMRI study on reading emotion-laden literature in late bilinguals. Cortex,63, 282–295.

    PubMed  Google Scholar 

  • Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language,33, 149–174.

    Google Scholar 

  • Majid, A., Roberts, S. G., Cilissen, L., et al. (2018). Differential coding of perception in the world’s languages. Proceedings of the National Academy of Sciences,115, 11369–11376.

    Google Scholar 

  • Marino, B. F., Gough, P. M., Gallese, V., Riggio, L., & Buccino, G. (2013). How the motor system handles nouns: A behavioral study. Psychological Research,77, 64–73.

    PubMed  Google Scholar 

  • Monaco, E., Jost, L. B., Gygax, P. M., & Annoni, J. M. (2019). Embodied semantics in a second language: Critical review and clinical implications. Frontiers in Human Neuroscience,13, 110.

    PubMed  PubMed Central  Google Scholar 

  • Nijhof, A. D., & Willems, R. M. (2015). Simulating fiction: Individual differences in literature comprehension revealed with fMRI. PLoS ONE,10, 1–17.

    Google Scholar 

  • Pavlenko, A. (2017). Do you wish to waive your rights? Affect and decision-making in multilingual speakers. Current Opinion in Psychology,17, 74–78.

    PubMed  Google Scholar 

  • Pecher, D., Van Dantzig, S., Zwaan, R. A., & Zeelenberg, R. (2009). Language comprehenders retain implied shape and orientation of objects. Quarterly Journal of Experimental Psychology,62, 1108–1114.

    Google Scholar 

  • Potter, M. C., So, K.-F., Von Eckardt, B., & Feldman, L. B. (1984). Lexical and conceptual representation in beginning and proficient bilinguals. Journal of Verbal Learning and Verbal Behavior,23, 23–38.

    Google Scholar 

  • Pulvermüller, F. (2013). Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits. Brain and Language,127, 86–103.

    PubMed  Google Scholar 

  • Qian, W. (2016). Embodied cognition processing and representation of power words by second language learners with different proficiency levels. Chinese Journal of Applied Linguistics,39, 484–494.

    Google Scholar 

  • Repetto, C., Pedroli, E., & Macedonia, M. (2017). Enrichment effects of gestures and pictures on abstract words in a second language. Frontiers of Psychology,8, 2136.

    Google Scholar 

  • Santos, A., Chaigneau, S. E., Simmons, W. K., & Barsalou, L. W. (2011). Property generation reflects word association and situated simulation. Language and Cognition,3, 83–119.

    Google Scholar 

  • Scarborough, D. L., Gerard, L., & Cortese, C. (1984). Independence of lexical access in bilingual word recognition. Journal of Verbal Learning and Verbal Behavior,23, 84–99.

    Google Scholar 

  • Sheikh, N., & Titone, D. (2015). The embodiment of emotional words in a second language: An eye-movement study. Cognition and Emotion,30, 488–500.

    PubMed  Google Scholar 

  • Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science,12, 153–156.

    PubMed  Google Scholar 

  • Vukovic, N., Feurra, M., Shpektor, A., Myachykov, A., & Shtyrov, Y. (2017). Primary motor cortex functionally contributes to language comprehension: An online rTMS study. Neuropsychologia,96, 222–229.

    PubMed  Google Scholar 

  • Vukovic, N., & Shtyrov, Y. (2014). Cortical motor systems are involved in second-language comprehension: Evidence from rapid mu-rhythm desynchronisation. NeuroImage,102, 695–703.

    PubMed  Google Scholar 

  • Vukovic, N., & Williams, J. N. (2014). Automatic perceptual simulation of first language meanings during second language sentence processing in bilinguals. Acta Psychologica,145, 98–103.

    PubMed  Google Scholar 

  • Xue, J., Marmolejo-Ramos, F., & Pei, X. (2015). The linguistic context effects on the processing of body-object interaction words: An ERP study on second language learners. Brain Research,1613, 37–48.

    PubMed  Google Scholar 

  • Zwaan, R. A. (2016). Situation models, mental simulations, and abstract concepts in discourse comprehension. Psychonomic Bulletin & Review,23, 1028–1034.

    Google Scholar 

  • Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language comprehenders mentally represent the shape of objects. Psychological Science,13, 168–171.

    PubMed  Google Scholar 

Download references

Funding

This study was funded by the National Social Science Foundation of China (19AYY009).

Author information

Authors and Affiliations

  1. Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, Center for Studies of Psychological Application, School of Psychology, South China Normal University, Zhongshan Street West, 55, Tianhe District, Guangzhou, 510613, China

    Donggui Chen & Ruiming Wang

  2. School of Foreign Languages, Guangdong Polytechnic Normal University, Guangzhou, China

    Donggui Chen

  3. College of Chinese Language and Culture, Jinan University, Guangzhou, China

    Jinqiao Zhang

  4. Department of Psychology, Qingdao University, Qingdao, 266071, China

    Cong Liu

Authors
  1. Donggui Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruiming Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jinqiao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ruiming Wang.

Ethics declarations

Conflict of interest

We declare that we have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, D., Wang, R., Zhang, J. et al. Perceptual Representations in L1, L2 and L3 Comprehension: Delayed Sentence–Picture Verification. J Psycholinguist Res 49, 41–57 (2020). https://doi.org/10.1007/s10936-019-09670-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10936-019-09670-x

Keywords

Search

Navigation