Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton May 26, 2023

Deployment of gestures in the semiotic construction of scientific knowledge: a systemic functional approach to pedagogic semiosis

  • Zekai Ayık EMAIL logo
From the journal Semiotica

Abstract

A variety of semiotic resources makes the construction of scientific knowledge possible and meaning-making resources are conveyed by certain semiotic modes. Next, numerous studies have demonstrated the pedagogical importance of gestures in the demonstration of scientific knowledge in the classroom. Drawing on social semiotic systemic functional theory and legitimation code theory, this study explores the types and the role of gestures in the semiotic construction of scientific knowledge in pedagogic semiosis and their pedagogical values for the meaning-making of science content. With this aim, a gesture observation protocol (GOP) is developed to annotate and analyze data. Two science lectures, which are broadcast remotely for middle school students including gifted students, are observed. Systemic Functional Multimodal Discourse Analysis (SF-MDA) method is employed to analyze and evaluate data. Results demonstrated that the deployment of gestures that contributes to the construction of scientific knowledge is low and deployed gestures mostly do not have pedagogical value. It is recommended that teachers should be more conscious and educated about deploying gestures to present scientific knowledge efficiently.


Corresponding author: Zekai Ayık, Harran University, Şanlıurfa, Türkiye, E-mail:

References

Airey, John & Cedric Linder. 2009. A disciplinary discourse perspective on university science learning: Achieving fluency in a critical constellation of modes. Journal of Research in Science Teaching 46(1). 27–49. https://doi.org/10.1002/tea.20265.Search in Google Scholar

Alibali, Martha W., Andrew G. Young, Noelle M. Crooks, Amelia Yeo, Matthew S. Wolfgram, Iasmine M. Ledesma, Mitchell J. Nathan, Ruth Breckinridge Church & Eric J. Knuth. 2013. Students learn more when their teacher has learned to gesture effectively. Gesture 13(2). 210–233. https://doi.org/10.1075/gest.13.2.05ali.Search in Google Scholar

Alibali, Martha W. & Mitchell J. Nathan. 2007. Teachers’ gestures as a means of scaffolding students’ understanding: Evidence from an early algebra lesson. In Ricki Goldman, Roy Pea, Brigid Barron & Sharon J. Denny (eds.), Video research in learning sciences, 349–365. London: Routledge.Search in Google Scholar

Bakhtin, Mikhail Mikhailovich. 1981. The dialogic imagination, Caryl Emerson & Michael Holquist (trans.). Austin: University of Texas Press.Search in Google Scholar

Bourne, Jill & Carey Jewitt. 2003. Orchestrating debate: A multimodal analysis of classroom interaction. Reading 37(2). 64–72. https://doi.org/10.1111/1467-9345.3702004.Search in Google Scholar

Christie, Frances. 1993. Curriculum genres: Planning for effective teaching. In Bill Cope & Mary Kalantzis (eds.), The powers of literacy: A genre approach to teaching, 154–178. Pittsburgh: University of Pittsburgh Press.Search in Google Scholar

Ciencki, Alan & Cornelia Müller (eds.). 2008. Methaphor and gesture. New York: John Benjamins.Search in Google Scholar

Cleirigh, Chris. 2011. Tokens of the sensor’s sensing: Pictures, protolanguage, phylogenesis & pedagogy. In Friday afternoon seminars at the University of Sydney. Sydney. http://www.interstrataltension.org/wpcontent/uploads/2011/02/TokensOfTheSensersSensing.ppt (accessed 3 May 2023).Search in Google Scholar

Creswell, John W. 2013. Nitel araştırma yöntemleri. London: SAGE.Search in Google Scholar

Crowder, Elaine M. 2009. Gestures at work in sense-making science talk. Journal of the Learning Sciences 5(3). 173–208. https://doi.org/10.1207/s15327809jls0503_2.Search in Google Scholar

Danielsson, Kristina. 2016. Modes and meaning in the classroom – The role of different semiotic resources to convey meaning in science classrooms. Linguistics and Education 35. 88–99. https://doi.org/10.1016/j.linged.2016.07.005.Search in Google Scholar

Derewianka, Beverly & Paulina Jones. 2012. Teaching language in context. Oxford: Oxford University Press.Search in Google Scholar

EBA. 2020a. Aynalar: Eğitim Bilişim Ağı. https://www.eba.gov.tr/ebatv/izle/4479c8ffe6a6406ba4e89a2f7b00e64851e79bb6a0001 (accessed 3 May 2020).Search in Google Scholar

EBA. 2020b. Enerji Dönüşümleri ve Çevre Bilimi/Fotosentez izle: Eğitim Bilişim Ağı. https://www.eba.gov.tr/ebatv/izle/6295c737b764728d545979524f471261c662fbb6a0001 (accessed 3 May 2020).Search in Google Scholar

Fogarty, Andrea J. 2018. The role of instructional gesture in learning science concepts in undergraduate students. Bridgewater, Massachusetts: Bridgewater State University Master’s thesis.Search in Google Scholar

Goldin-Meadow, Susan. 2003. Hearing gesture: How our hands help us think. Boston: Harvard University Press.10.1037/e413812005-377Search in Google Scholar

Goldin-Meadow, Susan & Martha Wagner Alibali. 2013. Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology 64(1). 257–283. https://doi.org/10.1146/annurev-psych-113011-143802.Search in Google Scholar

Goldin-Meadow, Susan, Susan C. Levine, Elena Zinchenko, Terina Kuangyi Yip, Naureen Hemani & Laiah Factor. 2012. Doing gesture promotes learning a mental transformation task better than seeing gesture. Developmental Science 15(6). 876–884. https://doi.org/10.1111/j.1467-7687.2012.01185.x.Search in Google Scholar

Halliday, Michael A. K. 1996. On grammar and grammatics. In Ruqaiya Hasan, Carmel Cloran & David Butt (eds.), Functional descriptions: Theory into practice, 1–38. Amsterdam: Benjamins.10.1075/cilt.121.03halSearch in Google Scholar

Halliday, Michael A. K. & Christian M. I. M. Matthiessen. 2004. An introduction to functional grammar. New York: Hodder Arnold.Search in Google Scholar

Halliday, Michael A. K. & Christian M. I. M. Matthiessen. 2014. Halliday’s introduction to functional grammar. London & New York: Routledge.10.4324/9780203783771Search in Google Scholar

Halliday, Michael A. K. & James R. Martin. 1993. Writing science: Literacy and discursive power. Bristol and London: The Falmer Press.Search in Google Scholar

Halliday, Michael A. K. & William S. Greaves. 2008. Intonation in the grammar of English. London: Equinox.Search in Google Scholar

Hao, Jing & Susan Hood. 2019. Valuing science: The role of language and body language in a health science lecture. Journal of Pragmatics 139. 200–215. https://doi.org/10.1016/j.pragma.2017.12.001.Search in Google Scholar

He, Qiuping & Gail Forey. 2018. Meaning-making in a secondary science classroom: A systemic functional multimodal discourse analysis. In Kok-Sing Tang & Kristina Danielsson (eds.), Global developments in literacy research for science education, 183–202. Berlin: Springer.10.1007/978-3-319-69197-8_12Search in Google Scholar

Hodge, Robert & Günther Kress. 1988. Social semiotics. Ithaca, NY: Cornell University Press.Search in Google Scholar

Hood, Susan. 2007. Embodying language: Bringing gesture in from the paralinguistic cold. Paper presented at Semiotic margins: Reclaiming meaning, Sydney.Search in Google Scholar

Hood, Susan. 2011. Body language in face-to-face teaching: A focus on textual and interpersonal meaning. In Shoshana Dreyfus, Susan Hood & Maree Stinglin (eds.), Semiotic margin: Meaning in multimodalities, 31–52. London: Continuum.Search in Google Scholar

Hood, Susan. 2017. Live lectures: The significance of presence in building disciplinary knowledge. Onomazein 35. 179–208. https://doi.org/10.7764/onomazein.ne2.07.Search in Google Scholar

Hood, Susan & Jo Leander. 2016. Technologies, modes and pedagogic potential in live versus online lectures. International Journal of Language Studies 10(3). 23–42.Search in Google Scholar

Hood, Susan & Patricia Maggiora. 2016. The lecturer at work: Language, the body and space in the structuring of disciplinary knowledge in law. In Joyce De Silva (ed.), Language at work, 108–128. Newcastle: Cambridge Scholars.Search in Google Scholar

Hostetter, Autumn B. 2011. When do gestures communicate? A meta-analysis. Psychological Bulletin 137(2). 297–315. https://doi.org/10.1037/a0022128.Search in Google Scholar

Jaipal, Kamini. 2010. Meaning making through multiple modalities in a biology classroom: A multimodal semiotics discourse analysis. Science Education 94(1). 48–72. https://doi.org/10.1002/sce.20359.Search in Google Scholar

Jewitt, Carey. 2008. Multimodality and literacy in school classrooms. Review of Research in Education 32. 241–267. https://doi.org/10.3102/0091732x07310586.Search in Google Scholar

Jewitt, Carey, Gunther Kress, Jon Ogborn & Charalampos Tsatsarelis. 2001. Exploring learning through visual, actional and linguistic communication: The multimodal environment of a science classroom. Educational Review 53(1). 5–18. https://doi.org/10.1080/00131910123753.Search in Google Scholar

Jewitt, Carey, Jeff Bezemer & Kay O’Halloran. 2016. Introducing multimodality. New York: Routledge.10.4324/9781315638027Search in Google Scholar

Kendon, Adam. 2004. Gesture: Visible action as utterance. Cambridge: Cambridge University Press.10.1017/CBO9780511807572Search in Google Scholar

Kress, Günther. 2010. Multimodality: A social semiotic approach to contemporary communication. London & New York: Routledge.Search in Google Scholar

Lambrinos, Elena. 2015. Embodied knowledge and body knowledge: Using LCT to explore dance and gesture in education. Paper presented at the First international legitimation code theory colloquium, Cape Town.Search in Google Scholar

Leeuwen, Theo van. 1999. Speech, music, sound. London: Macmillan.10.1007/978-1-349-27700-1Search in Google Scholar

Lemke, Jay L. 1990. Talking science: Language, learning, and values. Norwood, NJ: Ablex.Search in Google Scholar

Lemke, Jay L. 1998. Multiplying meaning: Visual and verbal semiotics in scientific text. In Jim R. Martin & Robert Veel (eds.), Reading science: Critical and functional perspectives on discourses of science, 87–114. London & New York: Routledge.Search in Google Scholar

Lim, Victor Fei. 2011. A systemic functional multimodal discourse analysis approach to pedagogic discourse. Singapore: National University of Singapore PhD dissertation.Search in Google Scholar

Lim, Victor Fei. 2019a. Analyzing the teachers’ use of gestures in the classroom: A systemic functional multimodal discourse analysis approach. Social Semiotics 29(1). 83–111. https://doi.org/10.1080/10350330.2017.1412168.Search in Google Scholar

Lim, Fei Victor. 2019b. Investigating intersemiosis: A systemic functional multimodal discourse analysis of the relationship between language and gesture in classroom discourse. Visual Communication 20(1). 34–58. https://doi.org/10.1177/1470357218820695.Search in Google Scholar

Liu, Qingtang, Ni Zhang, Wenli Chen, Qiyun Wang, Yangyang Yuan & Kui Xie. 2020. Categorizing teachers’ gestures in classroom teaching: From the perspective of multiple representations. Social Semiotics 32(2). 184–204. https://doi.org/10.1080/10350330.2020.1722368.Search in Google Scholar

Liu, Yu & Yuet See Monica Owyong. 2011. Metaphor, multiplicative meaning and the semiotic construction of scientific knowledge. Language Sciences 33(5). 822–834. https://doi.org/10.1016/j.langsci.2011.02.006.Search in Google Scholar

Martinec, Radan. 2000. Types of process in action. Semiotica 130(3/4). 243–268. https://doi.org/10.1515/semi.2000.130.3-4.243.Search in Google Scholar

Martinec, Radan. 2001. Interpersonal resources in action. Semiotica 135(1/4). 117–145.10.1515/semi.2001.056Search in Google Scholar

Martin, James R. 1992. English text: System and structure. Amsterdam: Benjamins.10.1075/z.59Search in Google Scholar

Martin, James R. 1999. Mentoring semogenesis: “Genre-based” literacy pedagogy. In Frances Christie (ed.), Pedagogy and the shaping of consciousness: Linguistic and social processes, 123–155. London: Continuum.Search in Google Scholar

Martin, James R. 2011. Multimodal semiotics: Theoretical challenges. In Shoshana Dreyfus, Susan Hood & Maree Stinglin (eds.), Semiotic margin: Meaning in multimodalities, 243–270. London: Continuum.Search in Google Scholar

Martin, James R. 2012. Register studies (Collected Works of J. R. Martin 4), Wang Zhenhua (ed.). Shangai: Shanghai Jiao Tong University Press.Search in Google Scholar

Martin, James R. & David Rose. 2007. Working with discourse: Meaning beyond the clause. New York: Continuum.Search in Google Scholar

Martin, James R. & Erika Matruglio. 2013. Revisiting mode: Context in/dependency in ancient history classroom discourse. In Huang Guowen, Zhang Delu & Yang Xinzhang (eds.), Studies in functional linguistics and discourse analysis, 72–295. Beijing: Higher Education Press.Search in Google Scholar

Martin, James R. & Michele Zappavigna. 2019. Embodied meaning: A systemic functional perspective on paralanguage. Functional Linguistics 6(1). 1–33. https://doi.org/10.1186/s40554-018-0065-9.Search in Google Scholar

Martin, James R. & Peter White. 2005. Language of evaluation: Appraisal in English. Basingstoke: Palgrave Macmillan.Search in Google Scholar

Marton, Ference & Shirley Booth. 1997. Learning and awareness. New York: Lawrence Erlbaum.Search in Google Scholar

Maton, Karl. 2014. Knowledge and knowers: Towards a realist sociology of education. London: Routledge.10.4324/9780203885734Search in Google Scholar

Norris, Sigrid. 2011. Three hierarchical positions of deictic gesture in relation to spoken language: A multimodal interaction analysis. Visual Communication 10(2). 129–147. https://doi.org/10.1177/1470357211398439.Search in Google Scholar

Norris, Sigrid. 2016. Concepts in multimodal discourse analysis with examples from video conferencing. Yearbook of the Poznan Linguistic Meeting 2(1). 141–165. https://doi.org/10.1515/yplm-2016-0007.Search in Google Scholar

O’Halloran, Kay L. 2007. Systemic functional multimodal discourse analysis (SF–MDA): Approach to mathematics, grammar, and literacy. In Anne McCabe, Mick O’Donnell & Rachel Whittaker (eds.), Advances in language and education, 77–102. London: Continuum.Search in Google Scholar

O’Halloran, Kay L. 2008. Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication 7(4). 443–475. https://doi.org/10.1177/1470357208096210.Search in Google Scholar

O’Halloran, Kay L. & Victor Fei Lim. 2014. Systemic functional multimodal discourse analysis. Interactions, Images and Texts 11. 137–154.10.1515/9781614511175.137Search in Google Scholar

Pozzer, Lilian & Wolff Michael Roth. 2020. A cultural-historical perspective on the multimodal development of concepts in science lectures. Cultural Studies of Science Education 15(1). 31–70. https://doi.org/10.1007/s11422-019-09910-5.Search in Google Scholar

Roth, Wolff Michael. 2001. Gestures: Their role in teaching and learning. Review of Educational Research 71(3). 365–392. https://doi.org/10.3102/00346543071003365.Search in Google Scholar

Roth, Wolff-Michael. 2003. From epistemic (ergotic) actions to scientific discourse: The bridging function of gestures. Pragmatics & Cognition 11(1). 141–170. https://doi.org/10.1075/pc.11.1.06rot.Search in Google Scholar

Roth, Wolff Michael & Manuela Welzel. 2001. From activity to gestures and scientific language. Journal of Research in Science Teaching 38(1). 103–136. https://doi.org/10.1002/1098-2736(200101)38:1<103::aid-tea6>3.0.co;2-g.10.1002/1098-2736(200101)38:1<103::AID-TEA6>3.0.CO;2-GSearch in Google Scholar

Rui, Ning & Jill Feldman. 2012. IRR (Inter-Rater Reliability) of a COP (Classroom Observation Protocol): A critical appraisal. US-China Education Review B3. 305–315.Search in Google Scholar

Smith, Michelle K., Francis H. M. Jones, Sarah L. Gilbert & Carl E. Wieman. 2013. Classroom observation protocol for undergraduate STEM – COPUS observation codes. CBE-Life Sciences Education 12(4). 618–627. https://doi.org/10.1187/cbe.13-08-0154.Search in Google Scholar

Tang, Kok-Sing, Seng Chee Tan & Jennifer Yeo. 2011. Students’ multimodal construction of the work-energy concept. International Journal of Science Education 33(13). 1775–1804. https://doi.org/10.1080/09500693.2010.508899.Search in Google Scholar

Vygotsky, Lev. 1978. Mind in society: The development of higher pedagogical processes. In Michael Cole, Vera John-Steiner, Sylvia Scribner & Ellen Souberman (eds.), Mind in society, 36–112. Cambridge: Harvard University Press.Search in Google Scholar

Waldrip, Bruce, Vaughan Prain & Jim Carolan. 2010. Using multi-modal representations to improve learning in junior secondary science. Research in Science Education 40(1). 65–80. https://doi.org/10.1007/s11165-009-9157-6.Search in Google Scholar

Walsh, Steve. 2011. Exploring classroom discourse: Language in action. London & New York: Routledge.10.4324/9780203827826Search in Google Scholar

Wartofsky, Marx W. 1979. Models: Representational and the scientific understanding, vol. 48. Dordrecht: Reidel.Search in Google Scholar

West, Emily A., Cassandra A. Paul, David Webb & Wendell H. Potter. 2013. Variation of instructor-student interactions in an introductory interactive physics course. Physical Review Special Topics – Physics Education Research 9(1). 010109. https://doi.org/10.1103/physrevstper.9.010109.Search in Google Scholar

Zappavigna, Michele, Chris Cleirigh, Paul Dwyer & James R. Martin. 2010. The coupling of gesture and phonology. In Monika Bednarek & James R. Martin (eds.), New discourse on language, 237–266. London: Continuum.Search in Google Scholar

Zhao, Sumin & Emilia Djonov. 2017. Social semiotics: A theory and a theorist in retrospect and prospect. In Sumin Zhao, Emilia Djonov, Anders Björkvall & Morten Boeriis (eds.), Advancing multimodal and critical discourse studies. New York: Taylor & Francis.10.4324/9781315521015Search in Google Scholar

Received: 2020-10-31
Accepted: 2023-01-13
Published Online: 2023-05-26
Published in Print: 2023-07-26

© 2023 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 28.4.2024 from https://www.degruyter.com/document/doi/10.1515/sem-2020-0107/html
Scroll to top button