Abstract
This paper presents a pilot study in the analysis of emotion integrating approaches from traditionally separate theoretical backgrounds: socio-semiotic studies and cognitive studies. The general aim is to identify a flexible and comprehensive framework for critical multimodal analysis of visual, verbal (oral, written and a blend of the two), kinetic, sound, music and graphic aspects. The case-study, exemplifying this kind of integrated approach in its initial stages, identifies the voices of emotion as expressed in the trailer of the film An Inconvenient Truth (2006) and discusses their intertextual and interdiscoursal characteristics. Aspects of the on-going research projects are discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baldry, A. (ed.): Multimodality and Multimediality in the Distance Learning Age. Palladino, Campobasso (2000)
Baldry, A.: A Multimodal Approach to Text Studies in English. Palladino, Campobasso (2005)
Baldry, A., Thibault, P.J.: Multimodal Transcription and Text Analysis Equinox, London (2006)
Bakhtin, M.: The Dialogical Imagination. University of Texas Press, Austin (1981)
Bednarek, M.: Emotion Talk across Corpora. Palgrave Macmillan, Basingstoke (2008)
Cortese, G., Duszak, A. (eds.): Identity, Community, Discourse. English in Intercultural Settings. Peter Lang, Bern (2005)
Damasio, A.R.: Looking for Spinoza: Joy, Sorrow and the Feeling Brain. Harvest Books, Washington (2003)
Damasio, A.R.: Emotion in the perspective of an integrated nervous system. Brain Research Reviews 26(2-3), 83–86 (1998)
Damasio, A.R.: The Feeling of What Happens: Body, Emotion and the Making of Consciousness, London, Heinemann (1999)
Davies, M., Ravelli, L. (eds.): Advances in Systemic Linguistics. Recent Theory and Practice. Pinter, London (1992)
Dusi, N.: Le forme del trailer come manipolazione intrasemiotica. In: Pezzini, I. (ed.) Trailer, spot, clip, siti, banner, Le forme brevi della comunicazione audiovisiva, pp. 31–66. Meltemi, Roma (2002)
Ekman, P.: Should we call it expression or communication? Social Science Research 10(4), 333–344 (1997)
Ekman P.: Basic Emotions (1999), http://www.paulekman.com/pdfs/basic_emotions.pdf (last accessed, 20-1-2009)
Esposito, A., et al. (eds.): Multimodal Signals: Cognitive and Algorithmic Issues. Springer, Berlin (2009)
Fairclough, N. (ed.): Critical Language Awareness. Longman, London (1992)
Fairclough, N.: Language and Power, 2nd edn. Pearson Education, London (2001)
Fairclough, N.: Analysing Discourse: Textual Analysis for Social Research. Routledge, London (2003)
Fairclough, N.: Language and Globalization. Routledge, London (2006)
Fedeli, D.: Emozioni e successo scolastico. Carocci, Roma (2006)
Forceville, C.: Pictorial Metaphor in Advertising. Routledge, London (1996)
Forceville, C.: Metaphor in Pictures and Multimodal Representations. In: Gibbs, R. (ed.) The Cambridge Handbook of Metaphor and Though, pp. 462–481. C.U.P., Cambridge (2008)
Fussell, S.R.: The Verbal Communication of Emotions. In: An Interdisciplinary Perspective. Lawrence Erlbaum Associates, Mahwah (2002)
Gallois, C.: Group membership, social rules, and power: a socio-psychological perspective on emotional communication. Journal of Pragmatics 22, 301–324 (1994)
Goatly, A.: Washing the Brain – Metaphor and Hidden Ideology. John Benjamins, Amsterdam (2007)
Halliday, M.A.K.: An Introduction to Functional Grammar, 2nd edn. Edward Arnold, London (1994)
Halliday, M.A.K., Matthiessen, C.M.I.M.: An Introduction to Functional Grammar, 3rd edn. Edward Arnold, London (2004)
Hasan, R., Matthiessen, C., Webster, J. (eds.): Continuing Discourse on Language. A Functional Perspective. Continuum, London (2005)
Hodge, R., Kress, G.: Language as Ideology, 2nd edn. Routledge, London (1993)
Holquist, M.: Glossary. In: Bakhtin, M. (ed.) The Dialogical Imagination, pp. 423–434. University of Texas Press, Austin (1981)
Hunston, S., Thompson, G. (eds.): Evaluation in Text: Authorial Stance and the Construction of Discourse. Oxford University Press, Oxford (2000)
Iedema, R.: Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice. Visual Communication 2(1), 29–57 (2003)
Johnson-Laird, P.N., Oatley, K.: The language of emotions: An analysis of a semantic field. Cognition and Emotion 3, 81–123 (1898)
Kővecses, Z.: Metaphor and emotion. Cambridge University Press, Cambridge (2000)
Kővecses, Z.: Metaphor in Culture. Cambridge University Press, Cambridge (2005)
Kress, G.: Literacy in the New Media Age. Routledge, London (2003)
Kress, G., van Leeuwen, T.: Multimodal Discourse. Edward Arnold, London (2001)
Kress, G., van Leeuwen, T.: Colour as a semiotic mode: notes for a grammar of colour. Visual Communication 1(3), 343–368 (2002)
Kress, G., van Leeuwen, T.: Reading Images: The Grammar of Visual Design. Routledge, London (2006)
Lakoff, G., Johnson, M.: Metaphors We Live By. The Chicago University Press, Chicago (1980)
Lassen, I., Strunck, J., Vestergaard, T. (eds.): Mediating Ideology in Text and Image. John Benjamins, Amsterdam (2006)
Ledoux, J.: Il cervello emotivo. Baldini and Castoldi, Milano (1998)
Maier, C.D.: The Promotional Genre of Film Trailers: Persuasive Structures in a Multimodal Form. Unpublished Ph.D Thesis, Aarhus school of Business, University of Aarhus, Denmark (2006)
Martin, J.R.: English Text: System and Structure. John Benjamins, Amsterdam (1992)
Martin, J.R., White, P.R.R.: The Language of Evaluation: Appraisal in English. Palgrave, London (2005)
Martin, J.R., Wodak, R. (eds.): Re/reading the past. Critical and functional perspectives on time and value. John Benjamins, Amsterdam (2003)
Niemeier, S., Dirven, R. (eds.): The Language of Emotions. John Benjamins, Amsterdam (1997)
Norris, S.: Analysing Multimodal Interaction: A Methodological Framework. Routledge, London (2004)
Norris, S., Jones, R.H. (eds.): Discourse in Action. Introducing Mediated Discourse Analysis. Routledge, London (2005)
Oatley, K., keltner, D., Jenkins, J.: Understanding Emotions. Blackwell, Oxford (2006)
O’Halloran, K. (ed.): Multimodal Discourse Analysis. Systemic-Functional Perspectives. Continuum, London (2004)
Riley, P.: Epistemic Communities: The Social Knowledge System, Discourse and Identity. In: Cortese, G., Riley, P. (eds.) Domain-specific English. Textual Practices across Communities and Classrooms, pp. 41–64. Peter Lang, Bern (2002)
Robinson, J.: Deeper than Reason: Emotion and Its Role in Literature, Music, and Art. O.U.P., Oxford (2005)
Semino, E.: Metaphor in Discourse. C.U.P., Cambridge (2008)
Scherer, K.R.: What are Emotions? And how can they be measured? Social Science Information 44(4), 695–729 (2005)
Turner, J., Stets, J.E.: The Sociology of Emotions. C.U.P., Cambridge (2005)
Van Dijk, T.A.: Critical Discourse Analysis. In: Schriffrin, D., Tannen, D., Hamilton, H.E. (eds.) The Handbook of Discourse Analysis, pp. 352–371. Blackwell, Oxford (2001)
Van Dijk, T.A.: The Discourse-Knowledge Interface. In: Weiss, G., Wodak, R. (eds.) Methods of Critical Discourse Analysis, pp. 95–120. Sage, London (2003)
Van Dijk, T.A.: Contextual Knowledge Management in Discourse Production. A CDA Perspective. In: Wodak, R., Chilton, P.A. (eds.) New Agenda in CDA, pp. 71–100. Benjamins, Amsterdam (2005)
Van Dijk, T.A.: Discourse and Power. Palgrave Macmillan, Basingstoke (2008)
Van Leeuwen, T.: Moving English: The Visual Language of Film. In: Goodman, S., Graddol, D. (eds.) Redesigning English: New Texts, New Identities, pp. 81–105. Routledge, London (1996)
Van Leeuven, T.: Speech, Music, Sound. Macmillan, London (1999)
Van Leeuwen, T., Machin, D.: Global Media Discourse. Routledge, London (2007)
Vincent, J., Fortunati, L. (eds.): Electronic Emotion, the Mediation of Emotion via Information and Communication Technologies. Peter Lang, Oxford (2009)
Weiss, G., Wodak, R. (eds): Critical Discourse Analysis. Theory and Interdisciplinarity. Palgrave Macmillan, Basingstoke (2002)
Wenger, E.: Communities of Practice, Learning, Meaning and Identity, 2nd edn. Cambridge University Press, Cambridge (1999)
White, P.R.R.: Appraisal – The Language of Evaluation and Intersubjective Stance (2005), www.grammatics.com/appraisal/ (last accessed, 20-1-2009)
White, P.R.R.: Evaluative semantics and ideological positioning in journalistic discourse. A new framework for analysis. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 37–67. John Benjamins, Amsterdam (2006)
Wierzbicka, A.: Emotions across languages and cultures: Diversity and Universals. Cambridge University Press, Cambridge (1999)
Wodak, R.: What CDA is about – a summary of its history, important concepts and its developments. In: Wodak, R., Meyer, M. (eds.) Methods in Critical Discourse Analysis, pp. 1–13. Sage, London (2001)
Wodak, R.: Images in/and news in a globalised world. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 1–16. John Benjamins, Amsterdam (2006)
Wodak, R., Meyer, M. (eds.): Methods in Critical Discourse Analysis. Sage, London (2001)
An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), www.climatecrisis.net (last accessed, 3-4-2009)
An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), http://www.climatecrisis.net/trailer/ (last accessed, 3-4-2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bortoluzzi, M. (2009). Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer. In: Esposito, A., Vích, R. (eds) Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions. Lecture Notes in Computer Science(), vol 5641. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03320-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-03320-9_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03319-3
Online ISBN: 978-3-642-03320-9
eBook Packages: Computer ScienceComputer Science (R0)