Skip to main content
SpringerLink
Log in

Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer

  • Conference paper
Book cover Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5641))

Abstract

This paper presents a pilot study in the analysis of emotion integrating approaches from traditionally separate theoretical backgrounds: socio-semiotic studies and cognitive studies. The general aim is to identify a flexible and comprehensive framework for critical multimodal analysis of visual, verbal (oral, written and a blend of the two), kinetic, sound, music and graphic aspects. The case-study, exemplifying this kind of integrated approach in its initial stages, identifies the voices of emotion as expressed in the trailer of the film An Inconvenient Truth (2006) and discusses their intertextual and interdiscoursal characteristics. Aspects of the on-going research projects are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baldry, A. (ed.): Multimodality and Multimediality in the Distance Learning Age. Palladino, Campobasso (2000)

    Google Scholar 

  2. Baldry, A.: A Multimodal Approach to Text Studies in English. Palladino, Campobasso (2005)

    Google Scholar 

  3. Baldry, A., Thibault, P.J.: Multimodal Transcription and Text Analysis Equinox, London (2006)

    Google Scholar 

  4. Bakhtin, M.: The Dialogical Imagination. University of Texas Press, Austin (1981)

    Google Scholar 

  5. Bednarek, M.: Emotion Talk across Corpora. Palgrave Macmillan, Basingstoke (2008)

    Book  Google Scholar 

  6. Cortese, G., Duszak, A. (eds.): Identity, Community, Discourse. English in Intercultural Settings. Peter Lang, Bern (2005)

    Google Scholar 

  7. Damasio, A.R.: Looking for Spinoza: Joy, Sorrow and the Feeling Brain. Harvest Books, Washington (2003)

    Google Scholar 

  8. Damasio, A.R.: Emotion in the perspective of an integrated nervous system. Brain Research Reviews 26(2-3), 83–86 (1998)

    Article  Google Scholar 

  9. Damasio, A.R.: The Feeling of What Happens: Body, Emotion and the Making of Consciousness, London, Heinemann (1999)

    Google Scholar 

  10. Davies, M., Ravelli, L. (eds.): Advances in Systemic Linguistics. Recent Theory and Practice. Pinter, London (1992)

    Google Scholar 

  11. Dusi, N.: Le forme del trailer come manipolazione intrasemiotica. In: Pezzini, I. (ed.) Trailer, spot, clip, siti, banner, Le forme brevi della comunicazione audiovisiva, pp. 31–66. Meltemi, Roma (2002)

    Google Scholar 

  12. Ekman, P.: Should we call it expression or communication? Social Science Research 10(4), 333–344 (1997)

    Article  MathSciNet  Google Scholar 

  13. Ekman P.: Basic Emotions (1999), http://www.paulekman.com/pdfs/basic_emotions.pdf (last accessed, 20-1-2009)

  14. Esposito, A., et al. (eds.): Multimodal Signals: Cognitive and Algorithmic Issues. Springer, Berlin (2009)

    Google Scholar 

  15. Fairclough, N. (ed.): Critical Language Awareness. Longman, London (1992)

    Google Scholar 

  16. Fairclough, N.: Language and Power, 2nd edn. Pearson Education, London (2001)

    Google Scholar 

  17. Fairclough, N.: Analysing Discourse: Textual Analysis for Social Research. Routledge, London (2003)

    Google Scholar 

  18. Fairclough, N.: Language and Globalization. Routledge, London (2006)

    Google Scholar 

  19. Fedeli, D.: Emozioni e successo scolastico. Carocci, Roma (2006)

    Google Scholar 

  20. Forceville, C.: Pictorial Metaphor in Advertising. Routledge, London (1996)

    Book  Google Scholar 

  21. Forceville, C.: Metaphor in Pictures and Multimodal Representations. In: Gibbs, R. (ed.) The Cambridge Handbook of Metaphor and Though, pp. 462–481. C.U.P., Cambridge (2008)

    Chapter  Google Scholar 

  22. Fussell, S.R.: The Verbal Communication of Emotions. In: An Interdisciplinary Perspective. Lawrence Erlbaum Associates, Mahwah (2002)

    Google Scholar 

  23. Gallois, C.: Group membership, social rules, and power: a socio-psychological perspective on emotional communication. Journal of Pragmatics 22, 301–324 (1994)

    Article  Google Scholar 

  24. Goatly, A.: Washing the Brain – Metaphor and Hidden Ideology. John Benjamins, Amsterdam (2007)

    Book  Google Scholar 

  25. Halliday, M.A.K.: An Introduction to Functional Grammar, 2nd edn. Edward Arnold, London (1994)

    Google Scholar 

  26. Halliday, M.A.K., Matthiessen, C.M.I.M.: An Introduction to Functional Grammar, 3rd edn. Edward Arnold, London (2004)

    Google Scholar 

  27. Hasan, R., Matthiessen, C., Webster, J. (eds.): Continuing Discourse on Language. A Functional Perspective. Continuum, London (2005)

    Google Scholar 

  28. Hodge, R., Kress, G.: Language as Ideology, 2nd edn. Routledge, London (1993)

    Google Scholar 

  29. Holquist, M.: Glossary. In: Bakhtin, M. (ed.) The Dialogical Imagination, pp. 423–434. University of Texas Press, Austin (1981)

    Google Scholar 

  30. Hunston, S., Thompson, G. (eds.): Evaluation in Text: Authorial Stance and the Construction of Discourse. Oxford University Press, Oxford (2000)

    Google Scholar 

  31. Iedema, R.: Multimodality, resemiotization: extending the analysis of discourse as multi-semiotic practice. Visual Communication 2(1), 29–57 (2003)

    Article  Google Scholar 

  32. Johnson-Laird, P.N., Oatley, K.: The language of emotions: An analysis of a semantic field. Cognition and Emotion 3, 81–123 (1898)

    Article  Google Scholar 

  33. Kővecses, Z.: Metaphor and emotion. Cambridge University Press, Cambridge (2000)

    Google Scholar 

  34. Kővecses, Z.: Metaphor in Culture. Cambridge University Press, Cambridge (2005)

    Book  Google Scholar 

  35. Kress, G.: Literacy in the New Media Age. Routledge, London (2003)

    Book  Google Scholar 

  36. Kress, G., van Leeuwen, T.: Multimodal Discourse. Edward Arnold, London (2001)

    Google Scholar 

  37. Kress, G., van Leeuwen, T.: Colour as a semiotic mode: notes for a grammar of colour. Visual Communication 1(3), 343–368 (2002)

    Article  Google Scholar 

  38. Kress, G., van Leeuwen, T.: Reading Images: The Grammar of Visual Design. Routledge, London (2006)

    Google Scholar 

  39. Lakoff, G., Johnson, M.: Metaphors We Live By. The Chicago University Press, Chicago (1980)

    Google Scholar 

  40. Lassen, I., Strunck, J., Vestergaard, T. (eds.): Mediating Ideology in Text and Image. John Benjamins, Amsterdam (2006)

    Google Scholar 

  41. Ledoux, J.: Il cervello emotivo. Baldini and Castoldi, Milano (1998)

    Google Scholar 

  42. Maier, C.D.: The Promotional Genre of Film Trailers: Persuasive Structures in a Multimodal Form. Unpublished Ph.D Thesis, Aarhus school of Business, University of Aarhus, Denmark (2006)

    Google Scholar 

  43. Martin, J.R.: English Text: System and Structure. John Benjamins, Amsterdam (1992)

    Book  Google Scholar 

  44. Martin, J.R., White, P.R.R.: The Language of Evaluation: Appraisal in English. Palgrave, London (2005)

    Book  Google Scholar 

  45. Martin, J.R., Wodak, R. (eds.): Re/reading the past. Critical and functional perspectives on time and value. John Benjamins, Amsterdam (2003)

    Google Scholar 

  46. Niemeier, S., Dirven, R. (eds.): The Language of Emotions. John Benjamins, Amsterdam (1997)

    Google Scholar 

  47. Norris, S.: Analysing Multimodal Interaction: A Methodological Framework. Routledge, London (2004)

    Google Scholar 

  48. Norris, S., Jones, R.H. (eds.): Discourse in Action. Introducing Mediated Discourse Analysis. Routledge, London (2005)

    Google Scholar 

  49. Oatley, K., keltner, D., Jenkins, J.: Understanding Emotions. Blackwell, Oxford (2006)

    Google Scholar 

  50. O’Halloran, K. (ed.): Multimodal Discourse Analysis. Systemic-Functional Perspectives. Continuum, London (2004)

    Google Scholar 

  51. Riley, P.: Epistemic Communities: The Social Knowledge System, Discourse and Identity. In: Cortese, G., Riley, P. (eds.) Domain-specific English. Textual Practices across Communities and Classrooms, pp. 41–64. Peter Lang, Bern (2002)

    Google Scholar 

  52. Robinson, J.: Deeper than Reason: Emotion and Its Role in Literature, Music, and Art. O.U.P., Oxford (2005)

    Book  Google Scholar 

  53. Semino, E.: Metaphor in Discourse. C.U.P., Cambridge (2008)

    Google Scholar 

  54. Scherer, K.R.: What are Emotions? And how can they be measured? Social Science Information 44(4), 695–729 (2005)

    Article  Google Scholar 

  55. Turner, J., Stets, J.E.: The Sociology of Emotions. C.U.P., Cambridge (2005)

    Book  Google Scholar 

  56. Van Dijk, T.A.: Critical Discourse Analysis. In: Schriffrin, D., Tannen, D., Hamilton, H.E. (eds.) The Handbook of Discourse Analysis, pp. 352–371. Blackwell, Oxford (2001)

    Google Scholar 

  57. Van Dijk, T.A.: The Discourse-Knowledge Interface. In: Weiss, G., Wodak, R. (eds.) Methods of Critical Discourse Analysis, pp. 95–120. Sage, London (2003)

    Google Scholar 

  58. Van Dijk, T.A.: Contextual Knowledge Management in Discourse Production. A CDA Perspective. In: Wodak, R., Chilton, P.A. (eds.) New Agenda in CDA, pp. 71–100. Benjamins, Amsterdam (2005)

    Google Scholar 

  59. Van Dijk, T.A.: Discourse and Power. Palgrave Macmillan, Basingstoke (2008)

    Book  Google Scholar 

  60. Van Leeuwen, T.: Moving English: The Visual Language of Film. In: Goodman, S., Graddol, D. (eds.) Redesigning English: New Texts, New Identities, pp. 81–105. Routledge, London (1996)

    Google Scholar 

  61. Van Leeuven, T.: Speech, Music, Sound. Macmillan, London (1999)

    Google Scholar 

  62. Van Leeuwen, T., Machin, D.: Global Media Discourse. Routledge, London (2007)

    Google Scholar 

  63. Vincent, J., Fortunati, L. (eds.): Electronic Emotion, the Mediation of Emotion via Information and Communication Technologies. Peter Lang, Oxford (2009)

    Google Scholar 

  64. Weiss, G., Wodak, R. (eds): Critical Discourse Analysis. Theory and Interdisciplinarity. Palgrave Macmillan, Basingstoke (2002)

    Google Scholar 

  65. Wenger, E.: Communities of Practice, Learning, Meaning and Identity, 2nd edn. Cambridge University Press, Cambridge (1999)

    Google Scholar 

  66. White, P.R.R.: Appraisal – The Language of Evaluation and Intersubjective Stance (2005), www.grammatics.com/appraisal/ (last accessed, 20-1-2009)

  67. White, P.R.R.: Evaluative semantics and ideological positioning in journalistic discourse. A new framework for analysis. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 37–67. John Benjamins, Amsterdam (2006)

    Chapter  Google Scholar 

  68. Wierzbicka, A.: Emotions across languages and cultures: Diversity and Universals. Cambridge University Press, Cambridge (1999)

    Book  Google Scholar 

  69. Wodak, R.: What CDA is about – a summary of its history, important concepts and its developments. In: Wodak, R., Meyer, M. (eds.) Methods in Critical Discourse Analysis, pp. 1–13. Sage, London (2001)

    Chapter  Google Scholar 

  70. Wodak, R.: Images in/and news in a globalised world. In: Lassen, I., Strunck, J., Vestergaard, T. (eds.) Mediating Ideology in Text and Image, pp. 1–16. John Benjamins, Amsterdam (2006)

    Chapter  Google Scholar 

  71. Wodak, R., Meyer, M. (eds.): Methods in Critical Discourse Analysis. Sage, London (2001)

    Google Scholar 

  72. An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), www.climatecrisis.net (last accessed, 3-4-2009)

  73. An Inconvenient Truth. A Global Warning. Paramount Classics, directed by Davis Guggenheim, U.S.A. (2006), http://www.climatecrisis.net/trailer/ (last accessed, 3-4-2009)

Download references

Author information

Authors and Affiliations

  1. Faculty of Education, Multimedia Science and Technology, University of Udine, Via Prasecco, 3, 33170, Pordenone, Italy

    Maria Bortoluzzi

Authors
  1. Maria Bortoluzzi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Psychology, Second University of Naples, and IIASS, Via G. Pellegrino 19, 84019, Vietri sul Mare, (SA), Italy

    Anna Esposito

  2. Institute of Photonics and Electronics, Academy of Sciences of the Czech Republic, Chaberská 57, 182 52, Prague 8, Czech Republic

    Robert Vích

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bortoluzzi, M. (2009). Towards a Framework of Critical Multimodal Analysis: Emotion in a Film Trailer. In: Esposito, A., Vích, R. (eds) Cross-Modal Analysis of Speech, Gestures, Gaze and Facial Expressions. Lecture Notes in Computer Science(), vol 5641. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03320-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03320-9_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03319-3

  • Online ISBN: 978-3-642-03320-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation