Skip to main content
SpringerLink
Log in

Meta-Analysis of Emotional Designs in Multimedia Learning: A Replication and Extension Study

  • Meta-Analysis
  • Published:
Educational Psychology Review Aims and scope Submit manuscript

Abstract

Emotions can both facilitate and hinder learning. Emotional design features such as colors and shapes can be embedded in multimedia learning environments to manipulate learners’ affects and learning outcomes. However, some studies suggest that emotional designs promote learning, while others show that they hinder it. Although Brom et al. (Educational Research Review 25:100–119, Brom et al. 2018) published a meta-analysis on the use of emotional designs in multimedia learning, an updated search showed that more studies were published recently. Thus, the present meta-analysis is a replication and extension of Brom et al.’s (Educational Research Review 25:100–119, Brom et al. 2018) meta-analysis. A total of 28 articles yielded the following independent effect sizes for each outcome examined: retention (k = 28), transfer (k = 38), comprehension (k = 16), mental effort (k = 28), perceived difficulty (k = 19), change in positive affect (k = 25), intrinsic motivation (k = 28), and liking/enjoyment (k = 19). Results showed that including emotional designs enhanced learning outcomes (retention: g+ = 0.35; transfer: g+ = 0.27; comprehension: g+ = 0.29), change in positive affect (g+ = 0.09), intrinsic motivation (g+ = 0.15), mental effort (g+ = 0.11), liking/enjoyment (g+ = 0.10), and reduced perceived difficulty (g+ = − 0.21). Moderator analyses were conducted for retention, mental effort, intrinsic motivation, and positive affect, and findings showed that mean effect sizes were moderated by participant characteristics as well as methodological and contextual features of the studies. We discuss these findings as well as their theoretical and practical implications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

The asterisk indicates studies included in this meta-analysis.

  • Baddeley, A. (1992). Working memory. Science, 255(5044), 556–559. https://doi.org/10.1126/science.1736359.

    Article  Google Scholar 

  • Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. https://doi.org/10.2307/2533446.

    Article  Google Scholar 

  • Benjaminni, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B: Methodological, 57(1), 289–300.

    Google Scholar 

  • Berney, S., & Bétrancourt, M. (2016). Does animation enhance learning? A meta-analysis. Computers & Education, 101, 150–167. https://doi.org/10.1016/j.compedu.2016.06.005.

    Article  Google Scholar 

  • Berry, D. S., & McArthur, L. Z. (1985). Some components and consequences of a babyface. Journal of Personality and Social Psychology, 48(2), 312–323. https://doi.org/10.1037/0022-3514.48.2.312.

    Article  Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, England: Wiley.

    Book  Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2013). Comprehensive meta-analysis (Version 3.0) [Computer software]. Englewood, NJ.

  • Brand, S., Reimer, T., & Opwis, K. (2007). How do we learn in a negative mood? Effects of negative mood on transfer and learning. Learning and Instruction, 17(1), 1–16. https://doi.org/10.1016/j.learninstruc.2006.11.002.

    Article  Google Scholar 

  • *Brom, C., Hannemann, T., Stárková, T., Bromová, E., & Děchtěrenko, F. (2016). Anthropomorphic faces and funny graphics in an instructional animation may improve superficial rather than deep learning: a quasi-experimental study. In J. Novotna & A. Jancarik (Eds.), Proceedings of the 15th European Conference on e-Learning, Prague, Czech Republic (pp. 89-97). Academic Conference and Publishing International Limited: Reading, UK.

  • Brom, C., Stárková, T., & D’Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004.

    Article  Google Scholar 

  • *Chui, T. K., Jong, M. S., & Mok, I. A. C. (2020). Does learner expertise matter when designing emotional multimedia for learners of primary school mathematics? Educational Technology Research and Development. Advanced online publication. https://doi.org/10.1007/s11423-020-09775-4

  • Dehn, D. M., & van Mulken, S. (2000). The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1), 1–22. https://doi.org/10.1006/ijhc.1999.0325.

    Article  Google Scholar 

  • *Dong, C. (2007). Positive emotions and learning: what makes a difference in multimedia design? (Unpublished doctoral dissertation). New York University: New York.

  • Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple graphical test. British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629.

    Article  Google Scholar 

  • Franco, A., Malhotra, N., & Simonovits, G. (2014). Publication bias in the social sciences: unlocking the file drawer. Science, 345(6203), 1502–1505. https://doi.org/10.1126/science.1255484.

    Article  Google Scholar 

  • *Gong, S., Shangguan, C., Zhai, K., & Guo, Y. (2017). The effects of emotional design on multimedia learning. Acta Psychologica Sinica, 49(6), 771-782. https://doi.org/10.3724/SP.J.1041.2017.00771

  • Gorn, G. J., Chattopadhyay, A., Yi, T., & Dahl, D. W. (1997). Effects of color as an executional cue in advertising: they’re in the shade. Management Science, 43(10), 1387–1400. https://doi.org/10.1287/mnsc.43.10.1387.

    Article  Google Scholar 

  • Grant, H., & Dweck, C. S. (2001). Cross-cultural response to failure: considering outcome attributions with different goals. In F. Salili, G. Ghiu, & Y. Hong (Eds.), Student motivation: the culture and context of learning (pp. 203–219). New York: Kluwer Academic/Plenumm Publishers.

    Chapter  Google Scholar 

  • *Haaranen, L., Ihantola, P., Sorva, J., & Vihavainen, A. (2015). In search of the emotional design effect in programming. In Proceedings of the 37th International Conference on Software Engineering, ICSE 2015, 2, 428-434.

  • Harp, S. F., & Mayer, R. E. (1998). How seductive details do their damage: a theory of cognitive interest in science learning. Journal of Educational Psychology, 50, 414–434. https://doi.org/10.1037/0022-0663.90.3.414.

    Article  Google Scholar 

  • Hasler, B. S., Kersten, B., & Sweller, J. (2007). Learner control, cognitive load and instructional animation. Applied Cognitive Psychology, 21(6), 713–729. https://doi.org/10.1002/acp.1345.

    Article  Google Scholar 

  • Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107–128.

    Article  Google Scholar 

  • *Heidig, S., Müller, J., & Reichelt, M. (2015). Emotional design in multimedia learning: differentiation on relevant design features and their effects on emotions and learning. Computers in Human Behavior, 44, 81–95. https://doi.org/10.1016/j.chb.2014.11.009

  • Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558.

    Article  Google Scholar 

  • Höffler, T. N., & Leutner, D. (2007). Instructional animation versus static pictures: a meta-analysis. Learning and Instruction, 17(6), 722–738. https://doi.org/10.1016/j.learninstruc.2007.09.013.

    Article  Google Scholar 

  • Höffler, T. N., & Schwartz, R. N. (2011). Effects of pacing and cognitive style across dynamic and non-dynamic representations. Computers & Education, 57(2), 1716–1726. https://doi.org/10.1016/j.compedu.2011.03.012.

  • Isen, A., & Reeve, M. (2005). The influence of positive affect on intrinsic and extrinsic motivation: facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 295–323. https://doi.org/10.1007/s11031-006-9019-8.

    Article  Google Scholar 

  • Isen, A. M., Daubman, K. A., & Nowicki, G. P. (1987). Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52(6), 1122–1131. https://doi.org/10.1037/0022-3514.52.6.1122.

    Article  Google Scholar 

  • Jamet, E., Gavota, M., & Quaireau, C. (2008). Attention guiding in multimedia learning. Learning and Instruction, 18(2), 135–145. https://doi.org/10.1016/j.learninstruc.2007.01.011.

    Article  Google Scholar 

  • Kumar, J. A. (2016). Effects of multimedia induced emotions on achievement, intrinsic motivation and satisfaction among polytechnic students with different levels of emotional intelligence. (Unpublished doctoral dissertation). Malaysia: Universiti Sains Malaysia.

  • *Kumar, J. A., Balakrishnan, M., & Yahaya, W. A. J. W. (2016). Emotional design in multimedia learning: how emotional intelligence moderates learning outcomes. International Journal of Modern Education and Computer Science, 8(5), 54–63. https://doi.org/10.5815/ijmecs.2016.05.07

  • *Kumar, J. A., Balakrishnan, M., & Yahaya, W. A. J. W. (2019). Exploring the effects of emotional design and emotional intelligence in multimedia-based learning: an engineering educational perspective. New Review of Hypermedia and Multimedia, 25(1-2), 57-86. https://doi.org/10.1080/13614568.2019.1596169

  • Lakens, D., Hilgard, J., & Staaks, J. (2016). On the reproducibility of meta-analyses: six practical recommendations. BMC psychology, 4(1), 1–10. https://doi.org/10.1186/s40359-016-0126-3.

    Article  Google Scholar 

  • *Le, Y., Liu, J., Deng, C., & Dai., D. Y. (2018) Heart rate variability reflects the effects of emotional design principle on mental effort in multimedia learning. Computers in Human Behavior, 89, 40-47. https://doi.org/10.1016/j.chb.2018.07.037

  • Linnenbrink, E. A. (2006). Emotion research in education: Theoretical and methodological perspectives on the integration of affect, motivation, and cognition. Educational Psychology Review, 18(4), 307–314. https://doi.org/10.1007/s10648-006-9028-x.

  • Lowe, R. K., & Schnotz, W. (2014). Animation principles in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., p. 513–546). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.026

  • Matsumoto, D., Consolacion, T., Yamada, H., Suzuki, R., Franklin, B., Paul, S., et al. (2002). Cognition and Emotion, 16(6), 721–747. https://doi.org/10.1080/02699930143000608.

    Article  Google Scholar 

  • Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 43–71). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005.

  • Mayer, R. E. (2017). Using multimedia for e-learning: multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197.

    Article  Google Scholar 

  • *Mayer, R. E., & Estrella, G. (2014). Benefits of emotional design in multimedia instruction. Learning and Instruction, 33, 12–18. https://doi.org/10.1016/j.learninstruc.2014.02.004

  • Mayer, R. E., & Fiorella, L. (2014). Principles for reducing extraneous processing in multimedia learning: coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 279–315). New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.015.

  • Mega, C., Ronconi, L., & De Beni, R. (2014). What makes a good student? How emotions, self-regulated learning, and motivation contribute to academic achievement. Journal of Educational Psychology, 106(1), 121–131. https://doi.org/10.1037/a0033546.

    Article  Google Scholar 

  • *Miller, C. (2011). Aesthetics and e-assessment: the interplay of emotional design and learner performance. Distance Education, 32(3), 307–337. https://doi.org/10.1080/01587919.2011.610291

  • *Moremoholo, T. P., & de Lange, R. W. (2018). Anthropomorphic graphics: how useful are they as an instructional aid to facilitate learning? The Independent Journal of Teaching and Learning, 13(2), 67–81.

  • Moreno, R. (2006). Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. Journal of Computer Assisted Learning, 22(3), 149–158.

    Article  Google Scholar 

  • Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326.

    Article  Google Scholar 

  • Münchow, H. (2017). I feel therefore I learn – effectiveness of affect induction interventions and possible covariates on learning outcomes. (Unpublished doctoral dissertation). Würzburg: Julius-Maximillians-Universität: Würzburg, Germany.

  • *Münchow, H., & Bannert, M. (2019). Feeling good, learning better? Effectivity of an emotional design procedure in multimedia learning. An International Journal of Experimental Educational Psychology, 39(4), 530-549. https://doi.org/10.1080/01443410.2018.1524852

  • *Münchow, H., Mengelkamp, C., & Bannert, M. (2017). The better you feel the better you learn: do warm colors and rounded shapes enhance learning outcome in multimedia learning? Education Research International, 2017, 1-15. doi:https://doi.org/10.1155/2017/2148139

  • Napolitano, A. C., & Sloutsky, V. M. (2004). Is a picture worth a thousand words? The flexible nature of modality dominance in young children. Child Development, 75(6), 1850–1870. https://doi.org/10.1111/j.1467-8624.2004.00821.x.

    Article  Google Scholar 

  • *Navratil, S. D., Kühl, T., & Heidig, S. (2018). Why the cells look like that – the influence of learning with emotional design and elaborative interrogations. Frontiers in Psychology, 9, 1–15. https://doi.org/10.3389/fpsyg.2018.01653.

  • *Ng, K. H., & Chiu, T. K. F. (2017). Emotional multimedia design for developing mathematical problem-solving skills. In W. W. K. Ma, C.-K. Chan, K. Tong, H. Fung, & C. W. R. Fong (Eds.), New ecology for education — communication x learning (pp. 131–141). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-10-4346-8_11

  • *Nurminen, M. (2016). Effects of emotional design and goal orientation on students’ emotions and learning outcomes in university programming education (Unpublished thesis). Tampere University of Technology: Tampere, Finland.

  • *Nurminen, M. I., Leppanen, L., Vaataja, H., & Ihantola, P. (2017). Search of the emotional design effect in programming revised. In É. Lavoué, H. Drachsler, K. Verbert, J. Broisin, & M. Pérez-Sanagustín (Eds.), Data driven approaches in digital education (Vol. 10474). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-66610-5

  • Orwin, R. G. (1983). A Fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.2307/1164923.

    Article  Google Scholar 

  • Paivio, A. (1986). Mental representations: a dual-coding approach. Oxford, England: Oxford University Press.

    Google Scholar 

  • Palmer, S. E., & Schloss, K. B. (2010). An ecological valence theory of human color preference. Proceedings of the National Academy of Sciences, 107(19), 8877–8882. https://doi.org/10.1073/pnas.0906172107.

    Article  Google Scholar 

  • Park, B., Plass, J. L., & Brünken, R. (2014). Cognitive and affective processes in multimedia learning. Learning and Instruction, 29, 125–127. https://doi.org/10.1016/j.learninstruc.2013.05.005.

    Article  Google Scholar 

  • *Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: an eyetracking study on the use of anthropomorphisms. Computers & Education, 86, 30–42. https://doi.org/10.1016/j.compedu.2015.02.016

  • Pekrun, R. (2006). The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9.

    Article  Google Scholar 

  • Pett, D., & Wilson, T. (1996). Color research and its application to the design of instructional materials. Educational Technology Research and Development, 44(3), 19–35. https://doi.org/10.1007/BF02300423.

    Article  Google Scholar 

  • Pintrich, P. R. (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95(4), 667–686. https://doi.org/10.1037/0022-0663.95.4.667.

    Article  Google Scholar 

  • Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31(2), 339–359. https://doi.org/10.1007/s10648-019-09473-5.

    Article  Google Scholar 

  • Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In S. Y. Tettegah & M. Gartmeier (Eds.), Emotions, technology, design, and learning (pp. 131–161). New York: Elsevier.

  • *Plass, J. L., Heidig, S., Hayward, E. O., Homer, B. D., & Um, E. (2014). Emotional design in multimedia learning: effects of shape and colour on affect and learning. Learning and Instruction, 29, 128–140. https://doi.org/10.1016/j.learninstruc.2013.02.006

  • Raffaelli, M., Crockett, L. J., & Shen, Y.-L. (2005). Developmental stability and change in self-regulation from childhood to adolescence. Journal of Genetic Psychology, 166(1), 54–76.

    Article  Google Scholar 

  • Rey, G. D. (2012). A review of research and a meta-analysis of the seductive detail effect. Educational Research Review, 7(3), 216–237. https://doi.org/10.1016/j.edurev.2012.05.003.

    Article  Google Scholar 

  • Rop, G., Schüler, A., Verkoeijen, P. P. J. L., Scheiter, K., & Van Gog, T. (2018). Effects of task experience and layout on learning from text and pictures with or without unnecessary picture descriptions. Journal of Computer Assisted Learning, 34(4), 458–470. https://doi.org/10.1111/jcal.12287.

    Article  Google Scholar 

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638.

    Article  Google Scholar 

  • *Schneider, S., Häßler, A., Habermeyer, T., Beege, M., & Rey, G. D. (2018a). The more human, the higher the performance? Examining the effects of anthropomorphism on learning with media. Journal of Educational Psychology, 111(1), 57–72. https://doi.org/10.1037/edu0000273.

  • *Schneider, S., Nebel, S., Beege, M., & Rey, G. D., (2018b). Anthropomorphism in decorative pictures: Benefit or harm for learning? Journal of Educational Psychology, 110(2), 218–232. https://doi.org/10.1037/edu0000207.

  • *Shangguan, C., Wang, Z., Gong, S., Guo, Y., & Xu, S. (2019). More attractive or more interactive? The effects of multi-leveled emotional design on middle school students’ multimedia learning. Frontiers in Psychology, 10, 1-12. https://doi.org/10.3389/fpsyg.2019.03065.

  • *Shangguan, C., Gong, S., Guo, Y., Wang, X., & Lu, J. (2020). The effects of emotional design on middle school students’ multimedia learning: the role of learners’ prior knowledge. Educational Psychology, 1–18. https://doi.org/10.1080/01443410.2020.1714548

  • *Stárková, T., Lukavský, J., Javora, O., & Brom, C. (2018). Anthropomorphisms in multimedia learning: attract attention but do not enhance learning? Journal of Computer Assisted Learning, 35, 555-568. https://doi.org/10.1111/jcal.12359

  • Tabbers, H. K., & de Koeijer, B. (2010). Learner control in animated multimedia instructions. Instructional Science, 38(5), 441–453. https://doi.org/10.1007/s11251-009-9119-4.

    Article  Google Scholar 

  • Tabbers, H. K., Martens, R. L., & Merriënboer, J. J. G. (2004). Multimedia instructions and cognitive load theory: effects of modality and cueing. British Journal of Educational Psychology, 74(1), 71–81. https://doi.org/10.1348/000709904322848824.

    Article  Google Scholar 

  • Tyng, C. M., Amin, H. U., Saad, M. N. M., & Malik, A. S. (2017). The influences of emotion on learning and memory. Frontiers in Psychology, 8, 1–22. https://doi.org/10.3389/fpsyg.2017.01454.

    Article  Google Scholar 

  • Um, E. R. (2008). The effect of positive emotions on cognitive processes in multimedia -based learning. (Publication No. 3308294), [Doctoral Dissertation, New York University]. ProQuest Dissertations Publishing.

  • *Um, E. R., Song, H. S., & Plass, J. L. (2007). The effect of positive emotions on multimedia learning. In C. Montgomerie & J. Seale (Eds.), EdMedia: World Conference on Educational Media and Technology, Vancouver, Canada (pp. 4176–4185). Association for the Advancement of Computing in Education (AACE): Waynesville, NC.

  • *Um, E. R., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485–498. https://doi.org/10.1037/a0026609.

  • *Uzun, A. M., & Yildirim, Z. (2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112-128. https://doi.org/10.1016/j.compedu.2018.01.002

  • Wang, Z., & Adesope, O. (2017). Do focused self-explanation prompts overcome seductive details? A multimedia study. Journal of Educational Technology & Society, 20(4), 47–57. 

  • Waytz, A., Cacioppo, J., & Epley, N. (2010). Who sees human? The stability and importance of individual differences in anthropomorphism. Perspectives on Psychological Science, 5(3), 219–232. https://doi.org/10.1177/1745691610369336.

    Article  Google Scholar 

  • Wittrock, M. C. (1989). Generative processes of comprehension. Educational Psychologist, 24(4), 345–376. https://doi.org/10.1207/s15326985ep2404_2.

    Article  Google Scholar 

  • Wolfson, S., & Case, G. (2000). The effects of sound and color on responses to a computer game. Interacting with Computers, 13(2), 183–192. https://doi.org/10.1016/S0953-5438(00)00037-0

Download references

Author information

Authors and Affiliations

  1. Department of Kinesiology and Educational Psychology, College of Education, Washington State University, Pullman, WA, 99164-2114, USA

    Rachel M. Wong & Olusola O. Adesope

Authors
  1. Rachel M. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olusola O. Adesope
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Olusola O. Adesope.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(XLSX 18 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wong, R.M., Adesope, O.O. Meta-Analysis of Emotional Designs in Multimedia Learning: A Replication and Extension Study. Educ Psychol Rev 33, 357–385 (2021). https://doi.org/10.1007/s10648-020-09545-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10648-020-09545-x

Keywords

Search

Navigation