Abstract
Cumulative tests (CTs) require learners to recall previously learned words. The scope of the tested words gradually increases with increased study sessions. A potential limitation of CTs is that less learning may occur for words introduced later than earlier. This study proposes random selection tests (RSTs), which may compensate for this problem. We randomly selected the tested words from all target words, such that learners can review all words in a balanced manner. To investigate whether RSTs compensate for CT limitations, the study randomly assigned 69 Japanese learners of English to the RST or CT group. They were given 45 Japanese and English word pairs and weekly small tests across three weeks. The CT group recalled 15 words per small test, in which the scope of the tested words increased (15 → 30 → 45 words). Alternatively, the RST group recalled 15 words, which were randomly selected from 45 words, per small test. The posttest revealed that the RST group compensated for the limitation and retained the second and last 15 words better than did the CT group. The findings suggest that RSTs enable L2 learners to study all words in a balanced manner.
Funding source: Grants-in-Aid for Scientific Research (C)
Award Identifier / Grant number: No. 21K00781
Acknowledgments
We are grateful to the anonymous reviewers for their constructive feedback and comments and to the journal editor, Xuesong Gao, for his useful comments.
-
Research funding: This study was supported by Grants-in-Aid for Scientific Research (C) [No. 21K00781].
-
Informed consent: Informed consent received from all the participants.
-
Ethical approval: Not applicable. The reason is that we used participants’ scores but not their personal names, so their privacy is totally protected.
-
Author contributions: All authors performed research design. Akira Iwata conducted the experiment and collected data in University A. Kohei Kanayama and Kiwamu Kasahara conducted the experiment in University B. Kohei Kanayama did data analysis and wrote the paper. Kiwamu Kasahara checked the paper.
-
Competing interests: The authors declare none.
References
ALC. 2001. Standard vocabulary list 12000. https://www.alc.co.jp/eng/vocab/svl/list.html (accessed 17 February 2023).Search in Google Scholar
Baddeley, Alan. 2014. Essentials of human memory. London: Psychology Press.Search in Google Scholar
Barcroft, Joe. 2007. Effects of opportunities for word retrieval during second language vocabulary learning. Language Learning 57(1). 35–56. https://doi.org/10.1111/j.1467-9922.2007.00398.x.Search in Google Scholar
Bates, Douglas, Martin Mächler, Ben Bolker & Steve Walker. 2015. Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67. 1–48. https://doi.org/10.18637/jss.v067.i01.Search in Google Scholar
Beagley, Jonathan & Mindy Capaldi. 2016. The effect of cumulative tests on the final exam. Problems, Resources, and Issues in Mathematics Undergraduate Studies 26(9). 878–888. https://doi.org/10.1080/10511970.2016.1194343.Search in Google Scholar
Bjork, Robert & Elizabeth Bjork. 2019. Forgetting as the friend of learning: Implications for teaching and self-regulated learning. Advances in Physiology Education 43(2). 164–167. https://doi.org/10.1152/advan.00001.2019.Search in Google Scholar
Carpenter, Shana. 2020. Distributed practice or spacing effect. In L.-F. Zhang (ed.), Oxford research Encyclopedia of education. Oxford: Oxford University Press.10.1093/acrefore/9780190264093.013.859Search in Google Scholar
Faul, Franz, Edgar Erdfelder, Axel Buchner & Albert-Georg Lang. 2009. Statistical power analysis using G*Power 3.1: Tests for correlation and regression analysis. Behavior Research Methods 41(4). 1149–1160. https://doi.org/10.3758/BRM.41.4.1149.Search in Google Scholar
Gayman, Catherine, Stephanie Jimenez, S. Hammock, S. Taylor & Jessica Rocheleau. 2021. The effects of cumulative and noncumulative exams within the context of interteaching. Journal of Behavioral Education Online First 32(2). 261–276. https://doi.org/10.1007/s10864-021-09451-4.Search in Google Scholar
Halamish, Vered & Robert Bjork. 2011. When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier. Journal of Experimental Psychology: Learning, Memory, and Cognition 37(4). 801–812. https://doi.org/10.1037/a0023219.Search in Google Scholar
Kanayama, Kohei, Akira Iwata & Kiwamu Kasahara. 2022. How can cumulative tests be applicable to effective L2 vocabulary instruction? Annual Review of English Language Education in Japan 33. 1–16. https://doi.org/10.20581/arele.33.0_1.Search in Google Scholar
Khanna, Maya, Amy Badura Brack & Laura Finken. 2013. Short- and long-term effects of cumulative finals on student learning. Teaching of Psychology 40(3). 175–182. https://doi.org/10.1177/0098628313487458.Search in Google Scholar
Kim, Kyung & Stuart Webb. 2022. The effect of spaced practice on second language learning: A meta-analysis. Language Learning 72(1). 269–319. https://doi.org/10.1111/lang.12479.Search in Google Scholar
Kornell, Nate. 2009. Optimising learning using flashcards: Spacing is more effective than cramming. Applied Cognitive Psychology 23(9). 1297–1317. https://doi.org/10.1002/acp.1537.Search in Google Scholar
Lawrence, Natalie. 2013. Cumulative exams in the introductory psychology course. Teaching of Psychology 40(1). 15–19. https://doi.org/10.1177/0098628312465858.Search in Google Scholar
Lenth, Russell. 2019. Emmeans: Estimated marginal means, aka, least-squares means. R package version 1.4.1.Search in Google Scholar
McDaniel, Mark, Janis Anderson, Mary Derbish & Nova Morrisette. 2007. Testing the testing effect in the classroom. European Journal of Cognitive Psychology 19(4–5). 494–513. https://doi.org/10.1080/09541440701326154.Search in Google Scholar
McDermott, Kathleen. 2021. Practicing retrieval facilitates learning. Annual Review of Psychology 72(1). 609–633. https://doi.org/10.1146/annurev-psych-010419-051019.Search in Google Scholar
Nakata, Tatsuya. 2017. Does repeated practice make perfect? The effects of within-session repeated retrieval on second language vocabulary learning. Studies in Second Language Acquisition 39(4). 653–679. https://doi.org/10.1017/S0272263116000280.Search in Google Scholar
Nakata, Tatsuya & Yuichi Suzuki. 2019. Effects of massing and spacing on the learning of semantically related and unrelated words. Studies in Second Language Acquisition 41(2). 287–311. https://doi.org/10.1017/S0272263118000219.Search in Google Scholar
Nakata, Tatsuya, Saori Tada, Stuart Mclean & Young Ae Kim. 2021. Effects of distributed retrieval practice over a semester: Cumulative tests as a way to facilitate second language vocabulary learning. Tesol Quarterly 55(1). 248–270. https://doi.org/10.1002/tesq.596.Search in Google Scholar
Nation, Paul. 2022. Learning vocabulary in another language, 3rd edn. Cambridge: Cambridge University Press.10.1017/9781009093873Search in Google Scholar
Nation, Paul & David Beglar. 2007. A vocabulary size test. The Language Teacher 31(7). 9–13.Search in Google Scholar
Putnam, Adam, John Nestojko & Henry Roediger. 2016. Improving student learning: Two strategies to make it stick. In J. C. Horvath, J. Lodge & J. A. C. Hattie (eds.), From the laboratory to the classroom: Translating the science of learning for teachers, 94–121. Oxon: Routledge.Search in Google Scholar
Pyc, Mary & Katherine Rawson. 2009. Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory? Journal of Memory and Language 60(4). 437–447. https://doi.org/10.1016/j.jml.2009.01.004.Search in Google Scholar
Richard, Jean-Pierre. 2021. The CEFR-J hierarchy and its relationship with TOEIC listening and reading. In P. Clements, R. Derrah & P. Ferguson (eds.), Communities of teachers & learners. Tokyo: JALT.Search in Google Scholar
Roediger, Henry & Jeffrey Karpicke. 2006. The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science 1. 181–210. https://doi.org/10.1111/j.1745-6916.2006.00012.x.Search in Google Scholar
Roediger, Henry L.III, Adam L. Putnam & Megan A. Smith. 2011. Ten benefits of testing and their applications to educational practice. In J. Mestre & B. Ross (eds.), Psychology of learning and motivation: Cognition in education, 55, 1–36. San Diego: Academic Press.10.1016/B978-0-12-387691-1.00001-6Search in Google Scholar
Rogers, John & Andrea Révész. 2020. Experimental and quasi-experimental designs. In J. McKinley & H. Rose (eds.), The Routledge handbook of research methods in applied linguistics, 133–143. Oxon: Routledge.10.4324/9780367824471-12Search in Google Scholar
Suzuki, Yuichi, Tatsuya Nakata & Robert Dekeyser. 2019. The desirable difficulty framework as a theoretical foundation for optimizing and researching second language practice. Modern Language Journal 103(3). 713–720. https://doi.org/10.1111/modl.12585.Search in Google Scholar
Terai, Masato, Junko Yamashita & Kelly E. Pasich. 2021. Effects of learning direction in retrieval practice on EFL vocabulary learning. Studies in Second Language Acquisition 43(5). 1116–1137. https://doi.org/10.1017/S0272263121000346.Search in Google Scholar
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/iral-2023-0141).
© 2023 Walter de Gruyter GmbH, Berlin/Boston
