Elsevier

Computers & Education

Volume 58, Issue 1, January 2012, Pages 63-76
Computers & Education

Effects of a vocabulary acquisition and assessment system on students’ performance in a blended learning class for English subject

https://doi.org/10.1016/j.compedu.2011.08.002Get rights and content

Abstract

Vocabulary acquisition and assessment are regarded as the key basis for the instruction of English as a second language. However, it is time-consuming, fallible and repetitive for the school teachers and parents to assess the proficiency of the students’ vocabulary acquisition. We customized the open source course management system Moodle to build the individualized vocabulary review and assessment functions for English instruction. This web-based system was integrated into the regular English instruction of an experiment class of Grade three in a junior middle school, i.e. it was used in one school hour almost every week for an entire school term. Within this blended learning environment, the students’ performance of the experiment class in the ordinary and especially vocabulary examinations throughout the school term was improved gradually and was better than that of the control class, so that it achieved number one among sixteen classes in the same grade at the final term examination, compared with number eight before this experiment. The survey and interview with the students also demonstrated the system’s valuable functions for vocabulary acquisition and listening comprehension, and showed the students’ favor to such a kind of syllabus design with the intelligent course management system. The implication of this research is that the blended learning of English class with the individualized vocabulary acquisition and assessment system can improve the students’ performance in vocabulary acquisition and in ordinary test. This system can also be applied in other English classes.

Highlights

► We build a vocabulary acquisition and assessment functions for English instruction. ► The web-based system was integrated into English instruction of an experiment class. ► With this blended learning system, the students’ performance improvement was greater. ► The improvement was verified by ordinary school tests, student survey and interview. ► The improvement in vocabulary test was more remarkable than in ordinary tests.

Introduction

Since English has long been the international communication language in the world as well as the most important second language in non-English speaking countries, English is listed as one of the three core subjects in middle schools in China. Vocabulary acquisition is the crucial element to learn English as a second language, because it is the fundamental prerequisite to the four skills of a language: listening, speaking, reading and writing. Wilkins (1972, p. 111) argued: “without grammar very little can be conveyed, without vocabulary nothing can be conveyed.” In recent years, abundant studies that investigated English instruction emphasized the importance of vocabulary learning to English instruction (Decarrico, 2001). An excellent and huge vocabulary is helpful to inferring meaning from English sentences and passages (Rupley, Logan, & Nichols, 1999). A limited vocabulary often leads to misunderstanding or poor comprehension of English texts (Lin, 2002, Segler et al., 2002). A few researchers stated that the main obstacle in English learning is facing entirely new words in an English text (Anderson and Freebody, 1981, Mezynski, 1983, Qian, 2002).

However, many learners think that memorizing English vocabulary for a long time is difficult. Oxford (1990) pointed out that language learners typically have significant difficulty remembering large vocabularies. Forgetting is another problem for Chinese students to learn English, because most of them usually just use English words and sentences in the school class time, for example, within less than ten school hours every week, and by the homework time.

The English teachers have also trouble in assessing the students’ vocabulary acquisition. They usually ask the students to learn the vocabulary in every unit or module, and then check their memory performance by letting them write the Chinese meaning according to English words in a test paper, or, write the English words according to Chinese phrases, vice versa. Then the teachers should check the students’ handwritten test papers very deliberately. The scoring error is unavoidable, because in a very limited time an English teacher should check and score the test papers for one class or more classes, each of which has 30-50 students, and every paper is filled with dozens of English-Chinese or Chinese-English word pairs that are hand written in various shapes. After the laborious work the teachers hardly have time to give individual feedback about the vocabulary acquisition to every student in the class.

Oxford (1990) divided memory strategies into four types: creating mental linkages, applying images and sounds, reviewing, and employing actions. In English language the word spelling is connected with its pronunciation. So the word spelling memory is not separated with its pronunciation recall. The vocabulary acquisition performance should be checked along with the listening comprehension of these words’ pronunciation. It is more time-consuming for the English teachers to check the students’ memory performance by asking the students to write down the English words in the paper in accordance with the words’ English pronunciations.

Furthermore, in order to assess the understanding of English vocabulary and Chinese meaning completely, the multilateral relations among English spelling, English pronunciation, Chinese pronunciation and Chinese phrase should be assessed as a whole, as illustrated in Fig. 1. As Chinese language is the mother language of the students and normally has been mastered by them from middle schools, the relation between Chinese phrase and its pronunciation need not to be assessed again in English classes. The other relations can be classified into ten levels.

The first level is the mastery of the map from an English spelling to its Chinese phrase. It is the most basic requirement for the students to read and to understand English texts, and can be assessed in traditional paper format and held collectively in a classroom, as above discussed.

The second level is the mastery of the map from a Chinese phrase to an English word. It is the basic requirement for the students to write English sentences and paragraphs.

The third level is the mastery of the map from English pronunciation to English spelling. The fourth level is the mastery of the map from English pronunciation to Chinese phrase. The fifth level is the mastery of the map from Chinese pronunciation to English spelling.

The third, fourth and fifth levels can be held collectively in a classroom, in the way that the teacher pronounces the English word or Chinese phrase, and the students write the English spellings and/or Chinese phrases in the paper format. These tests can be characterized as listening comprehension tests. The teacher’s English pronunciation may influence the students’ understanding and assessment result. An alternative is to play the “standard” pronunciations of the English words from a cassette or from a sound file with wav/mp3 or other formats in a multimedia computer supplied by the textbook publisher together with the textbook, but either the editing of the cassette content or the organization of the sound files is an easier said than done task for the English teacher.

The sixth level is the mastery of the map from English spelling to English pronunciation. The seventh level is the mastery of the map from English spelling to Chinese pronunciation. The eighth level is the mastery of the map from Chinese phrase to English pronunciation. The ninth level is the mastery of the map from English pronunciation to Chinese pronunciation. The tenth level is the mastery of the map from Chinese pronunciation to English pronunciation.

These five levels, from the sixth to the tenth level, can only been assessed individually, i.e. the student responds with their pronunciations. These tests can be characterized as pronunciation tests. Although the students’ response can happen collectively and simultaneously in a classroom, it is impossible for an English teacher to collect all the simultaneous sounds and then to evaluate them. Even if with the modern information and communication technology the student can record the pronunciation by speaking to the microphone in a classroom simultaneously, and then the teacher can collect all the sounds, the pronunciations will influence each other so that the teacher cannot analyze them correctly and score them fairly. Consequently these five levels can only be assessed individually and even in a separate space.

As for the ten levels, every map is not a one to one relation from the linguistic view in fact. An English word can have different semantic meanings expressed in different kinds of Chinese phrase. A Chinese phrase can be expressed with different English words and even have different kinds of POS (Part of Speech). But for a specific unit in a given school textbook, the students are required to learn the specific relation between an English word and its Chinese phrase. Within this instructional context of school education, the map in the ten levels can be a one to one relation.

The school pupils learn the English vocabulary gradually. In every grade and in every school stage the students are required to pass certain level tests. For example in Grade three of a junior middle school, which we label as JX school, located in Guangdong Province of southern China, 2300 km away from the researchers’ location in Beijing, the students are required to master the first, the third and the fourth levels. We define them as the three basic abilities of English vocabulary acquisition. The mastery of English pronunciation, its English spelling and Chinese phrase is emphasized in this learning stage, as shown in Fig. 2.

Three common problems exist in the three levels’ exams. First, the teacher should score the students’ exam papers that are hand written by the students with different forms very deliberately. Scoring errors are unavoidable for a teacher facing dozens of exam papers from one class or more classes.

Secondly, even after exact assessment of all the students’ vocabulary, the teacher hardly has time more to point out the shortcoming of every student and to give every one individual suggestion on vocabulary acquisition.

Thirdly, the design and scoring of the vocabulary exam is repetitive for a given unit or module in a textbook selected by the school. The vocabulary assessment is a regular work of the English instruction, i.e., it happens weekly or once every two weeks, thus it costs the teachers much time in every school term. If this work could be automatically done by a computer program, it would spare much time for the teacher.

Except the above three common problems, the assessment of the mastery of the map from English pronunciation requires the correct pronunciation of the English teacher. Unluckily, the qualified English teachers in secondary and primary education are inadequate, especially in most ordinary schools outside the metropolitan cities in China.

Additionally, the students can write and score the vocabulary exam in paper format by themselves at home, but it is a dull and monotonous work for the teenagers. Moreover, for the self assessment of the map from English pronunciation to English spelling and to Chinese phrase, the source of the English pronunciations is rarely to be found. The most ideal solution is that the parents pronounce the English words, while the child writes the answers in the paper. However, only few Chinese parents are able to speak English well and can spend such time on assessing the child’s mastery of English vocabulary.

Generally speaking, by assessment of the three basic abilities of English vocabulary, the traditional classroom method is time-consuming, fallible, and repetitive. Particularly for the assessment of English pronunciation, the sound source is another problem.

Section snippets

Related theories and works

In order to solve the problems in vocabulary acquisition and assessment, the CALL (Computer Assisted Language Learning) technology including computer-based test has been adopted for a long time. The privileges of computer based test over traditional paper-based test are the automatic scoring capability and student performance analysis, and even more advanced, adaptive testing based on examinees’ performance. The exams that can be automatically scored by the computer program have two forms:

Moodle and its quiz function

Moodle (http://www.moodle.org) is a widely used, free and open source CMS (Course Management System). Its latest version, for example V1.9.7 and later, can be packed with Apache http server, PHP program language and MySQL database management, i.e. all the other software needed to make it run with Windows. They are built using XAMPP (version 1.7.1 lite). It is almost trivial to be installed and to be maintained. Besides the flexible course management function, it also supplies the powerful exam

Research hypothesis

The blended learning in the computer pool with the customized vocabulary assessment system can improve the students’ learning performance in ordinary English test, especially in vocabulary acquisition.

Participants

There were sixteen classes in Grade three of JX junior middle school. The student number in every class counted from 46 to 50. Totally there are 768 students in this grade. Teacher R was teaching English subject for Class Number 11 and Number 12. She was interested in and experienced with the

Conclusion and analysis

In this section we review and analyze the conclusions drawn from the full point views of the school exams result of the experiment class, student interview, and student survey findings.

The integration of the vocabulary assessment system into the ordinary English teaching can improve the students’ test performance, and especially the vocabulary acquisition including the English pronunciation comprehension, spelling writing and Chinese meaning mastering. This conclusion is demonstrated by the

Limitation and future work

We customize the Moodle platform to facilitate the vocabulary acquisition and assessment for three levels for English learning as a foreign language: from English pronunciation to English spelling, from English pronunciation to Chinese meaning, and from English spelling to Chinese meaning. We design MQXEEV to automatically generate multiple choice and cloze questions based on triples of English spelling, its POS and its Chinese meaning. Although this customized vocabulary acquisition and

Acknowledgments

The research in this paper is a part of one ongoing project “The blended instruction research of middle school English subject supported by intelligent tutoring system CSIEC” (10BYY036), sponsored by National Social Science Council, China. It is also sponsored by the Program for New Century Excellent Talents in University (NCET-10-0179), Ministry of Education, China. We would like to thank all the principals, teachers and pupils in Jingxian junior middle school for their voluntary participating

References (29)

  • R.C. Anderson et al.

    Vocabulary knowledge

  • N. Chen et al.

    Effects of short-term memory and content representation type on mobile language learning

    Language Learning and Technology

    (2008)
  • R.B. Clariana et al.

    The effects of recognition and recall study tasks with feedback in a computer based vocabulary lesson

    Educational Technology Research and Development

    (2001)
  • R.B. Clariana

    The effectiveness of constructed-response and multiple-choice study tasks in computer aided learning

    Journal of Educational Computing Research

    (2003)
  • CSIEC, Computer simulation in educational communication. Available from...
  • J.S. Decarrico

    Vocabulary learning and teaching

  • R.M. Gagné et al.

    Principles of instructional design

    (1988)
  • J.A. Glover

    The testing phenomenon: not gone but nearly forgotten

    Journal of Educational Psychology

    (1989)
  • D.R. Godden et al.

    Context-dependent memory in two natural environments: on land and underwater

    British Journal of Psychology

    (1975)
  • D.R. Godden et al.

    When does context influence recognition memory?

    British Journal of Psychology

    (1980)
  • J. Jia et al.

    Script based design for human-computer dialog in given scenarios for English learners

  • J. Jia et al.

    The further development of CSIEC project driven by application and evaluation in English education

    British Journal of Educational Technology

    (2009)
  • S. Krashen

    Principles and practice in second language acquisition

    (1982)
  • Z. Lin

    Discovering EFL learners’ perception of prior knowledge and its role in reading comprehension

    Journal of Research in Reading

    (2002)
  • Cited by (0)

    View full text