Evaluation Methodologies for assessing the value of Educational Games
Evaluation methodologies have also been developed for the specific field of lan-guage teaching and learning through the support of technology. This field is commonly referred to as Computer Assisted Language Learning (CALL). CALL focuses on software applications, environments, digital media, and respective con-tent with a clear instructional purpose and a language learning objective (Hubbard, 1988). Diverse principles and pedagogical frameworks underline the design of CALL applications. Given that CALL software can be dated back to the 70s learning methodologies deployed are clearly influenced by broader educational tendencies in each historical era (Warschauer & Healey, 1998), (Williams, 1983). CALL software may be categorized as follows based on learning orientation:
*Behaviorist / structural CALL: implemented mainly in the 70’s, it consisted of traditional drill and practice content based on the stimulus-response philosophy. Software analyzed students’ input and provided feedback diagnosing their grammatical “mistakes”. In the following dec-ades behaviorist approaches were rejected and abandoned by most lan-guage teachers. The same happened to behaviorist CALL software
*Communicative CALL: it was implemented in the 80’s and 90’s in line with the advent of microcomputers and capitalizing on the ever increasing development and expansion of home/personal computing which, becoming more and more accessible to the masses, paved the way for more com-puters in the classrooms and the development of more sophisticated educa-tional software. As the term implies, it is based on the communicative learning approach that became very popular in the late 70’s and through-out the 80’s. The communicative approach focuses on the language use and less on grammar elements. Grammar is implicitly taught and not in an explicit, or in other words behaviouristic, manner. Students generate origi-nal, flexible, and open language output in the frame of a variety of activi-ties such as: gap-filling, cloze texts, multiple-choice, free-format (text en-try), adventures and simulations, sentence reordering, explanations, etc. A key element of this phase of CALL software is the fact that for the first time games and applications that weren’t initially designed for language learning purposes, such as commercially available games, made their ac-tive presence in didactic procedures
*Integrative CALL: since the middle of the 90’s and the advent of multi-media modern web-browsers and the popularity of the internet and internet based applications CALL has become really hard to be described and de-fined since it has embraced sophisticated tools such as interactive envi-ronments, hyperlinked content, Web 2.0 applications, blogs, wikis, social networking, online audiovisual materials, etc. Williams (1983) defined this new era of CALL software as “integrative” since it focuses on a blend of multimedia technology, computer-mediated communication, and task-based language instruction. This phase of CALL software hasn’t yet reached the state of “completeness” or “normalization” (Abt, 1970; Bax & Chambers, 2006; Bax,2011).
In relation to the effectiveness of CALL towards reaching language learning objectives it is possible to evaluate impact either quantitatively or qualitatively. Evaluation strategies aim to establish whether CALL provides a more inductive environment for language learning as compared to the conventional methods and media. Other evaluation indicators for assessing the impact of CALL towards building language skills include:
- The degree to which ICT is deployed in the context of first or second language teaching
- Practical issues such as availability of software, hardware, and Internet connections and their respective limitations
- Budgetary restrictions
- Teacher and learner attitudes towards CALL
- Adaptations in language teaching approaches
At the practical level CALL software evaluation has in the past been driven by checklists or forms, methodological frameworks for language teaching, or Second Language Acquisition (SLA) theory and research-based criteria.
According to Hubbard (1988), a methodological evaluation framework typically involves a description of the components of specific software in relation to a particular goal; in this case, the goal is the evaluation of CALL towards enriching language learning practices. In a methodological framework evaluation questions are not preset. Rather, a methodological framework is a tool that the evaluator can use to create a set of questions or develop some other evaluation scheme that meets the unique needs of each evaluation process.
Until the mid-80’s evaluation had largely been conceptualized in terms of checklists. Phillips (1985) proposed a framework more explicitly linked to language teaching and learning methodology. It included categories for the CALL software types that were popular at the time. It further described dimensions such as language difficulty, learner focus / skill area such as listening, speaking, reading, or writing, and language focus, such as lexis, grammar, and discourse, which were important to the language learning character of a particular software application. Hubbard (1988) expanded Phillips’ system by integrating it with the one developed independently by Richards and Rodgers (1986) for describing and analyzing language teaching methods in terms of three descriptive categories: approach, design including the syllabus model, procedure, namely classroom techniques and activities through which learning design is realized. Hubbard (1988) adapted these concepts into categories describing the key elements of evaluation and renamed them as “teacher fit”, “learner fit”, and “operational description”.
Second language acquisition-based (SLA) approaches: software applications are popular in teaching and learning of foreign languages. SLA theories and approaches can be used to develop software evaluation standards. One of the pioneers of this method was Underwood (1984), who established a case for a communicative approach to CALL based on generalizations from research and communicative theory of that era. His 13 points characterizing communicative CALL became a de facto evaluation rubric. Later on, Egbert and Hanson-Smith (1999) invented eight generalizations for optimal language learning environments based on Underwood’s previous work. In more recent years the work of Carol Chapelle (2001) introduced the Computer Applications in Second Language Acquisition (CASLA) framework.
Click here to go back to the Homepage.
References
Egbert, J., & Hanson-Smith, E. (Eds.) (1999). CALL environments: Re-search, practice, and critical issues. Alexandria, VA: Teachers of English to Speakers of Other Languages
Hubbard, P. (1988). An integrated framework for CALL courseware eval-uation. CALICO Journal, 6 (2), 51-72
Phillips, M. (1985). Logical possibilities and classroom scenarios for the development of CALL. In C. Brumfit, M. Phillips, & P. Skehan (Eds.), Computers in English language teaching (pp. 25-46). New York: Pergamon
Richards, J. and Rodgers, T. Approaches and Methods in Language Teaching: A Description and Analysis. New York: Cambridge University Press (1986)
Chapelle, C. (2001) Computer applications in second language acquisition: Foundations for teaching, testing, and research. Cambridge: Cambridge
