Assessing Writing
1018 articlesApril 2019
January 2019
-
Abstract
Numerous studies have examined the relationship between lexical features of students’ compositions and judgements of text quality. However, the degree to which teachers’ judgements are influenced by the quality of vocabulary in students’ essays with regard to their assessment of other textual characteristics is relatively unexplored. This experimental study investigates the influence of lexical features on teachers’ judgements of English as a second language (ESL) argumentative essays. Using analytic and holistic rating scales, English pre-service teachers (N = 37) in Switzerland assessed four essays of different proficiency levels in which the levels of lexical diversity and sophistication had been experimentally varied. Coh-Metrix software was used to manipulate the level of lexical diversity, as measured by MTLD and D, and the Tool for the Automatic Analysis of Lexical Sophistication (TAALES) software was used to obtain differing levels of lexical sophistication, as measured by word range. The results suggested that texts with greater lexical diversity and sophistication were assessed more positively concerning their overall quality as well as the analytic criteria ‘grammar’ and ‘frame of essay’. The implications of this study for classroom practice and teacher education are discussed.
October 2018
-
Abstract
The British Academic Written English (BAWE) corpus (www.coventry.ac.uk/BAWE) comprises almost 3,000 pieces of university student writing distributed across four domains (Arts & Humanities, Life Sciences, Social Sciences, Physical Sciences) and four levels of study (from first year undergraduate to taught Master's level). The texts had all been submitted as part of regular university coursework, and had been awarded top grades, indicating that they had met disciplinary requirements in terms of level and task. The corpus was compiled to enable identification of the linguistic and generic features associated with successful university student writing. Our detailed analyses of the corpus led to the identification of thirteen genre families, and supports the premises that university students write in a wider variety of genres than is commonly recognised, and that student writing differs across genres, disciplines and levels of university study. This review introduces the BAWE corpus and the associated genre family classification, then explains how they can be accessed and used for teaching and research purposes, how they have been used to deepen our understanding of academic writing in English, and where
July 2018
April 2018
-
Going online: The effect of mode of delivery on performances and perceptions on an English L2 writing test suite ↗
Abstract
In response to changing stakeholder needs, large-scale language test providers have increasingly considered the feasibility of delivering paper-based examinations online. Evidence is required, however, to determine whether online delivery of writing tests results in changes to writing performance reflected in differential test scores across delivery modes, and whether test-takers hold favourable perceptions of online delivery. The current study aimed to determine the effect of delivery mode on the two writing tasks (reading-into-writing and extended writing) within the Trinity College London Integrated Skills in English (ISE) test suite across three proficiency levels (CEFR B1-C1). 283 test-takers (107 at ISE I/B1, 109 at ISE II/B2, and 67 at ISE III/C1) completed both writing tasks in paper-based and online mode. Test-takers also completed a questionnaire to gauge perceptions of the impact, usability and fairness of the delivery modes. Many-facet Rasch measurement (MFRM) analysis of scores revealed that delivery mode had no discernible effect, apart from the reading-into-writing task at ISE I, where the paper-based mode was slightly easier. Test-takers generally held more positive perceptions of the online delivery mode, although technical problems were reported. Findings are discussed with reference to the need for further research into interactions between delivery mode, task and level.