Assessing Writing
1018 articlesOctober 2021
-
Abstract
The objectives of this paper are to identify the metadiscourse devices used by English learners at the different levels of language acquisition established by the Common European Framework of Reference and to categorise them to facilitate the assessment and learning of textual and interpersonal devices. First, a learner corpus of essays written by English learners was compiled. Then, the metadiscourse devices were classified in different levels and categories. The results showed the lists and frequencies of metadiscourse devices. The examples aim to make additional and explicit connections between levels of language proficiency and assessment of metadiscourse devices. It can be stated, as a conclusion, that metadiscourse devices portray specific ways of argumentation in essay writing in different levels of EFL proficiency.
July 2021
-
Examining lexical features and academic vocabulary use in adolescent L2 students’ text-based analytical essays ↗
Abstract
Having rich and complex vocabulary is a crucial component that contributes to the quality of writing for academic purposes. However, use of academic vocabulary can be challenging for adolescent L2 writers who are developing their academic language proficiency. Thus, understanding lexical needs of adolescent L2 students in composing academic essays is pivotal in supporting this population in their endeavor to become proficient academic writers. This study investigates the lexical features of adolescent L2 students’ text-based analytical essays and analyzes the extent to which lexical density, lexical diversity, and lexical sophistication predict the quality of their writing. Computational tools Coh-Metrix and VocabProfiler were used to obtain quantitative measures of lexical density, diversity, and sophistication. The results of the study indicate that the essays (n = 70), on average, have (1) low lexical density, (2) more repetition of words indicating less diversity compared to grade-level estimates, and (3) a higher percentage of basic words and lower percentage of academic words. 44 % of the AWL words in the essays come from the source text and prompt. The results of multiple hierarchical regression indicate that the use of academic vocabulary is a predictor of writing quality. The study has important pedagogical implications for classroom practice at secondary school.
April 2021
-
Abstract
Existing writing self-efficacy instruments have assessed the concept through mechanical and process features of writing to the neglect of the influence of situated context. The purpose of this study was to develop and test the Situated Academic Writing Self-Efficacy Scale (SAWSES) based on Bandura’s self-efficacy theory and a model of socially constructed writing. A sequential multimethod approach constituted the methods. A Delphi panel of 15 expert scholars conducted a theoretical evaluation of the scale and the items were piloted with 20 nursing undergraduate students using cognitive interviews. The scale was validated in two studies with independent samples of 255 nursing students (Study 1), and in an interdisciplinary sample of undergraduate (N = 543) and graduate students (N = 264) (Study 2). The three identified factors present a structure to the questionnaire which is developmental and has the potential to detect gaps in student self-assessed ability to master various facets of disciplinary writing: 1) Writing-Essentials – synthesis, emotional control, language; 2) Relational-Reflective – relationship building with writing facilitators (teachers, academic sources) and the self through reflection; and 3) Creative Identity – exploring gaps in student achievement of transformative writing (creativity, voice, and disciplinary identity), where confidence can help identify the most engaged writers.
January 2021
October 2020
-
TOEIC® Writing test scores as indicators of the functional adequacy of writing in the international workplace: Evaluation by linguistic laypersons ↗
Abstract
This study examines the extent to which TOEIC Writing test scores relate to an external criterion: evaluations by linguistic laypersons of the functional adequacy of writing in the international workplace. Test-taker responses to two representative tasks from the TOEIC Writing test (e-mail requests, opinion surveys) were adapted for workplace role-play scenarios that laypersons read and evaluated in an online survey. After reading each role-play scenario, laypersons evaluated the text produced by their imagined interlocutor using functional adequacy scale items (comprehensibility, content adequacy, effectiveness, support and coherence). Overall functional adequacy evaluations were obtained by averaging the ratings for each of the two tasks. Layperson ratings of functional adequacy were strongly correlated with TOEIC Writing test scores (r = 0.76). Results suggested that test-takers’ writing performance is likely to be perceived as functionally adequate for test scores at which important decisions are typically made. Study results are discussed in terms of their implications for claims about the generalizability of TOEIC Writing test score interpretations with respect to those made in the international workplace, as well as the potential benefits, challenges, and limitations involved in this approach to validation.