Assessing Writing

149 articles
Year: Topic: Clear
Export:
multilingual writers ×

January 2024

  1. Do I need feedback or avoid it in L2 writing? Impacts of self-efficacy and shyness on feedback-seeking behavior
    doi:10.1016/j.asw.2023.100805
  2. Amplifying test-taker voices in the validation of L2 writing assessment tasks
    doi:10.1016/j.asw.2023.100790
  3. A mixed Rasch model analysis of multiple profiles in L2 writing
    Abstract

    The present study used the Mixed Rasch Model (MRM) to identify multiple profiles in L2 students’ writing with regard to several linguistic features, including content, organization, grammar, vocabulary, and mechanics. To this end, a pool of 500 essays written by English as a foreign language (EFL) students were rated by four experienced EFL teachers using the Empirically-derived Descriptor-based Diagnostic (EDD) checklist. The ratings were subjected to MRM analysis. Two distinct profiles of L2 writers emerged from the sample analyzed including: (a) Sentence-Oriented and (b) Paragraph-Oriented L2 Writers. Sentence-Oriented L2 Writers tend to focus more on linguistic features, such as grammar, vocabulary, and mechanics, at the sentence level and try to utilize these subskills to generate a written text. However, Paragraph-Oriented Writers are inclined to move beyond the boundaries of a sentence and attend to the structure of a whole paragraph using higher-order features such as content and organization subskills. The two profiles were further examined to capture their unique features. Finally, the theoretical and pedagogical implications of the identification of L2 writing profiles and suggestions for further research are discussed.

    doi:10.1016/j.asw.2023.100803

October 2023

  1. Student engagement with peer feedback in L2 writing: Insights from reflective journaling and revising practices
    doi:10.1016/j.asw.2023.100784
  2. Growth mindset and emotions in tandem: Their effects on L2 writing performance based on writers’ proficiency levels
    doi:10.1016/j.asw.2023.100785
  3. Feedback literacy in writing research and teaching: Advancing L2 WCF research agendas
    Abstract

    Research on corrective feedback (CF) has developed from its original focus on identifying which type of CF is most effective for developing L2 language learners’ grammatical accuracy to focusing on how learners use CF. Underpinning this is the assumption that learners know what to do with CF when they receive it. The concept of “feedback literacy” challenges this assumption. Carless and Boud (2018), define feedback literacy as “the understandings, capacities and dispositions needed to make sense of information and use it to enhance work or learning strategies” (p. 1316). Our intention in this paper is to reflect on the manner in which theoretical and empirical work on feedback literacy can contribute to advancing L2 written corrective feedback (WCF) research agendas. Central in our proposal is the partially under-researched aspect of experience in terms of the L2 writers’ educational background experience, particularly experience with L1 and L2 writing. We further argue that how learners were taught L1 writing and how the L1 educational culture/ society values writing can impact on how learners approach L2 writing tasks and accompanying feedback. Implications of this inclusive view of the learner for future research and pedagogy is discussed.

    doi:10.1016/j.asw.2023.100786
  4. Understanding EFL students’ feedback literacy development in academic writing: A longitudinal case study
    doi:10.1016/j.asw.2023.100770
  5. Automated analysis of cohesive features in L2 writing: Examining effects of task complexity and task repetition
    doi:10.1016/j.asw.2023.100783

July 2023

  1. Diagnosing Chinese college-level English as a Foreign Language (EFL) learners’ integrated writing capability: A Log-linear Cognitive Diagnostic Modeling (LCDM) study
    doi:10.1016/j.asw.2023.100730
  2. Feedback seeking by first-year Chinese international students: Understanding practices and challenges
    doi:10.1016/j.asw.2023.100757
  3. The development of teacher feedback literacy in situ: EFL writing teachers’ endeavor to human-computer-AWE integral feedback innovation
    doi:10.1016/j.asw.2023.100739
  4. Using ChatGPT for second language writing: Pitfalls and potentials
    doi:10.1016/j.asw.2023.100745
  5. Connecting form with function: Model texts for bilingual learners’ narrative writing
    doi:10.1016/j.asw.2023.100753
  6. The mediating role of curriculum configuration on teacher’s L2 writing assessment literacy and practices in embedded French writing
    doi:10.1016/j.asw.2023.100742
  7. The development and validation of a scale on L2 writing teacher feedback literacy
    doi:10.1016/j.asw.2023.100743
  8. Shifting perceptions of socially just writing assessment: Labor-based contract grading and multilingual writing instruction
    doi:10.1016/j.asw.2023.100731

April 2023

  1. Your writing could have been better: Examining the effects of upward and downward counterfactual communication on the motivational aspects of L2 writing
    doi:10.1016/j.asw.2023.100714
  2. Individual differences in L2 writing feedback-seeking behaviors: The predictive roles of various motivational constructs
    doi:10.1016/j.asw.2023.100698
  3. An investigation into L2 writing teacher beliefs and their possible sources
    doi:10.1016/j.asw.2023.100710
  4. Exploring multilingual students’ feedback literacy in an asynchronous online writing course
    doi:10.1016/j.asw.2023.100718
  5. Genre pedagogy: A writing pedagogy to help L2 writing instructors enact their classroom writing assessment literacy and feedback literacy
    Abstract

    As part of a larger case study, this single exploratory case study aims to explore the potential of genre-based pedagogy (GBP) to allow L2 writing instructors to enact their writing assessment literacy and feedback literacy. The findings demonstrate that GBP afforded the participating writing instructor of a genre-based EAP writing course to carry out effective writing classroom assessment practices and thus enact their2 writing assessment literacy and feedback literacy. GBP allowed effective writing classroom assessment practices such as diagnostic assessment and learner involvement in assessment. More specifically, genre exploration tasks led to diagnostic assessment and helped the instructor coordinate effective classroom discussions to elicit evidence of the students’ knowledge of the target genre that they would study. Second, students’ production of texts in target genres not only allowed the instructor to collect evidence of the students’ specific genre knowledge, but it also afforded learner involvement through self-reflection. The instructor could also efficiently interpret this evidence and provide formative feedback through pre-established genre specific assessment criteria.

    doi:10.1016/j.asw.2023.100717

January 2023

  1. Exploring the development of student feedback literacy in the second language writing classroom
    doi:10.1016/j.asw.2023.100697

October 2022

  1. Transfer of ideal L1 and L2 writing selves and their impacts on L2 writing enjoyment and integrated writing performance
    doi:10.1016/j.asw.2022.100674
  2. Structure and coherence as challenges in composition: A study of assessing less proficient EFL writers’ text quality
    Abstract

    Students are usually expected to write full texts in English as a foreign language (EFL) at the end of secondary education. However, research on EFL writing at school is scarce, especially regarding less proficient writers, and seldom focuses on deep-level text features such as structure and coherence. Based on a sample of 166 EFL students in Year 9 attending German middle and lower performance track schools, this study examined 326 narrative and argumentative texts. First, we assessed structure and coherence via analytic ratings using detailed rubrics to gain insights into possible challenges for students. Our analysis showed that relevant text parts (such as the conclusion) were mostly missing and that students struggled to establish a broad common thread with argumentative texts being overall less structured and coherent than narrative texts. Second, we used the software Comproved® to conduct holistic ratings of overall text quality and compared them with our analytic ratings. Large correlations between both ratings suggest that structure and coherence are important aspects of text quality. We discuss how our rubrics can serve as a useful tool for assessment for learning and assist less proficient writers in establishing deep-level features in their texts.

    doi:10.1016/j.asw.2022.100672
  3. Using chatbots to scaffold EFL students’ argumentative writing
    doi:10.1016/j.asw.2022.100666
  4. Complexity, accuracy, and fluency in L2 writing across proficiency levels: A matter of L1 background?
    doi:10.1016/j.asw.2022.100673

July 2022

  1. How feedback conditions broaden or constrain knowledge and perceptions about improvement in L2 writing: A 12-week exploratory study
    doi:10.1016/j.asw.2022.100633
  2. Reconceptualizing the impact of feedback in second language writing: A multidimensional perspective
    doi:10.1016/j.asw.2022.100630
  3. Explicit strategy-based instruction in L2 writing contexts: A perspective of self-regulated learning and formative assessment
    doi:10.1016/j.asw.2022.100645

April 2022

  1. The mediating effects of student beliefs on engagement with written feedback in preparation for high-stakes English writing assessment
    Abstract

    Research in L2 writing contexts has shown developing writers’ beliefs exert a powerful mediating effect on how they respond to written feedback. The mediating role of beliefs is magnified in preparation for high-stakes English writing assessment contexts, where tangible outcomes pivot on successful test performance. The present qualitative case study utilises data from semi-structured interviews to investigate how the beliefs of three self-directed IELTS preparation candidates mediated their affective, behavioural, and cognitive engagement with electronic teacher written feedback across three multi-draft Task 2 rehearsal essays. Utilising a metacognitive conceptual approach (Wenden, 1998), the study identified seven themes: 1) self-concept beliefs regulated engagement, 2) reliance on the expertise of a quality teacher, 3) engagement was mediated by individuals’ learning-to-write beliefs, 4) belief in comprehensive, critical written feedback, 5) feedback deemed transferable was more comprehensively engaged with, 6) entrenched test-taking strategy beliefs hindered engagement, and 7) supplementary self-directed learning activities were considered of limited value. The implications for practitioners of IELTS Writing preparation and the IELTS co-owners are discussed.

    doi:10.1016/j.asw.2022.100611
  2. Assessing linguistic complexity features in L2 writing: Understanding effects of topic familiarity and strategic planning within the realm of task readiness
    doi:10.1016/j.asw.2022.100605

January 2022

  1. Dependency distance measures in assessing L2 writing proficiency
    doi:10.1016/j.asw.2021.100603
  2. Incremental Intelligence Matters: How L2 Writing Mindsets Impact Feedback Orientation and Self-Regulated Learning Writing Strategies
    doi:10.1016/j.asw.2021.100593
  3. Noun phrasal complexity in ESL written essays under a constructed-response task: Examining proficiency and topic effects
    doi:10.1016/j.asw.2021.100595
  4. Linguistic, cultural and substantive patterns in L2 writing: A qualitative illustration of MisLevy’s sociocognitive perspective on assessment
    doi:10.1016/j.asw.2021.100574
  5. Appropriateness as an aspect of lexical richness: What do quantitative measures tell us about children's writing?
    Abstract

    Quantitative measures of vocabulary use have added much to our understanding of first and second language writing development. This paper argues for measures of register appropriateness as a useful addition to these tools. Developing an idea proposed by Durrant and Brenchley (2019), it explores what such measures can tell us about vocabulary development in the L1 writing of school children in England and critically examines how results should be interpreted. It shows that significant patterns of discipline- and genre-specific vocabulary development can be identified for measures related to four distinct registers, though the strongest patterns are found for vocabulary associated with fiction and academic writing. Follow-up analyses showed that changes across year groups were primarily driven, not by the nature of individual words, but by the overall quantitative distribution of register-specific vocabulary, suggesting that the traditional distinction between measures of lexical diversity and lexical sophistication may not be helpful for understanding development in this context. Closer analysis of academic vocabulary showed development of distinct vocabularies in Science and English writing in response to sharply differing communicative needs in those disciplines, suggesting that development in children’s academic vocabulary should not be seen as a single coherent process.

    doi:10.1016/j.asw.2021.100596
  6. Revisiting the predictive power of traditional vs. fine-grained syntactic complexity indices for L2 writing quality: The case of two genres
    doi:10.1016/j.asw.2021.100597
  7. The impact of essay organization and overall quality on the holistic scoring of EFL writing: Perspectives from classroom english teachers and national writing raters
    doi:10.1016/j.asw.2021.100604
  8. Composing strategies employed by high-and low-performing Iranian EFL students in essay writing classes
    doi:10.1016/j.asw.2021.100601

October 2021

  1. Performance prediction strengths of noun and verb phrases in L2 writing: Comparison of density and complexity variables
    doi:10.1016/j.asw.2021.100572
  2. Assessing EFL students’ writing development as they are exposed to the integrated use of drama-based pedagogy and SFL-based teaching
    doi:10.1016/j.asw.2021.100569
  3. The assessment of metadiscourse devices in English as a foreign language
    Abstract

    The objectives of this paper are to identify the metadiscourse devices used by English learners at the different levels of language acquisition established by the Common European Framework of Reference and to categorise them to facilitate the assessment and learning of textual and interpersonal devices. First, a learner corpus of essays written by English learners was compiled. Then, the metadiscourse devices were classified in different levels and categories. The results showed the lists and frequencies of metadiscourse devices. The examples aim to make additional and explicit connections between levels of language proficiency and assessment of metadiscourse devices. It can be stated, as a conclusion, that metadiscourse devices portray specific ways of argumentation in essay writing in different levels of EFL proficiency.

    doi:10.1016/j.asw.2021.100560
  4. Individual and collaborative processing of written corrective feedback affects second language writing accuracy and revision
    doi:10.1016/j.asw.2021.100566
  5. Investigating the authenticity of computer- and paper-based ESL writing tests
    doi:10.1016/j.asw.2021.100548

July 2021

  1. Examining lexical features and academic vocabulary use in adolescent L2 students’ text-based analytical essays
    Abstract

    Having rich and complex vocabulary is a crucial component that contributes to the quality of writing for academic purposes. However, use of academic vocabulary can be challenging for adolescent L2 writers who are developing their academic language proficiency. Thus, understanding lexical needs of adolescent L2 students in composing academic essays is pivotal in supporting this population in their endeavor to become proficient academic writers. This study investigates the lexical features of adolescent L2 students’ text-based analytical essays and analyzes the extent to which lexical density, lexical diversity, and lexical sophistication predict the quality of their writing. Computational tools Coh-Metrix and VocabProfiler were used to obtain quantitative measures of lexical density, diversity, and sophistication. The results of the study indicate that the essays (n = 70), on average, have (1) low lexical density, (2) more repetition of words indicating less diversity compared to grade-level estimates, and (3) a higher percentage of basic words and lower percentage of academic words. 44 % of the AWL words in the essays come from the source text and prompt. The results of multiple hierarchical regression indicate that the use of academic vocabulary is a predictor of writing quality. The study has important pedagogical implications for classroom practice at secondary school.

    doi:10.1016/j.asw.2021.100540

January 2021

  1. Complexity, accuracy, and fluency as indices of college-level L2 writers’ proficiency
    doi:10.1016/j.asw.2020.100510
  2. The role of L2 writing self-efficacy in integrated writing strategy use and performance
    doi:10.1016/j.asw.2020.100504

July 2020

  1. Beyond linguistic complexity: Assessing register flexibility in EFL writing across contexts
    doi:10.1016/j.asw.2020.100465

April 2020

  1. Assessing the metacognitive awareness relevant to L1-to-L2 rhetorical transfer in L2 writing: The cases of Chinese EFL writers across proficiency levels
    doi:10.1016/j.asw.2020.100452

January 2020

  1. A measure of possible sources of demotivation in L2 writing: A scale development and validation study
    doi:10.1016/j.asw.2019.100438