Abstract

This paper examines the effect of linguistic accuracy (e.g., the lack of form, grammatical, and lexical errors) on scoring during the high-stakes national test of English in Swedish upper secondary school. Teachers are expected to score their own students’ texts with the help of assessment instructions containing benchmark texts (i.e., texts representing different score bands). The assessment instructions and the score bands provided to guide scoring are not explicit about how accuracy should influence scores. Two research questions were answered: As measured by ordinal regression, to what extent does linguistic accuracy predict rater scores? Do the texts scored by teachers reflect the graded example texts in terms of how linguistic accuracy predicts scores? The results revealed, amongst other things, that overall frequency of errors in texts significantly predicted scores as the model explained approximately 58 % of the variance in the outcome variable according to Nagelkerke’s pseudo R-squared. Accuracy also had a similar effect on scores in texts rated by teachers as in the benchmark texts. In relation to the findings, it was concluded that accuracy may have more of an impact on scores than constructs that are more explicit components of the score bands such as lexical complexity.

Journal
Assessing Writing
Published
2026-01-01
DOI
10.1016/j.asw.2025.100995
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (48) · 1 in this index

  1. The effect of ‘massed’task repetitions on complexity, accuracy and fluency: does it trans…
    The Language Learning Journal  
  2. Words are picked up along the way"-Swedish EFL teachers’ conceptualizations of vocabulary…
    Language Awareness  
  3. 10.1075/lllt.32.02bul
    Defining and operationalising L2 Complexity Dimensions of L2 Performance and proficiency: Complexity, Accuracy and Fluency in SLA  
  4. The impact of spelling errors on trained raters’ scoring decisions
    Language Education Assessment  
  5. Christensen, R. (2023). Ordinal—Regression Models for Ordinal Data. R package version, 2023.12-4.1. 〈https://…
Show all 48 →
  1. Corder, S.P. (1967). The significance of learner’s errors.
  2. Common European Framework of Reference for Languages: Learning, teaching, assessment
  3. Analysis of discourse features and verification of scoring levels for independent and int…
    ETS Research Report Series, 2005(1), i
  4. Error tagging systems for learner corpora
    Revista española Délelőtt lingüística aplicada
  5. Assessing Writing
  6. Educational Testing Service (2023Writing Scoring Guide. TOEFL iBT® Writing Scoring Guide Flyer(ets.org).
  7. The differential effects of three types of task planning on the fluency, complexity, and …
    Applied Linguistics  
  8. Analysing learner language
  9. National assessment of foreign languages in Sweden: A multifaceted and collaborative venture
    Language Testing  
  10. Overall, a good test, but…—Swedish lower secondary teachers’ perceptions and use of natio…
    Languages  
  11. Teaching L2 composition: Purpose
    process, and practice
  12. Capturing accuracy in second language performance: The case for a weighted clause ratio
    Annual Review of Applied Linguistics  
  13. Toward a transparent construct of reading-to-write tasks: The interface between discourse…
    Language Assessment Quarterly  
  14. The International Corpus of Learner English. Handbook and CD-ROM
  15. The Louvain Error tagging Manual. Version 2.0. CECL Papers 4
    Louvain-Louisiana-Neuve: Centre for English Corpus Linguistics/Université Catholique Délelőtt Louvain (38 Pages) Available here
  16. The UCLouvain Error Editor User guide - Version 2.0. CECL Papers 6
    Louvain-Louisiana-Neuve: Centre for English Corpus Linguistics/Université Catholique Délelőtt Louvain (33 Pages) Available here
  17. The effect of lexical complexity on grading of Swedish EFL learners’ texts during high-st…
    International Journal of Learner Corpus Research  
  18. Complexity, accuracy and fluency
    Dimensions of L2 performance and Proficiency
  19. Complexity, accuracy, and fluency in second language acquisition
    Applied Linguistics  
  20. The Uppsala Learner English Corpus: A new corpus of Swedish high school students’ writing
    Multilingualism: Proceedings of the 23rd Scandinavian Conference of Linguistics
  21. R package ‘aer’ version, 1.2-14
    org)
  22. Köhlmyr, P. (2003). To err is human. An investigation of grammatical errors in Swedish 16-year-old learners’ …
  23. Laerd Statistics. (n.d.). Ordinal Regression using SPSS Statistics. How to perform an Ordinal Regression in S…
  24. Adjusting expectations: The study of complexity, accuracy, and fluency in second language…
    Applied Linguistics  
  25. Mangiafico, S. (2024). rcompanion: Functions to Support Extension Education Program Evaluation. Rutgers Coope…
  26. Tagging the interlanguage of Chinese learners of English
    Entering text
  27. Neff, J., & Bunce, C. (2006). Pragmatic word order errors and discourse-grammar interdependence. In IV Confer…
  28. Pallotti, G. (2009). CAF: Defining, refining and differentiating constructs. Applied Linguistics, 30(4), 590–601.
  29. Doing interlanguage analysis in school contexts
    EUROSLA Monographs Series
  30. The phraseological dimension in interlanguage complexity research
    Second Language Research  
  31. Shaping a score: Complexity, accuracy, and fluency in integrated writing performances
    Language Testing  
  32. Measures of linguistic accuracy in second language writing research
    Language Learning  
  33. R: A language and environment for statistical computing. [Computer software]
  34. Schlegel, B.E., Steenbergen, M., Schlegel, M.B., & Imports, M.A. S.S. (2018). R Package brant, version 0.3-0.…
  35. Complexity, accuracy, fluency and lexis in task-based performance
    Dimensions of L2 performance and Proficiency
  36. Skolverket. (2022). Ämnesplan i Engelska. Skolverket.
  37. Accuracy across proficiency levels: A learner corpus approach
    Presses Universitaires Délelőtt Louvain
  38. Accuracy. In N.T-V. & M. Paquot (Eds.)
    The Routledge Handbook of Second Language Acquisition and Corpora
  39. University of Gothenburg (2023Exempel på texter bedömda som E, Engelska 5. Exempel på uppgiftstyper för Engel…
  40. University of Gothenburg (2023Översikt – Skriftlig produktion och interaktion, Engelska 5. Exempel på uppgift…
  41. Venables, W.N., & $1 $2 (2002). Modern Applied Statistics with S. (4th ed.) Springer.
  42. Second language development in writing: Measures of fluency, accuracy, & complexity. Tech…
    University of Hawai’i, Second Language Teaching and Curriculum Centre, Honolulu