Abstract

This study addresses the question of how different aspects of students’ writing achievement can be recognised and evaluated. We developed a linguistically based framework for criteria-based assessment, anchored in a functional view of language and language learning. The framework was used to determine what traits characterise texts at different Proficiency Groups based on comparative judgement and what traits characterise texts assessed differently. Altogether, 100 texts (written by students ages 6–9) representing four text genres were assessed and ranked using both comparative judgement (holistic assessment) and criteria-based analysis. The results indicate that texts generally are assessed as stronger (i.e., placed in a higher Proficiency Group) when comparative judgement is used than what the assessment of a specific language resource indicates. The results also indicate that assessment differences might be a result of different quality expectations for different genres. This points towards the need for genre- and subject-specific assessment criteria to scaffold students in their emergent disciplinary writing development.

Journal
Writing and Pedagogy
Published
2022-07-02
DOI
10.1558/wap.21504
CompPile
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (48) · 4 in this index

  1. Assessing Writing
  2. Barkaoui, K. (2010). Variability in ESL essay rating processes: The role of the rating scale and rater experi…
  3. Beck, I. L., McKeown, M. G. & Worthy, J. (1995). Giving a text voice can improve students’ understanding. Rea…
  4. Beck, I. L. & McKeown, M. G. (2007). Increasing young low-income children’s oral vocabulary repertoires throu…
  5. Benton, T. & Gallacher, T. (2018). Is comparative judgement just a quick form of multiple marking? Research M…
Show all 48 →
  1. Christie, F. (2012). Language education throughout the school years: A functional perspective. Wiley-Blackwell.
  2. Cristie, F. & Derewianka, B. (2008). School discourse: Learning to write across the years of schooling. London.
  3. Written Communication
  4. Fang, Z. & Coatoam, S. (2013). Disciplinary literacy: What you want to know about it. Journal of Adolescent &…
  5. Fang, Z. & Wang, Z. (2011). Beyond rubrics: Using functional language analysis to evaluate student writing. T…
  6. Folkeryd, J. W. (2006). Writing with an attitude: Appraisal and student texts in the school subject of Swedis…
  7. Folkeryd, J. W. (2014). Hjärtan, hjul och himlakroppar. Innehåll i elevers sakprosatexter på lågstadiet. In P…
  8. Folkeryd, J. W. (2021). Teorier och metoder för textanalys – exemplet skrivande i skolans tidiga år. In T. Ny…
  9. Fulcher, G. (2003). Testing second language speaking. Routledge.
  10. af Geijerstam, Å. (2006). Att skriva i naturorienterande ämnen i skolan. Uppsala University.
  11. Halliday, M. A. K. (1978). Language as social semiotic: The social interpretation of language and meaning. Ed…
  12. Halliday, M. A. K. & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar (3.). Arnold.
  13. Heldsinger, S. & Humphry, S. (2010). Using the method of pairwise comparison to obtain reliable teacher asses…
  14. Heller, R. (2010). In praise of amateurism: A friendly critique of Moje’s ‘call for change’ in secondary lite…
  15. Humphry, S. (2017). Academic literacies in the middle years: A framework for enhancing teacher knowledge and …
  16. Humphry, S. & Heldsinger, S. (2020). A two-stage method for obtaining reliable teacher assessments of writing…
  17. Humphry, S. & McGrane, J. A. (2015). Equating a large-scale writing assessment using pairwise comparisons of …
  18. Håland, A. (2016). Disciplinary literacy in elementary school: How a struggling student positions herself as …
  19. Ivanič, R. (2004). Discourses of writing and learning to write. Language and Education, 18(3), 220–245. https…
  20. Assessing Writing
  21. Lado, R. (1961) Language testing: The construction and use of foreign language tests: A teacher's book. McGra…
  22. Langer, J. A. (1992). Reading, writing and genre development. In J. W. Irwin & M. A. Doyle (Eds.), Reading/wr…
  23. Lesterhuis, M., Daal, T. van, Van Gasse, R., Coertjens, L. & Donche, V. (2018). When teachers compare argumen…
  24. Liberg, C. (2014). Att tala om innehåll och ämnesstämmor i elevtexter i tidiga skolår. In R. Hvistendahl & A.…
  25. Writing and Pedagogy
  26. Liberg, C., Espmark, L., Wiksten, J. & Bütler, I. (1997). Upplevelsepresenterande, händelsetecknande, berätta…
  27. Macken-Horarik, M., Sandiford, C., Love, K. & Unsworth, L. (2015). New ways of working ‘with grammar in mind’…
  28. Macken-Horarik, M. & Sandiford, C. (2016). Diagnosing development: A grammatics for tracking student progress…
  29. Madsen, H. (1983). Techniques in testing. Oxford University Press.
  30. Martin, J. R. (2009). Genre and language learning: A social semiotic perspective. Linguistics and Education, …
  31. Martin, J. & White, P. (2005). The language of evaluation: Appraisal in English. Palgrave Macmillan. https://…
  32. Moje, E. B. (2008). Foregrounding the disciplines in secondary literacy teaching and learning: A call for cha…
  33. Myers, M. (1980). A procedure for writing assessment and holistic scoring. ERIC Clearinghouse on Reading and …
  34. Olinghouse, N. G. & Leaird, J. T. (2009). The relationship between measures of vocabulary and narrative writi…
  35. Pollitt, A. (2012). The method of adaptive comparative judgement. Assessment in Education: Principles, Policy…
  36. Ravid, D. (2006). Semantic development in textual contexts during the school years: Noun scale analyses. Jour…
  37. Schleppegrell, M. J. (2004). The language of schooling: A functional linguistics perspective. Lawrence Erlbau…
  38. Shanahan, C. & Shanahan, T. (2014). Does disciplinary literacy have a place in elementary school? The Reading…
  39. Skar, G. B. & Aasen, A. J. (2018). Å måle skriving som grunnleggende ferdighet. Acta Didactica Norden, 12(4).…
  40. Skar, G. B., Jølle, L. & Aasen, A. J. (2020). Establishing rating scales to assess writing proficiency develo…
  41. Swedish National Agency for Education. (2018). Curriculum for the Compulsory School, Preschool Class and Scho…
  42. Tolchinsky, L. & Sandbank, A. (1994). Text production and text differentiation: Developmental changes and edu…
  43. Wheadon, C., Barmby, P., Christodoulou, D. & Henderson, B. (2020). A comparative judgement approach to the la…