Abstract

This study addresses the question of how different aspects of students’ writing achievement can be recognised and evaluated. We developed a linguistically based framework for criteria-based assessment, anchored in a functional view of language and language learning. The framework was used to determine what traits characterise texts at different Proficiency Groups based on comparative judgement and what traits characterise texts assessed differently. Altogether, 100 texts (written by students ages 6–9) representing four text genres were assessed and ranked using both comparative judgement (holistic assessment) and criteria-based analysis. The results indicate that texts generally are assessed as stronger (i.e., placed in a higher Proficiency Group) when comparative judgement is used than what the assessment of a specific language resource indicates. The results also indicate that assessment differences might be a result of different quality expectations for different genres. This points towards the need for genre- and subject-specific assessment criteria to scaffold students in their emergent disciplinary writing development.

Journal
Writing and Pedagogy
Published
2022-07-02
DOI
10.1558/wap.21504
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (4)

  1. Writing and Pedagogy
  2. Assessing Writing
  3. Written Communication
  4. Assessing Writing
Also cites 23 works outside this index ↓
  1. Barkaoui, K. (2010). Variability in ESL essay rating processes: The role of the rating scale and rater experi…
  2. Beck, I. L., McKeown, M. G. & Worthy, J. (1995). Giving a text voice can improve students’ understanding. Rea…
  3. Beck, I. L. & McKeown, M. G. (2007). Increasing young low-income children’s oral vocabulary repertoires throu…
  4. Fang, Z. & Coatoam, S. (2013). Disciplinary literacy: What you want to know about it. Journal of Adolescent &…
  5. Fang, Z. & Wang, Z. (2011). Beyond rubrics: Using functional language analysis to evaluate student writing. T…
  6. Heldsinger, S. & Humphry, S. (2010). Using the method of pairwise comparison to obtain reliable teacher asses…
  7. Heller, R. (2010). In praise of amateurism: A friendly critique of Moje’s ‘call for change’ in secondary lite…
  8. Humphry, S. (2017). Academic literacies in the middle years: A framework for enhancing teacher knowledge and …
  9. Humphry, S. & Heldsinger, S. (2020). A two-stage method for obtaining reliable teacher assessments of writing…
  10. Humphry, S. & McGrane, J. A. (2015). Equating a large-scale writing assessment using pairwise comparisons of …
  11. Håland, A. (2016). Disciplinary literacy in elementary school: How a struggling student positions herself as …
  12. Ivanič, R. (2004). Discourses of writing and learning to write. Language and Education, 18(3), 220–245. https…
  13. Lesterhuis, M., Daal, T. van, Van Gasse, R., Coertjens, L. & Donche, V. (2018). When teachers compare argumen…
  14. Macken-Horarik, M., Sandiford, C., Love, K. & Unsworth, L. (2015). New ways of working ‘with grammar in mind’…
  15. Martin, J. R. (2009). Genre and language learning: A social semiotic perspective. Linguistics and Education, …
  16. Moje, E. B. (2008). Foregrounding the disciplines in secondary literacy teaching and learning: A call for cha…
  17. Olinghouse, N. G. & Leaird, J. T. (2009). The relationship between measures of vocabulary and narrative writi…
  18. Pollitt, A. (2012). The method of adaptive comparative judgement. Assessment in Education: Principles, Policy…
  19. Ravid, D. (2006). Semantic development in textual contexts during the school years: Noun scale analyses. Jour…
  20. Shanahan, C. & Shanahan, T. (2014). Does disciplinary literacy have a place in elementary school? The Reading…
  21. Skar, G. B. & Aasen, A. J. (2018). Å måle skriving som grunnleggende ferdighet. Acta Didactica Norden, 12(4).…
  22. Skar, G. B., Jølle, L. & Aasen, A. J. (2020). Establishing rating scales to assess writing proficiency develo…
  23. Wheadon, C., Barmby, P., Christodoulou, D. & Henderson, B. (2020). A comparative judgement approach to the la…