Writing and Pedagogy Jul 2022 Open Access

Identifying texts in the Warning Zone

Gustaf B Skar ; Anne H Kvistad Norwegian University of Science and Technology ; Marita B Johansen Norwegian University of Science and Technology ; Gert Rijlaarsdam University of Amsterdam ; Arne Johannes Aasen Norwegian University of Science and Technology

Abstract

[Open Access CC BY-NC-ND]This article addresses the basis for the development of the screening tool Norwegian Early Writers Signal (NEWS). The aim of the study was to develop a tool for teachers in grades 1–3 to identify student texts in ‘the Warning Zone’, i.e., texts that signal insufficient overall text quality associated with students in need of extra instructional support. Text norms were elicited from a panel of 14 experts in a standardsetting seminar. The standard-setting procedure was a benchmarking-like approach in which panelists chose texts that according to their judgement were in the Warning Zone. Additionally, in an online questionnaire, data on experts’ expectation growth pattern for eight text quality aspects in grades 1–3 were collected. Furthermore, student texts in the Warning Zone were marked and then included in the screening tool to concretize the norms, showing that texts in this zone can take several shapes. The article discusses what steps can be taken to further validate and implement the NEWS tool.

Journal
Writing and Pedagogy
Published
2022-07-02
DOI
10.1558/wap.22095
CompPile
Open Access
OA PDF Hybrid
Export
BibTeX RIS

Citation Context

Cited by in this index (1)

  1. Skar et al. (2022)
    Audience awareness in elementary school students’ texts
    Writing and Pedagogy

References (33) · 5 in this index

  1. Bay, L. (2012). Developing achievement levels on the 2011 National Assessment of Educational Progress in grad…
  2. Berge, K. L., Evensen, L. S. & Thygesen, R. (2016). The wheel of writing: A model of the writing domain for t…
     ↗
  3. Berge, K. L., Skar, G. B., Matre, S., Solheim, R., Evensen, L. S., Otnes, H. & Thygesen, R. (2019). Introduci…
     ↗
  4. Cizek, G. J. & Bunch, M. B. (2007). Standard setting: A guide to establishing and evaluating performance stan…
  5. Eckes, T. (2011). Introduction to many-facet Rasch measurement: Analyzing and evaluating rater-mediated asses…
     ↗
Show all 33 →
  1. Evensen (2002)
    Convention from Below: Negotiating Interaction and Culture in Argumentative Writing
    Written Communication
  2. Foorman, B. R., Francis, D. J., Shaywitz, S. E., Shaywitz, B. A. & Fletcher, J. M. (1997). The case for early…
  3. Graham, S. (2018). A revised writer(s)-within-community model of writing. Educational Psychologist, 53(4), 25…
     ↗
  4. Graham, S. & Harris, K. R. (2018). Evidence-based practices in writing. In S. Graham, C. A. MacArthur & M. He…
  5. Graham, S. & Rijlaarsdam, G. (2016). Writing education around the globe: Introduction and call for a new glob…
     ↗
  6. Graham, S., Skar, G. B. & Falk, D. Y. (2021). Teaching writing in the primary grades in Norway: A national su…
     ↗
  7. Harsch, C. & Kanistra, V. P. (2020). Using an innovative standard-setting approach to align integrated and in…
     ↗
  8. Hooper, S. R., Roberts, J. E., Nelson, L., Zeisel, S. & Kasambira Fannin, D. (2010). Preschool predictors of …
     ↗
  9. Jeffery et al. (2019)
    Writing development and education standards in cross-national perspective
    Writing and Pedagogy
  10. Jeffery, J. V. & Parr, J. M. (Eds.). (2021). International perspectives on writing curricula and development.…
     ↗
  11. Juel, C. (1988). Learning to read and write: A longitudinal study of 54 children from first through fourth gr…
     ↗
  12. Opplæringslova [The Education Act]. (1998). Lov om grunnskolen og den vidaregåande opplæringa ({LOV}-1998-07-…
  13. Purves, A. C. (1992). Conclusion. In A. C. Purves (Ed.), The IEA study of written composition II: Education a…
  14. Rijlaarsdam, G., Jansen, T., Braaksma, M., Van Steendam, E., Van den Branden, K. & Verheyden, L. (2013). Lear…
  15. RUSSELL (1997)
    Rethinking Genre in School and Society: An Activity Theory Analysis
    Written Communication
  16. Schoonen, R. (2012). The validity and generalizability of writing scores: The effect of rater, task and langu…
     ↗
  17. Skar, G. B. (2017). The Norwegian national sample-based writing test 2016: Technical report. Nasjonalt senter…
  18. Skar et al. (2022)
    Audience awareness in elementary school students’ texts
    Writing and Pedagogy
  19. Skar, G. B., Aasen, A. J. & Jølle, L. (2020). Functional writing in the primary years: Protocol for a mixed-m…
     ↗
  20. Skar, G. B. & Huebner, A. (2022). The predictability of first grade students’ writing proficiency [Submitted]…
     ↗
  21. Skar, G. B. & Jølle, L. (2017). Teachers as raters: Investigation of a long-term writing assessment program. …
     ↗
  22. Skar, G. B., Jølle, L. & Aasen, A. J. (2020). Establishing scales to assess writing proficiency development i…
     ↗
  23. Skar, G. B., Lei, P-W., Graham, S., Aasen, A. J., Johansen, M. B. & Kvistad, A. H. (2022). Handwriting fluenc…
     ↗
  24. Van den Bergh, H., De Maeyer, S., Van Weijen, D. & Tillema, M. (2012). Generalizability of text quality score…
     ↗
  25. Verheyden, L. (2010). Achter de lijn. Vier empirische studies over ontluikende stelvaardigheid. [The story be…
  26. Verheyden, L., Van den Branden, K., Rijlaarsdam, G., Van den Bergh, H. & De Maeyer, S. (2010). Written narrat…
     ↗
  27. Wilson, J. (2018). Universal screening with automated essay scoring: Evaluating classification accuracy in gr…
     ↗
  28. Wilson et al. (2016)
    Comparing the accuracy of different scoring methods for identifying sixth grade…
    Assessing Writing
CrossRef global citation count: 3 View in citation network → Build reading path →