Assessing Writing Jan 2015 Open Access

An evaluation of the Writing Assessment Measure (WAM) for children's narrative writing

Sandra Dunsmuir University College London ; Maria Kyriacou University College London ; Su Batuwitage University College London ; Emily Hinson University College London ; Victoria Ingram University College London ; Siobhan O'Sullivan

Abstract

The study evaluated the reliability and validity of the Writing Assessment Measure (WAM), developed to reflect the skills which children of different abilities are expected to achieve in written expression, as part of the National Curriculum guidelines in England and Wales. The focus was on its potential use in investigations of children's written narrative in order to inform and target related interventions. The study involved 97 children aged 7–11 from one urban primary school in England. Prompt 1 was administered to all the children in their classrooms together with a standardised written expression test. After three weeks, the same procedure was followed and Prompt 2 was administered. Statistical analyses of the reliability and validity of the instrument showed that it is consistent over time and can be scored reliably by different raters. Content validity of the instrument was demonstrated through inspection of item total correlations which were all significant. Analyses for concurrent validity showed that the instrument correlates significantly with the Wechsler Written Expressive Language sub-test. Significant differences between children of different age and writing skill were also found. The findings indicate that the instrument has potential utility to professionals assessing children's writing.

Journal
Assessing Writing
Published
2015-01-01
DOI
10.1016/j.asw.2014.08.001
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
assessment
Export
BibTeX RIS

Citation Context

Cited by in this index (3)

  1. Sok et al. (2023)
    Investigating the dimensions and determinants of children’s narrative writing i…
    Assessing Writing
  2. Elosua (2022)
    Validity evidences for scoring procedures of a writing assessment task. A case …
    Assessing Writing
  3. Humphry et al. (2019)
    Raters’ perceptions of assessment criteria relevance
    Assessing Writing

References (80) · 9 in this index

  1. Alderson (2000)
    Assessing reading
  2. Alvès (2007)
    Influence of typing skill on pause-execution cycles in written composition
  3. Aron (1999)
    Statistics for psychology
  4. Bachman (2000)
    Modern language testing at the turn of the century: Assuring that what we count counts
    Language Testing  ↗
  5. Bachman (1996)
    Language testing in practice
Show all 80 →
  1. Barnett (2006)
    Handwriting policy and practice in English primary schools. An exploratory study
  2. British Psychological Society (2009)
    Code of ethics and conduct
  3. British Psychological Society (2011)
    Guidance for assessors for the qualification – Test user: Educational, ability/attainment (CCET)
  4. Broad (2000)
    Pulling Your Hair Out: Crises of Standardization in Communal Writing Assessment
    Research in the Teaching of English
  5. Brown et al. (2004)
    Accuracy in the scoring of writing: Studies of reliability and validity using a…
    Assessing Writing
  6. Camp (2012)
    The psychology of writing development—And its implications for assessment
    Assessing Writing
  7. Chanquoy (2002)
    Working memory and writing: Evolution of models and assessment of research
    Annee Psychologique  ↗
  8. Charney (1984)
    The Validity of Using Holistic Scoring to Evaluate Writing: A Critical Overview
    Research in the Teaching of English
  9. Cohen (1994)
    Assessing language ability in the classroom
  10. Cohen (1960)
    A coefficient of agreement for nominal scales
    Educational and Psychological Measurement  ↗
  11. Cole (1997)
    Written expression reviewed
    Research in the Schools
  12. Cole (1997)
    The impact of the pictorial stimulus on the written expression output
    Psychology in Schools  ↗
  13. Connelly (2006)
    Contribution of lower-order letter and word fluency skills to written composition of coll…
    Developmental Neuropsychology  ↗
  14. Connelly (2005)
    The slow handwriting of undergraduate students constrains overall performance in exam essays
    Educational Psychology  ↗
  15. Connelly (2011)
    Children challenged by writing due to language and motor difficulties
    Cognitive psychology of writing handbook: Past, present, and future contributions of cognitive writing research to cognitive psychology
  16. Cooper (1977)
    Evaluating writing: Describing, measuring, judging
  17. Dunsmuir (2004)
    Predictors of writing competence in 4-7 year old children
    British Journal of Educational Psychology  ↗
  18. Dunsmuir (2003)
    Children's Writing and the use of ICT
    Educational Psychology in Practice  ↗
  19. Espin (2004)
    Assessing the writing performance of students in special education
    Exceptionality  ↗
  20. Fathman (1990)
    Teacher response to student writing: Focus on form versus content
    Second language writing: Research insights for the classroom
  21. Flower (1980)
    The dynamics of composing: Making plans and juggling constraints
    Cognitive processes in writing
  22. Gregg (2002)
    School is fun at recess: Informal analyses of written language with students with learnin…
    Journal of Learning Disabilities  ↗
  23. Hamp-Lyons (2000)
    Assessing the portfolio: Practice, theory and research
  24. Hayes (1996)
    A new framework for understanding cognition and affect in writing
    The science of writing: Theories, methods, individual differences and applications
  25. HAYES et al. (2000)
    Does Holistic Assessment Predict Writing Performance?: Estimating the Consisten…
    Written Communication
  26. Herrington (2003)
    Writing development in the college years: By whose definition?
    College Composition and Communication  ↗
  27. Hooper (1994)
    Measurement of written language expression
    Frames of reference for the assessment of learning disabilities
  28. Huot (1990)
    The literature of direct writing assessment: Major concerns and prevailing trends
    Review of Educational Research  ↗
  29. Jeffery (2009)
    Constructs of writing proficiency in US state and national writing assessments:…
    Assessing Writing
  30. Jones (2002)
    Keeping track: Assessment in writing
    Unlocking writing: A guide for teachers
  31. Lynne (2004)
    Coming to terms: Theorizing writing assessment in composition studies
  32. Kane (2006)
    Validation
    Educational measurement
  33. Kane (2013)
    Validating the interpretations and uses of test scores
    Journal of Educational Measurement  ↗
  34. Kent (1974)
    Expectation bias in observational evaluation of therapeutic change
    Journal of Consulting and Clinical Psychology  ↗
  35. Kyriacou, M. (2009). The development of narrative writing in primary school children: Designing and evaluatin…
  36. Matarazzo (1990)
    Psychological assessment vs psychological testing: Validation from Binet to the school, c…
    American Psychologist  ↗
  37. McCutchen (2006)
    Cognitive factors in the development of children's writing
    Handbook of writing research
  38. McNamara (1996)
    Measuring second language performance
  39. Meier (2006)
    Teachers’ use of rubrics to score non-traditional tasks: Factors related to discrepancies…
    Assessment in Education: Principles, Policy and Practice  ↗
  40. Messick (1990)
    Validity of test interpretation and use
  41. Messick (1994)
    The interplay of evidence and consequences in the validation of performance assessments
    Educational Researcher  ↗
  42. Miller (1990)
    Validation methods for direct writing assessment
    Applied Measurement in Education  ↗
  43. Moran (1987)
    Options for written language assessment
    Focus on Exceptional Children  ↗
  44. Moss (1994)
    Can there be validity without reliability?
    Educational Researcher  ↗
  45. Moss (2004)
    The meaning and consequences of “reliability”
    Journal of Educational and Behavioral Statistics  ↗
  46. Muenz (1999)
    Item analysis of written expression scoring systems from the PIAT-R and WIAT
    Psychology in Schools  ↗
  47. Muller (1997)
    A critical discussion of intraclass correlation coefficients
    Statistics in Medicine
  48. Murphy (2001)
    Psychological testing: Principles and applications
  49. Office of Standard in Education (OFSTED) (1999)
    Pupils with specific learning disabilities in mainstream schools
  50. Office of Standard in Education (OFSTED) (2011)
    Removing barriers to literacy
  51. Olive (2002)
    Concurrent activation of high- and low-level production processes in written composition
    Memory & Cognition  ↗
  52. Penny et al. (2000)
    The effect of rating augmentation on inter-rater reliability
    Assessing Writing
  53. Peverly (2006)
    The importance of handwriting speed in adult writing
    Developmental Neuropsychology  ↗
  54. Qualifications and Curriculum Development Agency (2010)
    The National Curriculum. Level descriptors for subjects
  55. Rezaei et al. (2010)
    Reliability and validity of rubrics for assessment through writing
    Assessing Writing
  56. Rijlaarsdam (2006)
    Writing process theory: A functional dynamic approach
    Handbook of writing research
  57. Roberts, E. (2013). The impact of self-regulated strategy development on writing outcomes and affective facto…
  58. Rosnow (2002)
    Beginning behavioural research: A conceptual primer
  59. Ruttle (2004)
    What goes inside my head when I’m writing? A case study of 8–9 year old boys
    Literacy  ↗
  60. Scardamalia (1986)
    Research on written composition
    Handbook of research on teaching
  61. Shaw (2007)
    Examining writing: Research and practice in assessing second language writing
    Studies in language testing
  62. Shrout (1979)
    Intraclass correlations: Uses in assessing rater reliability
    Psychological Bulletin  ↗
  63. Tindal (1991)
    Identifying measures for evaluating written expression
    Learning Disabilities Research and Practice  ↗
  64. Torrance (2006)
    The processing demands of writing
    Handbook of writing research
  65. Wechsler (1996)
    Wechsler Objective Language Dimensions (WOLD)
  66. Wechsler (2004)
    The Wechsler Intelligence Scale for Children—Fourth edition (WISC-IVUK)
  67. Wechsler (2005)
    Wechsler Individual Achievement Test, Second UK Edition (WIAT-II UK)
  68. Weigle (2002)
    Assessing writing
  69. Weir (2005)
    Language testing and validation: An evidence-based approach
  70. White (1985)
    Teaching and assessing writing
  71. Wiggins (1994)
    The constant danger of sacrificing validity to reliability: Making writing asse…
    Assessing Writing
  72. Williams (2013)
    Narrative writing, reading and cognitive processes in middle childhood: What are the links?
    Learning and Individual Differences  ↗
  73. Williams (2013)
    Written language skills in children with specific language impairment
    International Journal of Language & Communication Disorders  ↗
  74. Williams (2000)
    The part which metacognition can play in raising standards in English at Key Stage 2
    Reading  ↗
  75. Woodcock (1989)
    WJ-R Tests of Cognitive Ability
CrossRef global citation count: 27 View in citation network → Build reading path →

Related Articles

  1. Assessing Writing Jul 2026
    LAWE-CL2: Multi-agent LLM-based automated writing evaluation system integrating linguistic features with fine-tuning for Chinese L2 writing assessment ↗
    Xuelin Wang; Qihao Yang; Yuxin Hao; Zhijun Wang; Sijia Guo
    assessment artificial intelligence multilingual writers
  2. Assessing Writing Jul 2026
    Investigating the impact of ChatGPT-assisted self-assessment on college students' writing development: Insights from diverse linguistic backgrounds ↗
    Hamidreza Moeiniasl
    assessment artificial intelligence
  3. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    assessment grammar and mechanics
  4. Assessing Writing Apr 2026
    How do L2 writing subskills interact hierarchically? Insights from diagnostic classification models ↗
    Farshad Effatpanah; Hamdollah Ravand; Mahmoud Abdi Tabari; Yi-Hsin Chen; Olga Kunina-Habenicht
    assessment multilingual writers grammar and mechanics
  5. Assessing Writing Apr 2026
    Assessing GenAI-assisted digital multimodal composing: Reconceptualizing a genre-based framework through self-assessment and peer assessment ↗
    Yunan Zhang; Zixuan Li
    genre theory assessment multimodality