Written Communication Oct 1984

The Impact of Content and Mechanics on Judgments of Writing Quality

BENNETT A. RAFOTH ; DONALD L. RUBIN

Abstract

This study concerns two related issues pertaining to the evaluation of students' written compositions: the relative effects of content versus mechanics on judgments of quality, and the extent to which raters are able to follow instructions directing them to attend more to one aspect of writing than to another. A college-level expository essay was made weaker in content (by reducing the number of underlying propositions) and in mechanics. The original and altered versions were rated analytically and holistically according to different sets of rating instructions. Analysis of variance indicated that mechanics had a greater influence on raters' judgments than either content or rating instructions. Thus the results suggest that evaluators may not be able to focus on individual criteria of writing quality.

Journal
Written Communication
Published
1984-10-01
DOI
10.1177/0741088384001004004
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
assessment
Export
BibTeX RIS

Citation Context

Cited by in this index (3)

  1. Rønneberg et al. (2022)
    Teachers’ talk about giving feedback to young text writers, and about giving fe…
    Writing and Pedagogy
  2. Wolfe et al. (2016)
    Features of difficult-to-score essays
    Assessing Writing
  3. HASWELL (2000)
    Documenting Improvement in College Writing: A Longitudinal Approach
    Written Communication

References (27) · 10 in this index

  1. 10.1111/j.1745-3984.1983.tb00207.x
     ↗
  2. Crowhurst (1980)
    Syntactic Complexity and Teachers’ Quality Ratings of Narrations and Arguments
    Research in the Teaching of English
  3. Diederich, P.
    Measuring growth in English
  4. Diederich, P. P.
    Factors in judgments of writing ability
     ↗
  5. 10.2307/356095
     ↗
Show all 27 →
  1. 10.1037/0022-0663.71.3.328
     ↗
  2. Fry, E. (1977)
    Journal of Reading
  3. Grobe (1981)
    Syntactic Maturity, Mechanics, and Vocabulary as Predictors of Quality Ratings
    Research in the Teaching of English
  4. Harris (1977)
    Teacher Response to Student Writing: A Study of the Response Patterns of High S…
    Research in the Teaching of English
  5. Hoetker (1982)
    Essay Examination Topics and Students' Writing
    College Composition and Communication
  6. Kintsch, W.
    The representation of meaning in memory
  7. 10.1016/S0022-5371(75)80065-X
     ↗
  8. Kirby, D.
    Inside out
  9. Kirschner et al. (1973)
    Non Standard English Usage in the Writing of Black, White, and Hispanic Remedia…
    Research in the Teaching of English
  10. Myers, M.
    A procedure for writing assessment and holistic scoring
  11. Neilsen et al. (1981)
    The Influence of Headed Nominal Complexity and Lexical Choice on Teachers’ Eval…
    Research in the Teaching of English
  12. Nold et al. (1977)
    An Analysis of Readers’ Responses to Essays
    Research in the Teaching of English
  13. 10.1007/BF01419938
     ↗
  14. Piché et al. (1978)
    Teachers’ Subjective Evaluations of Standard and Black Nonstandard English Comp…
    Research in the Teaching of English
  15. Quirk, R.
    A concise grammar of contemporary English
  16. Rafoth et al. (1983)
    Syntactic Complexity and Readers’ Perception of an Author’s Credibility
    Research in the Teaching of English
  17. Rosen, H. (1969). An investigation of the effects of differentiated writing assignments…
  18. 10.3102/00028312003002125
     ↗
  19. Stewart et al. (1979)
    Syntactic Maturity, Mechanics of Writing, and Teachers’ Quality Ratings
    Research in the Teaching of English
  20. Turner, A.
    The construction and use of a propositional text base
  21. 10.2307/356689
     ↗
  22. 10.2307/356693
     ↗
CrossRef global citation count: 22 View in citation network → Build reading path →

Related Articles

  1. Assessing Writing Jul 2026
    LAWE-CL2: Multi-agent LLM-based automated writing evaluation system integrating linguistic features with fine-tuning for Chinese L2 writing assessment ↗
    Xuelin Wang; Qihao Yang; Yuxin Hao; Zhijun Wang; Sijia Guo
    assessment artificial intelligence multilingual writers
  2. Assessing Writing Jul 2026
    Investigating the impact of ChatGPT-assisted self-assessment on college students' writing development: Insights from diverse linguistic backgrounds ↗
    Hamidreza Moeiniasl
    assessment artificial intelligence
  3. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    assessment grammar and mechanics
  4. Assessing Writing Apr 2026
    How do L2 writing subskills interact hierarchically? Insights from diagnostic classification models ↗
    Farshad Effatpanah; Hamdollah Ravand; Mahmoud Abdi Tabari; Yi-Hsin Chen; Olga Kunina-Habenicht
    assessment multilingual writers grammar and mechanics
  5. Assessing Writing Apr 2026
    Assessing GenAI-assisted digital multimodal composing: Reconceptualizing a genre-based framework through self-assessment and peer assessment ↗
    Yunan Zhang; Zixuan Li
    genre theory assessment multimodality