College Composition and Communication May 1990

Reliability, Validity, and Holistic Scoring: What We Know and What We Need to Know

Brian Huot

Abstract

cable of the direct writing assessment instruments (Baurer; Spandel and Stiggins; Scherer; Veal and Hudson). White notes that holistic scoring (not Diederich's general impression scoring used in early direct evaluation research) has quickly become standard practice in a profession that is slow to make significant changes (19). One reason holistic scoring has gained acceptance so quickly may be that it so well fits this era in English studies. By employing a rater's full impression

Journal
College Composition and Communication
Published
1990-05-01
DOI
10.2307/358160
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
assessment
Export
BibTeX RIS

Citation Context

Cited by in this index (29)

  1. Hartwell et al. (2024)
    Navigating innovation and equity in writing assessment
    Assessing Writing
  2. Wilson et al. (2016)
    Comparing the accuracy of different scoring methods for identifying sixth grade…
    Assessing Writing
  3. Xie (2015)
    “I must impress the raters!” An investigation of Chinese test-takers’ strategie…
    Assessing Writing
  4. Sundeen (2014)
    Instructional rubrics: Effects of presentation options on writing quality
    Assessing Writing
  5. Wu (2013)
    Native and non-native students’ interaction with a text-based prompt
    Assessing Writing
Show all 29 →
  1. DelleBovi (2012)
    Literacy instruction: From assignment to assessment
    Assessing Writing
  2. Huang (2012)
    Using generalizability theory to examine the accuracy and validity of large-sca…
    Assessing Writing
  3. Boettger (2010)
    Rubric Use in Technical Communication: Exploring the Process of Creating Valid …
    IEEE Transactions on Professional Communication
  4. Kreth et al. (2010)
    Situated assessment: Limitations and promise
    Assessing Writing
  5. Huang (2008)
    How accurate are ESL students’ holistic writing scores on large-scale assessmen…
    Assessing Writing
  6. Petruzzi (2008)
    Articulating a hermeneutic theory of writing assessment
    Assessing Writing
  7. Du et al. (2007)
    Learning With Weblogs: Enhancing Cognitive and Social Knowledge Construction
    IEEE Transactions on Professional Communication
  8. Hamp-Lyons (2007)
    Worrying about rating
    Assessing Writing
  9. Lee (2004)
    A comparative study of ESL writers’ performance in a paper-based and a computer…
    Assessing Writing
  10. Weigle (2004)
    Integrating reading and writing in a competency test for non-native speakers of…
    Assessing Writing
  11. Slomp et al. (2004)
    Following Phaedrus: Alternate choices in surmounting the reliability/validity dilemma
    Assessing Writing
  12. Crusan (2002)
    An assessment of ESL writing placement assessment
    Assessing Writing
  13. Penny et al. (2000)
    The effect of rating augmentation on inter-rater reliability
    Assessing Writing
  14. Gruber et al. (1999)
    Writing4practice in engineering courses: Implementation and assessment approaches
    Technical Communication Quarterly
  15. Weigle (1999)
    Investigating rater/prompt interactions in writing assessment: Quantitative and…
    Assessing Writing
  16. Yancey (1996)
    The electronic portfolio: Shifting paradigms
    Computers and Composition
  17. Huot (1996)
    Computers and assessment: Understanding two technologies
    Computers and Composition
  18. Gebhardt et al. (1995)
    Symposium on peer reviewing in scholarly journals
    Rhetoric Review
  19. Agnew (1995)
    Rigorous grading does not raise standards: It only lowers grades
    Assessing Writing
  20. Carrell (1995)
    The effect of writers' personalities and raters' personalities on the holistic …
    Assessing Writing
  21. Callahan (1995)
    Portfolio expectations: Possibilities and limits
    Assessing Writing
  22. Gearhart et al. (1995)
    Toward the instructional utility of large-scale writing assessment: Validation …
    Assessing Writing
  23. Elliot et al. (1994)
    The Assessment of Technical Writing: A Case Study
    Journal of Technical Writing and Communication
  24. Brown (1992)
    The daedalus integrated writing environment
    Computers and Composition

References (0)

No references on file for this article.

CrossRef global citation count: 94 View in citation network → Build reading path →

Related Articles

  1. Assessing Writing Jul 2026
    LAWE-CL2: Multi-agent LLM-based automated writing evaluation system integrating linguistic features with fine-tuning for Chinese L2 writing assessment ↗
    Xuelin Wang; Qihao Yang; Yuxin Hao; Zhijun Wang; Sijia Guo
    assessment artificial intelligence multilingual writers
  2. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    assessment grammar and mechanics
  3. Assessing Writing Apr 2026
    How do L2 writing subskills interact hierarchically? Insights from diagnostic classification models ↗
    Farshad Effatpanah; Hamdollah Ravand; Mahmoud Abdi Tabari; Yi-Hsin Chen; Olga Kunina-Habenicht
    assessment multilingual writers grammar and mechanics
  4. Assessing Writing Apr 2026
    Assessing GenAI-assisted digital multimodal composing: Reconceptualizing a genre-based framework through self-assessment and peer assessment ↗
    Yunan Zhang; Zixuan Li
    genre theory assessment multimodality
  5. Assessing Writing Apr 2026
    Assessing fairness in finetuned scoring models with demographically restricted training data ↗
    Langdon Holmes; Wesley Morris; Scott Crossley; Joon Suh Choi
    assessment artificial intelligence race and writing