Assessing Writing Oct 2011

The accuracy of performance task scores after resolution of rater disagreement: A Monte Carlo study

James A. Penny ; Robert L. Johnson
Journal
Assessing Writing
Published
2011-10-01
DOI
10.1016/j.asw.2011.06.001
CompPile
Search in CompPile ↗
Topics
multilingual writers

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (12)

  1. Rezaei et al. (2010)
    Reliability and validity of rubrics for assessment through writing
    Assessing Writing
  2. East (2009)
    Evaluating the reliability of a detailed analytic scoring rubric for foreign la…
    Assessing Writing
  3. Crawford et al. (2008)
    When a “sloppy copy” is good enough: Results of a state writing assessment
    Assessing Writing
  4. Dappen et al. (2008)
    A statewide writing assessment model: Student proficiency and future implications
    Assessing Writing
  5. Huang (2008)
    How accurate are ESL students’ holistic writing scores on large-scale assessmen…
    Assessing Writing
Show all 12 →
  1. Whithaus et al. (2008)
    Keyboarding compared with handwriting on a high-stakes writing assessment: Stud…
    Assessing Writing
  2. Brown et al. (2004)
    Accuracy in the scoring of writing: Studies of reliability and validity using a…
    Assessing Writing
  3. Penny (2003)
    Reading high stakes writing samples: My life as a reader
    Assessing Writing
  4. JOHNSON et al. (2001)
    Score Resolution and the Interrater Reliability of Holistic Scores in Rating Essays
    Written Communication
  5. Penny et al. (2000)
    The effect of rating augmentation on inter-rater reliability
    Assessing Writing
  6. HAYES et al. (2000)
    Does Holistic Assessment Predict Writing Performance?
    Written Communication
  7. Willard-Traub et al. (1999)
    The development of large-scale portfolio placement assessment at the University…
    Assessing Writing
Also cites 14 works outside this index ↓
  1. Baker (1999)
    Dimensions of children's motivation for reading and their relations to reading activity a…
    Reading Research Quarterly  ↗
  2. Bond (1998)
    Culturally responsive pedagogy and the assessment of accomplished teaching
    Journal of Negro Education  ↗
  3. Clauser (1999)
    Components of rater error in a complex performance assessment
    Journal of Educational Measurement  ↗
  4. Cronbach (1997)
    Generalizability analysis for performance assessments of student achievement or school ef…
    Educational and Psychological Measurement  ↗
  5. Hogan (1980)
    Relationships between essay tests and objective tests of language skills for elementary s…
    Journal of Educational Measurement  ↗
  6. Huot (1990)
    The literature of direct writing assessment: Major concerns and prevailing trends
    Review of Educational Research  ↗
  7. Johnson (2003)
    Score resolution: An investigation of the reliability and validity of resolved scores
    Applied Measurement in Education  ↗
  8. Johnson (2000)
    The relationship between score resolution methods and interrater reliability: An empirica…
    Applied Measurement in Education  ↗
  9. Johnson (2005)
    Resolving score differences in the rating of writing samples: Does discussion improve the…
    Language Assessment Quarterly  ↗
  10. Lane (1996)
    Generalizability and validity of a mathematics performance assessment
    Journal of Educational Measurement  ↗
  11. LeMahieu (1995)
    Portfolios in large-scale assessment: Difficult but not impossible
    Educational Measurement: Issues and Practice  ↗
  12. Penny (2000)
    Using rating augmentation to expand the scale of an analytic rubric
    Journal of Experimental Education  ↗
  13. Shumate (2007)
    The effects of the number of scale points and nonnormality on the generalizability coeffi…
    Applied Measurement in Education  ↗
  14. Taylor (1998)
    An investigation of scoring methods for mathematics performance-based assessments
    Educational Assessment  ↗
CrossRef global citation count: 6 View in citation network →

Related Articles

  1. Computers and Composition Jun 2026
    “Article laundry” or “tutor in pocket?”: Multilingual writers’ generative AI-assisted writing in professional settings ↗
    Qianqian Zhang-Wu
    artificial intelligence multilingual writers
  2. Journal of Technical Writing and Communication Apr 2026
    What Video Games Can Tell Us About Interactive Technical Communication ↗
    Emily Kuzneski Johnson
    multimodality technical communication multilingual writers
  3. Journal of Technical Writing and Communication Apr 2026
    “Is This Ethical?” New Data on the Ethical Principles and Practices of Document Design ↗
    Leslie Seawright; Amy Hodges; Timothy Ponce
    multimodality technical communication disability studies multilingual writers
  4. Journal of Technical Writing and Communication Apr 2026
    How to Write With GenAI: A Framework for Using Generative AI to Automate Writing Tasks in Technical Communication ↗
    Guiseppe Getto; Susan Kelley; Bremen Vance
    artificial intelligence technical communication multilingual writers
  5. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    multilingual writers