Abstract

This article examines the behavioral differences of essay scorers who demonstrate different levels of proficiency for a psychometric scoring task. The authors compare three proficiency groups to identify differences in (a) essay features they consider, (b) their understanding of the scoring rubric, and (c) their decision-making procedures. Results indicate scorers with different levels of proficiency do not focus on different essay features when making evaluative decisions but their understandings of the scoring criteria may vary. Proficient scores are more likely to focus on general features of an essay when making evaluative decisions and to adopt values espoused by the scoring rubric than are less proficient scorers. Also, proficient scorers make evaluations by reading the entire essay and then reviewing its content, whereas less proficient scorers may interrupt the reading process to monitor how well the essay satisfies the scoring criteria. Finally, the authors discuss implications for scorer selection and training.

Journal
Written Communication
Published
1998-10-01
DOI
10.1177/0741088398015004002
Open Access
Closed
Topics

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (2)

  1. Research in the Teaching of English
  2. Written Communication
Also cites 10 works outside this index ↓
  1. 10.2307/358048
  2. Factors in judgments of writing ability
  3. 10.1111/j.1745-3984.1994.tb00436.x
  4. 10.1111/j.1745-3984.1996.tb00480.x
  5. Measures of association
  6. 10.1207/s15324818ame0304_3
  7. 10.3102/0013189X023002005
  8. 10.1111/j.1745-3984.1993.tb00424.x
  9. 10.1037/0033-2909.86.2.420
  10. 10.1016/S1075-2935(97)80006-2
CrossRef global citation count: 58 View in citation network →