Assessing Writing Oct 2016

A Many-Facet Rasch analysis comparing essay rater behavior on an academic English reading/writing test used for two purposes

Sarah Goodwin Georgia State University
Journal
Assessing Writing
Published
2016-10-01
DOI
10.1016/j.asw.2016.07.004
CompPile
Search in CompPile ↗
Open Access
Closed
Export
BibTeX RIS

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (36) · 3 in this index

  1. Bachman (2004)
    Statistical analyses for language assessment
  2. Barkaoui (2010)
    Do ESL essay raters’ evaluation criteria change with experience? A mixed-methods, cross-s…
    TESOL Quarterly  ↗
  3. Bond (2007)
    Applying the Rasch model: Fundamental measurement in the human sciences
  4. Chien (2008)
    Repeated measure designs (time series) and Rasch
    Rasch Measurement Transactions
  5. Cumming (2001)
    Scoring TOEFL essays and TOEFL 2000 prototype writing tasks: an investigation into raters’ decision making and development of a preliminary analytic framework. (TOEFL Monograph No. MS-22)
Show all 36 →
  1. Cumming (1990)
    Expertise in evaluating second language compositions
    Language Testing  ↗
  2. Daly (1982)
    Contrast effects in evaluating essays
    Journal of Educational Measurement  ↗
  3. Eckes (2008)
    Rater types in writing performance assessments: A classification approach to rater variability
    Language Testing  ↗
  4. Eckes T. (2009). Many-facet Rasch measurement. Reference supplement to the manual for relating language exami…
  5. Engelhard (2002)
    Monitoring raters in performance assessments
    Large-Scale Assessment Programs for All Students: Development, Implementation, and Analysis
  6. Engelhard (2013)
    Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences
  7. Engelhard (2013)
    Rating quality studies using Rasch measurement theory. Research report 2013-3
  8. Hales (1975)
    The effect of the quality of preceding responses on the grades assigned to subsequent res…
    Journal of Educational Measurement  ↗
  9. Harsch et al. (2012)
    Adapting CEF-descriptors for rating purposes: Validation by a combined rater tr…
    Assessing Writing
  10. Hughes (1983)
    Effects of achievement expectations and handwriting quality on scoring essays
    Journal of Educational Measurement  ↗
  11. Knoch (2011)
    Rating scales for diagnostic assessment of writing: What should they look like …
    Assessing Writing
  12. Lim (2011)
    The development and maintenance of rating quality in performance writing assessment: A lo…
    Language Testing  ↗
  13. Linacre, J. M. (1989/1994). Many-facet Rasch measurement. MESA Press, Chicago.
  14. Linacre, J. M. (2014). Facets computer program for many-facet Rasch measurement, version 3.71.4. Beaverton, O…
  15. Lumley (2002)
    Assessment criteria in a large-scale writing test: What do they really mean to the raters?
    Language Testing  ↗
  16. McNamara (1996)
    Measuring second language performance
  17. Murphy (2008)
    Construct and consequence: Validity in writing assessment
    Handbook of research on writing: history, society, school, individual, text
  18. Myford (2009)
    Monitoring rater performance over time: A framework for detecting differential accuracy a…
    Journal of Educational Measurement  ↗
  19. Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish In…
  20. Shaw (2007)
    Examining writing: Research and practice in assessing second language writing
  21. Spear (1997)
    The influence of contrast effects upon teachers’ marks
    Educational Research  ↗
  22. Vaughan (1991)
    Holistic assessment: What goes on in the rater’s mind?
    Assessing second language writing in academic contexts
  23. Weigle (1994)
    Effects of training on raters of ESL compositions
    Language Testing  ↗
  24. Weigle (1998)
    Using FACETS to model rater training effects
    Language Testing  ↗
  25. Weigle (2002)
    Assessing writing
  26. Wind (2012)
    Examining rating quality in writing assessment: Rater agreement, error, and accuracy
    Journal of Applied Measurement
  27. Wind et al. (2013)
    How invariant and accurate are domain ratings in writing assessment?
    Assessing Writing
  28. Wolfe (2014)
    Evaluation of pseudo-scoring as an extension of rater training
    Research Report
  29. Wolfe (2004)
    Identifying rater effects using latent trait models
    Psychology Science
  30. Wright (1994)
    Reasonable mean-square fit values
    Rasch Measurement Transactions
  31. Wright (2003)
    Rack and stack: Time 1 vs. time 2 or pre-test vs. post-test
    Rasch Measurement Transactions
CrossRef global citation count: 20 View in citation network → Build reading path →