Rater effects: Ego engagement in rater decision-making

Cynthia S. Wiseman City University of New York
Journal
Assessing Writing
Published
2012-07-01
DOI
10.1016/j.asw.2011.12.001
CompPile
Search in CompPile ↗
Open Access
Closed
Export

Citation Context

References (51) · 2 in this index

  1. The architecture of cognition
  2. Investigating variability in asks and rater judgments in a performance test of foreign la…
    Language Testing  
  3. Language testing in practice: Designing and developing useful language tests
  4. Variability in ESL essay rating processes: The role of the rating scale and rater experience
    Language Assessment Quarterly  
  5. Breland, H., Bridgeman, B., & Fowles, M. E. (1999). Writing assessment in admission to higher education: Revi…
Show all 51 →
  1. Generalizability analyses of work key listening and writing tests
    Educational and Psychological Measurement  
  2. Do English and ESL faculties rate writing samples differently?
    TESOL Quarterly  
  3. Data analysis strategies for mixed-method evaluation designs
    Educational Evaluation and Policy Analysis  
  4. The interpretation of tasks by writers and readers in holistically rated direct assessmen…
    Reading in the composition classroom
  5. Designing and conducting mixed methods research
  6. Essentials of psychological testing
  7. Expertise in evaluating second language compositions
    Language Testing  
  8. Assessing Writing
  9. Cumming, A., Kantor, R., Powers, D., Santos, T., & Taylor, C. (2000). TOEFL 2000 writing framework: A working…
  10. Assessing Writing
  11. Examining rater errors in the assessment of written composition with a many-faceted Rasch model
    Journal of Educational Measurement  
  12. Protocol analysis: Verbal reports as data
  13. Testing second language speaking
  14. Psychometric methods
  15. Examining expert judgments of task difficulty on essay tests
    Journal of Second Language Writing  
  16. Accounting for nonsystematic error in performance ratings
    Language Testing  
  17. The influence of holistic scoring procedures on reading and rating student essays
    Validating holistic scoring for writing assessment
  18. The influence of rater language background on writing performance assessment
    Language Testing  
  19. An investigation into native and non-native teachers’ judgments of oral English performan…
    Language Testing  
  20. Native and nonnative reactions to ESL compositions
    TESOL Quarterly  
  21. A FACETS analysis of rater bias in measuring Japanese second language writing performance
    Language Testing  
  22. Linacre, J. M. (2005). A user's guide to FACETS: Rasch measurement computer program. Version 3.57. Chicago, IL.
  23. Assessing second language writing: The rater's perspective
  24. Using G-theory and many-facet Rasch measurement in the development of performance assessm…
    Language Testing  
  25. Measuring second language performance
  26. Professors’ ratings of language use and rhetorical organizations in ESL compositions
    TESL Canada Journal  
  27. A study of the decision-making behavior of composition markers
    Studies in language testing, Vol. 3: Performance testing, cognition and assessment
  28. Myford, C., & Wolfe, E. (2000). Monitoring sources of variability within the Test of Spoken English assessmen…
  29. Detecting and measuring Edward effects using many-facet Rasch measurement: Part 1
    Introduction to Rasch measurement
  30. The FCE speaking test: Using rater reports to help interpret test scores
    System  
  31. Rating the ratings: Assessing the psychometric quality of rating data
    Psychological Bulletin  
  32. Validation of holistic scoring for ESL writing assessment: How raters evaluate ESL compositions
    Fairness and validation in language assessment
  33. Professors’ reactions to the academic writing of non-native speaking students
    TESOL Quarterly
  34. The effect of raters’ background and training on the reliability of direct writing tests
    The Modern Language Journal  
  35. Rater judgments in the direct assessment of competency-based second language writing ability
    Studies in immigrant English language assessment
  36. Training programs for observers of behaviors: A review
    Personnel Psychology  
  37. A long-term research agenda for the Test of Written English
    Language Testing  
  38. Taking on testing: Teachers as testers researchers
    English Education
  39. ESL essay evaluation: The influences of sentence-level and rhetorical features
    Journal of Second Language Writing  
  40. Testing pronunciation: An application of generablizability theory
    Language Learning  
  41. Error gravity: Faculty response to errors in the written discourse of nonnative speakers …
    Assessing second language writing in academic contexts
  42. Holistic assessment: What goes on in the raters’ minds?
    Assessing second language writing in academic contexts
  43. Effects of training on raters of ESL compositions
    Language Testing  
  44. Using FACETS to model rater training effects
    Language Testing  
  45. Language testing and validation: An evidence-based approach
  46. Wiseman, C. (2005). A validation study comparing an analytic scoring rubric and a holistic scoring rubric in …