Establishing analytic score profiles for large-scale L2 writing assessment: The case of the CET-4 writing test

Shaoyan Zou ; Xun Yan University of Illinois Urbana-Champaign ; Jason Fan The University of Melbourne
Journal
Assessing Writing
Published
2024-04-01
DOI
10.1016/j.asw.2024.100826
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (81) · 9 in this index

  1. Using an analytic dichotomous evaluation checklist to increase inter-and intra-rater reli…
    Iranian Journal of Applied Linguistics (IJAL)
  2. American Educational Research Association, American Psychological Association, National Council on Measuremen…
  3. Writing evaluation: what can analytic versus holistic essay scoring tell us?
    System  
  4. The dynamic development of English⁃L2 writing competence
    Modern Foreign Languages
  5. Assessing Writing
Show all 81 →
  1. Variability in ESL essay rating processes: The role of the rating scale and rater experience
    Language Assessment Quarterly  
  2. Effects of marking method and rater experience on ESL essay scores and rater performance
    Assessment in Education: Principles, Policy & Practice
  3. Assessing Writing
  4. Bond, T.G., & Fox, C.M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd …
  5. Chapelle, C.A., Enright, M.K., & Jamieson, J.M.. (Eds.). (2008). Building a validity argument for the Test of…
  6. Empirical profiles of academic oral English proficiency from an international teaching as…
    Language Testing  
  7. Comparing L2 learners’ writing against parallel machine-translated texts: Raters’ assessm…
    System  
  8. Determining the scoring validity of a co-constructed CEFR-based rating scale. Language
    Testing  
  9. Frankfurt
    Introduction to many-facet Rasch measurement
  10. At the intersection of language testing policy, practice, and research: An interview with…
    Language Assessment Quarterly  
  11. Local english testing in China’s tertiary education: Contexts, policies, and practices
    Language Testing  
  12. A many-facet rasch model to detect halo effect in three types of raters
    Theory & Practice in Language Studies  
  13. Fei, Q. & Zhao, Y.Q. (2008). Problems in CET-4 writing rubric and scoring method. Foreign Language Teaching T…
  14. Revisiting multiple profiles of learner compositions: A comparison of highly rated NS and…
    Journal of Second Language Writing  
  15. Fulcher, G. (1993). The construction and validation of rating scales for oral tests in English as a foreign l…
  16. Does thick description lead to smart tests? A data-based approach to rating scale construction
    Language Testing  
  17. Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, po…
    Language Testing  
  18. Learning-oriented Language Test Preparation Materials: A contradiction in terms?
    Papers in Language Testing and Assessment
  19. Rating nonnative writing: The trouble with holistic scoring
    TESOL Quarterly  
  20. Assessing Writing
  21. Hamp-Lyons, L. (1991). Scoring Procedures for ESL Contexts. In L. Hamp-Lyons (Eds.), Assessing second languag…
  22. Assessing Writing
  23. Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments f…
    Language Testing  
  24. Assessing Writing
  25. Exploring multiple profiles of highly rated learner compositions
    Journal of Second Language Writing  
  26. Powerful tests, powerless test designers? — Challenges facing the College English test
    CELEA Journal
  27. Jin, Y. (2019). Testing tertiary-level English language learners: The College English Test in China. In Su, L…
  28. Jones, N., Saville, N., & Salamoura, A. (2016). Learning oriented assessment (Vol. 45). Cambridge University Press.
  29. Kassambara, A. (2017). A practical guide to cluster analysis in R: Unsupervised machine learning. Sthda.
  30. Exploring ways to provide diagnostic feedback with an ESL placement test: Cognitive diagn…
    Language Testing  
  31. Diagnosing EAP writing ability using the reduced Reparameterized Unified Model
    Language Testing  
  32. Diagnostic writing assessment: The development and validation of a rating scale
  33. Assessing Writing
  34. Differentiation of illusory and true halo in writing scores
    Educational and Psychological Measurement  
  35. Assessing Writing
  36. Toward automated multi-trait scoring of essays: Investigating links among holistic, analy…
    Applied Linguistics  
  37. Leighton, J., & Gierl, M. (Eds.). (2007). Cognitive diagnostic assessment for education: Theory and applicati…
  38. A comparison of EFL raters’ essay-rating processes across two types of rating scales
    Language Assessment Quarterly  
  39. Are teachers teaching to the test? A case study of the College English Test (CET) in China
    International Journal of Pedagogies and Learning  
  40. Constructing and validating a Q-matrix for cognitive diagnostic analyses of a reading test
    Educational Assessment  
  41. Assessing Writing
  42. Optimizing rating scale category effectiveness
    Journal of Applied Measurement
  43. Linacre, J.M. (2013). Facets Rasch measurement computer program (version 3.80.0). Chicago: Winsteps.com.
  44. The teaching of college English writing based on Chinese and foreign language learning co…
    Foreign Language World
  45. The quality assurance of a national English writing assessment: Policy implications for q…
    Evaluation
  46. Masters, G.N., & Wright, B.D. (1997). The partial credit model. In Handbook of Modern Item Response Theory (p…
  47. McNamara, T., Knoch, U., & Fan, J. (2019). Fairness, justice, and language assessment: The role of measuremen…
  48. Milanovic, M., Saville, N., Pollitt, A., & Cook, A. (1995). Developing rating scales for CASE: Theoretical co…
  49. Developing individualized feedback for listening assessment: Combining standard setting a…
    Language Testing  
  50. Scaling descriptors for language proficiency scales
    Language Testing  
  51. O’Sullivan, B. (2016a). Adapting tests to the local context. New Directions in Language Assessment, special e…
  52. Foreword: Localization
    In Su, Weir & Wu (Eds.), English Language Proficiency Testing in Asia (pp. xiii-xxviii)
  53. O’Sullivan, B. (2016b). Validity: What is it and who is it for? In Y.N. Leung (Ed.), Epoch making in English …
  54. Oon, P.T., & Subramaniam, R. (2011). Rasch modeling of a scale that explores the take-up of physics among sch…
  55. An investigation into rater performance with a holistic scale and a binary, analytic scal…
    Papers in Language Testing and Assessment
  56. Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Danish Institu…
  57. Using the bootstrap method to evaluate the critical range of misfit for polytomous rasch …
    Psychological Reports  
  58. Examining writing: Research and practice in assessing second language writing
  59. Shermis, M.D., Burstein, J., Elliot, N., Miel, S., & Foltz, P.W.. (2017). Automated writing evaluation: An ex…
  60. Staples, S., & Biber, D. (2015). Cluster analysis. In L. Plonsky (Ed.), Advancing quantitative methods in sec…
  61. Critical factors to consider in evaluating standard-setting studies to map language test …
    Language Assessment Quarterly  
  62. Locality, re-localization, structure-to-structure localism and the TOEIC test: Implicatio…
    Measuring up in Education
  63. Assessing Writing
  64. Cambridge
    Assessing writing
  65. A systematic review of methods for evaluating rating quality in language assessment
    Language Testing  
  66. Wiseman, C. (2008). Investigating selected facets in measuring second language writing ability using holistic…
  67. A bootstrap approach to evaluating person and item fit to the Rasch model
    Journal of Applied Measurement
  68. The general english proficiency test in Taiwan: Past, present, and future
    English Language Proficiency Testing in Asia
  69. Diagnosing university students’ academic writing in English: Is cognitive diagnostic mode…
    Educational Psychology  
  70. Development of a Profile-Based Writing Scale: How collaboration with teachers enhanced as…
    Challenges in language testing around the world
  71. A longitudinal study of the CET washback on college English classroom teaching and learni…
  72. The impact of the scoring system of a large-scale standardized EFL writing assessment on …
    Evaluation
  73. On the dynamic development of syntactic variability in second language writing
    Foreign Language Education
  74. The impact of rating scales on the CET-4 writing: A mixed-methods study
    Assessing the English Language Writing of Chinese Learners’ of English
  75. A preliminary examination of the rating scale validity of the CET-4 writing
    Foreign Language and Literature
  76. Pinpointing analytic rating criteria for EFL writing assessment: Rater’s perspectives
    Contemporary Foreign Language Studies