Examining the reliability of an international Chinese proficiency standardized writing assessment: Implications for assessment policy makers

Jinyan Huang Jiangsu University ; Danni Zhu Jiangsu University ; Duquan Xie Shanghai University of International Business and Economics ; Tiantian Shu Jiangsu University
Journal
Assessing Writing
Published
2023-01-01
DOI
10.1016/j.asw.2023.100693
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

References (60) · 3 in this index

  1. Standards for educational and psychological testing
  2. Variability in ESL essay rating processes: The role of the rating scale and rater experience
    Language Assessment Quarterly  
  3. Think-aloud protocols in research on essay rating: An empirical study of their veridicali…
    Language Testing  
  4. Statistics for social science and public policy: Generalizability theory
  5. Research design: Qualitative, quantitative, and mixed methods approaches
Show all 60 →
  1. GENOVA: A general purpose analysis of variance system. Version 2.1.
  2. The dependability of behavioral measurements: Theory of generalizability for scores and profiles
  3. CTI. (2022). Chinese proficiency test (HSK). Available at 〈https://www.chinesetest.cn〉.
  4. Decision-making while rating ESL/EFL writing tasks: A descriptive framework
  5. Examining the impact of rater educational background on ESL writing assessment: A general…
    Language and Communication Quarterly
  6. ETS. (2018). The TOEFL test. Available at 〈https://www.ets.org/toefl〉.
  7. To code or not to code: Dilemmas in analyzing think-aloud protocols in learning strategie…
    System  
  8. Guo, P. (2018). HSK writing analysis and teaching research based on abbreviated corpus. Unpublished Master’s …
  9. Guo, X. (2020, March). Study on the application of TAPs in the translating Class. In 4th International Confer…
  10. Scores assigned by inexpert EFL raters to different quality EFL compositions, and the rat…
    International Journal of Progressive Education
  11. Examining the impact of scoring methods on the institutional EFL writing assessment: A Tu…
    PASAA  
  12. Chinese language proficiency scales for speakers of other languages
  13. The New HSK test syllabus
  14. Retrospective and introspective think-aloud protocols in translation quality assessment: …
    Journal of Language and Translation
  15. Assessing Writing
  16. Generalizability theory as evidence of concerns about fairness in large-scale ESL writing…
    TESOL Journal  
  17. Assessing Writing
  18. Grading between the lines: What really impacts professors’ holistic evaluation of ESL gra…
    Language Assessment Quarterly  
  19. Educational researchers’ ethical responsibilities and human subjects’ ethical awareness: …
    Ethics & Behavior  
  20. IELTS. (2018). About the test. Available at 〈https://www.ielts.org/about-the-test/〉.
  21. Error analysis of vocabulary in Russian students’ HSK 5 writing
    Modern Chinese
  22. Fairness and validation in language assessment
  23. Evaluating prototype tasks and alternative rating schemes for a new ESL writing test thro…
    International Journal of Testing  
  24. Lee, Y., Kantor, R., & Mollaun, P. (2002, April). Score dependability of the writing and speaking sections of…
  25. A questionnaire-based analysis of satisfaction with HSK-6
    Modern Chinese  
  26. A comparison of EFL raters’ essay-rating processes across two types of rating scales
    Language Assessment Quarterly  
  27. Assessing Writing
  28. Li, X. (2018). A new HSK (Level 1–6) written test based on language test research. Unpublished Master’s thesi…
  29. Lin, J. (2016). A study on Chinese learning strategies for Thai students. Unpublished doctoral dissertation ,…
  30. The quality assurance of a national English writing assessment: Policy implications for q…
    Studies in Educational Evaluation  
  31. Ministry of Education [MoE]. (2021). Shoulder the responsibility of rejuvenating the country with iron should…
  32. Ministry of Education [MoE], & National Language and Literacy Working Committee [NLLWC]. (2021). The internat…
  33. The differences between Chinese and English vocabulary
    Overseas English
  34. Hanyu Shuiping Kaoshi (HSK): A multi-level, multi-purpose proficiency test
    Language Testing  
  35. Think aloud: Using cognitive interviewing to validate the PISA assessment of student self…
    International Journal of Research & Method in Education  
  36. Validation of holistic rating for ESL writing assessment: How raters evaluate ESL compositions
    Fairness and validation in language assessment
  37. Generalizability theory: A primer
  38. Hanyu Shuiping Kaoshi (HSK): Past, present, and future
    Chinese as a second language assessment
  39. Mandarin learning strategy in higher education to achieve the new Hanyu Shuiping Kaoshi s…
    Journal of Education Research and Evaluation
  40. Reliability of the analytic rubric and checklist for the assessment of story writing skil…
    European Journal of Educational Research  
  41. Retrospective vs. concurrent think-aloud protocols: testing the usability of an online li…
    Behavior & Information Technology  
  42. Consequential validity of the Chinese proficiency test (HSK) from macro and micro perspectives
  43. A prompt-independent and interpretable automated essay scoringmethod for Chinese second l…
    In Proceedings of the 20th ChineseNational Conference on Computational Linguistics
  44. Whipple, P. (2016). Rater variability and reliability of constructed-response questions in high-stakes tests …
  45. A study on Chinese writing strategies of foreign preparatory students in China
    Chinese Language Teaching and Research
  46. Peer feedback in the EFL writing Classrooms: A multiple perspective investigation into it…
    International Journal of TESOL and Learning
  47. Machine learning-based automated essay scoring system for Chinese proficiency test (HSK)
    In Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval
  48. Can cultural affinity promote trade? HSK test data from the belt and road countries
    China & World Economy  
  49. Increase in income and international promotion of language: Evidence from China
    International Review of Economics & Finance  
  50. The effects of task types and raters on Chinese writing scoring
    Collection of Chinese Language and Literature  
  51. How to process the score of New HSK-6?
    Examinations Research
  52. The impact of the scoring system of a large-scale standardized EFL writing assessment on …
    Studies in Educational Evaluation  
  53. Zhao, G. (2020). A study of the “sentence-completion” in new HSK Level-5 and the relevantstrategy in TCSOL. U…
  54. The scorer reliability of the writing section of the HSK: A case study of experienced and…
    China Examinations
  55. Improving dependability of the New HSK writing test score: A generalizability theory base…
    Journal of Psychological Science