Comparing GPT-based approaches in automated writing evaluation

Yingying Liu Ocean University of China ; Xiaofei Lu Pennsylvania State University ; Huilei Qi Fudan University
Journal
Assessing Writing
Published
2025-10-01
DOI
10.1016/j.asw.2025.100961
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (1)

  1. Assessing Writing

References (42) · 2 in this index

  1. A. Vaswani N. Shazeer N. Parmar J. Uszkoreit L. Jones A.N. Gomez I. Polosukhin. Attention is all you need Adv…
  2. Assessing the impact of changing environments on classifier performance
    In Canadian AI’08: Proceedings of the Canadian society for computational studies of intelligence, 21st conference on advances in artificial intelligence
  3. Automatic text scoring using neural networks
    Proceedings of the 54th annual meeting of the association for computational linguistics
  4. NCTE position statement on machine scoring: Machine scoring fails the test
    National Council of Teachers of English
  5. Automated essay scoring with e-rater V.2
    Journal of Technology, Learning, and Assessment
Show all 42 →
  1. Assessing Writing
  2. TOEFL11: A corpus of non-native English. (ETS Research Report No. RR-13-24)
  3. Explainable AI and AWE: Balancing tensions between transparency and predictive accuracy
    The routledge international handbook of automated essay evaluation
  4. Language models are few-shot learners
    Advances in Neural Information Processing Systems
  5. A systematic study of the class imbalance problem in convolutional neural networks
    Neural Networks  
  6. Emerging trends: A gentle introduction to fine-tuning
    Natural Language Engineering  
  7. Augmenting textual qualitative features in deep convolution recurrent neural network for …
    Proceedings of the 5th workshop on natural language processing techniques for educational applications
  8. BERT: Pre-training of deep bidirectional transformers for language understanding
  9. Attention-based recurrent convolutional neural network for automatic essay scoring
    Proceedings of the 21st conference on computational natural language learning
  10. Prompt-based and fine-tuned GPT models for context-dependent and -independent deductive c…
    Proceedings of the 14th learning analytics and knowledge conference
  11. The class imbalance problem: A systematic study
    Intelligent Data Analysis  
  12. Exploring the potential of using ChatGPT for rhetorical move-step analysis: The impact of…
    Journal of English for Academic Purposes  
  13. Towards optimal NLP solutions: Analyzing GPT and LLaMA-2 models across model scale, datas…
    Engineering, Technology Applied Science Research  
  14. How different is different? Systematically identifying distribution shifts and their impa…
    Language Resources and Evaluation
  15. Enhancing GPT-based automated essay scoring: The impact of fine-tuning and linguistic com…
    Computer Assisted Language Learning  
  16. An insight into classification with imbalanced data: Empirical results and current trends…
    Information Sciences  
  17. Directions for future automated analyses of L2 written texts
    The Routledge handbook of second language acquisition and writing
  18. Automated assessment of language
    The Cambridge introduction to applied linguistics
  19. Exploring the potential of using an AI language model for automated essay scoring
    Research Methods in Applied Linguistics  
  20. Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment
    Research Methods in Applied Linguistics  
  21. The imminence of grading essays by computer
    Phi Delta Kappan
  22. The use of the computer in analyzing student essays
    International Review of Education  
  23. Dataset shift in machine learning
  24. Appraising the scoring performance of automated essay scoring systems - Some additional c…
    Applied Measurement in Education  
  25. An automated essay scoring systems: A systematic literature review
    Artificial Intelligence Review  
  26. Evaluation of the e-rater scoring engine for the TOEFL independent and integrated prompts. (ETS Research Report No. RR-12-06)
  27. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics…
    Internet of Things and Cyber-Physical Systems  
  28. Rodriguez, P.U., Jafari, A., & Ormerod, C.M. (2019). Language models and automated essay scoring. arXiv Prepr…
  29. An evaluation of IntelliMetric essay scoring system
    Journal of Technology, Learning, and Assessment
  30. Automated essay scoring: A cross-disciplinary perspective
  31. Assessing Writing
  32. A neural approach to automated essay scoring
    Proceedings of the 2016 conference on empirical methods in natural language processing
  33. Effectiveness of large language models in automated evaluation of argumentative essays: F…
    Computer Assisted Language Learning  
  34. Automated feedback and automated scoring in the elementary grades: Usage, attitudes, and …
    International Journal of Artificial Intelligence in Education  
  35. The influence of rater effects in training sets on the psychometric quality of automated …
    International Journal of Testing  
  36. A brief overview of ChatGPT: The history, status quo and potential future development
    IEEE/CAA Journal of Automatica Sinica  
  37. Rating short L2 essays on the CEFR scale with GPT-4
    Proceedings of the 18th workshop on innovative use of NLP for building educational applications