Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study

Liang Guo Shanghai University of Finance and Economics ; Scott A. Crossley Georgia State University ; Danielle S. McNamara Arizona State University
Journal
Assessing Writing
Published
2013-07-01
DOI
10.1016/j.asw.2013.05.002
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (39)

  1. Assessing Writing
  2. Assessing Writing
  3. Assessing Writing
  4. Assessing Writing
  5. Assessing Writing
Show all 39 →
  1. Assessing Writing
  2. Assessing Writing
  3. Assessing Writing
  4. Assessing Writing
  5. Assessing Writing
  6. Assessing Writing
  7. Assessing Writing
  8. Assessing Writing
  9. Assessing Writing
  10. Assessing Writing
  11. Assessing Writing
  12. Assessing Writing
  13. Assessing Writing
  14. Assessing Writing
  15. Assessing Writing
  16. Assessing Writing
  17. Assessing Writing
  18. Assessing Writing
  19. Assessing Writing
  20. Assessing Writing
  21. Assessing Writing
  22. Assessing Writing
  23. Assessing Writing
  24. Assessing Writing
  25. Assessing Writing
  26. Assessing Writing
  27. Assessing Writing
  28. Assessing Writing
  29. Assessing Writing
  30. Assessing Writing
  31. Assessing Writing
  32. Assessing Writing
  33. Assessing Writing
  34. Assessing Writing

References (105) · 10 in this index

  1. Construct validity of e-rater® in scoring TOEFL essays (ETS Research Report No. RR-07-21)
  2. Automated essay scoring with e-rater® v.2.0 (ETS Research Report No. 04-45)
  3. Automated essay scoring with e-rater® V. 2
    The Journal of Technology, Learning and Assessment
  4. A developmental writing scale (ETS Research Report No. RR-08-19)
  5. e-rater® performance for TOEFL iBT Independent essays
Show all 105 →
  1. The CELEX lexical database (CD-ROM)
  2. Variation across speech and writing
  3. University language: A corpus-based study of spoken and written registers
  4. Challenging stereotypes about academic writing: Complexity, elaboration, explicitness
    Journal of English for Academic Purposes  
  5. Do English and ESL faculties rate writing samples differently?
    TESOL Quarterly  
  6. Written Communication
  7. Automated Essay Scoring for nonnative English speakers
    Proceedings of the ACL99 workshop on computer-mediated language assessment and evaluation of natural language processing
  8. Changing the model for the direct writing assessment
    Validating holistic scoring for writing assessment: Theoretical and empirical foundations
  9. A task analysis of reading and writing in academic contexts
    Linking literacies: Perspectives on L2 reading–writing connections
  10. Test score interpretation and use
    Building a validity argument for the test of English as a foreign language
  11. Written Communication
  12. Beyond essay length: Evaluating e-rater®’s performance on TOEFL essays (TOEFL Research Report No. 73)
  13. Statistical power analysis for the behavioral sciences
  14. Linguistic/rhetorical measures of international persuasive student writing
    Research in the Teaching of English
  15. Crosscultural comparison of writing standards: American ESL and Japanese EFL
    World Englishes  
  16. Computationally assessing lexical differences in second language writing
    Journal of Second Language Writing  
  17. Measuring second language lexical growth using hypernymic relationships
    Language Learning  
  18. Cohesion, coherence, and expert evaluations of writing proficiency
    Proceedings of the 32nd annual conference of the cognitive science society
  19. The development of polysemy and frequency use in English second language speakers
    Language Learning  
  20. The development of semantic relations in second language speakers: A case for Latent Sema…
    Vigo International Journal of Applied Linguistics
  21. Understanding expert ratings of essay quality: Coh-Metrix analyses of first and second la…
    International Journal of Continuing Engineering Education and Life-Long Learning  
  22. Predicting lexical proficiency in language learners using computational indices
    Language Testing  
  23. Predicting second language writing proficiency: The role of cohesion, readability, and le…
    Journal of Research in Reading  
  24. Predicting the proficiency level of language learners using lexical indices?
    Language Testing  
  25. Advancing research in second language writing through computational tools and machine lea…
    Language Teaching  
  26. Decision making while scoring ESL/EFL compositions: A descriptive model
    Modern Language Journal  
  27. TOEFL 2000 writing framework: A working paper (TOEFL Monograph Series, Report No. 18)
  28. Assessing Writing
  29. Analysis of discourse features and verification of scoring levels for independent and integrated tasks for the new TOEFL (TOEFL Monograph No. MS-30)
  30. Assessing Writing
  31. Investigating the reading-to-write construct
    Journal of English for Academic Purposes  
  32. The relationship of lexical proficiency to the quality of ESL compositions
    Journal of Second Language Writing  
  33. Integrated reading and writing tasks and ESL students’ reading and writing performance in…
    The Canadian Modern Language Review  
  34. Building on the impromptu: A source-based academic writing assessment
    College ESL
  35. WordNet: An electronic lexical database
  36. The design of an automatic analysis program for L2 text research: Necessity and feasibility
    Journal of Second Language Writing  
  37. Lexical and syntactic features of ESL writing by students at different levels of L2 proficiency
    TESOL Quarterly  
  38. Computer analysis of the TOEFL test of written english (TOEFL Research Report No. 64)
  39. Score generalizability of academic writing tasks: Does one test method fit it all?
    Journal of Language Testing  
  40. Investigating source use, discourse features, and process in integrated writing tests
    Spaan Fellow Working Papers in Second or Foreign Language Assessment
  41. A bird's-eye view of learner corpus research
    Computer learner corpora, second language acquisition and foreign language teaching
  42. What do readers need to learn in order to process coherence relations in narrative and ex…
    Rethinking reading comprehension
  43. Coh-Metrix: Analysis of text on cohesion and language
    Behavioral Research Methods, Instruments, and Computers  
  44. Using computer-tagged linguistic features to describe L2 writing differences
    Journal of Second Language Writing  
  45. Cohesion in English
  46. Writing science: Literacy and discursive power
  47. Introduction
    Assessing second language writing in academic context
  48. Issues in ESL writing assessment: An overview
    College ESL
  49. Who should be the judge? The use of non-native speakers as raters on a test of English as…
    Current developments and alternatives in language assessment: Proceedings of LRTC 96
  50. Second language writers’ text: Linguistic and rhetorical features
  51. ESL writing assessments: Contradictions and resolutions
    Assessing second language writing in academic context
  52. Prototyping a new test
    Building a validity argument for the test of English as a foreign language
  53. The influence of holistic scoring procedures on reading and rating student essays
    Validating holistic scoring for writing assessment: Theoretical and empirical foundations
  54. Short texts, best-fitting curves and new measures of lexical diversity
    Language Testing  
  55. Exploring multiple profiles of highly rated learner compositions
    Journal of Second Language Writing  
  56. The test-taker's choice: An investigation of the effect of topic on language test performance
    Language Testing
  57. A quantitative study of cohesion in Chinese graduate students’ writing: Variations across genres and proficiency levels (ERIC Document Reproduction Service No. ED 452 726)
  58. Summary street: Computer-guided summary writing
    Handbook of latent semantic analysis
  59. Factors affecting composition evaluation in an EFL context: Cultural rhetorical patterns …
    Language Learning  
  60. The intelligent essay assessor
    IEEE Intelligent Systems
  61. Completely different worlds: EAP and the writing experiences of ESL students in universit…
    TESOL Quarterly  
  62. Writing from sources: Does source material help or hinder students’ performance?
    Paper presented at the Annual International Language in Education conference, Hong Kong (RIC Document Reproduction Service No. ED386050)
  63. Investigating authenticity in language testing
  64. Assessing second language writing: The raters’ perspective
  65. A new measure of lexical diversity
    Evolving models of language
  66. MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversi…
    Behavior Research Methods  
  67. Are good texts always better? Interactions of text coherence, background knowledge, and l…
    Cognition and Instruction  
  68. Coh-Metrix: An automated tool for theoretical and applied natural language processing
    Applied natural language processing and content analysis: Identification, investigation, and resolution
  69. Word lists
  70. Towards an organic approach to investigating CAF in instructed SLA: The case of complexity
    Applied Linguistics  
  71. Syntactic complexity measures and their relationship to L2 proficiency: A research synthe…
    Applied Linguistics  
  72. Second language writing and reading-to-write assessment tasks: A process study
  73. Assessing Writing
  74. Assessing Writing
  75. Evaluating the construct-coverage of the e-rater® scoring engine (ETS Research Report No. 09-01)
  76. Evaluation of the e-rater® scoring engine for the TOEFL independent and integrated prompts (ETS Research Report No. 12-06)
  77. Writing, reading, and speaking memory spans and the importance of resource flexibility
    The cognitive demands of writing: Processing capacity and working memory in text production
  78. Assessing Writing
  79. Using the Writer's Workbench in composition teaching and testing
    Technology and language testing
  80. Responding to different topic types: A quantitative analysis from a contrastive rhetoric …
    Second Language Writing: Research insights for the classroom
  81. Variation in elementary student language: A multi-dimensional perspective
  82. Native- and nonnative-speaking EFL teachers’ evaluation of Chinese students’ English writing
    Language Testing
  83. The effect of raters’ background and training on the reliability of direct writing tests
    Modern Language Journal  
  84. A correlational study of the holistic measure with the index measure of accuracy and complexity in international English-as-a-second-language (ESL) student writings
  85. Do English and ESL faculty differ in evaluating the essays of native English-speaking and…
    Journal of Second Language Writing  
  86. Strategic planning, task structure, and performance testing
    Planning and task performance in a second language
  87. Handbook of semantic word norms
  88. Holistic assessment: What goes on in the rater's mind?
    Assessing second language writing in academic contexts
  89. Read-to-write tasks for the assessment of second language academic writing skills: Investigating text features and rater reactions
  90. Writing in the secondary foreign language classroom: The effects of prompts and tasks on …
    Modern Language Journal  
  91. Effects of training on raters of ESL compositions
    Language Testing  
  92. Assessing Writing
  93. Assessing writing
  94. Assessing Writing
  95. Assessing Writing
  96. Teaching and assessing writing
  97. MRC psycholinguistic database: Machine-usable dictionary, version 2.00
    Behavior Research Methods, Instrumentation and Computers  
  98. Data mining
  99. Exploring the complexity of second language writers’ strategy use and performance on an integrated writing test through structural equation modeling and qualitative approaches
  100. Lexical diversity in writing and speaking task performances
    Applied Linguistics