Assessing Writing Jul 2013

Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study

Liang Guo ; Scott A. Crossley ; Danielle S. McNamara
Journal
Assessing Writing
Published
2013-07-01
DOI
10.1016/j.asw.2013.05.002
CompPile
Search in CompPile ↗
Topics
multilingual writers

Citation Context

Cited by in this index (36)

  1. Yang et al. (2025)
    Linguistic predictors of L2 writing performance: Variations across genres
    Assessing Writing
  2. Potter et al. (2025)
    Assessing academic language in tenth grade essays using natural language processing
    Assessing Writing
  3. Wang et al. (2025)
    A meta-analysis of relationships between syntactic features and writing perform…
    Assessing Writing
  4. Pun et al. (2024)
    A structural equation investigation of linguistic features as indices of writin…
    Assessing Writing
  5. Naismith et al. (2024)
    The impact of task duration on the scoring of independent writing responses of …
    Assessing Writing
Show all 36 →
  1. Cai et al. (2024)
    Examining the direct and indirect impacts of verbatim source use on linguistic …
    Assessing Writing
  2. Yasuda (2024)
    Does “more complexity” equal “better writing”? Investigating the relationship b…
    Assessing Writing
  3. Crossley et al. (2024)
    A large-scale corpus for assessing written argumentation: PERSUADE 2.0
    Assessing Writing
  4. Emmanouil et al. (2024)
    Linguistic factors affecting L1 language evaluation in argumentative essays of …
    Assessing Writing
  5. Khushik (2024)
    Is the variation in syntactic complexity features observed in argumentative ess…
    Assessing Writing
  6. Arias-Hermoso et al. (2024)
    A comparison between input modalities and languages in source-based multilingua…
    Assessing Writing
  7. Appel et al. (2023)
    Insights from lexical and syntactic analyses of a French for academic purposes …
    Assessing Writing
  8. Tabari et al. (2023)
    Automated analysis of cohesive features in L2 writing: Examining effects of tas…
    Assessing Writing
  9. Tabari et al. (2023)
    Exploring new insights into the role of cohesive devices in written academic genres
    Assessing Writing
  10. Qian (2023)
    Use of lexical features in high-stakes tests: Evidence from the perspectives of…
    Assessing Writing
  11. Pan et al. (2023)
    The design and cognitive validity verification of reading-to-write tasks in L2 …
    Assessing Writing
  12. Li et al. (2023)
    The predictive powers of fine-grained syntactic complexity indices for letter w…
    Assessing Writing
  13. Zhang et al. (2023)
    Linguistic complexity as the predictor of EFL independent and integrated writin…
    Assessing Writing
  14. Li et al. (2023)
    Assessing the writing quality of English research articles based on absolute an…
    Assessing Writing
  15. Chan et al. (2022)
    Integrated writing and its correlates: A meta-analysis
    Assessing Writing
  16. Golparvar et al. (2022)
    Unpacking the contribution of linguistic features to graph writing quality: An …
    Assessing Writing
  17. Lee (2022)
    Examining the social consequences of a locally-developed placement test using t…
    Assessing Writing
  18. Uludag et al. (2022)
    Validating a rubric for assessing integrated writing in an EAP context
    Assessing Writing
  19. Steiss et al. (2022)
    Dimensions of text-based analytical writing of secondary students
    Assessing Writing
  20. Maamuujav (2021)
    Examining lexical features and academic vocabulary use in adolescent L2 student…
    Assessing Writing
  21. Kyle (2020)
    The relationship between features of source text use and integrated writing quality
    Assessing Writing
  22. Hodges et al. (2019)
    Developing and examining validity evidence for the Writing Rubric to Inform Tea…
    Assessing Writing
  23. Vögelin et al. (2019)
    The influence of lexical features on teacher judgements of ESL argumentative essays
    Assessing Writing
  24. Crossley et al. (2018)
    Assessing writing with the tool for the automatic analysis of lexical sophistic…
    Assessing Writing
  25. Kim et al. (2018)
    Modeling second language writing quality: A structural equation investigation o…
    Assessing Writing
  26. Kim et al. (2018)
    Examining the comparability between paper- and computer-based versions of an in…
    Assessing Writing
  27. Llosa et al. (2017)
    Student and instructor perceptions of writing tasks and performance on TOEFL iB…
    Assessing Writing
  28. Wind et al. (2017)
    Exploring the relationship between textual characteristics and rating quality i…
    Assessing Writing
  29. Plakans et al. (2017)
    Exploring the relationship of organization and connection with scores in integr…
    Assessing Writing
  30. Riazi (2016)
    Comparing writing performance in TOEFL-iBT and academic assignments: An explora…
    Assessing Writing
  31. McNamara et al. (2015)
    A hierarchical classification approach to automated essay scoring
    Assessing Writing

Cites in this index (10)

  1. Deane (2013)
    On the relation between automated essay scoring and modern views of the writing…
    Assessing Writing
  2. Weigle (2013)
    English language learners and automated scoring of essays: Critical considerations
    Assessing Writing
  3. Plakans et al. (2012)
    A close investigation into source use in integrated second language writing tasks
    Assessing Writing
  4. Plakans (2008)
    Comparing composing processes in writing-only and reading-to-write test tasks
    Assessing Writing
  5. Cumming et al. (2005)
    Differences in written discourse in independent and integrated prototype tasks …
    Assessing Writing
Show all 10 →
  1. Weigle (2004)
    Integrating reading and writing in a competency test for non-native speakers of…
    Assessing Writing
  2. CHENOWETH et al. (2001)
    Fluency in Writing
    Written Communication
  3. Weigle (1999)
    Investigating rater/prompt interactions in writing assessment: Quantitative and…
    Assessing Writing
  4. DeRemer (1998)
    Writing assessment: Raters' elaboration of the rating task
    Assessing Writing
  5. BROWN et al. (1991)
    Essay Prompts and Topics
    Written Communication
Also cites 34 works outside this index ↓
  1. Biber (2010)
    Challenging stereotypes about academic writing: Complexity, elaboration, explicitness
    Journal of English for Academic Purposes  ↗
  2. Brown (1991)
    Do English and ESL faculties rate writing samples differently?
    TESOL Quarterly  ↗
  3. Connor-Linton (1995)
    Crosscultural comparison of writing standards: American ESL and Japanese EFL
    World Englishes  ↗
  4. Crossley (2009)
    Computationally assessing lexical differences in second language writing
    Journal of Second Language Writing  ↗
  5. Crossley (2009)
    Measuring second language lexical growth using hypernymic relationships
    Language Learning  ↗
  6. Crossley (2010)
    The development of polysemy and frequency use in English second language speakers
    Language Learning  ↗
  7. Crossley (2011)
    Understanding expert ratings of essay quality: Coh-Metrix analyses of first and second la…
    International Journal of Continuing Engineering Education and Life-Long Learning  ↗
  8. Crossley (2011)
    Predicting lexical proficiency in language learners using computational indices
    Language Testing  ↗
  9. Crossley (2012)
    Predicting second language writing proficiency: The role of cohesion, readability, and le…
    Journal of Research in Reading  ↗
  10. Crossley (2012)
    Predicting the proficiency level of language learners using lexical indices?
    Language Testing  ↗
  11. Crossley (2013)
    Advancing research in second language writing through computational tools and machine lea…
    Language Teaching  ↗
  12. Cumming (2002)
    Decision making while scoring ESL/EFL compositions: A descriptive model
    Modern Language Journal  ↗
  13. Delaney (2008)
    Investigating the reading-to-write construct
    Journal of English for Academic Purposes  ↗
  14. Engber (1995)
    The relationship of lexical proficiency to the quality of ESL compositions
    Journal of Second Language Writing  ↗
  15. Esmaeili (2002)
    Integrated reading and writing tasks and ESL students’ reading and writing performance in…
    The Canadian Modern Language Review  ↗
  16. Ferris (1993)
    The design of an automatic analysis program for L2 text research: Necessity and feasibility
    Journal of Second Language Writing  ↗
  17. Ferris (1994)
    Lexical and syntactic features of ESL writing by students at different levels of L2 proficiency
    TESOL Quarterly  ↗
  18. Gebril (2009)
    Score generalizability of academic writing tasks: Does one test method fit it all?
    Journal of Language Testing  ↗
  19. Graesser (2004)
    Coh-Metrix: Analysis of text on cohesion and language
    Behavioral Research Methods, Instruments, and Computers  ↗
  20. Grant (2000)
    Using computer-tagged linguistic features to describe L2 writing differences
    Journal of Second Language Writing  ↗
  21. Jarvis (2002)
    Short texts, best-fitting curves and new measures of lexical diversity
    Language Testing  ↗
  22. Jarvis (2003)
    Exploring multiple profiles of highly rated learner compositions
    Journal of Second Language Writing  ↗
  23. Kobayashi (1996)
    Factors affecting composition evaluation in an EFL context: Cultural rhetorical patterns …
    Language Learning  ↗
  24. Leki (1997)
    Completely different worlds: EAP and the writing experiences of ESL students in universit…
    TESOL Quarterly  ↗
  25. McCarthy (2010)
    MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversi…
    Behavior Research Methods  ↗
  26. McNamara (1996)
    Are good texts always better? Interactions of text coherence, background knowledge, and l…
    Cognition and Instruction  ↗
  27. Norris (2009)
    Towards an organic approach to investigating CAF in instructed SLA: The case of complexity
    Applied Linguistics  ↗
  28. Ortega (2003)
    Syntactic complexity measures and their relationship to L2 proficiency: A research synthe…
    Applied Linguistics  ↗
  29. Shohamy (1992)
    The effect of raters’ background and training on the reliability of direct writing tests
    Modern Language Journal  ↗
  30. Song (1996)
    Do English and ESL faculty differ in evaluating the essays of native English-speaking and…
    Journal of Second Language Writing  ↗
  31. Way (2000)
    Writing in the secondary foreign language classroom: The effects of prompts and tasks on …
    Modern Language Journal  ↗
  32. Weigle (1994)
    Effects of training on raters of ESL compositions
    Language Testing  ↗
  33. Wilson (1988)
    MRC psycholinguistic database: Machine-usable dictionary, version 2.00
    Behavior Research Methods, Instrumentation and Computers  ↗
  34. Yu (2009)
    Lexical diversity in writing and speaking task performances
    Applied Linguistics  ↗
CrossRef global citation count: 181 View in citation network →

Related Articles

  1. Computers and Composition Jun 2026
    “Article laundry” or “tutor in pocket?”: Multilingual writers’ generative AI-assisted writing in professional settings ↗
    Qianqian Zhang-Wu
    artificial intelligence multilingual writers
  2. Journal of Technical Writing and Communication Apr 2026
    What Video Games Can Tell Us About Interactive Technical Communication ↗
    Emily Kuzneski Johnson
    multimodality technical communication multilingual writers
  3. Journal of Technical Writing and Communication Apr 2026
    “Is This Ethical?” New Data on the Ethical Principles and Practices of Document Design ↗
    Leslie Seawright; Amy Hodges; Timothy Ponce
    multimodality technical communication disability studies multilingual writers
  4. Journal of Technical Writing and Communication Apr 2026
    How to Write With GenAI: A Framework for Using Generative AI to Automate Writing Tasks in Technical Communication ↗
    Guiseppe Getto; Susan Kelley; Bremen Vance
    artificial intelligence technical communication multilingual writers
  5. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    multilingual writers