Assessing Writing Apr 2025

Assessing academic language in tenth grade essays using natural language processing

Andrew Potter Arizona State University ; Mitchell Shortt Arizona State University ; Maria Goldshtein Arizona State University ; Rod D. Roscoe Arizona State University
Journal
Assessing Writing
Published
2025-04-01
DOI
10.1016/j.asw.2025.100921
CompPile
Search in CompPile ↗
Open Access
Closed
Export
BibTeX RIS

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (121) · 16 in this index

  1. Allen (2016)
    Computer-based writing instruction
    Handbook of writing research
  2. Andreev (2023)
    The secret life of connectives: A taxonomy to study individual differences in mid-adolesc…
    Reading and Writing
  3. Anstrom (2010)
    A review of the literature on academic English: Implications for K-12 English language learners
  4. Barr (2019)
    Specifying the academic language skills that support text understanding in the middle gra…
    Language Learning  ↗
  5. Beacco (2002)
    Science in media and social discourse: new channels of communication, new linguistic forms
    Discourse Studies  ↗
Show all 121 →
  1. Beers (2009)
    Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre?
    Reading and Writing  ↗
  2. Biancarosa (2004)
    Reading next: A vision for action and research in middle and high school literacy: A repo…
    Alliance for Excellent Education
  3. Biber (2016)
    Grammatical complexity in academic English: Linguistic change in writing
  4. Biber (2020)
    Exploring the longitudinal development of grammatical complexity in the disciplinary writ…
    International Journal of Learner Corpus Research  ↗
  5. Bulté (2012)
    10.1075/lllt.32.02bul
    Defining and operationalising L2 Complexity Dimensions of L2 performance and proficiency: complexity, accuracy and fluency in SLA  ↗
  6. Burstein (1998)
    Computer analysis of essays
  7. Butterfuss (2022)
    Strategy uptake in writing pal: Adaptive feedback and instruction
    Journal of Educational Computing Research  ↗
  8. Chong (2010)
    Using natural language processing for automatic detection of plagiarism
    In: Proceedings of the fourth international plagiarism conference (IPC-2010)
  9. Coxhead (2000)
    A new academic word list
    TESOL Quarterly  ↗
  10. Coxhead (2011)
    The academic word list 10 years on: Research and teaching implications
    Tesol Quarterly  ↗
  11. Crossley (2020)
    Linguistic features in writing quality and development: An overview
    Journal of Writing Research
  12. Crossley et al. (2022)
    The persuasive essays for rating, selecting, and understanding argumentative an…
    Assessing Writing
  13. Crossley, S.A., Baffour, P., Tian, Y., Franklin, A., Benner, M., & Boser, U. (2023). A large-scale corpus for…
     ↗
  14. Crossley (2022)
    Managing second language acquisition data with natural language processing tools
    The Open Handbook of Linguistic Data Management
  15. Crossley (2019)
    The tool for the automatic analysis of cohesion 2.0: Integrating semantic similarity and …
    Behavioral Research Methods  ↗
  16. Crossley (2015)
    To Aggregate or Not? Linguistic Features in Automatic Essay Scoring and Feedback Systems
    Journal of Writing Assessment
  17. Crossley (2016)
    The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of loc…
    Behavior Research Methods  ↗
  18. Crossley (2016)
    The development and use of cohesive devices in L2 writing and their relations to judgment…
    Journal of Second Language Writing  ↗
  19. Crossley (2011)
    Text coherence and judgments of essay quality: Models of quality and coherence
    In: Proceedings of the twenty ninth annual conference of the cognitive science society
  20. Crossley et al. (2016)
    Say more and be more coherent: How text elaboration and cohesion can increase w…
    Journal of Writing Research
  21. Crossley et al. (2014)
    What Is Successful Writing? An Investigation Into the Multiple Ways Writers Can…
    Written Communication
  22. Crossley (2023)
    Source inclusion in synthesis writing: An NLP approach to understanding argumentation, so…
    Reading and Writing  ↗
  23. Cummins (2001)
    An introductory reader to the writings of Jim Cummins
  24. Cummins (2007)
    Academic language: what is it and how do we acquire it?
    International handbook of english language teaching
  25. Deane (2013)
    On the relation between automated essay scoring and modern views of the writing…
    Assessing Writing
  26. Deng et al. (2022)
    Diversity of Advanced Sentence Structures (DASS) in writing predicts argumentat…
    Assessing Writing
  27. DiCerbo (2014)
    A review of the literature on teaching academic English to English language learners
    Review of Educational Research  ↗
  28. Fang (2016)
    Academic language and subject area learning
    Adolescent literacy handbook of practice-based research
  29. Fang (2020)
    Adolescents’ use of academic language in informational writing
    Reading and Writing  ↗
  30. Fang (2006)
    Understanding the language demands of schooling: Nouns in academic registers
    Journal of Literacy Research  ↗
  31. Ferretti (2019)
    Argumentative writing: Theory, assessment, and instruction
    Reading and Writing  ↗
  32. Figueroa (2018)
    Academic language and the quality of written arguments and explanations of Chilean 8th graders
    Reading and Writing  ↗
  33. Fleckenstein (2020)
    Is a long essay always a good essay? The effect of text length on writing assessment
    Frontiers in Psychology  ↗
  34. Flores (2020)
    From academic language to language architecture: Challenging raciolinguistic ideologies i…
    Theory into Practice  ↗
  35. Flores (2015)
    Undoing appropriateness: Raciolinguistic ideologies and language diversity in education
    Harvard Educational Review  ↗
  36. Galloway (2015)
    Modeling the relationship between lexico-grammatical and discourse organization skills in…
    Reading and Writing  ↗
  37. García (2021)
    Academic language and the minoritization of US bilingual Latinx students
    Language and Education  ↗
  38. Gee (2005)
    Language in the science classroom: Academic social languages as the heart of schoolbased …
    Establishing scientific classroom discourse communities: Multiple voices of teaching and learning research
  39. Graham (2023)
    A meta-analysis of writing treatments for students in grades 6 to 12
    Journal of Educational Psychology  ↗
  40. Guo et al. (2013)
    Predicting human judgments of essay quality in both integrated and independent …
    Assessing Writing
  41. Harman (2018)
    Bilingual learners and social equity: Critical approaches to systemic functional linguistics
    Educational linguistics Series  ↗
  42. Haswell (2019)
    Early holistic scoring of writing: A theory, a history, a reflection
  43. Hyland (2009)
    Academic discourse
  44. Hyland (2007)
    Is there an “academic vocabulary”?
    TESOL Quarterly  ↗
  45. Johnson et al. (2017)
    College student perceptions of writing errors, text quality, and author charact…
    Assessing Writing
  46. Khurana (2023)
    Natural language processing: State of the art, current trends and challenges
    Multimedia tools and Applications  ↗
  47. Klebanov (2022)
    Automated scoring of content
    Automated Essay Scoring. Synthesis Lectures on Human Language Technologies
  48. Klein et al. (2016)
    Trends in Research on Writing as a Learning Activity
    Journal of Writing Research
  49. Kyle, K. (2016). Measuring syntactic development in L2 writing: Fine grained indices of syntactic complexity …
  50. Kyle (2015)
    Automatically assessing lexical sophistication: Indices, tools, findings, and application
    TESOL Quarterly  ↗
  51. Kyle (2016)
    The relationship between lexical sophistication and independent and source-based writing
    Journal of Second Language Writing  ↗
  52. Kyle (2018)
    Measuring syntactic complexity in L2 writing using fine‐grained clausal and phrasal indices
    The Modern Language Journal  ↗
  53. Kyle (2018)
    The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0
    Behavior Research Methods  ↗
  54. Kyle (2021)
    Assessing the validity of lexical diversity indices using direct judgements
    Language Assessment Quarterly  ↗
  55. Ladson-Billings (1995)
    Toward a theory of culturally relevant pedagogy
    American Educational Research Journal  ↗
  56. Ladson-Billings (2014)
    Culturally relevant pedagogy 2.0: aka the remix
    Harvard Educational Review  ↗
  57. LaRusso (2016)
    Contributions of academic language, perspective taking, and complex reasoning to deep rea…
    Journal of Research on Educational Effectiveness  ↗
  58. Laufer (1995)
    Vocabulary size and use: Lexical richness in L2 written production
    Applied Linguistics  ↗
  59. Lee (2017)
    Common core state standards for ELA/literacy and next generation science standards: Conve…
    Educational Researcher  ↗
  60. Li (2023)
    Still a fallible tool? Revisiting effects of automated writing evaluation from activity t…
    British Journal of Educational Technology  ↗
  61. Li, T., Creer, S.D., Arner, T., Roscoe, R.D., Allen, L.K., & McNamara, D.S. (2022). Participatory design of a…
  62. Linnarud (1986)
    Lexis in composition: A performance analysis of Swedish
  63. Lu (2010)
    Automatic analysis of syntactic complexity in second language writing
    International Journal of Corpus Linguistics  ↗
  64. MacArthur (2019)
    Which linguistic features predict quality of argumentative writing for college basic writ…
    Reading and Writing  ↗
  65. MacArthur (2023)
    The challenges of writing from sources in college developmental courses: Self-regulated s…
    Journal of Educational Psychology  ↗
  66. MacFarlane (2020)
    Core Academic Language Skills: validating a construct in linguistically dissimilar settings
    The Language Learning Journal  ↗
  67. Mach (2021)
    News media coverage of COVID-19 public health and policy information
    Humanities and Social Sciences Communications  ↗
  68. McCarthy et al. (2022)
    Automated writing evaluation: Does spelling and grammar feedback support high-q…
    Assessing Writing
  69. McHugh (2012)
    Interrater reliability: the kappa statistic
    Biochemia Medica  ↗
  70. Meurers (2017)
    Evidence and interpretation in language learning research: Opportunities for collaboratio…
    Language Learning  ↗
  71. McNamara (2017)
    Natural language processing and learning analytics
    Handbook of learning analytics
  72. McNamara et al. (2010)
    Linguistic Features of Writing Quality
    Written Communication
  73. McNamara (2014)
    Automated evaluation of text and discourse with Coh-Metrix
  74. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013). Distributed representations of words an…
  75. Myers (2022)
    Evaluating the construct validity of an automated writing evaluation system with a random…
    International Journal of Artificial Intelligence in Education
  76. Öncel (2021)
    Automatic student writing evaluation: Investigating the impact of individual differences …
    In: Proceedings of the LAK21: eleventh international learning analytics and knowledge conference  ↗
  77. (2017)
    Culturally sustaining pedagogies: Teaching and learning for justice in a changing world
  78. Perelman (2014)
    When “the state of the art” is counting words
    Assessing Writing
  79. Phillips Galloway (2020)
    Broadening the lens on the science of reading: A multifaceted perspective on the role of …
    Reading Research Quarterly  ↗
  80. Phillips Galloway (2020)
    The role of cross-disciplinary academic language skills in disciplinary, source-based wri…
    Reading and Writing  ↗
  81. Phillips Galloway (2019)
    Examining developmental relations between core academic language skills and reading compr…
    Journal of Educational Psychology  ↗
  82. Pirnay-Dummer (2016)
    Linguistic analysis tools
    Handbook of writing research
  83. Potter, A., Wilson, J., Roscoe, R.D., Arner, T., & McNamara, D.S. (In press). Computer-based writing instruct…
  84. Pretorius (2002)
    Reading ability and academic performance in South Africa: are we fiddling while Rome is b…
    Language Matters  ↗
  85. R Core Team (2023)
    R: A language and environment for statistical computing
  86. Ravid (2002)
    Developing linguistic literacy: A comprehensive model
    Journal of Child Language  ↗
  87. Reyhner (2017)
    Affirming identity: The role of language and culture in American Indian education
    Cogent Education  ↗
  88. Rosa (2017)
    Unsettling race and language: Toward a raciolinguistic perspective
    Language Society  ↗
  89. Roscoe (2019)
    Contrasting writing practice formats in a writing strategy tutoring system
    Journal of Educational Computing Research  ↗
  90. Roscoe (2023)
    Automated strategy feedback can improve the readability of physicians’ electronic communi…
    International Journal of Human-Computer Studies  ↗
  91. Rustamov (2021)
    The place of small genre texts in genre features
    Annals of the Romanian Society for Cell Biology
  92. Sarmiento (2024)
    Academic language use in middle school informational writing
    British Journal of Educational Psychology
  93. Schleppegrell (2001)
    Linguistic features of the language of schooling
    Linguistics and Education  ↗
  94. Schunk (2014)
    Motivation in education: Theory, research, and applications
  95. Shanahan (2008)
    Teaching disciplinary literacy to adolescents: Rethinking content-area literacy
    Harvard Educational Review  ↗
  96. Shermis (2024)
    Introduction to Automated Essay Evaluation
    In: The Routledge international handbook of automated essay evaluation
  97. Silliman (2020)
    Writing across the academic languages: Introduction
    Reading and Writing  ↗
  98. Silliman (2015)
    Two challenges of the academic language register for students with language learning disa…
    Routledge Handbook of Communication Disorders
  99. Simpson-Vlach (2010)
    An academic formulas list: New methods in phraseology research
    Applied Linguistics  ↗
  100. Snow (2009)
    The challenge of academic language
    The Cambridge handbook of literacy
  101. Strobl (2019)
    Digital support for academic writing: A review of technologies and pedagogies
    Computers Education  ↗
  102. Sylwander (2022)
    Fuck Them Walla’: Girls’ Resistance Within Racialized Online Assemblages
    YOUNG  ↗
  103. Taylor (2019)
    Cognitive and linguistic features of adolescent argumentative writing: Do connectives sig…
    Reading and Writing  ↗
  104. Uccelli (2023)
    The Language Demands of Analytical Reading and Writing at School
    Written Communication
  105. Uccelli (2019)
    Children's early decontextualized talk predicts academic language proficiency in midadolescence
    Child Development  ↗
  106. Uccelli et al. (2013)
    Mastering Academic Language: Organization and Stance in the Persuasive Writing …
    Written Communication
  107. Uccelli (2015)
    Beyond vocabulary: Exploring cross-disciplinary academic-language proficiency and its ass…
    Reading Research Quarterly  ↗
  108. Uccelli (2020)
    Amplifying and affirming students’ voices through CALS-informed instruction
    Theory Into Practice  ↗
  109. Ockenburg et al. (2019)
    Learning to write synthesis texts in secondary education: a review of intervent…
    Journal of Writing Research
  110. Wan, Q., Crossley, S., Allen, L., McNamara, D.S. (2020). Claim detection and relationship with writing qualit…
  111. Wan (2021)
    Automated claim identification using NLP features in student argumentative essays
    International Educational Data Mining Society Proceedings of the fourteenth International Conference on Educational Data Mining
  112. Ward (2008)
    Semantic cohesion and learning
    In: Intelligent Tutoring Systems: 9th International Conference, ITS 2008, Montreal, Canada, June 23-27, 2008 Proceedings 9
  113. White (1980)
    A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteros…
    Econometrica  ↗
  114. Wijekumar (2022)
    A teacher-technology tango shows strong results on 5th graders’ persuasive writing
    Educational Technology Research and Development  ↗
  115. Zenker et al. (2021)
    Investigating minimum text lengths for lexical diversity indices
    Assessing Writing
  116. Zhai (2023)
    The effectiveness of automated writing evaluation on writing quality: A meta-analysis
    Journal of Educational Computing Research  ↗
CrossRef global citation count: 4 View in citation network → Build reading path →