Exploring the Relationship Between Plan Features and Argument Essay Performance

Yi Song Princeton University ; Paul Deane Princeton University ; Chen Li

Abstract

We conducted a post hoc analysis of 771 students’ argumentative writing plans and essays in the Criterion ® database, a digital writing tool, to explore the relations among plan features, essay quality, and writing traits. Students in the study were in Grades 5 to 10 from 68 schools. We found that older students produced writing plans that received higher scores and demonstrated greater genre-specific knowledge than younger students, but regardless of their grade, most students did not consider alternative perspectives or rebut counterarguments in their writing plans. We also found that students’ choice of plan templates was associated with the scores of their plans. Further, factor analysis showed that six of the seven plan feature scores hung together in a single factor (Factor 1) and correlated with multiple trait scores (Factor 2), accounting for most of the shared variance connecting plan scores with writing traits. The “both sides” plan feature loaded on a different factor by its own, suggesting that considering different perspectives is a challenging skill that students may need extra support to develop.

Journal
Written Communication
Published
2026-02-26
DOI
10.1177/07410883251410152
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (84) · 9 in this index

  1. Automated essay scoring with e-rater® V.2
    The Journal of Technology, Learning and Assessment
  2. Attali Y. Powers D. (2008). A developmental writing scale. ETS Research Report Series 2008(1) i–59. https://d…
  3. Attali Y. Sinharay S. (2015). Automated trait scores for TOEFL® writing tasks. ETS Research Report Series 201…
  4. 10.1111/j.2517-6161.1954.tb00174.x
  5. Beauvais C. Olive T. Passerault J.-M. (2011). Why are some texts good and others not? Relationship between te…
Show all 84 →
  1. The psychology of written composition
  2. Boykin A. Evmenova A. S. Regan K. Mastropieri M. (2019). The impact of a computer-based graphic organizer wit…
  3. Brindle M. Harris K. R. Graham S. Hebert M. (2016). Third and fourth grade teachers’ classroom practices in w…
  4. Automated essay evaluation: The Criterion online writing service
    Ai Magazine
  5. Journal of Writing Analytics
  6. 10.18653/v1/W17-5011
  7. Companion proceedings 9th International Conference on Learning Analytics & Knowledge (LAK19)
  8. Handbook of automated essay evaluation: Current applications and new directions
  9. Assessing Writing
  10. Cho M. Kim Y. G. Olson C. B. (2021). Does perspective taking matter for writing? Perspective taking in source…
  11. Ciullo S. P. Reutebuch C. (2013). Computer-based graphic organizers for students with LD: A systematic review…
  12. Assessing Writing
  13. The key practice, ‘discuss and debate ideas’: Conceptual framework, literature review, an…
  14. Deane P. Song Y. van Rijn P. O’Reilly T. Fowles M. Bennett R. Sabatini J. Zhang M. (2019). The case for scena…
  15. 10.1002/ets2.12377
  16. De La Paz S. Graham S. (1997a). Strategy instruction in planning: Effects on the writing performance and beha…
  17. De La Paz S. Graham S. (1997b). Effects of dictation and advanced planning instruction on the composing of st…
  18. Dockrell J. Marshall C. Wyse D. (2016). Teachers’ reported practices for teaching writing in England. Reading…
  19. Evmenova A. S. Regan K. Boykin A. Good K. Hughes M. D. MacVittie N. Sacco D. Ahn S. Y. Chirinos D. (2016). Em…
  20. Handbook of writing research
  21. Ferretti R. P. Graham S. (2019). Argumentative writing: Theory assessment and instruction. Reading and Writin…
  22. Ferretti R. P. Lewis W. E. (2019). Knowledge of persuasion and writing goals predict the quality of children’…
  23. Ferretti R. P. MacArthur C. A. Dowdy N. S. (2000). The effects of an elaborated goal on the persuasive writin…
  24. Foltz P. Rosenstein M. (2019). Data-mining large-scale formative writing. In Lang C. Siemens G. Wise A. Gasev…
  25. Gilbert J. Graham S. (2010). Teaching writing to elementary students in Grades 4–6: A national survey. Elemen…
  26. Graesser A. C. McNamara D. S. Kulikowich J. M. (2011). Coh-metrix: Providing multilevel analyses of text char…
  27. Handbook of educational psychology
  28. Graham S. (2019). Changing how writing is taught. Review of Research in Education 43(1) 277–303. https://doi.…
  29. Graham S. Cao Y. Kim Y.-S. Lee J. Tate T. Collins P. Cho M. Moon Y. Chung H. Q. Olson C.B.(2025). Effective w…
  30. Graham S. Capizzi A. Harris K. R. Hebert M. Morphy P. (2014). Teaching writing to middle school students: A n…
  31. Graham S. Harris K. R. (1989). Improving learning disabled students’ skills at composing essays: Self-instruc…
  32. Graham S. Harris K. R. (1997). Self-regulation and writing: Where do we go from here? Contemporary Educationa…
  33. Best practices in writing instruction
  34. The handbook of learning disabilities
  35. Graham S. McKeown D. Kiuhara S. Harris K. R. (2012). A meta-analysis of writing instruction for students in t…
  36. Graham S. Perin D. (2007). A meta-analysis of writing instruction for adolescent students. Journal of Educati…
  37. Handbook of self-regulation of learning and performance
  38. The science of writing
  39. Handbook of writing research
  40. Written Communication
  41. Cognitive processes in writing
  42. Hier B. O. Eckert T. L. Datchuk S. M. (2023). The use of advanced planning among emerging writers. Reading an…
  43. 10.1007/BF02291575
  44. The science of writing: Theories, methods, individual differences, and applications
  45. Kim Y.-S. G. Park S. (2019). Unpacking pathways using the direct and indirect effects model of writing (DIEW)…
  46. Kim Y.-S. G. Schatschneider C. (2017). Expanding the developmental models of writing: A direct and indirect e…
  47. Kuhn D. Shaw V. Felton M. (1997). Effects of dyadic interaction on argumentive reasoning. Cognition and Instr…
  48. Kuhn D. Udell W. (2007). Coordinating own and other perspectives in argument. Thinking & Reasoning 13(2) 90–1…
  49. Written Communication
  50. Limpo T. Alves R. A. (2018). Effects of planning strategies on writing dynamics and final texts. Acta Psychol…
  51. Limpo T. Alves R. A. Fidalgo R. (2014). Children’s high-level writing skills: Development of planning and rev…
  52. Litman C. Greenleaf C. (2018). Argumentation tasks in secondary English language arts history and science: Va…
  53. Assessing Writing
  54. Can large language models automatically score proficiency of written essays?
    arXiv preprint arXiv:2403.06149
  55. Research in the Teaching of English
  56. Handbook of writing research
  57. Journal of Writing Research
  58. Midgette E. Haria P. MacArthur C. (2008). The effects of content and audience awareness goals for revision on…
  59. Mizumoto A. Eguchi M. (2023). Exploring the potential of using an AI language model for automated essay scori…
  60. The nation’s report card: Writing 2011 (NCES 2012-470)
  61. National Governors Association Center for Best Practices & Council of Chief State School Officers. (2010). Co…
  62. Nussbaum E. M. Dove I. J. Slife N. Kardash C. M. Turgut R. Vallett D. (2019). Using critical questions to eva…
  63. Nussbaum E. M. Edwards O. V. (2011). Critical questions and argument stratagems: A framework for enhancing an…
  64. Olive T. Favart M. Beauvais C. Beauvais L. (2009). Children’s cognitive effort and fluency in writing: Effect…
  65. Informal reasoning and education
  66. Philippakos Z. A. MacArthur C. A. (2016). The effects of giving feedback on the persuasive writing of fourth-…
  67. 10.4324/9781315647500-12
  68. Regan K. Evmenova A. S. Good K. Leggit A. Gafurov G. Mastropieri M. (2017). Persuasive writing with mobile-ba…
  69. Rietdijk S. van Weijen D. Janssen T. van den Bergh H. Rijlaarsdam G. (2018). Teaching writing in primary educ…
  70. Saddler B. Moran S. Graham S. Harris K. R. (2004). Preventing writing difficulties: The effects of planning s…
  71. Sexton M. Harris K. R. Graham S. (1998). Self-regulated strategy development and the writing process: Effects…
  72. Sheehan K. M. Kostin I. Napolitano D. Flor M. (2014). The TextEvaluator tool: Helping teachers and test devel…
  73. Assessing Writing
  74. Shermis M. D. Koch C. M. Page E. B. Keith T. Z. Harrington S. (2002). Trait ratings for automated essay gradi…
  75. Song Y. van Rijn P. Deane P. Chao S.-F. (2024). Assessing argumentation skills of middle school students: A l…
  76. Taylor K. S. Lawrence J. F. Connor C. M. Snow C. E. (2019). Cognitive and linguistic features of adolescent a…
  77. Unzueta C. H. Barbetta P. M. (2012). The effects of computer graphic organizers on the persuasive writing of …
  78. Argumentation schemes for presumptive reasoning
  79. 10.1016/B978-012109890-2/50031-7