Multidimensional Levels of Language Writing Measures in Grades Four to Six

Gary A. Troia Michigan State University ; Mei Shen Michigan State University ; Diana L. Brandon Charleston Southern University

Abstract

This study examined multiple measures of written expression as predictors of narrative writing performance for 362 students in grades 4 through 6. Each student wrote a fictional narrative in response to a title prompt that was evaluated using a levels of language framework targeting productivity, accuracy, and complexity at the word, sentence, and discourse levels. Grade-related differences were found for all of the word-level and most of the discourse-level variables examined, but for only one sentence-level variable (punctuation accuracy). The discourse-level variables of text productivity, narrativity, and process use, the sentence-level variables of grammatical correctness and punctuation accuracy, and the word-level variables of spelling/capitalization accuracy, lexical productivity, and handwriting style were significant predictors of narrative quality. Most of the same variables that predicted story quality differentiated good and poor narrative writers, except punctuation accuracy and narrativity, and variables associated with word and sentence complexity also helped distinguish narrative writing ability. The findings imply that a combination of indices from across all levels of language production are most useful for differentiating writers and their writing. The authors suggest researchers and educators consider levels of language measures such as those used in this study in their evaluations of writing performance, as a number of them are fairly easy to calculate and are not plagued by subjective judgments endemic to most writing quality rubrics.

Journal
Written Communication
Published
2019-04-01
DOI
10.1177/0741088318819473
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

References (88) · 8 in this index

  1. 10.1037/a0019318
  2. 10.1037/a0035692
  3. 10.1007/s11145-013-9481-0
  4. 10.1007/s11145-007-9107-5
  5. Assessing Writing
Show all 88 →
  1. The psychology of written composition
  2. 10.1097/00011363-200020040-00007
  3. 10.1080/1057356940100307
  4. 10.1037/0022-0663.94.2.291
  5. 10.1177/0265532214542994
  6. Handbook of automated essay scoring: Current applications and future directions
  7. 10.1037/a0022824
  8. Writing pathways: Performance assessments and learning progressions, grades K-8
  9. 10.1017/S0142716400007293
  10. 10.5070/L4112005035
  11. Proceedings of the Corpus Linguistics 2001 Conference
  12. Common Core State Standards. (2010). Preparing America’s students for success. National Governors Association…
  13. Written Communication
  14. 6 + 1 traits of writing: The complete guide grades 3 and up
  15. 10.1037/a0012656
  16. Assessing Writing
  17. 10.1177/001440298204800417
  18. Relationships among simple measures of written expression and performance on standardized…
  19. 10.1177/001440290907500403
  20. 10.1044/1092-4388(2004/098)
  21. 10.1207/s1532690xci0401_1
  22. Handbook of automated essay scoring: Current applications and future directions
  23. 10.1207/SLDRP1502_4
  24. 10.1080/02796015.2006.12087977
  25. 10.1086/651193
  26. 10.3102/0013189X11413260
  27. 10.3758/BF03195564
  28. Want to improve children’s writing?
    American Educator
  29. 10.1037/0022-0663.89.1.170
  30. 10.1007/s11145-013-9495-7
  31. 10.17161/foec.v44i4.6687
  32. 10.1007/s11145-007-9064-z
  33. 10.1037/0022-0663.87.2.230
  34. 10.17161/foec.v13i2.7428
  35. 10.1177/1525740112465001
  36. 10.1044/2015_LSHSS-14-0043
  37. Test of written language
  38. 10.2307/377723
  39. 10.1093/acprof:oso/9780199827282.003.0001
  40. 10.1080/01638538309544557
  41. 10.1111/emip.12036
  42. Grammatical structures written at three grade levels
  43. 10.1080/02796015.2007.12087919
  44. 10.1044/1058-0360(2006/017)
  45. Research in the Teaching of English
  46. 10.1044/2016_JSLHR-L-15-0133
  47. 10.1086/697510
  48. 10.1044/0161-1461(2012/11-0018)
  49. 10.1111/1460-6984.12306
  50. Analytic scoring of TOEFL CBT essays: Scores from humans and E-rater
  51. 10.1177/00224669060400020301
  52. MacArthur C. A. Jennings A. Philippakos Z. A. (2018). Which linguistic features predict quality of argumentat…
  53. 10.1177/093889829100600403
  54. 10.1044/1092-4388(2004/109)
  55. The reliability of simple, direct measures of written expression
  56. McCarthy P. M. (2005). An assessment of the range and usefulness of lexical diversity measures and the potent…
  57. McCarthy P. M. Jarvis S. (2010). MTLD vocd-D and HD-D: A validation study of sophisticated approaches to lexi…
  58. Written Communication
  59. 10.4018/978-1-60960-741-8.ch011
  60. 10.1017/CBO9780511894664
  61. McNamara D. S. Louwerse M. M. Cai Z. Graesser A. (2005). Coh-Metrix version 3.0. Retrieved from http://cohmet…
  62. Assessing Writing
  63. 10.20360/G21S3V
  64. 10.1080/10573560701277807
  65. Using a writing assessment framework to explore the validity of writing test results
  66. Research in the Teaching of English
  67. Proceedings of the second international Tampere conference in statistics
  68. 10.1044/1058-0360(2008/012)
  69. 10.2307/25474635
  70. 10.1207/S15326950dp2901_3
  71. Handbook of automated essay scoring: Current applications and future directions
  72. 10.1044/jslhr.4302.324
  73. 10.1086/683135
  74. 10.1044/0161-1461(2011/10-0099)
  75. 10.1016/j.sbspro.2013.10.668
  76. 10.3200/JOER.102.5.323-332
  77. 10.1177/00222194020350040101
  78. 10.1007/s11145-012-9379-2
  79. 10.1007/s11145-010-9266-7
  80. 10.1044/jshr.3806.1349
  81. 10.1016/S0022-5371(78)90110-X
  82. Assessing Writing
  83. 10.1044/jslhr.4306.1322