Abstract
This preliminary study examines the rating behavior of five composition and five ESL writing teachers while evaluating a text from a university-level non-native (L2) English speaking student. Using an eye tracker, we measured raters’ dwell times and reading behaviors across four areas of interest—rhetoric, organization, vocabulary, and grammar. Results indicate that raters with differing disciplinary backgrounds read the text differently. L2 writing teachers tended to spend more time on and re-read the rhetorical, lexical, and grammatical features of the text while skipping over more of the grammar errors, while composition teachers read the text more deliberately. The findings suggest L2 writing teachers were more prone to skim and scan for information on which to base a grade while composition teachers delayed rating decisions until after reviewing the entire text, which is corroborated in previous research. These findings can expand our understanding of how disciplinary background can influence rating processes, which can inform rater training procedures, especially in disciplinary writing contexts where L2 writing is judged by individuals with and without expertise in composition or second language writing. Moreover, it demonstrates the utility of eye-tracking methods to examine the cognitive processes associated with reading and scoring student writing.
- Journal
- Journal of Writing Research
- Published
- 2018-06-01
- DOI
- 10.17239/jowr-2018.10.01.01
- CompPile
- Search in CompPile ↗
- Open Access
- OA PDF Diamond
- Topics
- Export
- BibTeX RIS
Citation Context
Cited by in this index (0)
No articles in this index cite this work.
Cites in this index (0)
No references match articles in this index.
Related Articles
-
Assessing Writing Jan 2026Albert W. Li; Steve Graham
-
Assessing Writing Oct 2025Ruth Trüb; Jens Möller; Julian Lohmann; Thorben Jansen; Stefan D. Keller
-
The Peer Review Sep 2025Moving Against the Grain: Combining Writing Center Theory and In-House Editing Services to Create a Graduate Writing Center ↗Brian Harrell; Brook Wyers; Craig Theissen
-
Technical Communication Quarterly Oct 2024Jo Mackiewicz; Shaya Kraut; Allison Durazzirhetorical criticism discourse analysis first-year composition writing pedagogy graduate education teacher development writing centers technical communication professional writing digital rhetoric multilingual writers grammar and mechanics literacy studies race and writing public rhetoric editorial matter
-
Pedagogy Oct 2024rhetorical criticism first-year composition writing pedagogy basic writing writing across the curriculum graduate education two-year college service learning teacher development revision argument collaborative writing assessment writing program administration multimodality multilingual writers literacy studies race and writing disability studies community literacy editorial matter