Journal of Response to Writing
16 articlesApril 2026
-
Abstract
Despite the current widespread use of Automated Writing Evaluation (AWE) feedback, many issues regarding its efficacy still remain unresolved. Recent studies mainly focus on correctly detected errors with a lack of attention on the comprehensiveness of error detection, or error coverage. Error coverage is interesting because little is known about the capacity of AWE systems to fully detect common second language (L2) errors. It is also important to investigate the potential effect of such capacity on student uptake and retention, which are important constructs in fostering L2 writing development. To this end, the present study compared teacher feedback and AWE error coverage in L2 writing classes. The findings suggest that both the AWE system and the teacher demonstrated low error coverage across grammar, usage, and mechanics error categories. However, they indicated differences in the types of errors they identified most frequently. The AWE system flagged more mechanical errors, whereas the teacher provided twice as many corrections for grammar errors, including wrong/missing words, prepositions, and incorrect word forms. While the AWE system performed moderately in flagging articles and comma errors, it struggled with more nuanced grammatical errors, suggesting it may not be a reliable standalone tool for addressing specific needs of L2 learners’ writing challenges. Interestingly, coverage was positively associated with successful uptake, with students utilizing a wider variety of revision acts (i.e., change, add, delete, remove) on AWE errors identified compared to errors not identified. However, error coverage did not correlate with short- or long-term retention of accuracy, implying that retention may result from the interplay of error coverage with other factors. Findings provide implications for writing teachers regarding the employment of AWE systems and for AWE developers regarding the future optimizations of the AWE systems.
April 2025
-
Abstract
In this article I discuss some of the issues that scholars are and aren’t writing about in relation to the recent resurgence in contract grading, and reflect on my own experience using contract grading in composition and other classes. I come to the topic as a scholar and university teacher in rhetoric and composition, though my discussion certainly is relevant to teachers in many disciplines and institution types. My aim is to offer an analysis of the benefits and drawback of the “new” contract grading, with special attention to what I call the “more is better” mantra that informs many current iterations of contract grading.
December 2024
-
Developing a Learner-Centered Response to Writing through a Graduate Course in Writing-Across-the-Curriculum ↗
Abstract
Although writing-across-the-curriculum (WAC) programs have been commonplace since the 1970s, the focus has largely been at the level of assessment and programmatic development and less on the instructors, particularly graduate teaching assistants (TAs) who adopt these practices. In this article, we describe a pilot WAC graduate-level course in writing pedagogy that our institution developed as part of our recent membership in the Center for the Integration of Research, Teaching, and Learning (CIRTL). We also share how one science, technology, engineering, and mathematics (STEM) graduate student revised her approach to assignment design, feedback, and assessment for a general education course and deepened her understanding of herself as an instructor as well as her students. We end by reflecting on how training in writing pedagogy can support graduate student identity development and improve student learning.
May 2024
-
Generous Audience, Activist, Evaluator: Tutor-Teachers’ Knowledge, Practices, and Values for Response to Writing ↗
Abstract
The relationship between tutoring and teaching has been a recurrent topic of interest among writing center directors and writing program administrators. While scholarship agrees tutoring experience aids composition teachers with implementing process pedagogy and fostering a collaborative classroom, the relationship between tutoring and assessment of student writing is less clear. This qualitative study uses interviews with eight graduate teaching assistants with tutoring experience to examine how they transfer and juxtapose knowledge, practices, and values for response between the writing center and classroom. Like previous scholarship, this research finds writing center tutoring contributes to teachers’ enactment of constructivist, student-centered pedagogy and enhances their understanding of students’ relationship to writing and feedback, standard language ideology, and systemic inequities in education. However, evaluation led these instructors to experience tension between their values and preferred respondent roles, with many reporting anxious grading processes and some experimenting with alternatives to traditional grading. The article concludes with suggestions to build bridges between tutoring and teaching contexts, particularly through explicit attention to antiracist pedagogy and alternative assessment practices.
-
Transforming Feedback Practices through the Use of Screencast Video Feedback in L2 Writing Classrooms ↗
Abstract
Giving feedback to student writing is one of the writing teacher’s most important tasks in the classroom, and there are many forms of feedback that writing teachers can use such as written feedback, teacher-student conferencing, peer feedback or self-assessment. More than these options, the influx of technologies into writing classrooms provides teachers with the use of screencast video feedback when responding to student writing. In this article, two second language writing teachers questioned their feedback practices when responding to students’ texts and implemented feedback innovation by using screencast video feedback in their classrooms with the goal of exploring how their attempts to use video feedback affected their individual practices. The implementation of video feedback opened their eyes as writing teachers because of its multimodality. The combination of aural, visual, textual, and gestural modes was particularly innovative for them because it helps them to envision feedback as a tool for promoting the improvement and learning of writing instead of correcting students’ immediate errors in writing. This article provides ideas and suggestions for writing teachers interested in improving feedback practices with screencast video feedback.
January 2023
-
Abstract
The study explored six ESL university students’ behavioral, cognitive, and affective engagement with e-rater feedback on local issues and examined any changes in students’ engagement over two weeks. We explored behavioral engagement through the analysis of screencasts of students’ e-rater usage and writing assignments. We measured cognitive and affective engagement by analyzing students’ comments during the think-aloud protocol and reflection surveys. The findings indicated that the students had varying levels of engagement with the feedback. Behaviorally, all students used a range of revision operations to address errors based on the provided feedback. Cognitively, some students were more engaged than others. Affectively, students experienced both positive and negative reactions toward e-rater feedback. While some students’ engagement with feedback did not change over two weeks, others’ engagement grew more negative. We conclude that e-rater feedback could positively impact students’ accuracy in local aspects of writing if students are actively engaged with the feedback.
December 2022
-
Abstract
Assigning grades is conventionally the exclusive, lonely terrain of the instructor, even as other aspects of teaching and responding to student writing are collaborative. As an alternative that promotes student engagement and agency, labor-based contract grading is used in a growing number of writing classrooms. This article strives to add to these conversations by describing evidence-based, student-led grading as an option that engages students as well as a broad construct of writing. This approach foregrounds students’ own response to their writing, in the form of evidence-based interpretation and use arguments for their grades. It engages students in the process of assessment, in this case, in responding not only their labor but also to their writing process and writing they produce. First, the article briefly describes themes and challenges in conventional grading and in contract-based grading. Then, the article offers context and example material for evidence-based student interpretation and use arguments for summative grades. The article closes with limitations and ongoing considerations.
June 2022
-
Improving First- and Second-Year Student Writing Using a Metacognitive and Integrated Assessment Approach ↗
Abstract
Metacognition emphasizes an awareness and understanding of one’s thought and cognitive processes, along with management of cognition through multiple strategies including organizing, monitoring, and adapting. Before students can truly become effective writers, they must develop an appreciation for the amount of planning, organization, and revision that comprises a writing assignment. In order to improve student writing, the exam autopsy approach, an integrated post-exam assessment model that draws upon self-assessment, peer review, and instructor feedback, was modified to include metacognitive components for use with essay exams and writing assignments. The current study employed a mixed-methods design with a quasi-experimental, non-equivalent group component across four institutions over two semesters, with the fall semester classes (T1) functioning as the control group and the spring semester classes (T2) functioning as the experimental group. During the spring semester of each class, the modified version of the exam autopsy process (EA 2.0) was used between two submissions of student writing (either essay exams or drafts of papers). The process was found to be significant in terms of its impact on student scores in lower division classes, but not in upper division classes. Qualitative data analysis reveals some of the reasons behind the observable improvements (or lack thereof) in student writing. These, as well as possible future implications for both teaching and research, are offered in this article.
June 2021
-
Abstract
In writing studies research, automated writing evaluation technology is typically examined for a specific, often narrow purpose: to evaluate a particular writing improvement measure, to mine data for changes in writing performance, or to demonstrate the effectiveness of a single technology and accompanying validity arguments. This article adopts a broader perspective and offers a standpoint theory of action for formative automated writing evaluation (fAWE). Following presentation of the features of our standpoint theory of action, we describe our two study sites, and each instructor documents her experiences using the fAWE application (app), Writing Mentor® (WM). One instructor analyzes experiences using the app with nontraditional adult learners to provide career pathway access through a high school equivalency (HSE) credential awarded by successful completion of the GED® (General Educational Development Test) or of the HiSET® (High School Equivalency Test). A second instructor analyzes WM experiences working with a diverse population of two-year college students enrolled in first-year writing. These instructors’ experiences are used to propose two theory-of-action frameworks based on the instructors’ standpoints, with particular attention to fAWE components, pedagogies, and consequences. To explore the representativeness of these two case studies, we also analyze student feature use and self-reported self-efficacy data from a general sample (N = 5,595) collected through WM user engagement. We conclude by emphasizing the pedagogical potential of writing technologies, the advantages of instructionally situating these technologies, and the value of using standpoint theories of action as a way to anticipate local impact.
January 2021
-
Review of <i>Classroom Writing Assessment and Feedback in L2 School Contexts</i> (1st edition), by Icy Lee, 2017 ↗
Abstract
Writing classrooms focused on summative assessment are likely to lack formative feedback components that contribute to more motivated, confident, and autonomous writers, notes Icy Lee (2017), author of Classroom Writing Assessment and Feedback in L2 School Contexts. Ranging from $66.02 (Kindle) to $69.49– $102.24 (hardcopy), this 157-page work presents a strong case for school second-language (L2) writing education to shift away from traditional, score-based assessment. Though Lee targets L2 writing teachers and teacher trainers, she also appeals to researchers of L2 writing. Ten chapters provide thorough theoretical and research-based justification for a student-centered, learning-oriented feedback and assessment system and also provide practical suggestions for implementation. These chapters begin with the purpose, theory, and practice of L2 writing assessment and then explores various types of assessment and feedback, as well as the use of portfolios for assessment. The text concludes with chapters on technology in L2 writing assessment and classroom assessment literacy for L2 writing teachers. As a whole, the research-based guidance that Lee offers encourages writing teachers and educators to implement assessment, so it can “bring improvement to student learning and is supported by self-, peer-, and teacher-feedback” (p. 5).
January 2020
-
Abstract
Peer review is a common practice in writing studies. However, while there is considerable research on peer review, pedagogical studies on other forms of student-led assessment strategies are less prevalent. This study investigates the expansion of assessment practices into student-led rubric development and peer grading, focusing on their effect on student understanding of the writing process. Utilizing surveys and classroom observations in two second-year composition courses at a university in New York City, this study investigates student-led assessment strategies as a potent pedagogical tool, adding to literature that explores assessment as an active part of the writing process.
January 2017
-
Abstract
This qualitative study reports on teachers’ (formative) feedback practices in writing instruction. Observations and interviews were used to collect data from 10 upper-secondary school teachers of English as a Foreign Language (EFL) writing classes in Norway. The findings indicate that while the teachers attempt to comply with the requirements of the national curriculum regarding formative assessment, and acknowledge the pivotal role of feedback in that pedagogy, the dominant tendency is still to deliver feedback to a finished text. As such, there is limited use of feedback for that text and no resubmission of the text for new assessment, while feedforward is reduced to the correction of language mistakes, which does not foster writing development except for language accuracy. The limited use of formative feedback suggests the need for more systematic professional development of the teachers.
-
Abstract
Sustainable feedback practices, that can encourage self-regulation of performance and improvement in future work beyond an immediate task, require our students to be active participants in, and users of, the feedback we provide. Critical to this participation are the internal feedback mechanisms of reflection and self-assessment. They require students to make evaluations about their own writing without the aid of external agents, which in turn can encourage better use of teacher feedback. Moreover, dialogic collaborative feedback that encourages this type of self-evaluation through interactive cover sheets has been featured in existing practitioner research studies. This teaching article presents an extension to the use of such cover sheets to include student self-evaluation and reflection in relation to specific marking criteria as part of an existing feedback cycle on a first-year undergraduate course. Observations from the practitioner research presented here highlight how the inclusion of such rubric criteria not only helped to develop students’ confidence in independently monitoring and evaluating their writing but also heightened awareness of the rhetorical features of their texts.
January 2016
-
Abstract
Metacognition is a typical learning outcome in composition courses, but providing feedback on low-stakes reflective writing and assessing highstakes reflective writing are complex tasks that warrant more attention in the literature. Consequently, this article explores how the assignment of and response to low-stakes reflective writing can provide effective scaffolding to higher-stakes reflective writing tasks. We present an example of our strategy for response through one instructor’s experience with responding to her first-year composition student’s low-stakes reflective writing. Ultimately, we call for more research on responding to reflective writing that will ensure the valid and reliable assessment of metacognition in composition courses.
-
Abstract
The present study investigates learners’ participation in the activities of providing self and peer review in the context of a foreign language classroom to determine which feedback type contributes to greater gains in writing development. The study also investigates whether there are target areas of improvement that are more accessible to self-assessment compared with aspects that are better identified from an outsider’s perspective. Three intact classes of intermediate-level French learners (n = 44) were assigned to one of three conditions: peer review, self-review, and a no-review comparison group. Each group produced four texts over the course of the semester in the following ways: the peer review and self-review groups wrote drafts, provided reviews, and revised their drafts, while the comparison group completed each assignment in one draft. The texts were coded and scored by two raters to determine whether any groups improved significantly over the course of the semester, whether the revisions showed improvements over the drafts, what effect the feedback had on the final text, and which aspects the feedback targeted. Results indicate that none of the groups improved their scores significantly over time, but both treatment groups provided feedback resulting in improved scores. The peer group gave more feedback that was ignored or not useful, while self-reviewers gave more comments that resulted in positive changes. The peer group provided more organization-focused comments and compliments, while the self group focused more on structure and cohesion. Results are discussed in terms of autonomy (Benson, 2001), perspectives on writing development (Manchón, 2012), and foreign language writing instruction.
January 2015
-
Abstract
In an effort to rethink the evaluation of student writing with the ultimate goal of convincing novice writers that rewriting predicates as well as presupposes the act of writing, I describe a point-accrual grading system where students accumulate points with redrafted submissions during a semester. This approach to evaluation offers students more autonomy in controlling their “earned” grade as well as incentivizes their investments in the revision process. In contrast to the normative percentages approach to grading, this point-accrual system not only gives students a less ambivalent form of grading but also moves them past surface-level revision and into rhetorical restructuring.