Journal of Writing Research
23 articlesFebruary 2026
-
Abstract
Since the launch of ChatGPT, the use of and debate around generative AI has grown rapidly. Professionals whose work depends on writing have expressed concern about the potential impact of such tools on their roles. But are these concerns justified? Can ChatGPT truly take on the responsibilities of a professional writer? This study investigates that question by comparing the performance of ChatGPT with that of professional editors tasked with optimizing business communication. We conducted two studies, using both qualitative and quantitative methods. In the first, three experienced editors were asked to rewrite four business letters. Their editing processes were recorded using the Microsoft Snipping Tool, and immediately afterward, we conducted retrospective interviews using stimulated recall. These interviews were transcribed and analyzed. Insights from the observations and interviews informed the design of the prompt instructions used in the second study. In the second study, we asked ChatGPT to revise the same four letters using three different prompt types. The Simple prompt instructed the model to “make this text reader-focused.” The B1 prompt referred explicitly to the CEFR B1 language level, requiring ChatGPT to tailor the text for intermediate readers. Finally, the Process prompt simulated the editing steps observed in the professional editors’ workflows. To evaluate outcomes, we conducted both a qualitative comparison of the revised texts and a quantitative readability analysis using LiNT, a validated tool developed for Dutch texts. Our results show that the human editors substantially improved the readability of the original letters, reducing the use of unfamiliar words, shortening complex sentences, and increasing personal engagement through pronoun use. Among the AI outputs, ChatGPT B1 achieved results most comparable to the editors, both in readability and accuracy. In contrast, ChatGPT Simple fell short in terms of clarity and introduced errors through faulty inferences. Surprisingly, ChatGPT Process also underperformed compared to ChatGPT B1 and the human editors. Only the editors' and ChatGPT B1versions were free from errors. In the discussion, we reflect on how generative AI is reshaping the concept of writing within organizations, the skills required to produce effective written communication and the impact on writing pedagogy. Rather than replacing human editors, we argue that generative AI can play a valuable role as a collaborative tool in the organizational writing process.
June 2025
-
Abstract
Executive functions are attributed a central role in maintaining fluency during L2 text composition, allowing writers to orchestrate the various linguistic and cognitive processes and resources involved in writing. The study examined (1) whether language proficiency moderates the relationship between executive functions and writing fluency in L2 writing and (2) whether the effects indirectly affect text quality. Sixty university students composed two texts in English as their L2, an argumentation and a description, three executive function tasks assessing inhibition, shifting, and updating skills, a language proficiency test, and a copy task. Keystroke logging protocols were recorded with Inputlog and analyzed for writing fluency. Text quality was assessed with a holistic benchmark procedure and comparative judgments. The results revealed language-dependent and genre-specific effects of updating and shifting but not inhibition skills on writing fluency. Path models indicated that the interactions between executive functions and language proficiency indirectly affect text quality through process-related writing measures. The findings suggest a complex relation between executive functions and writing performance that depends on language proficiency and varies with task demands.
March 2024
-
Abstract
Poor writing skills are problematic in today’s society where writing expertise is essential in personal, academic and professional contexts. Students struggle most with argumentative writing. To write a good argumentative text, students need genre knowledge on this type of text. After all, genre knowledge has been proven to be related to writing quality. Considering its relevance, in this study we investigated whether learning from (comparing) text exemplars could be an effective method to enhance genre knowledge. This study aims to investigate whether learning from (comparing) text exemplars can enhance genre knowledge. A quasi-experimental study with 77 11th grade students was carried out to test the effects of four conditions on genre knowledge of argumentative texts. Findings show that genre knowledge increases through single and analogue text examples. In addition, learning from comparing text exemplars does not seem to increase genre knowledge more than learning from single, sequential exemplars.
August 2023
-
Abstract
This study examines associations between writing behaviors manifested by keystroke analytics and the formulation of argument elements in L2 undergraduate writers' writing processes. Ninety-nine persuasive essays written by L2 undergraduate writers were human annotated for Toulmin argument elements. The corresponding keystroke logs were segmented and analyzed to characterize the dynamics of writing processes for different categories of the elements. A multinomial mixed-effects logistic regression model was built to predict argument categories using the keystroke analytics. The study reported that L2 undergraduate writers' text production for final claims and primary claims featured P-bursts (execution processes delimited by pauses exceeding 2 seconds) of longer spans but lower production fluency compared to that for data. In addition, fewer revisions were observed when L2 writers were constructing final claims than when they were formulating data. These findings shed light on the varying cognitive loads and activities L2 undergraduate writers may experience when building different argument elements in written argumentation.
June 2023
-
Abstract
Students need support through intentional writing instruction to develop their discipline-specific writing skills outside of Language Arts. Yet, we argue not all writing instruction provides the same opportunities for student learning. In this study, with the support of professional development, teachers engaged students in civic perspective-taking through writing, focusing on locally relevant public issues. Drawing from disciplinary literacy and genre pedagogy, our research team conducted a descriptive study where thematic analysis was applied to examine second and third graders’ civics writing samples. Our findings indicate that students’ engagement with key civic concepts became more complex and purposeful as they practiced argumentative writing. Development continued from second to third grade in both the sophistication of their civic perspective-taking as well as their writing. Additionally, we found that student motivation to engage in argumentative writing increased in all classrooms across both grade levels when engaging with locally relevant public issues. This article provides details about the elementary civics writing curriculum and the students’ writing outcomes as well as includes the two graphic organizers used in the curriculum.
May 2023
-
Abstract
There is an assumption in education that allowing students to choose their writing topics and positions is beneficial; however, there is little research to support this belief, particularly from the students’ perspectives. In the present study, we conducted 20 semi-structured interviews with students at a large university in the Southwest of the United States after they completed two in-class argumentative writing assignments in a course on exceptional children, one where they chose their writing position and one where they were assigned their writing position. As a group, these 20 students (13 female, 7 male) were above average writers in their first to third year of study, and the majority of them were education majors (70%), followed by arts and sciences (25%), and design and the arts (5%). The interview protocol focused upon their shifting perspectives on the underlying motivational construct of choice related to this and other writing assignments. Taking a grounded theory approach to thematic analysis, findings indicated that having choice in writing was important because it allowed students to write about topics that they find easier, more interesting, and possess greater knowledge. Choice also allowed students to demonstrate their autonomy, which they believed, influenced their motivation and writing quality/grades. While the university students in this study generally preferred choice, a majority of them identified benefits of not choosing, including opportunities to improve writing tenacity, enhance their writing skills, and achieve new perspectives.
February 2023
-
Improving Argumentative Writing of Sixth-Grade Adolescents Through Dialogic Inquiry of Socioscientific Issues ↗
Abstract
This study investigated the effect of a four-week socioscientific issues (SSI)-based intervention on sixth-grade students’ argumentative writing and transferability of argument skills across topics. Students in three treatment classrooms engaged in an SSI unit on space exploration while students in three comparable classrooms continued regular space science lessons. Argumentation skills were assessed by individual decision letters about space exploration. Argument transfer was assessed by an essay to address a novel SSI. Treatment students wrote more elaborated decision letters with stronger arguments, relied less on personal ideas, and transferred argument skills to a novel SSI after the intervention. The implications of using SSI as a promising approach to integrating science and literacy learning for diverse adolescents were discussed.
June 2022
-
Abstract
This study examines links between human ratings of writing quality and the incidence of argumentative features (e.g., claims, data) in persuasive essays along with relationships among these features and their distance from one another within an essay. The goal is to better understand how argumentation elements in persuasive essays combine to model human ratings of essay quality. The study finds that, in most cases, it is not the presence of argumentation features that is predictive of writing quality but rather the relationships between superordinate and subordinate features, parallel features, and the distances between features. This finding has not only theoretical value but also practical value in terms of pedagogical approaches and automated writing feedback.
February 2022
-
Refocusing education in writing style? Relationships between stylistic lapses and the quality of Dutch secondary school students’ argumentative writing ↗
Abstract
In Dutch L1 classrooms, style in non-fictional genres is typically taught by means of normative exercises in which students are tasked to identify stylistic lapses. Not much is known about the effectiveness of such exercises when teaching style. Unknown factors include what kinds of stylistic shortcomings are found in Dutch students’ writing, and how the occurrence of certain stylistic lapses relates to writing quality. The current study empirically explores these scarcely investigated issues. Teachers rated 125 argumentative texts written by tenth-grade pre-university students by means of comparative judgement. Additionally, these texts were manually analyzed to investigate the occurrence of stylistic lapses, taking into account stylistic lapses that are common in text books (‘standard category’) and other types of style related errors (‘other category’). Multilevel regression analyses revealed that only one of the stylistic lapses from the standard category negatively influenced text quality as evaluated by teachers, namely the use of detached phrases. In the other category, only mistakes in question marks negatively predicted text quality. A final model including those two predictors explained 11.1% of the variance in text quality. The article discusses the implications of these findings for non-fictional style education, suggesting that it might need to be refocused.
October 2021
-
Teaching models of disciplinary argumentation in middle school social studies: A framework for supporting writing development ↗
Abstract
Modeling, by demonstrating and explaining the cognitive processes involved in writing, has been shown to support writing development. Less often have specific disciplinary aspects of teaching with models been investigated. We draw on research in English Language Arts and apply it in social studies inquiry contexts to propose a framework for teaching models of thinking and writing that offers teachers and researchers new perspectives on the discipline-specific work of modeling. This framework accounts for three modes of instruction – use of models (a tool or a text), demonstrating and explaining, and co-constructing model texts with students – and describes eleven instructional practices that support instruction across these modes. We analyze data from three years of social studies instruction to show how two teachers enact these practices across the three modes to highlight the disciplinary thinking and processes that support writing social studies arguments with sources, highlighting the ways students can actively participate in teaching writing with models. In addition, we consider the role of the curriculum in this work. We show how writing instruction can address disciplinary ways of thinking in social studies and illustrate the potential of the framework for guiding researchers’ and practitioners’ work on writing instruction across disciplinary contexts.
February 2021
-
The role of achievement goal orientations in the relationships between high school students' anxiety, self-efficacy, and perceived use of revision strategies in argumentative writing ↗
Abstract
This study examined the relationships between writing anxiety, writing self-efficacy, and perceived use of revision strategies in high school students with different achievement goals as they learned argumentative writing in English Language Arts classrooms. Three achievement goal orientation profiles emerged from a sample of 307 American high school students on the basis of their mastery, performance-approach, and performance-avoidance goal orientations: Low on All, Average on All, and High on All. These three profiles of students significantly differed with respect to their writing anxiety and their perceived use of revision strategies. Writing self-efficacy mediated the effect of writing anxiety on the perceived use of revision strategies for students in the Average on All profile only. The findings suggest that students are diverse in their motivational and affective experiences with respect to argumentative writing, and caution against using a one-size-fits-all approach for teaching argumentative writing to students.
June 2020
-
Abstract
C-SAW (Computer-Supported Argumentative Writer) is an online authoring software embodying design principles derived from theories on written argumentation, self-regulation and conceptual change as well as feedback from practitioners and users, in line with a design-based research approach. Designed to scaffold writing processes, C-SAW is intended as additional support in instructional designs using argumentative writing for learning. This article presents the results of a mixed-method study comparing undergraduate students writing with C-SAW or a text editor. Outcome measures included the number of arguments and the degree of their completion, knowledge of argument components, topic knowledge and changes in epistemic beliefs. Participants writing with C-SAW elaborated arguments to a greater degree, but there were otherwise no significant differences between conditions for other measured outcomes. Furthermore, results were influenced by informal reasoning skills that outweighed the effects of condition. These results are discussed with respect to the difficulties of studying the effects of digital tools on writing and learning in controlled first-use contexts and the importance of developing instructional designs with explicit learning outcomes that are aligned to the instructional principles embedded in digital tools.
-
Abstract
Writing an argumentation about a controversial issue from contradictory sources is a challenging task. It involves understanding, managing, and generating arguments and counterarguments from different sources to support a final position, conveyed in a formal structure. Despite its difficulty, argumentative writing is not often taught in higher education in Spain. Furthermore, online interventions regarding this type of task are scarce. For this reason, we designed and evaluated virtual training aimed at writing integrative and well-structured arguments in a distance learning university. Sixty-eight undergraduates participated in this pre-post with a control group design. The training included explicit instruction through video lectures and practice exercises with immediate feedback using open online resources (e.g., Moodle). The results show that after the instruction the participants' written products improved both in their structure, the number of arguments for the against-position, and the degree of integration of the two perspectives. However, those products that presented medium or maximum integration were still limited. These results illustrate how online instruction of argumentative writing can be implemented in higher education with positive results. However, students still need more support to expand their skills for generating integrative synthesis. Considering these results, we propose further improvements in the designed training.
October 2019
-
Assessment of Authorial Voice Strength in L2 Argumentative Written Task Performances: Contributions of Voice Components to Text Quality ↗
Abstract
The purpose of this study was twofold: (a) to examine the level of authorial voice strength among Iranian second language (L2) writers; and (b) to investigate the relationship between L2 learners’ authorial voice strength and the quality of their argumentative written task performances. Argumentative writing samples were elicited from 129 upper-intermediate L2 learners in writing courses. To quantify learners’ voice strength, these samples were scored by two raters using an analytic voice rubric. Raters also provided a holistic rating of the overall authorial voice strength in written argumentations. The quality of argumentations was measured using the TOEFL scoring rubric. While descriptive results indicated that learners demonstrated a low level of voice strength in their argumentations, results from Multiple Regression Analysis (MRA) suggested positive associations between voice strength along with two of its dimensions and the quality of writings. Moreover, results from Multiple Correspondence Analysis (MCA) pointed to the association of low and mid-level of writing quality and low voice strength, and the prevalence of high and mid voice strength in learners with high proficiency in writing. Finally, while an Item Response Theory (IRT) analysis revealed that the ‘presence’ dimension of authorial voice was the most difficult one for L2 learners, a Differential Item Functioning (DIF) analysis showed that the difficulty of the three voice dimensions did not differ significantly across genders. The findings were discussed regarding English L2 writing within the Iranian context.
June 2019
-
Abstract
We describe a dialogic approach to developing argumentive writing whose key components are deep engagement with the topic and extended discourse with peers that provides the activity with both an audience and a purpose. In a dialogic intervention extended over an entire school year, pairs of sixth graders engaged in electronic discourse with peers on a sequence of topics, as well as wrote individual final essays on each topic. In their essays, they showed achievements relative to a non-participating group in coordinating evidence with claims, in particular in drawing on evidence to weaken claims as well as to support them. They also showed some meta-level enhancement in understanding of the role of evidence in argument. A recall task ruled out the possibility that this enhancement was due to superior recall of the specific evidence available to them, rather than broader meta-level understanding. A case is made for fostering development in argumentive writing both dialogically and in the context of topics that students engage with deeply.
February 2019
-
Abstract
The current study examined the impact of adapting an evidence-based instructional approach to develop ninth-grade students’ argumentative writing and self-regulated strategy use. Following the Self-Regulated Strategy Development (SRSD) model, strategies to plan and write argumentative texts were implemented in two Portuguese classrooms. The model relies heavily on the use of mnemonic strategies to support instruction. Thus, incremental effects of using dual-coding mnemonics (i.e., visual and verbal mnemonics) were explored when implementing SRSD instruction. For the first group (n = 23), SRSD instruction included verbal and visual mnemonics; for the second group (n = 25), SRSD instruction included verbal mnemonics alone. Groups were compared with a control group (n= 25) receiving standard writing instruction.The following findings were significant: a) SRSD instruction increased writing quality, organising, and spontaneous planning; b) dual-coding mnemonics enhanced writing quality, development of ideas, organising, language clarity, and spontaneous planning; c) national exams completed 15 weeks after instruction reinforced the effectiveness of the adapted SRSD strategies. The process of culturally adapting and implementing SRSD instruction to teach argumentative writing will be discussed, including the potential incremental effects of adding visual mnemonics to the SRSD instructional routine.
June 2018
-
Persuasion by numbers: How does numeral marking of arguments in bad news letters influence persuasion? ↗
Abstract
To what extent does numbering the reasons for a negative decision influence the persuasive force of the text? That is the focus of this study, in which we report an experiment (with 265 participants) wherein the direct effects and the indirect effects of numeral markings are analyzed in two linguistic contexts: in the introduction of the upcoming enumeration of reasons (the so-called ‘trigger’) and in the lead-ins of the successive reasons of the enumeration itself. The experiment was conducted within the framework of the Elaboration Likelihood Model (Petty and Cacioppo, 1984) and the Schematic Text Structural Expectations Hypothesis (Sanders and Noordman, 2000; Mulder, 2008). Adding numeral markers in both trigger and lead-ins turns out to enhance the persuasiveness of the text in several ways. It stimulates readers to elaborate more on the content of the reasons. It helps readers to scrutinize the reasons and stimulates recall, which contributes to a more balanced judgment. The markings also have a direct positive effect on persuasiveness, which points to an effect on low elaborating readers. Furthermore, inconsistent implementation of numeral markings (the combination of a numeral trigger with non-numeral lead-ins or a non-numeral trigger with numeral lead-ins) has a negative indirect effect on persuasiveness via text evaluation. This effect is explained by assuming that the Schematic Text Structural Expectations Hypothesis not only applies to text processing, but to text evaluation as well.
February 2017
-
Abstract
Building upon research on writing and on students’ development of historical thinking, the current study uses patterns in 427 eighth graders’ writing about sources to assess the sophistication of their historical reasoning. A spectrum is proposed to represent five levels of increasingly sophisticated writing about the source of documents. Using examples of students’ writing, this paper shows how students at lower levels fail to recognize sources of documents or misuse source information. In contrast, students at higher levels of the spectrum critically analyze sources of documents and a few even use source information persuasively in their writing. The spectrum, which categorizes the quality of students’ sourcing, correlates positively with the frequency of sourcing in students’ writing, suggesting a connection between strategy use and historical thinking. Suggestions for designing written assessments of students’ historical thinking are proposed.
June 2016
-
Using Corpus Results to Guide the Discourse-Based Interview: A Case Study of a Student Writer’s Awareness of Stance in Philosophical Argumentation ↗
Abstract
Discourse-based interviews (or DBIs) have long been used in writing research to investigate writers’ tacit genre knowledge, including their rhetorical motivations for sentence-level wordings. Meanwhile, researchers in English for Academic and Specific Purposes (EAP/ESP) have used corpus techniques to uncover patterns of such wordings, ones that index community-valued ways of knowing and meaning. This article brings together these two methods in a novel way. By offering a case study of Richard, an advanced undergraduate writer majoring in philosophy at a U.S. university, the article demonstrates how systematic analysis of Richard’s writing informed and enriched DBIs with him and his professor, Maria. Specifically, corpus-based text analysis revealed that Richard regularly expressed an epistemic stance in his course essays in ways that are conventional and valued in philosophical argumentation, while the DBIs revealed that neither Richard nor Maria were consciously aware of these stance patterns, despite regular appearance in both their writing. Taken together, these findings point to the value of using corpus techniques prior to the DBI to identify meaningful choices in language that likely otherwise would be missed. The findings also raise important questions about the acquisition of disciplinary discourses and the sources of knowledge that foster that acquisition.
May 2015
-
Abstract
Writing-to-learn benefits have been explored in various educational settings. However, little research has been done on how a WTL approach in combination with two different languages of instruction can influence historical reasoning learning. The main objective of the present study is to examine the effects of a particular WTL instruction in two languages (L1 is Russian and L2 is English) on historical reasoning learning outcomes. The paper presents the results of a case study of first year students of the History Faculty. Learners received small-group L1/L2 instruction by a team of two teachers in a Logic module which included evidence based direct instruction and a set of WTL activities. The instruction explicitly targeted argumentation skills such as argument structure, validity of an argument, fact vs opinion and using documented historical sources. The Critical Thinking Analytic Rubric was used for both pre and post-course metacognitive competencies assessments while argumentation skills were assessed with the help of a new developed rubric. The results showed various patterns of positive change in all the categories and seem to support the hypothesis that this approach to writing-to-learn in L1 and L2 leads to successful acquisition of disciplinary knowledge and skills.
-
Abstract
This study investigated students' practice of philosophical thinking through collaborative writing in secondary education. A philosophy course was developed following the rationale of the learning communities in which writing was used as an epistemic tool. 45 students organized into 13 teams participated in the course. In this study, a subsample of six students working in 2 teams during one collaborative argumentative writing activity were analyzed. These groups were selected on the basis of their output (high and medium quality) and because both followed an integrating construction strategy for collaborative writing. Data collected included audio, video and computer screen recordings of both groups' discourse and writing activity during collaborative writing (using Camtasia and Atlas-ti software). Analysis focused on collaborative writing interaction (types of talk; evidence of philosophical competences - problematization, argumentation and conceptualization; regulation of the collaborative writing activity and group dynamics) and the quality of individual and collaborative texts.Results indicate that quality of the interaction was related to text quality. Collaborative writing helped the students: 1) to transform abstract ideas into more concrete and appropriate philosophical concepts using examples related to their experiences, 2) to use these philosophical concepts in their own discourse and 3) to problematize their own ideas and provide arguments to support them. From these results, the importance of a structured context of learning to promote critical thinking through writing is discussed as well as the need to train students to develop efficient peer discussion for learning through collaborative writing.
-
Abstract
Research on writing to learn is conceptually rich and pedagogically important. This special issue contributes to our growing knowledge about the variables that mediate and moderate the effects of writing on learning. One group of studies addresses individual writing; it adds to the growing evidence for the effects of several moderators, including cognitive, metacognitive, and personal utility prompts in journal writing (Wäschle et al.); and discipline-specific prompts for argument writing (Van Drie et al.). The individual-level studies also suggest moderator roles for discipline-general strategies of argumentation (Smirnova); and open-ended informational writing assignments (Wilcox et al.). Additionally, the Wäschle et al. study provides the strongest evidence for a specific sequence of mediation: Prompted journal writing to comprehension to interest to critical reflection. The second set of articles focusses on collaborative writing (Corcelles & Castelló; Ortoleva and Bétrancourt). It suggests moderating roles for discipline-specific analytic strategies, and peer interaction; and suggests mediating roles for exploratory discourse and group regulation. Further experimental research on collaborative writing is needed to conclusively test hypotheses about specific mediator and moderator variables. The studies in this special issue, like many recent studies, are incommensurable with some influential theories of writing to learn. Rather, individual and collaborative studies converge to suggest that writing to learn may be conceptualized as a guided process of cognition and self-regulation.
February 2013
-
Abstract
Do the quality and the quantity of arguments have an impact on the evaluation of bad news messages? To answer this question, two experiments were carried out using bad news letters in which the quality and the quantity of the arguments were manipulated in a contextually realistic way. The results of both experiments show that adding argumentation has a positive impact on the perceived politeness and the persuasive force of the letters. Furthermore, the studies show that the impact of strong arguments is greater than that of weak arguments. The effect of adding successive arguments is positive as well. However, the results indicate that one or two arguments are sufficient. Adding a third argument only minimally contributes to better evaluations.