All Journals
1471 articlesSeptember 2023
-
Abstract
This quasi-experimental study examines responses to surveys distributed to writing center tutors administered after training interventions on the topic of transfer. Tutors could opt into two short training modules, the first on tutoring for transfer and the second on using transfer in sessions specific to legal briefs. After each training module was phased out, an assessment was distributed to the entire population to measure the efficacy of the interventions. This study found that after completing a training module on tutoring for transfer, tutors tended to more readily articulate explicit transfer talk for helping writers connect a writing task to past experiences. The genre-specific intervention was found to help tutors articulate explicit transfer talk strategies for helping writers connect a writing task to future writing situations. In both assessments, tutors tended to report using questions to facilitate writers’ transfer of past knowledge to a present writing task; conversely, tutors tended to report using explanation, praise, and advice for facilitating transfer of knowledge from a current task to future tasks. The study also raises questions about how tutors themselves transfer tutoring knowledge from tutor training as well as past academic experiences to new tutoring situations.
Subjects: writing center, transfer, genre, writing across the curriculum, assessment, RAD, training
August 2023
-
Comparative approaches to the assessment of writing: Reliability and validity of benchmark rating and comparative judgement ↗
Abstract
In the past years, comparative assessment approaches have gained ground as a viable method to assess text quality. Instead of providing absolute scores to a text as in holistic or analytic scoring methods, raters in comparative assessments rate text quality by comparing texts either to pre-selected benchmarks representing different levels of writing quality (i.e., benchmark rating method) or by a series of pairwise comparisons to other texts in the sample (i.e., comparative judgement; CJ). In the present study, text quality scores from the benchmarking method and CJ are compared in terms of their reliability, convergent validity and scoring distribution. Results show that benchmark ratings and CJ-ratings were highly consistent and converged to the same construct of text quality. However, the distribution of benchmark ratings showed a central tendency. It is discussed how both methods can be integrated and used such that writing can be assessed reliably, validly, but also efficiently in both writing research and practice.
July 2023
-
Abstract
ABSTRACT Reverse eikos (plausibility) arguments are notorious for reversing a reason that supports an accusation into a reason that denies this accusation. This article offers new insights on their analysis and evaluation, by reconstructing a reverse eikos argument’s line of reasoning as an argumentative pattern. The pattern reveals that this type of argument centers not only on the arguer’s claim that by doing the act of which they have been accused, they would risk becoming the likely suspect, but also on the connected reasoning that they would not want to risk this since that would be stupid and they are not stupid. The proposed analysis, which is illustrated with classic and modern examples of reverse eikos arguments, shows that the evaluation of these arguments boils down to estimating the arguer’s calculation of the costs and benefits of taking the risk, while taking into account the arguer’s character, intellect, and circumstances.
-
Abstract
The “Power Hour of Writing” is an institution-led approach which brings together staff and postgraduate research students in a community that encourages participants to write regularly as part of their academic practice, helping to develop sustainable habits. This research into the “Power Hour of Writing” combines analysis of participant numbers with qualitative analysis of free text responses from online surveys taken at three different time points. Three themes emerged and were evident across all three surveys, independent of their time point: The importance of community; making writing a legitimate part of people’s everyday work; and accountability, which is built into the structure of the “Power Hour Of Writing”. Our research indicates that regular, short timeslots for writing can have a valuable impact on staff and postgraduate researchers. Not only did this intervention help build the community at a time while people were working even more in isolation due to the pandemic, but it also highlighted to participants that protecting time for writing benefits their work.
-
Abstract
In this paper, we present a science writing assignment in which students focus on targeting specific audiences when writing about a socioscientific issue as well as participate in a peer review process. This assignment helps students consider inclusive science communication in their writing, focusing on engaging unique audiences about the intersections of science and social justice. Students are introduced to evidence-based tools for formulating communication for unique audiences as well as for assessment of writing quality. This assignment is novel in that it helps students think about inclusion issues in STEM, science writing, and peer review, all of which are key disciplinary skills that are not always included in STEM courses. While this assignment was piloted in chemistry and environmental engineering courses, this assignment could easily be modified for other disciplines.
-
Abstract
The pandemic of 2020 forced many instructors to reevaluate their teaching and assessment practices. Assignments and assessments designed for face-to-face classes were quickly adapted to go online. Faculty-to-student relationships built through classroom interactions were transformed by the mediation of online platforms. At the time, the co-authors of this article were teaching different psychology courses at different institutions. However, we had similar concerns about the validity of our assessments in an unmonitored online environment and about maintaining personal connections with our students. We used the summer of 2020 to reimagine how our courses could be adapted to this new environment while satisfying specific learning goals, including demonstrating the ability to apply content knowledge and communicating scientific information through writing. To meet these challenges, we implemented a variation on authentic assessments. We replaced our exams with an assignment where students created artifacts of various forms to demonstrate what they had learned and how it connected to their future careers, personal interests, or real-world problems. They also had to include a written description for a non-expert audience to demonstrate their ability to explain their artifacts. This manuscript presents our rationale, requirements, assignments, grading rubrics, student feedback, and reflections on our experiences.
-
Preparing Reflective Practitioners: The Feedback Analysis Assignment for Writing Pedagogy Education ↗
Abstract
This essay describes a project in which graduate students who teach college writing and are enrolled in a composition practicum for first-year graduate student instructors (GSIs) reflect on their own practice of responding to student writing. To complete the project, students first write feedback in response to one of their first-year writing students’ writing projects, then (with student identifiers removed) the GSI annotates or otherwise analyzes their own feedback by answering reflection questions about their approach, what they admire about their written comments, and how they might revise their approach moving forward. This project helps writing instructors engage with assessment as reflective praxis, particularly in first-year writing contexts where instructors—in this case, GSIs—may be new to the practice of responding to student writing.
-
Abstract
AbstractThe rhetorical figure of speech called prolepsis, describing a presaging of time and events to come, commonly appears in environmental communication and importantly frames the possibilities for action. Prolepsis is a figure employed in communication about climate change that demands attention in its various deployments, configurations, and, importantly, rhetorical inducements. Such inducements may rely upon feelings of hope or fear, and this study investigates the rhetorical and ethical conditions prolepsis may generate. A considerable literature studying the concept of hope offers great insights into climate change perceptions and behavior concerning climate action. The present study examines prolepsis to discuss how the figure's inducement of suasive effect through appeals to hope and fear shape the ethical horizons for action. We examine media coverage of the IPCC's sixth report, Part I, warning of the enormous impacts of the ongoing climate emergency and necessary climate action to mitigate the worst of these effects. Additional informationNotes on contributorsAshley Rose MehlenbacherAshley Rose Mehlenbacher is Canada Research Chair in Science, Health, and Technology Communication at the University of Waterloo and the author of On Expertise (Penn State UP) and Science Communication Online (Ohio State UP). She is also the inaugural Co-Director, with Donna Strickland, for the Trust in Research Undertaken in Science and Technology (TRuST) network.Carolyn EckertCarolyn Eckert is a Ph.D. Candidate in English Language and Literature at the University of Waterloo. Her research investigates the ethotic construction of experts during the COVID-19 pandemic. She also teaches at Conestoga College and in the Humber College School of Business.Sara DoodySara Doody is a Postdoctoral Fellow in Knowledge Integration at the University of Waterloo where she investigates climate change communication and transdisciplinary collaboration between science and philosophy. Her research examines written communication in science and higher education and inter-/transdisciplinary communication and collaboration.Sarah ForstSarah Forst is a graduate psychology student at the University of Cologne and a research assistant in the Department of Research Methods and Experimental Psychology. She was a Mitacs Global Link intern in Summer 2021 at the University of Waterloo.Brad MehlenbacherBrad Mehlenbacher is Professor of Rhetoric and Communication in English Language & Literature at the University of Waterloo in Canada. Mehlenbacher is author of the NCTE award-winning book, Instruction and Technology: Designs for Everyday Learning (MIT Press), co-author of Online Help: Design and Evaluation (Ablex).
-
Lógos, éthos i pathos w komunikacji w biznesie. Na przykładzie metody Assessment Center/Development Center ↗
Abstract
Artykuł podejmuje zagadnienie obecności argumentacji typu lógos, éthos i pathos w biznesowych schematach konwersacyjnych. Zaprezentowano metodę Assessment Center/Development Center (AC/DC) jako przykład podejścia do komunikacji w biznesie (na linii przełożony–pracownik), w którym uwzględnia się tę retoryczną triadę. Przykładem obrazującym tę metodę jest schemat rozmowy oceniającej zmierzającej do ewaluacji dotychczasowej pracy oraz zmotywowania pracownika do rozwijania swoich umiejętności i podnoszenia kwalifikacji. Na początku wprowadzono ustalenia terminologiczne odnoszące się do klasycznej triady lógos, éthos, pathos. Następnie omówiono, czym jest komunikacja biznesowa, a czym komunikacja w biznesie. Uwzględniając różnice między komunikacją zewnętrzną oraz wewnętrzną, omówiono metodę AC/DC jako przykład skutecznego kierowania komunikacją wewnętrzną firmy. Przedstawienie schematu rozmowy oceniającej (związanej z udzielaniem konstruktywnych informacji zwrotnych oraz stosowaniem praktyk motywacyjnych, inaczej zwanych wzmacniającymi) pozwoliło wskazać wytyczne, zgodnie z którymi powinna ona przebiegać.
-
Abstract
Learning how to write occluded genres is an elusive task (Swales, 1996) – even more so in the case of students writing in a second or additional language. To achieve discourse competence in the use of one of these genres, in this case the ‘statement of purpose’ typical of post-graduate programme admission forms, it is first necessary to fully understand its features at both the macrotextual and microlinguistic levels (Gillaerts, 2003; Bhatia, 2004). This qualitative study focuses on the writing of learners of Spanish as an additional language to analyse whether feedback provided by peers impacts the quality of the statements of purpose they write. Through a dual discourse analysis of their written work and in-class interactions during peer- feedback sessions, our study finds that, when properly trained and using tailored assessment tools, students can use peer-assessment profitably to improve the quality of their statements of purpose, as well as to acquire appropriate metalanguage to guide others. Our results thus reconfirm the beneficial effects of helping students to achieve feedback literacy.
-
Beyond literacy and competency – The effects of raters’ perceived uncertainty on assessment of writing ↗
Abstract
This study investigated how common raters’ experiences of uncertainty in high-stakes testing are before, during, and after the rating of writing performances, what these feelings of uncertainty are, and what reasons might underlie such feelings. We also examined if uncertainty was related to raters’ rating experience or to the quality of their ratings. The data were gathered from the writing raters (n = 23) in the Finnish National Certificates of Proficiency, a standardized Finnish high-stakes language examination. The data comprise 12,118 ratings as well as raters’ survey responses and notes during rating sessions. The responses were analyzed by using thematic content analysis and the ratings by descriptive statistics and Many-Facets Rasch analyses. The results show that uncertainty is variable and individual, and that even highly experienced raters can feel unsure about (some of) their ratings. However, uncertainty was not related to rating quality (consistency or severity/leniency). Nor did uncertainty diminish with growing experience. Uncertainty during actual ratings was typically associated with the characteristics of the rated performances but also with other, more general and rater-related or situational factors. Other reasons external to the rating session were also identified for uncertainty, such as those related to the raters themselves. An analysis of the double-rated performances shows that although similar performance-related reasons seemed to cause uncertainty for different raters, their uncertainty was largely associated with different test-takers’ performances. While uncertainty can be seen as a natural part of holistic ratings in high-stakes tests, the study shows that even if uncertainty is not associated with the quality of ratings, we should constantly seek ways to address uncertainty in language testing, for example by developing rating scales and rater training. This may make raters’ work easier and less burdensome.
-
Abstract
Peerceptiv is a peer assessment tool developed by learning sciences researchers to help students demonstrate disciplinary knowledge through writing feedback practices. This review of Peerceptiv describes its key features while comparing it with other writing feedback tools and suggesting possibilities and limitations of using it to support AI-based online writing assessment across the disciplines. Future considerations regarding the use of Peerceptiv in assessing, teaching, and researching online writing are discussed.
-
Wicked Problems in Risk Assessment: Mapping Yellow Fever and Constructing Risk as an Embodied Experience ↗
Abstract
In this article, the author theorizes the process that a World Health Organization work group used to update yellow fever risk maps published in the Yellow Book, a handbook created by the Centers for Disease Control and Prevention for international travelers, from a “wicked problems” perspective. She argues that using this model highlights the complexity of nonexperts’ risk assessment practices in this context and that the work group's decision to create vaccination maps demonstrates an increased awareness of the embodied decision-making practices that nonexperts perform, aligning with and contributing to the growing emphasis on creating user-centered risk information that can be seen in some risk communication.
June 2023
-
Abstract
<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Background:</b> Fluent and accurate speaking is an essential set of skills that engineering students strive to achieve, as they can lead to better job placement and a promising future. This article documents a speaking assessment carried out among 120 engineering students who have undergone two semesters of Technical English courses in the final year of their study. The students from diverse departments opted for the English for Competitive Exams elective course to improve their English language proficiency. The objective of the elective is to train the learners in essential language components for facing high-stakes competitive exams with an integrated language skills approach. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Literature review:</b> This linguistics-focused study documents a cluster strategy, a pedagogical attempt at speaking, with a culminating self-reflection phase. The strategy cluster was thoughtfully designed and integrated throughout the semester to enhance the students' speaking competency. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research questions:</b> 1. How do learners perceive the effectiveness of speaking skills practice given to them in the online sessions? 2. What benefits through feedback have learners achieved during these sessions? 3. How do students perceive the role of self-directed efforts toward improving their speaking skills? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methods:</b> Students were trained on speaking skills as part of a semester-long online course, and an assessment for speaking skills was designed in which students answered 10 self-reflective questions about their perception and usefulness of practice, feedback from the instructor and peers, and self-directed efforts. Each student's recorded audio file of an average of 11 minutes 24 seconds was uploaded to the learning management system (LMS) as part of the assessment. A qualitative and interpretative investigation of their answers reflecting their learning experiences during the semester, based on the activities and self-regulation, and their self-rating were analyzed thematically. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results and discussion:</b> The findings of the metainvestigation show significantly valuable insights with potential implications on the language teachers’ perception of teaching speaking skills in the classroom, especially in the current online environment. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusions:</b> We conclude that using the strategy cluster comprising practice, feedback, and self-directed efforts with a culminating phase of oral self-reflection is highly beneficial in developing speaking skills in engineering courses focusing on technical communication.
-
Work descriptions written by third-graders: An aspect of disciplinary literacy in primary craft education education ↗
Abstract
This study focuses on disciplinary literacy in primary craft education. Disciplinary literacy refers to the specialised ways of reading, writing, and speaking in a particular discipline. In Finland, crafts is an obligatory school subject, and pupils are supposed to conceive and manage a complete crafts process, including documentation. However, disciplinary literacy in crafts has rarely been studied, let alone at the primary level. In this study, we explored the quality of a sample of work descriptions produced by third-graders. The data included digitally produced work descriptions (N=79) written by 42 third-grade pupils in a Finnish primary school. Based on a qualitative analysis, six main dimensions of work descriptions as a textual genre emerged: word count, crafts vocabulary, structure, spelling, multimodality, and self-assessment. The quality of work descriptions was analysed quantitatively according to scoring criteria based on these dimensions. A cluster analysis indicated that there were three groups of work descriptions with respect to their level of disciplinarity: limited, emerging, and advanced descriptions. The results show that the structure of the disciplinary texts develops first, and subject-specific vocabulary stabilises after that. The paper discusses the foundation for disciplinary literacy in primary craft education.
-
Abstract
Digital communication and digital oratory have become an integral part of today’s workplace. This research discusses an innovative assessment tool that uses digital oratory and digital video along with YouTube to create opportunities for the students to develop self-efficacy in digital oratory and public speaking. The measurement of the effectiveness through a survey questionnaire displays that the assessment tool met its learning objectives. The assessment tool fostered self-efficacy in digital oratory and improved digital communication knowledge and skills. The article also discusses the challenges and recommendations for implementing this assessment tool in various contexts.
May 2023
-
Abstract
This qualitative study explores how writing is conceptualised by teachers within the context of the primary National Curriculum and statutory writing assessment in England. The 10 participating teachers were drawn from nine primary schools and were interviewed about writing and writing assessment in year 6. Ivanic’s discourses of writing were used as the basis of a thematic analysis framework, which focussed on teachers’ perspectives and opinions. Findings showed that reference to the creative and skills discourses were most dominant within the teachers’ viewpoints; however, they also showed alignment to other discourses. Many of the teachers’ views were at odds with the National Curriculum and statutory writing assessment and this is discussed in relation to the tensions and conflict this created in pedagogy, attitudes, and assessment.
April 2023
-
Abstract
This article applies Kenneth Burke’s concept of piety to an evaluation of nine recovery stories from members of four different 12-step fellowships. In this theoretical context, recovery can be explained as a process of adopting and remaking pious systems. All nine recovery stories follow a similar pattern: (1) identifying difference and similarity in the community; (2) letting go of old pieties; (3) adopting group piety; and (4) inventing and remaking individual systems of piety. This analysis investigates how individual and group pieties interact to strengthen or threaten individual recovery and group cohesion.
-
Abstract
Rhetoric Re-View was established under the founding editorship of Theresa J. Enos and has been a feature of Rhetoric Review for over twenty-five years. The objective of Rhetoric Re-View is to offer review essays of prominent works that have made an impact on rhetoric. Reviewers evaluate the merits of established works, discussing their past and present contributions. The intent is to provide a long-term evaluation of significant research while also introducing important, established scholarship to those entering the field. This Rhetoric Re-View essay examines the long-term importance and impact of the 1982 MLA volume The Rhetorical Tradition and Modern Writing edited by James J. Murphy.Dedication: This Rhetoric Re-View essay is dedicated to the memory of James J. Murphy, who edited The Rhetorical Tradition and Modern Writing and, in addition to his impressive scholarship, served for many years on the editorial board of Rhetoric Review. Professor Murphy was 98 years old when he passed away shortly before Christmas 2021.
-
The design and cognitive validity verification of reading-to-write tasks in L2 Chinese writing assessment ↗
Abstract
Reading-to-write (RTW) tasks have been commonly employed in second language (L2) English academic writing pedagogy, and many studies have investigated the validity and reliability of RTW tasks in L2 English writing assessment. Meanwhile, few studies have examined the cognitive validity of RTW tasks, and the design and validation of such tasks in L2 Chinese academic writing assessment remain underexplored. This study develops a Chinese RTW task following a set of design criteria and procedures and evaluates its cognitive validity as an instrument of L2 Chinese academic writing assessment. The RTW task was administered to 15 undergraduate and 15 postgraduate L2 Chinese learners in an eye-tracking laboratory. Analyses of the task features and the eye-tracking and stimulated recall interview data suggested that the RTW task largely aligned with the characteristics of authentic tasks in real L2 Chinese academic writing contexts and elicited a representative range of cognitive processes in existing models of RTW cognitive processes. Many of these processes manifested in different ways between the two groups of participants at different L2 Chinese proficiency levels. Our findings have useful implications for understanding the cognitive validity of the RTW task in L2 Chinese writing assessment.
-
Genre pedagogy: A writing pedagogy to help L2 writing instructors enact their classroom writing assessment literacy and feedback literacy ↗
Abstract
As part of a larger case study, this single exploratory case study aims to explore the potential of genre-based pedagogy (GBP) to allow L2 writing instructors to enact their writing assessment literacy and feedback literacy. The findings demonstrate that GBP afforded the participating writing instructor of a genre-based EAP writing course to carry out effective writing classroom assessment practices and thus enact their2 writing assessment literacy and feedback literacy. GBP allowed effective writing classroom assessment practices such as diagnostic assessment and learner involvement in assessment. More specifically, genre exploration tasks led to diagnostic assessment and helped the instructor coordinate effective classroom discussions to elicit evidence of the students’ knowledge of the target genre that they would study. Second, students’ production of texts in target genres not only allowed the instructor to collect evidence of the students’ specific genre knowledge, but it also afforded learner involvement through self-reflection. The instructor could also efficiently interpret this evidence and provide formative feedback through pre-established genre specific assessment criteria.
-
Lecturer, Language Tutor, and Student Perspectives on the Ethics of the Proofreading of Student Writing ↗
Abstract
Various forms of proofreading of student writing take place in university contexts. Sometimes writers pay freelance proofreaders to edit their texts before submission for assessment; sometimes more informal arrangements take place, where friends, family, or coursemates proofread. Such arrangements raise ethical questions for universities formulating proofreading policies: in the interests of fairness, should proofreading be debarred entirely or should it be permitted in some form? Using questionnaires and semistructured interviews, this article investigates where three university stakeholder groups stand on the ethics of proofreading. Content lecturers, English language tutors, and students shared their views on the ethics of various lighter-touch and heavier-touch proofreader interventions. All three parties broadly approved of more minor interventions, such as correcting punctuation, amending word grammar, and improving sentence structure. However, students were found to be more relaxed than lecturers and language tutors about the ethics of more substantial interventions at the level of content. There were outliers within each of the three groups whose views on proofreading were wide apart, underscoring the difficulty of formulating proofreading policies that would attract consensus across the academy. The article concludes by discussing the formulation and dissemination of appropriate, research-led proofreading guidelines and issues for further exploration.
-
Prompting Reflection: Using Corpus Linguistic Methods in the Local Assessment of Reflective Writing ↗
Abstract
We report on a college-level study of student reflection and instructor prompts using scoring and corpus analysis methods. We collected 340 student reflections and 24 faculty prompts. Reflections were scored using trait and holistic scoring and then reflections and faculty prompts were analyzed using Natural Language Processing to identify linguistic features of high, middle, and low scoring reflections. The data sets were then connected to determine if there was a relationship between faculty prompts and scores. Additional analysis was completed to determine if there was a relationship between scores and students’ GPAs. The corpus linguistics analysis showed that higher-scoring reflections used words that referred to the self, the writing process, and specific rhetorical terms. Additional analysis showed student GPAs did not correlate with holistic scores but that higher scoring reflections were from faculty who included learning goals on reflective writing prompts. Results suggest that teachers can de-mystify reflective writing by linking learning outcomes to textual tasks and that corpus linguistics methods can provide an understanding of how local learning goals are transmitted to students.
-
Examining the Impact of a Cognitive Strategies Approach on the Argument Writing of Mainstreamed English Learners in Secondary School ↗
Abstract
The stagnation of National Assessment of Educational Progress (NAEP) Writing scores demonstrates the need for research-based instruction that improves writing for all students, especially English learners. In this article, we synthesize the literature on effective instructional practices for this diverse group of learners and describe how these strategies are leveraged in a teacher professional development program that has been previously shown to improve students’ argument writing. Then, we share results of a study that focuses on distinct subgroups of secondary English learners students to (a) determine their needs and challenges and (b) examine the impact of a cognitive strategies approach on rhetorical and linguistic aspects of writing at posttest. Results show English learners have considerable challenges with higher-order tasks involved in writing literary arguments and with the linguistic demands of academic writing before receiving the intervention. However, after receiving the intervention, using descriptive statistics and multiple hierarchical linear regression, we show that these students grew in the areas of presentation of ideas, organization, evidence use, and language use. For example, students designated as reclassified English learners (RFEP [Reclassified Fluent English Proficient]) and students who have even more limited English proficiency (designated as EL [English learner] here) show improvements in many aspects of writing, especially in their ability to write claims and use evidence. In contrast, improvements in language use components were more limited for both groups of learners. Moreover, some of the gains due to being in the treatment were significant enough to bring the average EL student close to parity or beyond their EO (English Only) / IFEP (Initial Fluent English Proficient) peers in the control condition at posttest. We conclude by discussing pedagogical implications for English learners.
March 2023
-
Efficient measurement of writing knowledge with forced-choice tasks: Preliminary data using the student knowledge of writing tests ↗
Abstract
Much of the research that has examined the writing knowledge of school-age students has relied on interviews to ascertain this information, which is problematic because interviews may underestimate breadth and depth of writing knowledge, require lengthy interactions with participants, and do not permit a direct evaluation of a prescribed array of constituent knowledge elements. For these reasons, our goal in this study is to report the development, piloting, and field testing, using a sample of 335 students from grades 4 and 5, of four alternate versions of a writing knowledge assessment—the Student Knowledge of Writing Test (SKOWT)—that uses forced-choice responses to evaluate students’ knowledge of writing processes, genre elements, and linguistic features of written language. All versions of the SKOWT demonstrated adequate internal consistency reliability and construct validity based on exploratory factor analyses following deletion of some items. In addition, there was acceptable predictive criterion validity based on associations of SKOWT scores with subtests from the Test of Written Language-4 and measures of narrative, opinion, and informative essay quality. We discuss how the SKOWT might be used in future research and educational practice.
-
Abstract
<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Introduction:</b> 360° videos are increasingly popular channels for science communication and higher education; however, time-limited 360° videos that disseminate scientific research via platforms like YouTube remain underexamined. To address this problem, this experience report reviews the creation and evaluation of six 2D video interviews and six 360° video tours. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">About the case:</b> The European Commission's Joint Research Centre (JRC) and other public-facing organizations already publish 2D videos on social media channels and host 360° video content on their institutional websites. This case addresses the affordances and constraints of creating short 360° videos for publication on public-facing platforms. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Situating the case:</b> 360° video content has been incorporated into science communication and pedagogical practices in higher education. The authors review these developments and show the need for further research on time-limited 360° video. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methods/approach:</b> Scientists researching energy-related technologies were invited to record 2D video interviews. Based on these interviews, six transcripts for 360° videos were drafted and recorded in the same lab settings. When the videos were published, European researchers and communication professionals were recruited to complete a short survey evaluating the videos’ relative merits. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results/discussion:</b> The survey results (n = 32) suggest a similar overall quality of the 2D video interviews and 360° video tours. Respondents ranked the interviewee or narrator as the best feature of both the 2D and 360° format, and 47% said that they would prefer to have a 360° video created about their research. Based on our experience, we provide guidelines related to the production and publication of short 360° videos. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusion:</b> Further research and practice are required to understand which specific features of the 360° videos are most effective and whether this technology offers distinct advantages as a tool for dissemination. Further research and practice will establish more detailed approaches to 360° video.
-
Abstract
The late Ghanaian poet, Professor Kofi Awoonor, compared the discourses that govern the affairs of this world to the stickiness of chameleon remains. For Awoonor, when one steps into the chameleon's gluey byproduct, it is difficult to wipe it off.1 This imagery represents the rhetorical potency of capitalism, its affective circulation, and how its influence over our lives makes it challenging to emancipate ourselves from the grips of market forces. For Catherine Chaput, the market is a powerful rhetorical force. The market's inherent trait to habituate our experiences means when “we place our faith in this all-knowing construct, we displace our own agentive powers” (2). In Market Affect, Chaput critiques capitalism with the conviction that other anticapitalist critiques could not dislocate the “affective circuits” of capitalism (18). Taking on Michael McGee's challenge to rhetoricians to investigate the link between rhetoric and social theory, Chaput rethinks affect to explain how we might unmask, demystify, and challenge capitalism by reclaiming human rhetorical agency.Since market forces obscure the exploitative powers of capital and have “fused with the energetic power of affect . . . thinking and acting,” anticapitalist discourses, Chaput asserts, constantly find themselves trapped and subsumed by procapitalist discourses (29). Chaput believes scholars are increasingly frustrated with the impotence of prevailing ideological analyses that sought to help us avert the influence of capitalist instincts in our lives (28). Chaput presents affective rhetorical critique as a paradigm in this endeavor. Affective critique, Chaput argues, empowers scholars to locate the “agentive capacity in our traditional rhetorical theories, enhance it with contemporary materialist perspectives, and develop a practice through which to glimpse, and later engage, the affective sensibilities” (18-19). Affect operates as an “organic power” (29); it is not a “theoretical abstraction or an illuminating metaphor, but a concrete, physiological force circulating into, and out of bodies through their sensuous interaction in the world” (30). Through affective critique, Chaput offers scholars new ways of discerning liberatory strategies against the aegis of capitalism.Chaput explains how procapitalists exploit the potency of affective desires to illustrate how capitalism operates and its ramifications for society. For Chaput, in the same way capitalism became an impregnable force, so is the principle that could derail its strategic maneuvers. Chaput rereads the rhetorical traditions of the classical, medieval, and enlightenment periods and exposes how forces of enlightenment crippled the affective resonances of rhetoric. In recovering this lost rhetorical power, according to Chaput, scholars ought to account for the omissions of the affective dimensions in the traditional rhetorical discipline and the “non-agentive impersonal operations that function so inconspicuously as to bleed into the natural background of life activities” (23). Chaput claims this notion of affect “has existed alongside and underdeveloped within” the rhetorical tradition (23). To convalesce this lost critical framework, Chaput's affective critique seeks to “expand and augment, rather than displace” rhetorical theory's valorization of the Aristotelian conceptualization of rhetoric. Across four chapters, Chaput reviews how economic theorists from Adam Smith and Karl Marx to Milton Friedman and John Galbraith “intuited and engaged the living power . . . of affect” in their positions for and against capitalism (37). In the final chapter, Chaput weaves their arguments and brokers them with Foucault's work on biopolitics and neoliberalism, packaging Foucauldian ideas as the most formidable salvo on capitalism.In chapter two, Chaput stitches the conflicting epistemologies of affect in Adam Smith's analysis of capitalism and Karl Marx's critique of capital. Chaput reasons that Smith and Marx are primarily immortalized as the “founding fathers” of discourses involving two opposing political systems—capitalism and socialism. Considered the father of capitalism, Smith postulates the “invisible hand” doctrine to account for the circulation of capitalist desires. For Marx, capitalism alienates us from our agentive powers. While both understood that labor, not commodities or gold, is wealth, they proposed “differing conceptions of the power structure propelling human relationships” (39). Smith sees the market as a natural force that represents traditional designations of affect. For Smith, capitalism pulls us into the market and constitutes us just as nationalism transforms us into nation-states. This way, the market's “invisible hand” directs societal and human affective desires.For Marx, an empowering agent exists internal to human beings, and capitalism works because of commodity fetishism— the ability to transfer a specific human power into things. Power circulates among people and things, orienting human decision-making. Affect is depleted through exploited labor because capital is “a process of coercive labor that traps naturally fluid lie energies or affect, within commodity form” (57). Capitalism depletes our personal power because commodities transform our “creative, energetic social beings into mechanical, lifeless, individual beings” (57). For Marx, “affect is that which adds value to life, and it is the essence or the core of our being as humans to participate in such value-adding activities” (46). Chaput observes that “for Marx, capitalism closes people off, making them less and less receptive to social potentialities; it repels or pushes away identities other than capitalist and worker; it depletes life energy of both identities, making them mere caricatures of capital” (57). In effect, our sensory capacities are subsumed by capitalism.In chapter three, Chaput examines how John Maynard Keynes and Thorstein Veblen's divergent but resonant thoughts fail to provide a robust framework for rethinking the problems of capitalism. A fundamental defect in their thinking is their valorization of rationality. Chaput realizes that the two shared many thoughts on the interconnectedness of the global market and the illogical human behaviors that drive economic attitudes. Capitalism, for Keynes, is global, but individual sympathies are national. In this case, “affect circulates locally while capitalism functions globally, forging a gap between our inner feelings and the outer reality of economic operations” (68). Keynes substitutes the “perfect invisible hand” with “imperfect visible arguments and grounds the need for greater economic deliberation among the public” (74). Veblen, likewise, believes in argumentation but not an explicit role. While Marx allows us to see how language produces a dominant ideology, Veblen extends this assessment to commodities. Because humans have little capacity to “outwit capitalism,” Veblen classifies workers as change agents (85). Both Keynes and Veblen neglect capitalism's affective dimension, which renders their theorizations inadequate to account for how affect circulates.In the immediate post–World War II environment, Frederick Hayek and Theodore Adorno turned their attention to the epistemic consequences of affect. They critiqued the scientific rationality logic as governing human decision-making processes. For Hayek, a rationally managed capitalist state, as envisioned by Keynes, produces poverty akin to modern-day slavery. “Managed capitalism” weakens individuals and does not allow for the assertion of human agency. Adorno rejects the persuasive force governing human desires, extending Marx and Veblen with Freud by realigning affect with rationality (97). Hayek vindicates the “self-regulating nature of capitalism, while Adorno discounts the “role of nonrational motivation” of “administrative society” to emancipate itself (91). As Chaput observes, Hayek envisions the market as working through our sensory orders clandestinely or unconsciously. As a result, we participate in capitalist orientations without realizing its corrosive maneuverings. For this reason, Adorno recommends “aesthetic interventions” that shock us out of our slumber (111). Instead of engaging in active “political and economic questions of the day, individuals turn to mass-produced entertainment, channeling their entire libidinal energies into consuming practices” (111). Chaput reasons that Hayek seems to be endorsed by recent democratic engagements even though he espouses and orients us toward antidemocratic tendencies.Chapter five addresses Milton Friedman's (pro-capitalist) and John Kenneth Galbraith's (anticapitalist) meddling with the politics of the right and left. Although these scholars are not economists by training, they offer perspectives on capitalism's pervasive power. Chaput's reading of them stamps the rhetoric of inquiry—reiterating the need to have rhetorical scholars import interdisciplinary literature into our critical projects. Friedman postulates that, guided by historical forces, “human behavior, particularly within nation states—functions with a high degree of consistency and requires an equally consistent monetary policy to maintain market stability” (114). Galbraith locates reality in contemporary political economy, consumer culture, long-term planning, and the transition from an industrial to a knowledge economy, creating a “corporatized marketplace” (114). Friedman believes in rational choice, while Galbraith sees corporate power as the most important way to think about human decision-making. Chaput argues that Galbraith's postulations appear overstated since they leave unexplored “anticapitalist discourse bound to a false binary between rational and irrational” (137).In the concluding chapter, Chaput details what she considers the most formidable confrontation of capitalism. Relying on Foucault's late lectures on biopolitics and neoliberalism, Chaput recognizes that procapitalist discourses appropriate the “affective force corralling human behavior before and alongside rationale decision making” (137). For Foucault, procapitalists maintain a superior “rhetorical edge” because they rely on a theory that combines the complexity of physiological effects and the discourses that govern humans. This understanding, Chaput maintains, prompts procapitalists to envision humans as subject to the market's governing rationality. Consequently, the market's “superior” affective sensibility inoculates it against critiques that ignore its affective dimensions and operations. Chaput reasons that anticapitalist offerings must consider humanity's thought-making processes and our natural instincts. Chaput directs us to the Foucauldian praxis that unlocks an unceasing resistance to capitalist governmentality. She believes a “free to choose” doctrine with a grounding in “courageous truth-telling,” or parrhesia, is potent to reconstitute and reinvent the governing praxis of our lives (150). Admitting that capitalist governmentality is impervious to “rhetorical deliberation” (142), Foucault's doctrine permits us to locate the “persuasive power of modern political economy in the market's invisible vitality” (144). Through it, we might see the formation of human agency as a “continuous ontological becoming” that must be orchestrated from within (144).Chaput concludes that the Foucauldian praxis is rooted in Greco-Roman practices of individual governance based on the apparatus of the “care of the self” and the desire to dissect the relationship between power, subjectivity, and discourse. This perspective is to create a confluence between “subject formation, bodily instinct, and truth” (150). Chaput states that “whereas biopolitics reflects the indirect manipulation of predictable instinct-driven bodies, care of the self consciously realigns automated bodily responses so as to oppose institutional injustice through the eruption of parrhesia or courageous truth-telling” (150). For Chaput, parrhesia's discursive apparatus grants agency and transcends courageous truth-telling to “adherence to a particular lifestyle designed to cultivate the kind of person who could “spontaneously confront injustice” (154). Through this attunement, we can distinguish bad parhessiates from good parhessiates. The telos of Chaput's call is “to produce people compelled to confront injustice even at the risk of retribution, requiring a practice of everyday life that constantly adjusts one's knowledge, behavior, and instincts” (157). Parhessiates, Chaput continues, identify as “sociopolitical and economic critics” even in the face of strict opposition (157). As cynics, parhessiates identify with all humanity and act altruistically. Chaput charges critics to “assess the persuasive work of our bodily instincts . . . to invent an alternative affective milieu . . . to assert newly cultivated agencies, ones simultaneously empowered by our conscious and unconscious choice” (159).Chaput's intervention comes at a time of global conflict: the Israeli-Palestinian strife, Russian occupation and aggression, movements and surges for #MeToo, #BlackLivesMatter, #Anti-racism, and the curricula of critical race theory. Chaput nudges scholars of rhetoric to examine the various affective circuits governing public debates. We might, for example, look to scholars and activists such as Ales Bialiatski, Cornel West, Nikole Hannah-Jones, etc. Specifically, attention to parrhesia charges media organizations and those in positions of power to give attention to vernacular discourses and ideas that dislodge oppression. Market Affect emphasizes that criticism of governing ideas goes beyond examining popular cultural products, innovations, and authoritative discourses. Market Affect prompts us to deconstruct the ideas that underlie and govern our world. Chaput prepares us to decipher and challenge the organizing force of human society and the creation of ideal material worlds that better serve the human commons.
February 2023
-
Abstract
The idea that engineers are graduating without the necessary communication skills, specifically written communication, is not new. In the past 25 years, changes have been made both in accreditation requirements and in engineering program curriculums to work to improve students’ writing skills and make their writing better align with the needs of industry, and research is emerging that considers industry standards and how those standards can be applied to the classroom. One challenge is that the characteristics of quality writing are not always the same for the industry and the classroom, which can create problems for new graduates entering the workforce. This article looks at how effective writing is defined by both academics and professional engineers. Drawing on a study by Cunningham & Stewart (2012), which researched the criteria professional engineers consider essential in effective writing, this article provides the results of a survey of instructors of introductory professional and technical writing classes. The survey was designed to determine the characteristics the instructors use when grading writing assignments. The results are then compared to the characteristics of quality writing as identified by the engineers. In addition, the article reviews assessment rubrics to identify criteria used when evaluating writing and compares these criteria to the qualities of effective writing as determined by the Analytic Writing Continuum, part of the National Writing Project. After determining gaps between industry and academics, the article considers ways to bridge those gaps, including working with professional engineers to obtain sample documents, increasing reading and evaluation of engineering documents in professional and technical writing classes, and using interdisciplinary approaches to course design and instruction.
-
How Prior Information from National Assessments can be used when Designing Experimental Studies without a Control Group ↗
Abstract
National assessments yield a description of the proficiency level in a domain while accounting for differences between tasks. For instance, in writing assessments the level of proficiency is typically evaluated with a variety of topics and multiple tasks. This enables generalizations from specific tasks to a domain. In (quasi-)experimental research, however, writing skills are often evaluated with a single task. Yet, conclusions about the effectiveness of the treatment are formulated on the level of the domain, which is, euphemistically put, quite a stretch. Although conclusions drawn about the effect of the treatment are specific to the task administered, they are often generalized to the domain without any form of reservation. This raises the question whether we can use the results of national assessments about differences between tasks in the analyses of experimental studies. In this paper, we demonstrate how the information of a baseline data set can be used as a kind of control condition in the analysis of an experimental study.
-
Abstract
Drawing on critical theories of labor and commodification, this qualitative embedded case study explores how students experience alienation and intimacy in the work of writing for an English language arts class. Analysis of fieldnotes from 30 observations, student writing products, and reflective interviews with focal students and the teacher illuminated the meaningful assemblages where conditions of intimacy permeated instruction. Two practices supported intimacy in working conditions: knowledge about writing built through a collective process of noticing, and open-ended work time characterized by “managed nonmanagement” (, p. 176), or calculated flexibility in rules and expectations. Findings illustrate how a literacy practice might contribute to students’ experience of alienation or intimacy (or both) while writing, depending on conditions of industrialization and commodification. Even as the teacher strove to deindustrialize work, commodification through grades and standardized assessments heightened alienation in the writing environment. The study provides an example of an educational context governed by an industrial system of assessment where local actors (the teacher and students) disrupted alienation by working in smaller scales and more closely with texts.
January 2023
-
Abstract
The study explored six ESL university students’ behavioral, cognitive, and affective engagement with e-rater feedback on local issues and examined any changes in students’ engagement over two weeks. We explored behavioral engagement through the analysis of screencasts of students’ e-rater usage and writing assignments. We measured cognitive and affective engagement by analyzing students’ comments during the think-aloud protocol and reflection surveys. The findings indicated that the students had varying levels of engagement with the feedback. Behaviorally, all students used a range of revision operations to address errors based on the provided feedback. Cognitively, some students were more engaged than others. Affectively, students experienced both positive and negative reactions toward e-rater feedback. While some students’ engagement with feedback did not change over two weeks, others’ engagement grew more negative. We conclude that e-rater feedback could positively impact students’ accuracy in local aspects of writing if students are actively engaged with the feedback.
-
Abstract
AbstractThis article recounts the experience of moving an in-person literature class online at the start of the COVID-19 pandemic. Drawing comparisons between the novel Mrs. Dalloway, which the class was reading at the time, and the experience of the early days of the pandemic, the piece outlines how the exigencies of the pandemic led to revised teaching and assessment practices.
-
Abstract
Abstract This article introduces a grounded theory of assessment in literary studies. Analysis of instructor interviews elucidates the cultural and dispositional influences that shape some instructors’ conscious decision not to teach or assess affective learning outcomes like empathy. The author urges literature instructors to engage critical inquiry of disciplinary assessment practices.
-
Abstract
Scrum is an increasingly important project management framework that has had limited study in technical communication (TC) and TC classrooms. While research has found student collaborations to be both frustrating and challenging, it has found Scrum to be a scaffolding framework that can improve student interactions and outcomes. Therefore, to determine whether Scrum affects the peer assessments of collaborative teams as well as project grades, this quasi-experimental classroom study compares the midproject and postproject peer assessments and grades of advanced TC students who used Scrum as a framework for collaboration against those students who did not use Scrum in their collaborations. The study found that students who used Scrum rated their team members significantly higher on some peer assessment measures and earned significantly higher grades than did those students who did not use Scrum. Additionally, students in the Scrum protocol reported satisfaction with their group experience broadly but did not report satisfaction with Scrum itself.
2023
-
Abstract
Motivation interconnects with many aspects of a student’s higher education journey; a student’s goals, self-efficacy, interests, and prior experiences affect their level of motivation and engagement in a writing center session. This primer discusses the multidimensional nature of motivation and its relation to identity. Through an exploration of the literature, the author designed a heuristic called the Writing Motivational Assessment Pathway (MAP). This tool focuses on understanding students’ motivations, engaging students more in their writing process, and encouraging their development as writers. The five components of the Writing MAP—identity, beliefs, perceptions, context, and interactions—work toward understanding a student’s motivational profile and pairing strategies that connect with each student. This article discusses how to identify students’ motivational habits through the Writing MAP to help students establish effective writing habits and foster self-regulation. This heuristic continues to be refined at the community college level.
-
Abstract
We write about a cultural rhetorics approach to writing center assessment at two different institutions where we think about assessment as everyday practice that enables us to tell multiple stories about our centers. We share how we create assessment committees within the center and collaboratively develop and revise assessment approaches and instruments, particularly with consultant input. Then, we discuss the various communities that inform and benefit from our assessments, including consultants, a broad range of writing center stakeholders, and writing center administrators. Assessment as everyday practice means that we are better informed and prepared when these constituents ask questions, make requests, or operate from (false) assumptions. We hope this view of assessment leads readers to build relationships with the individuals in their centers and universities in order to create assessments that matter in particular times and spaces as well as assessments that morph and change as the readers’ cultural communities change.
-
Abstract
Researchers have examined many strategies for instructor preparation, but the role of common textbooks has received little attention, despite Yancey listing them as an essential feature to consider in developing instructor preparation. This case study examines the impact of the custom common textbook on graduate and professional instructors in a First Year Writing program at a large Midwestern research university. Data were collected through a survey, focus groups, and interviews with instructors, as well as interviews with textbook authors. I found that although instructors varied widely in their use of the text, it did contribute to instructor preparation by influencing choices of content and awareness of program culture and values, especially for experienced instructors. Although additional instructional preparation measures are necessary for new instructors, common textbooks should not be ignored in research and assessment of instructor preparation strategies.
-
Accidental Outreach and Happenstance Staffing: A Cross-Institutional Study of Writing Center Support of First-Generation College Students ↗
Abstract
First-generation students (FGS) make up a significant percentage of college populations. However, they experience hardships that are less common for their continuing-generation peers. They struggle to understand the “rules” of college and lack the cultural capital that can help students succeed through generations of knowledge about how to navigate college. Writing centers attempt to lessen these burdens by providing outreach to marginalized student populations, including FGS. However, there has been a lack of cross-institutional research that examines exactly how writing centers support FGS. This article presents a mixed-methods study that begins to close that knowledge gap and demonstrate common patterns of FGS support across institution types in the United States. Results show that most FGS support is “accidental” and highly context-specific, which makes measuring success difficult. The results of this study also show that tutor staffing and training play a significant role in FGS support and should be further researched in writing center studies. The author argues that we need to do more assessment of our outreach and its outcomes for FGS, going beyond our narratives of what does or does not work for marginalized students.