All Journals
1472 articlesNovember 2018
-
Abstract
This paper discusses implementation of blog writing as a formative assessment within a final year undergraduate module. Drawing on students’ perceptions and experiences, it proposes that blogging offers a more inclusive writing genre for Higher Education than traditional forms of academic scholarship.
October 2018
-
Abstract
Graduate students often encounter obstacles related to written science communication that can set them back in their path towards degree completion. Efforts to support these students should be informed by what they actually need or desire; yet oftentimes, programs are developed based on assumptions or intuitions. In other cases, proven models from literature are used to develop programs; however, due to a lack of justification for approaches and vague descriptions of daily teaching and learning activities, the intricacies of design are relatively unknown. Thus, in institutes looking to establish research writing resources or build on existing infrastructure, more research is needed to demonstrate how needs assessment can directly transfer to program development. In this paper, I describe how findings from a campus-wide needs assessment of graduate students (N = 310) and faculty (N = 111) informed the development of design principles for a week-long dissertation writing workshop. The complete description of the intervention, including how main elements and content align with socio-cognitive perspectives to writing, can facilitate replication; theory building; and communication about effective writing instruction. This work also offers a springboard for future research and program development and establishes a blueprint.
-
Describing multifaceted writing interventions: From design principles for the focus and mode of instruction to student and teacher activities ↗
Abstract
To enable a proper evaluation of the results of writing interventions for scientific replication and theory building, it is of vital importance that the design principles underlying an intervention and operationalization thereof are clearly described. A detailed description of a writing intervention is also important from a practical point of view, to foster dissemination and successful implementation of the intervention into practice. In this paper we propose a framework for reporting on the design principles of multifaceted intervention programs in a systematic manner. Unique features of this framework are that we (1) separate the design principles for the focus and mode of instruction, (2) systematically describe how these principles are integrated and operationalized into learning and teaching activities, (3) systematically describe the professional development teachers need to be able to execute the teaching activities. We demonstrate how this framework can be applied, with a worked example of an intervention that we designed, implemented and tested in elementary schools in the Netherlands. The framework provided in this paper makes core features of writing interventions transparent to reviewers, other scholars, and educational practitioners, and warrants that an intervention includes all necessary elements in the most optimal way. Moreover, this type of framework facilitates the comparison of interventions across contexts and countries.
-
Abstract
This article dwells on the “I” who arrives in the university classroom by offering an earnest assessment of the vulnerabilities that one teacher-scholar of African American literature and culture brings with her into the classroom. Observations unfold by way of a critical, reflexive engagement with theories of haunting and Toni Morrison's novel Beloved, in order to account for some of the roots and routes, histories and inheritances, that call this I into being.
September 2018
-
Abstract
The teaching of composing strategies is acknowledged to be an important area in writing instruction and test preparation. This study presents a small set of data originating from a larger project which investigated the composing strategies reported by 30 international postgraduate students. These students were in their second year of university study and had all volunteered to attempt the TOEFL-iBT writing test. Immediately after completion of each task, they were interviewed about the way they had understood the requirements of the tasks and the processes and strategies they had used in order to complete them. All the students had successfully obtained entry to university and were functioning satisfactorily in their current areas of study, yet the scores they achieved in the TOEFL writing assessment showed considerable variation. Surprisingly, some were well below the benchmark for university entry. In order to investigate this, we revisited and reanalysed the interview data gathered from the three top and three bottom scorers, and examined similarities and differences in the way they approached and undertook the task. The high scorers' goals for task completion focused on the product as well as the process, and in contrast to the low scorers their monitoring strategies involved interaction with the emerging text. While we acknowledge that actual differences in language proficiency may have been partially responsible for the different scores, in this paper we explore the possible role of strategy choice, and we consider implications for test preparation teaching and writing instruction in general.
-
Abstract
This case study uses an action research approach to the implementation of a systematic bilingual writing assessment that K-5 teachers administered over a two-year period in an inner-city public school with a two-way bilingual English-Spanish program. The study reflects the importance of developing an awareness of academic discourse over time, as teachers participated in a writing assessment project that included the administration of writing prompts and corresponding analysis of student writing through use of grade level rubrics, three times each year. The instrument was developed by the first author, a participant-observer who in the role of writing coordinator also led professional development workshops, and provided mentorship to teacher participants. The second researcher is an outside expert on bilingual writing who participated in the retrospective interview stage of the study. This paper will focus on insights from semi-structured interviews with teachers that reveal their current views on aspects of the writing assessment project. The questions prompted teachers to review the rubrics and associated assessment materials to garner insights about their participation in the assessment project. Thematic analysis of the interviews indicates that teachers enhanced their awareness of discourse structure and the writing process, as they incorporated the rubrics for several pedagogical purposes: more targeted whole group instruction, strategic and flexible grouping of students, and more deliberate selection of topics to support writers during individual conferences. Furthermore, teachers appreciated the ability to systematically track writing growth across the academic year, an option that had formerly been used solely for documentation of reading development in this setting. The influence of standards in providing goals for instructional outcomes is also discussed. Changes in the form of assessment are unlikely to enhance equity unless we change the ways in which assessments are used: from sorting mechanisms to diagnostic supports; from external monitors of performance to locally generated tools for inquiring deeply into teaching and learning, (Darling- Hammond, 1994: 7)
-
Abstract
Dominant stories and narratives are violent: They disregard and erase the humanity of so much of the world, with some of us emerging as the dis/figured and inept beings that can, and, apparently, should, be used; our bodies, our spirits, and our lives too easily made into the waste of the world. That making of humans into non-humans happens in all kinds of material ways and through a seemingly never-ending spate of cultural and political practices—colonial histories, immigration policies, labor practices, control of land, extermination—all of which are not just cultural and political, but instead are fundamentally and materially discursive. It is to this force of dominance that Darrel Wanzer-Serrano’s book, The New York Young Lords and the Struggle for Liberation, intervenes. Advancing a decolonial rhetoric, Wanzer-Serrano takes rhetorical scholars to the complexities of violent narratives and the force of community resistance in his astute assessment of the New York Young Lords and their refusals to submit. His compelling account of the violent narratives surrounding Puerto Ricans makes this point quite clear: “Puerto Ricans were reduced in the popular imaginary and official histories to a caricature, a shell devoid of humanity, an image that was more a reflection of the attitudes of the colonizer than of the people themselves” (33).Given that dehumanized account, Wanzer-Serrano writes a book that asks and answers this compelling question: “Given a history of consciousness regarding Puerto Ricans that was … thoroughly racist and colonialist, how ought we proceed?” (33). Across the book, the answers he offers assess how Puerto Ricans wrote their own histories and futures. At the same time, his larger response, if not your imperative, is dual, and it is this: love and listen. To be fair, Wanzer-Serrano names the book’s primary intervention like this: I argue for a rethinking of democracy rooted in decolonial heterogeneities that keeps open the terrain for political contestation, features commitments to racial and gender justice, is guided more by liberation than by recognition, and empowers people to be engaged political subjects who exhibit epistemic disobedience by delinking from coloniality and rejecting neoliberal hegemonies. (27)Still, as I read through the book, it was love and listening that came together. Consider this frame of the project: “it is a commitment to finding ways to listen to others’ literal and metaphorical voices and to allow such listening to have its full, transformative effects on subjectivity” (127). That argument comes together most powerfully in chapter 4, where Wanzer-Serrano turns to the Young Lord’s “garbage offensive.” The garbage offensive, an instrumental move designed in part to simply clean the streets, became a much more comprehensive move, “a remarkable rhetoric about the decolonial ethos and ethics of [Puerto Ricans’] agency” (134). It’s here, in this analysis, that we can see listening and loving as ethics of both scholarship and activism, for what Wanzer-Serrano makes clear across the book is that the Young Lords intervened, made change, and reconstituted identity, politics, and community through their listening and loving.Wanzer-Serrano’s book raises numerous questions. What are the implications of the turn to decoloniality for scholars (like me) who remain pretty firmly centered in nation-states and race? And for rhetorical scholars more generally? How might we think de-linking outside of decoloniality? Can we? But perhaps the big question that this book raises is this: What would it mean for critical race rhetoricians to write within a love-and-listen framework? I see three critical mandates from this work for critical race rhetoricians. The first is that agency—so critical to Wanzer-Serrano’s project—has to be centered in much critical race rhetorical scholarship. As Wanzer-Serrano reminds us in the conclusion, this work teaches us much about the Young Lords but the bigger contribution lies in “what can be learned from the Young Lords” (167).In his emphasis on the voices, writings, and practices of the Young Lords and with his commitment to decoloniality, Wanzer-Serrano theorizes agency between the abstract and the concrete, always attentive to the histories, the people, and the locales. He advances a theory of rhetorical agency that we would do well to take up. What would it mean to rethink agency along the lines of what Wanzer-Serrano names “body-political modes of theorizing and acting in the world” (13)?If the first key mandate is a vigorous assessment of agency in critical race rhetorical work, a second lies in the discussions of the tensions between identity politics and politics that emerge out of identities. More specifically, Wanzer-Serrano’s project raises questions that we would do well to engage. What does it mean to build anti-essentialist identity politics? What are the other models of anti-essentialist identity politics? If we wanted to continue to theorize anti-essentialist identity politics, where would we begin? How do we make possible moments in which we name our identities, hold them, while also not being reduced to them or constrained by them? Here, Wanzer-Serrano’s turn to Kelly Oliver and response-ability is crucial, in part for the way response-ability, as Wanzer-Serrano argues, “generated the space where gendered subjectivity could become something, where subjectivity could begin to emerge as a set of practices oriented around an ethic of love built on witnessing to one another” (97). There is something in witnessing, something in stopping to see, to hear, to feel, that has potential.A final mandate of The New York Young Lords is the implicit call for more emphasis in our work on relationality. Certainly, relationality does not figure explicitly in the book as centrally as agency; still, it does drive the analysis. Here, I’m thinking relationality as informed by the work of Natalia Molina, in her argument for racial scripts; by that of Alexander Weiheyle, in his turn to racialized assemblages; and by Lisa Lowe, who reminds us that the many raced and colonial violences “are imbricated processes, not sequential events; they are ongoing and continuous in our contemporary moment, not temporally distinct nor as yet concluded” (7). What these folks make so clear is that we cannot think race, colonialism, dispossession, the nonhuman or less-than-human, in isolation. We cannot think just of the body, nor can we forget the body, nor just think here, but also there, not just in the moment, nor just in history.So how do we move forward? We write and think in spaces and voices of vulnerability and connection. This book—a first in our discipline—challenges all of us to attend to modernity and coloniality and our implication in it.
-
‘It’s Hard to Define Good Writing, but I Recognise it when I See it’: Can Consensus-Based Assessment Evaluate the Teaching of Writing? ↗
Abstract
In a Higher Education environment where evidence-based practice and accountability are highly valued, most writing practitioners will be familiar with direct requests or less tangible pressures to demonstrate that their teaching has a positive impact on students’ writing skills. Although such evaluations are not devoid of risk and the need for them is contested, it can be argued that it is better to engage with them, as this can avoid the danger of overly simplistic forms of measurements being imposed. The current paper engages with this question by proposing the conceptual basis for a new measurement tool. Based on Amabile’s Consensual Assessment Technique (CAT), developed to assess creativity, the tool develops the idea of consensual assessment of writing as a methodology that can provide robust data through systematic measurement. At the same time, I argue consensual assessment reflects the evaluation of writing in real life situations more closely than many of the methodologies for writing assessment used in other contexts, primarily large scale tests. As such, it would allow writing practitioners to go beyond ethnographic methods, or self- reporting, in order to obtain greater insight into the ways in which their teaching helps change students’ actual writing, without sacrificing the complexity of writing as social interaction, which is fundamental to an academic literacies approach.
-
Abstract
Acknowledging students’ and instructors’ desires for grades as affective carriers of achievement, belonging, and identity can move us beyond ideals of socially just assessment, making space for decolonizing action and explorations of how the classroom community and the field grapple with the dissonance between being a writer and being a student.
-
Abstract
While writing center scholarship has explored useful methods for helping the university-level English language learner (ELL) as well as the high school writer, there is little scholarship examining how writing centers can serve the high school ELL population. While university students must succeed in their university classes, high school students in 42 states must succeed within the Common Core English Language Arts classroom. The differing requirements between the two make it important to focus on the specific needs of peer writing tutors working with high school English language learners. This article applies Stanford University’s Understanding Language Initiative’s “Six Key Principles for ELL Instruction” to the high school writing center as a means of facilitating peer tutors to help the ELL writer with Common Core-based writing assignments. Each principle is examined in turn to consider the ways each intersects with previous writing center scholarship to help the high school English language learner. Keywords : high school writing centers, Common Core, English language learners Writing center scholarship has explored fruitful practices for helping non-native English speaking students at the university level (Bell & Youmans, 2006; Blalock, 1997; Bruce & Rafoth, 2009; Chiu, 2011; Enders, 2013; Nakamaru, 2010; Nan, 2012; Powers, 1993; Vallejo, 2004; Weirick, Davis, & Lawson, 2017). A growing number of resources seeks to provide guidance for the high school writing center director (Ashley & Shafer, 2006; Childers, 1989; Fels & Wells, 2011; Tobin, 2010; Upton, 1990). However, no such examination has been made of best practices for helping English language learners (ELL) in their high school writing center. While existing scholarship on both university non-native English writers and the high school writer can be applied to the ELL high school writer, an added complication for high school ELLs exists in the form of the Common Core English Language Arts Standards. Rather than achieving university requirements, high school ELL students in 42 states (and in a growing number of English-medium secondary schools in other countries) must succeed within the Common Core classroom. The differences between university requirements and the requirements of the Common Core make relying on existing writing center scholarship inadequate. For example, with the narrow exception of remedial classes, many writing requirements at the university level assume students have mastered the kinds of writing skills students learn in high school. While Common Core writing skills are meant to prepare students for university, high school students command only emergent skills in these areas. English language learners contend with even greater challenges, as many do not possess the language skills that their university counterparts have had to prove through entrance exams like the TOEFL. Therefore, targeted, specific guidelines regarding the high school ELL tutoring session are needed to help this demographic make greater academic gains. Currently, only one article outlines the connection between the high school writing center and the Common Core English Language Arts Standards (Horan, 2015), and it does not address ELL students’ specific needs. With 4.6 million non-native English speakers in public schools across the United States (National Center for Education Statistics, 2017), not to mention the 40% increase in the last five years in the number of English-medium high schools across the globe, many of which are beginning to adopt a U.S. curriculum (Morrison, 2016), supporting ELLs with Common Core-based writing assignments is imperative. As the director of a writing center serving a population of 100% ELLs in an English-medium high school in Guangzhou, China, that adheres to the Common Core State Standards, I have asked myself how my tutors can best help their clients. To address this gap in knowledge within my own writing center, I applied research from Stanford University’s Understanding Language Initiative, synthesized in a document entitled “Six Key Principles for ELL Instruction” (Stanford Graduate School of Education, 2013). These six principles are guidelines that seek to help instructors plan their curriculum in a way that allows language learners to access Common Core-based content at the same time they build English language competency. Figure 1 below lists the six principles, and the article then continues with a consideration of several strategies that high school writing center peer tutors who serve ELL students—within the U.S. or abroad—can use to alleviate some of their biggest challenges as they implement the six principles in their sessions. Principles One and Two have proven to be the least challenging to implement in the writing center. Principle One indicates that classroom instruction ought to give ELLs the opportunity to talk about discipline-specific topics and concepts in English so as to build both understanding of the content area and understanding of the English language simultaneously. Principle Two advises instructors to use ELLs’ home language, culture, and background knowledge to build off of what students already know, thereby providing them with a firm foundation on which to construct new knowledge. The nature of writing center work has meant that in its simplest form, tutors help clients build both content and language knowledge by talking about an assignment in English. Likewise, because my tutors are Mandarin speakers, they can easily leverage clients’ home language by speaking Mandarin as necessary, a practice already shown to be effective in the writing center (Ronesi, 2009) and which U.S. directors can implement by recruiting multilingual writers from within their schools. I have found the principles that most challenge my tutors are Three through Six. Principle Three states that instruction should put scaffolds in place to help ELLs reach grade-level standards (Donato, 1994; van Lier & Walquí, 2012). In a 2014 article, John Nordlof notes that there are two fundamental types of scaffolding that occur during writing center sessions, those of cognitive scaffolding and those of motivational scaffolding. In cognitive scaffolding, the tutor helps the clients discover problems on their own. Examples of this kind of tutor talk are prompting students with open-ended questions, responding to essays as a reader, and demonstrating a concept, among others (Mackiewicz & Thompson, 2014, p. 68). In motivational scaffolding, the tutor helps to create a supportive learning space for clients. Examples of this kind of tutor talk include showing concern for the client, praising a client, showing sympathy or empathy, and reinforcing a client’s ownership of their essay (Mackiewicz & Thompson, 2014, p. 71). To help scaffold our own clients in the ways mentioned above and thereby implement the third principle, I train tutors to employ each of these methods during their sessions. The real challenge for our tutors’ ability to scaffold, however, comes in knowing which of these methods to use and when to use it. To help our students make these decisions, my co-director and I developed a flow chart (Figure 2) that we post in the writing center. Tutors can refer to it as their sessions unfold so that they can make appropriate scaffolding decisions. As tutors and clients then engage in conversations between real readers and writers, clients receive reinforcement when they do well and empathetic guidance where they fall short. In so doing, tutors can effectively implement the third principle to scaffold students to achieve the next level of competence toward full proficiency in the standards. While scaffolding students, whether through cognitive or motivational methods, can lead students to success, knowledge of students’ previous experiences are equally as important to aiding clients. In considering background knowledge, Principle Four is twofold: It states that instruction should “[move] ELLs forward by taking into account [both] their English language proficiency level(s) and prior schooling experience” (Stanford Graduate School of Education, 2013). Because I work in a Chinese writing center, where all students speak Mandarin but learn English, we have the advantage in that our tutors share the same home language as their clients. To meet the first injunction, then, that of taking the language ability of clients into account, I encourage the tutors to use Mandarin in their sessions as necessary, as mentioned under Principle Two (Ronesi, 2009). However, Principle Four helps tutors to be thoughtful and intentional about when to use Mandarin and when to use English with their clients. To help tutors make these kinds of decisions, I guide discussions during training to help tutors understand the purposes that they have for using each language. Many of our students, particularly those in grades seven through nine, do not have the language proficiency to show the depth of thought required for their assignments. While certainly a challenge for these students, it also presents a challenge for our tutors, whose job is to help them overcome these kinds of hurdles. When they are helping a client of a lower English ability, it may be more helpful for the client to converse in Mandarin so that their thoughts can flow freely, uninhibited by an unfamiliar medium of communication. However, when the client is capable of expressing themselves with relative ease in English, it can be more helpful to hold a session in English for the same reason, to encourage a freer flow of thought than is able to happen when energy is spent translating ideas back and forth between the two languages. Following Peter Carino’s (2003) advice to take a more directive approach with inexperienced writers, I have trained tutors to use Mandarin more with younger learners (grades seven through nine), and English with more advanced learners (grades 10 through 12). An additional guideline I have given tutors is that if a client of any grade level seems unwilling or unable to engage very deeply in a conversation in English, switch to Mandarin to ensure that language is not the main barrier in conversation. Using Mandarin and English strategically in this way helps to support our students with one of their toughest challenges as language learners (Ronesi, 2009). For high schools in the U.S., the implication of this principle is that directors may find it helpful to prioritize finding multilingual tutors from within their student body. In addition to knowing how and when to use English or Mandarin to address the language needs of clients, tutors must also take into account the client’s prior formal education. For example, there is a difference between the way our students have been taught to write an essay in their Chinese public schools and the way Western academic readers will expect to read an essay. Because our students attend the school in order to prepare themselves to succeed in a Western academic environment, we must train tutors to address these differences. A basic understanding of contrastive rhetorical theory can aid us in this endeavor (Quinn, 2012). We take a direct look at some of the differences in the expectations between Western academic essays and Chinese academic essays during training, allowing tutors to take on a more directive role as is appropriate for working with language learners and as tutors who have more knowledge in the subject area (Carino, 2003; Nan, 2012). In their sessions, they can then say to a client, for example: Pointing out these differences is a way our tutors can address students’ previous academic formation. Conversely, our clients’ previous education can also serve as a well-aligned foundation to their current learning. Tutors can show the similarities between what they have been required to do before and what they are required to do for their present assignments. For instance, Chinese writing education has traditionally taught students to use others’ writings as a model and a scaffold for learning to write well. The citation of those words is not considered necessary in student writing (Chou, 2010, p. 38). This can result in what the North American academy considers plagiarism. To help their clients learn citation rules, our tutors can take what our students already know—that using someone else’s words can be useful to one’s own writing—and add to it the idea that in the West, one must give credit to the original writer for the use of those words. This kind of tutor talk uses the client’s knowledge of essay writing for one particular audience to help him be a more flexible writer who can reach audiences across cultures (Ede & Lunsford, 1984). These two strategies of intentionally noting both the differences and similarities between clients’ previous education and their current education helps our tutors to make use of what the client already knows. Principle Four does not require that tutors speak the same native language as their clients, and for that reason, it is easier to implement in U.S. high school writing centers than Principle Three. Writing center directors simply need to introduce their tutors to basic contrastive rhetoric in order to give them the tools they need to successfully implement Principle Four. While taking background knowledge and scaffolding methods into consideration during sessions, writing center tutors must also remember that the purpose for those strategies is to help the clients make independent choices in their writing. Principle Five encourages educators to foster their students’ autonomy by giving them strategies to understand and use language for their needs (Stanford Graduate School of Education, 2013). Writing centers can implement this principle by training tutors to let clients maintain control of their autonomy during a session. During tutor training, I make a point of reminding tutors to let the client hold the pencil (with the one exception being during a brainstorming session when it may be helpful for the tutor to have the pencil and write down the client’s ideas as they are speaking) (Bruffee, 1984; Clark, 1990; Cogie, 2001; Shamoon & Burns, 1995). For many students in both domestic and international settings who have been accustomed to a teacher-centered classroom, this can feel awkward at first (Nan, 2012) and has proven to be a stumbling block for my tutors, who automatically pick up a pencil when their sessions start. This may be to help themselves feel more confident, assuming the role of the authority figure they sometimes feel they need to be. Indeed, clients do come in expecting that they will be told what to write and how to “fix” their papers. However, with explanations for the reasons to hand over the pencil to the client, a visual reminder on the flow chart posted in the center to let the client hold the pencil, as well as increased self-efficacy after several sessions, tutors gradually become more comfortable in the role of a peer. They remember to hand over the pencil to the client at the beginning of a session, a sign and a symbol of handing the power over to the client. Another option may be to simply remove pens or pencils from the writing center, forcing clients to get out a pen or a pencil themselves. When clients are the ones writing the most, it, in effect, puts them in charge of the session, fostering their autonomy (Brookes, 1991). Reminders, both verbal and visual, can help reinforce this practice in our tutors so that ELL students have full autonomy over their learning. Finally, although writing center tutors want their clients to have autonomy and independence in their learning, writing centers are always necessary for writers of all levels to receive formative feedback. Principle Six states that teachers should use formative assessment to measure a student’s content knowledge and language competence (Stanford Graduate School of Education, 2013). In their article “Formative Assessment and the Paradigms of Writing Center Practice,” Joe Law and Christina Murphy (1997) highlight the ways that formative assessment and writing center theory intertwine. They write, “The almost century-long history of writing centers attests to an inquiry-based, individualized pedagogy directed toward the primary aims of formative assessment in providing in-process commentary that offers direction, guidance, and analytical critique to emerging writers” (Law & Murphy, 1997, p. 106). We can train our tutors to serve as a step in this process by being real readers who ask real questions of their clients’ essays. What parts do they find confusing? Where do they feel more information might be helpful? Has the writer satisfied all the reader’s doubts about the topic at hand? What parts does the reader find interesting, insightful, surprising, or particularly well said? This, in effect, helps the writer see what they have done well, plus where they can continue to improve, and is common writing center practice. Our tutors, however, were hesitant to implement these strategies due to their lack of self-confidence. Coming from an educational environment in which the teacher has always been seen as the center of authority and knowledge, our tutors found it difficult to believe that they had anything to offer their fellow students. They feared that if they read a student’s paper and felt confused, it was an indication that they as tutors were not smart enough or competent enough. This is another area in which contrastive rhetorical theory can be useful, specifically to talk about the differences between a reader-centric and a writer-centric culture. In some cultures, if a reader is confused, it is often an indication that the reader must spend more time pondering the writer’s thoughts. However, in other cultures, the tendency is the opposite. If readers are confused, it is an indication that the writer should explain more clearly (Connor, 2002). While contrastive rhetoric is more complicated than such brief explanations can fully present, an introduction to the idea can help our tutors to know that if they are confused, it is worthwhile to bring this to a client’s attention as a way of focusing the client on places of possible improvement. Such instruction has helped to give our clients more confidence in their ability to provide feedback, especially before they have the opportunity to develop the self-efficacy experience can provide. Tutors both in the U.S. and abroad may find themselves lacking the confidence to provide feedback for a variety of reasons, and an exploration of reader-centric and writer-centric cultures can help give tutors the confidence they need to provide astute, honest feedback to clients that provides the formative assessment so necessary to ELL academic success. As Common Core standards create expectations for college readiness that are ever more rigorous, students who must learn both English and the objectives of their content classes face heavy obstacles to success. Support from many areas is necessary to provide them an effective learning environment. The Six Principles help guide instruction in and out of the classroom so that ELLs can reach proficiency in the standards, and writing centers can play a significant role in supporting the implementation of the Six Principles at a school-wide level. With tutor training that comports with the Six Principles and gives tutors strategies to overcome challenges to their implementation, high school writing centers can offer a strong locus of support for ELLs, equipping them to participate and succeed in a Westernized, North American academic playing field.
July 2018
-
Functional Complexity and Web Site Design: Evaluating the Online Presence of UNESCO World Heritage Sites ↗
Abstract
Functional complexity is a widespread and underresearched phenomenon in Web sites. This article explores a specific case of functional complexity by analyzing the content of UNESCO World Heritage Web sites, which have to meet demands from both World Heritage and tourism perspectives. Based on a functional analysis, a content checklist was developed and used to evaluate a sample of 30 World Heritage Web sites. The results show that World Heritage Web sites generally fall short in all content categories. A cluster analysis reveals three types of World Heritage Web sites based on their emphasis on World Heritage content versus tourism content: (a) less well-developed Web sites (no emphasis), (b) Web sites of World Heritage Sites with touristic possibilities (emphasis on World Heritage), and (c) Web sites of touristic attractions with outstanding cultural or natural value (emphasis on tourism). In all, the findings show that functional complexity poses serious threats to the exhaustiveness of a Web site’s information and that evaluation approaches based on functional analysis can be useful in detecting blindspots in the content provided.
June 2018
-
Abstract
Contemporary reasoning about health is infused with the work products of experts, and expert reasoning about health itself is an active site for invention and design. Building on Toulmin’s largely undeveloped ideas on field-dependence, we argue that expert fields can develop new inference rules that, together with the backing they require, become accepted ways of drawing and defending conclusions. The new inference rules themselves function as warrants, and we introduce the term “warranting device” to refer to an assembly of the rule plus whatever material, procedural, and institutional resources are required to assure its dependability. We present a case study on the Cochrane Review, a new method for synthesizing evidence across large numbers of scientific studies. After reviewing the evolution and current structure of the device, we discuss the distinctive kinds of critical questions that may be raised around Cochrane Reviews, both within the expert field and beyond. Although Toulmin’s theory of field-dependence is often criticized for its relativism, we find that, as a matter of practical fact, field-specific warrants do not enjoy immunity from external critique. On the contrary, they can be opened to evaluation and critique from any interested perspective.
-
Abstract
This preliminary study examines the rating behavior of five composition and five ESL writing teachers while evaluating a text from a university-level non-native (L2) English speaking student. Using an eye tracker, we measured raters’ dwell times and reading behaviors across four areas of interest—rhetoric, organization, vocabulary, and grammar. Results indicate that raters with differing disciplinary backgrounds read the text differently. L2 writing teachers tended to spend more time on and re-read the rhetorical, lexical, and grammatical features of the text while skipping over more of the grammar errors, while composition teachers read the text more deliberately. The findings suggest L2 writing teachers were more prone to skim and scan for information on which to base a grade while composition teachers delayed rating decisions until after reviewing the entire text, which is corroborated in previous research. These findings can expand our understanding of how disciplinary background can influence rating processes, which can inform rater training procedures, especially in disciplinary writing contexts where L2 writing is judged by individuals with and without expertise in composition or second language writing. Moreover, it demonstrates the utility of eye-tracking methods to examine the cognitive processes associated with reading and scoring student writing.
-
Persuasion by numbers: How does numeral marking of arguments in bad news letters influence persuasion? ↗
Abstract
To what extent does numbering the reasons for a negative decision influence the persuasive force of the text? That is the focus of this study, in which we report an experiment (with 265 participants) wherein the direct effects and the indirect effects of numeral markings are analyzed in two linguistic contexts: in the introduction of the upcoming enumeration of reasons (the so-called ‘trigger’) and in the lead-ins of the successive reasons of the enumeration itself. The experiment was conducted within the framework of the Elaboration Likelihood Model (Petty and Cacioppo, 1984) and the Schematic Text Structural Expectations Hypothesis (Sanders and Noordman, 2000; Mulder, 2008). Adding numeral markers in both trigger and lead-ins turns out to enhance the persuasiveness of the text in several ways. It stimulates readers to elaborate more on the content of the reasons. It helps readers to scrutinize the reasons and stimulates recall, which contributes to a more balanced judgment. The markings also have a direct positive effect on persuasiveness, which points to an effect on low elaborating readers. Furthermore, inconsistent implementation of numeral markings (the combination of a numeral trigger with non-numeral lead-ins or a non-numeral trigger with numeral lead-ins) has a negative indirect effect on persuasiveness via text evaluation. This effect is explained by assuming that the Schematic Text Structural Expectations Hypothesis not only applies to text processing, but to text evaluation as well.
May 2018
-
Assessing Perspectivalism in Patient Participation: An Evaluation of FDA Patient and Consumer Representative Programs ↗
Abstract
Recent research in rhetoric of health and medicine (RHM) has worked to evaluate the effectiveness of patient inclusion initiatives in health policy decision-making. Extending this line of research, this article evaluates the extent to which the U.S. Food and Drug Administration’s (FDA) patient and consumer representative programs meaningfully engage patient experiences. In so doing, this study provides directed and summative content analyses of pharmaceuticals policy deliberation at 163 FDA drug advisory committee meetings. The results indicate that the current implementation of the patient and consumer representative programs do not adequately ensure that patient experiences are being included as a part of advisory committee deliberation or subsequent pharmaceuticals policy. Additionally, the results presented support the growing concern that attempts to include patient perspectives in health policy may actually further marginalize patient populations.
-
Abstract
The University of Oxford Press has recently published two books on rhetoric, Michel Meyer’s (Chaïm Perelman’s successor at the Université Libre de Bruxelles) What is Rhetoric and Martin Camper’s Arguing Over Texts. Meyer and Camper build from the writings of the ancient Greek and Roman philosophers and rhetoricians to develop the role of questions in rhetoric (Meyer) and stasis theory (Camper). That both books, published by one of the leading academic presses in the world, feature a recovery and a modern renovation of the rhetorical tradition marks a potentially exciting moment in the contemporary history of rhetoric. Camper’s book is but one of several illustrations of a renaissance in rhetorical history. Camper follows the line of argument set forth by Chaïm Perelman and Lucie Olbechts-Tyteca in their New Rhetoric Project and Douglas Walton in his “new dialectic.” They chronicle the origins, development, and fall of an ancient rhetorical concept and then engage in its restoration. Similarly, Martin Camper tells the history of the origins, development, and fall of stasis theory, creating as a result a compelling exigence for a “systematically, theoretically grounded method for understanding and analyzing patterns of interpretative disputes and how those disputes are resolved” (3).Camper has developed a new interpretative stasis that complements the new rhetoric and dialectic. He has, with success, revived “ancient rhetorical theory to think about and solve modern problems” (3). Toward this end, he has offered scholars of rhetoric a gift: a modern method of “understanding and analyzing patterns of interpretative disputes” (3). Camper has read the ancient Greek and Roman rhetoricians with care, calling on select passages from Aristotle, Cicero, Hermagoras, Quintilian, and other Greek and Roman rhetoricians to ground his new interpretive stases. Because the rhetorical problems humans face recur, as do rhetorical situations, the theoretical insights Camper draws from Aristotle’s Rhetoric, Hermagoras of Temnos’s On Stases: A Manual for Declamation, Cicero’s De Inventione, the anonymous Rhetorica ad Herennium, and Quintilian’s The Orator’s Education on stasis theory are strikingly relevant and helpful in the twenty-first century. Camper acknowledges the excellent work done by Fahnestock, Secor, and other modern scholars on stasis theory, building out of their contributions a truly novel system of six interpretative stases: AmbiguityDefinitionLetter versus spiritConflicting passagesAssimilationJurisdictionCamper’s illustrations of these interpretative stases are wide ranging, including a controversy involving climate-change scientists and the claim they had used deceitful practices; a truly insightful analysis of Jeremiah Wright’s sermons, which provoked significant controversy during Barack Obama’s campaign for the presidency; the Supreme Court ruling on gun control in District of Columbia v. Heller; a consideration of Phillis Wheatley’s poem “On Being Brought from Africa to America,” and others. His use of the interpretative stases introduced in Arguing Over Text to analyze critically passages from the Hebrew and Christian sacred texts stand out as exceptionally cogent. Camper’s new interpretative stases allow for sensitive and astute readings of these sacred texts, fulfilling his promise to provide a model of interpretative stases that effectively joins hermeneutics with rhetoric.Camper devotes chapters five and eight to an explanation of how his interpretative stases work using an extended illustration drawn from the Christian Bible. Passages from I Corinthians and II Timothy, Camper notes, are deployed by some within the Christian faith community to justify prohibitions against women preaching and speaking in church. Camper considers the outbreak of arguments between and among Christians about the meaning of these and other passages and explains how the stases of jurisdiction, ambiguity, definition, letter versus spirit, conflicting passages, and assimilation can be used to explain the interpretative disagreements. These interpretative stases “are ordered, with disagreements moving from jurisdiction, to ambiguity, and then definition, and finally to either letter versus spirit, conflicting passages, or assimilation” (165). The dispute within the Christian faith community over the role of women preaching and speaking in church is better understood as a result of Camper’s application of these ordered interpretative stases.Camper has a strong command of Christian theology and sacred texts, which allows him to trace with expertise the trajectories of the arguments. The arguments about women preaching and speaking in church he considers are those expressed by committed Christians who share a commitment to the authority of the Bible. Yet, because the passages in the Bible addressing the topic of women preaching and speaking elicit different interpretations in the Christian faith community, Camper’s stases constitute a taxonomy that describes and explains, but does not seek to judge, the disagreement. As Camper explains, the dispute takes place primarily within the “letter versus spirit,” “conflicting passages,” and “assimilation” interpretative stases.That members of the same faith tradition draw different interpretations from a shared sacred text underscores Camper’s wisdom in his claim that ambiguity “is the archetypal interpretative issue that readers face when they encounter a text: How does one decide between two or more competing readings of the same passage?” (16). The background, experience, and aspirations of those who interpret sacred scripture will significantly influence how the Christian Bible is understood, a point Camper develops. Humans will disagree about textual interpretations, even those with shared values and common texts, because they approach a communal text from different experiences and backgrounds to fetch out meaning of the same passage. There is, as a result, an essential and even a foundational ambiguity at the core of most sacred texts including the Bible and secular texts, like the US Constitution.Fortunately, Camper resist the temptation to view ambiguity as the ruling feature of textual interpretation. His interpretative stases can help those who must make judgments about conflicting interpretations of textual passages. Using the “letter versus spirit,” “conflicting passages,” and “assimilation” stases, the reader draws the conclusion from Camper’s neutral assessment of the arguments that the Apostle Paul in I Corinthians and II Timothy did not intend a full-scale prohibition of women preaching and speaking in church, that the spirit of Paul’s message on women is inconsistent with the particular passages cited by those who support a prohibition based on his words, and that there are passages in Paul’s letters that contradict and qualify the prohibitions found in I Corinthians and II Timothy.Camper stays true to his promise that he is “not interested in how one might arrive at a valid reading of a text … and does not offer a method for doing so” (11). The interpretative stases he offers are not “designed to offer a theory of proper reading practices,” and he provides “no normative judgments about the validity of any of the interpretations or supporting arguments offered in this book” (11). In Arguing Over Texts, Camper informs his reader that his book purposefully “sidesteps questions of valid interpretations” (11). While it is important to step back and sidestep questions of valid interpretations to understand how interpretative stases work, if Camper’s new interpretative stasis theory is to evolve beyond the goal of describing interpretative disagreements, it will need to step directly into questions of valid interpretations, normative standards, and issues of justice. To this end, the next step in the study of interpretative stases might be for Camper and other scholars of rhetoric to pair the wisdom of the ancients on stasis theory with contemporary research on argument and decision making. This might involve the research of Hugo Mercier and Dan Sperber on argumentation and reason, Daniel Kahneman and Paul Slovic on system-one and -two thinking, and Robin Gregory on structured decision making. This research provides insights on valid readings of texts, reaching normative judgments, and joining values to action. Regardless, Camper’s new interpretative stasis theory constitutes an important recovery and renovation of a key rhetorical concept.
April 2018
-
Flowcharts, Swimlanes, and Timelines: Alternatives to Prose in Communicating Legal–Bureaucratic Instructions to Civil Servants ↗
Abstract
Government-published documents often fail to communicate clearly—not only with citizens but also with professional readers such as civil servants. Visual or multimodal approaches remain rare. This is a particularly unhelpful practice in regard to legal–bureaucratic instructions (e.g., contracts, rules, policies), which exist to guide compliant behavior. This study explores the development and experimental evaluation of a diagrammatic guide of terms and conditions for public procurement that is addressed to civil servants. Results show that the diagrammatic format, compared to prose, significantly enhances comprehension accuracy and answering speed and is perceived as more appealing and functional by users.
-
Opportunities to Write: An Exploration of Student Writing During Language Arts Lessons in Norwegian Lower Secondary Classrooms ↗
Abstract
Research suggests that student development as writers requires a supportive environment in which they receive sustained opportunities to write. However, writing researchers in general know relatively little about the actual writing opportunities embedded in students’ language arts lessons and how students’ production of texts in class is framed. The present study analyzes 178 video-recorded language arts lessons across 46 secondary classrooms in Norway based on the Protocol for Language Arts Teaching Observation. Specifically, we assess how often and in what situations students get an opportunity to engage in writing or are explicitly encouraged to write. We found that some writing assignments are short and fragmented, especially when students are merely recopying information from teachers’ materials. However, our analysis also provides detailed insight into how some teachers facilitate sustained, genre-focused, and process-oriented writing opportunities. These are powerful examples of successful writing instruction, and they suggest that when Norwegian language arts teachers prioritize writing, the opportunities to write are both sustained and scaffolded, the purpose of writing is explicit, and genre-specific assessment criteria are often used.
March 2018
-
The eristic of newsworthiness in the representation of Barnevernet controversy: A case study of the Norwegian Child Welfare Service ↗
Abstract
This study offers a critical evaluation of news values by four selected contemporary media outlets: BBC News, The Federalist, OneEurope and Dagbladet. The material covers the controversy around the Norwegian Child Welfare Service with cases of children being taken away from their families, thus it involves cultural and legal aspects of the issue. The analytic categories are based on news value research guidelines that were introduced in the study by Johan Galtung and Mari H. Ruge (1965). In parallel, the philosophical reference is construed through the works by Artur Schopenhauer and Anton Powell. This, in turn, allows evaluating the language that construes newsworthiness from an eristic perspective. The study demonstrates how the eristic application of news values may influence the fair presentation of an issue, at least when a case is presented as involving a controversy. The focus is on the eristic tools of news value enhancement which lead to channeling consumers’ attention in a desirable manner.
February 2018
-
Effects of the Specificity and the Format of External Representations on Students’ Revisions of Fictitious Others’ Texts ↗
Abstract
University students are often challenged with the demand of providing cohesive explanatory texts. To support students in revising their explanatory texts with regard to cohesion, it could be useful to provide students with external representations as formative feedback. In this study, we provided participants with a scenario in which they were asked to review a fictitious student’s draft containing several cohesion gaps. Additionally, participants received an external representation as feedback to support them during their revisions. We varied the format (concept map versus outline) and the specificity (general versus specific) of the provided external representations. We found that participants with specific concept map representations correctly noticed more cohesion gaps, and perceived less cognitive load during reviewing than participants with the specific outline representation. Students with general external representations showed the lowest performance on the noticing task and the highest amount of cognitive load. However, there were no differences among the external representations regarding the quality of students’ revisions. Evidently, specific concept maps can be regarded as a useful scaffold to support students’ evaluation processes. However, additional instructional support is needed, particularly for novice writers, to effectively revise expository texts for cohesion.
January 2018
-
Abstract
This article outlines an approach to teaching a Writing for the Health Professions course and situates this approach within the aims of and tensions between the medical humanities, the rhetoric of health and medicine, and disability studies. This analysis provides a pragmatic walkthrough of how assignments in such courses can be linked to programmatic outcomes (with SOAP [Subjective, Objective, Assessment, Plan] note and patient education assignments as extended examples) as well as an interdisciplinary framework for future empirical studies.
-
Abstract
The Writing Mentor TM (WM) application is a Google Docs add-on designed to help students improve their writing in a principled manner and to promote their writing success in postsecondary settings. WM provides automated writing evaluation (AWE) feedback using natural language processing (NLP) methods and linguistic resources. AWE features in WM have been informed by research about postsecondary student writers often classified as developmental (Burstein et al., 2016b), and these features address a breadth of writing sub-constructs (including use of sources, claims, and evidence; topic development; coherence; and knowledge of English conventions). Through an optional entry survey, WM collects self-efficacy data about writing and English language status from users. Tool perceptions are collected from users through an optional exit survey. Informed by language arts models consistent with the Common Core State Standards Initiative and valued by the writing studies community, WM takes initial steps to integrate the reading and writing process by offering a range of textual features, including vocabulary support, intended to help users to understand unfamiliar vocabulary in coursework reading texts. This paper describes WM and provides discussion of descriptive evaluations from an Amazon Mechanical Turk (AMT) usability task situated in WM and from users-in-the-wild data. The paper concludes with a framework for developing writing feedback and analytics technology.
-
Abstract
Background: Current research in composition and writing studies is concerned with issues of writing program evaluation and how writing tasks and their sequences scaffold students toward learning outcomes. These issues are beginning to be addressed by writing analytics research, which can be useful for identifying recurring types of language in writing assignments and how those can inform task design and student outcomes. To address these issues, this study provides a three-step method of sequencing, comparison, and diagnosis to understand how specific writing tasks fit into a classroom sequence as well as compare to larger genres of writing outside of the immediate writing classroom environment. By doing so, we provide writing program administrators with tools for describing what skills students demonstrate in a sequence of writing tasks and diagnosing how these skills match with writing students will do in later contexts. Literature Review: Student writing that responds to classroom assignments can be understood as genres, insofar as they are constructed responses that exist in similar rhetorical situations and perform similar social actions. Previous work in corpus analysis has looked at these genres, which helps us as writing instructors understand what kind of constructed responses are required of students and to make those expectations explicit. Aull (2017) examined a corpus of first-year undergraduate writing assignments in two courses to create “sociocognitive profiles” of these assignments. We analyze student writing that responds to similar writing tasks, but use a different corpus method that allows us to understand the tasks in both local and global contexts. By doing so, we gain confidence and depth in our understanding of these tasks, analyze how they sequence together, and are able to compare argumentative writing across institutions and contexts. Research Questions: Two questions guided our study: What is the trajectory of skills targeted by the sequence of tasks in the two first-year writing courses, as evidenced by the rhetorical strategies employed by the writers in successive assignments? Focusing on the final argument assignments, how similar are they to argumentative writing in other contexts, in terms of rhetorical profiles? Methodology: We first conducted a local analysis, in which we used a dictionary-based corpus method to analyze the rhetorical strategies used by writers in the first-year writing courses to understand how they built on each other to form a sequence. Having understood what skills students are demonstrating in a course, we then conducted a global analysis which calculated a “distance” between the first-year argument writing and a corpus of argument writing drawn from other contexts. Recognizing that there was a non-trivial distance, we then identified and evaluated the sources of the distance so that the writing tasks could be assessed or modified. Results: The local analysis revealed eight key rhetorical strategies that student writing exhibits between the two first-year writing courses. With this understanding, we then placed the argument writing in global contexts to find that the assignments in both courses differ somewhat from argument writing in other contexts. Upon analyzing this difference, we found that the first-year writing primarily differs in its usage of academic language, the personal register, assertive language, and reasoning. We suggest that these differences stem primarily from the rhetorical situation and learning objectives associated with first-year writing, as well as the sequencing of the courses. Discussion: The three-step method presented provides a means for writing program administrators to describe and analyze writing that students produce in their writing programs. We intend these steps to be understood as an iterative process, whereby writing programs can use these results to evaluate what rhetorical skills their students are exhibiting and to benchmark those against the program’s goals and/or other similar writing programs. Conclusions: By presenting these analyses together, we ultimately provide a cohesive method by which to analyze a writing program and benchmark students’ use of rhetorical strategies in relation to other argumentative contexts. We believe this method to be useful not only to individual writing programs, but to assessment literature broadly. In future research, we anticipate learning how this process will practically feed back into pedagogy, as well as understanding what placing writing tasks into a global context can tell us about genre theory.
-
Abstract
Background: Over a decade ago, the Stanford Study of Writing (SSW) collected more than 15,000 writing samples from undergraduate students, but to this point the corpus has not been analyzed using computational methods. Through the use of natural language processing (NLP) techniques, this study attempts to reveal underlying structures in the SSW, while at the same time developing a set of interpretable features for computationally understanding student writing. These features fall into three categories: topic-based features that reveal what students are writing about; stance-based features that reveal how students are framing their arguments; and structure-based features that reveal sentence complexity. Using these features, we are able to characterize the development of the SSW participants across four years of undergraduate study, specifically gaining insight into the different trajectories of humanities, social science, and STEM students. While the results are specific to Stanford University’s undergraduate program, they demonstrate that these three categories of features can give insight into how groups of students develop as writers.Literature Review: The Stanford Study of Writing (Lunsford et al., 2008; SSW, 2018) involved the collection of more than 15,000 writing samples from 189 students in the Stanford class of 2005. The literature surrounding the original study is largely qualitative (Fishman, Lunsford, McGregor, & Otuteye, 2005; Lunsford, 2013; Lunsford, Fishman, & Liew, 2013), so this study makes a first attempt at a quantitative analysis of the SSW. When considering the ethics of a computational approach, we find it important not to stray into the territory of writing evaluation, as purely evaluative systems have been shown to have limited instructional use in the classroom (Chen & Cheng, 2008; Weaver, 2006). Therefore, we find it important to take a descriptive, rather than evaluative approach. All of the features that we extract are both interpretable and grounded in prior research. Topic modeling has been used on undergraduate writing to improve the prediction of neuroticism and depression in college students (Resnik, Garron, & Resnik, 2013), stance markers have been used to show the development of undergraduate writers (Aull & Lancaster, 2014), and parse trees have been used to measure the syntactic complexity of student writing (Lu, 2010).Research Questions: What computational features are useful for analyzing the development of student writers? Based on these features, what insights can we gain into undergraduate writing at Stanford and similar institutions?Methodology: To extract topic features, we use LDA topic modeling (Blei, Ng, & Jordan, 2003) with Gibbs Sampling (Griffiths, 2002). To extract stance features, we replicate the stance markers approach from a past study (Aull & Lancaster, 2014). To describe sentence structure, we use parse trees generated using Shift-Reduce dependency parsing (Sagae & Tsujii, 2008). For each parse tree, we use the tree depth and the average dependency length as heuristics for the syntactic complexity of the sentence.Results: Topic modeling was useful for sorting papers into academic disciplines, as well as for distinguishing between argumentative and personal writing. Stance markers helped us characterize the intersection between the majors that students hold and the topics that they are writing about at a given time. Parse tree complexity demonstrated differences between writing in different disciplines. In addition, we found that students of different disciplines have different syntactic features even during their first year at Stanford.Discussion: Topic modeling has given us a picture of interdisciplinary study at Stanford by showing how often students in the SSW wrote about topics outside their majors. Furthermore, studying interdisciplinary Stanford students allowed us to examine the intersection of a student’s major and current topic of writing when analyzing the other two sets of features. Stance markers in the SSW show that both field of study and topic of writing influence the ways in which students employ metadiscourse. In addition, when looking at stance across years, we see that Seniors regress towards their First-Year habits. The complexity results raise the question of whether different disciplines have different “ideal” levels of writing complexity.Conclusions: The present study yields insight into undergraduate writing at Stanford in particular. Notably, we find that students develop most as writers during their first two years and that students of different majors develop as writers in different ways. We consider our three categories of features to be useful because they were able to give us these insights into the dataset. We hope that, moving forward, educators will be able to use this kind of analysis to understand how their students are developing as writers.
-
Abstract
Background: The researchers conducted a corpus analysis of 548 research-based argument essays, totalling 1,465,091 words, written by first-year students at The City College of New York (CCNY). The purpose of this study was to better understand the ways in which CCNY students were constructing arguments in research essays in order to better support our instruction of the research essay. Curricular guidelines for the research assignment are general. Instructors are directed to require a research-based, persuasive argument that includes conflicting points of view. Model assignment sheets are provided to instructors, but they are free to write their own. Assignment sheets are not collected or approved. In the fall semester in which this corpus was collected, over 70 part-time instructors taught approximately 120 sections of the first- or second-semester composition course.Literature Review: The study of The City College of New York Corpus (CCNYC) partially replicates and relies on the analysis of three corpora of academic writing conducted by Zak Lancaster (2016a) in his examination of Gerald Graff’s and Cathy Birkenstein’s textbook They Say/I Say: The Moves that Matter in Academic Writing (2014). The current study also compares the CCNYC findings to studies of stance and voice markers frequency conducted by Ken Hyland (2012) and Ellen Barton (1993) and suggests the classroom use of corpus analysis as described by Raith Abid and Shakila Manan (2015), and Maggie Charles (2007).Research Questions: The study was guided by a narrowly-focused interest in learning whether or not the CCNYC would demonstrate the range and distribution of rhetorical moves that Lancaster found in his study of academic writing (2016a). The analysis of the corpus consists of frequency counts; we did not conduct other statistical analyses. Since we had little prior experience with corpus analysis, we wondered what would be revealed about students’ writing practices by a partial replication of Lancaster’s study. We did not reproduce Lancaster’s analysis but relied on his publised results. This study served as an assessment tool, providing a microscopic view of a limited number of rhetorical moves across a large corpus of student essays. As a result of our study, we hoped to be able to create assignments for research essays that responded directly to the patterns that we saw in our students’ essays.Methodology: Modeled on Lancaster’s study and the templates of rhetorical moves offered by Graff and Birkenstein, concordances of terms used to introduce objections, offer concessions, and make counterarguments were drawn from the CCNYC and then analyzed to confirm that the rhetorical form was in fact functioning as one of the above rhetorical moves within the context of the essay in which it was found.Results: Our study demonstrates that CCNY students use fewer linguistic resources than their peers at other institutions, a finding that helps shape faculty development seminars. The corpus analysis reveals that while CCNY students introduce objections to their arguments at about the same rates as in other corpora, they are less likely to concede to those objections. In addition, when students made counterarguments, they used only a limited range of the linguistic resources available to them.Conclusions: The low rate of engagement with opposing points of view and the limited use of linguistic resources for counterarguments all suggest the potential value of focused, corpus-based instruction.
-
Abstract
Background: Employing natural language processing and latent semantic analysis, the current work was completed as a constituent part of a larger research project for designing and launching artificial intelligence in the form of deep artificial neural networks. The models were evaluated on a proprietary corpus retrieved from a data warehouse, where it was extracted from MyReviewers, a sophisticated web application purposed for peer review in written communication, which was actively used in several higher education institutions. The corpus of laboratory reports in STEM annotated by instructors and students was used to train the models. Under the Common Rule, research ethics were ensured by protecting the privacy of subjects and maintaining the confidentiality of data, which mandated corpus de-identification.Literature Review: De-identification and pseudonymization of textual data remains an actively studied research question for several decades. Its importance is stipulated by numerous laws and regulations in the United States and internationally with HIPAA Privacy Rule and FERPA.Research Question: Text de-identification requires a significant amount of manual post-processing for eliminating faculty and student names. This work investigated automated and semi-automated methods for de-identifying student and faculty entities while preserving author names in cited sources and reference lists. It was hypothesized that a natural language processing toolkit and an artificial neural network model with named entity recognition capabilities would facilitate text processing and reduce the amount of manual labor required for post-processing after matching essays to a list of users’ names. The suggested techniques were applied with supplied pre-trained models without additional tagging and training. The goal of the study was to evaluate three approaches and find the most efficient one among those using a users’ list, a named entity recognition toolkit, and an artificial neural network.Research Methodology: The current work studied de-identification of STEM laboratory reports and evaluated the performance of the three techniques: brute forth search with a user lists, named entity recognition with the OpenNLP machine learning toolkit, and NeuroNER, an artificial neural network for named entity recognition built on the TensorFlow platform. The complexity of the given task was determined by the dilemma, where names belonging to students, instructors, or teaching assistants must be removed, while the rest of the names (e.g., authors of referenced papers) must be preserved.Results: The evaluation of the three selected methods demonstrated that automating de-identification of STEM lab reports is not possible in the setting, when named entity recognition methods are employed with pre-trained models. The highest results were achieved by the users’ list technique with 0.79 precision, 0.75 recall, and 0.77 F1 measure, which significantly outweighed OpenNLP with 0.06 precision, 0.14 recall, and 0.09 F1, and NeuroNER with 0.14 precision, 0.56 recall, and 0.23 F1.Discussion: Low performance of OpenNLP and NeuroNER toolkits was explained by the complexity of the task and unattainability of customized models due to imposed time constraints. An approach for masking possible de-identification errors is suggested.Conclusion: Unlike multiple cases described in the related work, de-identification of laboratory reports in STEM remained a non-trivial labor-intensive task. Applied out of the box, a machine learning toolkit and an artificial neural network technique did not enhance performance of the brute forth approach based on user list matching.Directions for Future Research: Customized tagging and training on the STEM corpus were presumed to advance outcomes of machine learning and predominantly artificial intelligence methods. Application of other natural language toolkits may lead to deducing a more effective solution.
2018
-
Abstract
This essay offers a review of Jay Dolmage’s Academic Ableism: Disability and Higher Education and Asao Inoue’s Antiracist Writing Assessment Ecologies: Teaching and Assessing Writing for a Socially Just Future with the intent of reminding composition instructors of the importance of intersectionality and accessibility. Each text encourages us to challenge traditional perceptions of success and failure thereby also interrogating imbalanced power dynamics between instructors and students particularly in regards to writing assessment and other pedagogical priorities. Finding ways to acknowledge difference, and affirm it, is vital to our collective success especially in the writing classroom.
December 2017
-
Abstract
Can argumentation schemes play a part in the critical processing of argumentation by lay people? In a qualitative study, participants were invited to come up with strong and weak arguments for a given claim and were subsequently interviewed for why they thought the strong argument was stronger than the weak one. Next, they were presented with a list of arguments and asked to rank these arguments from strongest to weakest, upon which they were asked to motivate their judgments in an interview. In order to assess whether lay people apply argument scheme specific criteria when performing these tasks, five different argumentation schemes were included in this study: argumentation from authority, from example, from analogy, from cause to effect, and from consequences. Laypeople’s use of criteria for argument quality was inferred from interview protocols. The results revealed that participants combined general criteria from informal logic (such as relevance and acceptability) and scheme-specific criteria (such as expertise for argumentation from authority, similarity for argumentation from analogy, effectiveness for argumentation from consequences). The results supported the conventional validity of the pragma-dialectical argument scheme rule in a strong sense and provided a more fine-grained view of central processing in the Elaboration Likelihood Model.
-
Abstract
Reviews Cristina Pepe, The Genres of Rhetorical Speeches in Greek and Roman Antiquity. International Studies in the History of Rhetoric 5. Leiden and Boston: Brill, 2013. xviii + 618 pp., ISBN: 978-90-04-24984-4 When I review a book that is of high quality, I like to read it twice before submitting the review. That does not excuse the inordinate length of time it has taken me to review Cristina Pepe's Genres of Rhetorical Speeches, for which I apologise to the author, but it immediately indicates my admiration for the book. I shall outline its contents, before making a few observations, all of which are offered in a constructive spirit. The book consists (suitably, given its theme) of three parts, followed by an extensive list of Testimonia, an Appendix, Bibliography, Index of Greek and Latin Terms, Index Locorum, and a General Index. Part One covers the fifth and fourth centuries, opening with an overview of the contexts of speechmaking in Greece and, of course, in particular Athens. Separate chapters address the practice of the Sophists (with an inevitable focus on Gorgias and the Helen, supplemented by observations on the ori gins of the praise speech); Thucydides (deliberative oratory, with an anal ysis of the Mytilenean Debate in Book 3); Plato (analyses of the Gorgias, Phaedrus and Sophist, and of Plato's conception of advice and praise); Isocrates (in particular how he defines his logoi); Demosthenes (his distinc tion between deliberative and judicial); and, in greater detail, the Rhetoric to Alexander (with a discussion of genres and species, and of the connected and complex ascription of the treatise to Anaximenes, without committing herself either way). Part Two is of roughly the same length as Part One, but focuses on one author only: Aristotle. Rhetorical development, including in the Rhetorica ad Alexandrian, all led to the Rhetoric, which for Pepe was Greek rhetoric's 'crowning theoretical achievement' (p. 123; I note that this repeats the earlier judgment of Laurent Pernot in the English translation of his Rhetoric in Antiquity, 'the crowning achievement of rhetorical theory in Classical Greece', p. 41), though the dates of composition of the Rhetoric to Alexander and the Rhetoric were not necessarily linear. Most will not quib ble with Pepe's concentration on the Rhetoric, even if we need to bear in mind Pernot's assessment that 'this treatise full of novel views was rela tively little read in antiquity' (Rhetoric in Antiquity p. 44). Pepe examines Rhetorica, Vol. XXXV, Issue 1, pp. 110-120. ISSN: 0734-8584, electronic ISSN: 1533-8541.© 2017 by The International Society for the History of Rhetoric. All rights reserved. Please direct all requests for permission to photocopy or reproduce article content through the University of California Press's Reprints and Permissions web page, http: / /www.ucpress. edu/joumals.php?p=reprints. DOI: https://doi.org/10.1525/rh.2017.35.L110. Reviews 111 the system of genres in the Rhetoric in minute and instructive detail, pay ing a great deal of attention to epideictic, which Rhetoric scholars agree Aristotle introduced 'as a genre in its own right' (p. 144), but also indicat ing the 'aspects of originality with respect to tradition' of his treatment of the deliberative genre (p. 159). Very helpful chapters on the different topics that are used in the three genres (Chapter Twelve), and on the style and arrangement of the genres (Chapter Thirteen), precede a final chapter in this Part on the relatively little-studied treatise, the Divisiones Aristoteleae. Part Three takes us through the Hellenistic period and into Rome (the title Rhetorical Genres in the Hellenistic and Imperial Ages' perhaps does not do full justice to the material on the Roman Republican period). This might be thought the least satisfying of the three parts, not because of any lack of knowledge, hut simply because it covers, inevitably in less detail, such a wide range of material, in Greek and Tatin, from Hellenistic theory to the proyyninasmata and declamation (Chapter Twenty). There is thus no individual chapter on Cicero or Quintilian, rather an approach that looks at topics from a combined Greek and Roman angle, such as the vocabulary used for each of the three genres...
-
Review: Antiracist Writing Assessment Ecologies: Teaching and Assessing Writing for a Socially Just Future, by Asao Inoue ↗
Abstract
Preview this article: Review: Antiracist Writing Assessment Ecologies: Teaching and Assessing Writing for a Socially Just Future, by Asao Inoue, Page 1 of 1 < Previous page | Next page > /docserver/preview/fulltext/tetyc/45/2/teachingenglishinthetwo-yearcollege29433-1.gif
-
Collaborative Ecologies of Emergent Assessment: Challenges and Benefits Linked to a Writing-Based Institutional Partnership ↗
Abstract
This essay reports on a writing-based formative assessment of a university-wide initiative to enhance students’ global learning. Our mixed (and unanticipated) results show the need for enhanced expertise in writing assessment as well as for sustained partnerships among diverse institutional stakeholders so that public programming—from events linked to classroom-level learning to broader cross unit mandates like accreditation—can yield more rigorous, responsive, and mixed method assessments.
November 2017
-
Abstract
In Hong Kong schools, source-based writing has risen in prominence in recent years with the incorporation of inquiry project-based learning (PjBL) into the curricula. Understanding how school students write from sources in this context will constitute a crucial step toward identifying potential problems and targeting educational strategies. In this paper we report an exploratory study of how junior secondary school (Forms 1–3) students reported sources in their research-based group project reports in the Liberal Studies subject in the environment of a Wiki online platform. Our analyses of a sample of 30 project reports focused on discovering how the students used reporting verbs and expressions to report information from sources, and how they expressed positive and critical evaluation of their sources. Our study addressed a gap in the literature by examining school students’ source-use practices in their first language, with valuable pedagogical insights generated and avenues of future research suggested.
October 2017
-
Abstract
The authors argue that skills in quantitative literacy (QL) and quantitative reasoning (QR) augment students’ communicative effectiveness. This article offers a pedagogical framework and model for how QR can be productively interwoven with the rhetorical know-how of technical writing pedagogy. The authors describe their course redesign, present preliminary assessment data, and conclude by highlighting some implications not only for student learning, but also for the QL movement itself.
-
Abstract
This study examined the effects of an innovative comprehensive writing program in upper primary education on students’ writing performance and on teachers´ classroom practices, beliefs and skills. The program focused on the communicative nature of writing, on writing as a process, and on explicit teaching of five genre-specific writing strategies. It was implemented by 43 teachers in their regular classrooms (Grades 4 to 6, N = 1052), with three conditions: (1) a writing program condition, (2) the same program complemented by professional development sessions and coaching, and (3) a control condition in which teachers taught their usual writing lessons. Students’ writing performance was measured three times with multiple writing tasks. Data on teachers’ practices, beliefs and skills were collected through lesson observations, interviews, questionnaires, teacher logs, and a text assessment task. The comprehensive writing program had a beneficial effect on students’ writing performance and the extent to which teachers taught writing strategies. The complementary professional development and coaching had a direct effect on the number of lessons implemented, and an indirect effect on students' performance. Overall, the innovation proved to be effective for improving students’ writing performance in the upper grades of primary schools.