All Journals

1472 articles
Year: Topic: Clear
Export:
assessment ×

March 2015

  1. Readers Write: Responses to Stuart Brooks
    Abstract

    A Modest Proposal for the 21st Century Peter Dow Adams Computerized Evaluation of Writing: Senseless Savings Eric BatemanKicking the “Fast Assessment” Habit Carolyn Calhoon-DillahuntDr. Test Cracker, Meet John Henry James FreemanA Cautionary Tale Sharon Mitchler

    doi:10.58680/tetyc201526946

February 2015

  1. Writing in Test and Non-test Situations: Process and Product
    Abstract

    Test writers sometimes complain they cannot perform to their true abilities because of time constraints. We therefore examined differences in terms of process and product between texts produced under test and non-test conditions. Ten L2 postgraduates wrote two argumentative essays, one under test conditions, with only forty minutes being allowed and without recourse to resources, and one under non-test conditions, with unlimited time as well as access to the Internet. Keystroke logging, screen capture software, and stimulated recall protocols were used, participants explaining and commenting on their writing processes. Sixteen writing process types were identified. Higher proportions of the processes of translation and surface revision were recorded in the test situation, while meaningful revision and evaluation were both higher in the non-test situation. There was a statistically significant difference between time allocation for different processes at different stages. Experienced teachers awarded the non-test texts a mean score of almost one point (0.8) higher. A correlational analysis examining the relationship between writing process and product quality showed that while the distribution of writing processes can have an impact on text quality in the test situation, it had no effect on the product in the non-test situation.

    doi:10.17239/jowr-2015.06.03.2
  2. An Appetite for Rhetoric
    Abstract

    The impetus for writing this essay is dreadful despite being ordinary (all the more dreadful because its ordinary). Today, just like yesterday or tomorrow, hundreds of millions of people will not eat or eat so little that it seems as nothing to those who always have food in easy reach. I am no moralist, this is no sermon, yet the emptiness of rhetorical theory regarding hunger has begun to gnaw at me, especially since philosophical concern for the body and for materiality in rhetoric studies has only intensified in recent years. Hunger might draw the attention of rhetorical critique when public action is taken to feed the poor or when gazing on their suffering exposes capital's cruelty. In the philosophy of rhetoric, however, hunger is something of a void, so I think it is important to note, amid omnipresent food insecurity, the unmarked satiety of the rhetor's body, which is typically assumed to be a well-fed body or at least not a starving one. It is not a simple case of oversight; hunger is separated from rhetoric as a condition of understanding both and recognizing that we might begin to reckon the significance of assuming instead that rhetoric's materiality, and hence its potential, is not detachable from food so far as human bodies are concerned.“Experience teaches us with abundant examples,” Spinoza remarks, “that nothing is less within men's power than to hold their tongues or control their appetites” (1992, 106). Speech is effectively a species of appetite for Spinoza. The “or” he inserts between tongues and appetites is bothersome, though, and it is exactly this analogic separation that I want to trouble: it is wrong to borrow from the master figure of appetite, hunger, to explain rhetoric's persistence while granting rhetoricity independence from nourishment. Rhetoric (understood as a collective noun) is permanently famished, but its human agents never seem to know the want of food. But maybe they could know that want, or maybe they have, and that is what I wish to discuss. My only point, ultimately, is that an appetite for rhetoric does not deserve autonomy from hunger, given that any rhetoric is immanent to hunger and hunger is always, everywhere imminent so long as that rhetoric is enlivened by bodies that eat. The consequence of hunger's particular immanence/imminence is that it shapes rhetoricity in ways different from that of other appetites. Hunger is a distinctive, inalterable condition for humanity—it is indiscriminate in that all people are finally subject to it, and it is like clockwork, which makes it terrifying. As a result, it is also a condition of the rhetorics that humans inhabit (not to mention a condition of creatures that humans love, fear, imprison, study, and/or rely on, such as those that become our food, but I limit myself to human want for reasons of space and concision).My concern with rhetoric's hungry body is very general, but it is important to demystify things because otherwise I risk reestablishing the analogic distance I have unfairly and opportunistically attributed to Spinoza. One in eight people currently go hungry worldwide, and although the hunger rate declined from 23.2 percent in 1990–92 to 14.9 in 2010–12, 870 million people are still undernourished (UN 2013). One in six Americans go hungry, which includes children (sixteen million of them), seniors, and working adults (Feeding America 2014b). According to the U.S. Census Bureau, in 2012, 49.7 million Americans lived in poverty (Short 2012). And according to the U.S. Department of Agriculture, in 2012, 49 million Americans lived in food insecure environments distributed over 17.6 million households, of which 7 million had very low food security (Coleman-Jensen, Nord, and Singh 2013). The nonprofit organization Feeding America says that “food insecure children don't develop and grow as well as others. They may have more difficulty learning and may not do as well in school. They are more likely to get sick and are more likely to be hospitalized. The effects of child food insecurity are severe and they can last a lifetime” (2014a).Presumably these effects include diminished rhetorical capacities due to stunted affective potential and responsiveness to the world. However, beyond diminished capacity, the universality and proximity of starvation is also important to accounting for the ways that hunger and rhetoric entwine. Poverty and its concomitant food insecurity are everywhere, and if you live in the United States you can see just how much poverty is tucked in around you with a handy interactive map provided by the New York Times (Bloch, Ericson, and Giratikanon 2014). At this writing, Maine ranks third in food insecurity in the nation and has seen a 38% rise in SNAP participation since 2006 (Preble Street, n.d.). The Supplemental Nutrition Assistance Program (aka food stamps) is the largest element of U.S. hunger alleviation programs. As I sit now in my house in Maine, I am surrounded by poverty, with rates reaching as high as 42 percent within nearby neighborhoods and communities. Undoubtedly, where I am a little peckish and looking forward to the fish tacos I will make this evening, someone (likely many someones) within walking distance has eaten little or nothing today and looks forward to little or nothing tonight.Hunger does not bargain, so one never comes to terms with it; hunger makes one incessant demand. Even when the demand is met, hunger cannot be banished to more than a few hours' distance and if one cannot give the body something to eat, the body will begin to eat itself. Perhaps the pitiless and unmoving character of hunger was on the mind of Ischomachus when he told Socrates “no man ever yet persuaded himself that he could live without the staff of life” in Xenophon's Economist (1897, 283). So rhetoric, at least in its traditional sense, is not more powerful than food. Over two millennia later, Norman Borlaug, the great advocate of the green revolution, made a similar point in his Landon Lecture at Kansas State. Referencing West African nations' collapse under the pressures of famine in the Sahel region, he set “flowery speeches” against crop yield: “Food is the first basic necessity…. When stomachs go empty, patience wears out and anger flares. If we're going to achieve world stability, it won't be done, I assure you, on empty stomachs” (1979, 3). The provision of food is irreducibly critical to the polis, but hunger's relation to rhetoric is hardly so singular, so either-or—indeed rhetoric is hardly so singular—as Borlaug makes it seem. Hunger and rhetoric are folded together in complex, dynamic layerings, such that is impossible to tell where one ends and the other begins (Deleuze 1992, 108–9). Instead of a binary in which sustenance sits to one side and words (as a cipher for rhetoricity) to the other, food pleats rhetoric and hunger into each other. Through its growth, harvesting, distribution, commodification, hoarding, preparation, aestheticization, enjoyment, and waste, food wraps rhetoricity and hunger over and over the other's fabric. We can begin to make out the curves and layers of these dense, plaited relations by attending to foodways more carefully.There is something to be learned by following the oversimplification of hunger's relation to rhetoric to its breakpoint, however. Ischomachus and Borlaug, each in his own idiom, describe a brute, destructive relation where want of food blankets and suffocates civil discourse, leaving only suasion by physically violent means. In Spinozist terms, hunger is not affect but an affective multiplier that takes over the desire to persist in being (conatus). Hunger unleashes a terrible vitality that seeks only its cessation; an unmet need to eat amplifies anger, leaving violence as the only possible style of being. Hunger heightens our material vulnerability to the world, including ourselves, while making us less vulnerable to the well-heeled habits of human communication. Starvation is a potent, wordless appetite that supersedes the normalized rhetorics of national and international politics, an incredible motive force whose danger lies in the fact that it smothers other strains of rhetoric that may forestall such violence.Elaine Scarry's discussion of pain resonates with me here (1987). As a body in pain, the hungry body becomes monadic in a particular way, folding everything in on itself and out from itself relative to the process of starvation. Or, to the extent that rhetoric is understood as creative forces that mobilize affect, hunger is “the wild” at the heart of civility (Bennett 2002, 19), a gaunt power that both obliterates and compels other forms of invention. And in the face of this immanent/imminent “wild,” confronted with myriad, complex adaptations to hunger, the oversimplification of its relation to rhetoric gives way.Beyond the remorseless, desperate experience of starving, hunger at a distance enfolds rhetoricity in endlessly inventive ways. Memories of hunger, personally felt or collectively recalled, afford communities a place to build on. In other words, the quest to forget the aching hopelessness and danger of a lack of food becomes a stable, recursive foundation on which to project a future; we can recall the kind of lives that we lead or should lead. Farming has special value in locating the present between the past and future, then. Farmers have been repeatedly valorized as the bringers of civilization; cultivators come before culture. Jefferson wrote to Washington that farmers were God's chosen people, since in addition to minimizing war, “husbandry begets permanent improvement, quiet life and orderly conduct, both public and private” (1904, 151). Emerson wrote that farming “stands nearest to God, the first cause” in that all that is good in society follows from it (1904, 137). The first first of farming, before virtue and wealth, is food. Agriculture, fisheries, and husbandry yield a surplus of culture along with meat, grains, and dairy because they turn the power of hunger over. Its cessation not only allows for but nourishes an abundance of creative achievement, which includes yet is in no way limited to civility's political rhetorics. It is the broadest pleat in the materiality of consumption, the turning back of starvation, that typically uncovers a rhetor whose belly is full and a polis that inclusively excludes the unfed. Yet many smaller folds texture the relations between hunger and rhetoric because hunger is never turned back (it cannot be satisfied) and the unfed inclusively exclude the polis too (their unfulfilled appetite carries an unrealized commons within it).The multiplicity of rhetoric and the singularity of hunger are thus bound up in each other, and their entanglements produce divergent powers. Foodways, dependent on farming, actualize hunger both as a destructive and constructive force, flipping between danger and bounty in relation to rhetoric. In a physiocratic rendering of the pharmakon, François Quesnay argues in “Natural Right” that “the physical causes of physical evil are themselves the causes of physical good” (2003, 47). Hunger causes war and violence but as a craving that we need to satisfy, it gives life purpose. For the physiocrats, Jefferson, Emerson, and Borlaug, providing enough food precedes political economy and at the same time is the principal focus of governance, or rather hunger is a radical political economy of need that engenders civil society and that must always be tended to lest a society collapse. Whether that society thrives or falls, however, hunger persists and the cultivation of food enlivens a great many rhetorics, big and small.In short, the materiality of needing sustenance constantly animates rhetoricity because the demands of the stomach are relentless. It is not simply when we put words on the problem that hunger and rhetoric clasp each other. Rather, because we are never done feeding ourselves (or trying to feed ourselves) food production and consumption implacably yet creatively take up rhetoric in hunger and hunger in rhetoric.Enter again the many millions who are hungry as I write and you read, but instead of surrounding yourself with want, turn it about, encircling the malnourished in a world of plenty. The most general fold of hunger and rhetoric, wherein starvation stifles all other rhetorics, is too general and one sided to account for the many ways food deprivation vitalizes rhetoric. There are countless twisted, wrinkled knots of community in which famished bodies and sated bodies find themselves pressed together and yet separated by food, much as I (and maybe you) sit within minutes, likely meters rather kilometers, of hunger. We are incorporated in many relationships that turn on food—some urgent, some negligent, some exploitative, some noble—and these relations, never firmly constructive or destructive, contingently capacitate rhetoric in the plural.I will not pretend to imagine the complexity of all the relations that I feel are at stake, but it is not hard to recognize the complexity when it presents itself. The most recent appropriation of SNAP was through the 2014 Agricultural Act, which included massive farm subsidies but a reduction in food stamps (O'Keefe 2014). In fall of 2013, conservatives in the House, as is their wont, decried assistance as promoting laziness, which assumes that the experience of hunger or at least the very real threat of going hungry is a teacher of self-reliance and civic virtue (Nixon 2013). Thus it is responsible (and a form of responsibilization) to let hunger rule in many pockets and corners of communities, if not whole communities. Hunger, valued as a political technology, is actively incorporated into a rhetoric of governance not as an abstract enemy but as a material application of motive force. In contrast, the liberal argument is often that food assistance promotes self-sufficiency, so ending hunger yields civic virtue. And there are the strange debates over what people on food stamps choose to eat, whether it is junk food or health food that draws public attention. The inspection of food choices is more than a shaming exercise. It is an assessment of the hunger curriculum and what people should learn through food when they can get it. Food rationing is hunger rationing, so it is not simply about empty bellies versus full bellies but about the distribution of hunger relative to being. Rhetoric is implicated in every aspect, in many different material profiles. Hunger is a silent force of appetite that destroys or empowers other rhetorics as it enfolds them, and food is, therefore, a principal mediator of material ecologies for rhetoric. Agriculture, aquaculture, food manufacturing, and culinary traditions extend soil, minerals, water, plants, animals, and humans into one another in ways that impact the affective power of other appetites, including but not only an appetite for political “speech.” Foodways are key adaptations of the will to matter and, thus, rhetoric. To paraphrase Bruno Latour, not all things in rhetoric are rhetorical (2013, 39).If one grants that an appetite for rhetoric is not parallel to hunger but is shaped by it and that rhetoric is organized for hunger, to affect it, then perhaps the groundwork is laid for the philosophy of rhetoric to reconsider the materiality of food. At the most esoteric level that would mean an appreciation that survival is not always prior to creativity. Or, rather, creativity is not only in the service of survival, which is implicit in the too general fold of rhetoric and hunger described by Ischomachus and Borlaug and which sometimes grounds the political ontology of rhetoric's being (Nietzsche 1989). As Elizabeth Grosz explains in Becoming Undone, conatus is about art as well. Discussing the value of Darwin for philosophy, she argues that the world's biotic diversity is not reducible to natural selection. Creative forces unleashed by flowers to attract bees, for example, exceed reproductive utility. She argues that art is the “eruption of taste” within conatus and exceeds survival because it “enables matter to become more than it is, it enables the body to extend itself” (2011, chap. 8). Food is infinitely more than sustenance, and humans adapt and develop with plants and animals in complicated relations of taste, not just of practicality. Hence, inspecting the taste of those who rely on food stamps is not so strange after all, even if it is unpalatable. Food culture is one of the great pillars of creative, nonrational achievement, so even as we recognize hunger's necessity as a mother of invention, we must also understand that invention mothers necessity back. Being “of the world” we must eat, but to eat we must be “for the world” in order to cultivate the food that we need (Deleuze 1992, 26).At the most concrete level, appreciating hunger's material significance to rhetoric would mean exploring how foodways participate in material ecologies of rhetoric, folding and refolding want and satisfaction together to create relations between subjects and objects, taste and need. It would mean thinking about the rhetor's hungry body, not just his or her sated body, and how the distribution of hunger impacts the evolution of rhetorical capacities. To do that, we need to avoid assuming that people have enough to eat when we theorize rhetoricity; instead, we should assume that many do not, anyone may not, and begin to ask how hunger helps produce a given rhetoric's affective potential. More simply, we need to not ignore hunger in the polis when we think of rhetoric but see that it is all around us, in us.

    doi:10.5325/philrhet.48.1.0099

January 2015

  1. Revising by Numbers: Promoting Student Revision Through Accumulated Points
    Abstract

    In an effort to rethink the evaluation of student writing with the ultimate goal of convincing novice writers that rewriting predicates as well as presupposes the act of writing, I describe a point-accrual grading system where students accumulate points with redrafted submissions during a semester. This approach to evaluation offers students more autonomy in controlling their “earned” grade as well as incentivizes their investments in the revision process. In contrast to the normative percentages approach to grading, this point-accrual system not only gives students a less ambivalent form of grading but also moves them past surface-level revision and into rhetorical restructuring.

  2. An evaluation of the Writing Assessment Measure (WAM) for children's narrative writing
    Abstract

    The study evaluated the reliability and validity of the Writing Assessment Measure (WAM), developed to reflect the skills which children of different abilities are expected to achieve in written expression, as part of the National Curriculum guidelines in England and Wales. The focus was on its potential use in investigations of children's written narrative in order to inform and target related interventions. The study involved 97 children aged 7–11 from one urban primary school in England. Prompt 1 was administered to all the children in their classrooms together with a standardised written expression test. After three weeks, the same procedure was followed and Prompt 2 was administered. Statistical analyses of the reliability and validity of the instrument showed that it is consistent over time and can be scored reliably by different raters. Content validity of the instrument was demonstrated through inspection of item total correlations which were all significant. Analyses for concurrent validity showed that the instrument correlates significantly with the Wechsler Written Expressive Language sub-test. Significant differences between children of different age and writing skill were also found. The findings indicate that the instrument has potential utility to professionals assessing children's writing.

    doi:10.1016/j.asw.2014.08.001
  3. Socializing Future Professionals
    Abstract

    This article argues that graduate education often does not fully prepare students to take on the role of faculty member after graduation because it does not make students aware of the importance of faculty responsibilities such as service. It also suggests that the increasing importance of assessment in education indicates that assessment should be an essential part of training future faculty. This argument is explored through a graduate-level assessment course that required students to conduct assessment research for their department and university not only to give students real experience with assessment but also to make them aware of faculty responsibilities beyond the classroom. These students were interviewed twice during the course and reported that they felt that learning and applying assessment research allowed them to develop practical professional skills and broadened their knowledge of academic opportunities for conference presentations and publication.

    doi:10.1215/15314200-2799180
  4. Assessing the Lexico-Grammatical Characteristics of a Corpus of College-Level Statistics Textbooks: Implications for Instruction and Practice
    Abstract

    A corpus of current editions of statistics textbooks was assessed to compare aspects and levels of readability for the topics of measures of center, line of fit, regression analysis, and regression inference. Analysis with lexical software of these text selections revealed that the large corpus can be described well by three index variables that summarize the lexical and grammatical complexity of the textbook excerpts. Assessment of those three variables indicates that substantial differences exist in the readability of the topics within textbooks with respect to lexical and grammatical complexity. This analysis suggests that general readability of introductory statistics topics within textbooks varies substantially and it is a recommendation that instructors: (1) be prepared to provide additional support for topics that are more grammatically and lexically complex, and (2) be aware that they can input their instructional materials into LexTutor VP or Coh-metrix as a quick screen for possible readability issues.

    doi:10.2190/tw.45.1.c
  5. Contested Science in the Media: Linguistic Traces of News Writers’ Framing Activity
    Abstract

    Science reporting in the media often involves contested issues, such as, for example, biotechnology, climate change, and, more recently, geoengineering. The reporter’s framing of the issue is likely to influence readers’ perception of it. The notion of framing is related to how individuals and groups perceive and communicate about the world. Framing is typically studied by means of content analysis, focusing primarily on the “stories” told about the issue. The current article, on the other hand, springs from an interest in writer behavior. I wish to investigate how news writers strategically exploit their rhetorical competence when reporting on contested issues, and I argue that text linguistics represents a fruitful approach to studying this process. It is suggested that genre features may serve as a basis for identifying key framing locations in the text, and that the notion of evaluation plays an important part in writers’ framing activity. I discuss these aspects through a case study involving six news reports on a geoengineering experiment.

    doi:10.1177/0741088314557623

2015

  1. A Compelling Collaboration: The First Year Writing Program, Writing Center, and Directed Self-Placement
  2. Word Choice Errors in Chinese Students' English Writing and How Online Writing Center Tutors Respond to Them
    Abstract

    Examining 200 word choice errors from Chinese students' drafts submitted to a writing center's online asynchronous tutoring program, the present study demonstrates that second language writers need help with word choice. Word choice problems, a natural part of second language learning, can negatively affect rhetorical effectiveness and readers' comprehension and evaluation. The study showed that 11% of online tutors' marginal comments related to word choice problems, among which 18% were due to translation. (Other error types were Wrong Context, Synform, Idiomaticity, Precision, and Register.) Direct corrections were the most common type of tutor comments -35%. (Other comment types were Explanation, Options, and Questions.) These numbers show that word choice errors are indeed critical, that even experienced writers rely on their first language, and tutors need more knowledge about word choice issues and how to provide instruction and feedback on them.

    doi:10.7771/2832-9414.1777
  3. The Development of Disciplinary Expertise: An EAP and RGS-informed Approach to the Teaching and Learning of Genre at George Mason University
    Abstract

    In the U.S., international enrollment trends have increased the pedagogical imperative to address multilingual graduate student writers’ linguistic needs/growth in the process of their developing disciplinary expertise. In the context of this internationalization effort, what can two disciplines—Applied Linguistics and Composition—constructively offer in terms of a pedagogical approach to address such growing institutional demands? With regard to the various ways in which these disciplines approach the teaching and learning of disciplinary expertise, what might a research-informed English for Academic Purposes (EAP)/Rhetorical Genre Studies (RGS) curriculum arc look like and how might multilingual graduate writers respond to such an integrated pedagogical trajectory? Further, to what extent might such a curriculum be able to balance evolving student needs and institutional expectations for students’ linguistic development? This program profile examines the potential of Tardy’s 2009 model for building genre knowledge among a specific student population: first-year multilingual international graduate students enrolled in a "bridge" program at George Mason University. In addition to describing the practical work of enacting Tardy’s model at the program and course levels, the authors detail the results of a related study aimed at exploring students’ development of genre knowledge over the course of the bridge year. Results point to the complexity of designing and implementing an EAP/RGS-informed course structure which values the intersectional nature of disciplinary knowledge development and suggest the need for such an approach to explicitly foreground the visibility of language teaching, learning, and assessment in order to ease student anxiety around both language and genre development.

  4. Linguistic Attention in Rhetorical Genre Studies and First Year Writing
    Abstract

    Since Carolyn Miller’s Genre as Social Action, North American Rhetorical Genre Studies (RGS) has facilitated analysis of how typified rhetorical actions constitute the contexts and communities in which writers write. In first-year writing (FYW) specifically, RGS approaches have focused on macro-level textual constructs, like the audience and evidence expectations of different genres, and have bolstered valuable attention to genre awareness and transfer. In its attention to context and macro-level features, however, RGS has focused less on recurring linguistic patterns in written genres, which has contributed to two gaps in genre-based approaches to FYW: few large-scale analyses of first-year written genres, and little attention to language patterns in genre-based FYW pedagogy and research. This article aims to interrogate these gaps and offer a way beyond them, in three parts. First, it historicizes the institutional separation of U.S. rhetoric-composition and linguistics. Second, it outlines recent pedagogical genre research in RGS and English for Academic Purposes (EAP), which together offer valuable insights for approaches to FYW. Finally, it delineates selected observations from a context-informed corpus linguistic analysis of 19,463 FYW argumentative essays that draws on both RGS and EAP genre traditions. The analysis highlights rhetorical cues of the essay prompts (often absent in EAP corpus linguistic research) alongside shared linguistic patterns (often absent in RGS studies). The analysis likewise outlines overall patterns that distinguish FYW from published academic writing. The article closes with implications for pedagogy, research, and assessment.

  5. Assessment as Living Documents of Program Identity and Institutional Goals: A Profile of Missouri University of Science and Technology’s Composition Program
    Abstract

    In this profile we describe changes to the composition program at Missouri University of Science and Technology, prompted by the hiring of the university’s first writing program administrator (WPA). We describe our efforts to implement evidence-based best practices in undergraduate writing courses in a context where very little program specific evidence was available. We also describe how challenges of effecting change at a university largely composed of science, technology, engineering, and mathematics (STEM) students has meant that many of the changes have been framed by the spirit of Writing Across the Curriculum (WAC) initiatives. Several new methods of assessment have been introduced to the program, including instructor feedback, student surveys, and skills tests. Allowing assessment to drive standardization has begun a process of measuring the transfer of student knowledge we believe other departments will find interesting. We close by outlining unresolved issues and ongoing challenges as the program moves forward.

  6. The Source of Our Ethos: Using Evidence-Based Practices to Affect a Program-Wide Shift from “I Think” to “We Know”
    Abstract

    This program profile demonstrates how the first-year writing program at Oakland University has engaged contingent faculty in research, assessment, and program development over the years, employing evidence-based practices to improve individual classroom instruction and to redesign the entire first-year curriculum. The authors describe their efforts to develop an inclusive model for research and professional development, a model that seeks to empower the faculty to join disciplinary conversations about the teaching of writing. Overall, the profile contributes to existing scholarship on large college writing programs by illustrating how faculty may collaborate to develop and assess curricula, to conduct and publish research, and to build a program that shifts the conversation from what individual instructors may believe about writing instruction (“I think”) to what the department may collaboratively know about best practices (“we know”).

  7. eComp at the University of New Mexico: Emphasizing Twenty-first Century Literacies in an Online Composition Program
    Abstract

    With distance education on the rise, a new program at the University of New Mexico provides an innovative way to teach first-year composition in a fully online format. The program, called eComp (short for Electronic Composition), insists that instructors receive formal and educational training before working in the model. In addition, the curriculum taught within the first-year writing courses attends to multimodal literacies, and students receive help with their drafts from various sources, including instructional assistants who are tutors embedded in each course shell. This profile describes the program, including the scholarship that informed its design, the pilot project, and results from a small-scale assessment. Furthermore, we discuss future expansion of the program. This program description can serve as a model—in whole or in part—for other English departments when structuring a successful, integrative online program that emphasizes teacher training and multimodal literacies.

December 2014

  1. Improving Writing Instruction in Second and Third Grade Classrooms
    Abstract

    This article presents research findings from a professional development project initiated by one rural Illinois primary school to improve writing instruction in 2nd and 3rd grade classrooms. During the 2010–11 academic year, the school partnered with a private university to provide customized, year-long professional development that integrated preparation for the state writing assessment and a writing process approach. Simultaneously, a study was conducted to identify and describe teacher thinking and practices related to writing instruction during participation in the project. Data were collected through a pre/post teacher survey and written teacher reflections. Participating teachers indicated 15 improvements in their thinking and practices related to writing instruction. However, confidence in their students’ likelihood to perform well on the state writing assessment decreased during the project, and changes in thinking and practices varied from teacher to teacher, possibly due to varying levels of teacher readiness to change.

    doi:10.1558/wap.v6i3.497

November 2014

  1. Literacy Sponsorship and The Post-9/11 GI Bill
    Abstract

    This essay argues that the Post-9/11 GI Bill (2008), despite the enormity of its scope, is failing those who need it to ascend in the economic order. The essay supports its position through a rhetorical analysis of several key texts connected to literacy relations between the US government and Post-9/11 veterans: a January 2001 press statement announcing the government’s abandonment of higher education sponsorship; America’s Army, a video game used to attract recruits; The American Council on Education’s “Guide to the Evaluation of Educational Experiences in the Armed Services”; and the Post-9/11 GI Bill. Expanding Deborah Brandt’s notion of “sponsorship” to include both purveyance (providing) and the government’s right of purveyance, this essay explains how the Bill consolidates literacy, particularly through transferability, which allows experienced veterans (those serving or agreeing to serve for a decade) to transfer their education benefits to spouses or children. Initial data about GI Bill use indicate high veteran attendance at for-profit institutions with poor retention rates, veteran confusion in interpreting GI Bill benefits, and bureaucratic tangles resulting in benefit delays. The government did not begin tracking graduation rates of veterans using the Post-9/11 GI Bill until 2013, further evidence that military recruitment and political aggrandizement, rather than democratizing literacy, were the Bill’s primary goals.

    doi:10.21623/1.2.2.2
  2. Equitable Poetics and the State of Conflict in Edmund Spenser's Two Cantos of Mutabilitie
    Abstract

    This essay argues that Edmund Spenser's legal poem, the Two Cantos of Mutabilitie, considers how civil conflicts implicitly generate a basis for their own evaluation and resolution. To illustrate this idea, Spenser draws from a tradition of rhetorical argumentation stretching from Aristotle and Cicero to Rudolph Agricola and Philip Sidney. This tradition emphasizes how fictions establish the shared questions that can create a deliberative context for equitable judgment when general law and particular case come into conflict. Dramatizing this rational process through an allegorical legal trial, Spenser illuminates how divergent judgments and actions become ethically legible to one another as parts of the same deliberative whole.

    doi:10.1525/rh.2014.32.4.362

October 2014

  1. Reflexive writers: Re-thinking writing development and assessment in schools
    doi:10.1016/j.asw.2014.08.002
  2. Just Ask Teachers: Building expertise, trusting subjectivity, and valuing difference in writing assessment
    doi:10.1016/j.asw.2014.06.002
  3. Three current, interconnected concerns for writing assessment
    doi:10.1016/j.asw.2014.09.003
  4. The challenges of emulating human behavior in writing assessment
    doi:10.1016/j.asw.2014.07.002

September 2014

  1. Feedback for Adolescent Writers in the English Classroom
    Abstract

    This study examined the impact of different forms of feedback on the writing of a group of 82 adolescent students in secondary English classes. During a 6-week intervention, students were randomly assigned to one of three feedback groups: peer feedback on pen-and-paper drafts, teacher feedback delivered electronically through a course management system, and automated feedback generated through computer-based writing evaluation software. Pre- and post-measures of student writing quality, length, and correctness were analyzed, and survey data explored student perceptions of their experiences. Findings indicate that all students, regardless of which form of feedback they received, wrote longer essays and scored higher on holistic ratings at post test than they did at pretest. Neither language status nor group assignment had a greater or lesser impact on performance on length or holistic quality. However, differences between feedback groups spiked on the proximal measure that examined mastery of particular aspects of the genre being taught. Both peer feedback and teacher feedback delivered electronically had a statistically significant impact on student performance in the genre of open-ended response. The article concludes with a discussion of the implications of these findings for future research and instruction in the secondary context.

    doi:10.1558/wap.v6i2.223
  2. The Many Faces of Feedback on Writing
    Abstract

    This article traces the development of feedback from comments on product alone to the interactive process-oriented approaches that are currently the state of the art. A range of variables that impact how feedback is given and received are considered. Attention is also paid to feedback givers, their beliefs, philosophies, and practices along with a critical view of language varieties and the roles they play in teachers’ evaluation of writing. Finally, the evolution of written feedback to incorporate the development of online technologies brings us to the present time and an exploration of their use and efficacy.

    doi:10.1558/wap.v6i2.195
  3. Handbook of Automated Essay Evaluation Current Applications and New Directions Mark D. Shermis and Jill Burstein (eds.) (2013)
    Abstract

    Handbook of Automated Essay Evaluation Current Applications and New Directions Mark D. Shermis and Jill Burstein (eds.) (2013) New York: Routledge. Pp. 194 ISBN: 9780415810968

    doi:10.1558/wap.v6i2.437
  4. Equitable Poetics and the State of Conflict in Edmund Spenser’s Two Cantos of Mutabilitie
    Abstract

    This essay argues that Edmund Spenser’s legal poem, the Two Cantos of Mutabilitie, considers how civil conflicts implicitly generate a basis for their own evaluation and resolution. To illustrate this idea, Spenser draws from a tradition of rhetorical argumentation stretching from Aristotle and Cicero to Rudolph Agricola and Philip Sidney This tradition emphasizes how fictions establish the shared questions that can create a deliberative context for equitable judgment when general law and particular case come into conflict. Dramatizing this rational process through an allegorical legal trial, Spenser illuminates how divergent judgments and actions become ethically legible to one another as parts of the same deliberative whole.

    doi:10.1353/rht.2014.0002
  5. Using Oral Exams to Assess Communication Skills in Business Courses
    Abstract

    Business, like many other fields in higher education, continues to rely largely on conventional testing methods for assessing student learning. In the current article, another evaluation approach—the oral exam—is examined as a means for building and evaluating the professional communication and oral dialogue skills needed and utilized by business graduates. Prior studies of oral exams in higher education are reviewed, along with the empirical findings from an exploratory investigation of an oral exam in an undergraduate human resource course. Implications for future research and the use of oral exams in business education are also presented.

    doi:10.1177/2329490614537873
  6. Program Review: Digital Composing and the Invention of a Program: Comprehensive Assessment and Faculty Development, Part 2
    Abstract

    “Assessment, from our perspective, should help us understand what we are doing and improve the ways that we are doing it.”

August 2014

  1. Dialogue Protocols for Formal Fallacies
    Abstract

    This paper presents a dialogue system called Lorenzen–Hamblin Natural Dialogue (LHND), in which participants can commit formal fallacies and have a method of both identifying and withdrawing formal fallacies. It therefore provides a tool for the dialectical evaluation of force of argument when players advance reasons which are deductively incorrect. The system is inspired by Hamblin’s formal dialectic and Lorenzen’s dialogical logic. It offers uniform protocols for Hamblin’s and Lorenzen’s dialogues and adds a protocol for embedding them. This unification required a reformulation of the original description of Lorenzen’s system to distinguish “between different stances that a person might take in the discussion”, as suggested by Hodges. The LHND system is compared to Walton and Krabbe’s Complex Persuasion Dialogue using an example of a dialogue.

    doi:10.1007/s10503-014-9324-4
  2. Towards Formal Representation and Evaluation of Arguments
    Abstract

    The aim of this paper is to propose foundations for a formal model of representation and numerical evaluation of a possibly broad class of arguments, including those that occur in natural discourse. Since one of the most characteristic features of everyday argumentation is the occurrence of convergent reasoning, special attention should be paid to the operation ⊕, which allows us to calculate the logical force of convergent arguments with an accuracy not offered by other approaches.

    doi:10.1007/s10503-014-9325-3

July 2014

  1. The three-fold benefit of reflective writing: Improving program assessment, student learning, and faculty professional development
    doi:10.1016/j.asw.2014.03.001
  2. “Lock the Doors”: Toward a Narrative–Semiotic Approach to Organizational Crisis
    Abstract

    Using a narrative–semiotic approach, this article explores the decisions, plans, and actions involved in dealing with organizational risks and crises. It describes a model, or methodological framework, for crisis analysis as well as for organizational learning aimed at crisis management and prevention. The model is based on the interrelational positioning of the relevant agents (project managers, project team members, and stakeholders), the discourses produced by these agents, and their actions. This model is valuable for understanding the situations, goals, motivations, and anxieties that underlie the risk assessment and actions taken during crises. To illustrate the theoretical discussion, the article analyzes the Columbia Space Shuttle accident of 2003.

    doi:10.1177/1050651914524781

June 2014

  1. Intensive Writing Institute for Second Language Writers
    Abstract

    This article discusses the design and evaluation of an intensive writing institute developed for students new to universities and colleges in the United States. In its first year, the program consisted of a hybrid (part online and part onsite) writing-intensive course which offered a brief but focused introduction to the writing and reading strategies necessary for success in U.S. universities and colleges, with an emphasis on reading complex texts like those which the students would encounter in content courses and on writing and revising completed compositions. Cultural differences and institutional expectations were also addressed in the course. Beyond the formal instruction, participating second language writers, all of whom were Chinese, were provided with extracurricular opportunities to interact with their professors in informal situations. Implications for preparing new international students for writing demands in university settings are discussed.

    doi:10.1558/wap.v6i1.107
  2. The Legal and the Local: Using Disparate Impact Analysis to Understand the Consequences of Writing Assessment
    Abstract

    In this article, we investigate disparate impact analysis as a validation tool for understanding the local effects of writing assessment on diverse groups of students. Using a case study data set from a university that we call Brick City University, we explain how Brick City’s writing program undertook a self-study of its placement exam using the disparate impact process followed by the Office for Civil Rights of the US Department of Education. This three-step process includes analyzing placement rates through (1) a threshold statistical analysis, (2) a contextualized inquiry to determine whether the placement exam meets an important educational objective, and (3) a consideration of less discriminatory assessment alternatives. By employing such a process, Brick City re-conceptualized the role of placement testing and basic writing at the university in a way that was less discriminatory for Brick City’s diverse student population.

    doi:10.58680/ccc201425448
  3. From the Editor: A Field with a View
    Abstract

    Dear Colleagues and Friends~~This month's issue includes various genres- articles, symposium contributions, review essay, exchange, and poster page-that tap both time and space. In these collective texts, we have historical perspectives helping us understand our own past and allowing us to update our present; linkages to other fields of endeavor so as to enhance our own; connections across spaces to other sites of writing around the world; and closer looks at our own sites-hence the title of this introduction. As represented here, our field includes a capacious view, and as we expand sites of inquiry and activity, we have a more robust and complex view. In this introduction, then, I'll summarize each of these contributions before taking up two other tasks: (1) outlining the treat in store for us, in the combined September and December special issue of College Composition and Communication, we will learn from colleagues about various and diverse Locations of Writing; and (2) sharing with readers our new policy on rememberingIn our first article, Expanding the Aims of Public Rhetoric and Writing Peda- gogy, Writing Letters to Editors, Brian Gogan takes up how the conventional assignment of the letter to the editor can be located in what he calls an ap- proach to public rhetoric and writing pedagogy that is conducted according to the tripartite aims of publicity, authenticity, and efficacy. Drawing on his work with students, Gogan expands on these single-concept aims to situate them in relationships: publicity-as-condition and publicity-as-action, authenticity- as-location and authenticity-as-legitimation, and efficacy-as-persuasion and efficacy-as-participation. Gogan also argues that we should separate and emphasize the participation the letter-to-the-editor genre entails from the persuasion that may be its aspiration: when the efficacy of the letter-to-the- editor assignment is expanded so that it is understood in terms of participation that may lead to persuasion, public rhetoric and writing pedagogy embraces the fullness of the ecological model [of writing] by seeing the wide range of effects-persuasive or not-there within.Continuing recent work recovering our collective writing pasts, our next article details the experiences of several 19th century women, some of them from the U.S., making their educational way at Cambridge University. In 'A Revelation and a Delight': Nineteenth-Century Cambridge Women, Academic Collaboration, and the Cultural Work of Extracurricular Writing, L. Jill Lam- berton focuses on the writing these women engaged in, especially outside the classroom, in order both to succeed in the classroom and to affect wider spheres of influence. Defining this writing as a form of collaborative peer activity foster- ing agency, Lamberton identifies three benefits accruing to her 19th century subjects: (1) use of extracurricular writing that augmented and enriched cur- ricular learning; (2) use of writing to develop social networks and circulation; and (3) use of such writing to shift public opinion, looking outside the college or university for broader audiences to voice support and agitate for change.Mya Poe, Norbert Elliot, John Aloysius Cogan Jr., and Tito G. Nurudeen Jr. return us to the present as they consider how our writing programs can be enhanced: by adapting a legal heuristic used to determine what in the law is called impact. In The Legal and the Local: Using Disparate Impact Analysis to Understand the Consequences of Writing Assessment, these col- leagues first distinguish between inequities produced by intent from those produced unintentionally-the latter called disparate impact-before outlin- ing a three-part question-driven process that can identify such instances and work toward ways of changing them:Step 1: Do the assessment policies or practices result in adverse impact on students of a particular race as compared with students of other races? …

    doi:10.58680/ccc201425445

April 2014

  1. Pair assessment of pupil writing: A dialogic approach for studying the development of rater competence
    doi:10.1016/j.asw.2014.01.002
  2. Directed self-placement questionnaire design: Practices, problems, possibilities
    doi:10.1016/j.asw.2013.11.006
  3. The Impact of Presentation Form, Entrepreneurial Passion, and Perceived Preparedness on Obtaining Grant Funding
    Abstract

    This study investigates important questions for any emerging high-technology firm attempting to obtain funding: Does the design of the presentation and the perceived passion and preparedness of the presenter influence expert reviewers’ assessment of the merits of the firm’s proposal? The authors analyzed 22 videotaped presentations to reviewer panels at a U.S. Department of Defense technology transfer consortium and compared the panels’ assessments of the presenting firms’ proposals both before and after the formal presentations. The data showed that, on average, higher levels of perceived entrepreneurial passion and presenter preparedness and presentation designs that effectively captured the audiences’ attention resulted in higher ratings by decision makers on the firm’s technology merit, management ability, and commercial potential.

    doi:10.1177/1050651913513902
  4. What Is Successful Writing? An Investigation Into the Multiple Ways Writers Can Write Successful Essays
    Abstract

    This study identifies multiple profiles of successful essays via a cluster analysis approach using linguistic features reported by a variety of natural language processing tools. The findings from the study indicate that there are four profiles of successful writers for the samples analyzed. These four profiles are linguistically distinct from one another and demonstrate that expert human raters examine a number of different linguistic features in a variety of combinations when assessing writing proficiency and assigning high scores to independent essays (regardless of the scoring rubric considered). The writing styles in the four clusters can be described as action and depiction style, academic style, accessible style, and lexical style. The study provides empirical evidence that successful writing cannot be defined simply through a single set of predefined features, but that, rather, successful writing has multiple profiles. While these profiles may overlap, each profile is distinct.

    doi:10.1177/0741088314526354

March 2014

  1. Seeking an Effective Program to Improve Communication Skills of Non-English-Speaking Graduate Engineering Students: The Case of a Korean Engineering School
    Abstract

    Research problem: Many Asian universities have begun reforms to enhance educational competitiveness in our globalizing economy. This study aims to ascertain the status of English communication education and English-medium instruction at a Korean engineering school and to offer workable suggestions for English communication training for Korean graduate engineering students. Research questions: Should English communication education be offered at the graduate level in Korean engineering schools? How could English communication education be improved for Korean graduate engineering students? Literature review: Studies of English communication education for graduate engineering students indicate that English as a Foreign Language (EFL) students have English needs to publish internationally and English needs for English-medium instruction classes and for after graduation. Furthermore, individual assistance and e-learning programs might strengthen English communication education and academic writing for EFL graduate engineering students. Methodology: An evaluation study was conducted at an institution that has been leading the wave of English as the language of instruction. We collected data from documents as well as through surveys of faculty and students in graduate engineering programs. Results and discussion: The study was conducted at the Korea Advanced Institute of Science and Technology. The results showed that students' English fluency is critical for the success of using English as a medium of instruction. To facilitate this fluency, universities need to establish an English communication center that provides a comprehensive, systematic approach to English language training. Faculty also need the services of such centers. It is also advised that a thesis writing course be customized according to students' actual writing and communication abilities and enhanced with collaboration between engineering faculty and English education faculty.

    doi:10.1109/tpc.2014.2310784
  2. ‘Enjoyable’, ‘okay’, or ‘like drawing teeth’? Chinese and British Students’ Views on Writing Assignments in UK Universities
    Abstract

    Research in academic writing is a growing field within Applied Linguistics, yielding a wide range of conferences, journal publications and books. However, comparatively little work has been conducted on students’ attitudes towards the production of writing for assessment. This article reports findings from a questionnaire study of Chinese and British students (n=202) across 37 UK universities. The study aims to uncover the extent to which students feel they were prepared for tertiary-level writing, how useful they find assignment-writing, and whether they enjoy this activity. The focus of the article is on the similarities and differences in attitudes towards assessed writing given by the two student groups. Chinese students were selected as a contrast to British students as the former are now the ‘largest single overseas student group’ in the UK with more than 60,000 Chinese people studying in 2008 (The British Council, 2010). Detailed, open-ended responses from the questionnaire were coded and followed up with email and face-to-face interview questions with a subset of students (n=55). The findings indicate that neither student group feel well-prepared for the challenges of tertiary-level writing, and reveal a depth of feeling regarding the enjoyment and perceived utility - or otherwise - of academic writing.

    doi:10.18552/joaw.v4i1.128
  3. Academic Writing Workshops: Impact of Attendance on Performance
    Abstract

    The purpose of this study is to explore if academic writing workshops contribute to students’ learning and performance in assessment. Academic writing workshops provide an opportunity to discuss specific learning areas and promote student engagement. The results of an assessed essay for a group of 65 first-year Mathematics students at Aston University, UK show that academic writing workshops have an association with students’ academic performance. An Independent Samples T-test was conducted to compare the mean performance of the students based on their attendance of academic writing workshops. The analyses reveal that students who attended 2-5 academic writing workhops had a far much better performance (mean: 58.60%) in comparison to students who attended 0-1 workshop (mean: 46.37%). In addition, the analyses show a statistically significant difference in the mean performance of students who attended and of students who did not attend an academic workshop specifically relating to the assessment.

    doi:10.18552/joaw.v4i1.139
  4. A Programmatic Ecology of Assessment: Using a Common Rubric to Evaluate Multimodal Processes and Artifacts
    doi:10.1016/j.compcom.2013.12.005
  5. The National Writing Project's Multimodal Assessment Project: Development of a framework for thinking about multimodal composing
    doi:10.1016/j.compcom.2013.12.004
  6. The Weight of Curious Space: Rhetorical Events, Hackerspace, and Emergent Multimodal Assessment
    doi:10.1016/j.compcom.2013.12.002
  7. Cross Talk
    Abstract

    A Response to Lindsey Harding’s “Writing beyond the Page: Reflective Essay as Box Composition” Rachel Ihara A Response to Rachel Ihara’s “Student Perspectives on Self-Assessment: Insights and Implications” Lindsey Harding

    doi:10.58680/tetyc201424605
  8. Feature: “Space to Grow”: Grading Contracts for Basic Writers
    Abstract

    The article provides suggestions for using a grading contract/portfolio approach to assessing writing for introductory composition classes comprised of basic writers.

    doi:10.58680/tetyc201424607
  9. Feature: Student Perspectives on Self-Assessment: Insights and Implications
    Abstract

    This article explores students’ responses to a formal self-assessment assignment, situating their views within the context of the texts they produced, identifying connections to scholarship on self reflection, and proposing a rethinking of pedagogical practices around reflective writing.

    doi:10.58680/tetyc201424603
  10. Closing Deals with Hamlet’s Help: Assessing the Instrumental Value of an English Degree
    Abstract

    Critics of contemporary higher education frequently overlook an important dimension of assessment of student learning: namely, the social and economic consequences used to justify the assessment measures in the first place. This essay argues that meaningful student assessment must take into account the unintended, transferable utility of liberal higher education. The authors, from a large master’s-comprehensive state university, use a recent survey of alumni of their English degree program from as far back as the 1960s to assess the importance that the degree has had in the lives of former students. Believing that disciplinary differences may help us to understand the navigational courses that emerge as seemingly nonlinear and unpredictable paths from the college degree to the life after college, the authors use students’ responses to identify how, where, and what students have used from their English courses in their most recent professions and, in turn, the limitations of current value-added assessments such as the Collegiate Learning Assessment (CLA).

    doi:10.58680/ce201424599

February 2014

  1. Theorizing Failure in US Writing Assessments
    Abstract

    How do teachers define failure when learning to write? We don’t ask the question often enough. In this article, I attempt to offer a definition and critique of the nature and production of failure in writing classrooms and programs. I argue that the production of failure in writing assessments can create more purposeful consequences, particularly for those historically most likely to suffer “failures” in writing classrooms: students of color, multilingual students, and working-class students. Drawing upon survey and grade data from California State University, Fresno, I examine two kinds of failure produced in writing classrooms, quality-failure and labor-failure. I argue that quality-failure (associated with judging the quality of drafts) is the least useful kind of failure for writing classrooms, while labor-failure (associated with work and effort) offers better consequences for student-writers and can help articulate a more robust writing construct by including noncognitive dimensions of writing. I conclude by proposing “productive failure” as a future possibility for writing classrooms.

    doi:10.58680/rte201424581