<bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Problem:</b> This tutorial aims to guide readers through key concepts, basic processes, and common decision points that inform computer-assisted corpus-based research in technical, professional, and scientific communication (TPSC). <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Key concepts:</b> Based on our collaborative experiences and an example developed for this tutorial, key concepts of corpus analysis useful to TPSC researchers and practitioners include the following: corpus location, text preparation, and programming language and software selection. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Key lessons:</b> These key concepts can be used to establish basic processes and decision points that, in turn, yield lessons related to the usefulness of lexicogrammatical language models and the significance of multidisciplinarity. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Implications:</b> Although corpus research is a growing and important part of the field of TPSC, challenges remain in terms of language model variety and ethical considerations. At least in part, these challenges can be met, respectively, by alignment between corpus and analytic tools and reference to the Common Rule and related international standards.

The Writing Mentor TM (WM) application is a Google Docs add-on designed to help students improve their writing in a principled manner and to promote their writing success in postsecondary settings. WM provides automated writing evaluation (AWE) feedback using natural language processing (NLP) methods and linguistic resources. AWE features in WM have been informed by research about postsecondary student writers often classified as developmental (Burstein et al., 2016b), and these features address a breadth of writing sub-constructs (including use of sources, claims, and evidence; topic development; coherence; and knowledge of English conventions). Through an optional entry survey, WM collects self-efficacy data about writing and English language status from users. Tool perceptions are collected from users through an optional exit survey. Informed by language arts models consistent with the Common Core State Standards Initiative and valued by the writing studies community, WM takes initial steps to integrate the reading and writing process by offering a range of textual features, including vocabulary support, intended to help users to understand unfamiliar vocabulary in coursework reading texts. This paper describes WM and provides discussion of descriptive evaluations from an Amazon Mechanical Turk (AMT) usability task situated in WM and from users-in-the-wild data. The paper concludes with a framework for developing writing feedback and analytics technology.

Expert readers’ responses to texts offer specific, meaningful insights useful in building English language arts models (ELA) for student writers. In the case of academic peer review, previous research has demonstrated that expert reviewers have specific expectations involving readers, texts, and processes. Identifying congruence between research on expert readers and the design of ELA models, however, has proven elusive—and detrimental to the advancement of student learning. One promising integrative direction is the study of two complementary ELA models, one emphasizing the role of meta-reading and the other of cognition. To explore the capability of an ELA model for writing studies informed by expert reader practice, we present a case study that has educative implications for the teaching of writing. Specifically, the study reports the observations of six expert readers reviewing manuscripts for an academic journal in writing studies. Following completion of an online survey of their reading aims as they reviewed manuscripts for publication, colleagues participated in a 30-minute semi-structured recorded interview about their strategies. The interview responses were coded using both meta-reading and cognitive models. Based on analysis of 529 reviewer comments included in the analysis, the findings support conceptualization of integrated, multi-faceted ELA models. While limited, our study has generative research and classroom implications for the development of writing studies pedagogy.

Reviewed: Standards for Educational and Psychological Testing, 6th ed.

In this article, we investigate disparate impact analysis as a validation tool for understanding the local effects of writing assessment on diverse groups of students. Using a case study data set from a university that we call Brick City University, we explain how Brick City’s writing program undertook a self-study of its placement exam using the disparate impact process followed by the Office for Civil Rights of the US Department of Education. This three-step process includes analyzing placement rates through (1) a threshold statistical analysis, (2) a contextualized inquiry to determine whether the placement exam meets an important educational objective, and (3) a consideration of less discriminatory assessment alternatives. By employing such a process, Brick City re-conceptualized the role of placement testing and basic writing at the university in a way that was less discriminatory for Brick City’s diverse student population.

Distinct from prose essays as cultural expression, we use technical communication for functional purposes, addressing questions of how people learn as we craft our communications. Aristotle set out psychological principles of how people learn -- or are persuaded to change their minds -- when he laid down his foundational advice for rhetors to cultivate "the faculty of observing in any given case the available means of persuasion on almost any subject presented to us." Building on this foundational principle, technical communicators since World War II have studied how to achieve persuasion (or change) by making information accessible, formatting documents, writing at designated reading levels, and setting out instruction steps clearly. Recently, we have also become interested in how, through the concept of rhetoric, oral and written language acquires poignant social, ethical and technical dimensions, situating Aristotle's "faculties" of persuasion within specific cultural and political contexts.

Research problem: A construct mediated in digital environments, information communication technology (ICT) literacy is operationally defined as the ability of individuals to participate effectively in transactions that invoke illocutionary action. This study investigates ICT literacy through a simulation designed to capture that construct, to deploy the construct model to measure participant improvement of ICT literacy under experimental conditions, and to estimate the potential for expanded model development. Research questions: How might a multidisciplinary literature review inform a model for ICT literacy? How might a simulation be designed that enables sufficient construct representation for modeling? How might prepost testing simulation be designed to investigate the potential for improved command of ICT literacy? How might a regression model account for variance within the model by the addition of affective elements to a cognitive model? Literature review: Existing conceptualizations of the ICT communication environment demonstrate the need for a new communication model that is sensitive to short text messaging demands in crisis communication settings. As a result of this prefect storm of limits requiring the communicator to rely on critical thinking, awareness of context, and information integration, we designed a cognitive-affective model informed by genre theory to capture the ICT construct: A sociocognitive ability that, at its most effective, facilitates illocutionary action—to confirm and warn, to advise and ask, and to thank and request—for specific audiences of emergency responders. Methodology: A prepost design with practitioner subjects <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex Notation="TeX">$({N}=50)$</tex></formula> allowed investigation of performance improvement on tasks demanding illocutionary action after training on tasks of high, moderate, and low demand. Through a model based on the independent variables character count, wordcount, and decreased time on task <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex Notation="TeX">$(X)$</tex></formula> as related to the dependent variable of an overall episode score <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex Notation="TeX">$(Y)$</tex></formula> , we were able to examine the internal construct strength with and without the addition of affective independent variables. Results and discussion: Of the three prepost models used to study the impact of training, participants demonstrated statistically significant improvement on episodes of high demand on all cognitive model variables. The addition of affective variables, such as attitudes toward text messaging, allowed increased model strength on tasks of high and moderate complexity. These findings suggest that an empirical basis for the construct of ICT literacy is possible and that, under simulation conditions, practitioner improvement may be demonstrated. Practically, it appears that it is possible to train emergency responders to improve their command of ICT literacy so that those most in need of humanitarian response during a crisis may receive it. Future research focusing on communication in digital environments will undoubtedly extend these finding in terms of construct validation and deployment in crisis settings.

The purpose of the present study is to examine concurrent and predictive evidence used in the validation of ACCUPLACER, a purchased test used to place first-year students into writing courses at an urban, public research university devoted to science and technology education. Concurrent evidence was determined by correlations between ACCUPLACER scores and scores on two other tests designed to measure writing ability: the New Jersey Basic Skills Placement Test and the SAT Writing Section. Predictive evidence was determined by coefficients of determination between ACCUPLACER scores and end-of-semester performance measures. A longitudinal study was also conducted to investigate the grade history of students placed into first-year writing by established and new methods. When analyzed in terms of gender and ethnicity impact, ACCUPLACER failed to achieve statistically significant prediction rates for student performance. The study reveals some limits of placement testing and the problems related to it.

For what purpose is this midrash presented? As parable, paraphrase, prophecy, and dramatic monologue, midrash offers an illuminating perspective on Louise Rosenblatt's Literature as Exploration. Deeply influenced by libertarian ideals of her family, Rosenblatt crafted a unique philosophy in which the process of reading literature was intertwined with the aims of democratic citizenry. Working to understand her insistence on the need for imaginative extension helps us to recall a vanished ideal of democratic culture and the role that literature was to play within it.

This article describes the design and evaluation of a formal writing assessment program within a technical writing course. Our purpose in this base-line study was to evaluate student writing at the conclusion of the course. In implementing this evaluation, we addressed fundamental issues of sound assessment: reliability and validity. Our program may encourage others seeking to assess educational outcomes in technical writing courses.

Technical writing will become increasingly important to the nation's engineering interests in the 21st century. To meet a national agenda of competitiveness, writing program administrators must build courses and programs that are sensitive to unique institutional perceptions about writing. By means of a quantitative and qualitative methodology, the present study describes the perceptions of technical writing held by department heads at a technological university. Using a combined survey method and structured interview process, we investigate how department chairs felt about the contents, instruction, and assessment of a technical writing course. We also investigate perceptions about writing products and processes. Based on our experiences with the survey, we call for writing program administrators to study the institutional context for courses and programs in technical writing.

This book is a major breakthrough for developers of writing assessment programs who must certify the writing competency of undergraduate students. Legislators and accreditation boards across the nation have called for and implemented large scale projects to measure educational outcomes. This single source provides comprehensive information on the history, underlying concepts, and process of conducting a large scale writing assessment program at a specific institution of higher education. The handbook opens with an analysis of the rationale for the assessment of writing during the junior year of the undergraduate curriculum. The authors then turn to a case study of the success of their own institutional wide assessment program. A history is provided of 20th century writing assessment practices; as well, attention is given to defining levels of literacy. After describing an assessment process model, discussion turns to the design of questions, the administration of the assessment, the rating of papers, and the statistical analysis of data. Attention is also given to the design of a course for those who are unsuccessful on the assessment. The study closes with directions for further research and over 200 references in the bibliography.