Journal of Technical Writing and Communication Jan 2019 OA PDF

Testing the Test: Expanding the Dialogue on Technical Writing Assessment in the Academy and Workplace

Lindsay Tanner ; Jon Balzotti Brigham Young University

Abstract

The small amount of work on workplace writing assessment has focused almost entirely on student readiness for professional writing or included case studies of employer expectations for new writers. While these studies provide insight into current pedagogies for technical writing and writing instruction in general, the main conclusion to be drawn from them is the unsatisfactory number of recent graduates who display workplace readiness. In this article, we explore writing assessment research in both the academy and the workplace and attempt to identify ways in which the academy’s assessment practices lead, lag behind, or simply differ from writing assessment in the workplace. This comparison will serve to identify not only where the academy might improve pedagogy in its curriculum for technical communication in order to best prepare students for workplace writing but also where the workplace might learn from the academy to improve its own hiring and training procedures for technical writers. In this case study, we used Neff’s approach to grounded theory to categorize rater feedback according to a ranking system and then used statistical analysis to compare writer performance. We found that the direct test method yields the most predictive results when raters combine tacit knowledge with a clearly defined rubric. We hope that the methods used in this study can be replicated in future studies to yield further results when exploring workplace genres and what they might teach us about our own pedagogical practice.

Journal
Journal of Technical Writing and Communication
Published
2019-01-01
DOI
10.1177/0047281618784267
CompPile
Search in CompPile ↗
Open Access
OA PDF Bronze
Topics
genre theory writing pedagogy assessment technical communication professional writing qualitative research
Export
BibTeX RIS

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (29) · 12 in this index

  1. Ackerman (1991)
    Reading, Writing, and Knowing: The Role of Disciplinary Knowledge in Comprehens…
    Research in the Teaching of English
  2. Beaman, R. (August, 1990). Alternative student assessments in advertising copywriting …
  3. Bean J. C. (2011)
    Engaging ideas: The professor’s guide to integrating writing, critical thinking, and acti…
  4. Boettger R. K. (2014)
    Technical Communication
  5. Assessment (1995)
    Writing Assessment: A Position Statement
    College Composition and Communication
Show all 29 →
  1. Dias P. (1999)
    Worlds apart: Acting and writing in academic and workplace contexts
  2. Diederich P. (1974)
    Measuring growth in English
  3. Downs et al. (2007)
    Teaching about Writing, Righting Misconceptions:
    College Composition and Communication
  4. Elbow P. (1996)
    Assessment of writing: Politics, policies, practices
  5. Elbow (2006)
    Do we need a single standard of value for institutional assessment? An essay re…
    Assessing Writing
  6. Elbow et al. (1994)
    On the nature of holistic scoring: An inquiry composed on email
    Assessing Writing
  7. Haswell (1998)
    Rubrics, prototypes, and exemplars: Categorization theory and systems of writin…
    Assessing Writing
  8. Hart H. (2006)
    Technical Communication
  9. Huot B. A. (1993)
    Validating holistic scoring for writing assessment
  10. Kaufer D. S. (1993)
    Theory and practice in the teaching of writing: Rethinking the discipline
  11. 10.1093/applin/amp040
     ↗
  12. 10.2307/377930
     ↗
  13. Moss (1994)
    Validity in high stakes writing assessment: Problems and possibilities
    Assessing Writing
  14. 10.2307/j.ctt46nrqf.12
     ↗
  15. Penny et al. (2000)
    The effect of rating augmentation on inter-rater reliability
    Assessing Writing
  16. Perney, J. (April, 1994). Using writing samples to predict success in a graduate colleg…
  17. Petraglia J. (1995)
    Introduction: General writing skills instruction and its discontents. Reconceiving writin…
  18. 10.1002/j.2168-9830.2001.tb00660.x
     ↗
  19. Savage et al. (2010)
    Technical Communication Internship Requirements in the Academic Economy: How We…
    Journal of Technical Writing and Communication
  20. 10.1002/j.2161-1920.2005.tb00893.x
     ↗
  21. 10.2190/PL1C6
     ↗
  22. White (2005)
    The Scoring of Writing Portfolios: Phase 2
    College Composition and Communication
  23. Whiteside (2003)
    The Skills That Technical Communicators Need: An Investigation of Technical Com…
    Journal of Technical Writing and Communication
  24. Wiggins (1994)
    The constant danger of sacrificing validity to reliability: Making writing asse…
    Assessing Writing
CrossRef global citation count: 0 View in citation network → Build reading path →

Related Articles

  1. IEEE Transactions on Professional Communication Dec 2023
    Fostering Advocacy, Developing Empathetic UX Bricoleurs: Ongoing Programmatic Assessment and Responsive Curriculum Design ↗
    Scott J. Kowalewski; Bill Williamson
    writing pedagogy curriculum design service learning teacher development assessment technical communication professional writing empirical research qualitative research
  2. Pedagogy Jan 2022
    Contributors ↗
    modern rhetorical theory rhetorical criticism genre theory discourse analysis african american rhetorics decolonial rhetorics first-year composition writing pedagogy basic writing writing across the curriculum graduate education teacher development argument collaborative writing transfer assessment portfolios writing program administration writing centers peer tutoring technical communication professional writing archival research digital rhetoric social media grammar and mechanics literacy studies race and writing gender and writing disability studies public rhetoric community literacy literary studies editorial matter
  3. IEEE Transactions on Professional Communication Mar 2020
    Using a Transfer-Focused Writing Pedagogy to Improve Undergraduates’ Lab Report Writing in Gateway Engineering Laboratory Courses ↗
    Dave Kim; Wendy M. Olson
    rhetorical criticism genre theory first-year composition writing pedagogy basic writing teacher development argument transfer assessment technical communication professional writing scientific writing book reviews
  4. Journal of Technical Writing and Communication Jul 2008
    Contextualize Technical Writing Assessment to Better Prepare Students for Workplace Writing: Student-Centered Assessment Instruments ↗
    Han Yu
    genre theory writing pedagogy teacher development assessment technical communication professional writing literacy studies
  5. Journal of Technical Writing and Communication Apr 2005
    Perceptions of Memo Quality: A Case Study of Engineering Practitioners, Professors, and Students ↗
    Nicole Amare; Charlotte Brammer
    rhetorical criticism genre theory writing pedagogy technical communication professional writing qualitative research