IEEE Transactions on Professional Communication Mar 2010

Rubric Use in Technical Communication: Exploring the Process of Creating Valid and Reliable Assessment Tools

Ryan K. Boettger University of North Texas

Abstract

Assessing the quality of student efforts and products is a continual necessity for academics and practitioners in technical communication; however, the process of constructing valid and reliable rubrics remains an underexplored topic in the field. This paper first addresses some of the assessment concerns and then describes a case study that documents the development and implementation of one holistic and five analytic rubrics to evaluate undergraduate projects. The discussion focuses on identifying site-specific criteria and training effective raters and is intended to help academics respond to their required accreditation mandates and offer practitioners alternatives for evaluating products and services.

Journal
IEEE Transactions on Professional Communication
Published
2010-03-01
DOI
10.1109/tpc.2009.2038733
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
assessment technical communication qualitative research
Export
BibTeX RIS

Citation Context

Cited by in this index (2)

  1. Wilson-Fetrow et al. (2023)
    Engineering Students’ Writing Perceptions Impact Their Conceptual Learning
    IEEE Transactions on Professional Communication
  2. Boettger et al. (2018)
    Introduction to the Special Issue: Data-Driven Approaches to Research and Teach…
    IEEE Transactions on Professional Communication

Cites in this index (14)

  1. Warnock (2009)
    Methods and Results of an Accreditation-Driven Writing Assessment in a Business…
    Journal of Business and Technical Communication
  2. Katz (2008)
    Assessing a Hybrid Format
    Journal of Business and Technical Communication
  3. Taylor (2007)
    Comments on Lab Reports by Mechanical Engineering Teaching Assistants
    Journal of Business and Technical Communication
  4. Johnson (2006)
    A Decade of Research: Assessing Change in the Technical Communication Classroom…
    Journal of Technical Writing and Communication
  5. White (2005)
    The Scoring of Writing Portfolios: Phase 2
    College Composition and Communication
Show all 14 →
  1. Allen (2004)
    The Impact of Student Learning Outcomes Assessment on Technical and Professiona…
    Technical Communication Quarterly
  2. Brown et al. (2004)
    Accuracy in the scoring of writing: Studies of reliability and validity using a…
    Assessing Writing
  3. Cook (2003)
    How Much is Enough? The Assessment of Student Work in Technical Communication Courses
    Technical Communication Quarterly
  4. Coppola (1999)
    Setting the discourse community: Tasks and assessment for the new technical com…
    Technical Communication Quarterly
  5. ROGERS (1994)
    Analytic Measures for Evaluating Managerial Writing
    Journal of Business and Technical Communication
  6. Freedman (1993)
    Show and Tell? The Role of Explicit Teaching in the Learning of New Genres
    Research in the Teaching of English
  7. Allen (1993)
    The role(s) of assessment in technical communication: A review of the literature
    Technical Communication Quarterly
  8. Huot (1990)
    Reliability, Validity, and Holistic Scoring: What We Know and What We Need to Know
    College Composition and Communication
  9. Charney (1984)
    The Validity of Using Holistic Scoring to Evaluate Writing: A Critical Overview
    Research in the Teaching of English
Also cites 16 works outside this index ↓
  1. 10.1080/09500690802267579
     ↗
  2. 10.1177/026553229901600403
     ↗
  3. 10.1207/S15324818AME1302_1
     ↗
  4. 10.1111/j.1467-1770.1991.tb00610.x
     ↗
  5. 10.1177/0265532208094276
     ↗
  6. 10.1177/026553229801500205
     ↗
  7. 10.1080/0950069022000038268
     ↗
  8. 10.1177/026553229401100206
     ↗
  9. 10.3102/00346543060002237
     ↗
  10. 10.1177/1461445600002004004
     ↗
  11. 10.1177/1080569905279405
     ↗
  12. 10.1017/CBO9780511732997
     ↗
  13. 10.1109/IPCC.2005.1494219
     ↗
  14. 10.2307/256820
     ↗
  15. 10.1177/001316446002000104
     ↗
  16. 10.2307/3172601
     ↗
CrossRef global citation count: 15 View in citation network → Build reading path →

Related Articles

  1. IEEE Transactions on Professional Communication Mar 2026
    Surveys as UXR: Using Design Thinking to Shape a Survey-Based UX Assessment for Rural Audiences ↗
    Kaitlin J. Coyle; Derek G. Ross
    assessment technical communication qualitative research literacy studies
  2. IEEE Transactions on Professional Communication Dec 2023
    Fostering Advocacy, Developing Empathetic UX Bricoleurs: Ongoing Programmatic Assessment and Responsive Curriculum Design ↗
    Scott J. Kowalewski; Bill Williamson
    writing pedagogy curriculum design service learning teacher development assessment technical communication professional writing empirical research qualitative research
  3. Reflections: A Journal of Community-Engaged Writing and Rhetoric Jun 2020
    Pentadic Critique for Assessing and Sustaining Service-Learning Programs by Amy Rupiper Taggart ↗
    modern rhetorical theory rhetorical criticism service learning assessment technical communication qualitative research
  4. IEEE Transactions on Professional Communication Mar 2019
    YouTube Gamers and Think-Aloud Protocols: Introducing Usability Testing ↗
    Jamie May
    assessment technical communication qualitative research social media
  5. Journal of Technical Writing and Communication Jan 2019
    Testing the Test: Expanding the Dialogue on Technical Writing Assessment in the Academy and Workplace ↗
    Lindsay Tanner; Jon Balzotti
    genre theory writing pedagogy assessment technical communication professional writing qualitative research