Journal of Technical Writing and Communication Oct 2006

A Decade of Research: Assessing Change in the Technical Communication Classroom Using Online Portfolios

Carol Siri Johnson New Jersey Institute of Technology

Abstract

Over a period of 10 years, we have developed a sustainable process of online portfolio assessment that demonstrates both reliability and validity, using both qualitative and quantitative measures. The sustainable cycle is that, each semester, we assess a random sampling of the students' work that they have posted, as per our instructions, in an online portfolio. During the reading, the faculty score the documents for 11 variables, including writing, content, audience awareness, and document design. We achieved validity by a modified online Delphi that led to a redefinition of the construct of technical communication itself; we achieved reliability by adjudication resulting in adjacent scores. The results of our assessment meet the requirements of ABET and result in a continual cycle of improvement for our technical communication curriculum. Results from three semesters show an improving correlation between the course grade and the overall, holistic portfolio score.

Journal
Journal of Technical Writing and Communication
Published
2006-10-01
DOI
10.2190/c481-k214-8472-n377
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
assessment portfolios technical communication
Export
BibTeX RIS

Citation Context

Cited by in this index (6)

  1. Ford et al. (2024)
    Integrating Professional Preparedness ePortfolios Within an Undergraduate Engin…
    IEEE Transactions on Professional Communication
  2. Sánchez (2017)
    The Roles of Technical Communication Researchers in Design Scholarship
    Journal of Technical Writing and Communication
  3. Lallmamode et al. (2016)
    Development and initial argument-based validation of a scoring rubric used in t…
    Assessing Writing
  4. Bacabac (2013)
    Creating Professional ePortfolios in Technical Writing
    Journal of Business and Technical Communication
  5. Boettger (2010)
    Rubric Use in Technical Communication: Exploring the Process of Creating Valid …
    IEEE Transactions on Professional Communication
Show all 6 →
  1. Yu (2008)
    Contextualize Technical Writing Assessment to Better Prepare Students for Workp…
    Journal of Technical Writing and Communication

References (19) · 3 in this index

  1. Huot B. (2002)
    (Re)Articulating Writing Assessment for Teaching and Learning
  2. Huot Brian (2002)
    (Re)Articulating Writing Assessment for Teaching and Learning
  3. Criteria for ABET can be found on their website at: <http://www.abet.org/forms.shtml> August 19, 2006.
  4. 10.2307/j.ctt46nxvm
     ↗
  5. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (1999)
    Standards for Educational and Psychological Testing
Show all 19 →
  1. Camp R. (1996)
    Assessment of Writing: Politics, Policies, and Practices
  2. Sternglass M. S. (1997)
    Time to Know Them: A Longitudinal Study of Writing and Learning at the College Level
  3. Miller C. M. (2004)
    Liberal Education in Twenty-First Century Engineering: Responses to ABET/EC2000 Criteria
  4. Johnson C. and Elliot N., Portfolio Assessment in Program Evaluation, ASEE Mid-Atlantic Section 2004 Fall Con…
  5. 10.1002/j.2168-9830.2005.tb00836.x
     ↗
  6. Coakley J., Placement in English Composition Courses: When “One-Size-Doesn't-Fit-All,” Fourteenth Internation…
  7. Elliot N. (2005)
    On A Scale: A Social History of Writing Assessment in America
  8. Elliot et al. (1994)
    The Assessment of Technical Writing: A Case Study
    Journal of Technical Writing and Communication
  9. Coppola (1999)
    Setting the discourse community: Tasks and assessment for the new technical com…
    Technical Communication Quarterly
  10. 10.2307/4140669
     ↗
  11. 10.2307/j.ctt46nxvm
     ↗
  12. Coppola N.
    Assessment in Professional and Technical Communication
  13. Dayton et al. (2004)
    Results of a Survey , of ATTW Members, 2003
    Technical Communication Quarterly
  14. Linstone H. A. and Turoff M., The Delphi Method: Techniques and Applications. Available at: <http://www.is.nj…
CrossRef global citation count: 10 View in citation network → Build reading path →

Related Articles

  1. IEEE Transactions on Professional Communication Jun 2024
    Integrating Professional Preparedness ePortfolios Within an Undergraduate Engineering Curriculum ↗
    Julie Dyke Ford; Destiny Crawford
    teacher development assessment portfolios technical communication
  2. Pedagogy Jan 2022
    Contributors ↗
    modern rhetorical theory rhetorical criticism genre theory discourse analysis african american rhetorics decolonial rhetorics first-year composition writing pedagogy basic writing writing across the curriculum graduate education teacher development argument collaborative writing transfer assessment portfolios writing program administration writing centers peer tutoring technical communication professional writing archival research digital rhetoric social media grammar and mechanics literacy studies race and writing gender and writing disability studies public rhetoric community literacy literary studies editorial matter
  3. Business and Professional Communication Quarterly Dec 2019
    Eportfolios on the Job: The Use of Assessment Eportfolios in the Business and Technical Communication Job Market ↗
    Ashley Clayson
    writing pedagogy assessment portfolios technical communication labor and working conditions
  4. Journal of Business and Technical Communication Apr 2017
    Assessing Multimodal Literacy in the Online Technical Communication Classroom ↗
    Tiffany Bourelle; Andrew Bourelle; Stephanie Spong; Brian Hendrickson
    genre theory first-year composition writing pedagogy teacher development assessment portfolios technical communication multimodality literacy studies
  5. Journal of Business and Technical Communication Jan 2013
    Creating Professional ePortfolios in Technical Writing ↗
    Florence Elizabeth Bacabac
    writing pedagogy assessment portfolios technical communication labor and working conditions literacy studies