Expert Judgments versus Reader Feedback: A Comparison of Text Evaluation Techniques

Menno D. T. De Jong; Leo R. Lentz

doi:10.2190/66yb-njew-jx8w-ydpr

Journal of Technical Writing and Communication Oct 1996

Expert Judgments versus Reader Feedback: A Comparison of Text Evaluation Techniques

Menno D. T. De Jong ; Leo R. Lentz

Abstract

Are technical writers able to predict the results of a reader-focused text evaluation? In this article we report a study with fifteen technical writers, who were asked to point out the reader problems in a public information brochure. The brochure was also evaluated with thirty readers from the target audience (using a combination of the plus-minus method, a questionnaire, and user protocols). The results of both kinds of text evaluation show little overlap. The technical writers only predicted a small proportion of the reader feedback, and produced a lot of new problem detections. In addition, there was little agreement among the technical writers with regard to their problem detections.

Journal: Journal of Technical Writing and Communication
Published: 1996-10-01
DOI: 10.2190/66yb-njew-jx8w-ydpr
CompPile: Search in CompPile ↗
Open Access: Closed
Topics: assessment
Export: BibTeX RIS

Citation Context

Cited by in this index (11)

Fuller et al. (2021)

Conceptualizing Empathy Competence: A Professional Communication Perspective

Journal of Business and Technical Communication
Schriver (2017)

Plain Language in the US Gains Momentum: 1940–2015

IEEE Transactions on Professional Communication
Wiatrak-Uhlenkott et al. (2013)

Book Reviews: Rhetorical Strategies and Genre Conventions in Literary Studies: …

Journal of Technical Writing and Communication
Ganier et al. (2012)

TIP-EXE: A Software Tool for Studying the Use and Understanding of Procedural D…

IEEE Transactions on Professional Communication
Jong et al. (2006)

Dynamics of Iterative Reader Feedback: An Analysis of Two Successive Plus-Minus…

Journal of Business and Technical Communication

Show all 11 →

Jong et al. (2001)

Readers' Background Characteristics and Their Feedback on Documents: The Influe…

Journal of Technical Writing and Communication
Jong et al. (2001)

Readers' Background Characteristics and Their Feedback on Documents: The Influe…

Journal of Technical Writing and Communication
Jong et al. (2000)

Toward a document evaluation methodology: what does research tell us about the …

IEEE Transactions on Professional Communication
Connatser (1999)

Last Rites for Readability Formulas in Technical Communication

Journal of Technical Writing and Communication
DEJONG et al. (1997)

Reader-Focused Text Evaluation: An Overview of Goals and Methods

Journal of Business and Technical Communication
Lentz et al. (1997)

The evaluation of text quality: expert-focused and reader-focused methods compared

IEEE Transactions on Professional Communication

References (27) · 2 in this index

Dumas J. S. (1993)

A Practical Guide to Usability Testing
Rubin J. (1994)

Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Velotta C. (1995)

Practical Approaches to Usability Testing for Technical Documentation
Wright P. (1985)

The Technology of Text: Principles for Structuring, Designing, and Displaying Text
10.1016/B978-0-12-223260-2.50019-0

↗

Show all 27 →

Schriver (1989)

Evaluating text quality: the continuum from text-focused to reader-focused methods

IEEE Transactions on Professional Communication
Swaney J. H. (1991)

Plain Language: Principles and Practice
Jansen et al. (1992)

Forms as a Source of Communication Problems

Journal of Technical Writing and Communication
10.1515/9783111701868.189

↗
de Jong M. D. T. (1994)

Functional Communication Quality

↗
Wright A. D. (1994)

The Bulletin of the Association for Business Communication
Schriver K. A. (1995)

Document Design as Rhetorical Action
Dieli M. (1986)

Designing Successful Documents: An Investigation of Document Evaluation Methods
Lentz L. (1992)

Studies of Functional Text Quality

↗
10.1016/S0020-7373(05)80167-1

↗
Desurvire H. W. (1994)

Usability Inspection Methods
Karat C. M. (1994)

Usability Inspection Methods
Mack R. (1994)

Usability Inspection Methods
de Jong M. D. T. (1992)

Pretest van de brochure Huursubsidie 1991–1992, Deelrapport 1 van het onderzoeksproject P…
de Haas W. (1994)

Government Information in the Netherlands
de Jong M. D. T. (1996)

Betrouwbaarheid en steekproefomvang bij een pretest met de plus-en-minmethode, Deelrappor…
10.1177/001872089203400407

↗
Wharton C. (1994)

Usability Inspection Methods
de Jong M. (1994)

Quality of Technical Documentation

↗
de Jong M. D. T. (1994)

Functional Communication Quality

↗
Lentz L. (1992)

Studies of Functional Text Quality

↗
Pander Maat H. (1994)

Functional Communication Quality

CrossRef global citation count: 21 View in citation network → Build reading path →

Expert Judgments versus Reader Feedback: A Comparison of Text Evaluation Techniques

Abstract

Citation Context

Cited by in this index (11)

References (27) · 2 in this index

Related Articles