Web sites increasingly encourage users to provide comments on the quality of the content by clicking on a feedback button and filling out a feedback form. Little is known about users’ abilities to provide such feedback. To guide the development of evaluation tools, this study examines to what extent users with various background characteristics are able to provide useful comments on informational Web sites. Results show that it is important to keep the feedback tools both simple and attractive so that users will be able and willing to provide useful feedback on Web site pages.

A brochure that had been revised on the basis of feedback from readers using the plus-minus evaluation method was evaluated again using the same method. This article compares the results of these two successive evaluation studies to examine the dynamics of evaluating and revising using a troubleshooting method based on verbal self-reports. The findings show that the plus-minus method does not necessarily lead to a decrease in the number of problems readers find in a revised document. But the types of problems readers find are significantly different. For example, after the brochure was revised, it had fewer clarity and structural problems, and readers could focus more on credibility issues.

Reader feedback is generally considered to be valuable input for writers who want to optimize their documents, but a reader-focused evaluation is often time-consuming. For this reason, we have developed Focus, a software tool for collecting reader comments more efficiently. The design and rationale of the software are described in this article. In a small-scale evaluation study, the results we obtained using Focus were compared to the reader feedback collected under the plus-minus method. It appeared that the number of problems detected per participant did not differ, but there were differences in the types of problems found. Focus participants appeared to comment more from a reviewer's and less from a user's perspective. Although the two methods are not interchangeable, Focus can be said to be a promising evaluation tool, deserving further research.

What is the influence of demographic variables such as gender and educational level on the reader feedback collected under the plus-minus method? To answer this question, an analysis was made of the problems detected in four public information brochures. The average amount of feedback per participant did not vary among the four brochures, but the severity of the problems did. Male participants mentioned more problems than female participants, but the problems detected by female participants were on average more severe. Highly educated participants detected more problems than participants with a lower level of education. No differences in problem types mentioned were found between male and female participants, and only one difference was found between the two educational levels: Highly educated participants focused more strongly on the structuring of information. In general, brochure characteristics had more effect on the types of feedback collected than the two demographic participant characteristics.