Product Review Users' Perceptions of Review Quality: The Role of Credibility, Informativeness, and Readability

Jo Mackiewicz Iowa State University ; Dave Yeats PayPal (United States)

Abstract

Research problem: Gauging the quality of product reviews through helpfulness votes is problematic for a variety of reasons. We examine potential characteristics of review quality that span review credibility, informativeness, and readability to contribute to better ways of assessing review quality. Research question: Do specific review characteristics improve reviewer users' perceptions of review quality? Literature review: Studies from information systems, electronic marketing and commerce, and technical and professional communication suggest that characteristics of reviews fall into three areas, each with specific characteristics of quality. Findings from these studies suggest the 11 characteristics of review quality within those three areas as potential contributors to review quality. The first area is credibility, a construct consisting (in part) of expertise; we tested these potential specific characteristics of credibility: an assertion of a relevant role, of use of a prior model, of other products in the brand, of a similar product, of having conducted research on the product, and of having tested the product. The second area is informativeness, which is a review's diagnosticity. We tested these potential specific characteristics: a general recommendation, a specific recommendation, a statement about the product's value, and a statement about the extent to which the product met expectations. The third area is readability, which is (in part) comfort of reading, and has this specific characteristic: the use of headings. Methodology: We conducted a quantitative study using a survey distributed though SurveyMonkey Audience, a service that samples from a pool of 30 million respondents. Using control and experimental versions of 11 product reviews, we gauged participants' perceptions of review quality on a five-point scale. We looked for significant differences in participants' perceptions of quality using Pearson's chi square. Results and conclusions: We received 829 responses to include in the analysis. We found the following significant at the p > 0.05 level: a statement about reviewer's prior experience with a similar product (credibility). We found the following significant at the p > 0.01 level: A statement about researching the product, for example, online research (credibility), a general recommendation about the product (informativeness), and formatting with headings (readability). We found the following significant at the p > 0.001 level: a statement about the extent to which the product met expectations (informativeness) and a specific recommendation about the product (informativeness). Using these results, companies can better locate quality reviews; reviewers can increase the quality and, therefore, salience of their reviews; and communication specialists can help reviewers write and revise reviews for improved quality. Future research on review quality could investigate other potential characteristics of credibility, informativeness, and readability.

Journal
IEEE Transactions on Professional Communication
Published
2014-12-01
DOI
10.1109/tpc.2014.2373891
CompPile
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (8)

  1. Journal of Business and Technical Communication
  2. IEEE Transactions on Professional Communication
  3. IEEE Transactions on Professional Communication
  4. IEEE Transactions on Professional Communication
  5. IEEE Transactions on Professional Communication
Show all 8 →
  1. Journal of Technical Writing and Communication
  2. IEEE Transactions on Professional Communication
  3. IEEE Transactions on Professional Communication

References (30) · 3 in this index

  1. 10.1145/1526709.1526729
  2. 10.1016/j.elerap.2011.10.003
  3. Understanding and mitigating uncertainty in online exchange relationships: A principal-ag…
    MIS Quart  
  4. Journal of Business and Technical Communication
  5. 10.1109/HICSS.2011.260
Show all 30 →
  1. Social Cognition
  2. 10.1016/j.ijhcs.2008.09.012
  3. 10.1016/j.tourman.2010.12.011
  4. 10.2139/ssrn.1282303
  5. Low-quality product review detection in opinion summarization
    Proc Joint Conf Empirical Methods Natural Lang Process Computat Natural Lang Learn
  6. 10.1016/j.pec.2009.09.030
  7. The Cult of the Amateur How Today's Internet is Killing Our Culture
  8. 10.3115/1219840.1219857
  9. Can user-generated content change your world?
    EMarketer
  10. Acquisition of subjective adjectives with limited resources
    Proc AAAI Spring Symp Exploring Attitude and Affect in Text
  11. 10.1109/TKDE.2010.188
  12. Social media is NOT that bad! The lexical quality of social media
    Proc 6th AAAI Int Conf on Weblogs and Social Media
  13. 10.3115/1219840.1219855
  14. 10.1509/jmkg.74.2.133
  15. 10.1016/j.jretai.2004.04.001
  16. 10.1016/j.chb.2010.01.005
  17. 10.1145/1386790.1386838
  18. 10.1002/dir.10073
  19. 10.1177/0165551508089719
  20. Quality in product reviews: What technical communicators should know
    Tech Commun
  21. IEEE Transactions on Professional Communication
  22. The impact of review environment on review credibility
    IEEE Trans Prof Commun
  23. Perceptions of product review quality: Testing credibility, informativeness, and readability
    Int Commun Assoc Conf
  24. Journal of Technical Writing and Communication
  25. Millions are ready to share their opinions