IEEE Transactions on Professional Communication Sep 2010

Assessing Concurrent Think-Aloud Protocol as a Usability Test Method: A Technical Communication Approach

Lynne Cooke West Chester University

Abstract

Concurrent think-aloud protocol (CTA) is often used in usability test settings to gain insight into participants' thoughts during their task performances. This study adds to a growing body of research within technical communication that addresses the use of think-aloud protocols in usability test settings. The eye movements and verbalizations of 10 participants were recorded as they searched for information on a website. The analysis of transcripts and real-time eye movement showed that CTA is an accurate data-collection method. The researcher found that the majority of user verbalizations in the study included words, phrases, and sentences that users read from the screen. Silence and verbal fillers that occurred during CTA enabled users to assess and process information during their searches. This study demonstrates the value technical communicators add to the study of usability test methods, and the paper recommends future avenues of research.

Journal
IEEE Transactions on Professional Communication
Published
2010-09-01
DOI
10.1109/tpc.2010.2052859
CompPile
Open Access
Closed
Topics
technical communication qualitative research
Export
BibTeX RIS

Citation Context

Cited by in this index (18)

  1. Mysore et al. (2026)
    Visualizing Heat Risk: Infographics, Memorability, and Design
    Journal of Technical Writing and Communication
  2. Yu (2026)
    From vision to insight: Enhancing students’ user-centered design skills with ey…
    Computers and Composition
  3. Green (2026)
    Trans and Queer Visibility in an Era of Hyper Surveillance: A User Experience S…
    Journal of Technical Writing and Communication
  4. Shivener et al. (2025)
    Capturing the Experiences of Simulated Writing for Novice Virtual Reality Users
    IEEE Transactions on Professional Communication
  5. St.Amant (2024)
    ARCO Mapping the Cognitive Dynamics of Communication Expectations: An Approach …
    Journal of Technical Writing and Communication
Show all 18 →
  1. Wright (2024)
    Perspectives on Usability Testing with IoT Devices in Technical Communication Courses
    Technical Communication Quarterly
  2. Tham et al. (2022)
    Extending Design Thinking, Content Strategy, and Artificial Intelligence into T…
    Journal of Technical Writing and Communication
  3. Gallagher et al. (2021)
    Phenomenology of writing with unfamiliar tools in a semi-public environment: A …
    Computers and Composition
  4. Lanius et al. (2021)
    User Experience Methods in Research and Practice
    Journal of Technical Writing and Communication
  5. Carradini (2020)
    A Comparison of Research Topics Associated With Technical Communication, Busine…
    IEEE Transactions on Professional Communication
  6. May (2019)
    YouTube Gamers and Think-Aloud Protocols: Introducing Usability Testing
    IEEE Transactions on Professional Communication
  7. Chong (2018)
    Implementing Usability Testing in Introductory Technical Communication Service …
    IEEE Transactions on Professional Communication
  8. Bartolotta et al. (2017)
    Revising the Online Classroom: Usability Testing for Training Online Technical …
    Technical Communication Quarterly
  9. Acharya (2017)
    User value and usability in technical communication: a value-proposition design model
    Communication Design Quarterly
  10. Chong (2016)
    The Pedagogy of Usability: An Analysis of Technical Communication Textbooks, An…
    Technical Communication Quarterly
  11. Elling et al. (2012)
    Combining Concurrent Think-Aloud Protocols and Eye-Tracking Observations: An An…
    IEEE Transactions on Professional Communication
  12. McDonald et al. (2012)
    Exploring Think-Alouds in Usability Testing: An International Survey
    IEEE Transactions on Professional Communication
  13. Redish (2010)
    Technical Communication and Usability: Intertwined Strands and Mutual Influences
    IEEE Transactions on Professional Communication

References (53) · 6 in this index

  1. cooke (2008)
    how do users search web home pages? an eye-tracking study of multiple navigation menus
    Tech Commun
  2. cooke (2005)
    Eye tracking: How it works and how it relates to usability
    Tech Commun
  3. 10.1177/154193129003401719
     ↗
  4. van den haak (2007)
    evaluation of an informational web site: three variants of the think-aloud method compared
    Tech Commun
  5. Haak et al. (2006)
    Constructive Interaction: An Analysis of Verbal Interaction in a Usability Setting
    IEEE Transactions on Professional Communication
Show all 53 →
  1. 10.1016/j.intcom.2004.07.007
     ↗
  2. jacob (2003)
    Cognitive and Applied Aspects of Eye Movement Research
  3. 10.1037/h0027443
     ↗
  4. 10.1177/154193129003401720
     ↗
  5. 10.1080/01449290701773842
     ↗
  6. Krahmer (2004)
    Thinking About Thinking Aloud: A Comparison of TwoVerbal Protocols for Usabilit…
    IEEE Transactions on Professional Communication
  7. rubin (1994)
    Handbook of Usability Testing How to Plan Design and Conduct Effective Tests
  8. 10.1080/0044929031000
     ↗
  9. byrne (2003)
    The Human-computer interaction handbook
  10. 10.1145/502907.502908
     ↗
  11. 10.2307/356600
     ↗
  12. 10.2307/358259
     ↗
  13. 10.2307/376913
     ↗
  14. nielsen (1993)
    Usability Engineering
  15. 10.2307/377376
     ↗
  16. dumas (1994)
    A Practical Guide to Usability Testing
  17. schneiderman (1998)
    Designing the User Interface Strategies for Effective Human-Computer Interaction
  18. 10.1016/B978-008043361-5/50013-4
     ↗
  19. 10.1016/S0010-0277(02)00017-3
     ↗
  20. Jong et al. (2000)
    Toward a document evaluation methodology: what does research tell us about the …
    IEEE Transactions on Professional Communication
  21. goffman (1981)
    Forms of Talk
  22. Sullivan (1989)
    Beyond a narrow conception of usability testing
    IEEE Transactions on Professional Communication
  23. 10.1207/S1532785XMEP0203_2
     ↗
  24. 10.1109/IPCC.1988.24046
     ↗
  25. ericsson (1993)
    10.7551/mitpress/5657.001.0001
    Protocol Analysis Verbal Aspects as Data  ↗
  26. ericsson (1980)
    Protocol Analysis
  27. 10.1016/0010-0285(90)90004-N
     ↗
  28. 10.1037/0003-066X.47.6.802
     ↗
  29. 10.1037/0022-3514.60.2.181
     ↗
  30. 10.1037/0096-3445.122.2.166
     ↗
  31. 10.3758/BF03202637
     ↗
  32. Boren et al. (2000)
    Thinking aloud: reconciling theory and practice
    IEEE Transactions on Professional Communication
  33. 10.1146/annurev.psych.54.101601.145044
     ↗
  34. anderson (1993)
    Rules of the Mind
  35. holtzblatt (2003)
    The Human-computer interaction handbook
  36. 10.1146/annurev.psych.48.1.61
     ↗
  37. 10.1109/IPCC.1988.24019
     ↗
  38. 10.1097/00006324-199507000-00005
     ↗
  39. ramey (1987)
    usability testing: conducting the test procedure itself
    Proc Int Professional Communication Conf
  40. Redish (1989)
    Reading to learn to do
    IEEE Transactions on Professional Communication
  41. krug (2005)
    Don't Make Me Think A Common Sense Approach to Web Usability
  42. redish (2007)
    Letting Go of the Words Writing Web Content That Works
  43. 10.1016/0042-6989(77)90207-3
     ↗
  44. nielsen (2006)
    Prioritizing Web Usability
  45. wesolowsky (1976)
    Multiple Regression and Analysis of Variance
  46. 10.1086/266577
     ↗
  47. ericsson (1988)
    concurrent verbal reports on reading and text compression
    Text  ↗
  48. 10.1037/0033-2909.124.3.372
     ↗
CrossRef global citation count: 122 View in citation network → Build reading path →

Related Articles

  1. Journal of Technical Writing and Communication May 2026
    The User Experience of Virtual Reality for Longitudinal Writing: A Diary Study of Immersive Graduate Dissertation Composing Experience ↗
    Jason Tham; Rich Shivener; Niveditha Pookkottuvariam; Sarah Riddick
    rhetorical criticism graduate education technical communication archival research empirical research qualitative research
  2. Journal of Technical Writing and Communication Mar 2026
    “It's Hard to Show ROI When You’re Preventing Things from Happening”: How Impact Storytelling Frames Community Health Initiatives for Executive Audiences ↗
    Margaret Hsiao
    technical communication professional writing qualitative research
  3. IEEE Transactions on Professional Communication Mar 2026
    Effective Practices for User-Centered Instant Localization of a Screen Reader Software ↗
    Zsuzsanna B. Palmer
    technical communication professional writing qualitative research
  4. IEEE Transactions on Professional Communication Mar 2026
    Surveys as UXR: Using Design Thinking to Shape a Survey-Based UX Assessment for Rural Audiences ↗
    Kaitlin J. Coyle; Derek G. Ross
    assessment technical communication qualitative research literacy studies
  5. Technical Communication Quarterly Feb 2026
    “No Mining Engineer Could Be a Lady”: A Historical Case Study of Drag and Humor in Technical Writing, 1911–1917 ↗
    Andrew Fiss
    technical communication qualitative research