YouTube Gamers and Think-Aloud Protocols: Introducing Usability Testing

Jamie May University of Colorado Colorado Springs

Abstract

Background:Recordings of gamers interacting with video games have become a mainstay of online video-sharing communities such as YouTube. Sometimes called Let's Play videos, those recordings include content relatable to usability testing sessions and potentially illustrate basic think-aloud protocols.Literature review:Research regarding think-aloud protocols indicates that the use of video to review concurrent user commentary is a valid usability testing technique, including sessions that include little to no tester instruction or intervention. Evaluation using a heuristic created for the studied interface can support this type of usability testing.Research questions:1. Based on a heuristic created from video game usability research, do Let's Play videos provide content representative of think-aloud protocols regarding usability of the games played? 2. Are relevant Let's Play videos potentially useful tools for illustrating think-aloud protocols to students unfamiliar with this type of usability testing?Methods:After reviewing research concerning video game heuristics to create a common set of guidelines, the author selected and reviewed five YouTube videos, gathering and coding information related to the heuristic.Results:The recordings were found to contain relevant information regarding video game usability based on the criteria developed from the literature, specifically considering verbalizations relative to think-aloud protocols.Conclusion:Because these gaming videos contain commentary measurable against a research-based heuristic for game usability, they could be used as an additional method to introduce think-aloud protocols to usability students.

Journal
IEEE Transactions on Professional Communication
Published
2019-03-01
DOI
10.1109/tpc.2018.2867130
CompPile
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (1)

  1. IEEE Transactions on Professional Communication

References (29) · 3 in this index

  1. 10.1177/154193129003401723
  2. How (much) to intervene in a usability testing session
    Common Ground
  3. 10.1016/j.ijhcs.2006.03.004
  4. This guy makes millions playing video games on YouTube
    Atlantic
  5. How has the rise of YouTubers affected how you make games?
    Gamasutra
Show all 29 →
  1. Usability 101: Introduction to usability
  2. Heuristics and usability guidelines for the creation of fun in video games
  3. 10.1145/985921.986102
  4. 10.1109/PCI.2009.14
  5. 10.1145/1357054.1357282
  6. Five Nights at Freddys - Scariest game ever! (lol no)
  7. 10.7551/mitpress/5657.001.0001
    Protocol Analysis Verbal Reports as Data  
  8. Bunny gives me nightmares!! - Five Nights at Freddy's - Part 1
  9. Think gaming content is niche? Think again
    Think with Google
  10. IEEE Transactions on Professional Communication
  11. Warning: Scariest game in years | Five Nights at Freddy's - Part 1
  12. 10.1006/ijhc.1994.1065
  13. Handbook of Usability Testing How to Plan Design and Conduct Effective Tests
  14. IEEE Transactions on Professional Communication
  15. Gamertube: PewDiePie and the YouTube commentary revolution
    Polygon
  16. IEEE Transactions on Professional Communication
  17. YouTube's biggest draw plays games, earns $4 million a year
    Wall Street J
  18. Heuristics for usability in games
  19. 10.1145/97243.97281
  20. Five Nights at Freddy's review: Nightmare and death at Chuck E Cheese's
    IndieGame
  21. Five Nights at Freddy's
  22. Five Nights at Freddy's #1 | The night shift
  23. This game is so creepy - Five Nights at Freddy's