Role Play: Conversational Roles as a Framework for Reflexive Practice in AI-Assisted Qualitative Research

Luke Thominet Florida International University ; Jacqueline Amorim Florida International University ; Kristine Acosta Florida International University ; Vanessa K. Sohan

Abstract

Previous literature has shown that generative artificial intelligence (GAI) software, including large language model (LLM) chatbots, might contribute to qualitative research studies. However, there is still a need to examine the relationships between researchers, GAI technologies, data, and findings. To address this need, our team conducted a thematic analysis of our reflexive journals from an LLM chatbot-assisted research project. We identified four roles that researchers adopted: managers closely monitored the LLM's work, teachers instructed the LLM on theories and methods, colleagues openly discussed the data with the LLM, and advocates worked with the LLM to improve user experiences. Planning for and playing with multiple roles also helped to enrich the research process. This study underscores the potential for using conversational roles as a framework to support reflexivity when working with GAI technologies on qualitative research.

Journal
Journal of Technical Writing and Communication
Published
2024-10-01
DOI
10.1177/00472816241260044
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (2)

  1. Computers and Composition
  2. Journal of Technical Writing and Communication

References (46) · 9 in this index

  1. Journal of Technical Writing and Communication
  2. Algorithmic Justice League (2024). About. https://www.ajl.org/.
  3. Reflexive methodology: New vistas for qualitative research
  4. Anthropic (2023a). Claude (2.0) [AI Assistant]. https://www.anthr…
  5. Anthropic. (2023b). How long do you store personal data? Anthropic Support, https://support.anthropic.com/en/…
Show all 46 →
  1. arXiv
  2. 10.1145/3442188.3445922
  3. Successful qualitative research: A practical guide for beginners
  4. Thematic analysis: A practical guide
  5. Proceedings of the 41st ACM International Conference on Design of Communication
  6. AI and Writing
  7. 10.1177/104973202129120052
  8. Business and Professional Communication Quarterly
  9. Let’s flip the script: An African American discourse on language, literature, and learning
  10. Technical Communication Quarterly
  11. Gross T. (2023, November 28). Unmasking AI’s racism and sexism. [Audio podcast]. In Fre…
  12. 10.1177/16094069231201504
  13. 10.34293/education.v8i2.1477
  14. What writing does and how it does it: An Introduction to analyzing texts and textual practices
  15. 10.1007/978-0-585-35958-8_1
  16. Journal of Technical Writing and Communication
  17. College Composition and Communication
  18. Kochhar R. (2023, July 26). Which US Workers Are More Exposed to AI on Their Jobs? Pew …
  19. Lancaster A. (2023, March 20). Beyond chatbots: The rise of large language models. Forb…
  20. Technical Communication Quarterly
  21. Superminds: The surprising power of people and computers thinking together
  22. Master’s degree consortium of writing studies specialists roster (2019). https://docs.google.com/spreadsheets…
  23. SSRN Electronic Journal
  24. Melonçon L. (n.d.). Maps of TPC programs. Tek-Ritr . Retrieved Ma…
  25. Co-intelligence: Living and working with AI
  26. 10.1177/16094069231211248
  27. The Design of Everyday Things
  28. 10.1007/s11747-019-00710-5
  29. 10.21105/joss.03522
  30. Journal of Technical Writing and Communication
  31. 10.1002/9781444392654
  32. 10.1016/j.cpa.2024.102722
  33. Communication Design Quarterly
  34. The sage encyclopedia of action research
  35. Proceedings of the 41st ACM International Conference on Design of Communication
  36. 10.1177/16094069241231168
  37. 10.37514/TPC-B.2022.1725.2.08
  38. arXiv
  39. 10.1016/0277-5395(88)90024-6
  40. 28th International Conference on Intelligent User Interfaces
  41. Communication Design Quarterly