Abstract

The emergence of large language models (LLMs) has disrupted approaches to writing in academic and professional contexts. While much interest has revolved around the ability of LLMs to generate coherent and generically responsible texts with minimal effort and the impact that this will have on writing careers and pedagogy, less attention has been paid to how LLMs can aid writing research. Building from previous research, this study explores the utility of AI text generators to facilitate the qualitative coding research of linguistic data. This study benchmarks five LLM prompting strategies to determine the viability of using LLMs as qualitative coding, not writing, assistants, demonstrating that LLMs can be an effective tool for classifying complex rhetorical expressions and can help business and technical communication researchers quickly produce and test their research designs, enabling them to return insights more quickly and with less initial overhead.

Journal
Journal of Business and Technical Communication
Published
2024-07-01
DOI
10.1177/10506519241239927
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (4)

  1. Technical Communication Quarterly
  2. Technical Communication Quarterly
  3. IEEE Transactions on Professional Communication
  4. Technical Communication Quarterly

References (50) · 15 in this index

  1. Genre: An introduction to history, theory, research, and pedagogy
  2. 10.1145/3442188.3445922
  3. Analysing genre: Language use in professional settings
  4. IEEE Transactions on Professional Communication
  5. Advances in Neural Information Processing Systems
Show all 50 →
  1. Journal of Business and Technical Communication
  2. 10.1016/j.esp.2011.04.001
  3. Chowdhery A., Narang S., Devlin J., Bosma M., Mishra G., Roberts A., Barham P., Won Chung H., Sutton C., Gehr…
  4. Journal of Business and Technical Communication
  5. Journal of Business and Technical Communication
  6. 10.1093/elt/54.4.369
  7. 10.1016/j.esp.2015.10.001
  8. 10.37514/PRA-B.2019.0230
  9. Ghahramani Z. (2023). Introducing PaLM 2 . Google. https://blog.g…
  10. Rhetoric Society Quarterly
  11. Hajikhani A., Cole C. (2023). A Critical Review of Large Language Models: Sensitivity, …
  12. 10.1007/s11192-022-04358-x
  13. 10.4324/9780429485480
  14. 10.3102/003465430298487
  15. Jiang E., Olson K., Toh E., Molina A., Donsbach A., Terry M., Cai C. J. (2022). Promptmaker: Prompt-based pro…
  16. Technical Communication Quarterly
  17. Kane M. (2020). Communicating the “write” values: Developing methods of computer-aided text analysis for inst…
  18. Advances in Neural Information Processing Systems
  19. Larson B., Hart-Davidson W., Walker K. C., Walls D. M., Omizo R. (2016). Use what you choose: Applying comput…
  20. Advances in Neural Information Processing Systems
  21. Written Communication
  22. Technical Communication Quarterly
  23. 10.1080/00335638409383686
  24. Narang S., Chowdhery A. (2022). Pathways language model (PaLM): scaling to 540 billion …
  25. Omizo R., Meeks M., Hart-Davidson W. (2021). Detecting high-quality comments in written feedback with a zero …
  26. Rhetorical machines: Writing, code, and computational ethics
  27. Written Communication
  28. Reynolds L., McDonell K. (2021). Prompt programming for large language models: Beyond the few-shot paradigm. …
  29. Written Communication
  30. 10.1016/S0889-4906(00)00023-5
  31. Written Communication
  32. Siad S. M. (n.d.). The promise and perils of Google’s bard for scientific research …
  33. Spinuzzi C. (2002). Modeling genre ecologies. In Proceedings of the 20th Annual Interna…
  34. Written Communication
  35. Genre analysis: English in academic and research settings
  36. Journal of Business and Technical Communication
  37. Turpin M., Michael J., Perez E., Bowman S. R. (2023). Language models don’t always say …
  38. 10.1177/1461445609341006
  39. Advances in neural information processing systems
  40. Technical Communication Quarterly
  41. Wang L., Xu W., Lan Y., Hu Z., Lan Y., Lee R. K. W., Lim E. P. (2023). Plan-and-solve p…
  42. Wei J., Bosma M., Zhao V. Y., Guu K., Yu A. W., Lester B., Du N., Dai A. M., Le Q. V. (2022). …
  43. Advances in Neural Information Processing Systems
  44. Journal of Business and Technical Communication
  45. Zhang Z., Zhang A., Li M., Zhao H., Karypis G., Smola A. (2023). Multimodal chain-of-th…