Abstract

This study explores how prompting techniques, especially those integrated with rhetorical analysis results, may improve the effectiveness of artificial intelligence (AI)-generated business communication messages. I conducted an experiment to assess the effectiveness of these prompting techniques in the context of crafting a negative message generated with ChatGPT 3.5 ( n = 85). A multiple regression was calculated to explore prompting techniques’ impact on the negative message grades and how each technique influences the message grade. The results ( F(4, 80) = 31.84, p < .001), with an adjusted R2 = .595, indicate a positive relationship between prompting techniques and the effectiveness of AI-generated messages. This study also identified challenges related to students’ AI literacy. I conclude the study by recommending practical measures on how to incorporate AI into business and professional writing classrooms.

Journal
Journal of Technical Writing and Communication
Published
2024-10-01
DOI
10.1177/00472816241260033
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (1)

  1. Technical Communication Quarterly

References (43) · 4 in this index

  1. 10.1057/s41599-023-02269-7
  2. Genre: An introduction to history, theory, research, and pedagogy
  3. 10.1007/s11528-023-00896-0
  4. Chenault C. (n.d.). Beginner’s guide: How to incorporate feedback loops in ChatGPT …
  5. The complete obsolete guide to generative AI
Show all 43 →
  1. Cohen A. (n.d.). Prompt engineering: Automatic application idea to code generator …
  2. Writing genres
  3. Dhaduk H. (2023). Reinforcement Learning from Human Feedback (RLHF): Benefits, challeng…
  4. 10.1016/j.ijinfomgt.2023.102642
  5. 10.1016/j.jrt.2023.100060
  6. 10.36227/techrxiv.22683919.v2
  7. Business communication: Process & product
  8. Hu K. (2023). ChatGPT sets record for fastest-growing user base. Reuters …
  9. Kong A., Zhao S., Chen H., Li Q., Qin Y., Sun R., Zhou X. (2023). Better zero-shot reasoning with role-play p…
  10. 10.15678/EBER.2023.110302
  11. TextGenEd: Teaching with text generation technologies
  12. 10.26615/978-954-452-092-2_069
  13. Li Z., Yang Z., Wang M. (2023). Reinforcement learning with human feedback: Learning dynamic choices via pess…
  14. 10.1016/j.ijme.2023.100790
  15. Business and administrative communication
  16. Long J. (2023). Large language model guided tree-of-thought. arXiv …
  17. 10.1080/00335638409383686
  18. Rhetoric Society Quarterly
  19. 10.1016/j.chbah.2023.100027
  20. 10.2139/ssrn.4300783
  21. Business and Professional Communication Quarterly
  22. 10.1007/s10462-022-10246-w
  23. 10.1016/j.metrad.2023.100022
  24. 10.1609/hcomp.v8i1.7469
  25. OpenAI. (n.d.). Prompt engineering . https://platform.openai.com/…
  26. Ouyang L., Wu J., Jiang X., Almeida D., Wainwright L., Mishkin P., Zhang C., Agarwal S., Slama K., Ray A.Schu…
  27. IEEE Transactions on Professional Communication
  28. Prompt Engineering Guide. (n.d.). Zero-shot prompting . https://w…
  29. 10.1016/j.iotcps.2023.04.003
  30. Teaching business writing: Challenges, plans, pedagogy, research
  31. 10.1016/j.jbvi.2023.e00388
  32. Genre studies around the globe: Beyond the three traditions
  33. Journal of Business and Technical Communication
  34. Finetuned language models are zero-shot learners
  35. Wei J., Wang X., Schuurmans D., Bosma M., Chi E., Le Q., Zhou D. (2022). Chain of thought prompting elicits r…
  36. White J., Fu Q., Hays S., Sandborn M., Olea C., Gilbert H., Elnashar A., Spencer-Smith J., Schmidt D. C. (202…
  37. Wolfram S. (2023). What is ChatGPT doing… and why does it work? S…
  38. Zhou Y., Muresanu A. I., Han Z., Paster K., Pitis S., Chan H., Ba J. (2023). Large language models are human-…