“Don’t Ban, Teach”: Two Pilot Studies on AI Instruction in Business Communication

Emily Barrow DeJeu Carnegie Mellon University ; Beth A. Walter Carnegie Mellon University ; Michael C. Melville

Abstract

Emerging consensus suggests faculty should teach students to use large language models (LLMs) rather than ban them, but it is not clear that students need detailed AI-related instruction. To investigate, we conducted two studies: Study 1 used survey and focus group methods to assess how such instruction influenced students’ perceptions, while Study 2 used rater evaluation to examine how AI use affected message quality. Study 1 found no meaningful impact on perceptions. Study 2 found that instruction did not affect ratings, but genAI use did—messages composed with LLM assistance received higher evaluations than those without it. We conclude with recommendations for genAI-focused classroom instruction.

Journal
Business and Professional Communication Quarterly
Published
2025-05-28
DOI
10.1177/23294906251336719
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (41) · 16 in this index

  1. Abbas M. Jam F. A. Khan T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of gene…
  2. Written Communication
  3. Writing in the real world: Making the transition from school to work
  4. Blandin A. Bick A. Deming D. (2024). The rapid adoption of Generative AI. SSRN 4965142. https://doi.org/10.21…
  5. Breland H. M. (2025). The direct assessment of writing skill: A measurement review (College Board Report No. …
Show all 41 →
  1. Brown D. Robertson S. (2024 November 9). Enterprise data protection in Microsoft 365 Copilot and Microsoft Co…
  2. Plagiarism in the age of generative ai: Cheating method change and learning loss in an in…
  3. Dell’Acqua F. McFowland E.III Mollick E. R. Lifshitz-Assaf H. Kellogg K. Rajendran S. Krayer L. Candelon F. L…
  4. DeJeu E. B. (2023). Applications of GenAI for business communication. Center for Intelligent Business Tepper …
  5. Business and Professional Communication Quarterly
  6. Journal of Business and Technical Communication
  7. Business and Professional Communication Quarterly
  8. Diederich P. B. (1974). Measuring growth in English. National Council of Teachers of English. https://eric.ed…
  9. Ember S. (2024 August 18). A.I. Is helping to launch new businesses (and not just A.I. Businesses). The New Y…
  10. Journal of Business and Technical Communication
  11. Gerlich M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. …
  12. Business communication: Process and product
  13. Ibrahim H. Liu F. Asim R. Battu B. Benabderrahmane S. Alhafni B. Adnan W. Alhanai T. AlShebli B. Baghdadi R. …
  14. Jaffri A. (2024 November 11). Hype Cycle for Artificial Intelligence 2024 | Gartner. Gartner. https://www.gar…
  15. Jick T. D. (1979). Mixing qualitative and quantitative methods: Triangulation in action. Administrative Scien…
  16. Kaldaras L. Akaeze H. O. Reckase M. D. (2024). Developing valid assessments in the era of generative artifici…
  17. Lee H. P. H. Sarkar A. Tankelevitch L. Drosos I. Rintel S. Banks R. Wilson N. (2025). The impact of generativ…
  18. Business and Professional Communication Quarterly
  19. Journal of Business and Technical Communication
  20. Business and Professional Communication Quarterly
  21. Business and Professional Communication Quarterly
  22. Mahapatra S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention…
  23. Business and Professional Communication Quarterly
  24. Business and Professional Communication Quarterly
  25. Business and Professional Communication Quarterly
  26. Business and Professional Communication Quarterly
  27. Rim C. (n.d.). Don’t ban ChatGPT—Teach students how to use it. Forbes. https://www.forbes.com/sites/christoph…
  28. Roose K. (2023 January 12). Don’t ban ChatGPT in schools. Teach with it. The New York Times. https://www.nyti…
  29. Business and Professional Communication Quarterly
  30. Business and Professional Communication Quarterly
  31. Shields C. (2023 January 5). Don’t ban ChatGPT. Use it as a teaching tool. Education Week. https://www.edweek…
  32. Business communication: Polishing your professional presence
  33. Student Guide to AI Literacy. (2024). MLA Style Center. https://style.mla.org/student-guide-to-ai-literacy/
  34. Excellence in business communication
  35. Corporate genAI governance: Towards a dialogic response
    Journal of Dialogic Ethics
  36. Research in the Teaching of English