Can Artificial Intelligence Robots Write Effective Instructions?

Johndan Johnson-Eilola Clarkson University ; Stuart A. Selber Pennsylvania State University ; Eric J. York Clarkson University

Abstract

The authors analyze the ability of ChatGPT to generate effective instructions for a consequential task: taking a COVID-19 test. They compare the output from a commercial prompt for generating these instructions to those provided by the test manufacturer. They also analyze the input, the prompt itself, to address prompt-engineering issues. The results show that although the output from ChatGPT exhibits certain conventions for documentation, the human-authored instructions from the manufacturer are superior in most ways. The authors conclude that when it comes to creating high-quality, consequential instructions, ChatGPT might be better seen as a collaborator than a competitor with human technical communicators.

Journal
Journal of Business and Technical Communication
Published
2024-07-01
DOI
10.1177/10506519241239641
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (13)

  1. Computers and Composition
  2. Technical Communication Quarterly
  3. Technical Communication Quarterly
  4. Journal of Technical Writing and Communication
  5. Journal of Technical Writing and Communication
Show all 13 →
  1. Written Communication
  2. Journal of Business and Technical Communication
  3. IEEE Transactions on Professional Communication
  4. Technical Communication Quarterly
  5. College Composition and Communication
  6. Technical Communication Quarterly
  7. Technical Communication Quarterly
  8. Journal of Technical Writing and Communication

References (18) · 2 in this index

  1. Critical power tools: Technical communication and cultural studies
  2. Edwards B. (2023). ChatGPT sets record for fastest-growing user base in history, report says. …
  3. 10.37514/TPC-B.2023.1923.2.10
  4. Felten E., Raj M., Seamans R. (2023). How will language modelers like ChatGPT affect oc…
  5. Harwell D. (2023). Tech’s hottest new job: AI whisperer. No coding required …
Show all 18 →
  1. Poroi
  2. Technical communication today
  3. Advances in neural information processing systems
  4. Pandora’s hope: Essays on the reality of science studies
  5. Topologies as techniques for a post-critical rhetoric
  6. OpenAI. (2022). ChatGPT (3.0 version) [Large language model]. htt…
  7. OpenAI. (2023). How can educators respond to students presenting AI-generated content as their own? …
  8. Multiliteracies for a digital age
  9. Technical Communication Quarterly
  10. Assembling critical components: A framework for sustaining technical and professional com…
  11. Wang L., Xu W., Lan Y., Hu Z., Lan Y., Lee R. K. W., Lim E. P. (2023). Plan-and-solve p…
  12. Whitenton K. (2014). Satisficing: Quickly meet users’ main needs …
  13. Wiggers K. (2022). A startup is charging $1.99 for strings of text to feed to DALL-E 2 …