Research Brief: Transformers

Abstract

This Research Brief discusses transformers—the core engine for most artificial intelligence applications. The brief situates transformer technology within the field of rhetoric and composition by surveying recent studies; highlights the innovative aspects of transformers; and, finally, thinks through (Majdik and Graham) the operations of transformers and generative AI through Miller’s theory of topoi, illustrating one way in which rhetoric and composition scholars and teachers can critically engage with generative AI in instruction and research.

Journal
College Composition and Communication
Published
2025-09-01
DOI
10.58680/ccc2025771197
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (42) · 15 in this index

  1. Computers and Composition
  2. The Illustrated GPT-2 (Visualizing Transformer Language Models)
  3. The Illustrated Transformer
  4. Hands-On Large Language Models: Language Understanding and Generation
  5. Meet GPT, the Decoder-Only Transformer
    Towards Data Science
Show all 42 →
  1. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
    Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, ACM
  2. Neural Machine Translation by Jointly Learning to Align and Translate. arXiv:1409.0473
    arXiv.org
  3. Transformer Explainer: Interactive Learning of Text-Generative Models. arXiv:2408.04619
    arXiv.org
  4. The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
  5. What Is Attention?
    MachineLearningMastery.Com
  6. Rhetoric Society Quarterly
  7. Stanford CS25: V2 I Introduction to Transformers w/Andrej Karpathy
    YouTube
  8. Computers and Composition
  9. Philosophy & Rhetoric
  10. Deep Learning
    Nature  
  11. A Survey of Transformers. arXiv:2106.04554
    arXiv.org
  12. What Is Communication?
    Communication Theory  
  13. Technical Communication Quarterly
  14. Rhetoric Society Quarterly
  15. Sample Size Considerations for Fine-Tuning Large Language Models for Named Entity Recogni…
    JMIR AI  
  16. Computers and Composition
  17. Journal of Technical Writing and Communication
  18. The Aristotelian Topos: Hunting for Novelty
    Foundations for Sociorhetorical Exploration: A Rhetoric of Religious Antiquity Reader  
  19. Rhetoric Society Quarterly
  20. An Alternative Rationalisation of Creative AI by De-Familiarising Creativity: Towards an …
    AI for Everyone? Critical Perspectives  
  21. Rhetoric Society Quarterly
  22. Detecting High-Quality Comments in Written Feedback with a Zero Shot Classifier
    Proceedings of the 39th ACM International Conference on Design of Communication
  23. GPT-4 Technical Report (No. arXiv:2303.08774)
    arXiv
  24. Computers and Composition
  25. Multiliteracies for a Digital Age
  26. Computers and Composition
  27. Genre Analysis
  28. How Our AI-Assisted Qualitative Analysis Failed
    Proceedings of the 42nd ACM International Conference on Design of Communication, Association for Computing Machinery
  29. Transformer: A Novel Neural Network Architecture for Language Understanding
    Google Research
  30. A Complete Guide to Nvidia: The Chipmaker Behind the AI Boom
    Business Insider
  31. Attention Is All You Need
    Proceedings of the 31st International Conference on Neural Information Processing Systems
  32. Computers and Composition
  33. A Multiscale Visualization of Attention in the Transformer Model
    Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Association for Computational Linguistics  
  34. jessevig/bertviz
    GitHub
  35. Transparency and the Black Box Problem: Why We Do Not Trust AI
    Philosophy & Technology  
  36. Rhetoric Review
  37. Rhetoric Society Quarterly