Multimodal composing with generative AI: Examining preservice teachers’ processes and perspectives

Blaine E. Smith Vanderbilt University ; Amanda Yoshiko Shimizu Knoxville College ; Sarah K. Burriss Vanderbilt University ; Melanie Hundley Vanderbilt University ; Emily Pendergrass Vanderbilt University

Abstract

The question of how generative Artificial Intelligence (Gen AI) will reshape communication is causing questions and concerns across the field of education, particular literacy and writing classrooms. Although important questions have surfaced surrounding the varied effects on writing instruction and ethical implications of AI in the classroom, there are calls for deeper investigations about how these tools might shape multimodal composing processes. This study builds upon this developing field by exploring how 21 university students in literacy education courses multimodally composed with generative AI and their perspectives on the use of AI in the classroom. Data sources included screen capture and video observations, design interviews, pre- and post- surveys, and multimodal products. Through qualitative and multimodal analysis, four main themes emerged for understanding preservice teachers’ multimodal composing processes: (1) composing was an iterative process of prompting guided by the AI tools, (2) composers exhibited two distinct processes when designing their projects, (3) AI shaped creative possibilities, and (4) play, humor, and surprise served a key function while composing. Preservice teachers’ perspectives also revealed insights into how AI shaped engagement with content, the importance of scaffolding AI in the classroom, and how ethics were intertwined with technical function and teaching beliefs.

Journal
Computers and Composition
Published
2025-03-01
DOI
10.1016/j.compcom.2024.102896
Open Access
OA PDF Hybrid
Topics

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (4)

  1. Computers and Composition
  2. Computers and Composition
  3. Computers and Composition
  4. Research in the Teaching of English
Also cites 36 works outside this index ↓
  1. Using ChatGPT for second language writing: Pitfalls and potentials
    Assessing Writing  
  2. Bishop, L. (2023). A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and Writing. In h…
  3. Critical posthumanist literacy: Building theory for reading, writing, and living ethicall…
    Reading Research Quarterly  
  4. Exploring teachers’ perceptions of artificial intelligence as a tool to support their pra…
    International Journal of Artificial Intelligence in Education  
  5. Fifth-grade students’ digital retellings and the Common Core: Modal use and design intent…
    The Elementary School Journal,  
  6. Cultivating writerly virtues: Critical human elements of multimodal writing in the age of…
    Journal of Adolescent & Adult Literacy  
  7. Toward a corridista consciousness: Learning from one transnational youth’s critical readi…
    Reading Research Quarterly  
  8. The racializing forces of/in AI educational technologies
    Learning, Media and Technology  
  9. Working in tandem with editing tools: iterative meaning-making in filmmaking practices
    Visual Communication  
  10. What do turkish pre-service teachers think about artificial intelligence?
    International Journal of Computer Science Education in Schools  
  11. The ethics of disclosing the use of artificial intelligence tools in writing scholarly ma…
    Research Ethics  
  12. Cultural citizenship and cosmopolitan practice: Global youth communicate N
    English Education  
  13. Beyond ChatGPT: Multimodal generative AI for L2 writers
    Journal of Second Language Writing  
  14. EFL adolescent learners’ perceptions of digital multimodal composing tasks and task outco…
    Vigo International Journal of Applied Linguistics  
  15. Learning design to support student-AI collaboration: perspectives of leading teachers for…
    Education and Information Technologies  
  16. Chatbots in education and research: A critical examination of ethical implications and so…
    Sustainability: Science Practice and Policy  
  17. Rereading “A Pedagogy of Multiliteracies”: bodies, texts, and emergence
    Journal of Literacy Research  
  18. The effects of pre-service early childhood teachers’ digital literacy and self-efficacy o…
    Education and Information Technologies  
  19. Metaphor analysis on pre-service early childhood teachers’ conception of AI (Artificial I…
    Thinking Skills and Creativity  
  20. Children's digital multimodal composing: Implications for learning and teaching
    Learning, Media and Technology  
  21. Investigating students’ cognitive processes in generative AI-assisted digital multimodal …
    Computers & Education  
  22. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and t…
    Journal of the Association for Information Science and Technology  
  23. The impact of AI writing tools on the content and organization of students’ writing: EFL …
    Cogent Education  
  24. Writing machines: Formative assessment in the age of big data
    Journal of Adolescent & Adult Literacy: A Journal from the International Reading Association  
  25. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics…
    Internet of Things and Cyber-Physical Systems  
  26. Constructing language ideologies in a multilingual, second-grade classroom: A case study …
    Linguistics and Education  
  27. Where to hide a stolen elephant: leaps in creative writing with multimodal machine intelligence
    ACM Trans. Comput.-Hum. Interact.  
  28. Composing across modes: A comparative analysis of adolescents’ multimodal composing processes
    Learning, Media & Technology  
  29. Emergent bilingual students and digital multimodal composition: A systematic review of re…
    Reading Research Quarterly  
  30. Digital support for academic writing: A review of technologies and pedagogies
    Computers & Education  
  31. Powerful or mediocre? Kindergarten teachers’ perspectives on using ChatGPT in early child…
    Interactive Learning Environments  
  32. Collaborating with ChatGPT in argumentative writing classrooms
    Assessing Writing  
  33. Warschauer, M., Tseng, W., Yim, S., Webster, T., Jacob, S., Du, Q., & Tate, T. (2023). The Affordances and Co…
  34. Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation
    Education and Information Technologies  
  35. Academic integrity in the age of Artificial Intelligence (AI) authoring apps
    TESOL Journal  
  36. Acceptance of artificial intelligence among pre-service teachers: a multigroup analysis
    International Journal of Educational Technology in Higher Education  
CrossRef global citation count: 13 View in citation network →