Multimodal composing with generative AI: Examining preservice teachers’ processes and perspectives

Blaine E. Smith Vanderbilt University ; Amanda Yoshiko Shimizu Knoxville College ; Sarah K. Burriss Vanderbilt University ; Melanie Hundley Vanderbilt University ; Emily Pendergrass Vanderbilt University

Abstract

The question of how generative Artificial Intelligence (Gen AI) will reshape communication is causing questions and concerns across the field of education, particular literacy and writing classrooms. Although important questions have surfaced surrounding the varied effects on writing instruction and ethical implications of AI in the classroom, there are calls for deeper investigations about how these tools might shape multimodal composing processes. This study builds upon this developing field by exploring how 21 university students in literacy education courses multimodally composed with generative AI and their perspectives on the use of AI in the classroom. Data sources included screen capture and video observations, design interviews, pre- and post- surveys, and multimodal products. Through qualitative and multimodal analysis, four main themes emerged for understanding preservice teachers’ multimodal composing processes: (1) composing was an iterative process of prompting guided by the AI tools, (2) composers exhibited two distinct processes when designing their projects, (3) AI shaped creative possibilities, and (4) play, humor, and surprise served a key function while composing. Preservice teachers’ perspectives also revealed insights into how AI shaped engagement with content, the importance of scaffolding AI in the classroom, and how ethics were intertwined with technical function and teaching beliefs.

Journal
Computers and Composition
Published
2025-03-01
DOI
10.1016/j.compcom.2024.102896
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
Export

Citation Context

Cited by in this index (2)

  1. Computers and Composition
  2. Assessing Writing

References (58) · 6 in this index

  1. Artificial intelligence-based tools in research writing: current trends and future potentials
    Artificial intelligence in higher education
  2. Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?
    Patterns (New York, N.Y.)
  3. Not quite eye to AI: student and teacher perspectives on the use of generative artificial…
    International Journal of Educational Technology in
  4. Assessing Writing
  5. Bishop, L. (2023). A Computer Wrote this Paper: What ChatGPT Means for Education, Research, and Writing. In h…
Show all 58 →
  1. Research in the Teaching of English
  2. Critical posthumanist literacy: Building theory for reading, writing, and living ethicall…
    Reading Research Quarterly  
  3. Burriss, S. K., Smith, B. E., Shimizu, A., Hundley, M., & Pendergrass, E. (under review). Exploring the ethic…
  4. Exploring EFL students’ writing performance and their acceptance of ai-based automated wr…
    Proceedings of the 2021 2nd International Conference on Education Development and Studies
  5. Exploring teachers’ perceptions of artificial intelligence as a tool to support their pra…
    International Journal of Artificial Intelligence in Education  
  6. Strategies for qualitative data analysis
  7. Computers and Composition
  8. Fifth-grade students’ digital retellings and the Common Core: Modal use and design intent…
    The Elementary School Journal,  
  9. Cultivating writerly virtues: Critical human elements of multimodal writing in the age of…
    Journal of Adolescent & Adult Literacy  
  10. Toward a corridista consciousness: Learning from one transnational youth’s critical readi…
    Reading Research Quarterly  
  11. The racializing forces of/in AI educational technologies
    Learning, Media and Technology  
  12. Doing naturalistic inquiry: A guide to methods
  13. Working in tandem with editing tools: iterative meaning-making in filmmaking practices
    Visual Communication  
  14. What do turkish pre-service teachers think about artificial intelligence?
    International Journal of Computer Science Education in Schools  
  15. The ethics of disclosing the use of artificial intelligence tools in writing scholarly ma…
    Research Ethics  
  16. Cultural citizenship and cosmopolitan practice: Global youth communicate N
    English Education  
  17. Computers and Composition
  18. Beyond ChatGPT: Multimodal generative AI for L2 writers
    Journal of Second Language Writing  
  19. EFL adolescent learners’ perceptions of digital multimodal composing tasks and task outco…
    Vigo International Journal of Applied Linguistics  
  20. Learning design to support student-AI collaboration: perspectives of leading teachers for…
    Education and Information Technologies  
  21. Chatbots in education and research: A critical examination of ethical implications and so…
    Sustainability: Science Practice and Policy  
  22. Multimodality: a social semiotic approach to contemporary communication
  23. Rereading “A Pedagogy of Multiliteracies”: bodies, texts, and emergence
    Journal of Literacy Research  
  24. Multiplying meaning: Visual and verbal semiotics in scientific text
    Reading science
  25. The effects of pre-service early childhood teachers’ digital literacy and self-efficacy o…
    Education and Information Technologies  
  26. Metaphor analysis on pre-service early childhood teachers’ conception of AI (Artificial I…
    Thinking Skills and Creativity  
  27. Children's digital multimodal composing: Implications for learning and teaching
    Learning, Media and Technology  
  28. Investigating students’ cognitive processes in generative AI-assisted digital multimodal …
    Computers & Education  
  29. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and t…
    Journal of the Association for Information Science and Technology  
  30. The impact of AI writing tools on the content and organization of students’ writing: EFL …
    Cogent Education  
  31. Writing machines: Formative assessment in the age of big data
    Journal of Adolescent & Adult Literacy: A Journal from the International Reading Association  
  32. Analyzing multimodal interaction: a methodological framework
  33. Computers and Composition
  34. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics…
    Internet of Things and Cyber-Physical Systems  
  35. Constructing language ideologies in a multilingual, second-grade classroom: A case study …
    Linguistics and Education  
  36. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
    Journal of Applied Learning and Teaching
  37. Can artificial intelligence help for scientific writing?
    Critical Care
  38. Across spaces, writers, and modes: Elementary students’ collaborative and multimodal comp…
    ProQuest Dissertations & Theses Global
  39. Where to hide a stolen elephant: leaps in creative writing with multimodal machine intelligence
    ACM Trans. Comput.-Hum. Interact.  
  40. Composing across modes: A comparative analysis of adolescents’ multimodal composing processes
    Learning, Media & Technology  
  41. Emergent bilingual students and digital multimodal composition: A systematic review of re…
    Reading Research Quarterly  
  42. Digital writing with AI platforms: the role of fun with/in generative AI
    English Teaching: Practice & Critique
  43. Digital support for academic writing: A review of technologies and pedagogies
    Computers & Education  
  44. Powerful or mediocre? Kindergarten teachers’ perspectives on using ChatGPT in early child…
    Interactive Learning Environments  
  45. Assessing Writing
  46. Introducing social semiotics
  47. Artificial Intelligence in K-12 Education: eliciting and reflecting on Swedish teachers’ …
    Education and Information Technologies
  48. Warschauer, M., Tseng, W., Yim, S., Webster, T., Jacob, S., Du, Q., & Tate, T. (2023). The Affordances and Co…
  49. Mind as action
  50. Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation
    Education and Information Technologies  
  51. Academic integrity in the age of Artificial Intelligence (AI) authoring apps
    TESOL Journal  
  52. Multimodal literacies in teaching and learning in and out of school
    Handbook of tesol in K–12
  53. Acceptance of artificial intelligence among pre-service teachers: a multigroup analysis
    International Journal of Educational Technology in Higher Education