People working at the intersection of composition and user experience often serve as the connective material that binds content to use. In merging fundamental skills of both in multimodal UX, practitioners position themselves as essential mediators connecting technical information, storytelling, and technologies that carry impactful messages across disciplines, audiences, and contexts. Building on previous work that advocates for the power of narrative in AR/VR storytelling, we demonstrate how combining the composing strategy of narrative layering with user testing can guide the creation of inclusive, community-centered VR experiences. To illustrate the power of this capacity, we ground our analysis in the design of a Virtual Reality experience about advanced water purification, outlining a method for how narrative layering and UX testing can be woven together to address a variety of perspectives through interdisciplinary, layered storytelling. In doing so, we argue that multimodal UX is most powerful when it blends the needs of a range of audiences to build stories that communicate complex information in an inclusive and engaging way.

User experience (UX) as both a vocation and a skillset is currently in the center of a wicked knot: emerging technologies such as generative artificial intelligence (GenAI) and large language models (LLMs) are (for the moment) widely accessible in unprecedented ways and are already heavily integrated into modern workplace practices and educational spaces. Further, workplace demands have led to a change in perception of the function and value of UX, and the field is facing new obstacles to hiring and research funding. Our article argues that a resituation of UX is needed: we-as instructors and administrators-need to focus on UX as an act of slow, embodied, and multimodal UX composition. To do this work, we offer the strategy of détournement as central to UX curriculum and preparing students for design work in a variety of rhetorical situations, expressed through our example assignments for instructors to implement within the college classroom.

Content personalization or tailoring content as per the needs of users has been a focus of technical communicators’ work since a very long time. Recently, algorithms have helped trace users’ characteristics such as devices they use, platforms they work on, local language spoken, etc. to personalize content through strategies like responsive content, automatic translation and so on. AI tools have extended algorithmic capabilities for personalization, but at the same time increased the randomness of personalized content. That is, algorithms produce different results for the same user at different times or different results for different users at the same time with the same prompt thus shifting the agency of both rhetors (or content creators) and the audience (or content users). While conventional technical communication pedagogy has focused on writing for users, and more recently on writing for algorithms which serve the users, today it is crucial to understand how technologies like AI impact knowledge consumption processes from a user experience perspective? And how can we teach content personalization and adaptive techniques in the increasingly digital spaces of audience interactions? These questions motivated our research. To follow the roles of algorithms and technical communicators closely, we analyzed three different case studies where algorithms are responsible for a high level of personalization beyond the decisions made by technical communicators. Our findings suggest that we must teach students to investigate concepts such as user personas in UX for understanding audiences, several methods of decision-making for content assets, and rhetorical ecology for a holistic view of content production to dissemination.

The question of how generative Artificial Intelligence (Gen AI) will reshape communication is causing questions and concerns across the field of education, particular literacy and writing classrooms. Although important questions have surfaced surrounding the varied effects on writing instruction and ethical implications of AI in the classroom, there are calls for deeper investigations about how these tools might shape multimodal composing processes. This study builds upon this developing field by exploring how 21 university students in literacy education courses multimodally composed with generative AI and their perspectives on the use of AI in the classroom. Data sources included screen capture and video observations, design interviews, pre- and post- surveys, and multimodal products. Through qualitative and multimodal analysis, four main themes emerged for understanding preservice teachers’ multimodal composing processes: (1) composing was an iterative process of prompting guided by the AI tools, (2) composers exhibited two distinct processes when designing their projects, (3) AI shaped creative possibilities, and (4) play, humor, and surprise served a key function while composing. Preservice teachers’ perspectives also revealed insights into how AI shaped engagement with content, the importance of scaffolding AI in the classroom, and how ethics were intertwined with technical function and teaching beliefs.

• This study explores GenAI's role in multimodal composition, including Adobe Firefly and DALL·E. • GenAI reshapes the composition stages of invention, designing, and revising. • Despite its limitations, GenAI offers alternative solutions to wicked problems. • Post-GenAI use, students critically revise and iterate their compositions. • The study contributes to future research and teaching of AI-assisted composition. This study explores the integration of generative artificial intelligence (GenAI) design technologies, including Adobe Firefly and DALL·E, into the teaching and learning of multimodal composition. Through focus group discussions and case studies, this paper demonstrates the potential of GenAI in reshaping the various stages of the composition process, including invention, designing, and revising. The findings reveal that GenAI technologies have the potential to enhance students’ multimodal composition practices and offer alternative solutions to the wicked problems encountered during the design process. Specifically, GenAI facilitates invention by offering design inspirations and enriches designing by expanding, removing, and editing the student-produced design contents. The students in this study also shared their critical stance on the revision process by modifying and iterating their designs after their uses of GenAI. Through showcasing both the opportunities and challenges of GenAI technologies, this paper contributes to the ongoing scholarly conversations on multimodal composition and pedagogy. Moreover, the paper offers implications for the future research and teaching of GenAI-assisted multimodal composition projects, with the aim of encouraging thoughtful integration of GenAI technologies to foster critical AI literacy among college composition students.

This article describes five first-year writing instructors’ experiences with personalizing shared curriculum across three different course delivery formats (face-to-face, hybrid, online). The data is drawn from teaching journals that the co-authors, a non-tenure track, part-time Lecturer and a tenured Writing Program Administrator, and three Graduate Student Teaching Associates completed throughout Fall 2022. The findings illustrate both benefits and drawbacks related to shared curriculum: discussing and troubleshooting curriculum in a community of practice is highly valuable, but separating course delivery from course design is challenging. In our study, those challenges manifested as disconnects between course content and disciplinary identity, as well as personal feelings of failure. On the other hand, the need to personalize shared curriculum across multiple delivery formats proved productive, especially when instructors used asynchronous online materials as a starting point to develop hybrid and face-to-face lesson plans. Ultimately, we advocate for more conversations about how writing programs can support contingent faculty as they personalize shared curriculum through both course delivery and design, and we offer an example of a successful community of practice that revises shared curriculum in response to community members’ experiences with teaching in multiple modalities.

Our First-year Writing program began intentional student engagements with generative AI in the fall of 2022. We developed assignments for brainstorming research questions, writing counterarguments, and editing assistance using the AI tools Elicit, Fermat, and Wordtune. Students felt that the tools were helpful for finding ideas to get started with writing, to find sources once they had started writing, and to get help with counterarguments and alternate word choices. But when given the choice to use the assistants or not, most declined. Generative AI at this stage is unreliable, and many students found the tradeoff in reviewing AI suggestions to be too time consuming. And many students expressed a preference for continuing to develop their own voices through writing. Our experience in engaging AI led to the creation of the DEER praxis, which emphasizes defined engagements with AI tools for specific purposes, and generous use of reflection.

In this article, an analysis of multimodal representations in elementary school students’ descriptive texts about the mobile game Pokémon Go (PG) is used to discuss youths’ new literacy practices emerging from their out-of-school experiences (e.g., gaming, producing game-walkthroughs, and fan art). Social semiotic multimodal analyses of two students’ PG texts and their participation in talks around their texts are used to exemplify what occurs semiotically in the translation of meanings and designs across modes, media, and sites. Combining the analysis of the meaning potentials of multimodal representations with ethnographic accounts of their use in context produces the following findings: The PG writing task connects with the students’ life-worlds and the gaming context around PG prompts the design of their multimodal representations. The students are active creators of content and demonstrate purposeful and innovative uses of semiotic resources in self-representation, stance taking, and audience awareness. The iPad facilitates multimodal and digital crossovers between leisure activities and school subjects. The concluding discussion suggests how game-based literacy practices could be transferred into academic settings.

The authors, an instructor and students, describe our practice of user-centered design on three levels: in the design and structure of an advanced undergraduate course in which we all participated, in student projects designed during the course, and in our reflections on the course presented here. We argue that principles of user-centered design can and should be more than course concepts and assignments; they can be core practices of the course that hold both students and teachers accountable for the impacts of their rhetorical choices. We offer a model for other teacher-scholars looking to involve students in the design of their courses and in writing together about their work.