Immersive virtual reality (VR) technology is becoming widespread in education, yet research of VR technologies for students’ multimodal communication is an emerging area of research in writing and literacies scholarship. Likewise, the significance of new ways of embodied meaning making in VR environments is undertheorized—a gap that requires attention given the potential for broadened use of the sensorium in multimodal language and literacy learning. This classroom research investigated multimodal composition using the virtual paint program Google Tilt Brush™ with 47 elementary school students (ages 10–11 years) using a head-mounted display and motion sensors. Multimodal analysis of video, screen capture, and think-aloud data attended to sensory-motor affordances and constraints for embodiment. Modal constraints were the immateriality of the virtual text, virtual disembodiment, and somatosensory mismatch between the virtual and physical worlds. Potentials for new forms of embodied multimodal representation in VR involved extensive bodily, haptic, and locomotive movement. The findings are significant given that research of embodied cognition points to sensorimotor action as the basis for language and communication.

<p>Video making and sharing have the potential to represent attitude in powerful ways and have become everyday literacy practices for many children. Research has only recently attended to the multimodal grammars of attitudinal meaning that characterize filmic media, while providing few examples of the successful teaching of these semiotic principles to elementary students. This article reports original research conducted in two schools over two years with elementary students (ages 9 to 11 years). It examines students' application of semiotic knowledge of the appraisal framework to communicate attitudinal meanings multimodally through film. Attitudinal meanings in the appraisal framework are categorized as affect, judgment, or appreciation, and can be communicated through discourse and multimodal texts. The students learned to configure multiple modes, including speech, written text, image, gaze, facial expressions, body movement, posture, gesture, and sound, to communicate attitude in their films. The findings provide an exemplar for the teaching and analysis of students' filmmaking that applies systematic, multimodal grammars for communicating attitude. The findings are significant because interpersonal language is a major semiotic system of English, and visual texts now feature prominently in digital communication environments. </p>

Communication using popular digital media involves understanding multimodal systems of appraisal for expressing attitude, which traditionally deals with emotions, ethics, and aesthetics in language. The formulation and teaching of multimodal grammars for attitudinal meanings in popular texts and culture is currently underresearched. This article reports findings from multisite qualitative research that developed students’ ability to use semiotic resources for communicating attitude multimodally. The research participants were 68 students (ages 9–11 years) from two elementary schools. Students learned how to use attitudinal language—affect, judgment, and appreciation—and applied this knowledge to multimodal design. The findings advance a leading system of appraisal for discourse by adapting the system to the multimodal communication of attitude in digital comic making in schooling. The research is significant because it demonstrates the potentials for augmenting students’ linguistic and visual semiotic resources to convey multimodal attitudinal meanings in contemporary communication.

Theorists of multiliteracies, social semiotics, and the New Literacy Studies have drawn attention to the potential changing nature of writing and literacy in the context of networked communications. This article reports findings from a design-based research project in Year 4 classrooms (students aged 8.5-10 years) in a low socioeconomic status school. A new writing program taught students how to design multimodal and digital texts across a range of genres and text types, such as web pages, online comics, video documentaries, and blogs. The authors use Bernstein’s theory of the pedagogic device to theorize the pedagogic struggles and resolutions in remaking English through the specialization of time, space, and text. The changes created an ideological struggle as new writing practices were adapted from broader societal fields to meet the instructional and regulative discourses of a conventional writing curriculum.