IEEE Transactions on Professional Communication Dec 2015 Open Access

Efficiently Connecting Textual and Visual Information in Operating Instructions

Thora Tenbrink Bangor University ; Annika Maas University of Bremen

Abstract

Research problem: Most technical documents rely on a combination of text and visuals to communicate their messages. To achieve the desired effect of improved processing and comprehension of operating instructions, the text must guide readers in a clear way to the relevant visual information in order to avoid ambiguity and misinterpretation, and to ensure that the reader optimally benefits from the available information.Research questions: (1) How are textual and visual information combined in operating instructions in order to guide the user's attention precisely toward the relevant parts of a household appliance? (2) In what ways can ambiguity arise, and what kinds of strategies can be used to avoid miscommunication and conceptual problems? Literature review: Operating manuals are usually procedural instructions that tell the user how to set up an appliance, how to operate and maintain it, and how to solve any problems. The vast majority of operating instructions are multimodal in that they include visuals of some kind. But previous research has shown that visual representations of instructions can be just as difficult to interpret as textual instructions-especially if the visuals come without textual elaboration. A combination of text and visuals provides opportunities for taking advantage of both by balancing the other mode's limitations. Methodology: Our exploratory qualitative study of a small set of operating instructions identifies and classifies types of references to visuals in the documents, enriched by interviews with the technical writers of these manuals. Besides showing patterns of reference types, we examine the potential ambiguity of some types of references along with strategies to avoid communication failure. Results and conclusions: We identified 10 distinct ways in which links from text to visuals can be established. Line drawings were referred to more than visuals showing display content. The clarity of the link between text and visuals may be affected by the use of spatial expressions (such as left/right) that presuppose an underlying perspective, as well as by the use of semantic and functional information that is not readily accessible to laypersons. Ambiguity can be avoided by using clearly defined labels, specific perceptual information, and by repetition of visual elements in the text. Also, overspecification can be useful for enhancing communication. We conclude that technical writers need to attend to the links between text and visuals in order to support users effectively, avoiding ambiguity by purposeful strategies. Because our study is qualitative and analytic, implications are limited by the scope of our study, and by the lack of empirical user comprehension studies.

Journal
IEEE Transactions on Professional Communication
Published
2015-12-01
DOI
10.1109/tpc.2016.2517451
CompPile
Open Access
OA PDF Green
Topics
qualitative research multimodality book reviews
Export
BibTeX RIS

Citation Context

Cited by in this index (3)

  1. Li et al. (2021)
    Getting the Picture: A Cross-Cultural Comparison of Chinese and Western Users’ …
    Journal of Technical Writing and Communication
  2. Passera (2018)
    Flowcharts, Swimlanes, and Timelines: Alternatives to Prose in Communicating Le…
    Journal of Business and Technical Communication
  3. Passera et al. (2017)
    Diagrams in Contracts: Fostering Understanding in Global Business Communication
    IEEE Transactions on Professional Communication

References (39) · 4 in this index

  1. 10.1016/0010-0285(91)90005-9
     ↗
  2. 10.1017/CBO9780511613609
     ↗
  3. 10.1016/j.learninstruc.2009.02.021
     ↗
  4. Gellevij et al. (1999)
    The effects of screen captures in manuals: a textual and two visual manuals compared
    IEEE Transactions on Professional Communication
  5. winn (1989)
    10.1016/S0166-4115(08)62151-2
    Knowledge Acquisition from Text and Pictures  ↗
Show all 39 →
  1. ballstaedt (2005)
    Visualisierung: Bilder in der technischen Kommunikation
    Skript Fachhochschule Gelsenkirchen
  2. tenbrink (2007)
    10.1515/9783110198829
    Space Time and the Use of Language An Investigation of Relationships  ↗
  3. arts (2004)
    Overspecification in instructive texts
  4. van der meij (1998)
    Minimalism Beyond the Nurnberg Funnel
  5. rothkegel (2010)
    Technikkommunikation [Technical Communication]
  6. 10.1016/0749-596X(92)90008-L
     ↗
  7. Ganier (2004)
    Factors Affecting the Processing of Procedural Instructions: Implications for D…
    IEEE Transactions on Professional Communication
  8. heiser (2004)
    Identification and validation of cognitive design principles for automated generation of …
    Proc Conf Advanced Visual Interfaces  ↗
  9. Maes et al. (1999)
    How to put the instructive space into words
    IEEE Transactions on Professional Communication
  10. 10.1016/S0166-4115(08)62154-8
     ↗
  11. 10.1016/j.pragma.2010.07.013
     ↗
  12. rude (2011)
    Technical Editing
  13. 10.1016/0010-0277(86)90010-7
     ↗
  14. (2000)
    Language and Gesture
  15. emmorey (2002)
    Spatial Language Cognitive and Computational Aspects
  16. KRULL et al. (2004)
    Designing procedural illustrations
    IEEE Transactions on Professional Communication
  17. 10.1017/langcog.2014.19
     ↗
  18. kress (2001)
    Multimodal Discourse The Modes and Media of Contemporary Communication
  19. martin (2003)
    Working with Discourse Meaning beyond the Clause
  20. bhatia (2004)
    Worlds of Written Discourse A Genre-Based View
  21. paivio (1986)
    Mental Representations A Dual Coding Approach
  22. leckie-tarry (1995)
    Language & Context A Functional Linguistic Theory of Register
  23. 10.1016/S0166-4115(08)62158-5
     ↗
  24. 10.1016/S0166-4115(08)62150-0
     ↗
  25. van leeuwen (2004)
    Discourse and Technology?Multimodal Discourse Analysis
  26. johnson-laird (1983)
    Mental Models
  27. halliday (1994)
    An Introduction to Functional Grammar
  28. 10.1017/CBO9780511620539
     ↗
  29. (2003)
    Spatial Schemas and Abstract Thought
  30. 10.1016/0004-3702(71)90011-7
     ↗
  31. 10.1002/hfm.20092
     ↗
  32. tversky (2000)
    10.1007/3-540-45460-8_6
    Spatial Cognition II Integrating Abstract Theories Empirical Studies Formal Methods and Practical Applications  ↗
  33. 10.1515/9783110197532.3.199
     ↗
  34. herskovits (1998)
    Representation and Processing of Spatial Expressions
CrossRef global citation count: 9 View in citation network → Build reading path →

Related Articles

  1. Pedagogy Oct 2023
    Contributors ↗
    rhetorical criticism first-year composition writing pedagogy writing across the curriculum two-year college teacher development collaborative writing assessment writing centers qualitative research multimodality literacy studies race and writing gender and writing disability studies affect and writing literary studies book reviews editorial matter
  2. Rhetorica Mar 2021
    Domestic Occupations: Spatial Rhetorics and Women’s Work by Jessica Enoch ↗
    Kate Rich
    modern rhetorical theory rhetorical criticism teacher development argument archival research qualitative research multimodality gender and writing place and space book reviews
  3. IEEE Transactions on Professional Communication Mar 2016
    iFixit Myself: User-Generated Content Strategy in “The Free Repair Guide for Everything” ↗
    Guiseppe Getto; Jack T. Labriola
    technical communication empirical research qualitative research multimodality book reviews
  4. IEEE Transactions on Professional Communication Jun 2013
    Improving User Experience for Passenger Information Systems. Prototypes and Reference Objects ↗
    Simone Wirtz; Eva-Maria Jakobs
    genre theory assessment qualitative research digital rhetoric multimodality gender and writing book reviews
  5. IEEE Transactions on Professional Communication Jun 2011
    Envisioning Collaboration: Group Verbal-Visual Composing in a System of Creativity (Cross, G.A.; 2011) [Book Review] ↗
    Christon Walker
    rhetorical criticism collaborative writing professional writing qualitative research multimodality book reviews