IEEE Transactions on Professional Communication

120 articles
Year: Topic: Clear
Export:
assessment ×

March 2026

  1. US Hospital Educators' Technology Needs: A Qualitative Study for Developing Action-Oriented Technology
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Background:</i></b> Hospital educators are designated individuals who provide hospitalized K-12 children with their schooling during the time of their stay. They play a vital role in maintaining educational continuity for hospitalized children, yet their professional information and communication practices remain understudied in US settings. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Literature review:</i></b> We build on literature within technical and professional communication (TPC), specifically scholars who have studied technology and health in understanding US hospital educators' unique technological needs and communication practices within highly regulated healthcare environments. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research questions:</i></b> How do hospital educators navigate professional communication, adapt teaching practices to meet diverse student needs, and utilize technology in hospital settings? What opportunities exist for artificial-intelligence (AI) integration? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research method:</i></b> We conducted semistructured interviews with four hospital educators across US hospitals, applying reflexive thematic analysis, informed by Participatory Communication Theory, Sociotechnical Systems Perspectives, and Knowledge Justice. Analysis employed iterative open coding followed by theory-informed thematic development, where communication theory guided the identification of dialogical patterns, systems theory directed attention to sociotechnical interactions, and knowledge justice sensitized us to power dynamics affecting professional knowledge access and sharing. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Results/discussion:</i></b> Findings reveal characteristics of US hospital education contexts in our study: short patient stays, strict security requirements, institutional variability across hospital settings, and emphasis on engagement over assessment. Educators demonstrate remarkable adaptability in coordinating among stakeholders while navigating institutional constraints and developing strategies for rapid assessment and flexible instruction. While educational technologies offer benefits, implementation faces significant challenges regarding security, practical limitations, and offline functionality needs. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Conclusion:</i></b> We propose guideline themes for developing information and communication technologies–including some that use AI–that support hospital educators' professional needs while respecting hospital setting constraints. This research contributes to understanding how technologies can enhance hospital education while highlighting the importance of context-specific design that empowers rather than replaces educator expertise.

    doi:10.1109/tpc.2026.3658847
  2. Surveys as UXR: Using Design Thinking to Shape a Survey-Based UX Assessment for Rural Audiences
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>About the case:</i></b> While several established user-experience research (UXR) methods can reach far-away users (e.g., remote usability testing), the digital divide makes implementation difficult, especially for rural populations facing barriers to transportation and high-speed internet. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Situating the case:</i></b> Web surveys can eliminate these concerns by providing customization for specific use cases, gathering both qualitative and quantitative data, and combining multiple questionnaires and/or UXR methods within them. Our case study demonstrates an instance where our lab—Auburn University's Lab for Usability, Communication, Interaction, and Accessibility—used advocacy-based HCD and design thinking (DT) to develop a nonstandard UXR Qualtrics web survey to solve our client's wicked problem: designing a usability test for rural audiences unable to travel to our lab while also considering time constraints and technological literacy. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Methods:</i></b> Our survey design followed the Nielsen Norman Group's adaptation of DT, and our process was informed by academic research on: 1. Survey design, question formats, and response bias, 2. Existing user-experience (UX)/usability methods, and 3. Mixed-methods approaches to UXR. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Discussion:</i></b> Our work suggests this tool can potentially serve as the UX testing situation itself, implementing multiple in-person research methods (i.e., heatmapping, user interviews, card sorting) virtually. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Conclusion:</i></b> We conclude with six survey design suggestions and a discussion of how this nonstandard UXR tool can reach underrepresented or vulnerable populations, serving to empower and advocate for users. We suggest that using DT to ideate new UXR methods is a means for UXR practitioners conducting future studies to better address the wicked problems they will face.

    doi:10.1109/tpc.2026.3658115
  3. Bridging the Gap: A Comparative Study of Students’ and LSPs’ Perceptions of Translation Internships
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Background:</i></b> Both technical professional communication (TPC) and translation training call for a closer academia-industry link to cultivate students’ professional competence and enhance employability. Among the collaborative efforts, the internship serves as a key part in bridging the gap and enhancing students’ work-readiness. Their effectiveness, however, depends on the alignment of expectations among the internship stakeholders. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Literature review:</i></b> While prior studies have examined translation internships, they typically center around either students or language service providers (LSP) in isolation. A significant gap exists in quantitatively comparing the perceptions of these two key stakeholder groups. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research questions:</i></b> How do students and LSPs differ in their perceptions of internships? What factors contribute to the misalignment in stakeholders’ perceptions from the perspective of university educators and administrators? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Methods:</i></b> This study employed a mixed-methods approach. A survey was administered to translation students and LSP representatives to identify their perception differences across four key dimensions of internships, followed by interviews with university educators and administrators to explore the causes. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Results:</i></b> Quantitative analysis revealed statistically significant discrepancies in 18 of the 44 items. The subsequent qualitative interviews identified four primary factors contributing to these discrepancies: inadequate internship management, curriculum misalignment due to the lack of qualified faculty, emphasis on hard skills over soft skills in evaluation, and pragmatic concerns from both students and employers. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Implication:</i></b> The findings provided recommendations for students, employers, and institutions to improve the effectiveness of internships, which are relevant not only for translation but also for other practice-oriented disciplines like TPC.

    doi:10.1109/tpc.2026.3658891

September 2025

  1. Professionalizing Researchers: Mapping and Visualizing Doctoral Engineering Student Identity Development Through User-Experience (UX) Methods
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Background:</i></b> Responding to current research gaps in the investigation of researcher identity development among graduate students, we implement a longitudinal study, powered by user-experience (UX) methods, to document engineering doctoral students’ identity formation. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Literature review:</i></b> Identity formation in novice engineering researchers, such as doctoral students remains underexamined. A process-oriented approach to studying researchers’ identity development may yield useful theoretical and programmatic insights. UX methods offer visual and qualitative approaches to the understanding of student experiences by revealing their identity formation journey over time. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research questions:</i></b> 1. How can UX methods like persona building support studies of researcher identity development? 2. How can the insights generated from longitudinal UX methods inform graduate program design and assessment? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Methodology:</i></b> Twenty participants were recruited from an industrial engineering department at an R1 university. Data were collected via surveys, qualitative interviews, and journey mapping. Analysis methods, informed by a phenomenological perspective, included persona building and collaborative affinity diagramming. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Results:</i></b> Seven distinctive personas were created to represent identity formation experiences influenced by learning modality, attitude, program stage, and prior experience. Theoretical conclusions and opportunities for academic programming emerged from affinity diagrams. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Conclusion:</i></b> Doctoral engineering students’ researcher identity formation presented implications for theory and curricular design. UX methods offered benefits to qualitative research that can support cross-disciplinary efforts.

    doi:10.1109/tpc.2025.3586424

June 2025

  1. Presenting and Making Relevant: Analyzing Teaching Assistant Perceptions of Writing in Statistics Using Semantic Frames
    Abstract

    <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Background:</b></i> Instructors in STEM fields help prepare students to be effective communicators in the workplace, partially through instruction of professional genres such as client-facing reports. At the same time, class sizes are increasing, and writing assessment often falls to teaching assistants (TAs). <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Literature review:</b></i> Research suggests that TAs possess a maturing but inchoate sense of writing in their field, which potentially complicates their ability to deliver quality feedback. This study uses frame semantics, a form of discourse analysis, to probe TAs for their beliefs about writing in statistics. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Research questions:</b></i> 1. When asked to describe the function and role of writing in statistics, what lexical verbs do TA informants use? 2. What frames are invoked by those verbs? 3. How do the invoked semantic frames position writing in relation to disciplinary and professional work in the field? <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Research methodology:</b></i> This study interviewed three TAs from an introductory statistics course about their perceptions of writing in statistics. Frame semantics was used to analyze TA responses. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Results:</b></i> Less experienced TAs tended to perceive writing as a means of presentation, which entailed a weak sense of the role of rhetoric in technical communication and a muddied understanding of writing assessment. The more advanced TA perceived writing as a means of contextualizing statistical evidence for particular audiences. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Conclusion:</b></i> Due to their maturing perceptions of writing in their disciplines, TAs might not possess the ability to deliver quality formative feedback. One means of support for these TAs may be opportunities to discuss assessment decisions with one another, thereby calibrating against available expectations and rubrics.

    doi:10.1109/tpc.2025.3561609

December 2024

  1. The Packaging and Labeling of Cannabis Edibles: Opportunities for Professional Communication Researchers
    Abstract

    Introduction: As demand for cannabis edibles increases worldwide, researchers have called for evidence-based packaging and labeling. To assist in these efforts, this integrative review focused on two questions. 1. What aspects of edibles packaging and labeling has the empirical literature covered across disciplines, and how? 2. How might professional communication researchers build on that empirical literature, addressing consumer and industry needs? Research methodology: The methods followed Whittemore and Knafl, who described five stages for integrative reviews: problem identification, literature search, data evaluation, data analysis, and presentation. These methods, supplemented with guidance from Arksey and O'Malley, involved searches in seven relevant databases, producing 341 total returns. The final corpus consisted of 25 empirical studies. I constructed tables of these studies to facilitate iterative comparisons and synthesis. Results/discussion: The final corpus covered five aspects of packaging and labeling: label accuracy; visual content, appeal, and compliance; comprehension of serving size and dosage; perceptions of warnings; and possible enhancements through innovative technologies. The most common intervention types were laboratory analyses (n = 8), followed by surveys paired with experimental tasks (n = 7) and content analyses (n = 4), two of which included a compliance audit. Conclusions and further research: Based on current literature, more empirical studies are needed overall as well as more geographic and linguistic coverage. These needs align with our field's calls for more experimental and quasi-experimental research, alongside long-standing commitments to translation and localization, including participatory localization. As in other fields, future studies should emphasize child and youth protection as well as label accuracy.

    doi:10.1109/tpc.2024.3452288
  2. Training Empathy Competence in a Professional Communication Program: Course Development, Evaluation, and Student Reflections
    Abstract

    Introduction: Research shows that empathy is a core competence of communication professionals. Still, the pedagogy of including empathy in professional communication curricula has been underexposed in the literature. About the case: This article describes the development and evaluation of a course aimed at increasing students’ empathy competence in the final year of a Dutch bachelor-level communication program. A detailed description of the course is provided. Situating the case: The course operationalizes a recent model of empathy competence in professional communication settings. It focuses on empathy-related skills, knowledge, and attitudes. Experiential learning and student-led discussions are core elements in the course. Methods/approach: The course was taught in two different classes (N = 47). Student evaluations and reflections included standard institutional course assessment data, a report from an institution-led student panel evaluation, and student reflections during coursework as well as before, immediately after, and two years after the course. Results/discussion: The course was evaluated very positively in the institutional course assessment and panel evaluation. The student reflections show that students had a great appreciation for the course overall, as well as for specific course elements. The course made them aware of the complexity and multifaceted nature of empathy, and had a profound impact on their professional and personal identity. Conclusion: This article demonstrates the effectiveness of a course designed to develop empathy competence in communication professionals and advocates for future research to explore long-term effects and cross-industry applications.

    doi:10.1109/tpc.2024.3455448

September 2024

  1. Positive Evaluation in the Translation of Online Promotional Discourse in the Cheese Industry
    Abstract

    Background: The bulk of international trade has led to increasing demand for specialized professional communication texts in multilingual contexts. Persuasive language is required in promotional discourse to sell products. When transactions are carried out with foreign countries, translation becomes essential for successful commercial exchange. Literature review: Persuasion requires the use of positive evaluation to describe products. This article addresses the need to contrast the expression of positive evaluation in English and Spanish online promotional cheese descriptions. Research questions: 1. What are the linguistic resources used to express positive evaluation in English and Spanish in online promotional texts of the cheese industry? 2. What is the distribution across parts of speech and semantic categories and subcategories between these two languages? 3. How can semantic tags in bilingual comparable corpora provide useful information for translation practice? Methodology: Empirical data have been extracted from Online Cheese Descriptions (OCD), a semantically tagged English-Spanish corpus, and classified using the Appraisal Framework into the subcategories of appreciation, judgment, affect, and graduation. Results and discussion: Tests of statistical significance have revealed cross-linguistic differences, mainly in appreciation, thus leading to a qualitative analysis. The findings also include a large inventory of all evaluative items that express appreciation for cheeses in both languages and general guidelines for translators. Conclusions: This multilayer corpus-based analysis has yielded relevant data that can be used to enhance the second-language writing and translation processes required for marketing cheese in English and Spanish, thus supporting international professionals in their communication in multilingual contexts.

    doi:10.1109/tpc.2024.3417056
  2. Integrating Technical Communication Into China's Translation and Interpreting Curriculum: Course Design, Practice, and Evaluation of Two Graduate Classes
    Abstract

    Introduction: Graduates with master's degrees in Translation and Interpreting (MTI) are an important workforce in technical communication. To meet this need, we examined the pedagogy of trans-writing to better integrate technical communication (TC) into translation programs. This teaching case from two Chinese universities discusses the curriculum design, its implementation, and teaching effectiveness. Situating the case: While an increasing number of universities in China are interested in embedding TC courses into their translation programs, no research-backed effective solution has been identified. About the case: To boost the employability of MTI students, we designed the courses as “user-centered trans-writing with global content,” which features trans-writing as a strategy for global content creation, user research as the core learning task, and team projects as the primary form of engagement. Methods: We used a mixed method of interviews and surveys to investigate the course effectiveness, each targeting different groups of stakeholders. Results: We synthesized a competence framework for trans-writers based on interviews, which showed that graduates (who work as trans-writers) and their employers prioritized language/culture, user-centered mindset, and cooperation as core competencies. A survey focusing on other graduates who took our courses but did not become trans-writers also revealed positive learning outcomes, including expanded professional visions and enhanced skills in user awareness, project management, collaboration, and communication. Conclusion: The trans-writing approach is effective in equipping MTI students with the necessary competencies for global technical communication.

    doi:10.1109/tpc.2024.3413368

June 2024

  1. Constructing Entrepreneurial Opportunities: The Argumentative Structure of Early-Stage Business Pitch Problem Statements at an International Business Accelerator
    Abstract

    <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Background:</b></i> This project investigates the persuasive strategies used when articulating the problem statement section of entrepreneurial business pitches. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Literature review:</b></i> Although there are many studies of the pitch genre, surprisingly few studies investigate the structural elements of the pitch. Our research fills this gap by structuring the pitch using data from Start Up Chile (SUP), a globally recognized business accelerator. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Research questions:</b></i> 1. Is there a relationship between certain industries and SUP's evaluation of exigence/opportunity? 2. In written problem statements, what rhetorical strategies appear most effective for articulating entrepreneurial exigencies to investors within SUP's business accelerator? <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Methodology:</b></i> We analyze 44 written problem statements that scored highly on a metric of problem identification via an initial statistical analysis and a genre-based rhetorical move analysis. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Results and discussion:</b></i> We first establish that a relationship between SUP's ratings and the entrepreneurs’ industries cannot be assumed, then detail rhetorical moves are used by entrepreneurs. Our findings indicate that when entrepreneurs effectively construct problems/opportunities, they employ a cause-and-effect argumentative structure. Their “cause” is described as the result of a societal change or a shortcoming in current solutions to the problem, and the “effects” of this problem are pain points, which frequently manifest as a loss of time, money, or other resources. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Implications:</b></i> By identifying rhetorical moves from real-world instantiations of the problem-statement genre, we offer entrepreneurs and other business communicators persuasive strategies for navigating the rhetorical situation of the pitch.

    doi:10.1109/tpc.2024.3382548
  2. Integrating Professional Preparedness ePortfolios Within an Undergraduate Engineering Curriculum
    Abstract

    Introduction: We introduce our initiative to integrate professional preparedness electronic portfolios (ePortfolios) within an undergraduate mechanical engineering program. EPortfolios provide students with a visual way to illustrate examples of their skills and can help set them apart in employment applications and interviews. About the case: To better prepare our students to communicate their preparedness to potential employers, we integrated ePortfolios within existing undergraduate design courses. We also designed a new portfolio studio course. Situating the case: This teaching case is situated through previous literature on professional preparedness ePortfolios. We limit our scope to studies within engineering and technical communication disciplines. Methods/approach: We integrated ePortfolio instruction and an accompanying ePortfolio artifact assignment requirement within three design classes in our undergraduate Mechanical Engineering curriculum. We assessed assignments and surveyed participants to understand students’ takeaways and approaches on the ePortfolio classroom instruction and assignment. Results/discussion: Results from 147 assignment submissions across three classes indicated that although most assignment submissions demonstrated effective communication of engineering skills, a considerable number of submissions lacked in clarity, professionalism, or relevance. Extended instructional time on ePortfolios could benefit students. More focused instruction could be integrated into existing courses or in a stand-alone portfolio studio course. Our design of this future course was informed by our assessment of student artifacts as well as what we learned about students’ perceptions of ePortfolios from the 130 survey responses. Conclusions: We share lessons learned for teachers from multiple disciplines interested in integrating professional preparedness ePortfolios within their curricula.

    doi:10.1109/tpc.2024.3387582

December 2023

  1. The State of UX Pedagogy
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research problem:</b> A considerable amount of scholarship has amassed over the last 20 years regarding the teaching of user experience (UX) design, but there has been no systematic attempt to review this literature. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research questions:</b> 1.What is the definition of UX pedagogy according to technical communication and adjacent fields? 2. What is the state of specific UX pedagogical approaches in technical communication and adjacent fields? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Literature review:</b> Our corpus contained 76 sources directly pertaining to the teaching of UX. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research methodology:</b> The theoretical framework of this study marries rhetorical theory and critical thinking. The former provides technical communication literature reviews with keen discourse analysis and the latter offers objectivity to the evaluation. To use this framework, we sought sources using journals related to technical communication and large databases from adjacent fields, including the ACM digital library and IEEE Xplore. We completed our search using Google Scholar to ensure broad coverage. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results and conclusions:</b> Our review of sources revealed a variety of trends and a remarkably diverse conversation on UX, including various definitions of UX pedagogy, and a large variety of theoretical orientations, educational models, instructional approaches, industry influences, methods, and ethical concerns. From this diverse corpus, we hazard a unifying definition centered on teaching the UX process through hands-on approaches such as engaged learning. We close our article with recommendations for continuing to refine UX pedagogy in the future.

    doi:10.1109/tpc.2023.3314313
  2. Fostering Advocacy, Developing Empathetic UX Bricoleurs: Ongoing Programmatic Assessment and Responsive Curriculum Design
    Abstract

    <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Introduction:</b></i> As a field, we have tended to look at user-experience design (UXD) as a data-driven design process, anchored by usability studies, and anchored in fulfilling user needs and expectations. How then might technical and professional communication (TPC) curricula respond to evolving trends in user-experience (UX) scholarship and pedagogy? <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>About the case:</b></i> Addressing this question, we share our programmatic journey, a teaching case that represents more than a decade of reflection and evolution, culminating in the launch of a redesigned major and a UXD minor in a stand-alone department at a regional, primarily undergraduate teaching-focused university. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Situating the case:</b></i> Our programmatic identity began to shift toward a designer mindset that embraced three core frames for professional action–information design, problem solving, and civic engagement—and three complementary design tenets—empathy, advocacy, and bricolage. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Methods/approach:</b></i> To better understand this shift, we recognized the need for a multimethod approach of data gathering. Beginning with an annual assessment of our introductory and capstone courses, we collected data through examination of key course artifacts, through department self-studies, which includes surveys, interviews, and focus groups with relevant stakeholders, and through an external review. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Results/discussion:</b></i> Our self-study data indicated that our students would benefit from stronger audience awareness and design competencies. From these data, we discuss curricular revisions, which include creating a UXD minor. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Conclusions:</b></i> We conclude this article by considering the following three questions: 1. What strategies might other programs consider if they want to design empathy-driven UX pedagogy that is responsive to prevailing scholarly and pedagogical trends? 2. Why might programs cultivate student-researchers as UX bricoleurs? 3. What might other programs expect from student-researcher UX bricoleurs?

    doi:10.1109/tpc.2023.3320530

June 2023

  1. A Metainvestigation of Speaking Skills: Practice, Feedback, and Self-Directed Efforts
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Background:</b> Fluent and accurate speaking is an essential set of skills that engineering students strive to achieve, as they can lead to better job placement and a promising future. This article documents a speaking assessment carried out among 120 engineering students who have undergone two semesters of Technical English courses in the final year of their study. The students from diverse departments opted for the English for Competitive Exams elective course to improve their English language proficiency. The objective of the elective is to train the learners in essential language components for facing high-stakes competitive exams with an integrated language skills approach. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Literature review:</b> This linguistics-focused study documents a cluster strategy, a pedagogical attempt at speaking, with a culminating self-reflection phase. The strategy cluster was thoughtfully designed and integrated throughout the semester to enhance the students' speaking competency. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research questions:</b> 1. How do learners perceive the effectiveness of speaking skills practice given to them in the online sessions? 2. What benefits through feedback have learners achieved during these sessions? 3. How do students perceive the role of self-directed efforts toward improving their speaking skills? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methods:</b> Students were trained on speaking skills as part of a semester-long online course, and an assessment for speaking skills was designed in which students answered 10 self-reflective questions about their perception and usefulness of practice, feedback from the instructor and peers, and self-directed efforts. Each student's recorded audio file of an average of 11 minutes 24 seconds was uploaded to the learning management system (LMS) as part of the assessment. A qualitative and interpretative investigation of their answers reflecting their learning experiences during the semester, based on the activities and self-regulation, and their self-rating were analyzed thematically. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results and discussion:</b> The findings of the metainvestigation show significantly valuable insights with potential implications on the language teachers’ perception of teaching speaking skills in the classroom, especially in the current online environment. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusions:</b> We conclude that using the strategy cluster comprising practice, feedback, and self-directed efforts with a culminating phase of oral self-reflection is highly beneficial in developing speaking skills in engineering courses focusing on technical communication.

    doi:10.1109/tpc.2023.3251140

March 2023

  1. 360° Video for Research Communication and Dissemination: A Case Study and Guidelines
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Introduction:</b> 360° videos are increasingly popular channels for science communication and higher education; however, time-limited 360° videos that disseminate scientific research via platforms like YouTube remain underexamined. To address this problem, this experience report reviews the creation and evaluation of six 2D video interviews and six 360° video tours. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">About the case:</b> The European Commission's Joint Research Centre (JRC) and other public-facing organizations already publish 2D videos on social media channels and host 360° video content on their institutional websites. This case addresses the affordances and constraints of creating short 360° videos for publication on public-facing platforms. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Situating the case:</b> 360° video content has been incorporated into science communication and pedagogical practices in higher education. The authors review these developments and show the need for further research on time-limited 360° video. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methods/approach:</b> Scientists researching energy-related technologies were invited to record 2D video interviews. Based on these interviews, six transcripts for 360° videos were drafted and recorded in the same lab settings. When the videos were published, European researchers and communication professionals were recruited to complete a short survey evaluating the videos’ relative merits. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results/discussion:</b> The survey results (n = 32) suggest a similar overall quality of the 2D video interviews and 360° video tours. Respondents ranked the interviewee or narrator as the best feature of both the 2D and 360° format, and 47% said that they would prefer to have a 360° video created about their research. Based on our experience, we provide guidelines related to the production and publication of short 360° videos. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusion:</b> Further research and practice are required to understand which specific features of the 360° videos are most effective and whether this technology offers distinct advantages as a tool for dissemination. Further research and practice will establish more detailed approaches to 360° video.

    doi:10.1109/tpc.2022.3228022

December 2022

  1. Heuristic Evaluation Versus Guideline Reviews: A Tale of Comparing Two Domain Usability Expert's Evaluation Methods
    Abstract

    <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Background:</i></b> The usability of university websites is important to ascertain that they serve their intended purpose. Their usability can be evaluated either by testing methods that rely on actual users or by inspection methods that rely on experts for evaluation. Heuristic evaluation and guideline reviews are two inspection methods of usability evaluation. A heuristic evaluation consists of a few general heuristics (rules), which are limited to checking general flaws in the design. A guideline review uses a much larger set of guidelines/suggestions that fit a specific business domain. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Literature review:</i></b> Most of the literature has equated usability studies with testing methods and has given less focus to inspection methods. Moreover, those studies have examined usability in a general sense and not in domain- and culture-specific contexts. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research questions:</i></b> 1. Do domain- and culture-specific heuristic evaluation and guideline reviews work similarly in evaluating the usability of applications? 2. Which of these methods is better in terms of the nature of evaluation, time needed for evaluation, evaluation procedure, templates adopted, and evaluation results? 3. Which method is better in terms of thoroughness and reliability? <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Research methodology</i></b> : This study uses a comparative methodology. The two inspection methods—guideline reviews and heuristic evaluation—are compared in a domain- and the culture-specific context in terms of the nature, time required, approach, templates, and results. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Results:</i></b> The results reflect that both methods identify similar usability issues; however, they differ in terms of the nature, time duration, evaluation procedure, templates, and results of the evaluation. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><i>Conclusion:</i></b> This study contributes by providing insights for practitioners and researchers about the choice of an evaluation method for domain- and culture-specific evaluation of university websites.

    doi:10.1109/tpc.2022.3201732
  2. So, You Have to Write a Literature Review: A Guided Workbook for Engineers: Catherine G. P. Berdanier and Joshua B. Lenart: [Book Review]
    Abstract

    The book offers a range of plans including a 32-week plan to craft chapter-length literature reviews for a dissertation, a 16-week plan for those more time-crunched or experienced, an 8-week plan for the “highly motivated” or those with shorter literature review requirements such as for a conference paper, and finally two-week and one-week plans for the truly desperate. Activities in each chapter take the writer step-by-step through the process of preparing the review for evaluation by an advisor. The book is further divided into 12 chapters, the last of which is geared more toward advisors and writing instructors. This book fills a long-standing gap in resources for novice research writers. Too often, graduate students receive feedback on only grammar and punctuation issues—surface concerns—rather than the structure and clarity of their narratives. Berdanier and Lenart provide a step-by-step guide for graduate students, postdoctoral researchers, and new graduate advisors in writing effective, impactful literature reviews, the backbone of journal articles that get cited and grant proposals that get funded. Not to be overlooked, though, are writing center coaches, who often see engineering students and faculty in their sessions but may not have the background to feel comfortable providing guidance on such projects. At a minimum, this book is a must-have for engineering graduate students seeking a path through one of the more challenging writing tasks early in their careers.

    doi:10.1109/tpc.2022.3214413

June 2022

  1. Designing Three-Dimensional Augmented Reality Weather Visualizations to Enhance General Aviation Weather Education
    Abstract

    <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Objective</b>:</roman> We designed, developed, and evaluated a 3D augmented reality (AR) weather visualization to investigate whether it could enhance communication about weather in general aviation (GA) education. <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Background</b>:</roman> Evaluations of GA weather training identified gaps in training where students lack the ability to correlate weather knowledge to inflight decision making. <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Literature review</b>:</roman> 3D AR learning objects have been used in the sciences to make representations of multidimensional natural phenomena more accessible in classroom settings, and they offer the promise of enhancing communication about weather. <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Research question</b>:</roman> Can smartphone- and tablet-based 3D AR weather visualizations be effective tools to enhance current GA weather education? <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Methods</b>:</roman> A 3D AR thunderstorm cell lifecycle visualization was designed and developed. A preliminary evaluation of the application for GA weather training was conducted with one certified flight instructor, one university aviation meteorology instructor, one university thunderstorm expert, and three students to assess whether the AR thunderstorm visualization can communicate weather theory and whether the interfaces are usable for learning and task completion. <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Results</b>:</roman> Students’ knowledge of thunderstorms increased after using the visualization to explore the dynamics of the thunderstorm lifecycle and various aspects of thunderstorms. Experts felt that the learning experience met their expectations of what they wanted to communicate about thunderstorm theory. The AR interfaces were rated as usable for learning interactions and produced low levels of workload. <roman xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><b>Conclusion</b>:</roman> The communication of thunderstorm theory was supported by the animation and interactivity of the visualization, and has the potential to enhance current general aviation weather education.

    doi:10.1109/tpc.2022.3155920

December 2021

  1. Elevator Pitch Assessment Model: A Systematization of Dimensions in Technology Entrepreneurship Presentations
    Abstract

    The creation of a technology venture brings the entrepreneur to interact with different stakeholders and persuade them of the quality of the business idea. In such endeavors, entrepreneurial storytelling and business pitches are crucial to attract stakeholder interest and potential commitment. We focus on longer and structured elevator pitches used by entrepreneurs seeking funds and partners for their startup, and we present an integrative framework of evaluation dimensions, specific items, and key evidence to assess a pitch. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research methodology:</b> We conducted a systematic review of specialized literature on business venturing, entrepreneurship, and business communication, and we selected 40 research articles from which we have extracted concepts related to the quality and effectiveness of an elevator pitch. We analyze and aggregate concepts to derive a taxonomy of evaluation dimensions. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Results and discussion:</b> We identify four dimensions of evaluation of an elevator pitch: background and contextual knowledge showed in the presentation, project content and venture information, storytelling approach and style, and entrepreneurial flow or “algorithm” of the pitch. We detail the dimensions by defining 19 evaluation items and associated key evidence to support assessment. We undertake a preliminary application of the framework with three groups: Business investors, potential entrepreneurs, and entrepreneurship students. <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Conclusion and further research:</b> We advance the discussion on venture storytelling and provide practitioners with a useful tool to support the evaluation of an entrepreneurial idea presented through an elevator pitch.

    doi:10.1109/tpc.2021.3110620

September 2021

  1. Opening the Conversation: The Development of a Faculty-Facing Module on Teaching Students With Dyslexia
    Abstract

    Introduction: Accessibility training frequently relies upon checklist-based approaches to convey important standards and guidance. Such approaches limit scalability and acknowledgement of the user experience. About the case: A certificate program for faculty and graduate teaching assistants who are instructors of record at one university provided an opportunity to develop a learning module about dyslexia. Situating the case: Dyslexic students frequently require alterations to both teaching approaches and document design; however, studies show that some faculty do not see or feel a need to offer any accommodations for this dis/ability. Research indicates that train-the-trainer approaches to accessibility training offer improved scalability and efficacy when it comes to engaging and acknowledging the needs of dis/abled communities. Amplifying voices from the dis/abled community in training also personalizes the need to make content accessible. Approach: This article covers the module's creation and implementation via the iterative Analysis, Design, Development, Implementation, and Evaluation (ADDIE) method. In doing so, it provides a framework for creating similar modules that industry practitioners and faculty can implement within their own organizations. Results/discussion: The COVID-19 pandemic led to fewer participants in the module than anticipated; however, preliminary feedback suggests the approach's efficacy. Conclusion: A train-the-trainer approach that integrates testimonials from the dis/abled community offers a user-focused means of disseminating accessibility guidelines that organizations should consider if looking for rapid scalability for new accessibility initiatives.

    doi:10.1109/tpc.2021.3089859

March 2020

  1. Using a Transfer-Focused Writing Pedagogy to Improve Undergraduates’ Lab Report Writing in Gateway Engineering Laboratory Courses
    Abstract

    Background: The lab report is a commonly assigned genre in engineering lab courses; however, students often have difficulties meeting the expectations of writing in engineering labs. At the same time, it is challenging for engineering faculty to instruct lab report writing because they are often under-supported in writing pedagogies and usually unfamiliar with the extent of students' prior writing knowledge. Literature review: Literature on technical communication in engineering addresses the importance of a rhetorical approach to writing instruction, as well as an emphasis on genre. Extending this literature, research into writing transfer provides valuable insight for better understanding how undergraduates negotiate the engineering lab report as a new genre within this distinct rhetorical context. Research questions: 1. How effective is a transfer-focused writing pedagogy in supporting students' understanding of the genre conventions of engineering lab reports? 2. How does the transfer-focused writing pedagogy impact students' writing quality in five categories (rhetorical knowledge, organization, evidence, critical thinking, and disciplinary conventions)? 3. What are the rhetorical features that engineering students improve or struggle with the most with lab report writing? Research methodology: Four engineering instructors and two English instructors participated in this study to design and develop the lab report writing instructional module, and implemented the module materials into their engineering lab courses. The module, consisting of lab report writing instruction and assessment resources, shares a rhetorical approach and foundational writing terms with first-year composition courses to emphasize a writing-transfer pedagogy. We collected and analyzed undergraduates' lab report samples to evaluate the impact of the module on students' writing performance. Two sets of lab reports were collected for analysis: the sample sets before (control), during the 2015-2016 academic year; and after (experimental) implementation of the module, during the 2016-2017 academic year. Results and conclusions: Data collected via pre- and post-implementation writing artifacts show that a rhetorical approach to teaching lab reports helped students better understand the expectations of the lab report as a discipline-specific genre, and it developed students' understanding of the rhetorical features of engineering writing. The pilot module positively impacted the quality of students' lab reports, a finding that suggests that using a transfer-focused writing pedagogy can successfully support the transfer and adaptation of writing knowledge into gateway or entry-level engineering laboratory courses.

    doi:10.1109/tpc.2019.2961009

March 2019

  1. David Kmiec and Bernadette Longo Eds.: The IEEE Guide to Writing in the Engineering and Technical Fields [book review]
    Abstract

    The IEEE Guide to Writing in the Engineering and Technical Fields is a concise manual for engineers, technical professionals, scientists, researchers, teachers, and students to improve their writing skills. Each chapter is short—ranging from 20 to 40 pages—and the entire book is 200 pages, including appendices. The book accomplishes its purpose of providing recommendations for writing activities and for "assessing the social situation of writing, then using that assessment to make writing decisions" (p. 5). Throughout the book, the authors offer short, manageable takeaway lessons to help readers make writing decisions and learn IEEE style for references. Compared to other engineering communication textbooks and manuals, this guide is short and manageable, yet its approach still considers the rhetorical and contextual dimensions of writing. Because it is brief, the guide does not explicitly cover ethics, risk communication, information graphics, presentations, and global or international communication. It also does not provide as many examples or complete samples of the genres and best practices discussed. Finally, as with other textbooks, some genres are missing, such as reviews, evaluations, and regulations. Nevertheless, these limitations do not diminish the value of the book in giving a concise and convenient overview of standard engineering communication genres and a rhetorically grounded framework for readers to use when writing in the engineering workplace. The book has potential for use in writing-intensive courses, where students must compose documentation for labs and projects, as well as for in-house training for employees. Its hybrid framework for making decisions as you write is flexible and can be applied to many different writing situations. Furthermore, the guide offers valuable, basic help on writing mechanics. It offers readers an approach to engineering communication that can help them think about the decisions that they make when they write and make thoughtful, informed choices in their writing.

    doi:10.1109/tpc.2019.2895181
  2. YouTube Gamers and Think-Aloud Protocols: Introducing Usability Testing
    Abstract

    Background:Recordings of gamers interacting with video games have become a mainstay of online video-sharing communities such as YouTube. Sometimes called Let's Play videos, those recordings include content relatable to usability testing sessions and potentially illustrate basic think-aloud protocols.Literature review:Research regarding think-aloud protocols indicates that the use of video to review concurrent user commentary is a valid usability testing technique, including sessions that include little to no tester instruction or intervention. Evaluation using a heuristic created for the studied interface can support this type of usability testing.Research questions:1. Based on a heuristic created from video game usability research, do Let's Play videos provide content representative of think-aloud protocols regarding usability of the games played? 2. Are relevant Let's Play videos potentially useful tools for illustrating think-aloud protocols to students unfamiliar with this type of usability testing?Methods:After reviewing research concerning video game heuristics to create a common set of guidelines, the author selected and reviewed five YouTube videos, gathering and coding information related to the heuristic.Results:The recordings were found to contain relevant information regarding video game usability based on the criteria developed from the literature, specifically considering verbalizations relative to think-aloud protocols.Conclusion:Because these gaming videos contain commentary measurable against a research-based heuristic for game usability, they could be used as an additional method to introduce think-aloud protocols to usability students.

    doi:10.1109/tpc.2018.2867130

December 2018

  1. More Than a Feeling: Applying a Data-Driven Framework in the Technical and Professional Communication Team Project
    Abstract

    Introduction: Group projects are a common pedagogical tool for technical and professional communication courses. These projects provide students with valuable learning experiences that they would not otherwise receive working individually. However, student group projects come with some unique challenges, such as unequal distribution of work, unequal levels of learning, and perceptions of fairness. Situating the case: While many instructor-led resources and strategies exist for facilitating group projects, fewer student-empowering strategies exist. Data provide one potential way to empower students to take ownership of their team experience and make more informed decisions throughout the teamwork process. About the case: This teaching case was born out of a response to the many teamwork problems that are outlined in the literature and that the author has observed as an instructor. This teaching case describes the implementation and outcomes of a data-driven framework for decision making called collect, analyze, triangulate, and act (CAT) that the author developed. After they learned about the CATA framework, the students completed a series of data-driven exercises during the team formation, team functioning, and team evaluation stages of the team project. Perceptions of CATA's effectiveness were collected after the project ended. Methods: A mixed-methods approach, which included a survey and a series of interviews, was used to gain insights into how both team members and team leaders perceived the CATA framework. Results: Survey results indicated that students found the CATA framework helpful in many team contexts. Students expressed particularly strong opinions about how CATA aided in the fairness and accuracy of peer evaluations, was helpful for self-reflection, and was useful for making informed arguments to convince team members of a decision. Interviews with team leaders revealed that appealing to data using the CATA framework was helpful in managing the team but had limited capacity to aid in managing conflict. Conclusions: Students realized many benefits from the CATA framework, and some team leaders even felt empowered in certain instances by appealing to data. However, instructors should still consider scaffolding data literacy and teamwork skills for students to be fully prepared for successful teamwork.

    doi:10.1109/tpc.2018.2870683

September 2017

  1. A Writing-Across-the-Curriculum Faculty Development Program: An Experience Report
    Abstract

    This case study reports on the experiences of designing and assessing the effectiveness of a faculty development program on writing across the curriculum (WAC). The report focuses on the question: What are the key components of an effective faculty development program to integrate WAC into engineering and scientific courses taught by faculty in those disciplines? Situating the case: Two main models of WAC implementation exist: direct instruction, which uses writing specialists to deliver instruction to engineering and science students, and the department-centered model, which instructs faculty in engineering and scientific disciplines to teach writing as part of technical courses. How the case was studied: A report of the experiences of the authors and the feedback from the participants. About the case: The workshop was aimed at teachers in various disciplines and covered these main topics: fundamentals of writing theory and pedagogy, writing assignment design and assessment, and situating writing assignments in courses across the disciplinary curriculum. It took place over 10 weeks during a 15-week semester and included large- and small-group meetings, consultations with the members of the university WAC program, and peer review of writing assignment drafts. Conclusions, limitations, and suggestions for future research: Key challenges in developing the workshop included designing ways to bridge the conceptual gap between the participants' and WAC instructors' understanding of the role of writing in disciplinary courses, limited time available to the participants, and scheduling challenges. The workshop was given seven times. Most of the faculty participants (90%) generally found it to be very effective or effective. Studies of workshops with larger populations of trainees are suggested.

    doi:10.1109/tpc.2017.2702041

June 2017

  1. The New Normal: Pressures on Technical Communication Programs in the Age of Austerity [by Tillery, D. and Nagelhout, E., Eds.; Book review]
    Abstract

    This book examines some of the many struggles that various programs in the field have endured in light of the "Great Recession" and shares the faculty’s initiative to take action to ensure the sustainability of their programs. Eleven essays written by 20 different contributors from a range of institutions assist in successfully achieving the book’s purpose—namely, providing methods and models for how academic programs can “do more with less” in an age of austerity. Program coordinators and those who teach program assessment should take heart in knowing that they do not face these challenges alone, and they might use this book to brainstorm and identify solutions for their programs.

    doi:10.1109/tpc.2017.2685758
  2. Creative Content Management: Importance, Novelty, and Affect as Design Heuristics for Learning Management Systems
    Abstract

    Background: This paper examines creativity in content management (CM) by presenting a case study analysis of an original, open-source, Web-based learning-management system (LMS). It explores existing literature and suggests new ideas about creativity and CM. Research questions: How can we conceptualize creativity in relation to CM? How can creativity be operationalized into specific design practices within CM? What dimensions of creativity should be considered when designing or evaluating creative CM systems?Situating the case: Theoretical research in content-management systems (CMSs) and LMSs has revealed a gap in our field's current understanding of how creativity relates to CM. Research studies related to the measurement of creativity have provided insight into characteristics and methodologies that could be adopted and adapted to evaluate creativity in CM. Studies from the learning sciences have investigated where LMSs fall short and suggested where new opportunities exist to better facilitate the informational needs of users. These works have pointed to a need for research on integrating creativity and CM, both in content and in the systems that manage content, and have laid the groundwork for this study. Methodology: This research investigates theories of creativity as they relate to CM by conducting a case study analysis of unique instructional software designed to deliver content to students enrolled in a university course. The primary evidence is taken from notes about the design and evaluation of the software and from survey data illustrating students' user experiences. About the case: We developed a classification strategy for exploring creativity along three dimensions-importance, novelty, and affect-and then used this strategy to explore a unique system's approach to deal with content challenges in each of those areas. User experience impressions provide evidence of successes and failures of experimental CM in these domains. Conclusions: The study finds that this original LMS design did contain features that exhibited novelty, importance, and affect, and that such features can be used to identify creativity in product design as well as to assess the design of complex software systems such as CMSs and LMSs. This detailed analysis of an original design for an LMS suggests new ideas for implementing and using CMSs and LMSs in technical communication. The study concludes by presenting a rubric for evaluating creativity in CMSs and LMSs, or for designing such systems with creativity in mind.

    doi:10.1109/tpc.2017.2656578

September 2015

  1. A Study of the Usefulness of Deploying a Questionnaire to Identify Cultural Dynamics Potentially Affecting a Content-Management Project
    Abstract

    Background: A content-management project that proceeds with an incomplete understanding of the views, reservations, agendas, and attitudes held by stakeholders could likely encounter problems in implementation. The vast majority of content-management implementation projects proceed with very little visibility into the cultural dynamics that will eventually play such a central role in determining the success or failure of the projects. This case study examines the usefulness of deploying a needs assessment questionnaire to gather qualitative data that could help content-management project leaders understand participant needs, attitudes, and perceptions, and that could potentially improve the implementation of content-management projects. Research questions: How might previously published research questions for assessing cultural dynamics be adapted for a questionnaire intended to gather input from participants in the early stages of the implementation of two separate content-management projects? What kinds of issues does the questionnaire elicit from participants? To what extent is the questionnaire useful in assessing content-management project participant needs and how might it be revised and adapted for other organizational contexts? Situating the case: Implementing a content-management project results in a change to organizational processes; careful attention to managing this change is essential to the success of the project. Specific change-management issues emphasized in literature that addresses organizational and technological change include organizational readiness, stakeholder input, communication of project goals and plans with stakeholders, and training and time to learn and practice new approaches to operations. Organizational culture-a set of beliefs and values that members of an company share in common-plays a role in implementations of technology. Assessing organizational climate and stakeholder values and attitudes-characteristics of organizational culture-as part of a change-management plan can ensure that the culture is addressed when implementing a content-management project. Methodology: This project consisted of three parts: designing a pilot questionnaire based on a previous published methodology for assessing cultural dynamics, conducting the questionnaire within two organizations implementing content-management systems, and assessing the extent to which the questionnaire was useful in the context of the content-management projects. Responses were analyzed using a Grounded Theory approach. About the case: We developed a cultural dynamics needs assessment questionnaire and deployed it within two organizations with the purpose of gathering data about the attitudes and perceptions of project participants toward the impending content-management system implementation. The questionnaires informed the implementations of content management as anticipated. Conclusions: A questionnaire can help understand the cultural dynamics impacting the adoption of new technologies and processes; this method can be included as part of an overall needs assessment for a content-management project. This study also confirms the merit of the research methodology followed; the questionnaire design elicited thoughtful responses from participants and the analysis approach illuminated insights that were then used to engage participants and modify project implementation plans. The constructive outcome of this study suggests the need for more empirical studies and field evaluation studies that build on this one.

    doi:10.1109/tpc.2016.2516638

June 2015

  1. Personas in Heuristic Evaluation: An Exploratory Study
    Abstract

    Research problem: No study has explored how incorporating personas into heuristic evaluation of products, namely websites, affects the kinds of findings reported and the recommendations presented by usability evaluators. Research questions: (1) Do findings resulting from heuristic evaluations of a website without the use of personas differ from findings resulting from heuristic evaluations of the same website with the use of personas? (2) Do findings from persona-based heuristic evaluations in which evaluators develop their own personas differ from findings from persona-based heuristic evaluations in which evaluators are given personas? (3) If findings and recommendations are different, how do they differ? (4) How does the use of personas affect the evaluators' confidence in the findings of a heuristic evaluation? Literature review: First, previous research of heuristic evaluation has concluded that although heuristic evaluation is inexpensive and does not require advance planning, it has several shortcomings, including its too-intense focus on minor issues and its inability to capture all usability issues. Second, data-driven personas, which have long been a resource in user-centered design, have been suggested as a way to improve or enhance heuristic evaluation, and several studies suggest that usability professionals are indeed using personas in their evaluations. However, no empirical study has assessed heuristic evaluations that include personas. Methodology: In this exploratory study involving three sections of an advanced technical writing course, groups of evaluators conducted a heuristic evaluation of a website. Each section was randomly assigned a different condition with which they would conduct the heuristic evaluation: (a) a traditional heuristic evaluation, (b) a persona-led heuristic evaluation in which the personas were given to the evaluators, or (c) a persona-led heuristic evaluation in which the evaluators themselves created their own personas. Each group wrote a report identifying the major problems with the website and provided recommendations to solve the identified problems. The evaluators completed pretesting demographic surveys and posttesting confidence surveys. Results and discussion: This exploratory study found few detectable differences in the findings reported by groups that used personas in heuristic evaluation and groups that did not use personas. The groups that used personas were more likely to report findings related to navigation than the groups that did not use personas, while the groups that did not use personas were more likely to report findings related to design than the groups that used personas. The groups that created their own personas were more likely than the other groups to include complex issues in their reports and include language that directly references users and user needs. All groups were confident in their findings.

    doi:10.1109/tpc.2015.2429971
  2. Teaching and Learning in Cross-Disciplinary Virtual Teams
    Abstract

    Background: Virtual teams collaborate across distances using information communication technologies (ICTs). A distinctive set of communication skills is needed by people who work successfully in virtual teams, and few universities or companies provide structured education and training in virtual teamwork. At a midsized southeastern Masters Comprehensive University, professors from the Colleges of Arts and Sciences, Business, and Education came together to explore how they might use cross-disciplinary student teams (groups comprised of students with different backgrounds and educational goals) to teach concepts in their own disciplines while providing students with the opportunity to become more proficient in virtual team communication. Research questions: (1) Can cross-disciplinary student team projects successfully support learning in virtual team communication as well as address the learning objectives of specific courses? (2) What can faculty learn from a cross-disciplinary teaching model that can be applied to virtual teams? Situating the case: Experiential learning is based on performing real tasks and reflecting on that process; it benefits learners by engaging them in complex, authentic situations. Virtual teams are significant because they support a great deal of the work currently taking place in our global economy; they are significant in higher education because students need to develop skills in international virtual communication before they are introduced to high-stakes work environments. In previous cases, students have collaborated across national cultures to develop project deliverables, such as websites, reports, and usability studies and present them in virtual environments using such tools as WebEx, Skype, and live streaming. How this case was studied: The findings from this case are based on individual student reflections, which were used to create a data matrix for each project, and instructor observation and evaluation. About the case: In Spring 2013, six faculty from the same university worked together to incorporate virtual teams into their classrooms. These six faculty members were divided into two groups of three with each group representing three colleges mentioned earlier. The faculty developed two interdisciplinary projects (one on infographics and another on social media) that enabled rich and diverse student collaboration. In both groups, the three faculty leaders worked together to define a project scope that students could achieve and that would relate to learning goals in each discipline. Conclusions: The lessons learned from this experience are that: (1) technical challenges will occur; (2) students from all disciplines must receive the same information; (3) instructors must balance respect for their colleagues and support for their students; (4) team assignments need to be consistent and fair; (5) instructors need to establish appropriate and fair assessment measurements for their own students; and (6) projects need to be realistic in order to show the students the value of virtual work.

    doi:10.1109/tpc.2015.2429973

March 2014

  1. Seeking an Effective Program to Improve Communication Skills of Non-English-Speaking Graduate Engineering Students: The Case of a Korean Engineering School
    Abstract

    Research problem: Many Asian universities have begun reforms to enhance educational competitiveness in our globalizing economy. This study aims to ascertain the status of English communication education and English-medium instruction at a Korean engineering school and to offer workable suggestions for English communication training for Korean graduate engineering students. Research questions: Should English communication education be offered at the graduate level in Korean engineering schools? How could English communication education be improved for Korean graduate engineering students? Literature review: Studies of English communication education for graduate engineering students indicate that English as a Foreign Language (EFL) students have English needs to publish internationally and English needs for English-medium instruction classes and for after graduation. Furthermore, individual assistance and e-learning programs might strengthen English communication education and academic writing for EFL graduate engineering students. Methodology: An evaluation study was conducted at an institution that has been leading the wave of English as the language of instruction. We collected data from documents as well as through surveys of faculty and students in graduate engineering programs. Results and discussion: The study was conducted at the Korea Advanced Institute of Science and Technology. The results showed that students' English fluency is critical for the success of using English as a medium of instruction. To facilitate this fluency, universities need to establish an English communication center that provides a comprehensive, systematic approach to English language training. Faculty also need the services of such centers. It is also advised that a thesis writing course be customized according to students' actual writing and communication abilities and enhanced with collaboration between engineering faculty and English education faculty.

    doi:10.1109/tpc.2014.2310784

December 2013

  1. Enhancing Team Performance Through Tool Use: How Critical Technology-Related Issues Influence the Performance of Virtual Project Teams
    Abstract

    Research problem: The project management of virtual teams differs from that of traditional ones. Traditional project risks, such as complexity, the uncertainty of factors influencing the project, and the high interdependency of project tasks must be managed alongside changed temporal, geographic, and cultural dimensions. Only a few studies have investigated the effect of critical technological issues, such as wrong tool selection or limited internet access on performance as well as team and team member satisfaction in virtual work settings. Research questions: How do critical technology-related issues concerning the selection and use of web-based tools influence the performance and satisfaction of virtual project teams? Literature review: Instead of categorizing virtual teams as a type of team that contrasts with traditional or face-to-face teams, the focus has shifted to virtualness as a characteristic present in all teams. Project teamwork is often integrated in university degree programs in order to prepare students appropriately for real-life projects. While these student teams are often not geographically spread across countries, they have a high degree of virtualness because of their diverse team composition, the necessity for working at different places, and the limited face-to-face meeting opportunities. Performance, effectiveness, and satisfaction are central issues in the evaluation and measurement of project teams: Team performance is often evaluated on the basis of acceptance of a specified output by a customer. Through specific mediating processes, team performance can alternatively be assessed by inquiring the team's perception on their performance. Effectiveness can be defined as the achievement of clear goals and objectives and it is often related to the team's performance. Finally, satisfaction can be defined as having three dimensions-satisfaction with the team, the satisfaction of meeting customer needs, and general satisfaction with extrinsic rewards and work. Technology use is substantial for distributed teamwork and can be assessed by the extent to which it supports communication, collaboration, and project-management tasks. Methodology: Fifteen teams were observed and interviewed over a two-year period. The resulting data were analyzed using a Grounded Theory approach, which revealed how the selection and use of tools for communication, collaboration, and project management in the different project activities influenced the team's performance. Results and conclusions: Our results contribute to practice by providing a number of guidelines for the management of virtual teams as well as knowledge required by companies wishing to launch projects with virtual teams. Differing performances of teams can, in many cases, be attributed to such conditions as: internet availability and bandwidth; lack of training for certain tools; the selection and appropriate use of tools; integrated tool support for task management; as well as the promotion of transparency about progress made. It was found that restrictions in internet access of even a single member within a team limited the team's technological choices, which affected the team's performance.

    doi:10.1109/tpc.2013.2287571

June 2013

  1. A User-Centered Design Approach to Self-Service Ticket Vending Machines
    Abstract

    Since their introduction, self-service ticket vending machines (TVMs) have become an increasingly important distribution channel in the public transport sector, progressively replacing the traditional ticket counter. In a public transport setting, where ticket counter closures have left different groups of people dependent on TVM to meet their mobility needs, a single, effective system is required. Research questions: (1) Which barriers do currently hinder the usage of TVM? (2) Which requirements should a barrier-free TVM fulfill? (3) How can we design a new self-service TVM for a nationwide public railway company? (4) How can we ensure that the usability and user experience (UX) is high for all users, especially for those with low levels of technological affinity? Situating the case: Most other studies on the use and usability of TVMs were conducted as post-hoc evaluations. In contrast, our case study presents a user-centered design (UCD) approach that takes the needs of the different target groups into account throughout the whole development process. Theories and concepts that guided the case included UCD, which involves alternating test and evaluation loops that actively involve users to create a usable product and UX, which describes the quality of the experience a person has when interacting with a specific computer system using a specific interaction technique. Methodology: More than 250 participants were involved in focus groups, observations, interviews, and experiments from the very first stages of development. Interface designs were presented to the future end users to obtain their feedback, with the results fed back into the design process. About the case: A prototype for a novel generation of TVM was developed in three phases: First, the context of use was analyzed. In the second phase, we conducted a requirements analysis. Third, different hardware and software interaction designs were iteratively tested and evaluated. The resulting prototype met the requirements of most user groups, though further adjustments are necessary. Conclusions: The UCD approach proved to be a valuable framework for the development and design of self-service systems.

    doi:10.1109/tpc.2013.2257213
  2. Improving User Experience for Passenger Information Systems. Prototypes and Reference Objects
    Abstract

    Research problem: This study explores how established patterns, means, and services influence the users' first experience when encountering a novel self-service application. The application (DB Cairo) is a passenger information system for public transportation running on mobile phones. Research questions: Is the users' first experience with the application influenced by established communicative patterns, means, and services? Are they used as reference objects? Which attributes of the application are relevant? Is there a leading reference object (prototype)? Do reference objects vary depending on the personal factors age and gender? Literature review: Little is known about user experience in first contact situations regarding passenger information systems. For our investigations, we used a theoretical framework combining Linguistic Evaluation Theory, Prototype Theory, and Linguistic Genre Theory: Evaluations are regarded as an integral part of user experience. Evaluation is conceptualized as an act where a subject evaluates an object with a certain purpose at a certain time by comparing it with other objects. Every object has various attributes-some are relevant for the evaluation, and others are not. Communication quality is seen as a crucial complex attribute for the evaluation of communicative applications. Methodology: We conducted a qualitative study: Data from two user test series (n = 12)with thinking-aloud protocols and retrospective interviews were analyzed with qualitative content analysis procedures. The participants were male and female, age 25-35 or 55-65, mobile-phone users, and multimodal travellers. The tests were conducted in a laboratory with a computer-based mobile-phone emulator. Results and conclusions: Results show that the participants explore the application by comparing its attributes with attributes of reference objects. Reference objects vary depending on attributes of the application. Regarding topic-related attributes, participants rely on established artifacts, which form a topic-related multimedia network. Within this network, the website of German Railways functions as prototype. Age- and gender-specific differences were not detected. The findings indicate that research into user experience and development practice could benefit from reconstructing and analyzing topic-related artifacts. Limitations of the study were a small sample size, the test location, and environment. Future challenges are the investigation of influencing factors and the development of new methods/tools for data collection infield studies.

    doi:10.1109/tpc.2013.2257211

March 2013

  1. Research Article Measuring Mobile ICT Literacy: Short-Message Performance Assessment in Emergency Response Settings
    Abstract

    Research problem: A construct mediated in digital environments, information communication technology (ICT) literacy is operationally defined as the ability of individuals to participate effectively in transactions that invoke illocutionary action. This study investigates ICT literacy through a simulation designed to capture that construct, to deploy the construct model to measure participant improvement of ICT literacy under experimental conditions, and to estimate the potential for expanded model development. Research questions: How might a multidisciplinary literature review inform a model for ICT literacy? How might a simulation be designed that enables sufficient construct representation for modeling? How might prepost testing simulation be designed to investigate the potential for improved command of ICT literacy? How might a regression model account for variance within the model by the addition of affective elements to a cognitive model? Literature review: Existing conceptualizations of the ICT communication environment demonstrate the need for a new communication model that is sensitive to short text messaging demands in crisis communication settings. As a result of this prefect storm of limits requiring the communicator to rely on critical thinking, awareness of context, and information integration, we designed a cognitive-affective model informed by genre theory to capture the ICT construct: A sociocognitive ability that, at its most effective, facilitates illocutionary action—to confirm and warn, to advise and ask, and to thank and request—for specific audiences of emergency responders. Methodology: A prepost design with practitioner subjects <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex Notation="TeX">$({N}=50)$</tex></formula> allowed investigation of performance improvement on tasks demanding illocutionary action after training on tasks of high, moderate, and low demand. Through a model based on the independent variables character count, wordcount, and decreased time on task <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex Notation="TeX">$(X)$</tex></formula> as related to the dependent variable of an overall episode score <formula formulatype="inline" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex Notation="TeX">$(Y)$</tex></formula> , we were able to examine the internal construct strength with and without the addition of affective independent variables. Results and discussion: Of the three prepost models used to study the impact of training, participants demonstrated statistically significant improvement on episodes of high demand on all cognitive model variables. The addition of affective variables, such as attitudes toward text messaging, allowed increased model strength on tasks of high and moderate complexity. These findings suggest that an empirical basis for the construct of ICT literacy is possible and that, under simulation conditions, practitioner improvement may be demonstrated. Practically, it appears that it is possible to train emergency responders to improve their command of ICT literacy so that those most in need of humanitarian response during a crisis may receive it. Future research focusing on communication in digital environments will undoubtedly extend these finding in terms of construct validation and deployment in crisis settings.

    doi:10.1109/tpc.2012.2208394

September 2012

  1. Combining Concurrent Think-Aloud Protocols and Eye-Tracking Observations: An Analysis of Verbalizations and Silences
    Abstract

    Research problem: Concurrent think-aloud (CTA) protocols are one of the dominant approaches of usability testing. However, there is still debate about the validity of the method, partly focusing on the usefulness and exhaustiveness of participants' verbalizations. The rise of eye-tracking technology sheds new light on this discussion, as participants' working processes can now be observed in more detail. Research questions: (1) What kinds of verbalizations do participants produce, and how do they relate to the information that can be directly observed using eye tracking? (2) What do eye movements reveal about cognitive processes at times when participants stop verbalizing? Literature review: Our study replicates an earlier study by Cooke (2010), who used a combination of CTA protocols and eye tracking in a small sample with experienced and highly educated participants to investigate the validity of CTA. Cooke's results suggest that the additional value of participants' verbalizations is limited: at least 77% of the verbalizations referred to things that could be easily observed with eye tracking. Methodology: We conducted a study in which 60 participants with different characteristics performed tasks on informational websites. During their task performance, they verbalized their thoughts, and simultaneously their eye movements were measured. The resulting think-aloud protocols were divided in verbalization units, which were coded into content types. Silences were registered, and eye movements during these silences were analyzed. Results and discussion: We found a different distribution of verbalization types than Cooke (2010) reported, with far more verbalizations where participants formulated doubts, judgments on the website, or expressions of frustration. In our study, verbalizations provided a substantial contribution in addition to the directly observable user problems. We measured a rather high percentage of silences (27%), during which participants most often were scanning pages for information. During these silences, interesting observations could be made about users' processes and obstacles on the website. The implication of our study is that we now have a better understanding of the types of verbalizations that a CTA evaluation might generate. Further, we know that relevant usability observations can be made during silences. A limitation is that we do not know yet the influence of specific characteristics of the evaluation setting on the types of verbalizations and silences. Future research should focus on the influence of evaluation settings on the outcomes of an evaluation, in particular, the influence of characteristics of the participants who are involved in the study.

    doi:10.1109/tpc.2012.2206190

June 2012

  1. Different Approaches to Similar Challenges: An Analysis of the Occupational Cultures of the Disciplines of Technical Communication and Training Tutorial
    Abstract

    Problem: Perhaps it is presumptuous of technical communicators to assume that, because some of their skills that might be employed in developing and delivering training materials, that those skills alone are qualifications to work in training, much less the source by which the processes of Training might be examined. Using data from one survey and one interview-based study of the work of Technical communication and Training groups, as well as participation on committees responsible for certification examinations for technical communicators and trainers, this tutorial analyzes differences in the occupational cultures of the two fields. Key concepts: The work differs: technical communicators produce content that explains how to perform tasks; trainers produce programs that develop skills that a third party can verify. To do so, technical communicators follow a process that emphasizes writing and production; trainers follow a process that emphasizes the analysis of intended goals and evaluation of whether those goals have been achieved. The guiding philosophy of Technical communication is usability; the guiding philosophy of Training is performance. Although both disciplines are rooted in cognitive psychology, the primary intellectual roots of Technical communication are in rhetoric and composition, while the primary intellectual roots are in education. The preferred research methods of Technical communication are critical; the preferred research methods of trainers are empirical qualitative and quantitative methods. Key lessons: As a result, Technical communication professionals and researchers who want to work in training should approach the field in a culturally appropriate way by (1) recognizing distinctions between a communication product and a training program, (2) recognizing distinctions in work processes, (3) recognizing distinctions in language, (4) recognizing differences in values, and (5) acknowledging that an academic discipline of training exists.

    doi:10.1109/tpc.2012.2194601
  2. A Study of Engineering Students' Intercultural Competence and Its Implications for Teaching
    Abstract

    Research problem: The purpose of this study is to examine US engineering students' intercultural competence and its pedagogical implications. Three research questions are addressed: (1) What are engineering students' levels of awareness and sensitivity toward intercultural communication? (2) What are their perceived needs in learning intercultural communication? (3) Given these findings, what are some useful approaches and methods to teach intercultural communication in the engineering communication service class? Literature review: The literature review examines current studies on US engineering students' intercultural competence and establishes the scope of the study: intercultural awareness and sensitivity. The researcher consulted literature in intercultural studies, international education, and engineering education. Methodology: The researcher conducted a mixed method study, using surveys, textual analysis, and interviews. Two-hundred seventy-two engineering undergraduates at a Midwestern public university participated in the study. Participants were recruited from an engineering communication class. Data were collected through survey instruments, written responses to cross-cultural dialogs and critical incidents, and interviews. Both qualitative and quantitative analyses were performed. Results and discussion: Participants exhibited vague and passive awareness of intercultural communication, average to high intercultural sensitivity (subject to self-assessment and social desirability bias), and partial acceptance of intercultural communication education. Based on these findings, the researcher suggests a cultural-general approach to teaching intercultural competence in engineering communication service classes. The study is limited to research participants at one institution and two aspects of intercultural competence. Future studies can involve diverse research participants, address more aspects of intercultural competence, and examine the use of cultural-general teaching methods in the classroom.

    doi:10.1109/tpc.2012.2186657

March 2012

  1. Assessing the Impact of Student Peer Review in Writing Instruction by Using the Normalized Compression Distance
    Abstract

    Research Problem: Studies identify peer review as an effective instructional method to improve student writing. Some teachers, however, avoid peer review, perhaps due to the workload required for assessing and correcting peer reviews. Previous studies have not proposed any method to reduce teacher workload by using an objective means to analyze the effects of peer review. Research Questions: This study assesses the degree of similarity between student essay drafts using normalized compression distance (NCD), a compression-based classification algorithm. How does peer review affect student essays, as measured by the NCD? What were the changes in essay length and holistic scores? How did students respond to peer essays? How did peer review affect students during revision? What were the NCD results? How did holistic scoring correspond to NCD results? Literature Review: Studies of pharmacists and engineers indicate that English language technical communication skills are important. Studies of peer review in language education indicate that peer comments are valuable but cultural differences and lack of confidence may impede making or using comments. Studies of NCD applied to web data, figures, and images indicate useful results. Methodology: This quantitative study used anonymous peer review and compared the results of traditional holistic scoring against a novel NCD measure. The researchers conducted the study with 35 student volunteers at a pharmaceutical university in Tokyo, Japan. The students had at least nine years of previous English instruction and previous peer-review experience. In class, students wrote an essay, anonymously reviewed a peer's essay according to instructions, then revised their own essays based on peer comments. An assessor graded the two drafts using a holistic scoring rubric. The researchers used NCD to quantify the change between drafts. Results and Discussion: Sixty percent of revisions contained more words than the originals. 51% percent of revisions received higher scores, 40% had no change, and 8.5% percent had reduced scores. Eleven percent of reviewers with low English proficiency did not identify obvious errors. Three revised essays had lower grades because the writers did not know how to incorporate peer comments. Anonymous peer review could lead to poor results where students had poor reviewing skills or did not know how to use peer comments. NCD helps teachers identify which revised essays to re-evaluate after peer review by indicating those with large quantities of changes. The study was limited by its small group of participants. Future research will examine longer essays, more participants, varied backgrounds, web delivery of NCD, and finding more factors to indicate the quality of written work to reduce teacher workload.

    doi:10.1109/tpc.2011.2172833
  2. A Tale of Four Functions in a Multifunctional Device: Extending Implementation Intention Theory
    Abstract

    Research problem: This study examines functions in a multifunctional device, the smartphone. Specifically, it explores (1) to what extent does the theory of planned behavior capture user evaluation of different functions? (2) to what extent does pleasure have positive effects on intentions of different functions? (3) to what extent could the implementation intention theory identify the important functions? Literature review: To answer these questions, we look at the Theory of Planned Behavior which has been used to examine a single function device and test the predictability of the theory for a multifunctional system. We also review the Implementation Intention Theory and test the predictability of the theory for identifying important functions. Methodology: A quantitative survey of more than 200 smartphone owners in information-technology shopping malls and customer service centers for major smartphone brands was conducted. Results: The results from the data collected show that the theory of planned behavior and the additional pleasure construct explain more than 50% of the variance in intentions. The effect of pleasure on intention varies from one function to another. In general, pleasure shows much stronger effects for high-hedonic functions than for low-hedonic functions. In addition, the Implementation Intention Theory reveals that phone and organizer are the most important functions. Implications: These results contribute to research on multifunctional systems and communication technology, the Theory of Planned Behavior, the Implementation Intention Theory, and to the practitioners. However, the results of this study may be somewhat limited to users in a modern city. Future research could extend this study to include a task dimension, to compare different technologies and their functions, and to look at modality preferences.

    doi:10.1109/tpc.2011.2182570

December 2011

  1. Designing and Developing Questionnaires for Translation Tutorial
    Abstract

    Problem: Questionnaires are a popular method used by global companies to gain understanding or assess various aspects of their businesses. However, using a questionnaire across cultures requires extra effort in translating it into the target language(s) and culture(s) because a good questionnaire developed in one language/culture may not necessarily “travel well” across cultures due to differences in meaning and interpretation. This tutorial synthesizes the extant research on cross-cultural communication and surveys, and provides guidance in preparing cross-cultural questionnaires. Concepts: Translation affects the design and development of questionnaires to be used across cultures in these ways: (1) It affects the theoretical concepts to be studied: indicators-questions about concrete elements that can be measured and constructs-a series of questions about abstract elements that cannot be measured directly and essentially represent an underlying concept. Constructs must be adapted into a specific cultural context to achieve accuracy in measurements. (2) Differences in the contexts-the overall cross-cultural research context (the setting and the purpose) and the cultural context (the participants and their cultural background) of the study-affect translation because concepts in the source culture might be applied differently or not exist in the target cultures. (3) Translation might unintentionally introduce bias by inadvertently changing the perceived meanings of terms and questions-creating bias in constructs, on individual items on the questionnaire, and in its administration. (4) Translation might affect equivalence of terms in the source and translated versions, including linguistic equivalence (that is, wording of items), semantics (meaning of a phrase or concept), and grammar and syntax. Suggestions: Given these concepts, consider the following items when translating questionnaires: (1) accurately adapt or adopt questions from existing instruments, (2) make sure that you adapt the language to suit the situation, (3) hire translators who understand research processes, (4) use the decentering approach (a process in which translators move back and forth amongst the languages, checking for cultural and linguistic accuracy) when preparing the actual translation, and (5) assess your overall translated questionnaire. The questionnaire assessment model is a resource for guiding the assessment.

    doi:10.1109/tpc.2011.2172834

June 2011

  1. Assessing Typographic Knowledge Using Timed Tests
    Abstract

    While researchers and instructors of technical and professional communication have embraced the importance of visual communication skills in recent years, little systematic effort has been made to develop assessment instruments that measure visual design skills. This paper presents a project that examines timed tests as a means of measuring a student's ability to solve design problems. The process and rationale for the test designs and the results of a series of empirical studies are discussed. The results of the studies suggest that timed tests can be a viable complement to the project-oriented assessment approach suggested by prior studies.

    doi:10.1109/tpc.2011.2121670

March 2011

  1. Assessment in Technical and Professional Communication (Hundleby, M. and Allen, J., Eds.; 2010) [Book Review]
    Abstract

    The editors present a collection of 16 essays focusing on the state of assessment in technical and professional communication.

    doi:10.1109/tpc.2010.2077890

March 2010

  1. Assessing Technical Communication within Engineering Contexts Tutorial
    Abstract

    <para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> A major challenge in engineering education is to prepare professionals for communicating well in writing and speaking, using appropriate technologies, within professional contexts. Communication in the global engineering world includes collaboration on cross-functional teams, virtual-project team management, and writing for multiple, complex audiences. This tutorial discusses how one small engineering school has integrated technical communication teaching and assessment throughout the curriculum with demonstrated success. The integrated curriculum, formative and summative assessments, and real-world contexts offer one model to address growing communication challenges. </para>

    doi:10.1109/tpc.2009.2038736
  2. Rubric Use in Technical Communication: Exploring the Process of Creating Valid and Reliable Assessment Tools
    Abstract

    Assessing the quality of student efforts and products is a continual necessity for academics and practitioners in technical communication; however, the process of constructing valid and reliable rubrics remains an underexplored topic in the field. This paper first addresses some of the assessment concerns and then describes a case study that documents the development and implementation of one holistic and five analytic rubrics to evaluate undergraduate projects. The discussion focuses on identifying site-specific criteria and training effective raters and is intended to help academics respond to their required accreditation mandates and offer practitioners alternatives for evaluating products and services.

    doi:10.1109/tpc.2009.2038733
  3. Evaluating What Students Know: Using the RosE Portfolio System for Institutional and Program Outcomes Assessment Tutorial
    Abstract

    Currently, colleges and universities have developed assessment systems that can collect student work products for evaluation in an effort to make student learning transparent and ensure accountability in higher education. At the Rose-Hulman Institute of Technology, we have developed a digital portfolio system, the RosE Portfolio System (REPS), that allows for efficient data collection; the results of portfolio evaluations are used by academic departments and programs to improve curricula and provide evidence to external accrediting agencies. The results of evaluations of student performance are also used to ensure the quality of academic curricula.

    doi:10.1109/tpc.2009.2038737
  4. Assessment in Professional Communication
    Abstract

    The assessment of engineering products and services is central to the work of engineering, but the evaluation of human communication and its development in engineering and other technical professions has not yet received enough attention in IEEE research and publications. This special section begins to remedy this situation by calling for more research in the assessment of professional communication skills and training programs as well as in the development of better assessment tools and procedures. It features four new articles on the topic in the hope that these will inspire even more research related to the assessment of human communication in scientific and technical professions.

    doi:10.1109/tpc.2009.2038731

December 2009

  1. The Role of Information and Communication in the Context of Humanitarian Service
    Abstract

    Information and communication are playing an increasingly important and more sophisticated role in humanitarian-service activities involving logistics, organizational learning, health-care delivery systems, assessment, and education. This role is impacted by important trends and environments within which the humanitarian sector operates. These include a shift of focus from providing direct aid to capacity building, empowerment, and assessment; a shift in project focus from technical solutions to broader sociotechnical strategies; and increased emphasis on demonstrating effectiveness, improving efficiency, and collaborating with other organizations. Five articles in this issue address these areas, including two pieces on developing information and communication tools to support the work of humanitarian organizations, two pieces on preparing students to work in the humanitarian environment, and one on organizational culture and the challenge of enhancing organizational learning in the humanitarian sector.

    doi:10.1109/tpc.2009.2032379

September 2009

  1. Going Global: A Case Study of Rhetorical Invention, Packaging, Delivery, and Feedback Collection
    Abstract

    When the primary aim of global, professional communication expands to include rapport building in addition to information sharing, basic parts of the communication process must be reevaluated. Such an assessment was conducted through a case study of a team that adapted a US training seminar for a Japanese audience. The team's strong emphasis on the communicative aim of relationship building illustrated how traditional conceptions of rhetorical invention, packaging, delivery, and feedback collection might be revised. For practitioners and educators, the findings of this case study prompt a reevaluation of the rhetorical abilities that are required in global professional communication contexts.

    doi:10.1109/tpc.2009.2025305

March 2009

  1. "Ethics in the Details": Communicating Engineering Ethics via Micro-Insertion
    Abstract

    Work is described on a National Science Foundation grant that supports the development, assessment, and dissemination of ldquomicro-insertionrdquo problems designed to integrate ethics into the graduate engineering curriculum. In contrast to traditional modular approaches to ethics pedagogy, micro-insertions introduce ethical issues by means of a ldquolow-doserdquo approach. Following a description of the micro-insertion approach, we outline the workshop structure being used to teach engineering faculty and graduate students how to write micro-insertions for graduate engineering courses, with particular attention to how the grant develops engineering students' (and faculty members') ability to communicate across disciplinary boundaries. We also describe previous and planned methods for assessing the effectiveness of micro-insertions. Finally, we explain the role that technical communication faculty and graduate students are playing as part of the grant team, specifically in developing an Ethics In-Basket that will disseminate micro-insertions developed during the grant.

    doi:10.1109/tpc.2008.2012286