IEEE Transactions on Professional Communication
3229 articlesSeptember 2012
-
Abstract
Problem: One of the biggest problems with student and novice writing is that it often lacks clear organization and a coherent structure. However, it is difficult for newer writers to conceptualize a clear structure prior to writing a first draft. Thus, there is a need for an effective process to help writers revise early drafts with a particular focus on organizational clarity. Key concepts: Two concepts underlie this issue. The first is revision, which is the process of changing text to better achieve the writer's goals and serve the reader's needs. Two general categories of revision exist: a comprehensive edit (a thorough review of content, organization, visual design, style, illustrations, accessibility, and reuse to best serve readers) and a copyedit (a review of proper adherence to accepted language standards, which includes attention to grammar, spelling, punctuation, and sentence structure). The second is organizational structure (the arrangement and relationship of ideas), which is critical to help readers understand and use the information in the document. Key lessons: A reverse outline-a process that helps improve document structure and organization from an early draft-was developed to help writers make the organizational structure of an existing document to assess and improve the structure in a subsequent revision explicit. Reverse outlining has four steps: (1) identifying and listing discourse topics from a written draft, (2) arranging the discourse topics into an outline, (3) assessing the structure for appropriateness to audience and purpose, and (4) creating the new structure, modifying content where necessary, and adding headings, bullets, overview statements, and other advanced organizers. The reverse outlining process has been used extensively in the classroom and in the workplace.
-
Abstract
Research problem: This study investigates the characteristics of corporate social responsibility (CSR), which are discursive attempts at creating positive impact and indicate to readers the process of business management in society. Research questions: (1) What is the intended purpose and function of the CSR reports taken from some of the most dominant corporations in the oil, banking, and aviation industries in the US and China, and how and to what extent do these reports meet the expectations of the international discourse community? (2) Are there any differences in the discursive construction of the CSR reports taken from the different industries? If so, what are these differences, and why might they exist? Literature review: Contrasting CSR practices in China and the US are appropriate because of their economic power, and rigorous CSR reporting practices. According to previous research, CSR practices in China are mandatory for state-owned enterprises, but voluntary in the US. Interdiscursivity, the appropriation of established generic resources across genres and practices to create new forms, provides a framework for exploring differences in reports between the countries. Critical discourse analysis (analyzing discourse as social practice) and genre analysis (analyzing discourse as genre), provide methods for exploring these differences. Methodology: Using discourse analysis, this study analyzed six samples of CSRs, three from Chinese corporations, three from American corporations. Samples were selected through rigorous online search for top companies in oil, aviation, and banking. The study involved a general content analysis of the overall CSR reports using genre and critical discourse analysis, and then more focused analysis of sections on the environment. Results and discussion: The main function of the CSR reports analyzed seems to be the promotion of the company image. Although all analyzed reports drew on the discourse of goodwill and promoted company engagement with society, CSR reports from the oil industry employed discourse of self-justification more, attributing company actions to external constraints. CSR, as a generic construct in its hybrid form, seems a “typification” of three interdiscourses-discourses of promotion, goodwill, and self-justification-sociopragmatically co-constructed within an interdiscursive space. The purity of this genre lies in its hybridization, primarily in the integration of promotional cues in reporting genre, illustrating how interdiscursivity can explore the interrelationship between discursive and professional practices. The limitation of the study was the limited choice of countries and sample size. Future research could compare reporting practices of companies with newly instituted CSR practices with companies in countries with a longer history of CSR reporting.
-
Abstract
Advertisement: The IEEE Member Digital Library brings you access to IEEE journals, magazines and conference papers published today or in the last five years. Full-text access to the most essential information in technology today with one convenient subscription. Subscribe: www.ieee.org/ieeemdl.
-
Scientific Writing and Communication Papers, Proposals, and Presentations (Hofmann, A. H.; 2010) [Book Review] ↗
Abstract
This book is written as a text for a scientific research writing course but could also be used as a reference book to support a research methods course or be a useful companion for a student in the thesis stage of his or her program. In addition, this book would remain as a useful reference for researchers through their careers. The most appropriate place to locate this book as a text for students pursuing a program involving a research project would depend on the division of subject areas into courses in the particular program.
-
Abstract
Research questions: How can our current knowledge of experiential learning be applied to cross-cultural web-based training? How do postproject interviews with the participants advance our knowledge about experiential learning? What practical recommendations for teachers and trainers can be offered based on this and similar case studies? Situating the case: Literature on virtual teams stipulates the importance of teaching leadership development within teams, including methods of conflict resolution, and flexibility in methods and tools of communication. Literature on experiential learning places a high value on learner experience, and on indirect and combined methods of assessing experiential learning projects. Methodology: The case was studied through the analysis of data obtained from unstructured class interviews with three of the US-based participants of the teaching project. Interview participants were chosen to ensure a variety of responses about their experiences while taking part in the project. About the case: The project was a part of an introductory graduate-level seminar in technical and scientific communication. Graduate students in technical communication from the US and graduate students in marketing from Ukraine participated in the project. The participants worked in virtual teams to create collaborative analyses of localized versions of websites of transnational corporations. The findings of this research are as follows. (1) Virtual teams work more effectively when given time to build trust and connections among participants. (2) Virtual teams work more effectively when time is devoted to the development of leaders and the articulation of leadership responsibilities within teams. (3) Experiential learning team participants use a variety of communication tools depending on the nature of the communicative task at hand. (4) As part of the learning process, virtual team members recognized and attempted to adjust to cultural and professional discourse differences between countries and professional fields.
-
Abstract
Donna Spencer's "A Practical Guide to Information Architecture" introduces the reader to Information Architecture (IA) and describes how to learn about your users, content, designing an IA, and effective navigation techniques. This book has a very easy-to-follow narrative where different IA professionals share their practical experiences. The book, while providing legible diagrams to explain IA concepts, also includes a few interesting questions from the author’s projects and workshops and a useful list of reading resources. The book is divided into five sections and each section has five chapters. The book is written in such a way that a novice reader can read the chapters sequentially or an expert can choose to read a section or chapter of interest. The book is a perfect example of effective IA.
-
Differential Effects of the Volume and Diversity of Communication Network Ties on Knowledge Workers' Performance ↗
Abstract
Research problem: For knowledge workers, such as IT professionals, the ties within their social network are a major channel for communicating the requisite knowledge and information. While prior studies tended to favor higher network centrality (i.e., larger volume of network ties), in this study, the researchers argue that centrality can reduce communication efficiency if the diversity of the ties is low. Research question: Which characteristic of communication ties, volume or diversity, has more influence on knowledge workers' performance? Literature review: Using social network analysis (SNA) as the theoretical framework, a review of the literature shows that social network ties have important performance implications because they can enhance an individual's access to valued resources. Studies have also examined the performance impact of “hindrance network centrality,” or how frequently a person is described by other network members as a hindrance to their performance. However, current research has overlooked the possible negative communication consequences of centrality in regards to redundant information, which may negatively affect job performance. Methodology: The current study employs a quantitative approach, using the standard SNA method of a “name generator” questionnaire to collect network data. Participants were 98 people in the IT department at a large defense company. We identified 3905 relationships and analyzed them with the UCINET software. Subsequently, social network variables, as well as performance and human capital variables were analyzed in logistic regressions. Results and discussion: Results showed a significant relationship between constraint, a measure of tie diversity, and performance. Centrality, the measure of tie volume, however, was not significantly related to performance. Our findings about the volume versus diversity of communication ties have important implications for professional communicators in the age of fast-growing social network media. A limitation of our study is that we approximated communication ties with social network links. We suggest that future studies further validate our findings by using a more direct measure of communication ties.
-
Abstract
This study examines the nature, manifestations and causes of communication problems in international outsourcing engagements. Specifically, it explores a case of business process outsourcing (BPO), which is the transfer of a number of business processes, such as payroll, supply chain management, and customer relations to an external supplier. In this case, a company based in the US outsourced its business processes to a company in India. (1) If widespread proficiency in English is the reason for India's predominant position in outsourcing, then why do we hear about communication problems? (2) What are the causes of such problems? (3) In what forms and situations do they manifest? (4) How could technical communication offer solutions to ameliorate or minimize some of these communication problems? Similar cases studied include previous studies of call centers in the Philippines and outsourcing relationships in software companies have identified challenges in those relationships to problems of intercultural communications, such as language use and differences in culture. Three areas of inquiry informed this study. Intercultural communication theories provide frameworks and touch points for assessing the role of culture in communication. Previous studies of outsourcing and offshoring provided definitions of the broad range of arrangements that comprise outsourcing. Although these studies all concluded that communication is a crucial factor in the success of outsourced projects, they offered few details of communication problems, their causes, manifestations, and possible solutions. Accounts of India represent India as a rapidly-growing, dynamic economy with certain typical communication problems. The study was designed as a mixed-methods, single-case study with a mix of quantitative and qualitative methods. Quantitative data were gathered through surveys that helped develop a picture of patterns in areas such as communication problems, preferred methods of communication, and patterns of escalation while qualitative data from 45 personal interviews and one group interview provided insights into the nature and resolution of communication dissonances. The case studied ABC Corporation, a captive Indian company that performed BPO for a major American corporation. Communication problems that arise in the outsourcing relationship include differences in corporate culture and differences in linguistic and rhetorical choices. Issues causing these problems include differences in education and training. Ongoing training in cross-cultural communication is needed at all stages of the outsourcing cycle, with an emphasis on communication skills in the early stages of the process, especially the hiring stage. Technical communication can offer solutions to these problems because our field can help structure suitable training applying theories such as Cross' Theory of centripetal and centrifugal forces, which provide frameworks for assessing and addressing communication problems.
-
Combining Concurrent Think-Aloud Protocols and Eye-Tracking Observations: An Analysis of Verbalizations and Silences ↗
Abstract
Research problem: Concurrent think-aloud (CTA) protocols are one of the dominant approaches of usability testing. However, there is still debate about the validity of the method, partly focusing on the usefulness and exhaustiveness of participants' verbalizations. The rise of eye-tracking technology sheds new light on this discussion, as participants' working processes can now be observed in more detail. Research questions: (1) What kinds of verbalizations do participants produce, and how do they relate to the information that can be directly observed using eye tracking? (2) What do eye movements reveal about cognitive processes at times when participants stop verbalizing? Literature review: Our study replicates an earlier study by Cooke (2010), who used a combination of CTA protocols and eye tracking in a small sample with experienced and highly educated participants to investigate the validity of CTA. Cooke's results suggest that the additional value of participants' verbalizations is limited: at least 77% of the verbalizations referred to things that could be easily observed with eye tracking. Methodology: We conducted a study in which 60 participants with different characteristics performed tasks on informational websites. During their task performance, they verbalized their thoughts, and simultaneously their eye movements were measured. The resulting think-aloud protocols were divided in verbalization units, which were coded into content types. Silences were registered, and eye movements during these silences were analyzed. Results and discussion: We found a different distribution of verbalization types than Cooke (2010) reported, with far more verbalizations where participants formulated doubts, judgments on the website, or expressions of frustration. In our study, verbalizations provided a substantial contribution in addition to the directly observable user problems. We measured a rather high percentage of silences (27%), during which participants most often were scanning pages for information. During these silences, interesting observations could be made about users' processes and obstacles on the website. The implication of our study is that we now have a better understanding of the types of verbalizations that a CTA evaluation might generate. Further, we know that relevant usability observations can be made during silences. A limitation is that we do not know yet the influence of specific characteristics of the evaluation setting on the types of verbalizations and silences. Future research should focus on the influence of evaluation settings on the outcomes of an evaluation, in particular, the influence of characteristics of the participants who are involved in the study.
June 2012
-
Introduction to the special section: Navigating the boundaries in global training and education: new literacies, competencies, and practices ↗
Abstract
The two tutorials and one research article in this special section focus on navigating the boundaries in global training and education. Two additional papers on this topic will appear in the next issue (September 2012).
-
Different Approaches to Similar Challenges: An Analysis of the Occupational Cultures of the Disciplines of Technical Communication and Training Tutorial ↗
Abstract
Problem: Perhaps it is presumptuous of technical communicators to assume that, because some of their skills that might be employed in developing and delivering training materials, that those skills alone are qualifications to work in training, much less the source by which the processes of Training might be examined. Using data from one survey and one interview-based study of the work of Technical communication and Training groups, as well as participation on committees responsible for certification examinations for technical communicators and trainers, this tutorial analyzes differences in the occupational cultures of the two fields. Key concepts: The work differs: technical communicators produce content that explains how to perform tasks; trainers produce programs that develop skills that a third party can verify. To do so, technical communicators follow a process that emphasizes writing and production; trainers follow a process that emphasizes the analysis of intended goals and evaluation of whether those goals have been achieved. The guiding philosophy of Technical communication is usability; the guiding philosophy of Training is performance. Although both disciplines are rooted in cognitive psychology, the primary intellectual roots of Technical communication are in rhetoric and composition, while the primary intellectual roots are in education. The preferred research methods of Technical communication are critical; the preferred research methods of trainers are empirical qualitative and quantitative methods. Key lessons: As a result, Technical communication professionals and researchers who want to work in training should approach the field in a culturally appropriate way by (1) recognizing distinctions between a communication product and a training program, (2) recognizing distinctions in work processes, (3) recognizing distinctions in language, (4) recognizing differences in values, and (5) acknowledging that an academic discipline of training exists.
-
Style Congruency and Persuasion: A Cross-cultural Study Into the Influence of Differences in Style Dimensions on the Persuasiveness of Business Newsletters in Great Britain and the Netherlands ↗
Abstract
Research problem: The purpose of the present study was to investigate whether style congruency on the dimensions succinct-elaborate and instrumental-affective influenced the persuasiveness of business newsletters in the Netherlands and Great Britain. Research question: Is a writing style more persuasive in a country with cultural preferences that are congruent with this writing style? Literature review: The purpose of the literature review was to present two theoretical frameworks for investigating cross-cultural differences in style preferences. Theories about cross-cultural differences in value orientations show that value orientations can be linked to cross-cultural differences in persuasion. Theories about cross-cultural differences in communication styles show that preferences for particular communication styles can be linked to cultural value orientations. Methodology: Two quantitative experimental studies were conducted among 344 business-to-business customers of a company in the Netherlands and Great Britain. Using seven-point scales, participants evaluated different versions of a newsletter on comprehensibility, attractiveness, and intention to order goods. Statistical analyses included general linear model (GLM) repeated measures and two-way ANOVAs. Results and discussion: Findings reveal limited differences between the Dutch and British participants in preferences for communication styles. Consequently, it may not be worthwhile for organizations to adjust the style of their documents to preferences in different cultures. A limitation of the current study was that it only investigated style preferences for one particular business genre (i.e., newsletters). Future research should investigate stylistic preferences in other business genres and in other cultures.
-
Incorporating user appropriation, media richness, and collaborative knowledge sharing into blended e-learning training tutorial ↗
Abstract
Problem: E-learning has become a standard in many organizations to train its workforce and build an information network that encourages collaborative knowledge sharing. As a result of technological and global factors, the complexity of delivering successful e-learning courses and products is an increasing challenge for subject matter experts and instructional designers. Online training courses have become blended learning environments, comprised of synchronous and asynchronous modes of delivery, multiple media forms, and global and localized audiences to meet the demands and flexibility it affords. Successful blended e-learning is more than simply mixing online and live instructional modes; it can also include a combination of multiple media types, technologies, and communication modes. E-learners have become multimodal learners, with the ability to adapt to multiple media forms, environment types, and tools. Key concepts: Understanding the complex interaction of technology use, collaborative knowledge sharing, and media can facilitate more effective communication exchanges between instructor, content, and learner. Some concepts that help describe the complexities of blended e-learning include technological appropriation, technological accommodation, media richness, media synchronicity and naturalness, blended e-learning, and collaborative knowledge sharing. Key lessons: Research trends suggest learners appropriate technology and media forms, and evaluate usefulness based on a range of factors, including richness, experience, perception, and recommendation. Blended learning environments add complexity by mixing spatial (distributed and colocated) and temporal (asynchronous and synchronous) components with increased levels of collaborative knowledge sharing. From these research trends, the following best practices for developing e-learning are recommended: (1) consider media richness factors and user preferences in media and tool selection; (2) encourage personalization to foster trust; (3) facilitate collaborative knowledge sharing both inside and outside the training setting; (4) balance roles as knowledge facilitator, coach, and information manager; and (5) invest additional time in both course and instructor preparation. Implications: Blended e-learning presents a number of challenges for subject matter experts and designers of instructional content. Subject matter experts must consult with instructional designers and consider the different media platforms, environments, and formats that optimize the best pairing of content with delivery mode and media type. Content experts and designers must collaborate on methods of effectively adapting course content to account for perceived richness, user experience, and task complexity. Instructors must also invest additional time in planning and accounting for user preferences and communication practices in online training.
-
Abstract
Research problem: The purpose of this study is to examine US engineering students' intercultural competence and its pedagogical implications. Three research questions are addressed: (1) What are engineering students' levels of awareness and sensitivity toward intercultural communication? (2) What are their perceived needs in learning intercultural communication? (3) Given these findings, what are some useful approaches and methods to teach intercultural communication in the engineering communication service class? Literature review: The literature review examines current studies on US engineering students' intercultural competence and establishes the scope of the study: intercultural awareness and sensitivity. The researcher consulted literature in intercultural studies, international education, and engineering education. Methodology: The researcher conducted a mixed method study, using surveys, textual analysis, and interviews. Two-hundred seventy-two engineering undergraduates at a Midwestern public university participated in the study. Participants were recruited from an engineering communication class. Data were collected through survey instruments, written responses to cross-cultural dialogs and critical incidents, and interviews. Both qualitative and quantitative analyses were performed. Results and discussion: Participants exhibited vague and passive awareness of intercultural communication, average to high intercultural sensitivity (subject to self-assessment and social desirability bias), and partial acceptance of intercultural communication education. Based on these findings, the researcher suggests a cultural-general approach to teaching intercultural competence in engineering communication service classes. The study is limited to research participants at one institution and two aspects of intercultural competence. Future studies can involve diverse research participants, address more aspects of intercultural competence, and examine the use of cultural-general teaching methods in the classroom.
-
Abstract
Research problem: The purpose of the study was to explore how a boundary spanner can successfully facilitate knowledge sharing across functional and geographical boundaries. The main research questions are: (1) Does matching the complexity of knowledge boundary with the knowledge-sharing process lead to successful knowledge sharing? and (2) What are the key factors that influence a boundary spanner when deciding how to facilitate the knowledge sharing across functional and location boundaries? Literature review: The purpose of the literature review was to better understand the existing knowledge-sharing frameworks. Finding no framework that can directly address the research problem, the researchers decided to build on the closest one which is a framework for knowledge sharing across functional boundaries. By not taking into consideration knowledge sharing across location boundaries, the framework assumes collocated and synchronous knowledge-sharing interaction. To understand the potential supporting media for knowledge-sharing interaction across functional and geographical boundaries, the researchers consulted the Media Naturalness Theory. Media naturalness is the ability of the media to support a sense of collocated and synchronous interaction. Methodology: The researchers conducted a qualitative exploratory case study in the IT department of a Fortune 500 multinational finance company. Researchers selected a boundary spanner and observed her facilitation of knowledge-sharing interactions for four months. A total of 78 knowledge-sharing interaction logs were collected during the period of observation from five data sources: wiki, email, instant messaging, teleconference, and face-to-face interactions. Data analysis was carried out through template coding. Results and discussion: The researchers found that matching the knowledge boundary with the knowledge-sharing process is an essential yet insufficient condition for successful knowledge sharing. A boundary spanner should also pay attention to the boundary objects and media used to support the knowledge-sharing interaction. Spatial dispersion and knowledge commonality between the source/recipient and boundary spanner affected the media selection which, in turn, influenced the selection of the boundary objects. The implication of the study is that there are three important factors that the boundary spanner should consider when deciding how to facilitate knowledge sharing (i.e., knowledge boundary, spatial dispersion, and knowledge commonality). The main limitations of the study were the relatively short observation period of the knowledge-sharing interactions via a boundary spanner. Future research should quantitatively validate the proposed optimal knowledge-sharing designs to test the generalizability of the findings with a survey and profile deviation analysis.
-
Abstract
Research problem: When dealing with procedural documents, individuals sometimes encounter comprehension problems due to poor information design. Researchers studying the use and understanding of procedural documents, as well as technical writers charged with the design of these documents, or usability specialists evaluating their quality, would all benefit from tools allowing them to collect real-time data concerning user behavior in user-centered studies. With this in mind, the generic software Technical Instructions Processing-Evaluations and eXperiments Editor (TIP-EXE) was designed to facilitate the carrying out of such studies. Research questions: Does document design, and specifically the matching or mismatching of the terms employed in a user manual and on the corresponding device, affect the cognitive processes involved in the comprehension of procedural instructions? Can we use a software tool like TIP-EXE to assess the impact of document design on the use and understanding of a procedural document? Literature review: A review of the methods employed to study either the use of procedural documents or their cognitive processing, and to evaluate the quality of these documents, revealed the lack of tools for collecting relevant data. Methodology: TIP-EXE software was used to set up and run a laboratory experiment designed to collect data concerning the effect of document design on the performance of a task. The experiment was conducted with 36 participants carrying out tasks involving the programming of a digital timer under one of three conditions: “matching instructions,” “mismatching instructions,” “mismatching instructions + picture”. Based on a click-and-read method for blurred text, TIP-EXE was used to collect data on the time the users spent reading the instructions, as well as the time spent handling the timer. Results and discussion: Results show that “matching instructions” (when the terms employed in the user manual match the terms on the device) enhance user performance. This instructional format results in less time spent consulting the instructions and handling the device, as well as fewer errors. This research shows that TIP-EXE software can be used to study the way in which operating instructions are read, and the time spent consulting specific information contained therein, thereby revealing the effects of document design on user behavior.
March 2012
-
Designing Visual Language: Strategies for Professional Communicators, Second Edition (Kostelnick, C. and Roberts, D. D.; 2011) [Book Review] ↗
Abstract
This second edition may help readers develop a basic understanding of part of the design decision-making process, and the physical aspects of designing print documents. But the book is unlikely to support professionals or students who engage electronic documents, or user-centered design and the user experience (UX), in depth.
-
Writing in the Sciences: Exploring Conventions of Scientific Discourse (Part of the Allyn & Bacon Series in Technical Communication), 3/E (Penrose, A. M. and Katz, S. B.; 2010) [Book Review] ↗
Abstract
This book is a thorough examination of best practices for communicating science-related ideas to a carefully targeted audience. Such integration of theory with practical applications makes this book an immensely useful resource for any science writer.
-
An Examination of Deception in Virtual Teams: Effects of Deception on Task Performance, Mutuality, and Trust ↗
Abstract
Research Problem: This study investigates the impact of deception on the performance of tasks in virtual teams. While the advantages of virtual teams in organizations have been well-studied, as the use of these teams expands, organizations must acknowledge the potential for negative consequences of team member actions. Research Questions: (1) How does deceptive communication influence the outcomes of virtual group collaboration? and (2) How does perceived deception impact the individual perceptions, such as perceived trustworthiness and mutuality, of the virtual team itself? Literature Review: Based on (1), the conclusion from the literature on virtual teams that trust and mutuality are vital toward team development, (2) the propositions put forth by Interpersonal Deception Theory that deception will be perceived by team members, and (3) from the conclusion from the literature on interpersonal deception and trust that deception will impact outcomes of an interaction, including trust, mutuality, and ultimately team performance, we developed a model of the impact of deception on outcomes in virtual teams. This model suggests that deceptive communication negatively impacts task performance. Deceptive communication is also expected to impact perceived deception both within and between groups. The model further proposes that perceived deception will negatively impact both perceived trustworthiness and mutuality. Methodology: Through an experiment, virtual teams of three members participated in a group decision-making task in which team members must cooperate to search a grid for enemy camps and then collaborate on a strike plan, with half the teams populated by a deceptive team member. Two-hundred seventeen subjects were recruited from courses at three universities. Five experimental sessions were conducted across two semesters in computer labs at the three universities. Following the virtual team experiment, subjects completed surveys related to key constructs. Analysis of variance and linear regression were used to test the hypotheses. Results and Discussion: Deception has a negative impact on task performance by virtual teams. Participants perceived deception when it was present. Perceived deception led to decreased mutuality and trust among team members. These findings suggest that organizations that utilize virtual teams must be aware of and prepared to deal with negative behaviors, such as deception. The generalizability of these findings is potentially limited by the use of student subjects in a laboratory setting. Future research may extend these findings by incorporating additional variables that have been found to be important to virtual team outcomes or studying the current model in a longitudinal design.
-
Assessing the Impact of Student Peer Review in Writing Instruction by Using the Normalized Compression Distance ↗
Abstract
Research Problem: Studies identify peer review as an effective instructional method to improve student writing. Some teachers, however, avoid peer review, perhaps due to the workload required for assessing and correcting peer reviews. Previous studies have not proposed any method to reduce teacher workload by using an objective means to analyze the effects of peer review. Research Questions: This study assesses the degree of similarity between student essay drafts using normalized compression distance (NCD), a compression-based classification algorithm. How does peer review affect student essays, as measured by the NCD? What were the changes in essay length and holistic scores? How did students respond to peer essays? How did peer review affect students during revision? What were the NCD results? How did holistic scoring correspond to NCD results? Literature Review: Studies of pharmacists and engineers indicate that English language technical communication skills are important. Studies of peer review in language education indicate that peer comments are valuable but cultural differences and lack of confidence may impede making or using comments. Studies of NCD applied to web data, figures, and images indicate useful results. Methodology: This quantitative study used anonymous peer review and compared the results of traditional holistic scoring against a novel NCD measure. The researchers conducted the study with 35 student volunteers at a pharmaceutical university in Tokyo, Japan. The students had at least nine years of previous English instruction and previous peer-review experience. In class, students wrote an essay, anonymously reviewed a peer's essay according to instructions, then revised their own essays based on peer comments. An assessor graded the two drafts using a holistic scoring rubric. The researchers used NCD to quantify the change between drafts. Results and Discussion: Sixty percent of revisions contained more words than the originals. 51% percent of revisions received higher scores, 40% had no change, and 8.5% percent had reduced scores. Eleven percent of reviewers with low English proficiency did not identify obvious errors. Three revised essays had lower grades because the writers did not know how to incorporate peer comments. Anonymous peer review could lead to poor results where students had poor reviewing skills or did not know how to use peer comments. NCD helps teachers identify which revised essays to re-evaluate after peer review by indicating those with large quantities of changes. The study was limited by its small group of participants. Future research will examine longer essays, more participants, varied backgrounds, web delivery of NCD, and finding more factors to indicate the quality of written work to reduce teacher workload.
-
Abstract
Research problem: This study examines functions in a multifunctional device, the smartphone. Specifically, it explores (1) to what extent does the theory of planned behavior capture user evaluation of different functions? (2) to what extent does pleasure have positive effects on intentions of different functions? (3) to what extent could the implementation intention theory identify the important functions? Literature review: To answer these questions, we look at the Theory of Planned Behavior which has been used to examine a single function device and test the predictability of the theory for a multifunctional system. We also review the Implementation Intention Theory and test the predictability of the theory for identifying important functions. Methodology: A quantitative survey of more than 200 smartphone owners in information-technology shopping malls and customer service centers for major smartphone brands was conducted. Results: The results from the data collected show that the theory of planned behavior and the additional pleasure construct explain more than 50% of the variance in intentions. The effect of pleasure on intention varies from one function to another. In general, pleasure shows much stronger effects for high-hedonic functions than for low-hedonic functions. In addition, the Implementation Intention Theory reveals that phone and organizer are the most important functions. Implications: These results contribute to research on multifunctional systems and communication technology, the Theory of Planned Behavior, the Implementation Intention Theory, and to the practitioners. However, the results of this study may be somewhat limited to users in a modern city. Future research could extend this study to include a task dimension, to compare different technologies and their functions, and to look at modality preferences.
-
Abstract
This book provides key insights into the user-centered design (UCD) process, in general, with a specific emphasis on personalization in particular. Anyone interested in the process of UCD and personalization will likely benefit from some of the information available in this book and gain valuable insight in a review of its highlighted studies.
-
Too Early, Too Bad: Uncovering and Understanding the Initial Participation Paradox in Technology-Mediated Learning Teams ↗
Abstract
Research Problem: Time is of the essence in technology-mediated teams. However, research has been inconclusive about the impact of team participation on outcomes. A possible reason can be found in the temporal dimension; particularly, we refer to the time points examined in relation to the entirety of the period. Indeed, we can find research attention on initial participation (IP) in fields such as social psychology. IP refers to the contributions of team members during the earlier half of the team's lifespan. Comparable efforts are in want in information systems contexts where the relevancy and saliency of IP is no less. Research Questions: Does IP affect outcomes of technology-mediated teams? Do team size and task type affect IP in technology-mediated teams? Literature Review: Based on a review of literature that includes group development, information overload, and integrative complexity, we discover an IP paradox. More intense IP, in terms of amount and equality, could decrease outcomes, namely, task performance, team learning, and outcome satisfaction. Moreover, two cornerstone boundary conditions of teamwork, team size and task type, could affect IP. Methodology: A quantitative field experiment with 49 technology-mediated learning teams that involved 245 participants was conducted. These teams used a wiki to complete a task in a course in higher education. Data were collected from a pretest survey, posttest survey, and electronic records of the wiki (editcount and wordcount). Qualitative data from participants were also sought for the sake of triangulation. The data were analyzed using partial least squares. Results and Discussion: The results show that higher IP amount and equality decreased task performance and outcome satisfaction as predicted. However, higher IP amount did not significantly affect team learning although this was significant in the hypothesized direction for IP equality. As for team size, larger team sizes increased IP amount but lowered IP equality. Task type did not affect IP amount and contrary to our prediction, multiple solution tasks instead of single solution tasks decreased IP equality. Nevertheless, the findings support the notion that higher IP leads to detrimental outcomes. This suggests the importance of coordination mechanisms in the initial period especially in time-limited teams. For instance, knowledge leaders and facilitators can step up to organize and reduce information overload during the initial period to ensure an easier time synthesizing in the later period and better task performance. The current work was limited in terms of using only objective data for participation amount and equality. Future research could involve a combination of perceptual and objective data as well as other types of participation constructs, such as task related, norms and rules, and socioemotional acts for a richer insight into the IP paradox.
-
Abstract
Research problem: The study explored think-aloud methods usage within usability testing by examining the following questions: How, and why is the think-aloud method used? What is the gap between theory and practice? Where does this gap occur? Literature review: The review informed the survey design. Usability research based on field studies and empirical tests indicates that variations in think-aloud procedures may reduce test reliability. The guidance offered on think-aloud procedures within a number of handbooks on usability testing is also mixed. This indicates potential variability in practice, but how much and for what reasons is unknown. Methodology: An exploratory, qualitative survey was conducted using a web-based questionnaire (during November-December 2010). Usability evaluators were sought via emails (sent to personal contacts, usability companies, conference attendees, and special interest groups) to be cascaded to the international community. As a result we received 207 full responses. Descriptive statistics and thematic coding were used to analyze the data sets. Results: Respondents found the concurrent technique particularly suited usability testing as it was fast, easy for users to relate to, and requires limited resources. Divergent practice was reported in terms of think-aloud instructions, practice, interventions, and the use of demonstrations. A range of interventions was used to better understand participant actions and verbalizations, however, respondents were aware of potential threats to test reliability, and took steps to reduce this impact. Implications: The reliability considerations underpinning the classic think-aloud approach are pragmatically balanced against the need to capture useful data in the time available. A limitation of the study is the focus on the concurrent method; other methods were explored but the differences in application were not considered. Future work is needed to explore the impact of divergent use of think-aloud instructions, practice tasks, and the use of demonstrations on test reliability.
January 2012
-
Abstract
This study examines the impact of a new communication tool, the social media release (SMR), on bloggers. Specifically, we seek to determine what factors will influence bloggers' intent to use SMRs or their components. Our global survey of 332 bloggers finds that bloggers' perceptions of the effectiveness of the SMR and the use of SMRs by companies positively affect their decisions to use SMRs now and in the future. We also find that bloggers' current use of SMRs influences their decisions to continue using SMRs. Implications on the use of SMRs as corporate communication tools are discussed.
December 2011
-
Abstract
Research Problem: There are no prior studies comparing modes of communication for virtual teams working over a substantial period of time that combined an initial synchronous desktop audio or video meeting with subsequent text-based computer-mediated communication (CMC). Research Questions: Does the initial medium condition impact decision-making quality, creativity, group development, and process satisfaction? Literature Review: Previous literature on media richness (the ability of a medium to carry and reproduce information based on feedback, multiple cues, language variety, and personal focus) and group outcomes (the level of creativity and quality of the work delivered by the group) suggests that ad-hoc groups using asynchronous CMC alone (without any initial meeting) or asynchronous CMC combined with an initial face-to-face (FTF) meeting have significantly higher levels of creativity and decision quality, compared to single-mode synchronous CMC groups or FTF groups. Methodology: In this study, a laboratory experiment was conducted with 136 participants from 14 countries. All teams used asynchronous CMC for two weeks for a software requirements task, following an initial synchronous meeting in one of four conditions: FTF, desktop audioconferencing, desktop videoconferencing, or text only. Results and Discussion: Results suggest that there are no significant differences among the four conditions. This research indicates that it does not matter what medium is used for an initial short meeting of a group that is to subsequently work together via asynchronous text communication.
-
Abstract
Problem: Questionnaires are a popular method used by global companies to gain understanding or assess various aspects of their businesses. However, using a questionnaire across cultures requires extra effort in translating it into the target language(s) and culture(s) because a good questionnaire developed in one language/culture may not necessarily “travel well” across cultures due to differences in meaning and interpretation. This tutorial synthesizes the extant research on cross-cultural communication and surveys, and provides guidance in preparing cross-cultural questionnaires. Concepts: Translation affects the design and development of questionnaires to be used across cultures in these ways: (1) It affects the theoretical concepts to be studied: indicators-questions about concrete elements that can be measured and constructs-a series of questions about abstract elements that cannot be measured directly and essentially represent an underlying concept. Constructs must be adapted into a specific cultural context to achieve accuracy in measurements. (2) Differences in the contexts-the overall cross-cultural research context (the setting and the purpose) and the cultural context (the participants and their cultural background) of the study-affect translation because concepts in the source culture might be applied differently or not exist in the target cultures. (3) Translation might unintentionally introduce bias by inadvertently changing the perceived meanings of terms and questions-creating bias in constructs, on individual items on the questionnaire, and in its administration. (4) Translation might affect equivalence of terms in the source and translated versions, including linguistic equivalence (that is, wording of items), semantics (meaning of a phrase or concept), and grammar and syntax. Suggestions: Given these concepts, consider the following items when translating questionnaires: (1) accurately adapt or adopt questions from existing instruments, (2) make sure that you adapt the language to suit the situation, (3) hire translators who understand research processes, (4) use the decentering approach (a process in which translators move back and forth amongst the languages, checking for cultural and linguistic accuracy) when preparing the actual translation, and (5) assess your overall translated questionnaire. The questionnaire assessment model is a resource for guiding the assessment.