IEEE Transactions on Professional Communication Dec 2018

Hand Collecting and Coding Versus Data-Driven Methods in Technical and Professional Communication Research

Claire Lauer Arizona State University ; Eva Brumberger ; Aaron Beveridge University of North Carolina at Greensboro

Abstract

Background: Qualitative technical communication research often produces datasets that are too large to manage effectively with hand-coded approaches. Text-mining methods, used carefully, may uncover patterns and provide results for larger datasets that are more easily reproduced and scaled. Research questions: 1. To what degree can hand collection results be replicated by automated data collection? 2. To what degree can hand-coded results be replicated by machine coding? 3. What are the affordances and limitations of each method? Literature review:We introduce the stages of data collection and analysis that researchers typically discuss in the literature, and show how researchers in technical communication and other fields have discussed the affordances and limitations of hand collection and coding versus automated methods throughout each stage. Research methodology: We utilize an existing dataset that was hand-collected and hand-coded. We discuss the collection and coding processes, and demonstrate how they might be replicated with web scraping and machine coding. Results/discussion: We found that web scraping demonstrated an obvious advantage of automated data collection: speed. Machine coding was able to provide comparable outputs to hand coding for certain types of data; for more nuanced and verbally complex data, machine coding was less useful and less reliable. Conclusions: Our findings highlight the importance of considering the context of a particular project when weighing the affordances and limitations of hand collecting and coding over automated approaches. Ultimately, a mixed-methods approach that relies on a combination of hand coding and automated coding should prove to be the most productive for current and future kinds of technical communication work, in which close attention to the nuances of language is critical, but in which processing large amounts of data would yield significant benefits as well.

Journal
IEEE Transactions on Professional Communication
Published
2018-12-01
DOI
10.1109/tpc.2018.2870632
CompPile
Open Access
Closed
Topics
technical communication professional writing empirical research
Export
BibTeX RIS

Citation Context

Cited by in this index (12)

  1. Getto et al. (2025)
    UX Research, Management, and Design: What a Textual Analysis of UX Job Ads Mean…
    IEEE Transactions on Professional Communication
  2. Spinuzzi et al. (2025)
    “The City Residents Do Not Get Involved”: Understanding Barriers to Community P…
    IEEE Transactions on Professional Communication
  3. Gupta et al. (2024)
    “Wayfinding” through the AI wilderness: Mapping rhetorics of ChatGPT prompt wri…
    Computers and Composition
  4. Liddle (2024)
    Commemoration and Context: The Death Counter Graphics of COVID-19
    Communication Design Quarterly
  5. Deets et al. (2024)
    Content Analysis, Construct Validity, and Artificial Intelligence: Implications…
    Journal of Business and Technical Communication
Show all 12 →
  1. Walwema et al. (2024)
    The Rhetorical Function of Corporate DEI Reports
    Business and Professional Communication Quarterly
  2. Majdik et al. (2023)
    Building Better Machine Learning Models for Rhetorical Analyses: The Use of Rhe…
    Technical Communication Quarterly
  3. Gallagher et al. (2022)
    Project-Oriented Web Scraping in Technical Communication Research
    Journal of Business and Technical Communication
  4. Phelps (2021)
    The Transformative Paradigm: Equipping Technical Communication Researchers for …
    Technical Communication Quarterly
  5. Omizo (2020)
    Machining Topoi: Tracking Premising in Online Discussion Forums with Automated …
    Computers and Composition
  6. Phelps (2020)
    Modernization Updates to the Common Rule: Recommendations for Researchers Worki…
    IEEE Transactions on Professional Communication
  7. Robles (2019)
    Caveat Emptor: How Lay Technical and Professional Communicators Sell Technical …
    IEEE Transactions on Professional Communication

References (29) · 6 in this index

  1. 10.4135/9781848607941.n13
     ↗
  2. 10.4054/DemRes.2017.37.42
     ↗
  3. Koerber et al. (2008)
    Qualitative Sampling Methods: A Primer for Technical Communicators
    Journal of Business and Technical Communication
  4. 10.1080/13645579.2011.625764
     ↗
  5. rinker (2017)
    textstem: Tools for Stemming and Lemmatizing Text Version 0.1.3
Show all 29 →
  1. van horn (2016)
    Attention ecology: Trend circulation and the virality threshold
    Digital Humanities
  2. mueller (2017)
    10.37514/WRI-B.2017.0124
    Network Sense Methods for Visualizing a Discipline  ↗
  3. Omizo et al. (2016)
    Finding genre signals in academic writing
    Journal of Writing Research
  4. blei (2012)
    Topic modeling and digital humanities
    Digital Humanities
  5. silge (2017)
    Text Mining with R A Tidy Approach
  6. grun (2011)
    topicmodels: An R package for fitting topic models
    J Stat Softw  ↗
  7. 10.2196/jmir.4612
     ↗
  8. huckin (2004)
    Content analysis: What texts talk about
    What Writing Does and How it Does it An Introduction to Analyzing Texts and Textual Practices
  9. Rude (2009)
    Mapping the Research Questions in Technical Communication
    Journal of Business and Technical Communication
  10. Frith (2017)
    Big Data, Technical Communication, and the Smart City
    Journal of Business and Technical Communication
  11. Pflugfelder (2013)
    Big data, big questions
    Communication Design Quarterly
  12. 10.1007/s13142-014-0256-1
     ↗
  13. beveridge (2015)
    Looking in the dustbin: Data janitorial work, statistical reasoning, and information rhetorics
    Comput Compos Online
  14. 10.4304/jetwi.1.1.60-76
     ↗
  15. lauer (2013)
    Technology and technical and professional communication through the lens of the MLA Job …
    Program Perspect
  16. 10.1080/0013188032000133548
     ↗
  17. brumberger (2015)
    The evolution of technical communication: An analysis of industry job postings
    Tech Commun
  18. 10.1145/2133806.2133826
     ↗
  19. McNely (2012)
    Big data, situated people: humane approaches to communication design
    Communication Design Quarterly
  20. brett (2012)
    Topic modeling: A basic introduction
    Digital Humanities
  21. henschel (2014)
    Of horsemen and layered literacies: Assessment instruments for aligning technical and pr…
    Program Perspect
  22. 10.2196/jmir.9702
     ↗
  23. rainey (2005)
    Do curricula correspond to managerial expectations? Core competencies for technical comm…
    Tech Commun
  24. lanier (2009)
    Analysis of the skills called for by technical communication employers in recruitment postings
    Tech Commun
CrossRef global citation count: 24 View in citation network → Build reading path →

Related Articles

  1. Journal of Technical Writing and Communication Jan 2024
    Implementing a Continuous Improvement Model for Assignment Evaluation at the Technical and Professional Communication Program Level ↗
    Michelle Sonnenberg; Carolyn Gubala; Justiss Burry; Jessica Griffith; Tanya Zarlengo; Lisa Melonçon
    writing pedagogy assessment writing program administration technical communication professional writing labor and working conditions empirical research
  2. IEEE Transactions on Professional Communication Dec 2023
    Longitudinal Study of Usability and User Experience in Technical and Professional Communication Research ↗
    Erin Friess; Christina Liles
    technical communication professional writing empirical research
  3. IEEE Transactions on Professional Communication Dec 2023
    Fostering Advocacy, Developing Empathetic UX Bricoleurs: Ongoing Programmatic Assessment and Responsive Curriculum Design ↗
    Scott J. Kowalewski; Bill Williamson
    writing pedagogy curriculum design service learning teacher development assessment technical communication professional writing empirical research qualitative research
  4. IEEE Transactions on Professional Communication Mar 2021
    Hybrid Model for Multidisciplinary Collaborations for Technical Communication Education in Engineering ↗
    Christopher D. M. Andrews; Mehrube Mehrubeoglu; Charles Etheridge
    writing pedagogy writing across the curriculum collaborative writing writing centers technical communication professional writing empirical research
  5. IEEE Transactions on Professional Communication Jun 2020
    A Comparison of Research Topics Associated With Technical Communication, Business Communication, and Professional Communication, 1963–2017 ↗
    Stephen Carradini
    writing pedagogy technical communication professional writing scientific writing empirical research book reviews