Computers and Composition Sep 2025 Open Access

When collaborating turns into dishonesty: A data-driven heuristic comparing human and AI collaborators

John R. Gallagher ; Kyle Wagner University of Findlay ; Jordan Canzonetta Lewis University

Abstract

With respect to AI writing technologies (AIWT), we pose three foundational questions about academic dishonesty. First, do writing instructors and students perceive differences between AI agents and human agents in classroom scenarios? Second, to what extent are writing instructor and student perceptions are aligned? Third, what types of writing scenarios are perceived as academic dishonesty? Answering these questions provides a baseline of comparison not only for future studies of AIWT collaboration but also contextualizes perceptions of human-to-human collaboration. We report on a large-scale experimental survey study that answers these questions using item response theory (IRT). Our findings demonstrate that while there are differences between AI and human agents of collaborations, writing instructors and students are generally aligned in their perceptions. Using a Rasch model, we find that academic dishonesty operates along a spectrum of textual production. Regardless of whether the collaborating agent is human or AI, the more an agent produces text, the more this collaboration is perceived as academic dishonesty. Conversely, the less text that is produced, the less this scenario is perceived as academically dishonest. In our discussion, we provide a data-driven heuristic to guide instructors and administrators.

Journal
Computers and Composition
Published
2025-09-01
DOI
10.1016/j.compcom.2025.102947
CompPile
Search in CompPile ↗
Open Access
OA PDF Hybrid
Topics
collaborative writing empirical research artificial intelligence
Export
BibTeX RIS

Citation Context

Cited by in this index (1)

  1. McKee (2026)
    Computers & composition research at the dawn of generative AI: Threats, opportu…
    Computers and Composition

References (36) · 15 in this index

  1. Abdelwahab (2023)
    Business students’ perceptions of Dutch higher educational institutions in preparing them…
    Industry and Higher Education  ↗
  2. Aguilar (2024)
    Rhetorically training students to generate with AI: Social justice applications…
    Computers and Composition
  3. Bedington et al. (2024)
    Writing with generative AI and human-machine teaming: Insights and recommendati…
    Computers and Composition
  4. Busch (2023)
    International pharmacy students’ perceptions towards artificial intelligence in medicine—…
    British Journal of Clinical Pharmacology
  5. Canzonetta (2021)
    Repurposing plagiarism detection services for responsible pedagogical applicati…
    Assessing Writing
Show all 36 →
  1. Canzonetta (2016)
    Globalizing plagiarism and writing assessment: A case study of TurnItIn
    Journal of Writing Assessment
  2. Chan (2023)
    Deconstructing student perceptions of Generative AI (GenAI) through an Expectancy Value Theory (EVT)-based instrument
  3. Cummings et al. (2024)
    Generative AI in first-year writing: An early analysis of affordances, limitati…
    Computers and Composition
  4. De Ayala, R.J. (2009). The theory and practice of item response theory. The Guilford Press. https://books.goo…
  5. Desjardins (2018)
    Handbook of educational measurement and psychometrics using r
  6. Emig (1977)
    Writing as a Mode of Learning
    College Composition and Communication
  7. Flower et al. (1981)
    A Cognitive Process Theory of Writing
    College Composition and Communication
  8. Gallagher et al. (2024)
    Comparing Student and Writing Instructor Perceptions of Academic Dishonesty Whe…
    Journal of Business and Technical Communication
  9. Graham (2023)
    Post-process but not post-writing: Large language models and a future for composition pedagogy
    Composition Studies
  10. Gruenhagen (2024)
    The rapid rise of generative AI and its implications for academic integrity: Students’ pe…
    Computers and Education: Artificial Intelligence
  11. Howard (1995)
    Plagiarisms, Authorships, and the Academic Death Penalty
    College English
  12. Howard (1999)
    Standing in the shadow of giants: plagiarists, authors, collaborators
  13. Kennedy et al. (2013)
    Introduction to the Special Issue on Western Cultures of Intellectual Property
    College English
  14. Knowles (2024)
    Machine-in-the-loop writing: Optimizing the rhetorical load
    Computers and Composition
  15. Krosnick (1999)
    Survey research
    Annual Review of Psychology  ↗
  16. Lunsford (1996)
    Representing audience: “Successful” discourse and disciplinary critique
    College Composition and Communication
  17. Mahmoud (2025)
    The reality of using artificial intelligence technology in teaching by Hail University pr…
    Journal of Ecohumanism  ↗
  18. Murray (1972)
    Teach writing as a process not product
    The Leaflet
  19. Odell (1980)
    The Process of Writing and the Process of Learning
    College Composition and Communication
  20. Ofem (2025)
    Students’ perceptions, attitudes and utilisation of ChatGPT for academic dishonesty: Mult…
    Education and Information Technologies  ↗
  21. Prior (1998)
    Writing/Disciplinarity: a sociohistoric account of literate activity in the academy
  22. Ritter (2005)
    The Economics of Authorship: Online Paper Mills, Student Writers, and First-Yea…
    College Composition and Communication
  23. Shoufan (2023)
    Exploring students’ perceptions of ChatGPT: Thematic analysis and follow-up survey
    IEEE Access  ↗
  24. Sutherland-Smith (2008)
    Plagiarism, the internet, and student learning
  25. Tindle, R., Pozzebon, K., Willis, R.L., & Moustafa, A. (2023). Academic misconduct and generative artificial …
     ↗
  26. TurnItIn (2016)
    The plagiarism spectrum: Instructor insights into the 10 types of plagiarism
  27. TurnItIn (2024). Turnitin named 2024’s EdTech breakthrough awards "overall edtech company of the year.' Www.T…
  28. Vetter et al. (2024)
    Towards a framework for local interrogation of AI ethics: A case study on text …
    Computers and Composition
  29. Vie (2013)
    A Pedagogy of Resistance Toward Plagiarism Detection Technologies
    Computers and Composition
  30. Vojak et al. (2011)
    New Spaces and Old Places: An Analysis of Writing Assessment Software
    Computers and Composition
  31. Westfall, C. (2023). Educators battle plagiarism as 89% of students admit to using OpenAI’s ChatGPT for homew…
CrossRef global citation count: 3 View in citation network → Build reading path →

Related Articles

  1. IEEE Transactions on Professional Communication Mar 2026
    Bridging the Gap: A Comparative Study of Students’ and LSPs’ Perceptions of Translation Internships ↗
    Shuang Liu
    collaborative writing assessment professional writing empirical research
  2. Journal of Writing Research Feb 2026
    Can ChatGPT do the same? ChatGPT and professional editors compared ↗
    Daniël Janssen; Henri Raven; Lisanne Van Weelden; Yohannes Den Hertog
    writing pedagogy argument collaborative writing professional writing quantitative research artificial intelligence
  3. Journal of Writing Research Feb 2026
    Prompting for scaffolding: A thematic analysis of K-12 students’ use of educational chatbots for writing support ↗
    Jon Olav Sørhaug
    writing pedagogy empirical research qualitative research artificial intelligence
  4. Journal of Writing Research Feb 2026
    Enhancing elementary students' writing habits with generative AI: A study of handwritten diary and AI companions ↗
    Chang-Yen Liao
    collaborative writing artificial intelligence
  5. College Composition and Communication Sep 2025
    From Cheating to Cheat Codes: Integrating Generative AI Ethics into Collaborative Learning ↗
    Kristi Girdharry
    modern rhetorical theory rhetorical criticism writing pedagogy argument collaborative writing writing centers artificial intelligence literacy studies