IEEE Transactions on Professional Communication Jan 2005

A framework for analyzing levels of analysis issues in studies of e-collaboration

M.J. Gallivan ; R. Benunan-Fich

Abstract

There has been a proliferation of competing explanations regarding the inconsistent results reported by the e-collaboration literature since its inception. This study advances another possible explanation by investigating the range of multilevel issues that can be encountered in research on the use of synchronous or asynchronous group support systems. We introduce concepts of levels of analysis from the management literature and then examine all empirical studies of e-collaboration from seven information systems journals for the period 1999-2003. We identified a total of 54 studies of e-collaboration in these journals, and after excluding 18 nonconforming studies - those that were primarily conceptual, qualitative, or exploratory only-we analyzed the levels of analysis issues in the remaining 36 empirical studies. Based on our analysis and classification of these studies into six different clusters according to their levels of analysis, we found that a majority of these studies contain one or more problems of levels incongruence that cast doubts on the validity of their results. It is indeed possible that these methodological problems are in part responsible for the inconsistent results reported in this literature, especially since researchers' frequent decisions to analyze data at the individual level - even when the theory was formulated at the group level and when the research setting featured individuals working in groups -may very well have artificially inflated the authors' chances of finding statistically significant results. Based on our discussion of levels of analysis concepts, we hope to provide guidance to empirical researchers who study e-ollaboration.

Journal
IEEE Transactions on Professional Communication
Published
2005-01-01
DOI
10.1109/tpc.2005.843301
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
collaborative writing empirical research online writing instruction
Export
BibTeX RIS

Citation Context

Cited by in this index (1)

  1. Koh et al. (2012)
    Too Early, Too Bad: Uncovering and Understanding the Initial Participation Para…
    IEEE Transactions on Professional Communication

Cites in this index (1)

  1. Kock (2003)
    Action research: Lessons learned from a multi-iteration study of computer-media…
    IEEE Transactions on Professional Communication
Also cites 94 works outside this index ↓
  1. 10.7312/luca94612
     ↗
  2. 10.1080/07421222.2000.11518272
     ↗
  3. 10.1145/163298.163309
     ↗
  4. 10.1093/oso/9780195068061.003.0004
     ↗
  5. 10.1287/mnsc.42.4.541
     ↗
  6. 10.1257/jep.14.4.23
     ↗
  7. 10.1145/641865.641866
     ↗
  8. 10.2307/249475
     ↗
  9. 10.1287/isre.10.2.167
     ↗
  10. 10.1287/isre.6.1.3
     ↗
  11. 10.1162/003355302753399526
     ↗
  12. 10.1287/isre.10.2.110
     ↗
  13. 10.2307/3250972
     ↗
  14. 10.1287/mnsc.34.5.583
     ↗
  15. 10.1080/07421222.2002.11045728
     ↗
  16. 10.2307/3250928
     ↗
  17. 10.2307/2392578
     ↗
  18. 10.2307/258703
     ↗
  19. 10.5465/AMR.1999.1893934
     ↗
  20. 10.2307/258559
     ↗
  21. 10.1080/07421222.2002.11045696
     ↗
  22. 10.1080/07421222.1998.11518216
     ↗
  23. 10.1080/07421222.2000.11045657
     ↗
  24. 10.1287/orsc.5.2.121
     ↗
  25. 10.2307/249668
     ↗
  26. 10.1287/isre.8.4.342
     ↗
  27. 10.1287/isre.13.1.91.93
     ↗
  28. 10.1023/A:1008765029795
     ↗
  29. 10.1037/0021-9010.86.1.3
     ↗
  30. 10.1037/0021-9010.77.2.161
     ↗
  31. 10.2307/259086
     ↗
  32. 10.1037/0021-9010.67.2.219
     ↗
  33. 10.1037//0021-9010.69.1.85
     ↗
  34. 10.1177/014920639802400202
     ↗
  35. 10.1016/S1048-9843(01)00105-9
     ↗
  36. 10.1037/0021-9010.78.2.306
     ↗
  37. 10.1177/014920630202800305
     ↗
  38. 10.2307/259082
     ↗
  39. 10.2307/4132339
     ↗
  40. 10.1287/isre.10.2.186
     ↗
  41. 10.1080/07421222.2000.11045630
     ↗
  42. 10.1287/isre.12.3.304.9708
     ↗
  43. 10.1287/isre.11.1.61.11783
     ↗
  44. 10.2307/30036518
     ↗
  45. Yoris (2001)
    Should we wait? Network externalities, compatibility, and electronic billing adoption
    J. Manage. Inform. Syst.  ↗
  46. 10.1080/07421222.2002.11045721
     ↗
  47. 10.1057/palgrave.ejis.3000375
     ↗
  48. 10.1057/palgrave.ejis.3000455
     ↗
  49. 10.1016/S0167-9236(99)00049-4
     ↗
  50. 10.1016/S0167-9236(99)00042-1
     ↗
  51. 10.1016/S0167-9236(02)00132-X
     ↗
  52. Briggs (1998/1999)
    A technology transition model derived from field investigation of GSS use
    J. Manage. Inform. Syst.  ↗
  53. Briggs (2003)
    Collaboration engineering with thinklets to pursue sustained success with group support systems
    J. Manage. Inform. Syst.  ↗
  54. 10.2307/3250948
     ↗
  55. 10.2307/3250930
     ↗
  56. Scott (2000)
    Facilitating interorganizational learning with information technology
    J. Manage. Inform. Syst.  ↗
  57. 10.1080/07421222.1998.11518218
     ↗
  58. 10.1080/07421222.2003.11045742
     ↗
  59. 10.2307/3250979
     ↗
  60. 10.1080/07421222.2003.11045768
     ↗
  61. 10.1016/S0167-9236(02)00124-0
     ↗
  62. 10.1016/S0167-9236(02)00072-6
     ↗
  63. 10.1080/07421222.2002.11045691
     ↗
  64. 10.2307/30036538
     ↗
  65. 10.2307/3250922
     ↗
  66. 10.1080/07421222.2000.11045647
     ↗
  67. 10.1016/S0167-9236(02)00009-X
     ↗
  68. 10.1080/07421222.2003.11045754
     ↗
  69. 10.1080/07421222.1999.11518238
     ↗
  70. 10.1080/07421222.2002.11045697
     ↗
  71. 10.1287/isre.11.4.386.11874
     ↗
  72. 10.1057/palgrave.ejis.3000335
     ↗
  73. 10.1046/j.1365-2575.2001.00103.x
     ↗
  74. 10.2307/249489
     ↗
  75. 10.1080/07421222.1999.11518260
     ↗
  76. 10.1016/S0167-9236(01)00143-9
     ↗
  77. 10.1287/isre.12.3.322.9710
     ↗
  78. Hilmer (2000)
    Stimulating thinking: Cultivating better decisions with groupware through categorization
    J. Manage. Inform. Syst.  ↗
  79. 10.1016/S0167-9236(99)00028-7
     ↗
  80. 10.1080/10864415.2003.11044295
     ↗
  81. 10.2307/3250989
     ↗
  82. 10.1287/isre.13.4.404.72
     ↗
  83. 10.2307/249411
     ↗
  84. Dennis (2003)
    The adoption and use of GSS in project teams: Toward more participative processes and outcomes
    MIS Quart.  ↗
  85. Hayne (2003)
    Identification of comment authorship in anonymous group support systems
    J. Manage. Inform. Syst.  ↗
  86. Hender (2002)
    An examination of the impact of stimuli type and GSS structure on creativity: Brainstormi…
    J. Manage. Inform. Syst.  ↗
  87. Karahanna (2002)
    Individual differences and relative advantage: The case of GSS
    Decision Support Syst.  ↗
  88. 10.1057/palgrave.ejis.3000421
     ↗
  89. 10.1080/07421222.2002.11045731
     ↗
  90. 10.1057/palgrave.ejis.3000358
     ↗
  91. 10.1080/07421222.1999.11518223
     ↗
  92. 10.1080/07421222.2003.11045750
     ↗
  93. 10.1287/isre.13.1.70.92
     ↗
  94. 10.1046/j.1365-2575.1999.00065.x
     ↗
CrossRef global citation count: 7 View in citation network → Build reading path →

Related Articles

  1. IEEE Transactions on Professional Communication Mar 2005
    A Framework for Analyzing Levels of AnalysisIssues in Studies of E-Collaboration ↗
    M.J. Gallivan; R. Benbunan-Fich
    collaborative writing empirical research online writing instruction
  2. IEEE Transactions on Professional Communication Mar 2026
    Bridging the Gap: A Comparative Study of Students’ and LSPs’ Perceptions of Translation Internships ↗
    Shuang Liu
    collaborative writing assessment professional writing empirical research
  3. Computers and Composition Dec 2025
    Supporting online learning for diverse elementary students: A community of inquiry approach to collaborative multimodal composing—processes, products, and perspectives ↗
    Amanda Yoshiko Shimizu; Jill Santos
    collaborative writing multimodality online writing instruction
  4. Computers and Composition Sep 2025
    When collaborating turns into dishonesty: A data-driven heuristic comparing human and AI collaborators ↗
    John R. Gallagher; Kyle Wagner; Jordan Canzonetta
    collaborative writing empirical research artificial intelligence
  5. Business and Professional Communication Quarterly Sep 2025
    Social Media: An Elixir to Boost Student Engagement in Higher Education Learning ↗
    Surabhi Koul; Sahil Singh Jasrotia
    teacher development collaborative writing professional writing social media online writing instruction