Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Flavio Canavero Polytechnic University of Turin ; Fiorenzo Franceschini Polytechnic University of Turin ; Domenico Maisano Polytechnic University of Turin ; Luca Mastrogiacomo Polytechnic University of Turin

Abstract

Research problem: This study explores the use of bibliometric indicators to objectively evaluate IEEE scientific journals from two different perspectives: (1) journal impact and diffusion and (2) the academic reputation of journal authors. Research questions: (1) Which journals are better at selecting articles with high scientific impact (measured by average citations per article), and publishing authors with strong reputations (measured by h-indices)? (2) Does the impact of journal articles correlate positively with the reputations of their authors? and (3) Can bibliometric indicators provide a simple way for journal editors to monitor journal performance in a manner complementary to traditional ISI impact factor (IF)? Literature review: This paper reviews literature on citation analysis, a bibliometric method of measuring impact based on the number of times a work is cited, and explains such bibliometric indicators as CPP, Hirsch index, and IF which measure the impact of a journal, and introduces a new indicator called h-spectrum to objectively measure the reputation of a journal's author group. Methodology: This quantitative study performed citation analysis on 250,000 authors in 110 IEEE journals using citation statistics from the Google Scholar, Web of Science, and Scopus databases to construct the h-spectrum indicator. The authors used automated filtering techniques to exclude questionable author data. Results and conclusions: The first phase of analysis indicated significant differences among IEEE publications in journal impact, and found that the h-index and CPP were suitable for evaluating journals except in their most recent five years where annual rankings are proposed instead. The second phase of analysis found that h-spectra distributions of author reputation differ among journals in a single year, and are generally stable for a single journal over five years. Maps were constructed to locate journals graphically based on the complementary indicators of impact and reputation, and to show changes in impact and reputation over time. The maps indicated that journals with high impact tend to have authors with high reputations but the opposite is not necessarily true. Suggestions were made to explain different combinations of high and low impact and reputation for journals. The use of maps complements IF and provides a simple tool to monitor journal reputation at the time of most recent publication. The study is limited by assumptions about the value of citations, the reliability of search engine statistics, and the homogeneity of IEEE journal citation practices, as well as the failure to account for coauthors, article age, and authors who publish multiple times per year in the same journal. Future research could examine non-IEEE journals and normalize subfields within IEEE journals to avoid favoring fields that use more citations.

Journal
IEEE Transactions on Professional Communication
Published
2014-03-01
DOI
10.1109/tpc.2013.2255935
CompPile
Search in CompPile ↗
Open Access
Closed
Topics
Export

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (2)

  1. IEEE Transactions on Professional Communication
  2. IEEE Transactions on Professional Communication
Also cites 36 works outside this index ↓
  1. 10.1007/s11192-007-1895-5
  2. 10.1007/s11192-006-0175-0
  3. 10.1007/s11192-006-1774-5
  4. 10.1007/s11434-007-0145-9
  5. 10.1007/s11192-006-0147-4
  6. 10.1007/s11192-006-0090-4
  7. 10.1016/j.joi.2012.09.008
  8. 10.1016/j.joi.2006.05.001
  9. 10.1016/j.ejor.2009.08.001
  10. 10.1109/MEMB.2006.1705735
  11. 10.1109/TNSRE.2004.838568
  12. 10.1073/pnas.0707962104
  13. 10.1002/asi.20609
  14. 10.1016/j.joi.2007.02.001
  15. 10.1002/aris.2010.1440440109
    Annual Review of Information Science and Technology  
  16. 10.1016/j.joi.2009.04.001
  17. 10.1007/s11192-009-0115-x
  18. 10.1108/14684521111128050
  19. Convergent validity of bibliometric Google Scholar data in the field of chemistry?citatio…
    Inf Des J  
  20. 10.1007/s11192-008-2109-5
  21. 10.1007/978-3-540-75530-2_10
  22. 10.1007/s11192-009-0048-4
  23. 10.1016/j.joi.2009.08.003
  24. 10.1002/asi.20802
  25. 10.1007/s11192-010-0301-x
  26. 10.1007/s11192-009-0124-9
  27. 10.3354/esep00076
  28. 10.1002/asi.21024
  29. 10.1001/jama.295.1.90
  30. 10.1007/978-3-642-57748-2
  31. 10.1073/pnas.0507655102
  32. 10.1007/s11192-009-0098-7
  33. 10.1002/asi.20936
  34. 10.1002/asi.22898
  35. 10.1108/14684520610675816
  36. 10.1007/s11192-010-0185-9