Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Flavio Canavero; Fiorenzo Franceschini; Domenico Maisano; Luca Mastrogiacomo

doi:10.1109/tpc.2013.2255935

IEEE Transactions on Professional Communication Mar 2014

Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Flavio Canavero Polytechnic University of Turin ; Fiorenzo Franceschini Polytechnic University of Turin ; Domenico Maisano Polytechnic University of Turin ; Luca Mastrogiacomo Polytechnic University of Turin

Abstract

Research problem: This study explores the use of bibliometric indicators to objectively evaluate IEEE scientific journals from two different perspectives: (1) journal impact and diffusion and (2) the academic reputation of journal authors. Research questions: (1) Which journals are better at selecting articles with high scientific impact (measured by average citations per article), and publishing authors with strong reputations (measured by h-indices)? (2) Does the impact of journal articles correlate positively with the reputations of their authors? and (3) Can bibliometric indicators provide a simple way for journal editors to monitor journal performance in a manner complementary to traditional ISI impact factor (IF)? Literature review: This paper reviews literature on citation analysis, a bibliometric method of measuring impact based on the number of times a work is cited, and explains such bibliometric indicators as CPP, Hirsch index, and IF which measure the impact of a journal, and introduces a new indicator called h-spectrum to objectively measure the reputation of a journal's author group. Methodology: This quantitative study performed citation analysis on 250,000 authors in 110 IEEE journals using citation statistics from the Google Scholar, Web of Science, and Scopus databases to construct the h-spectrum indicator. The authors used automated filtering techniques to exclude questionable author data. Results and conclusions: The first phase of analysis indicated significant differences among IEEE publications in journal impact, and found that the h-index and CPP were suitable for evaluating journals except in their most recent five years where annual rankings are proposed instead. The second phase of analysis found that h-spectra distributions of author reputation differ among journals in a single year, and are generally stable for a single journal over five years. Maps were constructed to locate journals graphically based on the complementary indicators of impact and reputation, and to show changes in impact and reputation over time. The maps indicated that journals with high impact tend to have authors with high reputations but the opposite is not necessarily true. Suggestions were made to explain different combinations of high and low impact and reputation for journals. The use of maps complements IF and provides a simple tool to monitor journal reputation at the time of most recent publication. The study is limited by assumptions about the value of citations, the reliability of search engine statistics, and the homogeneity of IEEE journal citation practices, as well as the failure to account for coauthors, article age, and authors who publish multiple times per year in the same journal. Future research could examine non-IEEE journals and normalize subfields within IEEE journals to avoid favoring fields that use more citations.

Journal: IEEE Transactions on Professional Communication
Published: 2014-03-01
DOI: 10.1109/tpc.2013.2255935
CompPile: Search in CompPile ↗
Open Access: Closed
Topics: quantitative research book reviews
Export: BibTeX RIS

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

Cites in this index (2)

Boettger et al. (2010)

Quantitative Content Analysis: Its Use in Technical Communication

IEEE Transactions on Professional Communication
Lowry et al. (2007)

A Scientometric Study of the Perceived Quality of Business and Technical Commun…

IEEE Transactions on Professional Communication

Also cites 36 works outside this index ↓

10.1007/s11192-007-1895-5

↗
10.1007/s11192-006-0175-0

↗
10.1007/s11192-006-1774-5

↗
10.1007/s11434-007-0145-9

↗
10.1007/s11192-006-0147-4

↗
10.1007/s11192-006-0090-4

↗
10.1016/j.joi.2012.09.008

↗
10.1016/j.joi.2006.05.001

↗
10.1016/j.ejor.2009.08.001

↗
10.1109/MEMB.2006.1705735

↗
10.1109/TNSRE.2004.838568

↗
10.1073/pnas.0707962104

↗
10.1002/asi.20609

↗
10.1016/j.joi.2007.02.001

↗
egghe (2010)

10.1002/aris.2010.1440440109

Annual Review of Information Science and Technology ↗
10.1016/j.joi.2009.04.001

↗
10.1007/s11192-009-0115-x

↗
10.1108/14684521111128050

↗
bornmann (2009)

Convergent validity of bibliometric Google Scholar data in the field of chemistry?citatio…

Inf Des J ↗
10.1007/s11192-008-2109-5

↗
10.1007/978-3-540-75530-2_10

↗
10.1007/s11192-009-0048-4

↗
10.1016/j.joi.2009.08.003

↗
10.1002/asi.20802

↗
10.1007/s11192-010-0301-x

↗
10.1007/s11192-009-0124-9

↗
10.3354/esep00076

↗
10.1002/asi.21024

↗
10.1001/jama.295.1.90

↗
10.1007/978-3-642-57748-2

↗
10.1073/pnas.0507655102

↗
10.1007/s11192-009-0098-7

↗
10.1002/asi.20936

↗
10.1002/asi.22898

↗
10.1108/14684520610675816

↗
10.1007/s11192-010-0185-9

↗

CrossRef global citation count: 11 View in citation network → Build reading path →

Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Abstract

Citation Context

Cited by in this index (0)

Cites in this index (2)

Related Articles