Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Flavio Canavero; Fiorenzo Franceschini; Domenico Maisano; Luca Mastrogiacomo

doi:10.1109/tpc.2013.2255935

IEEE Transactions on Professional Communication Mar 2014

Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Flavio Canavero Polytechnic University of Turin ; Fiorenzo Franceschini Polytechnic University of Turin ; Domenico Maisano Polytechnic University of Turin ; Luca Mastrogiacomo Polytechnic University of Turin

Abstract

Research problem: This study explores the use of bibliometric indicators to objectively evaluate IEEE scientific journals from two different perspectives: (1) journal impact and diffusion and (2) the academic reputation of journal authors. Research questions: (1) Which journals are better at selecting articles with high scientific impact (measured by average citations per article), and publishing authors with strong reputations (measured by h-indices)? (2) Does the impact of journal articles correlate positively with the reputations of their authors? and (3) Can bibliometric indicators provide a simple way for journal editors to monitor journal performance in a manner complementary to traditional ISI impact factor (IF)? Literature review: This paper reviews literature on citation analysis, a bibliometric method of measuring impact based on the number of times a work is cited, and explains such bibliometric indicators as CPP, Hirsch index, and IF which measure the impact of a journal, and introduces a new indicator called h-spectrum to objectively measure the reputation of a journal's author group. Methodology: This quantitative study performed citation analysis on 250,000 authors in 110 IEEE journals using citation statistics from the Google Scholar, Web of Science, and Scopus databases to construct the h-spectrum indicator. The authors used automated filtering techniques to exclude questionable author data. Results and conclusions: The first phase of analysis indicated significant differences among IEEE publications in journal impact, and found that the h-index and CPP were suitable for evaluating journals except in their most recent five years where annual rankings are proposed instead. The second phase of analysis found that h-spectra distributions of author reputation differ among journals in a single year, and are generally stable for a single journal over five years. Maps were constructed to locate journals graphically based on the complementary indicators of impact and reputation, and to show changes in impact and reputation over time. The maps indicated that journals with high impact tend to have authors with high reputations but the opposite is not necessarily true. Suggestions were made to explain different combinations of high and low impact and reputation for journals. The use of maps complements IF and provides a simple tool to monitor journal reputation at the time of most recent publication. The study is limited by assumptions about the value of citations, the reliability of search engine statistics, and the homogeneity of IEEE journal citation practices, as well as the failure to account for coauthors, article age, and authors who publish multiple times per year in the same journal. Future research could examine non-IEEE journals and normalize subfields within IEEE journals to avoid favoring fields that use more citations.

Journal: IEEE Transactions on Professional Communication
Published: 2014-03-01
DOI: 10.1109/tpc.2013.2255935
CompPile
Open Access: Closed
Topics: quantitative research book reviews
Export: BibTeX RIS

Citation Context

Cited by in this index (0)

No articles in this index cite this work.

References (58) · 2 in this index

10.1007/s11192-007-1895-5

↗
10.1007/s11192-006-0175-0

↗
10.1007/s11192-006-1774-5

↗
10.1007/s11434-007-0145-9

↗
10.1007/s11192-006-0147-4

↗

Show all 58 →

10.1007/s11192-006-0090-4

↗
(0)

Citation statistics
garfield (2005)

Agony and the ecstasy?the history and meaning of the impact factor

Int Congr Peer Rev Biomed Publ Chicago IL USA
schreiber (2010 feb 10) (2010)

Modification of the h-Index The -index accounts for multi-authored manuscripts
katsaros (2007)

Age decaying H?Index for social network of citations

Workshop Social Aspects Web Poznan Poland
10.1016/j.joi.2012.09.008

↗
10.1016/j.joi.2006.05.001

↗
10.1016/j.ejor.2009.08.001

↗
10.1109/MEMB.2006.1705735

↗
10.1109/TNSRE.2004.838568

↗
10.1073/pnas.0707962104

↗
10.1002/asi.20609

↗
gl�nzel (2006)

On the opportunities and limitations of the h-index

Scie Focu
franceschini (2007)

Management by Measurement Designing Key Indicators and Performance Measurement Systems
10.1016/j.joi.2007.02.001

↗
egghe (2010)

10.1002/aris.2010.1440440109

Annual Review of Information Science and Technology ↗
10.1016/j.joi.2009.04.001

↗
10.1007/s11192-009-0115-x

↗
thompson (1993)

1993. GRE percentile ranks cannot be added or averaged: A position paper exploring the sc…

Annu Meet Mid-South Educ Res Assoc New Orleans LA USA
10.1108/14684521111128050

↗
bornmann (2009)

Convergent validity of bibliometric Google Scholar data in the field of chemistry?citatio…

Inf Des J ↗
(0)

Societies and communities
10.1007/s11192-008-2109-5

↗
10.1007/978-3-540-75530-2_10

↗
10.1007/s11192-009-0048-4

↗
leydesdorff (2011)

An evaluation of impacts in ?nanoscience & nanotechnology:? Steps towards standards f…

Atlanta Conf Sci Technol Innov Policy Atlanta GA USA
10.1016/j.joi.2009.08.003

↗
Boettger et al. (2010)

Quantitative Content Analysis: Its Use in Technical Communication

IEEE Transactions on Professional Communication
10.1002/asi.20802

↗
10.1007/s11192-010-0301-x

↗
10.1007/s11192-009-0124-9

↗
gl�nzel (2010)

Hirsch-type characteristics of the tail of distributions

Generalised h-Index J Inf
Lowry et al. (2007)

A Scientometric Study of the Perceived Quality of Business and Technical Commun…

IEEE Transactions on Professional Communication
de bellis (2009)

2009 Bibliometrics and Citation Analysis From the Science Citation Index to Cybermetrics
cronin (1984)

The Citation Process The Role and Significance of Citations in Scientific Communication
10.3354/esep00076

↗
(0)

Scopus?Elsevier 2011 (2011 Feb 10)
10.1002/asi.21024

↗
10.1001/jama.295.1.90

↗
amin (2000)

?Impact factors Use and abuse ? Elsevier Science Perspectives in Publishing
rogers (2003)

Diffusion of Innovations
moed (2005)

Citation analysis in research evaluation
10.1007/978-3-642-57748-2

↗
10.1073/pnas.0507655102

↗
(0)

[Online] Available www thomsonreuters com/products_services/scientific/Journal_Citation_Reports
dervos (2006)

The universal author identifier system (UAI_Sys)

1st Int Scientif Conf eRA Contribution of Inf Technol Sci Econ Soc Educ Tripolis Greece
10.1007/s11192-009-0098-7

↗
borda (1781)

M�moire sur les �lections au scrutin, Comptes Rendus de l'Acad�mie des sciences, translat…

Isis
10.1002/asi.20936

↗
10.1002/asi.22898

↗
10.1108/14684520610675816

↗
(0)

IEEE Xplore
10.1007/s11192-010-0185-9

↗

CrossRef global citation count: 11 View in citation network → Build reading path →

Impact of Journals and Academic Reputations of Authors: A Structured Bibliometric Survey of the IEEE Publication Galaxy

Abstract

Citation Context

Cited by in this index (0)

References (58) · 2 in this index

Related Articles