Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

  1. Erin C McKiernan  Is a corresponding author
  2. Lesley A Schimanski
  3. Carol Muñoz Nieves
  4. Lisa Matthias
  5. Meredith T Niles
  6. Juan P Alperin  Is a corresponding author
  1. Universidad Nacional Autónoma de México, Mexico
  2. Simon Fraser University, Canada
  3. Freie Universität Berlin, Germany
  4. University of Vermont, United States
1 figure, 2 tables and 2 additional files

Figures

Grouping of terms related to the JIF.

Terms found in RPT documents were classified as either: (1) referring directly to the JIF (inner ring); (2) referring in some way to journal impact (middle ring); or (3) indirect but probable references to the JIF. For simplicity, singular versions of each term are shown, but searches included their plural equivalents. Our analysis is based only on those terms found in groups 1 and 2 (the two innermost rings).

https://doi.org/10.7554/eLife.47338.002

Tables

Table 1
Sampling summary of universities from Canada and the United States.
Number in categoryNumber sampledPercent sampledNumber with documents
R-type3506519%57
M-type847506%39
B-type602508%33
Table 2
Mentions of the JIF in RPT documents, overall and by institution type.

Note that percentages do not sum to one hundred in any given column, since many institutions had more than one JIF mention that could be classified differently. For example, an institution was marked as having a supportive mention if at least one RPT document from that institution, or any of its academic units, had a supportive mention. The same institution could also be counted under ‘cautious’ if a different academic unit within that institution had such a mention.

AllR-typeM-typeB-type
How many institutions mention the JIF?n129573933
JIF mentioned30 (23%)23 (40%)7 (18%)0 (0%)
Are the JIF mentions supportive or cautionary?n302370
supportive26 (87%)19 (83%)7 (100%)-
cautious4 (13%)3 (13%)1 (14%)-
neutral5 (17%)4 (17%)1 (14%)-
What do institutions measure with the JIF?n302370
quality19 (63%)14 (61%)5 (71%)-
impact/importance/significance12 (40%)8 (35%)4 (57%)-
prestige/reputation/status6 (20%)5 (22%)1 (14%)-
unspecified23 (77%)17 (74%)6 (86%)-

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Erin C McKiernan
  2. Lesley A Schimanski
  3. Carol Muñoz Nieves
  4. Lisa Matthias
  5. Meredith T Niles
  6. Juan P Alperin
(2019)
Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations
eLife 8:e47338.
https://doi.org/10.7554/eLife.47338