Scientific Publishing: The eLife approach to peer review

All editorial decisions at eLife are taken by working scientists in a process that emphasizes fairness, speed and transparency.

One of the founding principles of eLife has been to assign authority for the editorial decisions to scientists who are still active in the research community. Although the same is true of many journals, particularly those run by scientific societies, eLife has introduced a number of innovations into the peer review process to ensure that editorial judgments are made in a way that is both decisive and fair to authors, and also more transparent than at most journals. We believe that these innovations—combined with our commitment to open access and to fully exploiting the potential offered by digital media (Schekman et al., 2012)—will allow us to publish some of the best work in the life and biomedical sciences in a way that benefits both authors and readers.

When a paper is submitted to eLife, it is assigned to one of the senior editors on the journal. This editor then makes the initial decision on the paper, usually after consulting colleagues, in particular members of the larger Board of Reviewing Editors (BRE), which contains at least one expert in the areas of science that eLife aims to cover. As with most journals, authors are asked during the submission stage to identify the most appropriate editors to handle their manuscripts, and to propose suitable referees, and they are also given the opportunity to request that certain editors and referees are excluded from the process.

If the work is judged to represent a significant achievement using a broad set of criteria, a full submission is encouraged and a reviewing editor is appointed from the BRE or from the senior editors. This reviewing editor acts as a referee, selects one or more additional referees and oversees the peer review process. About 43% of initial submissions make it through this initial stage, and the median time from receipt to initial decision is about three days.

An important element of the peer review process at eLife is that referees are directed to limit their recommendations to changes that bear directly on the major conclusions of the work. As it states on our web site:

  1. We will only request new work, such as experiments, analyses, or data collection, if the data are essential to support the major conclusions.

  2. The authors must be able to do any new work in a reasonable time frame. If the conclusions are not adequately supported by the existing data, the submission should be rejected.

  3. Any requests for new work must fall within the scope of the current submission and the technical expertise of the authors.

The new approach being taken by eLife really kicks in once all the reviews have been received: the reviewing editor initiates an online consultation session in which each referee can see who the other referees are and what they wrote about the manuscript. Over the course of several days, the referees exchange views on the merits of the work. If the consensus is that the manuscript should be rejected—and about 40% of the manuscripts that have reached this stage to date have been rejected—the reviews are usually conveyed to the authors in full.

If, on the other hand, the consensus is that the manuscript is, in principle, acceptable for publication in eLife, but requires additional experiments or analysis, the referees work with each other to identify the additional studies that are required for acceptance. The reviewing editor then drafts a decision letter that explains these essential revisions; we prefer that these core comments are summarized in at most 1000 words. If it is agreed during the consultation session that some of the referees’ concerns do not affect the validity or overall conclusions of the manuscript, then these concerns are not included in the decision letter. (Such concerns are sometimes conveyed to the authors, but in these cases it is made clear to the authors that it is not essential to address these concerns in the revised manuscript.) All decisions, either favourable or unfavourable, are reviewed and approved by the Editor-in-Chief or one of the two Deputy Editors, plus one other senior editor. The end result is that the authors have a clear directive from the editors—a roadmap that, if navigated successfully, will virtually guarantee acceptance. Although the consultation among the referees adds some time to the decision process, the median time from receiving the full submission to the decision after peer review is currently running at 27 days.

The end result is that the authors have a clear directive from the editors—a roadmap that, if navigated successfully, will virtually guarantee acceptance.

When the revised manuscript is received, the reviewing editor can usually make an executive decision on whether or not the authors have addressed the major concerns conveyed in the decision letter in a satisfactory manner. This is one of the reasons why the median time from receiving the full submission to acceptance is presently less than 80 days. Finally, subject to approval by the authors, the decision letter after peer review and the author response to this decision letter are included in the HTML version of the article as part of our efforts to make the peer review process more transparent.

The responses of referees, authors and editors to this approach have been almost universally enthusiastic. Referees, in particular, have found the consultation session to be engaging and an improvement on the conventional approach in which reviews are cast into an electronic void and the referee often remains oblivious to the fate of the paper, and rarely learns who the other referees were. And, surprisingly perhaps, several authors of papers that were not accepted after initial or full review have told us that, despite their disappointment, they found the whole process of peer review—and, in some cases, rebuttal—to be fair and, in general, fast. It will be clear to readers that the eLife approach to peer review requires a significant commitment to the journal from researchers who already have many calls on their time. The editors are therefore financially remunerated in recognition of the work that they are putting into the journal.

As with any new process, some concerns were raised about our consultation stage, particularly the identification of referees to one another. Would a junior investigator feel reluctant to challenge the views of an established expert? Could we assure the confidentiality of the process? And what would happen in the event that a consensus could not be reached? To date, these issues have not presented a problem. Young scholars who have served as referees have not been reluctant to express contrary views, referees have maintained confidentiality (where desired) and, remarkably, a consensus has always been reached (although the relevant senior editor can be called on to make a final decision in the case of deadlock).

As eLife grows, the capacity of our editors and our procedures will be challenged. It is already obvious, however, that our fresh approach to editorial decision making is working well. And with other journals making similar innovations—and here we acknowledge the pioneering work of the British Medical Journal, EMBO Journal and some of the BMC journals in this regard—we are clearly entering a new era of fairer and more efficient peer review.

References

Article and author information

Author details

  1. Randy Schekman, Editor-in-Chief

    For correspondence
    editorial@elifesciences.org
    Competing interests
    RS receives funding from the Howard Hughes Medical Institute
  2. Fiona Watt, Deputy Editor

    Competing interests
    FW receives funding from the Wellcome Trust
  3. Detlef Weigel, Deputy Editor

    Competing interests
    DW is employed by the Max Planck Society.

Publication history

  1. Version of Record published: April 30, 2013 (version 1)
  2. Version of Record updated: May 12, 2017 (version 2)

Copyright

© 2013, Schekman et al.

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 8,757
    Page views
  • 227
    Downloads
  • 19
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, Scopus, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Randy Schekman
  2. Fiona Watt
  3. Detlef Weigel
(2013)
Scientific Publishing: The eLife approach to peer review
eLife 2:e00799.
https://doi.org/10.7554/eLife.00799