Estimation and worldwide monitoring of the effective reproductive number of SARS-CoV-2

  1. Jana S Huisman  Is a corresponding author
  2. Jérémie Scire
  3. Daniel C Angst
  4. Jinzhou Li
  5. Richard A Neher
  6. Marloes H Maathuis
  7. Sebastian Bonhoeffer
  8. Tanja Stadler  Is a corresponding author
  1. Department of Environmental Systems Science, ETH Zurich, Swiss Federal Institute of Technology, Switzerland
  2. Swiss Institute of Bioinformatics, Switzerland
  3. Department of Biosystems Science and Engineering, ETH Zurich, Swiss Federal Institute of Technology, Switzerland
  4. Department of Mathematics, ETH Zurich, Swiss Federal Institute of Technology, Switzerland
  5. Biozentrum, University of Basel, Switzerland

Decision letter

  1. Miles P Davenport
    Senior and Reviewing Editor; University of New South Wales, Australia

Our editorial process produces two outputs: (i) public reviews designed to be posted alongside the preprint for the benefit of readers; (ii) feedback on the manuscript for the authors, including requests for revisions, shown below. We also include an acceptance summary that explains what the editors found interesting or important about the work.

Decision letter after peer review:

Thank you for submitting your article "Estimation and worldwide monitoring of the effective reproductive number of SARS-CoV-2" for consideration by eLife. Your article has been reviewed by 2 peer reviewers, and the evaluation has been overseen by a Reviewing Editor and Miles Davenport as the Senior Editor. The reviewers have opted to remain anonymous.

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Essential revisions:

1) In addition to the stringency index, please incorporate mobility in selected countries where relevant data are available.

2) Moreover, please integrate additional data types, eg case series, hospitalizations and deaths, to estimate a single set of R_e (t), rather than separate analyses on each data stream.

3) Please address the uncertainty estimation procedure as queried by Reviewer #1.

Reviewer #1 (Recommendations for the authors):

1) Explain more for the simulation approach in the paper, such as why the noise should be computed in this way, instead of just based on the theoretical delay distribution from infection to death/hospitalization/reported, to simulate the input time series.

2) More simulations to validate the real-time property of the estimates of Rt

3) A potential framework that can use both time series for cases, hospitalization and death to jointly infer the infection time series.

The results are easy to be assessed and presented clearly, which is good. I am not sure how I can get the data and also the code to replicate the analysis. Ideally it should be available.

(Note from Ed: Data and code must be available to conform with eLife data policies)

https://doi.org/10.7554/eLife.71345.sa1

Author response

Essential revisions:

1) In addition to the stringency index, please incorporate mobility in selected countries where relevant data are available.

We have now integrated mobility data into our dashboard, similar to our stringency index and vaccination time series. We show both Apple and Google mobility data. All these traces can be downloaded and compared against our Re estimates. We have also incorporated this data into the empirical analysis of Figure 5 in the manuscript.

2) Moreover, please integrate additional data types, eg case series, hospitalizations and deaths, to estimate a single set of R_e (t), rather than separate analyses on each data stream.

We think it is a strength of our approach to show the different traces in parallel, as this allows direct comparison during periods where one trace may be more or less credible. We have revised the text to make clear early on that we estimate separate Re values, and what the advantages of this approach are.

3) Please address the uncertainty estimation procedure as queried by Reviewer #1.

We believe there was some misunderstanding here regarding the logic behind our simulation set-up. We have revised the corresponding method sections, specifically adding more information on why and how we incorporate observation noise into our simulations.

Reviewer #1 (Recommendations for the authors):

1) Explain more for the simulation approach in the paper, such as why the noise should be computed in this way, instead of just based on the theoretical delay distribution from infection to death/hospitalization/reported, to simulate the input time series.

We added more explanation about our simulation approach to the corresponding method section (lines 488-518). We found that simulated observations based only on the delay from infection to reporting did not show the same amount of variability as real case data from around the world. We added reporting noise to the simulations to be able to accurately assess the coverage of our method.

Please also refer to our answer to the public review above, for a more detailed overview of our simulation set-up.

2) More simulations to validate the real-time property of the estimates of Rt

As suggested, we performed an additional simulation study to investigate the accuracy and stability of the last possible Re estimate. We present this analysis in a new results paragraph (subsection "Stability of Re estimates in an outbreak monitoring context"; line 121) and Appendix 4 – Figure 1. This analysis emphasizes the need to be cautious with the most recent Re estimates when these values are directly policy relevant.

We revised the wording of our manuscript everywhere to replace the ambiguous "near real-time" by "timely", and added text to highlight the delay between latest Re estimates and latest case observations.

3) A potential framework that can use both time series for cases, hospitalization and death to jointly infer the infection time series.

Please refer to our response to item #1 of the public review (for reviewer 1).

The results are easy to be assessed and presented clearly, which is good. I am not sure how I can get the data and also the code to replicate the analysis. Ideally it should be available.

(Note from Ed: Data and code must be available to conform with eLife data policies)

The information on data sources is provided in the Data subsection (4.6) of the Materials and methods section, with additional information in Supplementary File S1.

The information on software repositories is provided at the very end of the main text of the manuscript, in the Materials and methods section (subsection 4.8).

Specifically, the source code of the software pipeline is openly accessible at https://github.com/covid-19-Re/shiny-dailyRe, and the code necessary to reproduce the figures and analyses presented in this paper is available at https://github.com/covid-19-Re/paper-code.

https://doi.org/10.7554/eLife.71345.sa2

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Jana S Huisman
  2. Jérémie Scire
  3. Daniel C Angst
  4. Jinzhou Li
  5. Richard A Neher
  6. Marloes H Maathuis
  7. Sebastian Bonhoeffer
  8. Tanja Stadler
(2022)
Estimation and worldwide monitoring of the effective reproductive number of SARS-CoV-2
eLife 11:e71345.
https://doi.org/10.7554/eLife.71345

Share this article

https://doi.org/10.7554/eLife.71345