Quantifying antibody kinetics and RNA detection during early-phase SARS-CoV-2 infection by time since symptom onset

  1. Benny Borremans  Is a corresponding author
  2. Amandine Gamble
  3. KC Prager
  4. Sarah K Helman
  5. Abby M McClain
  6. Caitlin Cox
  7. Van Savage
  8. James O Lloyd-Smith
  1. Ecology and Evolutionary Biology Department, University of California, Los Angeles, United States
  2. I-BioStat, Data Science Institute, Hasselt University, Belgium
  3. Evolutionary Ecology Group, University of Antwerp, Belgium
  4. National Marine Mammal Foundation, United States
  5. Biomathematics Department, University of California, Los Angeles, United States

Decision letter

  1. Talía Malagón
    Reviewing Editor; McGill University, Canada
  2. Miles P Davenport
    Senior Editor; University of New South Wales, Australia
  3. Michael J Mina
    Reviewer; Harvard School of Public Health, United States

In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.

Acceptance summary:

This manuscript presents an important and timely assessment of current data on antibody kinetics and RNA shedding during SARS-CoV-2. The researchers used innovative estimating procedures that draw from multiple data streams and data sources. The characterization of detection probabilities of different tests over time is topical and very relevant for clinical use, public health and modeling and other research.

Decision letter after peer review:

Thank you for submitting your article "Quantifying antibody kinetics and RNA shedding during early-phase SARS-CoV-2 infection" for consideration by eLife. Your article has been reviewed by three peer reviewers, one of whom is a member of our Board of Reviewing Editors, and the evaluation has been overseen by Miles Davenport as the Senior Editor. The following individual involved in review of your submission has agreed to reveal their identity: Michael J Mina (Reviewer #3).

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

As the editors have judged that your manuscript is of interest, but as described below that additional experiments are required before it is published, we would like to draw your attention to changes in our revision policy that we have made in response to COVID-19 (https://elifesciences.org/articles/57162). First, because many researchers have temporarily lost access to the labs, we will give authors as much time as they need to submit revised manuscripts. We are also offering, if you choose, to post the manuscript to bioRxiv (if it is not already there) along with this decision letter and a formal designation that the manuscript is "in revision at eLife". Please let us know if you would like to pursue this option. (If your work is more suitable for medRxiv, you will need to post the preprint yourself, as the mechanisms for us to do so are still in development.)

Summary:

This manuscript presents an important and timely assessment of current data on antibody kinetics and RNA shedding during SARS-CoV-2. All reviewers expressed that they greatly enjoyed reading the paper and thought it is exactly the type of data integration that needs to be taking place in this fast paced and sparse data world that is COVID-19. However, there were some methodological concerns that should be addressed in a revision as we felt they may influence the validity of the estimates in this paper:

Essential revisions:

1) Reporting of the review component: This paper is missing some reporting elements that are usual in reviews of the literature and required for full transparency. Please provide: a) the full electronic search strategy for at least one database in appendix, with search terms used; b) a flowchart of the study selection process, with inclusions and exclusions; c) a summary table of all included studies, providing an overview of their main characteristics (ex. assay, antigen, countries, age range of participants, sample sizes, and maximum follow-up times) ; d) the full list of citations of all included studies. While this paper is not a formal systematic review, some guidance on how to present the elements listed above can be found in the PRISMA guidelines.

2) Chain convergence: Looking at the plots in the supplementary information, the MCMC chains have not converged. This means that the results on the fitting of antibody levels cannot be reliably interpreted and casts doubt on the validity of estimates from these analyses. There are several individuals for which we observe very poor fits. Perhaps visualizing the uncertainty in the model estimates of antibody levels would clarify. The chains need to be run again. Calculation of the Gelman-Rubin convergence statistic would provide evidence of chain convergence. The reviewers recommend running the chains for longer and re-tuning the proposal distributions in order to achieve chain convergence.

https://doi.org/10.7554/eLife.60122.sa1

Author response

Essential revisions:

1) Reporting of the review component: This paper is missing some reporting elements that are usual in reviews of the literature and required for full transparency. Please provide: a) the full electronic search strategy for at least one database in appendix, with search terms used; b) a flowchart of the study selection process, with inclusions and exclusions; c) a summary table of all included studies, providing an overview of their main characteristics (ex. assay, antigen, countries, age range of participants, sample sizes, and maximum follow-up times) ; d) the full list of citations of all included studies. While this paper is not a formal systematic review, some guidance on how to present the elements listed above can be found in the PRISMA guidelines.

We agree that more information about the selection process would be valuable, and have added all information as suggested (subsection “Estimating the distribution of seroconversion times”). We have also added a flowchart (Figure 5) and a table listing the key features of the selected articles (Figure 5—source data 1).

2) Chain convergence: Looking at the plots in the supplementary information, the MCMC chains have not converged. This means that the results on the fitting of antibody levels cannot be reliably interpreted and casts doubt on the validity of estimates from these analyses. There are several individuals for which we observe very poor fits. Perhaps visualizing the uncertainty in the model estimates of antibody levels would clarify. The chains need to be run again. Calculation of the Gelman-Rubin convergence statistic would provide evidence of chain convergence. The reviewers recommend running the chains for longer and re-tuning the proposal distributions in order to achieve chain convergence.

We fully agree, and have re-done all MCMC fitting using a better method (JAGS instead of R Metropolis-Hastings MCMC).

Chains for all parameters now converge nicely, with clean posterior distributions.

Additionally, the much improved model fits have motivated us to improve parameter estimation by implementing individual growth rates (as opposed to one population-level growth rate previously).

These improvements did not change any qualitative results, and now allowed all statistical comparisons of model parameters to be done fully based on posterior distributions that take into account parameter uncertainty.

These changes resulted in the following edits in the main text and supplementary information:

– Updated description of MCMC model fitting in the main text.

– Updated antibody kinetics results in the main text

– Updated MCMC results in Figure 3—figure supplements 1-10.

Unfortunately a bug was found in the code in the process of improving the models, which previously resulted in wrong subsetting of IgM results of mild cases.

As a result, we now find a marginally significant difference in IgM antibody level growth rates and peak level timing between mild and severe cases.

This did not have a major impact on the overall conclusions however, as the difference was not large, and seroconversion as well as antibody detection patterns that are based on much larger datasets do not provide evidence for a general effect of disease severity on antibody patterns.

We edited the relevant section in the Discussion accordingly: "Here, we did not detect any significant effects of disease severity on antibody patterns, with the single exception that we estimated a lower rate of IgM increase in severe/critical cases relative to mild/moderate cases", and "Our findings do not support the idea that severe cases seroconvert faster. Indeed, the only significant effect of severity in our analyses is that the inferred growth rate of IgM levels is slower for severe/critical cases. It is not clear whether this reflects a relevant biological difference, considering that all other parameters do not differ among disease severity categories. The consensus patterns from our meta-analysis suggest that any interaction between disease severity and antibody response must be subtle and sensitive to other sources of variation, explaining the inconsistencies seen across studies".

https://doi.org/10.7554/eLife.60122.sa2

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Benny Borremans
  2. Amandine Gamble
  3. KC Prager
  4. Sarah K Helman
  5. Abby M McClain
  6. Caitlin Cox
  7. Van Savage
  8. James O Lloyd-Smith
(2020)
Quantifying antibody kinetics and RNA detection during early-phase SARS-CoV-2 infection by time since symptom onset
eLife 9:e60122.
https://doi.org/10.7554/eLife.60122

Share this article

https://doi.org/10.7554/eLife.60122