Arguments for the biological and predictive relevance of the proportional recovery rule

  1. Jeff Goldsmith  Is a corresponding author
  2. Tomoko Kitago
  3. Angel Garcia de la Garza
  4. Robinson Kundert
  5. Andreas Luft
  6. Cathy Stinear
  7. Winston D Byblow
  8. Gert Kwakkel
  9. John W Krakauer
  1. Department of Biostatistics, Columbia Mailman School of Public Health, United States
  2. Burke Neurological Institute, United States
  3. Weill Cornell Medicine, United States
  4. Cereneo, Center for Neurology and Rehabilitation, Switzerland
  5. Vascular Neurology and Neurorehabilitation, Department of Neurology, University Hospital Zurich, University of Zurich, Switzerland
  6. Department of Medicine, University of Auckland, New Zealand
  7. Department of Exercise Sciences, University of Auckland, New Zealand
  8. Rehabilitation Research Centre, Reade, Netherlands
  9. Rehabilitation Medicine, Amsterdam UMC - Location VUMC, Amsterdam Movement Sciences, Netherlands
  10. Department of Neurology, Johns Hopkins University, United States
  11. Department of Neuroscience, Johns Hopkins University, United States
  12. Department of Physical Medicine and Rehabilitation, United States
  13. Santa Fe Institute, United States
8 figures, 2 tables and 2 additional files

Figures

The left panels show four generated datasets, labeled A, B, C, and D.

In the top row, panels show outcome values and baseline (x) and follow-up (y). In the bottom row, panels show change (δ) against initial impairment (66 − x). The right panel shows a contour plot of Equation 1, with contours corresponding to values of the variance ratio k and the contour for k=1 highlighted. Points on this surface show correlation values obtained for Datasets A through D. A figure similar to the contour plot is shown in Hope et al., 2018, with different axes and orientations.

The top panels show three generated datasets with true outcome values and baseline (x) and follow-up (y); a horizontal line indicates a ceiling on observed values.

In the bottom row, panels show the observed (ceiled) value at follow-up against the baseline value. Fitted values from an intercept-only model (Int), a generalized additive model (GAM), and the proportional recovery rule (PRR) are shown in the bottom row.

Each panel shows the distribution of median absolute prediction errors (MAPE) obtained using cross validation for each of five models.

Panels correspond to the generated datasets shown in Figure 2. Models compared are an intercept-only model (Int), a generalized additive model (GAM), and the proportional recovery rule (PRR).

The left panels show three real datasets.

In the top row, panels show outcome values and baseline (x) and follow-up (y); points are colored to indicate recoverers (purple) and non-recoverers (yellow) using the definitions from each paper describing the data. In the bottom row, panels show change (delta) against initial impairment (66 − x), again separating recoverers and non-recoverers. The right panel shows a contour plot of Equation 1, with contours corresponding to values of the variance ratio k and the contour for k=1 highlighted. Points on this surface show correlation values obtained for the real datasets.

Each panel shows the results of the bootstrap procedure used to obtain inferences about the value of correlations and variance ratio.

Red points are the values obtained for the full dataset, and blue points are values obtained in each of 1000 bootstrap samples; points are overlaid on the contour plot of Equation 1.

Each panel shows the distribution of median absolute prediction errors (MAPEs) obtained using cross validation for each of five models.

Panels correspond to the datasets shown in Figure 4. Models compared are an intercept-only model, a generalized additive model, and the proportional recovery rule (PRR).

Both panels show change between baseline and follow-up against initial impairment (66 – baseline).

Left panel shows data generated under a ‘random recovery’ process, in which outcome values are drawn from a uniform distribution over the baseline value and ceiling. Right panel presents again data from Winters et al., 2015.

Appendix 1—figure 1
Fitted values for each of four models, obtained within separate training / testing splits as part of the cross validation procedure.

Tables

Table 1
Values and 95% confidence intervals for k and cor(x,y) for each of three datasets.

Confidence intervals are obtained through a bootstrap procedure with 1000 bootstrap samples.

Dataset namekcor(x,y)
Stinear and Byblow0.39 [0.27, 0.54]0.73 [0.66, 0.79]
Winters0.07 [0.05, 0.09]0.59 [0.49, 0.69]
Zarahn0.13 [0.03, 0.24]0.75 [0.55, 0.92]
Table 2
The proportion of follow-up (y) variation explained by the proportional recovery rule (PRR) for each of three datasets.

Follow-up fitted y^PRR values are obtained by adding predicted change from the PRR to observed baseline values, and we compute 1(yiy^ iPRR)2(yiy¯)2.

Dataset namePercent of outcome variation explained
Stinear and Byblow0.55
Winters0.35
Zarahn0.56

Additional files

MDAR checklist
https://cdn.elifesciences.org/articles/80458/elife-80458-mdarchecklist1-v2.pdf
Source data 1

The zip file contains two data sets ("Winters"and "Zarahn"), as well as code that can be used to reproduce all analyses of these datasets.

https://cdn.elifesciences.org/articles/80458/elife-80458-data1-v2.zip

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Jeff Goldsmith
  2. Tomoko Kitago
  3. Angel Garcia de la Garza
  4. Robinson Kundert
  5. Andreas Luft
  6. Cathy Stinear
  7. Winston D Byblow
  8. Gert Kwakkel
  9. John W Krakauer
(2022)
Arguments for the biological and predictive relevance of the proportional recovery rule
eLife 11:e80458.
https://doi.org/10.7554/eLife.80458