Memory CD4 T cell subsets are kinetically heterogeneous and replenished from naive T cells at high levels
Abstract
Characterising the longevity of immunological memory requires establishing the rules underlying the renewal and death of peripheral T cells. However, we lack knowledge of the population structure and how selfrenewal and de novo influx contribute to the maintenance of memory compartments. Here, we characterise the kinetics and structure of murine CD4 T cell memory subsets by measuring the rates of influx of new cells and using detailed timecourses of DNA labelling that also distinguish the behaviour of recently divided and quiescent cells. We find that both effector and central memory CD4 T cells comprise subpopulations with highly divergent rates of turnover, and show that inflows of new cells sourced from the naive pool strongly impact estimates of memory cell lifetimes and division rates. We also demonstrate that the maintenance of CD4 T cell memory subsets in healthy mice is unexpectedly and strikingly reliant on this replenishment.
https://doi.org/10.7554/eLife.23013.001eLife digest
The immune system protects the body from the infectious bacteria, viruses and other microorganisms present in our everyday environment (collectively known as pathogens). One feature of this system is that it can form longlasting memories of the pathogens it has previously encountered by creating cells called memory cells. When the same pathogen invades the body again, the memory cells help the immune system to kill off the infection more rapidly and efficiently than before. This process also underlies how vaccines work. By exposing the immune system to a pathogen in a controlled, safe way, memory cells form that can efficiently fight off a future infection.
Do immune memories only form when we are sick with infections? Or does constant exposure to the microbes that are present in the natural environment also stimulate the formation of memory cells? Also, how does the formation of new memory cells affect the existing memory cells?
To answer these questions, Gossel, Hogan et al. studied laboratory mice that were kept in a clean, controlled environment – and not exposed to pathogens – for a year. This timespan represents about half of a mouse’s normal lifespan. Over the course of the year, new immune memory cells constantly formed in the mice. Furthermore, in young healthy mice up to a tenth of the existing immune memory cells were replaced each week. Despite the constant formation of new memory cells, the overall number of immune memory cells in the mice only doubled over the course of the year, suggesting that some memory cells must also be lost.
The discovery that new immune memory cells are constantly made raises new questions to be investigated in future studies. For example, does the constant formation of memory cells make it harder to retain useful memories of pathogens, and does this explain the need for booster vaccinations?
https://doi.org/10.7554/eLife.23013.002Introduction
The diversity and longevity of T cell memory are shaped by influx, cell division and cell death. A major challenge is to understand how these processes are regulated in health and how they respond to perturbations such as chronic infections. To understand the evolution of immune repertoires within a host therefore requires quantifying homeostatic processes, identifying the rules of replacement within memory subsets, and characterising any distinct homeostatic niches that lie within them. The dominant approaches to studying T cell population dynamics at steady state involve the adoptive transfer of cells labelled with inert dyes such as CFSE and using its rate of dilution to infer rates of proliferation (De Boer et al., 2006; Choo et al., 2010), or tracking the uptake and dilution of labels incorporated into the DNA of dividing cells, the kinetics of which contain information regarding both division and loss of cells (De Boer and Perelson, 2013). In both cases, mathematical models are needed to interpret the data. However, while for some T cell subsets in mice and humans there is broad agreement regarding basic parameters such as populationaveraged cell lifetimes, discrepancies remain and defining homeostatic dynamics in detail is difficult. Gaps in our understanding of how memory compartments are structured, and how the processes of cell division and death are correlated, generate uncertainty in how to formulate the dynamical models to describe data from labelling studies (De Boer et al., 2003) and indeed these data may not be sufficiently rich in information to allow us to discriminate between these models (De Boer et al., 2012).
One major difficulty is measuring the contribution that any influx of new cells originating from naive precursors makes to the maintenance of immune memory. While it is clear that new memory T cells are generated during infections and by the seeding of empty peripheral compartments, either early in ontogeny (Le Campion et al., 2002) or following reconstitution in irradiation chimeras (Surh and Sprent, 2008), it is unclear whether there continue to be significant contributions from the naive pool in the steady state in normal healthy hosts, in the absence of infection. Labelling experiments can be inconclusive in this regard. In early studies, flows into cell populations of interest – for example, entry of recent thymic emigrants into the mature naive T cell pools, or cells moving from the naive pools into memory through antigendriven expansion – were invoked to explain observations that average rates of division and death were estimated to be unequal, despite the populations being apparently stable in size (Mohri et al., 1998, 2001; Bonhoeffer et al., 2000). However, in some cases the nature of these source terms was puzzling. First, the required magnitude of the source in studies of naive T cell turnover vastly exceeded what was expected from the thymus (Asquith et al., 2002; Borghans and de Boer, 2007). Second, sources were also required to be largely unlabelled during label administration (Mohri et al., 2001; Asquith et al., 2002), but memory precursors might be expected to have divided – and thus incorporated the label – shortly before entering the memory pool.
An alternative explanation of these observations reflects heterogeneity within T cell compartments. A key study (Asquith et al., 2002) pointed out that differences in division and death rates inferred from the accrual and loss of label need not derive from influx and instead may arise if the behaviour of labelled (and so recentlydivided) cells does not reflect the population average. Such heterogeneity can be classified into two nonexclusive types; kinetic (Asquith et al., 2002; Macallan et al., 2003; Asquith et al., 2006; Borghans and de Boer, 2007; Vrisekoop et al., 2008; Asquith et al., 2009; Ganusov et al., 2010; Ganusov and De Boer, 2013; De Boer et al., 2012; De Boer and Perelson, 2013; Westera et al., 2013) and temporal (Grossman et al., 1999; Bonhoeffer et al., 2000; Ribeiro et al., 2002; De Boer et al., 2003, 2012; De Boer and Perelson, 2013). A kinetically heterogeneous population comprises two or more subpopulations with different rates of division and/or death, and shortterm labelling experiments will tend to oversample those dividing fastest. Temporal heterogeneity reflects the idea that cells within a single population may display different rates of division or turnover (loss) at different times. For example, quiescent and dividing or recentlydivided cells may be differentially susceptible to death. This form of heterogeneity has been invoked in models of T cell clonal expansion (Bonhoeffer et al., 2000; Ribeiro et al., 2002; De Boer et al., 2003, 2012) and homeostasis (De Boer et al., 2012). Discriminating between kinetic and temporal heterogeneity with DNA labelling alone is challenging (De Boer et al., 2012; De Boer and Perelson, 2013), but doing so has the potential to give us mechanistic insights into T cell homeostasis on different levels. Kinetic heterogeneity likely reflects phenotypic substructure, and suggests the existence of distinct homeostatic or ecological niches if these subpopulations are stably maintained. In contrast, the extent of temporal heterogeneity – that is, how division and death are coupled – provides clues as to how numbers are regulated at the singlecell level.
In short, our understanding of memory T cell homeostasis is limited because the effects of external sources of cells and heterogeneity in population dynamics may mimic or mask one another and it is difficult to distinguish them with conventional approaches. In this study we aimed to disentangle these processes, focusing on memory CD4 T cell subsets in mice. We use a temporal fate mapping method to directly estimate the constitutive rates of flow of cells into different memory CD4 T cell compartments. We then generate finegrained timecourses of DNA labelling combined with measurements of cell cycle status, a strategy that when paired with the independent estimates of memory influxes yields sufficient information to discriminate between alternative models of population dynamics. This combined approach allows us to estimate for the first time the contributions at steady state of de novo production of memory cells and production through division of existing memory cells, as well as yielding insights into the cellular mechanisms regulating memory CD4 T cell subsets in mice.
Results
Naive T cells transition to memory in the steady state and in the absence of deliberate infection
It is an immunological paradigm that activation of naive T cells by foreign antigens ultimately gives rise to persistent populations of memory cells. However, in healthy individuals, not deliberately infected, it is unclear whether generation of memory is an event restricted to first encounter with environmental antigens, such as in the establishment of the T cell compartment in neonates, or whether generation of memory cells occurs constitutively throughout life. Whether there is continual differentiation of naive cells into memory in the steady state has not previously been assessed, and knowledge of this quantity is critical for quantitative analysis of memory homeostasis. To characterise the fluxes into memory subsets, we took advantage of a temporal fate mapping approach described previously (Hogan et al., 2015) that allows visualisation of tonic reconstitution processes within different haematopoetic compartments. Briefly, we condition young adult CD45.1 hosts with the chemotherapeutic drug busulfan that ablates haematopoetic stem cells (HSC) but leaves compartments of committed lineages intact, including thymic and peripheral T cells. Conditioned hosts are then reconstituted with CD45.2 bone marrow (Figure 1A). Total numbers of thymocytes remain normal, and by 6 weeks the CD45.1:CD45.2 ratio equilibrates in all thymic compartments (Hogan et al., 2015). We see no trend in thymic chimerism across treated animals out to a year postBMT (Hogan et al., 2015), indicating that chimerism among T cell precursors is stably maintained. Chimeric mice also exhibit normal numbers of peripheral CD4 naive and CD4 memory T cells (Figure 1B), and both populations display normal levels of proliferation as assessed by Ki67 expression (Figure 1C). Together these data indicate that busulfan treatment and the generation of bone marrow chimerism have no meaningful impact on lymphocyte homeostasis, as previously described (Vezys et al., 2006; Hogan et al., 2015). By 8 weeks postBMT, donorderived cells are readily detectable not only in the naive but also to a striking extent in the CD44^{hi} memory compartment (Figure 1D), revealing that well into adulthood newly generated naive T cells continue to differentiate into memory in clean healthy mice. We observe a steady but ultimately incomplete replacement of the hostderived CD4 memory cells with donor cells over the course of a year (Figure 1E), while the total CD4 memory compartment remains relatively stable in size (Figure 1B).

Figure 1—source data 1
 https://doi.org/10.7554/eLife.23013.004

Figure 1—source data 2
 https://doi.org/10.7554/eLife.23013.005
Measuring the constitutive flows into CD4 T cell memory subsets
Since the continuous generation of new memory T cells was readily detectable, we examined the underlying dynamics more closely, paying particular attention to the feeding of canonically defined memory subsets. Specifically, we modelled the kinetics of replacement of host cells by donor cells within the CD4^{+}CD25^{−}CD44^{hi} CD62L^{hi} and CD4^{+}CD25^{−}CD44^{hi}CD62L^{lo} populations, termed CD4 central memory (CD4 T_{CM}) and CD4 effector memory (CD4 T_{EM}) respectively (Figure 2A), for over a year posttreatment. We previously demonstrated that the kinetics of lymphocyte replacement in the busulfan chimeras are a rich source of information regarding homeostatic turnover and population substructure (Hogan et al., 2015).

Figure 2—source data 1
 https://doi.org/10.7554/eLife.23013.007

Figure 2—source data 2
 https://doi.org/10.7554/eLife.23013.008
Assuming host and donor cells behave similarly, the rate of accumulation of donor cells in each subset is a constant fraction of the total rate of influx of cells from the naive pool, presumably following clonal expansion, and/or through differentiation from other memory subsets. We used simple mathematical models to describe these flows (see Materials and methods). Our choice of models was guided by two key observations. First, the appearance of donor CD4 T_{EM} cells lagged that of both naive and T_{CM} cells (Figure 2C and Figure 2—figure supplement 1), suggesting that CD4 T_{CM} are sourced predominantly from naive precursors while CD4 T_{EM} may be sourced either directly from the naive compartment and/or via CD4 T_{CM}. Second, donor cells displayed a more restricted capacity for populating memory relative to the naive pool (Figure 1E). We considered two explanations of this observation; either that there exist selfrenewing populations of hostderived memory cells that resist displacement by newly recruited cells (the ‘resistant memory’ model), or that the percell rates of entry into each memory subset wane over time (the ‘declining recruitment’ model).
We then assessed the abilities of these models to describe the kinetics of the sizes and host/donor compositions of the CD4 T_{EM} and CD4 T_{CM} pools in healthy, chimeric laboratory mice aged between 14 and 60 weeks. For both memory subsets we fitted each combination of model and source population to the timecourses of the total numbers and donor chimerism of cells recovered from spleen and lymph nodes. The donor chimerism was normalised to that at the early DP1 stage of thymic development in each animal. Doing this controlled for varying degrees of depletion of HSC across animals with busulfan treatment. The size and donor/host composition of the putative source populations (naive for CD4 T_{CM}, and either naive or T_{CM} for CD4 T_{EM}) were not modelled explicitly but instead described by empirical functions fitted to the observations (Figure 2B; Materials and methods). Together these steps allowed us to describe the data from multiple mice with single predictors reflecting the populationaverage parameters (Figure 2C; Materials and methods).
For both models explaining the apparent capping in host memory cell replacement, we compared the variant models in which CD4 T_{EM} was fed either directly from naive or from CD4 T_{CM}. Comparing these fits, we found the strongest statistical support for a dominant naive CD4 $\to $ T_{EM} recruitment pathway over CD4 T_{CM} →T_{EM }(ΔAIC = 11). Although the model fits were visually similar (Figure 2C), the conclusion favouring a naive source derives largely from substantial differences in the quality of the fits during the early stages of infiltration of donor cells into memory, which are relatively datarich and well defined. Thus, naive T cell numbers, and not CD4 T_{CM} numbers, provide the strongest predictor of CD4 T_{EM} accumulation over long timescales.
For CD4 T_{EM} we found comparable statistical support for the resistant memory and declining recruitment models ($\mathrm{\Delta}$AIC = 0.16). For CD4 T_{CM} we found stronger support for the resistant memory model ($\mathrm{\Delta}$AIC = 8.3). We cannot rule out a combination of resistant memory and declining recruitment, and by parsimony we favour the resistant memory model for both populations (fits shown in Figure 2C). We estimate that in 14 weekold mice, 6.3% of CD4 T_{EM} (95% confidence interval 4.4–8.6) and 9.8% (6.5–16.9) of CD4 T_{CM} are displaced per week by new memory cells from the source. The declining recruitment model yielded comparable parameter estimates (Table 1). Indeed, consistent rates of production of new memory cells could be derived simply from the growth rate of chimerism in memory and the difference in chimerism between it and its source, irrespective of the details of the mechanism limiting memory replacement (see Materials and methods).
If this seeding of new memory occurs through recruitment of naive cells followed by clonal expansion and differentiation, one would expect there to be a delay in the transition between source and memory. To explore this we extended the models to allow for lags of 1–7 days before changes in the source population were reflected in changes in the rate of entry into memory. During this period the transitioning cells would likely disappear from the naive and memory T cell populations as we defined them (see Materials and methods), through expression of the IL2 receptor $\alpha $chain, CD25. These extensions yielded rates of replacement that were very similar to the zerolag models, with weaker statistical support, although the timecourses lack the resolution required to examine this transition process in detail.
The models can also be used to predict how the rates of replacement of CD4 T_{EM} and CD4 T_{CM} change with age (Figure 2D), although these predictions derive from relatively uncertain projections of the sizes of the populations beyond a year of age (Figure 2C). We predict that between 14 weeks and 1 year of age, the proportion of cells replaced each week by new memory falls from 6.3% to 1% for CD4 T_{EM} and 9.8% to 6% for CD4 T_{CM}. For CD4 T_{EM} this decline stems from a combination of the fall in naive T cell numbers (the putative source population) with age, and a predicted slow increase in CD4 T_{EM} numbers (Figure 2C). The declining recruitment model predicts a steeper drop in rates of replacement with age, due to the multiplicative effect of the fall in both naive T cell numbers and the per capita rate of recruitment from the naive pool with age (Figure 2D, blue shaded regions). For CD4 T_{CM} the proportional replacement remains relatively steady with age, because the drop in the size of the naive source population is balanced by the predicted slow decline in CD4 T_{CM} numbers.
Finally, we estimate that between 14 weeks and 1 year of age the resistant, numerically stable memory populations make up 16% to 40% of CD4 T_{CM} and 96% to 46% of CD4 T_{EM}, though with some uncertainty (Figure 2—figure supplement 2). Throughout this period approximately 10% of the remaining displaceable CD4 T_{CM} subpopulation is replaced each week. For CD4 T_{EM}, because the resistant population at 14 weeks of age is estimated to be a large proportion of the pool and the source is substantial, we predict that as much 65% of displaceable CD4 T_{EM} are replaced per week. This rate falls to 1.5 %/week in yearold mice as the displaceable population grows and the rate of immigration falls in tandem with naive T cell numbers (Figure 2D, righthand panels).
In summary, we find clear evidence for substantial tonic flows of cells from the naive T cell pool into both CD4 central and effector memory. For central memory we favour a model in which this flow remains high well into the second year of life, but displaces only a subset of cells. The remainder are generated before 8 weeks of age and analogous to the apparently stable ‘incumbent’ populations of naive CD4 and CD8 T cells that also resist replacement (Figure 2B, righthand panel; and Hogan et al. (2015)). We estimate that CD4 effector memory is replaced at a rate comparable to that of central memory in young adult mice, but that the rate of assimilation of new effector memory cells declines more strongly with age. This kinetic can be explained equally well by the existence of a resistant CD4 T_{EM} subset or simply by a waning force of recruitment from the naive pool.
Using Ki67 expression as a molecular clock permits temporal stratification of DNA label uptake
Having identified and measured the contributions to CD4 memory subsets from naive sources, we wanted to measure cell lifetimes and division rates within these subsets in normal healthy mice and to test alternative models of homeostatic dynamics. Resolving different types of heterogeneity in these dynamics requires dissecting the fates of quiescent and dividing or recentlydivided cells. Doing so is difficult with DNA labelling alone because for anything other than very short pulsechase experiments the labelled fraction contains cells with a wide range of times since their last division. We therefore measured the divisionlinked uptake of the nucleoside analogue 5bromo2’deoxyuridine (BrdU) in the context of Ki67 expression. Ki67 is a nuclear protein that is expressed during cell division but subsequently lost by nondividing cells on a timescale of a few days (Pitcher et al., 2002; Younes et al., 2011; De Boer and Perelson, 2013). As such, it is a marker of active and recent division. The frequency of cells expressing Ki67 is expected to be constant in a population at steady state, but when combined with time courses of BrdU labelling, Ki67 acts as a timestamp allowing us to distinguish the fates of recently divided Ki67^{high} BrdU^{+} cells and their quiescent Ki67^{low} BrdU${}^{+}$ progeny (Figure 3A).
We performed three pulsechase experiments in which mice were fed BrdU for either 4, 7 or 21 days, with a chase period of 8–14 days following withdrawal of the label from drinking water. Groups of mice were analysed for costaining of Ki67 and BrdU at different times during these experiments to define the population dynamics of CD4 T_{EM} and CD4 T_{CM} in detail (Figure 3B; for the experimental protocols see Materials and methods M1). Over the relatively short time courses of the experiments we saw no substantial changes in either the absolute sizes of memory T cell subsets or in the fraction of cells expressing Ki67 (Appendix 1—figure 1). With these constraints the dynamics of the system can be characterised by two quantities – the proportions of cells within the Ki67^{high} and Ki67^{low} populations that are BrdU${}^{+}$. In this equilibrium, loss (turnover) of memory is balanced by production of new cells by division and input from external sources.
Modelling BrdU/Ki67 kinetics reveals strong support for kinetic over pure temporal heterogeneity in CD4 T cell memory subsets
To assess the support for different homeostatic mechanisms, we used mathematical models to describe the fluxes of cells between the BrdU^{+/− }× Ki67^{high/low} populations within the CD4 T_{EM} and CD4 T_{CM} subsets (Figure 3C and Materials and methods; detailed in Appendix 1). In a model of pure temporal heterogeneity (TH), each memory subset is assumed to comprise one population of cells undergoing single stochastic divisions characteristic of T cell homeostasis (Yates et al., 2008; Choo et al., 2010; Hogan et al., 2013), but with potentially different rates of loss of quiescent (Ki67^{low}) and recently divided (Ki67^{high}) cells. We also considered a model of pure kinetic heterogeneity (KH) in which each memory subset is assumed to comprise two subpopulations maintained independently, each at constant size and with their own rates of division and loss, and with Ki67^{high} and Ki67^{low} cells within each subpopulation having equal susceptibility to death. In both TH and KH models, any external source is assumed to feed the Ki67^{high} subpopulation(s) exclusively.
We aimed to estimate the rate(s) of division and loss in both models, together with a minimal set of additional parameters representing key biological quantities. In the KH models these included the relative sizes of the two subpopulations and the allocation of the source into each. Both TH and KH models also required parameters quantifying the efficiency of BrdU uptake per cell division and the gradual decline of the BrdU${}^{+}$ fraction once BrdU feeding stops. The latter can result from three nonexclusive processes; (i) differences in the death rates of BrdU^{−} and BrdU^{+} cells, (ii) dilution of the labelled population by unlabelled cells from the source (Tough and Sprent, 1994; Bonhoeffer et al., 2000; Debacq et al., 2002; De Boer et al., 2003), and (iii) withincell dilution of BrdU through division postadministration (Tough and Sprent, 1994; Parretta et al., 2008; Ganusov et al., 2010). The first process is captured in the basic KH/TH model structure. The second requires a description of the dilution of label within the source postadministration. We found the strongest support for a simple model in which the BrdU content of the souce drops rapidly from 100% to zero after a delay that is estimated from the data (see Appendix 1). For the third, we found that the bestfitting models required two divisions to drive cells from BrdU${}^{+}\to $ → BrdU${}^{}$, consistent with another BrdU labelling study in mice (Parretta et al., 2008). Finally, we explored different distributions of times spent in the Ki67^{high} state postmitosis, by assuming cells progress through a variable number of intermediate states before transitioning to Ki67^{low}. Bestfitting models for both KH and TH require more than 12 such states, meaning that there is very little variance in the time cells spend in the Ki67^{high} state. We note that these kinetics and the estimated mean residence time in Ki67^{high} ($1/\beta $) reflect the Ki67 gating strategy as well as the cellintrinsic rate of loss of Ki67 postmitosis. Exploiting the constraints that there were no significant changes in the numbers and the proportions of cells that were Ki67^{high} within both CD4 T_{EM} and T_{CM} during the labelling experiments (see Appendix 1—figure 1), four free parameters remained for the TH model and six for the KH model. A detailed description of the model formulation and the strategy for parameter estimation is given in Appendix 1.
Strikingly, despite this freedom in parameterisation, the data were sufficiently rich to discriminate between the models and showed unequivocal support for kinetic over pure temporal heterogeneity within the CD4 effector and central memory pools (Figure 4, $\mathrm{\Delta}$AIC = 110 (CD4 T_{EM}), 251 (CD4 T_{CM})). For both memory subsets the BrdU/Ki67 timecourses were consistent with the existence of two subpopulations roughly equal in size but with highly distinct kinetics (Table 2 and Figure 5A, at dashed vertical lines). CD4 T_{CM} appear to comprise a population dividing and dying roughly every 3 days, and a slower population with mean lifetime of 38 days, dividing every 170 days, with the source feeding the slow and fast populations in roughly a 2:1 ratio. For CD4 T_{EM} the fast population appears to be essentially selfrenewing, dividing and dying every 6 days, with the slower population fed by the source (mean lifetime 43 days, interdivision time 140 days).

Figure 4—source data 1
 https://doi.org/10.7554/eLife.23013.014

Figure 4—source data 2
 https://doi.org/10.7554/eLife.23013.015

Figure 5—source data 1
 https://doi.org/10.7554/eLife.23013.017
Sensitivity of predictions to the size of memory influx and choice of model
Given the notorious dependence of estimates of lymphocyte division and death rates on model assumptions (De Boer and Perelson, 2013), we explored the sensitivity of our estimates and predictions to the magnitude of the source. We performed fits to the BrdU/Ki67 timecourses for multiple values of the influx spanning values of zero to 30% of the pool size per week, which included the point estimates and their 95% confidence intervals (Figure 5A). Despite the two additional parameters required to describe the source (i.e. its partitioning between the fast and slow subpopulations, and the timing of the switch to unlabelled source after withdrawal of BrdU; see Appendix), including a source gave superior descriptions of both CD4 T_{EM} and T_{CM} labelling kinetics compared to models of selfrenewing memory with no influx ($\mathrm{\Delta}$AIC = 9 and 20, respectively, at the best estimates of the source). The flows into memory impact measures of homeostatic dynamics significantly; if the contribution of the source is neglected, poolaveraged cell lifetimes may be overestimated by 25–50% and, more strikingly, interdivision times underestimated by a factor of 2–3 (Figure 5A).
At our best estimates of the influx into CD4 T_{EM} and T_{CM} from the naive pool, we infer that it predominantly feeds the slower subpopulations within each. Since we presume that memory is largely generated from naive cells through antigendriven proliferation, this result was puzzling. A more restricted model in which the source was constrained to feed exclusively into the faster subpopulation had substantially lower statistical support ($\mathrm{\Delta}$AIC = 18 for CD4 T_{EM}, 9.9 for T_{CM}), but visually the fits were similar (Appendix 1—figure 2; parameter estimates in Appendix 1—table 3). Further, if CD4 T_{EM} derive from T_{CM} to any extent, we predict higher levels of influx (Table 1) and the proportion predicted to enter the slow population is then lower (Figure 5A, upper panels). We therefore remain cautious regarding the extents to which the constitutive influx feeds low and fastdividing memory subsets. Irrespective, at all values of the source we explored, all variants of the KH model were far better descriptions of the kinetics than the TH model ($\mathrm{\Delta}$AIC $>$ 90 for both CD4 T_{EM} and T_{CM}).
Despite the richness of the BrdU/Ki67 timecourse, given the number of unknowns to be estimated it was not possible to fit a single model containing both forms of heterogeneity. However to look for a signature of temporal heterogeneity we explored variants of the KH model in which the loss rates of Ki67^{high} cells were forced to be either a tenth or ten times that of the Ki67^{low} cells in each subpopulation. For CD4 T_{EM} neither extension improved on the basic KH model’s description of the data ($\mathrm{\Delta}$AIC$>$4). For CD4 T_{CM} we found almost equal support for a model in which Ki67^{high} cells died 10 times faster than Ki67^{low} cells and for the basic KH model in which death rates are independent of the level of Ki67 expression. This additional level of temporal heterogeneity increased the estimated mean lifetimes of both fast and slow CD4 T_{CM} subsets but had little impact on estimates of interdivision times (Table 2 and Figure 5—figure supplement 1). We conclude that our data do not provide evidence for substantial differences in the susceptibility to death of recentlydivided and quiescent memory CD4 T cells.
We estimated the mean postmitotic duration of Ki67 expression to be between 3.1 and 3.7 days, consistent with estimates elsewhere (Pitcher et al., 2002; Younes et al., 2011; De Boer and Perelson, 2013). This estimate was modelindependent, insensitive to the magnitude of the influx into memory, and closely comparable for CD4 T_{EM} and T_{CM} (Figure 5B). The KH model predicted that the fast subpopulations express Ki67 at levels of approximately 65% (CD4 T_{EM}) and 85% (T_{CM}), while the slow populations in both are less than 10% Ki67^{high} (Figure 5C). Ki67^{high} CD4 memory cells are therefore predicted to be highly enriched for the fast dividing subset. Notably, the relative sizes of the fast and slow subsets were similar to the split of donor/host cells observed in memory in the busulfan chimeras (Figure 2C). It was then tempting to speculate that the slowlydividing cells were the apparently resistant and stable populations of hostderived CD4 T_{EM} and T_{CM} cells in the busulfan chimeras, while the more rapidly dividing cells represent the influx of donor cells into memory subsets. To test this, we measured Ki67 expression in busulfan chimeras 8 weeks after BMT, when hosts were a comparable age to those used in the BrdU feeding experiments. Although donor cells were indeed slightly enriched for Ki67^{high} cells relative to host cells, both subpopulations exhibited substantial levels of Ki67 expression (Figure 5D) and did not map to the fast/slow populations inferred from the BrdU labelling analysis. These data therefore strongly suggest that both newlyrecruited donor and more established host memory CD4 T cells are kinetically heterogeneous.
In summary, we find strong evidence for rapidly and slowlydividing populations within both effector and central CD4 memory T cells in uninfected adult mice. We find no strong evidence for recent division impacting susceptibility to cell death. Accounting for the constitutive flows of cells into both memory subsets significantly improves the description of BrdU labelling kinetics, and strongly impacts estimates of rates of memory T cell division and turnover.
Discussion
To date, our understanding of how CD4 memory is structured and maintained has been limited by uncertainty in the interpretation of labelling data and lack of knowledge of the extent to which newly differentiated cells contribute to renewal. No single method has been able to successfully distinguish between and quantify these different processes. Here, we were able to both measure tonic influx into memory, and dissect memory compartment dynamics in detail by distinguishing turnover in quiescent and recently divided cells.
Temporal fate mapping in the busulfan chimeras revealed the surprisingly high rate of de novo generation of memory/effector cells in the CD4 memory compartments from naive cells, with at least 6–10% of cells replaced each week in 14 week old mice. Even at the lower bounds, the extent of this new memory generation from naive sources was surprising given that the hosts were in a clean, regulated environment and not deliberately infected. A recent study of feral mice and those in dirty environments revealed the expansion of CD8 T_{EM} compartments resulting from the increased antigenic load (Beura et al., 2016). The authors concluded that expansion was driven by episodic exposure and not constitutive stimuli, as the activation and proliferative status of immune cells were similar to those in cleaner laboratory mice. However, our data strongly indicate the existence of tonic drivers of generation of new memory cells. An obvious mechanism is the continued recruitment of recent thymic emigrants into responses against commensal or environmental antigens. The fact that memory compartments remain remarkably stable in size in the face of this chronic stimulus suggests that these responding cells are regulated differently to those generated in an active infection, perhaps due to the absence of overt inflammatory stimulus. Whether inflammatory stimuli modulate these responses will be the subject of future study.
We also explored the differentiation pathways underlying the flow of cells from naive to different memory compartments over timescales of weeks to months. Previous studies suggest that regulation of CD62L expression by activated CD4 T cells is both heterogenous and slow, compared with CD8 cells (Bjorkdahl et al., 2003; Chao et al., 1997). Loss of CD62L expression is largely irreversible in CD4 T_{EM} (Kassiotis and Stockinger, 2004; Bingaman et al., 2005), suggesting that the CD62Lexpressing CD4 T_{CM} derive directly from activation of naive T cells and not from T_{EM}. Consistent with this we clearly observed more rapid and slightly greater replacement of the CD4 T_{CM} than CD4 T_{EM} compartment in busulfan chimeras. For CD4 T_{EM} the situation is less clear, but CD8 T_{EM} may be generated both directly from activation of naive T cells or by subsequent differentiation of CD8 T_{CM} (Restifo and Gattinoni, 2013). Due to the risk of overfitting it was not possible to quantify the contributions of each of these pathway to CD4 T_{EM} at steady state, and so we considered only the extreme alternatives in which CD4 T_{EM} are sourced entirely from naive or entirely from CD4 T_{CM}. The T_{CM} → T_{EM} model was statistically inferior but gave visually similar fits (Figure 2C), and predicted much higher rates of CD4 T_{EM} replacement ($\sim $23%/week, compared to $\sim $6% for a naive source; Table 1 ). As it seems likely that the CD4 T_{EM} population is fed by both naive and T_{CM} cells to some extents, we conclude that our estimate of 6% is a lower bound and it is possible that nearly a quarter of CD4 T_{EM} are replaced each week under healthy conditions at 14 weeks of age.
Our estimated average lifetimes of lymphnodederived memory CD4 T cells (21d for T_{CM} and 29d for T_{EM}) are slightly higher than those made previously. Other studies of total CD44^{hi} CD4 T cells using BrdU or deuterated water labelling found kinetics consistent with mean lifetimes of 1422d (De Boer and Perelson, 2013; Westera et al., 2013). One of these studies found that a simple model of two selfrenewing, stable populations described the labelling kinetics better than the simplest singlecompartment model with no temporal heterogeneity, and that the fast and slow CD4 memory populations were comparable in size (Westera et al., 2013). Both studies assumed that memory is selfrenewing and constant in size, so mean lifetimes are necessarily equal to average interdivision times. If we make a similar assumption and neglect the memory sources, our estimates of lifetimes increase (40d and 30d for CD4 T_{EM} and T_{CM} respectively). Thus, studies assuming memory is a selfrenewing compartment will tend to overestimate lifetimes and underestimate interdivision times. This issue again highlights the sensitivity of measures of population dynamics to the biology encoded in the model. Our analysis suggests that the rate of recruitment into memory from the naive pool varies with age, and given the relative stability of memory population sizes it is therefore likely that memory turnover is also not constant over the life course. It is possible that the discrepancies between our and other estimates may derive from differences in host age or in commensal colonisation arising in the different housing facilities, both of which may impact the rate of tonic recruitment into memory, the relative sizes of fast and slowly dividing subpopulations, and hence estimates of cell lifetimes and division rates.
Our experimental analyses revealed heterogeneous behaviour amongst memory CD4 T cells at multiple levels. Heterogeneity within the CD4 memory compartment as a whole has been recognised for some time, with a distinction drawn between slowdividing cells driven by cytokines (Seddon et al., 2003; Purton et al., 2007) and in which memory to defined antigens is thought to reside, and fastdividing cells (Tough and Sprent, 1994; Robertson et al., 2006; Purton et al., 2007; Surh and Sprent, 2008; Younes et al., 2011) whose proliferation is dependent on TCR signalling (Min et al., 2003; Seddon et al., 2003; Leignadier et al., 2008; Younes et al., 2011). We infer that Ki67 expression levels in the slowerdividing populations are approximately 9–11% (Figure 5C), consistent with direct observations of antigenspecific CD4 memory (Lenz et al., 2004; Purton et al., 2007; Pepper et al., 2010; Younes et al., 2011). However, the relation of these kinetically distinct populations to the canonical CD4 T_{EM} and T_{CM} subsets delineated by CD62L expression has been unclear. Here, we find evidence that CD4 T_{EM} and T_{CM} subsets comprise both fast and slow subpopulations, suggesting that they are indeed similar in their homeostatic dynamics and structure. The lineage relationships between the respective fast and slow subpopulations of CD4 T_{EM} and T_{CM} therefore need further investigation.
In the absence of infection, it is intuitive that the stimulus driving the continuous recruitment into memory derives from environmental antigens in food and commensal organisms. It also seems intuitive that this stimulus should continue to drive fastdividing memory subpopulations throughout life. Certainly, we find evidence of these within both new (donorderived) and more established (hostderived) memory populations (Figure 5D). However if environmental antigens are the stimulus for tonic recruitment, then it is surprising that newly generated memory cells are not exclusively fastdividing. These observations could be explained if exposure to environmental antigens is subject to natural fluctuations in load, resulting in episodic but frequent stimuli to divide rather than continuous rounds of division. Indeed bursts of TCRdriven proliferation may be involved in the maintenance of CD4 memory to persistent phagosomal infections (Nelson et al., 2013). Such a view would be consistent with the estimates of interdivision times for the fast subpopulations, which are still much longer than the interdivision times of several hours that result from cognate antigen challenge. Episodic fast divisions within both CD4 T_{EM} and T_{CM} could also account for the arguably counterintuitive model prediction that the source predominantly feeds the slowlydividing subpopulations. We also note that the fits yielded by the model of discrete fast and slow populations are good, but not perfect, and it seems likely that there is a richer kinetic substructure (Ganusov et al., 2010). Testing this hypothesis that the composition of fast and slow populations is dynamic, establishing how the influx into memory is routed to these subpopulations, and identifying the lineage relationships between CD4 T_{EM} and T_{CM} at steady state, will require new approaches. What is clear, however, is that whether subdivided by surface phenotype or age structure, kinetically distinct subpopulations are consistently demonstrable within memory CD4 T cells.
Our analysis also provides new insight into the interpretation of Ki67 expression, which is commonly used as a proxy for levels of cell proliferation. There has been a growing awareness that while Ki67 is induced at onset of cell cycle, expression persists following completion of mitosis (Pitcher et al., 2002; Younes et al., 2011; Hogan et al., 2013; De Boer and Perelson, 2013). Here we explicitly model its expression and estimate that cells take approximately 3.5 days to become Ki67^{low}. This figure depends in part on the flow cytometry gating strategy and so is a functional rather than a biochemical measure. However the modelling indicated that the residence time in Ki67^{high} has a low coefficient of variation and so we infer that the postmitotic loss of Ki67 is essentially deterministic, with very little cellcell variation. Since cell division only takes between 2–8 hr (Bruno and Darzynkiewicz, 1992; Hogan et al., 2013), Ki67 is therefore chiefly a postmitotic marker. Its extended expression makes it a sensitive measure for detecting cell division occurring at low absolute frequencies. Knowledge of its lifetime is also useful for isolating cell populations. The fast CD4 T_{CM} and T_{EM} subpopulations divide approximately every 3 and 6 days respectively, while their slower counterparts divide only every 140 days or more. Therefore a substantial fraction of the fast subsets (greater than half for CD4 T_{CM}) will begin to divide again before losing Ki67 expression. Ki67bright CD4 memory cells are therefore highly enriched for the fast dividing subsets, and the BrdU${}^{+}$ Ki67^{low} subset is increasingly rich in slowlydividing cells. These properties can be used as basis for further functional characterisation of these subpopulations.
Taken together, our data reveal complexity in the regulation of memory compartments, in which the substantial and tonic de novo generation of memory cells braids into highly dynamic and heterogeneous subpopulations which themselves exhibit an unexpectedly diverse age structure. Despite this complexity in cell dynamics, the compartment sizes are remarkably stable throughout life, indicating tight homeostatic control. Key questions for the future are whether tonic influxes contribute to the erosion of antigenspecific CD4 T cell memory over time (Homann et al., 2001), whether the tonic recruitment and turnover of memory cells are modulated during the course of an inflammatory, infectious episode, and whether this backdrop of memory cell activity in any way influences T cell activation and development that occurs during such challenges.
Methods and materials
Experimental protocols
Mice
WT CD45.1 and CD45.2 mice were bred and maintained in conventional pathogenfree colonies at either the National Institute for Medical Research (London, UK) or at the Royal Free Campus of University College London. All experiments were performed in accordance with UK Home Office regulations, project license number PPL708310.
Busulfan chimeras
View detailed protocolChimeric mice were generated as described previously in Bioprotocol (Hogan et al., 2017a). Briefly, WT CD45.1 mice aged 8 weeks were treated with 20 mg/kg busulfan (Busilvex, Pierre Fabre) to deplete HSC, and reconstituted with Tcell depleted bone marrow cells from congenic donor WT CD45.2 mice. Chimeras were sacrificed at 6–52 weeks after bone marrow transplantation, and cells from the thymus, spleen and lymph nodes were analysed by flow cytometry.
BrdU timecourses
View detailed protocolBrdU (Sigma) was administered to WT mice by an initial intraperitoneal injection of 0.8 mg BrdU, followed by maintenance of 0.8 mg/mL BrdU in drinking water for the indicated time periods up to 21 days. BrdU in drinking water was refreshed every 2–3 days. Starting times for BrdU treatment were staggered so that all mice in a timecourse experiment were sacrificed on the same day for analysis of lymph node cells by flow cytometry. Ages at sacrifice were in the range 14–16 weeks. The protocol described in more detail at Bioprotocol (Hogan et al., 2017b).
Flow cytometry
Request a detailed protocolCells were stained with the following monoclonal antibodies and cell dyes: CD45.1 FITC, CD45.2 AlexaFluor 700, TCRbeta APC, CD4 PerCPeFluor710, CD25 PE, CD44 APCeFluor780, CD25 eFluor450, CD62L eFluor450 (all eBioscience), TCR$\beta $ PerCPCy5.5, CD5 BV510, CD4 BV650, CD44 BV785 (all BioLegend), CD62L BUV737 (BD Biosciences), LIVE/DEAD nearIR and LIVE/DEAD Blue viability dyes (Invitrogen). BrdU and Ki67 costaining was performed using the FITC BrdU Flow Kit (BD Biosciences) according to the manufacturer’s instructions, along with antiKi67 eFluor660 (eBioscience). Cells were acquired on a BD LSRII or BD LSRFortessa flow cytometer and analysed using Flowjo software (Treestar). Subset gates were as follows: CD4 naive: live TCR$\beta $+ CD5+ CD4+ CD25 CD44 CD62L+. CD4 T_{EM}: live TCR$\beta $+ CD5+ CD4+ CD25 CD44+ CD62L. CD4 T_{CM}: live TCR$\beta $+ CD5+ CD4+ CD25 CD44+ CD62L+.
Modelling the fluxes between naive, central memory and effector memory subsets
Request a detailed protocolWe used a simple framework to describe the kinetics of constitutive renewal of the effector and central memory CD4 compartments. Assume that cells flow into a memory subset $M(t)$ at per capita rate $\gamma $ from a precursor population $S(t)$, and that in the absence of this source, memory is lost to death and/or differentiation at net rate $\lambda $. We place no constraints on the growth or decay of memory so $\lambda $ may be positive or negative. Then if host and donor cells follow identical kinetics,
The rate $\gamma $ is the product of the per capita rate of egress of cells from the precursor population $S$ and the net effect of any expansion and/or contraction that takes place during the transition into memory. We define the memory chimerism to be the fraction of cells that are donorderived,
which differs among agematched animals due to variation in the degree of HSC depletion with busulfan treatment. We normalise the memory chimerism to that in the thymic precursor population DP1, ${\chi}_{\mathrm{DP1}}$, which is stable by approximately 6 weeks postBMT. Equations 1 and 2 can then be recast in forms that do not depend on the degree of HSC depletion and so are applicable across mice in the experimental cohort:
where $M={M}_{\mathrm{host}}+{M}_{\mathrm{donor}}$, and ${\rho}_{M}={\chi}_{\mathrm{M}}/{\chi}_{\mathrm{DP1}}$ and ${\rho}_{\mathrm{S}}={\chi}_{S}/{\chi}_{\mathrm{DP1}}$ are the normalised donor chimerism in the memory and source populations respectively.
To account for the apparent capping of chimerism in the memory subsets, this model can be extended to allow the percell rate of recruitment into memory to vary with the age of the animal, $\gamma (t)$, and/or a population of hostderived memory cells, ${M}_{\mathrm{inc}}$, that resists displacement by newer cells. Combining these extensions yields
where now $M={M}_{\mathrm{host}}+{M}_{\mathrm{donor}}+{M}_{\mathrm{inc}}$. Note that in the text we work with two submodels – one in which there is a resistant population ${M}_{\mathrm{inc}}$ but the per capita rate of recruitment from the source $\gamma ={\gamma}_{0}$ is a constant; and another in which all memory is displaceable (${M}_{\mathrm{inc}}=0$) but that the per capita rate of recruitment from the source wanes with age, $\gamma (t)={\gamma}_{0}\mathrm{exp}(\varphi t)$. Below we show the predictions of the most general model that combines both elements.
We can make a conservative estimate of the flows into memory by assuming that both the effector and central memory pools are fed directly from the naive pool. For each, we fitted the model of the dynamics of total cell numbers and the normalised chimerism within the naive CD4 T cell pool (Equations 5 and 6) to the observations, using empirical functions describing changes in the size and chimerism of the source population with time. The following functional forms described both putative source populations (naive and CD4 T_{CM}) well;
Source population size
Source chimerism
Estimates of the parameters governing these functions are given in Appendix 1—table 1.
To fit the resistant memory and declining recruitment models, we maximised the product of the log likelihoods of the two timecourses, as described in the Supporting Information of Hogan et al. (2015), using a trust region method implemented in Python (Figure 2—source data 2). We estimated the net rate of loss/growth of memory, $\lambda $ and the initial rate of recruitment from the source, ${\gamma}_{0}$; and either (i) ${M}_{\mathrm{inc}}$ for the model of resistant memory with constant per capita rate of recruitment from the source; or (ii) $\varphi $ for the model in which the per capita rate of recruitment from the source itself falls exponentially at rate $\varphi $. Confidence intervals on these parameters were generated by simultaneously bootstrapping residuals 3000 times and resampling from the bootstrap estimates of the parameters governing the sources, $S(t)$ and ${\rho}_{\mathrm{S}}(t)$.
One quantity of interest is $\gamma (t)S(t)/M(t)$, which is the number of new cells entering memory per unit time as a fraction of the memory pool size. Another is the fraction of memory cells replaced through immigration. Because we assumed that recently recruited memory cells are as susceptible to loss as older displaceable memory cells, the number of memory cells expected to be replaced through immigration during a time $(0,t)$ is slightly less than the total influx in the same period. Consider a memory population $M(0)$ that comprises a displaceable population $X(0)$ and an incumbent selfrenewing population ${M}_{\mathrm{inc}}$, $M(0)=X(0)+{M}_{\mathrm{inc}}$. We defined the fractional replacement to be the proportion of the memory pool comprised of immigrants after a time $t$;
where $X(t)=X(0){e}^{\lambda t}$ is the number of displaceable cells present at $t=0$ which survived to time $t$; and $Y(t)$ is the number of cells that entered memory during $(0,t)$ and survived to $t$, which is the solution to $dY/dt=\gamma (t)S(t)\lambda Y(t)$ given $Y(0)=0$. If we assume $\gamma (t)={\gamma}_{0}\mathrm{exp}(\varphi t)$ and the empirical form for the source $S(t)={S}_{0}\mathrm{exp}(Rt)$, this yields
where we define $\psi =R+\varphi \lambda $. In the text we quote both the daily influx $\gamma S/M$ and the expected weekly fractional replacement, ${f}_{\mathrm{r}\mathrm{e}\mathrm{p}\mathrm{l}\mathrm{a}\mathrm{c}\mathrm{e}}(t=7$ days$)$, both at 14 weeks of age, which is 6 weeks postBMT in these animals (Table 1). We also quote replacement as a fraction of the displaceable subpopulation only:
Figure 2D shows how the weekly fractional replacement of both total and displaceable memory is predicted to change with age.
The estimates of daily influx are robust to the details of the model of the capping of memory chimerism. This is because information regarding this parameter is largely contained in the gradient of the donor chimerism in memory $d{\rho}_{\mathrm{M}}/dt$ early in reconstitution, which is welldefined in the data (Figure 2C, lower panels; animals of age c. 100 days). When the chimerism ${\rho}_{\mathrm{M}}$ and/or the rate of change of memory cell numbers in the absence of influx ($\lambda $) are low, then in either model
This expression yields estimates of influx of 2.5% of the pool size per day for CD4 T_{CM} and 1.2% per day for CD4 T_{EM}, assuming both are sourced by naive cells. Both of these estimates lie within the 95% confidence intervals calculated using the bestfitting models (Table 1). Equation 12 also explains why the predicted rates of CD4 T_{EM} replacement are much higher if one assumes that the source is T_{CM} rather than naive; this rate scales inversely with the difference in chimerism between the source and target populations, which is lower for a T_{CM} → T_{EM} pathway than for naive $\to $ T_{EM}.
Modelling BrdU/Ki67 dynamics
Request a detailed protocolThe model is illustrated in Figure 3C, indicating flows between the BrdU${}^{/+}\times $ Ki67^{low/high} populations following first order kinetics with fixed rate constants. To describe the data we made the following extensions to this basic structure:
Figure 3C represents a cell population exhibiting temporal heterogeneity; all cells share a common per capita rate of entry into division ($\alpha $) but quiescent (Ki67^{low}) and dividing or recently divided cells (Ki67^{high}) have potentially different rates of death (${\delta}^{}$ and ${\delta}^{+}$ respectively). Kinetic heterogeneity can be represented by combining two or more instances of this model, with each subpopulation present in unknown proportions and with potentially different rate constants and/or source terms. To minimise the number of parameters, and motivated by our analysis of the pathways of the fluxes into memory, we assumed that there are no significant flows between these subpopulations.
Ki67^{high} cells are shown transitioning to Ki67^{low} with firstorder kinetics at rate $\beta $. Ki67 expression is continuous, however (Figure 3A) and we model its loss postmitosis as a multistep process through intermediate expression levels, giving gammadistributed residence times in the Ki67^{high} compartments with mean $1/\beta $. The variance in the residence time is unknown and we explored it by modelling $\widehat{k}$ intermediate steps between the highest and lowest levels of Ki67 expression (i.e. from immediately postmitosis to quiescence), with a transition rate of $\widehat{k}\beta $ between each of them. Both $\widehat{k}$ and $\beta $ are parameters to be estimated. This distribution of residence times reflects a combination of the kinetics of Ki67 loss postmitosis and the gating strategy used to distinguish Ki67^{low} and Ki67^{high} cells.
For simplicity Figure 3C indicates that during administration all dividing cells are labelled with BrdU, but its efficiency of uptake is a free parameter ($\u03f5$, with $0<\u03f5\le 1$).
Following withdrawal of BrdU, we assumed that label is diluted through division. The number of divisions required for a BrdU${}^{+}$ cell to return to unlabelled status (BrdU${}^{}$) is a free parameter in the model, $\widehat{b}$. Thus we modelled multiple subcompartments within the BrdU${}^{+}$ population. If BrdU uptake is not 100% efficient ($\u03f5<1$), BrdU dilution can also occur during labelling, through division of previously labelled cells without further uptake.
We assumed that any sourcederived cells are Ki67^{high} and BrdU${}^{+}$ during labelling, and that the source switches to BrdU${}^{}$ a time $\tau $ after labelling stops.
With these extensions, the model parameterises the following processes:
$\alpha$ = rate of entry into division resulting in expression of Ki67,
$\delta}^{$ = rate of loss (death or differentiation) for Ki67^{low} cells,
$\delta}^{+$ = rate of loss (death or differentiation) for Ki67^{high} cells,
$\u03f5$ = probability of incorporating BrdU per division during label administration,
$S}^{\pm$ = rate of entry of cells into the K^{+}B^{±} compartments from the source,
$\hat{k}$ = number of Ki67^{high} intermediate compartments,
$1/\beta$ = mean duration of Ki67 expression (i.e., mean total residence time in Ki67^{high} compartments),
$\hat{b}$ = number of divisions required for a BrdU^{+} cell to become BrdU^{−} in the absence of label,
$\tau$ = time for source to become BrdU^{−} following withdrawal of BrdU.
For the basic KH model we set ${\delta}^{+}={\delta}^{}=\delta $ for each subpopulation. We also examined variants of KH in which the death rate of Ki67^{high} cells in each subpopulation was forced be either 1/10 or 10 times the death rate of of Ki67^{low} cells.
Detailed descriptions of the representation of this model as ordinary differential equations and the procedure for parameter estimation are given in Appendix 1.
Acknowledgments
The analyses were supported in part through the computational resources and staff expertise provided by Scientific Computing at the Icahn School of Medicine at Mount Sinai.
Appendix 1

Appendix 1—figure 1—source data 1
 https://doi.org/10.7554/eLife.23013.023
Detailed description of modelling of BrdU/Ki67 timecourses
We define ${B}_{0}$ and ${K}_{0}$ to be the numbers of BrdU^{−} and Ki67^{low} cells respectively; ${B}_{\widehat{b}}$ and ${K}_{\widehat{k}}$ to be the numbers of cells with the highest levels of expression of BrdU and Ki67 respectively; and ${B}_{i}$ ($0\text{}\text{}i\text{}\text{}\hat{b}$) and ${K}_{j}$ ($0\text{}\text{}j\text{}\text{}\hat{k}$) to be populations expressing intermediate levels of BrdU or Ki67, but still classed as BrdU^{+} or Ki67^{high} in terms of our flow cytometry gating strategy. A cell that has successfully incorporated BrdU must therefore undergo $\widehat{b}$ further divisions without further label uptake to become BrdU${}^{}$. Similarly, $\widehat{k}$ is the number of substates through which postmitotic Ki67^{high} cells must transition before becoming Ki67^{low}. Each transition occurs with firstorder kinetics at rate $\widehat{k}\beta $, such that the total time spent in the Ki67^{high} states $\{\widehat{k},\mathrm{\dots},1\}$ is gammadistributed with mean $1/\beta $. When fitting the models we explored multiple values of $\widehat{b}$ and $\widehat{k}$. For all models of heterogeneity and magnitudes of the source, $\widehat{b}=2$ and $\hat{k}\text{}\text{}12$ yielded the lowest AIC values. The former indicates that two divisions without label uptake are sufficient to dilute into the BrdU^{−} gate. The latter indicates that there is a narrow distribution of times spent in Ki67^{high} postmitosis. We then use ${B}_{i}{K}_{j}$ to denote the number of cells simultaneously at the ${i}^{\mathrm{th}}$ level of BrdU expression and the ${j}^{\mathrm{th}}$ level of Ki67 expression, leading to the following definitions:
Dropping the timedependence of the cell populations for brevity, the set of coupled ODEs describing a single population of cells entering division at rate $\alpha $, and with Ki67^{low} and Ki67^{high} cells being lost through death or differentiation at rates ${\delta}^{}$ and ${\delta}^{+}$ respectively, is
Here ${S}^{}$ and ${S}^{+}$ are respectively the rates of entry of unlabelled and labelled cells into memory from the source population, and $\u03f5$ is the efficiency of uptake of BrdU per division.
Initial conditions and population size constraints
All cells are unlabelled initially,
Ki67^{high} cells are assumed to be in a steadystate distribution of stages of loss of Ki67 following mitosis. Empirically, BrdU labelling has no detectable effect on Ki67 expression levels and total numbers of memory cells are constant across the course of the experiments (Appendix 1—figure 1). We therefore assume that the total numbers of cells within the Ki67^{low} and each of the Ki67^{high} states (irrespective of label content) are all constant over time:
where $\kappa $ is the measured and constant proportion of cells that are Ki67^{high} and we have normalised the total population size to 1. As these relations hold for all $t$, setting $t=0$ gives two constraints,
The transitions out of each state (i.e. death, reentry into division or progression to the next, lower, state of Ki67 expression) are assumed to obey first order kinetics, so the size of each Ki67^{high} compartment is simply a constant proportion of the one upstream of it. Specifically,
Equations 15 and 18–20 specify the initial conditions for all compartments. The constraints of constant pool size and constant Ki67^{high} fraction allow us to solve for two of the free parameters. We choose these to be the rate of entry into division $\alpha $ and the Ki67^{low} loss rate ${\delta}^{}$.
Fitting the model
When fitting the delabelling curves, we use the conditions at $t=0$ and propagate the system forward to give the predicted state of the system at the beginning of the delabelling. We then solve and propagate the system forward to give the predicted state of the system at the beginning of the delabelling. We then solve Equations 14 but with no BrdU uptake ($\u03f5=0$) and with specified forms for the timedependence of the labelled and unlabelled source (${S}^{+}(t)$ and ${S}^{}(t)$). Fitting is performed on the timecourses of the two proportions
Modelling the BrdU content of the source
We assume that differentiation from naive to memory is linked to cell division and so cells entering from the source are all Ki67^{high}. We also assume that during labelling the source is entirely BrdU^{+}. During delabelling we expect there to be a shift from labelled to unlabelled source. We explored a ‘delayedswitch’ model in which the shift to a BrdU^{−} source occurs a time $\tau $ postlabelling,
where ${t}_{\text{off}}$ is the time at which the label is withdrawn and $S={S}^{+}+{S}^{}$ is the total magnitude of the source, assumed to be constant over the course of the labelling experiments. We did not consider a similar delay at the onset of labelling while the source switches from BrdU${}^{}$ to BrdU${}^{+}$. We assumed that cells divide during the process of differentiation into memory, which means that any such delay could only be caused by inefficient label uptake and so likely occurs on a timescale shorter than $\tau $. We estimated the efficiency of label uptake to be around 80% for all levels of the source that we explored, in line with other estimates (De Boer and Perelson, 2013), and so by parsimony we did not add an additional parameter to describe the early labelling kinetics in the source. We also considered models of a smooth transition in the postlabelling BrdU content of the source, but these gave poorer descriptions of the data.
Parameter estimation for models of temporal and kinetic heterogeneity
Equations 14 and 22 describe the labelling and delabelling of a single population of cells with two death rates ${\delta}^{}$ and ${\delta}^{+}$, representing temporal heterogeneity. The poolaveraged Ki67^{high} fraction $\kappa $ was determined empirically from the data, and the source $S$ was an input to the model. By eliminating $\alpha $ and ${\delta}^{}$ the model is determined by the unknowns $\beta $, $\u03f5$, ${\delta}^{+}$, $\widehat{k}$, $\widehat{b}$, $\tau $. To fit the models we scanned over sets of the integer values of the numbers of Ki67^{high} and BrdU^{+} compartments ($\widehat{k}$ and $\widehat{b}$), and for each pair we estimated the remaining parameters by fitting Equation 14 to the timecourses of the observables given in Equation 21 . These quantities were logittransformed to normalise residuals. Using the maximum likelihood estimates of the variance of the residuals in each of the timecourses, fitting a model of temporal heterogeneity to the BrdU/Ki67 timecourses therefore required maximising the product of the likelihoods of the two timecourses (See Supporting Information S2 in Hogan et al. (2015) for a description) over four continuous parameters ($\beta $, $\u03f5$, ${\delta}^{+}$, $\tau $) and two discrete ones ($\widehat{k}$, $\widehat{b}$).
To model multiple subpopulations (kinetic heterogeneity, KH) we used replicates of Equations 14. This process increased the number of parameters to be estimated and so we explored a model of two distinct subpopulations only. We therefore had two sets of subpopulationspecific parameters (${\alpha}_{i}$, ${\delta}_{i}^{}$, ${\delta}_{i}^{+}$, ${\kappa}_{i}$, ${S}_{i}$) and the global parameters ($\beta $, $\u03f5$, $\widehat{k}$, $\widehat{b}$, $\tau $). In the simplest KH model we assumed that within each subpopulation Ki67^{low} and Ki67^{high} cells are lost at the same rate; ${\delta}_{i}^{}={\delta}_{i}^{+}\equiv {\delta}_{i}$. Both subpopulations were assumed to be in equilibrium, allowing us to eliminate ${\alpha}_{i}$ and ${\delta}_{i}$ for each. Two further constraints were that the weighted average of the Ki67^{high} fractions within each subpopulation must equal the observed Ki67^{high} fraction in the memory subset, and the weighted average of the influx into each subpopulation must equal the estimated flux of cells into the memory subset.
Consider two kinetically distinct subpopulations, $A$ and $B$, which evolve independently (i.e. there is no significant interconversion between $A$ and $B$). If the overall proportion of cells that are Ki67^{high} is $\kappa $,
where $q$ is the proportion of cells in population $A$. We define $A$ to be the faster subpopulation with the higher Ki67^{high} fraction, so $0\le {\kappa}_{B}\le \kappa \le {\kappa}_{A}\le 1$. In the text (Table 2 and Figure 5 ) we show estimates of the fraction of the total source feeding the slow subpopulation,
In summary, a twopopulation model of kinetic heterogeneity is parameterised by ($\beta $, $\u03f5$, ${\kappa}_{A}$, ${\kappa}_{B}$, $\zeta $, $\tau $, $\widehat{k}$, $\widehat{b}$). The remaining parameters (${\alpha}_{A}$, ${\alpha}_{B}$, ${\delta}_{A}$, ${\delta}_{B}$ , $q$) can be calculated in terms of these unknowns, the overall Ki67^{high} fraction $\kappa $, and the total source $S$. Therefore for each discrete pair ($\widehat{k}$, $\widehat{b}$) we estimated six continuous parameters ($\beta $, $\u03f5$, ${\kappa}_{A}$, ${\kappa}_{B}$, $\zeta $, $\tau $). We generated bootstrap confidence intervals on these parameters by resampling residuals 1500 times and refitting. Uncertainties in the Ki67^{high} fraction $\kappa $ and the source $S$ were propagated into these confidence intervals by simultaneously drawing values of $\kappa $ and $S$ from their empirical (bootstrap) distributions.
References

Lymphocyte kinetics in health and diseaseTrends in Immunology 30:182–189.https://doi.org/10.1016/j.it.2009.01.003

Quantifying lymphocyte kinetics in vivo using carboxyfluorescein diacetate succinimidyl ester (CFSE)Proceedings of the Royal Society B: Biological Sciences 273:1165–1171.https://doi.org/10.1098/rspb.2005.3432

Lymphocyte kinetics: the interpretation of labelling dataTrends in Immunology 23:596–601.https://doi.org/10.1016/S14714906(02)023372

Novel phenotypes and migratory properties distinguish memory CD4 T cell subsets in lymphoid and lung tissueEuropean Journal of Immunology 35:3173–3186.https://doi.org/10.1002/eji.200526004

Quantification of cell turnover kinetics using 5bromo2'deoxyuridineThe Journal of Immunology 164:5049–5054.https://doi.org/10.4049/jimmunol.164.10.5049

Quantification of Tcell dynamics: from telomeres to DNA labelingImmunological Reviews 216:35–47.https://doi.org/10.1111/j.1600065X.2007.00497.x

Mechanisms of Lselectin regulation by activated T cellsJournal of Immunology 159:1686–1694.

Estimating lymphocyte division and death rates from CFSE dataBulletin of Mathematical Biology 68:1011–1031.https://doi.org/10.1007/s1153800690948

Estimating average cellular turnover from 5bromo2'deoxyuridine (BrdU) measurementsProceedings of the Royal Society B: Biological Sciences 270:849–858.https://doi.org/10.1098/rspb.2002.2316

Modelling deuterium labelling of lymphocytes with temporal and/or kinetic heterogeneityJournal of the Royal Society Interface 9:2191–2200.https://doi.org/10.1098/rsif.2012.0149

Quantifying T lymphocyte turnoverJournal of Theoretical Biology 327:45–87.https://doi.org/10.1016/j.jtbi.2012.12.025

A mechanistic model for bromodeoxyuridine dilution naturally explains labelling data of selfrenewing T cell populationsJournal of the Royal Society Interface 10:20120617.https://doi.org/10.1098/rsif.2012.0617

Clonally diverse T cell homeostasis is maintained by a common program of cellcycle controlThe Journal of Immunology 190:3985–3993.https://doi.org/10.4049/jimmunol.1203213

Anatomical heterogeneity of memory CD4+ T cells due to reversible adaptation to the microenvironmentThe Journal of Immunology 173:7292–7298.https://doi.org/10.4049/jimmunol.173.12.7292

Measurement and modeling of human T cell kineticsEuropean Journal of Immunology 33:2316–2326.https://doi.org/10.1002/eji.200323763

Increased turnover of T lymphocytes in HIV1 infection and its reduction by antiretroviral therapyThe Journal of Experimental Medicine 194:1277–1288.https://doi.org/10.1084/jem.194.9.1277

CD4+ T cell persistence and function after infection are maintained by lowlevel peptide:MHC class II presentationThe Journal of Immunology 190:2828–2834.https://doi.org/10.4049/jimmunol.1202183

Development and homeostasis of T cell memory in rhesus macaqueThe Journal of Immunology 168:29–43.https://doi.org/10.4049/jimmunol.168.1.29

Antiviral CD4+ memory T cells are IL15 dependentThe Journal of Experimental Medicine 204:951–961.https://doi.org/10.1084/jem.20061805

Lineage relationship of effector and memory T cellsCurrent Opinion in Immunology 25:556–563.https://doi.org/10.1016/j.coi.2013.09.003

Modeling deuterated glucose labeling of TlymphocytesBulletin of Mathematical Biology 64:385–405.https://doi.org/10.1006/bulm.2001.0282

Not all CD4+ memory T cells are long livedImmunological Reviews 211:49–57.https://doi.org/10.1111/j.01052896.2006.00383.x

Turnover of naive and memoryphenotype T cellsJournal of Experimental Medicine 179:1127–1135.https://doi.org/10.1084/jem.179.4.1127

Continuous recruitment of naive T cells contributes to heterogeneity of antiviral CD8 T cells during persistent infectionThe Journal of Experimental Medicine 203:2263–2269.https://doi.org/10.1084/jem.20060995

Mathematical modeling reveals the biological program regulating lymphopeniainduced proliferationThe Journal of Immunology 180:1414–1422.https://doi.org/10.4049/jimmunol.180.3.1414
Decision letter

Rob de BoerReviewing Editor; University of Utrecht, Netherlands
In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.
Thank you for submitting your article "Memory CD4 T cell subsets in mice are kinetically heterogeneous and replenished from naive T cells at high levels" for consideration by eLife. Your article has been favorably evaluated by Michel Nussenzweig as the Senior Editor, Rob de Boer as the Reviewing Editor and Reviewer #1, and two peer reviewers: Jose Borghans (Reviewer #2) and Ruy Ribeiro (Reviewer #3).
The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.
Summary:
The main novelty of the study is to include ablation and reconstitution of the hematopoietic stem cell compartment, which allows for the measurement of flow of "new" cells into the memory compartment, i.e. to quantify the source of cells into these compartments. The maintenance of memory T cell populations in nonimmunized mice is shown to depend strongly on a tonic influx of naive T cells. In 14 weekold mice 510% of the memory T cells are replaced per week by cells from the naive compartment. Both the effectormemory (TEM) and the central memory (CM) T cell compartments consist of at least two subpopulations that are either longlived (half a year) or shortlived (less than a week).
Important revisions:￼￼
1) It would be helpful to add more (possible) interpretations of the results. For instance, it could be emphasized more that these are "clean" laboratory mice with few memory T cells. The nature of the memory pools in unchallenged mice has always been elusive. If these are cells responding to environmental and food antigens, it becomes much more natural that for such cells there is a tonic flow from naive to memory because these are "persisting" antigens that continue to activate novel naive T cells. The group of Rafi Ahmed (Choo JI 2010) convincingly demonstrate that memory T cells generated during antiviral immune responses are relatively longlived, and these cells are maintained in the absence of a flow from naive to memory (because the antigen is not persistent). Summarizing, it would be good to emphasize that this tonic flow could be related to persisting antigens only, and hence be valid for a subset of the memories only.
2) A second example is the fact that about 50% of the population is incumbent in both the CM and EM populations (which I first found to be very surprising). However, if we turn things around, and argue that there are incumbent memory T cell clonotypes (that are slow and specific for nonpersisting antigens, like Rafi's memory cells), and more activated memory cells (maybe specific for persisting antigens) with a major input from novel naive T cells activated by these antigens, then we only have to argue that each of these two pools is segregated into CM and EM cells. It is then much less coincidental that both CM and EM have about 50% incumbent cells.
3) It would be good to make a better connection between the incumbent cells and the slow subcompartments in the CM and EM pools. Do you think they are the same (see my reasoning above, arguing that they could be)? How do you think the two subpopulations defined in the paragraph about Ki67 and BrdU relate to the incumbent and replaceable populations of the first half of the manuscript? It is somewhat puzzling is that the cells resistant to displacement are those turning over faster. Do you have any more insight what could be defining this population? How can it be created before 6(?) weeks and then maintained more or less indefinitely?
4) One of the most surprising findings is that central memory and effector memory CD4^{+} Tcells have very similar kinetics. However, this is not discussed appropriately. Did you expect this? Is it not surprising? Are these two subsets maintained by similar processes / mechanisms? Are there really two distinct subsets (I understand the surface markers difference…)?
5) The method of busulfan treatment that is used is said to "leave compartments of committed lineages intact", but Figure 1F shows that the memory pool shortly after BMT is clearly smaller than a few weeks postBMT. Have the authors also counted cell numbers before busulfan treatment? Is the increase in memory cell numbers and the decline in naive cell numbers completely caused by aging, or could these changes partially reflect (side) effects of busulfan treatment on the peripheral compartments? It is also not clear if the level of DP1 chimerism is changing in time or not. I infer from the text that it is not after a certain time point, but it would be worth showing this in a figure, since this is used to normalize all the data.
6) According to the authors, the model analysis of Figure 2 provides "strong support" for the option that new TEM are recruited directly from the naive compartment rather than from TCM. I find this interesting, but surprising for two reasons. Firstly, by eye the fits of the two models do not look very different and it is even hard to judge which of the models is describing the data better, especially because cell number data tend to be quite noisy. Secondly, the model in which TEM are sourced by the naive pool rather than by TCM contradicts quite some literature concluding that TEM are sourced by TCM (as nicely reviewed by Restifo et al. 2013). The authors should at least discuss what could explain this difference.
7) The most difficult part is to understand the results of Figure 2D.
It remains unclear to me why the changes in% replaced with age differ so much between TCM and TEM. Since the changes in chimerism with age (Figure 2C) do not differ much between both subsets, I guess it must be the large difference in changes in cell numbers with age that is driving this. It would be very helpful if the authors could explain this in more detail/ more intuitively.
In the same panels, I find it confusing that the "%Total pool replaced" is so similar to the "%Displaceable replaced" for TCM but not for TEM.
The results of Figure 2—figure supplement 1 also confuse me. According to these predictions the TEM pool would consist of nearly 100% incumbent cells at age 100 days. Is that a direct reflection of the low chimerism at day 100 reported in Figure 2C? Is the slow increase of the chimerism with age not due to the time it takes for the replaceable cells to be replaced?
The authors conclude that the rate of recruitment into memory from the naive pool varies with age. Can one safely conclude that, or should one in fact perform busulfan treatment at higher ages to find this out?
8) The authors prefer a model with two kinetic populations, although they say that likely there are even more kinetically differentiated populations, but the study does not have power to probe these. One alternative model is to have just one population with a distribution of turnover rates, as proposed in Ganusov et al. PLoS Comp BIol 2010. This model has the same (or approximately the same) number of parameters and perhaps could offer a more biological and parsimonious explanation of the current data.
9) It would be helpful to have an intuitive explanation for the reason the temporal heterogeneity model is not fitting the data well in Figure 4. It would be important to provide some insight into why the temporal heterogeneity model does not work. Currently, when can see that the fits are poorer (both in Figure 4 and by AIC), but do you have any understanding why this is the case from studying the model. In particular, it is a little strange that the fits are so tight, but so poor.
10) It would be interesting to show what the prediction of the model for the fraction of chimerism in the slow and fast turning over populations is. Do you have data on this that you could compare to the model predictions?
11) The modeling methods would benefit from a little more detail in some parts. For instance, in the subsection “M2 Modelling the fluxes between naive, central memory and effector memory subsets” what do you mean by "using exponentialsmoother functions", or what is your assumption for γ(t) – you say that you estimate γ, but here the model presented has a γ(t). It is not clear how you obtain equations M2.7 and M2.8. In the last paragraph of the aforementioned subsection, why is 100 days of age special?
12) Equations A1 are hard to follow. You define B^{}K^{} and B^{}K^{+} but these are not used in the equations. Are these not important here? This nomenclature then reappears in equations A2 and after. What is S_{G} in A9? The last paragraph of the subsection “Parameter estimation for models of temporal and kinetic Heterogeneity” is not completely clear. What do you mean "using a value of the total magnitude of the source chosen randomly from its bootstrap distribution"?
https://doi.org/10.7554/eLife.23013.027Author response
Important revisions:
1) It would be helpful to add more (possible) interpretations of the results. For instance, it could be emphasized more that these are "clean" laboratory mice with few memory T cells. The nature of the memory pools in unchallenged mice has always been elusive. If these are cells responding to environmental and food antigens, it becomes much more natural that for such cells there is a tonic flow from naive to memory because these are "persisting" antigens that continue to activate novel naive T cells. The group of Rafi Ahmed (Choo JI 2010) convincingly demonstrate that memory T cells generated during antiviral immune responses are relatively longlived, and these cells are maintained in the absence of a flow from naive to memory (because the antigen is not persistent). Summarizing, it would be good to emphasize that this tonic flow could be related to persisting antigens only, and hence be valid for a subset of the memories only.
We agree. Though we did allude to this in the Discussion; we now bring it out more in the second paragraph. We would also argue that much of our understanding of memory turnover (including that deriving from Rafi’s studies) relates to CD8 and not CD4 T cells – and one shouldn’t assume they are similar.
2) A second example is the fact that about 50% of the population is incumbent in both the CM and EM populations (which I first found to be very surprising). However, if we turn things around, and argue that there are incumbent memory T cell clonotypes (that are slow and specific for nonpersisting antigens, like Rafi's memory cells), and more activated memory cells (maybe specific for persisting antigens) with a major input from novel naive T cells activated by these antigens, then we only have to argue that each of these two pools is segregated into CM and EM cells. It is then much less coincidental that both CM and EM have about 50% incumbent cells.
Yes, this is a nice observation – although we are now showing data (see next point) that suggests that the incumbents are not exclusively slow cells. But basically, yes – one could infer simply that resistant memory has a similar EM/CM composition to that of displaceable memory.
3) It would be good to make a better connection between the incumbent cells and the slow subcompartments in the CM and EM pools. Do you think they are the same (see my reasoning above, arguing that they could be)? How do you think the two subpopulations defined in the paragraph about Ki67 and BrdU relate to the incumbent and replaceable populations of the first half of the manuscript?
This is a good suggestion and we have added some data to make a stronger connection between the two elements. Accumulating sufficient agematched chimeras to perform a detailed BrdU/Ki67 analysis split over host and donor is currently beyond us (we’re working on it, and it’s for a further study). However, we now include a figure showing Ki67 expression split by donor and host and CD4 EM/CM in chimeras of similar ages to those used in the BrdU analysis (~14 weeks) – see new panel in Figure 5.
It is clear that a larger proportion of donor cells express Ki67 than host. Yet the differences are not as extreme as the fast/slow split we infer from the BrdU analysis – so fast/slow does not simply map to donor/host, and both are likely heterogeneous. So, if chronic stimuli are responsible for driving relatively rapid turnover, and transient stimuli elicit slow dividing memory, perhaps to infection as you suggest, then we see evidence for the both amongst new (donor) and more established (host, possibly incumbent) populations.
It is somewhat puzzling is that the cells resistant to displacement are those turning over faster. Do you have any more insight what could be defining this population? How can it be created before 6(?) weeks and then maintained more or less indefinitely?
We did not connect the nonreplaced (host) cells in the first part of the analysis to either the fast or slow populations that emerged from the BrdU analysis. Indeed with the new data we now show that host memory cells appear to be slightly enriched for slower cells compared to donor.
Regarding the assumption of longterm stability – it comes from parsimony and resolving power. It was simply not possible to detect any significant growth or decay of this population. We observed the same issue with naive cells in our earlier study. All we are saying is that the attainment of steady peripheral chimerism and steady memory cell numbers is consistent with a model of memory homeostasis that includes a numerically stable, incumbent subset generated preBMT.
4) One of the most surprising findings is that central memory and effector memory CD4^{+} Tcells have very similar kinetics. However, this is not discussed appropriately. Did you expect this? Is it not surprising? Are these two subsets maintained by similar processes / mechanisms? Are there really two distinct subsets (I understand the surface markers difference…)?
We agree this is surprising, and yes, we think it suggests that in CD4 memory these populations are not as distinct as dogma (arguably driven more by CD8 studies) would have it. We conclude that the CD4 EM/CM split on the basis of Lselectin expression alone doesn’t identify kinetically uniform populations, suggesting that these subsets are also functionally diverse. This diversity, and the EM/CM lineage relationships in CD4 memory, therefore need further analysis. We’ve added text to the Discussion on this point.
5) The method of busulfan treatment that is used is said to "leave compartments of committed lineages intact", but Figure 1F shows that the memory pool shortly after BMT is clearly smaller than a few weeks postBMT. Have the authors also counted cell numbers before busulfan treatment? Is the increase in memory cell numbers and the decline in naive cell numbers completely caused by aging, or could these changes partially reflect (side) effects of busulfan treatment on the peripheral compartments? It is also not clear if the level of DP1 chimerism is changing in time or not. I infer from the text that it is not after a certain time point, but it would be worth showing this in a figure, since this is used to normalize all the data.
Yes, it is important to clarify these control issues. We’ve now reworked Figure 1to show that peripheral compartment sizes across age look normal in chimeras.
Regarding the longterm stability of DP1 chimerism; since sampling is destructive this is hard to test directly, but in Figure 1 in Hogan PNAS 2015 we showed (i) chimerism stabilised within the thymus by 6 weeks postBMT, (ii) no evidence for a consistent trend in DP1 chimerism across animals out to 52 weeks postBMT, and (iii) there was no impact of treatment on total thymocyte numbers. We now describe and reference those data.
6) According to the authors, the model analysis of Figure 2 provides "strong support" for the option that new TEM are recruited directly from the naive compartment rather than from TCM. I find this interesting, but surprising for two reasons. Firstly, by eye the fits of the two models do not look very different and it is even hard to judge which of the models is describing the data better, especially because cell number data tend to be quite noisy. Secondly, the model in which TEM are sourced by the naive pool rather than by TCM contradicts quite some literature concluding that TEM are sourced by TCM (as nicely reviewed by Restifo et al. 2013). The authors should at least discuss what could explain this difference.
This is a fair point and it’s very useful to clarify this. Note that we did include a section in the Discussion stating that EM are likely sourced by both naive and CM, but that we lack the power to fit a combined model. In response to your comment we’ve removed the statement “strong support” and added the Restifo citation in the Discussion (although it deals predominantly with CD8 and not CD4). We also extended the description of the model discrimination in the Results. Essentially, assessing the fits by eye can be misleading, because the much of the information comes from the upslope in EM chimerism, where there is very little spread in the data (fitting of these fractions was performed on a logit scale to normalise the errors). The naive source model clearly describes these observations better than a CM source.
7) The most difficult part is to understand the results of Figure 2D.
It remains unclear to me why the changes in% replaced with age differ so much between TCM and TEM. Since the changes in chimerism with age (Figure 2C) do not differ much between both subsets, I guess it must be the large difference in changes in cell numbers with age that is driving this. It would be very helpful if the authors could explain this in more detail/ more intuitively.
We agree that the analysis of the source required more intuitive explanations, and we have revised appropriately in multiple places. You’re right – this effect is due to different trends in cell numbers with age.
In the same panels, I find it confusing that the "%Total pool replaced" is so similar to the "%Displaceable replaced" for TCM but not for TEM.
This is due to EM/CM differences in the estimated sizes of the incumbent populations, although note that these come with considerable confidence intervals (Figure 2—figure supplement 1). For EM, the point estimate of the incumbent population size as a proportion of the pool is initially very high; so that daily replacement as a fraction of the total pool is low, but is close to 100% of the small displaceable subset. For CM, the incumbent fraction is small and so% total pool replaced and% displaceable replaced are more similar.
We’ve added a line to make this clearer.
The results of Figure 2—figure supplement 1 also confuse me. According to these predictions the TEM pool would consist of nearly 100% incumbent cells at age 100 days. Is that a direct reflection of the low chimerism at day 100 reported in Figure 2C?
Not exactly – the estimate of close to 100% incumbents at 100d arises from a combination of three factors: (i) the fact that the EM pool grows with age, (ii) the assumption that incumbents are stable in numbers, and (iii) donor cells are entering EM at a significant rate – reflected by the high chimerism in the source – yet the EM chimerism remains relatively low. Together these mean that at early timepoints the displaceable EM population must be relatively small.
Is the slow increase of the chimerism with age not due to the time it takes for the replaceable cells to be replaced?
No – we infer that the displaceable cells are replaced quickly. The slow shift in chimerism is due to the slow net growth of the donorrich displaceable populations, while the host incumbent cells remain stable in number.
The authors conclude that the rate of recruitment into memory from the naive pool varies with age. Can one safely conclude that, or should one in fact perform busulfan treatment at higher ages to find this out?
This is a great point and we are planning experiments with older chimeras – though these data will not be available for several months. This is the next study.
Basically, yes – in the resistant memory model, we predict that rate of influx in terms of absolute #s of cells per unit time declines in tandem with naive T cell numbers.
Our core result relates to the magnitude of the source at around 14 weeks of age. The data are conclusive on this point, since the upslopes in chimerism at that age are very clearly defined. The relative sparsity of data later on and in particular, uncertainty in the trends in the sizes of the EM and CM pools – mean that the predictions in Figure 2D are more speculative, as reflected in the confidence intervals.
8) The authors prefer a model with two kinetic populations, although they say that likely there are even more kinetically differentiated populations, but the study does not have power to probe these. One alternative model is to have just one population with a distribution of turnover rates, as proposed in Ganusov et al. PLoS Comp BIol 2010. This model has the same (or approximately the same) number of parameters and perhaps could offer a more biological and parsimonious explanation of the current data.
We like that model and did indeed consider it, but faced the issue of parameterising how the source is then distributed continuously across the distribution of subpopulations, which substantially increases the number of parameters. We acknowledge that there is likely richer substructure, maybe even dynamic, and have extended the discussion on this point (and also include Vitaly’s ref.). But we believe our analysis captures the key issue that there is kinetic heterogeneity at multiple levels within CD4 memory subsets, and that one model of pure TH is ruled out.
9) It would be helpful to have an intuitive explanation for the reason the temporal heterogeneity model is not fitting the data well in Figure 4. It would be important to provide some insight into why the temporal heterogeneity model does not work. Currently, when can see that the fits are poorer (both in Figure 4 and by AIC), but do you have any understanding why this is the case from studying the model.
Yes, this is important, and we were puzzled too. Essentially we believe the answer is that in the TH model, the kinetic of accumulation of the BrdU^{+}Ki67^{} population is heavily influenced by that of their BrdU^{+}Ki67^{+} precursors – there is both a simple proportional flow from K^{+} to K^{}, and the empirical constraint of the global Ki67 fraction tightly couples the K^{+} and K^{} populations. There is also a tight constraint on the Ki67 lifetime, defined by the obvious delay before BrdU^{+}Ki67^{} cells first appear. There is therefore very little wiggle room with which to fit both the time courses well. In the KH model, we allow the kinetics of the B^{+}K^{} and B^{+}K^{+} to be more decoupled, since they are enriched for the slow and fast populations respectively, and the two interact only weakly through the constraint of the total Ki67 fraction being constant.
We’ve tried to paraphrase this in the caption to Figure 4.
In particular, it is a little strange that the fits are so tight, but so poor.
This is an interesting point and is an artefact of bootstrapping residuals (because we’re working with time series) and not the data themselves. The empirical bootstrap distributions of parameters are used to generate the confidence envelopes on the fits; but strictly this procedure is only precisely valid if the underlying model is correct. An illustration is in Author response image 1: generate a noisy sine wave and fit a straight line to it. Then resample residuals and generate a confidence envelope – which is clearly not very useful.
If one were to use the ‘true’ bootstrapping of the observations themselves, these envelopes would be larger, and would give a truer reflection of the sensitivity of parameter estimates to noise in the data. This is what the envelopes in the KH fits show more meaningfully, since it is clearly the better model.
10) It would be interesting to show what the prediction of the model for the fraction of chimerism in the slow and fast turning over populations is. Do you have data on this that you could compare to the model predictions?
We’re not connecting the fast/slow compartments to host/donor, or modelling them as such. However, we’ve included the breakdown of host/donor Ki67 expression (Figure 5D) to show that both host and donor cells contain fast and slow populations.
11) The modeling methods would benefit from a little more detail in some parts. For instance, in the subsection “M2 Modelling the fluxes between naive, central memory and effector memory subsets” what do you mean by "using exponentialsmoother functions", or what is your assumption for γ(t) – you say that you estimate γ, but here the model presented has a γ(t). It is not clear how you obtain equations M2.7 and M2.8. In the last paragraph of the aforementioned subsection, why is 100 days of age special?
We’ve addressed these points in a revised and expanded Methods, and have included the parameter estimates in an Appendix. Quoting 100 days of age without context was misleading – this just happens to be the age of the animals where the early upslope in peripheral chimerism is apparent, and clearly defined – and so is the age at which we have most confidence in the source term.
12) Equations A1 are hard to follow. You define B^{}K^{} and B^{}K^{+} but these are not used in the equations. Are these not important here? This nomenclature then reappears in equations A2 and after. What is S_{G} in A9?
Yes, thank you – old text had crept into the Methods and so notation was inconsistent. We’ve overhauled this section and cleaned up the notation. S_{G} was simply the total magnitude of the source. Now defined as “S” for simplicity.
The last paragraph of the subsection “Parameter estimation for models of temporal and kinetic Heterogeneity” is not completely clear. What do you mean "using a value of the total magnitude of the source chosen randomly from its bootstrap distribution"?
We tried to clarify this. We are describing how we propagate multiple sources of uncertainty into the confidence intervals on the parameters inferred from the BrdU timecourses.
https://doi.org/10.7554/eLife.23013.028Article and author information
Author details
Funding
National Institutes of Health (R01 AI093870)
 Andrew J Yates
Arthritis Research UK
 Andrew J Yates
Medical Research Council (MCPC13055)
 Thea Hogan
 Benedict Seddon
National Science Foundation (1548123)
 Graeme Gossel
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics
Animal experimentation: All experiments were performed in accordance with UK Home Office regulations, project license number PPL708310.
Reviewing Editor
 Rob de Boer, University of Utrecht, Netherlands
Version history
 Received: November 5, 2016
 Accepted: March 4, 2017
 Accepted Manuscript published: March 10, 2017 (version 1)
 Version of Record published: May 11, 2017 (version 2)
 Version of Record updated: February 8, 2018 (version 3)
Copyright
© 2017, Gossel et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 5,046
 Page views

 952
 Downloads

 46
 Citations
Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading

 Computational and Systems Biology
 Immunology and Inflammation
Mathematical modeling reveals that longterm immunological memory is maintained in a manner that is even more dynamic than previously thought.

 Computational and Systems Biology
 Neuroscience
Cerebellar climbing fibers convey diverse signals, but how they are organized in the compartmental structure of the cerebellar cortex during learning remains largely unclear. We analyzed a large amount of coordinatelocalized twophoton imaging data from cerebellar Crus II in mice undergoing ‘Go/Nogo’ reinforcement learning. Tensor component analysis revealed that a majority of climbing fiber inputs to Purkinje cells were reduced to only four functional components, corresponding to accurate timing control of motor initiation related to a Go cue, cognitive errorbased learning, reward processing, and inhibition of erroneous behaviors after a Nogo cue. Changes in neural activities during learning of the first two components were correlated with corresponding changes in timing control and error learning across animals, indirectly suggesting causal relationships. Spatial distribution of these components coincided well with boundaries of AldolaseC/zebrin II expression in Purkinje cells, whereas several components are mixed in single neurons. Synchronization within individual components was bidirectionally regulated according to specific task contexts and learning stages. These findings suggest that, in close collaborations with other brain regions including the inferior olive nucleus, the cerebellum, based on anatomical compartments, reduces dimensions of the learning space by dynamically organizing multiple functional components, a feature that may inspire newgeneration AI designs.