Abstract
Affinity maturation is a complex dynamical process allowing the immune system to generate antibodies capable of recognizing antigens. We introduce a model for the evolution of the distribution of affinities across the antibody population in germinal centers. The model is amenable to detailed mathematical analysis and gives insight on the mechanisms through which antigen availability controls the rate of maturation and the expansion of the antibody population. It is also capable, upon maximumlikelihood inference of the parameters, to reproduce accurately the distributions of affinities of IgGsecreting cells we measure in mice immunized against Tetanus Toxoid under largely varying conditions (antigen dosage, delay between injections). Both model and experiments show that the average population affinity depends nonmonotonically on the antigen dosage. We show that combining quantitative modeling and statistical inference is a concrete way to investigate biological processes underlying affinity maturation (such as selection permissiveness), hardly accessible through measurements.
Introduction
Vaccines are undoubtedly one of the most effective preventive procedure ever developed and have even been used to eradicate diseases (Greenwood, 2014; Nanni et al., 2017). In many cases, vaccinemediated protection can be directly linked to the generation of an antigenspecific antibody repertoire (Nakaya et al., 2015; Li et al., 2014), such as for tetanus toxoid (TT) vaccination (WHO, 2017; Ershler et al., 1982). The repertoire, a term detailing the present antibody variants within an organism, is adapted upon vaccination to include vaccinespecific clones (Lavinder et al., 2014; Lee et al., 2017). The processes that shape and expand this repertoire upon vaccination are highly complex and dynamic and are strongly linked to affinity maturation (AM) (Keck et al., 2016; Tas et al., 2016; Allen et al., 2007a). AM entails a series of mechanisms through which the immune system is able to produce potent highaffinity and antigenspecific antibodies (Abs) (Victora and Nussenzweig, 2012; De Silva and Klein, 2015; Bannard and Cyster, 2017; Mesin et al., 2016; Eisen, 2014; Victora and Mesin, 2014). Briefly speaking, AM is achieved through the combination of random mutations and selection for Antigen (Ag) binding. AM takes place in microanatomical structures, known as germinal centers (GCs). GCs are initially seeded by Blymphocytes from the naive repertoire with sufficient affinity to bind the Ag. This initial affinity is achieved thanks to the great diversity of the immune repertoire, generated by processes such as VDJ recombination (Elhanati et al., 2015). Bcells in GCs iteratively migrate through two areas, called the GC light and dark zones (LZ/DZ). In DZ, cells duplicate and are subject to a high mutation rate through a process known as Somatic Hypermutation (SHM). Cells then migrate out of DZ to LZ, where they are selected for Ag binding through a process involving interaction with follicular Thelper cells. Selected cells migrate then back to DZ for further duplications. This combination of random mutations and selection for Ag binding constitute a Darwinian evolutionary process, which progressively enhances the affinity of the Bcell population for the Ag.
In practice, AM is induced through administration of some dose of attenuated Ag, often mixed with adjuvants and other additives that have both immunestimulatory effect and facilitate retention of Ag for longer periods of time (Asensio et al., 2019; HogenEsch et al., 2018; Awate et al., 2013; Coffman et al., 2010). Whilst the adjuvant and additives define the nature of the immune response (Coffman et al., 2010), Ag dose is a major variable in AM (Eisen, 2014; Foote and Eisen, 1995; Kang et al., 2015). Highaffinity cells are discriminated and selected based on their capacity to bind Ag, and the amount of available Ag therefore tunes the strength of the applied Darwinian selection, that is defining the selection pressure (Kang et al., 2015; Baer et al., 1954; Tam et al., 2016). For example in reference (Kang et al., 2015), based on measurements of Abs affinity in rabbit sera following hapten immunization (Eisen and Siskind, 1964), the authors observed that average affinity decreased and heterogeneity increased with Ag dosage, suggesting that the latter was controlling the strength of selection: low and high dosages corresponded to, respectively, strong and weak selections (Goidl et al., 1968; Nussenzweig and Benacerraf, 1967; Tam et al., 2016). However, experimental evidence exists suggesting that Ag dosage has also a nontrivial effect on the efficacy of affinity maturation. This selection will be applied in the highly complex and dynamic environment of the immune response and the doseresponse curve for some vaccines is not a saturating function of the Ag dose (Rhodes et al., 2019). Experiments showed that there was an intermediate range of concentrations for optimal stimulation of the immune system, leading the authors to advocate the development of datainformed models to guide the vaccine dose decisionmaking process, for example in the cases of tuberculosis, malaria, HIV (Rhodes et al., 2019). Models for AM were proposed to investigate this aspect and to help developing protocols in the field of vaccine design. Examples include the study of optimal immunization strategies against highly mutable pathogens such as HIV (Shaffer et al., 2016; Wang, 2017; Wang et al., 2015) and the influence of Ag administration kinetic on the humoral response (Tam et al., 2016); a review of Germinal Center Reaction models and their ingredients can be found in Buchauer and Wardemann, 2019.
A second open issue concerning AM is to characterize in a quantitative way the selection acting in the GC, in particular how permissive it is (Bannard and Cyster, 2017; Mesin et al., 2016; Victora and Mouquet, 2018; Inoue et al., 2018). Through mechanisms such as bystander activation (Bernasconi, 2002; Eyer et al., 2020; Eyer et al., 2017) GC selection can indeed allow intermediate and lowaffinity clones to survive (Tas et al., 2016). These phenomena generate a wider diversity than previously appreciated, especially when considering complex Ags displaying different epitopes (Kuraoka et al., 2016). In Finney et al., 2018 for example the authors try to characterize the GC response to complex Ags such as influenza vaccine, as opposed to simple ones such as haptens. While in the latter case, a strong homogenizing selection and affinity maturation is observed, for complex Ags response is more polyclonal and a consistent part of the GC population (20–30%) is composed of lowaffinity clones. This suggests a more permissive nature of the GC selection, in which even lowaffinity clones have a nonzero probability of passing the selection. Permissiveness could for example be useful against mutable pathogens, where maintaining a pool of general crossreactive cells might be a better strategy than only selecting for the best strainspecific binders.
In this paper, we tackle the question of how the Ag dosage and the time delay between subsequent vaccine injections can influence the quality of immunization, measured as the Ag affinity of the Bcell population that respond to a further antigenic challenge. Thanks to the technique developed in Eyer et al., 2017 we were able to access full experimental affinity distribution of splenic Absecreting cells (AbSCs) extracted from mice following TT immunization. These distributions constitute a much more detailed information than other affinity measurement, such as average serum affinity, which only summarize them in a single number that is often related to their average. We introduce a computational model, inspired by previous work (Wang et al., 2015), that is capable of reproducing these distribution under different immunization schemes, in which both the Ag dosage and the delay between injections can be varied. We aim at studying the mechanisms underlying the observed optimality of Ab affinity at intermediate dosages through detailed mathematical analysis of the model. In addition to this, our aim is to probe how restrictive GC selection is in our particular immunization protocol, and therefore we include in the model some parameters that encode for permissiveness and stochasticity. We use inference techniques to find the most likely value of the parameters given the observed data. This allow us to have information on quantities that are not directly measurable in experiments.
Results
Stochastic model for affinity maturation
We model the stochastic evolution of the distribution of binding energies of a population of Bcells during the affinity maturation (AM) process. A virtual population of Bcells in the GC is subject to iterative rounds of duplication, mutation and selection, see Figure 1 (Wang et al., 2015). Each Bcell in our model is characterized by the binding energy $\u03f5$ between its receptor and the Ag; $\u03f5$ is measured in units of ${k}_{B}T$, where ${k}_{B}$ is Boltzmann constant and $T$ the organism temperature (This choice of unit is standard in biophysics, and allows one to simply express Boltzmann factors as ${e}^{\u03f5}$; in practice, $1{k}_{B}T\simeq {10}^{24}$ kcal). This energy is related to the dissociation constant ${K}_{d}$ between the Bcell receptor and the Ag through $\u03f5=\mathrm{log}{K}_{d}$ is here expressed in Molar units, other choices of units would shift energies by a constant amount. Hence, lower energies correspond to higher affinities (For example, the dissociation constant ${K}_{d}=$ 1 μM corresponds to the energy $\u03f5=13.8$, and a tenfold decrease in affinity (with ${K}_{d}$ varying from 1 μM to 10 μM) corresponds to an increase in binding energy of 2.3). The main objective of our model is to track the evolution of the distribution of binding energies across the Bcell population, $\rho (\u03f5)$, during the GC maturation process. Tracking the full distribution is important for later comparison with experimental data, which themselves consist of affinity distributions. We now describe the main ingredients of the model.
Ag dynamics
In the course of AM, the concentration $C$ of Ag varies over time, due both to gradual release from the adjuvant matrix and to decay and consumption (Figure 2A). At time of injection Ag molecules are trapped in the adjuvant matrix, which constitutes an Ag reservoir. Ag is then quickly released at a fast rate ${k}^{+}$. Due to recycling of Ag from surface of follicular dendritic cells (FDCs) to endosomal compartments (Heesters et al., 2013; Mesin et al., 2016) available Ag decays at a slow rate ${k}_{\mathrm{\varnothing}}^{}$, and are consumed by Bcells at a faster rate, ${k}_{B}^{}{N}_{B}$, proportional to the number ${N}_{B}$ of Bcells. As the amount of Ag is depleted, selection of Bcell is more and more stringent, and the GC eventually dies out.
GC affinity maturation
The GC is initialized with ${N}_{\text{found}}$ founder clones from the population of naive responders (Tas et al., 2016). Their binding energies $\u03f5$ are independently drawn from a Gaussian distribution, with mean ${\mu}_{\text{naive}}$ and standard deviation ${\sigma}_{\text{naive}}$ (Histogram one in Figure 1). During the initial phase of colonization and expansion, these founder clones duplicate uniformly (without mutation) to produce a population of ${N}_{i}$ Bcells. We do not model this initial phase, and start our simulation ${T}_{\text{GC}}$ days after Ag injection, when the GC is mature (Victora and Nussenzweig, 2012; De Silva and Klein, 2015).
During each evolution round (of duration ${T}_{\text{turn}}$ hours), all cells are assumed to divide twice, independently of their affinity. If the number of cells in the population, ${N}_{B}$, exceeds some threshold value ${N}_{\mathrm{max}}$ during the division process, each cell is removed with probability $1{N}_{\mathrm{max}}/{N}_{B}$, so that on average only ${N}_{\mathrm{max}}$ cells are left. Imposing a finite carrying capacity to the GC takes into account limitations on its growth, due to the availability of metabolic resources or the finite amount of Tcell help.
At division Bcells have probability ${p}_{\text{mut}}$ of developing mutations through a process known as Somatic HyperMutation. Mutations can be lethal, neutral, or affinityaffecting with probabilities equal to, respectively, ${p}_{\text{l}}$, ${p}_{\text{s}}$, or ${p}_{\text{a}}$ (Zhang and Shakhnovich, 2010). In the latter case, the binding energy of the cell is added a random contribution, $\u03f5\to \u03f5+\mathrm{\Delta}\u03f5$, drawn from a lognormal distribution ${K}_{\text{aa}}(\mathrm{\Delta}\u03f5)$ (Ovchinnikov et al., 2018), see Appendix 1—figure 1.A. Most affinityaffecting mutations are deleterious, that is correspond to $\mathrm{\Delta}\u03f5>0$ (Histogram 2 in Figure 1).
After duplication Bcells are first selected according to their capability to bind Ags exposed on FDCs (Figure 1 top right). The probability for a cell to survive this selection step is a decreasing function of its binding energy $\u03f5$ and increases with the concentration $C$ of Ag on FDCs; it is given by
where ${\u03f5}_{\text{Ag}}$ is a threshold binding energy (Appendix 1—figure 1C). As a consequence, cells with high binding energy (larger than ${\u03f5}_{\text{Ag}}+\mathrm{log}C$) are likely to be removed from the population, compare Histograms 2 and 3 in Figure 1.
Following internalization, Bcells load the Ag on MHC molecules on their surface (Nowosad et al., 2016; Natkanski et al., 2013; Batista and Neuberger, 2000). By probing these molecules T follicular helper cells provide survival signals to the Bcells with high Ag affinity (Figure 1, ‘Competition for Tcell help’) (Allen et al., 2007b; Shulman et al., 2014; Victora and Nussenzweig, 2012; Depoil et al., 2005). The probability that a Bcell with binding energy $\u03f5$ survives this second step of selection is
The threshold energy $\overline{\u03f5}$ depends on the current state of the Bcell population in the GC, as a result of the competition amongst these cells for getting the survival signal from Thelper cells, see Histogram four in Figure 1. Parameter $a$ represents the probability for any Bcells to be selected due to stochastic effects (e.g. bystander activation [Horns et al., 2019]) even with very low affinity; it is introduced to reproduce the observation that selection in GCs is permissive in the presence of complex Ags such as the ones found in vaccines (Finney et al., 2018). Parameter $b$ instead represents the probability for a Bcell to fail selection at high affinity. The introduction of $b$ comes from the experimental observation that part of the population of apoptotic cells in GCs has high affinity for the antigen (Mayer et al., 2017); the removal of these cells could result from stochastic effects (Lau and Brink, 2020).
We will consider three variants of the above selection process: (A) twostep selection described in Equations 1 and 2; (B) same twostep selection, but without permissiveness, that is with $a=b=0$; (C) simpler selection process based on competition for Tcell help only, that is Equation 2, but allowing for permissiveness.
Differentiation into plasma and memory cells
Clones that successfully survive selection differentiate with probability ${p}_{\text{diff}}$ in either Abproducing plasma cells (PCs) or longlived memory cells (MCs), or start a new evolution cycle with probability $1{p}_{\text{diff}}$. The probabilities of differentiation into MC and PC, respectively, ${\mu}_{\text{MC}}(t)$ and ${\mu}_{PC}(t)=1{\mu}_{\text{MC}}(t)$, depend on the time following Ag injection $t$ (early vs. late response) (Weisel et al., 2016). The MC cell fate is more likely at the beginning of evolution and the PC is more likely towards the end, effectively resulting in a temporal switch occurring around day 11 after injection (Weisel et al., 2016; Appendix 1—figure 1B). The MC and PC populations (Histograms five in Figure 1) grow at each evolution step, as more and more clones differentiate.
Administering a recall Ag injection some time after vaccination generates responders Absecreting cells (AbSCs). These cells comprise both MCs, that can be stimulated to differentiate and produce Abs upon new Ag encounter (McHeyzerWilliams et al., 2015; Dogan et al., 2009; Mesin et al., 2016; Inoue et al., 2018), and residual PCs formed during previous maturations; PCs belonging to the longlived pool are capable of surviving up to a human lifetime in the absence of division (Wong and Bhattacharya, 2019; Crotty et al., 2003). The affinity distribution of AbSCs is assumed to be a weighted mixture of the MC and PC populations, with fractions equal respectively to $g$ and $1g$, where the value of $g$ is expected to depend on the conditions under which the system is probed.
Cells harvested from the spleen originate from multiple GCs. To account for this phenomenon, we carry out several parallel stochastic simulations of GCs (${N}_{\text{GCs}}=20$); the GCs are initialized with different populations of founders, and produce different AbSC populations. The distribution of affinities, averaged over the GCs, is our outcome and can be compared to experimental results. We choose not to introduce interactions between the evolving GCs, due to the lack of experimental quantification of possible GCcrosstalk.
GC reinitialization
When a second Ag injection is performed after the end of the first GC reaction a new GC is initiated. The population of ${N}_{\text{found}}$ founder clones for the new GC is composed of both new GC Bcells with naive precursors having sufficient affinity to bind the Ag, and reactivated MCs accumulated during the past evolution (McHeyzerWilliams et al., 2015; Dogan et al., 2009; Inoue et al., 2018). The probability for a founder cell to be extracted from the MC pool is ${p}_{\text{mem}}={N}_{\text{mem}}/({N}_{\text{mem}}+{N}_{i})$, where ${N}_{\text{mem}}$ is the number of MCs accumulated up to the time of the second injection. This hypothesis reflects the fact that we expect more reactivated MCs to colonize the newly formed GC if more MCs were produced in the previous maturation. However, one could also consider this ratio to be constant (see appendix sect. 6 'Possible model variations').
If the Ag injection occurs before the end of the first GC reaction, only the MC produced so far are considered to seed the second GC reaction. This initial exchange of MCs is the only interaction between the two GCs, which evolve independently at later times.
Values of model parameters
The values of all but nine model parameters listed above were extracted from existing literature, see description in appendix section (Model definition and parameters choice) and table of parameter values in Table 1. The remaining nine parameters, which were either not precisely known or strongly dependent on our experimental protocol, were fitted from the experimental data through a MaximumLikelihood inference procedure for each selection variant (A), (B) or (C); the inference procedure is described in Materials and methods and in appendix sect. 4. These fitted parameters describe: the initial distribution of affinities (${\mu}_{\text{naive}}$, ${\sigma}_{\text{naive}}$), the Agbinding selection threshold (${\u03f5}_{\text{Ag}}$, not included in variant (C)), the Agcomsumption rate per Bcell (${k}_{B}^{}$), the permissiveness characterizing parameters ($a$, $b$, not included in variant (B)), the contribution $g$ of MC to AbSC population (for the 1 and 4day protocols in our experiments), and the conversion factor $\alpha $ between vaccine Ag dosage $D$ in units of mass and dimensionless injected concentration $C}^{\text{inj}$ (we express $\alpha $ as a mass, which makes concentrations dimensionless).
Phenomenology of the stochastic affinity maturation model
Schematic evolution of the affinity distribution in the course of maturation
In Figure 2 B, C and D we report the result of two stochastic simulations of our model on a protocol consisting of a single Ag injection. The simulations differ by the administered Ag dosages $D=1$ (blue) or 10 (orange) $\mu \mathrm{g}$. The founder clones population is the same in the two simulations in order to eliminate differences coming from variations in the affinities of the initial population. For both concentrations, the main phases in the evolution of the GC can be summarized as follows. After injection and before the start of the GC reaction at day six the amount of available Ag increases due to gradual release from the adjuvant matrix, while consumption exponentially increases. At the beginning of the simulation (day 6) the GC is at maximum capacity and the driving contribution to Ag depletion is consumption by Bcells, which occurs at a rate ${k}_{B}^{}{N}_{\text{max}}$ (Figure 2C). This consumption continues until Ag concentration reaches a critical value, at which selection pressure becomes strong enough to reduce the population size (despite the duplication step) and eventually drives GCs to extinction (Figure 2C).
Maturation induces progressive loss of clonality
We investigated how the changes in affinity reflect changes in the clonal population in the GC. Recent experiments Tas et al., 2016; Abbott et al., 2018; Kuraoka et al., 2016 have shown that maturation is accompanied by various degrees of homogenizing selection, that is, a reduction of clonality, leading in some cases to strong clonal dominance. We assess the impact of homogenizing selection in our model by keeping trace of the offspring of each founder clone in the stochastic evolution of a single GC for a 4 weeks timespan. The evolution of clonality is reported for two representative simulations in Figure 3A, B. The plot report the cumulative composition of the population as a function of time; the offspring of each founder clone is represented by a different color, associated to the binding energy of the founder clone, see color scale on the right. In the simulation reported in Figure 3A, a single clonal family ensued from a highaffinity clone progressively expands, and constitutes around 70% of the total GC population at 4 weeks. In the simulation reported in Figure 3B, no clone dominates the population, and the GC maintains its polyclonality throughout maturation, with many good affinity clones sharing substantial fractions of the GC.
To quantify the evolution of homogenization over time, we estimated the fraction of the population constituted by the most expanded clone at each given time, where 100% would correspond to the GC being completely populated by the offspring of a single founder clone. In Figure 3C, we plot the distribution of this mostexpandedclone fraction 1000 stochastic simulations at four different timepoints (1,2,3,4 weeks after injection). All GCs in our simulations are highly polyclonal at the beginning, with each clone constituting 1% of the initial population. As time goes on, however, more and more GCs feature a dominant clone, sometimes with a very high population fraction. The median of the frequency distribution at week 4 is around 30%, meaning that in half of the simulated GCs a single clonal family makes up for more than 30% of the total Bcell population. Finally, in Figure 3D we plot, for each simulation, the final (week 4) fraction of the population corresponding to the mostabundant clonal family against its initial binding energy. As expected homogenization correlates with the presence of a highaffinity founder precursor.
Efficacy of affinity maturation varies non monotonically with Ag dosage
Inspection of Equations 1 and 2 shows that the role of Ag concentration in our model is to shift the selection thresholds by $\mathrm{log}C$. This shift has two different consequences. First, its affects the speed of affinity maturation, that is, the decrease in the population average binding energy per round of evolution. The histograms in Figure 2B (area reflects the size of the population) and the curve for the average binding energy of the population in Figure 2C show that smaller Ag dosages correspond to faster affinity maturation. Secondly, strong or weak selection resulting from, respectively, small or large concentrations also affects the changes over time in the size of the Bcell population, which in turns impacts the Agconsumption rates and, therefore, the lifetime of the GC. This can be again visualized by comparing population evolutions on the histograms of Figure 2B and on the curve of the population size in Figure 2C.
These two competing effects concur to shape the final MCs and PCs binding energy distribution (Figure 2D). Protection against future pathogen encounters will be granted by these cells, and as such their affinity distribution can be used as an indicator to estimate the success and quality of the immunization procedure.
Because of the double role that Ag concentration plays in controlling the maturation rate and the duration of the GC reaction, in our model the optimal average binding energy of the MC and PC population is achieved at intermediate Ag dosages. Intuitively, this can be explained by observing that, while small Ag dosages cause faster affinity gains, they also result in fast population decrease and short maturation. Therefore in this scenario only a few highaffinity cells will be produced. Conversely, if the dosage is too high then a lot of mediocre or intermediate affinity clones will accumulate, and the highaffinity clones obtained at the end of the evolution process will be in minority. Only intermediate dosages realize a good combination of good maturation speed and population survival. In order to better understand this phenomenon, we can introduce a deterministic version of the model, which is both able to reproduce the average of stochastic simulations and is also amenable to detailed mathematical analysis.
Resolution of the model offers insight on effect of ag dosage
Deterministic evolution reproduces stochastic simulations
In order to gain insight on the nonmonotonic effects of concentration onto affinity maturation, we introduce a deterministic version of the model, which formally becomes exact in the limit of very large sizes $N$. In practice, when the size of the population is big enough, the distribution of binding energies can be considered as continuous. The evolution of this continuous distribution $\rho (\u03f5,t)$ over time (number of rounds) $t$ becomes deterministic (Materials and methods); in other words, the stochastic nature of the underlying process disappears in this limit. This introduces a twofold advantage. Firstly, studying deterministic rather than stochastic evolution is a significant simplification, which allows mathematical analysis, see section (Theoretical analysis at fixed concentration) Secondly, numerically evaluating the average outcome of an immunization scheme is computationally much cheaper if done through the deterministic model rather than by averaging many stochastic simulations. This is of paramount importance when using our stochastic fitting procedure, which requires simulating the system for many different values of the parameters.
As a first check, we compare the predictions of the deterministic solution of the model with the corresponding averages for the stochastic simulations to verify that they are in good agreement. For example in Apendix 1—figure 2AD, we show the size of the GC Bcell population, and the average binding energies for the GC Bcell, MC and PC populations, averaged over 1000 simulations, which are in very good agreement with their theoretical counterparts. Notice that the model looses accuracy when the population size is too small (cf accuracy of predictions for GC Bcells average binding energies in Apendix 1—figure 2C), as expected. However, these finitesize effects are generally irrelevant, since lowpopulation size states contribute only marginally to the final MCs/PCs distributions we are interested in (cf accuracy of predictions for MCs and PCs average binding energies in Apendix 1—figure 2B and D). The deterministic theory is therefore able to accurately predict the full AbSC distributions (see Apendix 1—figure 7, blue distributions correspond to the deterministic solution, and green histograms to the average distribution over 1000 stochastic simulations).
Theoretical analysis at fixed concentration
We can gain deep insight on the role of Ag concentration in regulating maturation by studying the theoretical solution of the model in the special case of constant Ag concentration $C$. To be able to observe asymptotic population expansion, we momentarily relax the maximum population size constraint, and set ${N}_{\mathrm{max}}=\mathrm{\infty}$. Furthermore, for variants (A) and (B), we consider that the cells in the population have high enough affinity to successfully overcome the first selection step, that is $\u03f5\ll {\u03f5}_{\text{Ag}}$; this assumption is not necessary for variant (C), which does not include Agbinding selection. The effects of these simplifications will be discussed below.
In Figure 4A, we report the evolution of the distribution of binding energies with constant Ag concentration $C=30$ (top right). Notice that the distribution is not normalized to one, but to the number of cells in the population. Color encodes time from the beginning of the GC evolution. We observe that, as the number $t$ of evolution rounds increases, the size of the population increases exponentially with a growth rate $\varphi $ (top left) and the average binding energy shifts linearly, with a speed $u$ (bottom left). The distribution of binding energies therefore evolves as a travelling wave of profile ${\rho}^{*}$, with exponentially increasing size:
This behavior can be mathematically established, and the growth rate $\varphi $ and maturation speed $u$ computed by solving an appropriate eigenvalue equation. To do so, we introduce the evolution operator $\mathbf{\mathbf{E}}$ that describes how the distribution of binding energies evolves after each round of maturation. Briefly speaking, $\mathbf{\mathbf{E}}(\u03f5,{\u03f5}^{\prime})$ is the average number of Bcells with energy $\u03f5$ produced, through the duplication, selection and mutation steps by an ancestor cell of energy ${\u03f5}^{\prime}$ (Materials and methods); it depends on the Ag concentration $C$ through the selection step, see Equation 2. The travelling wave behavior for the distribution of binding energies expressed in Equation 3 implies that
This eigenvalue equation can be solved to determine the growth rate $\varphi $, the wave (maturation) speed $u$, and the wave profile ${\rho}^{*}$ as functions of the concentration $C$. More details on eigenvalue equation Equation 4 and on how it can be numerically solved can be found in Materials and methods Eigenvalue equation and phase diagram and Appendix (Theoretical solution and eigenvalue equation).
Results are shown in Figure 4B. Two special values of the concentration are ${C}^{*}$, the concentration at which the growth rate $\varphi $ vanishes, and ${C}^{**}$, the concentration at which the maturation speed $u$ vanishes. Distinct regimes of maturation are found, depending on the dosage $C$:
At low Ag concentration $C<{C}^{*}$, both $\varphi $ and $u$ are negative: the strong selection pressure produces high affinity clones and maturation is fast, but the number of cells decreases exponentially, leading to a quick extinction of the population.
At high concentration $C>{C}^{**}$, the selection pressure is too weak to compensate the deleterious drift due to mutations, and binding energies increase on average at each round ($u>0$). The growth rate $\varphi $ is positive, hence an exponentially increasing number of poorquality Bcells are produced.
In the intermediate range of concentration, ${C}^{*}<C<{C}^{**}$, we have both population expansion (positive growth rate $\varphi $) and affinity maturation (negative maturation speed $u$). The most efficient maturations are obtained for values of $C$ slightly exceeding ${C}^{*}$, as $u$ is very close to 0 for values of $C$ tending to ${C}^{**}$ (Figure 4B).
The above analysis provides a detailed picture of the effect of Ag concentration on population growth and maturation, even when realistic constraints are reintroduced. First, if we forbid the population to expand indefinitely and enforce the maximum carrying capacity (${N}_{\mathrm{max}}$) again, the value of $u(C)$ is not modified, since this constraint has no effect on affinity. It also does not influences the regime $C<{C}^{*}$ in which the population contracts ($\varphi (C)<0$). However, it prevents the population from expanding, thus setting effectively the maximum asymptotic growth rate to $\varphi (C)=0$ if $C\ge {C}^{*}$. Second, if we reintroduce Agbinding selection we observe no difference in asymptotic behavior when the population is maturating ($C<{C}^{**}$ and $u<0$). However for high concentration $C>{C}^{**}$ a positive asymptotic velocity is not possible, since in this case the distribution will eventually reach the threshold Agbinding energy and this selection will prevent further affinity decrease. This limits the maximum asymptotic velocity to 0 and maximum growth rate to $\varphi ({C}^{**})$. Finally, when the Ag concentration is not kept constant but varies during immunization through consumption and decay (Figure 2A), the maturation behaviors observed during GC evolution (Figure 2B and C) can be understood depending on whether the value $C$ of the concentration crosses the boundaries ${C}^{**}$ or ${C}^{*}$ over time.
Model distributions of affinities match experimental measurements in immunized mice
Probing immunization outcome through singlecell affinity measurements
We compare our model predictions for the effects of Ag dosage and release schedule to experimental data from mice immunization against TT (Materials and methods). These data consist of singlecell affinity measurements performed on IgG Secreting Cells (IgGSCs) extracted from mice spleen following immunization. In practice, we immunize mice according to different immunization schemes, described below. Following immunization cells from the spleen are harvested, purified and the affinity of single IgGSCs is measured according to the protocol developed in Eyer et al., 2017. By pooling all the measurements from mice immunized according to the same scheme we are able to obtain a full affinity distribution, such as the ones reported in Figure 5 (orange histograms, for each histogram the number of mice and pooled measurements is indicated). Measurements are limited by experimental sensitivity. In particular, only affinities above the minimum affinity limit of $K}_{d}=500\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$, that is energies below ${\u03f5}_{\mathrm{max}}=23.03$ are measurable. In addition, our measurement technique cannot resolve affinities higher than $K}_{d}=0.1\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$. The range of energies accessible to measurements is represented with the gray shaded area in the histograms of Figure 5. These distributions give us an affinity snapshot of the Abproducing cell population; they contain much more information than average quantities, such as the average serum affinity. Our approach allows to probe both tails of the affinity spectrum, and to fully test the effectiveness of the immunization procedure. In our experiments we test three different immunization protocols, schematized in Figure 5 (top row). Scheme 1 consists of two injections of a dose $D$ of Ag, separated by a 4 weeks interval. Cells are harvested 4 days after the second injections. In the first injection, the Ag is mixed with Complete Freund’s Adjuvant (CFA), whilst in the second Incomplete Freund’s Adjuvant (IFA) is used. In this protocol, we tested five different Ag dosages: $D=0.01,0.1,0.5,1$ and 10 $\mu \mathrm{g}$ TT. Only four of them are reported in Figure 5 but the rest can be found in Appendix 1—figure 7. Scheme 2 (see Figure 5 middle column) is identical to scheme one up to the second injection. At this point, after an additional 4 weeks delay, a boost injection of $1\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ pure TT is administered and cells are harvested 1 day later. Tested dosages are $D=0,0.01,0.1,0.5,1,3$ and 10 $\mu \mathrm{g}$ TT. Finally, scheme 3 (see Figure 5 right column) is the same as scheme two with a differences. Instead of varying the injected Ag dosage, which is kept constant at $D=10\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ TT, in this scheme the time delay between the first two injections $\mathrm{\Delta}T$ is varied. We test four different values for this delay: $\mathrm{\Delta}T$ = 1, 2, 4 and 8 weeks. These protocols have also been used in Eyer et al., 2020, and thanks to the multiple injections they allow us to study the effect of memory recall in subsequent immunizations.
Inference of model parameters and match with full experimental affinity distributions
We now use the full variety of the data (distributions of affinities obtained with different immunization protocols) to compute and maximize the likelihood of the model as a function of the parameter values. Our objective is twofold. First, we expect the inferred parameters to provide insights on hardly measurable features of AM, in particular, on the complex steps of selection in our model. Secondly, we show that a single set of parameters is able to accurately reproduce all the experimental measurements corresponding to different situations.
We have implemented a version of the Parallel Tempering algorithm (Swendsen and Wang, 1986; Sugita and Okamoto, 1999) to perform a stochastic search in parameter space and progressively maximize the likelihood $\mathcal{L}$ for the selection variant (A), (B), and (C). For each point in the parameter space, the deterministic model is simulated according to the immunization scheme considered, see Figure 5. In particular, for scheme one the prediction consists in the simulation of a single GC with variable injected dosage $D$ lasting at most for 4 weeks. Since cells are harvested 4 days after the second injection, we consider the AbSCs population to be comprised of a mixture of MC and PC according to the MC fraction ${g}_{\text{imm}}$, whose value is inferred to be zero (i.e. in this case the AbSC population comprises only PCs). For scheme 2 and 3 instead we consider two GC simulations, one per injection. We vary either the injected dosage $D$ or the time between the two injections $\mathrm{\Delta}T$ according to the protocol in exam. The second GC simulation, initiated 6 days after the second injection, can be seeded by MCs collected during the first GC evolution up to the injection time. Moreover, since cells are harvested 1 day after boost we consider the MC fraction in the AbSC population to be ${g}_{\text{recall}}$. The affinity distribution of AbSCs obtained with the deterministic model is then used to compute the likelihood of the experimentally measured affinities of the IgGSCs, under all tested immunization schemes. Cells sampled from the spleen can originate from different GCs, but, as long as these GCs have equal defining parameters, their average evolution is the same, and their multiplicity does not affect the inference procedure. See Materials and methods and appendix sect. 4 ('Maximum likelihood fit procedure') for a more detailed description of the procedure. Notice that the inference of many parameters is made possible by the richness of information contained in the experimental affinity distributions.
As an outcome, we obtain the loglikelihoods of the three variants listed above: $\mathrm{ln}{\mathcal{L}}^{(A)}=7400.37$ for full twostep selection, $\mathrm{ln}{\mathcal{L}}^{(B)}=7459.39$ for nonpermissive twostep selection, and $\mathrm{ln}{\mathcal{L}}^{(C)}=7400.67$ for Tcellbased selection (see Appendix 1—figure 9 for the inferred parameters value in all cases). A fair comparison between these three hypothesis must however acknowledge that (B) and (C) have, respectively, 2 and 1 less parameter to fit the data than (A). We therefore resort to the socalled Bayesian Information Criterion (BIC), which takes into account the number of parameters by estimating the volume in the parameter space around the peak in likelihood. BIC is defined as $k\mathrm{ln}n2\mathrm{ln}\mathcal{L}$, where $k$ is the number of parameters in the model and $n$ is the number of data points available for the inference. We obtain BIC^{(A)} = 14877.3, BIC^{(B)} = 14978.3, BIC^{(C)} = 14869.4. We conclude that the model to be chosen (with lowest BIC) is (C) (Notice that variant (C) is also preferred based on an alternative to BIC, the Akaike Information Criterion, defined through AIC $=2k2\mathrm{ln}\mathcal{L}$ (AIC^{(A)} = 14818.7, AIC^{(B)} = 14932.8, AIC^{(C)} = 14817.3). Including Agbinding selection improves slightly the likelihood, but less than expected from the introduction of an extra parameter (${\u03f5}_{Ag}$). On the contrary, the large increase in BIC when forbiding permissiveness shows that nonzero values for $a,b$ are definitely needed to fit the data. Within variant (C) the values of the eight model parameters that maximize the likelihood are (see Table 1): $k}_{B}^{}=2.07\times {10}^{5}\phantom{\rule{thinmathspace}{0ex}}/\mathrm{d$, ${\mu}_{\text{naive}}=14.59$, ${\sigma}_{\text{naive}}=1.66$, $a=.12$, $b=.66$, as well as ${g}_{\text{recall}}=56\%,{g}_{\text{imm}}=0\%$ for the values of $g$ corresponding to the measurements of affinities, respectively, 1 day after boost injection (immunization scheme 2 and 3) or 4 days after the second injection (scheme 1), and the dosagetoconcentration conversion factor $\alpha =23\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{g}$ which allows us to convert Ag dosages in units of mass into dimensionless concentrations. In Figure 5 we report for every experimentally measured affinity distribution (orange histograms) the maximumlikelihood corresponding prediction according to the deterministic model evolution (blue curves; for good comparison normalization considers only the area of the curve below the experimental sensitivity threshold). Under all tested immunization schemes, we observe a very good agreement between theory and experiments. See Appendix 1—figure 7 for the full plot including all experimental conditions.
Effect of varying Ag dosage and time between injections
In Figure 6, we report average measures performed on the affinity distributions for the three different schemes (scheme 1 to 3, left to right) considered. The measurements are the average binding affinity (top) and the high energy fraction (bottom). The latter is defined as the fraction of cells in the population having binding affinity higher than $K}_{d}^{\text{haff}}=50\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$, or equivalently $\u03f5<{\u03f5}_{\text{haff}}=16.8$. In the figure we compare experimental values (orange) with the theoretical prediction of the deterministic model (blue line) and the stochastic simulations (light green shaded area corresponds to the standard deviation over 1000 stochastic simulations). To convey a measure of experimental individual variability, for each immunization scheme we report singlemouse measurements as orange crosses, connected by vertical lines; Orange empty dots represent instead averages over the pooled data. As cells measured from a mouse spleen can originate from different GCs, for example 20 to 50 GCs per spleen section were reported in Wittenbrink et al., 2011, we also display in a darker shade of green the standard deviation of the mean of 20 simulations of the stochastic model. This allows us to estimate the expected variations of the binding energy or other quantities due to the existence of multiple GCs. For all the schemes considered, we observe a very good agreement between the stochastic model and theoretical predictions, showing that the infinite size limit is a good approximation to the average stochastic evolution. This agreement also extends to full distributions (compare green histograms and blue curves in Appendix 1—figure 7).
Most importantly, for all schemes, model and data are in very good agreement. In schemes 1 and 2 in particular both show the existence of an optimal intermediate dosage corresponding to maximal affinity of the Absecreting cells recalled population. This experimental observation can now be interpreted with the theoretical analysis introduced in section (Theoretical analysis at fixed concentration).
In scheme 3, we observe that experimental data show a slight increase in affinity for longer injection delays, and so does our model. This is presumably due to a combination of two effects. Firstly, the fact that higher affinity cells are produced late in the response, and waiting more before harvesting cells allows for higher affinity cells to be created. Secondly, giving the first GC time to produce highaffinity MCs is beneficial since then these cells can then colonize the second GC and continue their maturation even further there.
Discussion
Summary and significance
In this paper, we have investigated the relationship between Ag dosage and quality of immunization outcome. Several studies (Victora and Nussenzweig, 2012; Kang et al., 2015; Eisen and Siskind, 1964; Goidl et al., 1968; Nussenzweig and Benacerraf, 1967) report the fact that better affinity maturation is not always favored by higher doses of Ag, but can instead be enhanced by lower doses. Similarly, the strength of a response to a vaccine, usually measured through the count of responding cells, may show a belllike curve at intermediate dosages, and understanding the mechanisms underlying this behavior and locating the optimal Ag dose are of crucial importance (Rhodes et al., 2019). Our works provide quantitative theoretical and experimental support to these findings. In particular, the stochastic model for affinity maturation we consider here is capable of explaining and accounting for the existence of an intermediate optimal Ag dosage, that results in the highest average affinity of the recalled population. While our model is inspired by previous studies of the evolution of a population of Bcells in a Germinal Center during Affinity Maturation, such as (Wang et al., 2015, it differs in two substantial ways.
First, our model is amenable to detailed mathematical analysis. We show that the stochastic evolution of the distribution of binding energies can be accurately approximated by a deterministic dynamics (see Figure 6), which we resolve exactly. Under constant Ag concentration, the distribution of binding energies behaves as a traveling wave, whose speed and growth rate can be recovered by solving an appropriate eigenvalue Equation 4. The dependence of these two quantities on Ag concentration reveals the role Ag availability plays in controlling the strength of selection, both in the generated data and models. In particular, high Ag dosage results in low selection pressure and no maturation, and conversely too low Ag dosage in high selection pressure and population extinction. Only intermediate Ag concentration and intermediate selection pressure ensures both population survival and successful AM.
Second, we show that a single set of parameters of our model is able to reproduce quantitatively the many distributions of singlecell affinities measured on IgGSC extracted from mice immunized against TT corresponding to multiple protocols largely varying in Ag dosages and delays between injections. To determine the best parameters, we introduce a maximumlikelihoodbased inference method. Our inference method fully exploits the results of the experimental technique, developed in Eyer et al., 2017, giving access not to the average affinity, as titer measurement would, but to the complete affinity distribution of the recalled AbSC population. This population information is crucial for accurate inference of the model parameters and for a meaningful validation of the model. Furthermore, the inferred parameters provide insights on the internal processes of affinity maturation, such as on the role of permissiveness, as discussed later. Inference techniques are powerful instruments in this respect, since they help us investigate experimentally unaccessible features of the system through their indirect but measurable effects. Our inference procedure is very flexible and can readily be applied to new datasets, providing adhoc estimates of parameters for different antigens or even different organisms.
Maturation as combination of beneficial mutations and selection of highaffinity precursors
Our stochastic model for affinity maturation is subject to homogenizing selection (Figure 3), to degrees depending on the presence of a highaffinity precursor (Figure 3D), in agreement with experimental evidence (Tas et al., 2016; Abbott et al., 2018). In addition, the initial choice of founder clones accounts for a large part of the stochasticity in the maturation outcome (Appendix 1—figure 3E to H), Hence, in our model, selective expansion of highaffinity precursors plays an important role in affinity enhancement. Affinity enhancement is also obtained through the accumulation of beneficial mutations. When observing the distribution of beneficial and deleterious mutations in the MC and PC populations (Appendix 1—figure 10), one finds that, even though on average cells accumulate very few mutations during the AM process, selection tends to favor the fixation of beneficial mutations and the disappearance of deleterious ones.
Stochastic effects in fitness waves
Both the mathematical analysis and the inference procedure are made possible by the fact that our stochastic maturation model is wellapproximated by its deterministic counterpart. This is usually not the case when describing the evolution of fitness waves (Neher and Walczak, 2018). In many systems, stochastic fluctuations may play a major role, for example when the evolving population passes through a bottleneck, and transiently has very low size, before increasing again. Fluctuations may also be acquire crucial importance when the evolution lasts so long that the leading edge of the fitness wave has time to exponentially amplify and govern the bulk of the population. Here, experimentally measured quantities, such as the distribution of affinities, are the outcome of an average over multiple GC reactions in the spleen. While single simulated GCs show signs of individuality, see homogenizing selection and the evolution of clonality in Figure 3, the average product of multiple GCs is wellapproximated by our deterministic theory. Moreover, stochastic effects are also partially mitigated by the fact that we consider quantities related to the integral over time of the fitness wave evolution, namely, the MC and PC distributions. Hence temporal fluctuations are smoothed out. Another factor contributing to this mitigation is the limited selection we infer. The permissiveness of selection results in a less drastic decrease of the population size, and a reduced sensitivity to fluctuations from the leading edge of the fitness wave.
Permissiveness in GC selection
The role of permissiveness in germinal center selection is still an open question (Bannard and Cyster, 2017; Mesin et al., 2016; Victora and Mouquet, 2018). Through phenomena such as bystander activation (Horns et al., 2019) and stochastic noise, GC selection may also allow intermediate and lowaffinity clones to survive, rather than maturing exclusively via selection of the few best clones (Lau and Brink, 2020; Tas et al., 2016). These phenomena generate a wider diversity than previously appreciated, especially when considering complex Ags displaying different epitopes (Kuraoka et al., 2016). In Finney et al., 2018 for example the authors try to characterize the GC response to complex Ags such as influenza vaccine, as opposed to simple ones such as haptens. While in the latter case a strong homogenizing selection and affinity maturation is observed, for complex Ags response is more polyclonal and a consistent part of the GC population (20–30%) is composed of lowaffinity clones. This suggests a more permissive nature of the GC selection, in which even lowaffinity clones have a nonzero probability of receiving Tcell help.
To model these effects, we have introduced two parameters, $a$ and $b$, in the competitive selection process involving survival signals from $T$helper cells, see Equation 2 and Appendix 1—figure 1D. $a$ corresponds to the baseline probability for cells to survive a selection step, while $b$ is equal to the probability for cells to fail selection even if they have high affinity; this could be due for example to the limited availability of Tcell help, which could increase the stochasticity of the selection process (Krishna and Bachman, 2018). The role of the parameters $a$ and $b$ in controlling the population evolution is studied in section appendix (Permissive and stochastic selection: effect of a, b parameters Our maximum likelihood fit of the data yields $a=0.12$ and $b=0.66$. These values imply that the probability that a highaffinity cell to survive the second step of selection is $1b=34\%$, about two and a half times the probability for a lowaffinity cell, given by $a=12\%$. This observation is in support for the permissive and stochastic nature of selection, at least in our experimental conditions. The nonpermissive variant of our model with baseline levels $a=b=0$ in Equation 2, referred to as variant (B), offers a much worse fit of the data, even when taking into account the smaller number of parameters of this variant (see appendix 'Possible model variations').
GCs entry selection does not seem to be restrictive
Our inference procedure supports the statistical prevalence of variant (C), with Tcellbased selection only, with respect to (A), which included Agbinding selection. The fact that Agbinding selection does not seem to be a limiting step for GC colonization, at least in the range of our experimentally measurable affinities, is compatible with experiments performed in Schwickert et al., 2011, in which it is shown that in absence of high affinity competitors even clones with low affinity (as low as $K}_{d}\sim 8\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{M$ or equivalently $\u03f5\sim 11.7$) can colonize GCs. This is also in accordance with the fact that selection in GCs should be relatively permissive (Bannard and Cyster, 2017; Victora and Nussenzweig, 2012) in order not to limit the diversity of the repertoire. Let us emphasize, however, that the difference in the BIC of the two selection models is rather weak and that our conclusion is contingent on the data set collected and analyzed here.
Fractions of PCs and MCs amongst AbSCs
Our experimental setup does not allow us to identify whether the IgGSCs we observe originate from reactivated MCs or residual PCs generated during previous immunizations. We therefore compared the experimental measurements with a weighted mixture of the MC and PC populations predicted by our model. This mixture, which we call the AbSC population, represents the population of cells that respond to antigenic challenge under particular conditions. We introduced the parameters ${g}_{\text{recall}}$ and ${g}_{\text{imm}}$, corresponding to the fraction of reactivated MCs in the AbSC populations when measurement is performed one day after boost or four days after the second injection, and fit their value on the experimental measurements. The result of our inference procedure indicates that, when the system is probed 1 day after pure TT boost, most of the response consists in reactivated memory cells (${g}_{\text{recall}}=56\%$). This is in agreement with experimental observations performed in Eyer et al., 2020, in which the frequency of IgGSCs increased from 0.6 ± 0.1% to 1.6 ± 0.2% one day after the boost, indicating that around 64% of IgGSCs were not present before the boost. When the measurement is performed 4 days after the second injection then we predict that the vast majority of responders consist of residual PCs (${g}_{\text{imm}}=0\%$, with a confidence interval extending to 6%, Appendix 1—figure 6). This is consistent with experimental data (unpublished), which indicate that the majority of IgGSCs are still active 28 days after CFA immunization, and will be secreting at +4 days.
Concerning the biological difference between the MC and PC populations, it has been observed that MCs show on average less maturation than PCs (Inoue et al., 2018; Shinnakasu et al., 2016; Shinnakasu and Kurosaki, 2017), a feature that is reproduced in our model (Figure 2D) as a consequence of the temporal switch we introduced (Appendix 1—figure 1B) and might be important in maintaining diversity in the response, especially against highly mutable pathogens, and mitigating original antigenic sin (Suan et al., 2017; Morens et al., 2010). The results of our inference are in agreement with the fact that experimentally we observe a higher affinity of the responders if measurement is performed 4 days after the last injection (scheme 1) rather than 1 day after boost (schemes 2,3). This difference in affinity could also originate from some form of selection acting on the responder population during the first days of the response, which could selectively expand highaffinity clones in the time between Ag challenge and measurement. Including this selection in the model would result in a different estimate of the fractions ${g}_{\text{recall}}$ and ${g}_{\text{imm}}$. However, for simplicity and lack of explicit experimental evidence we did not include this selection in the model.
Model limitations and discussion
In building the model, we chose to only keep the minimal features that could allow us to understand the existence of an optimal dosage and be able to reproduce experimental observations, while still being mathematically tractable. Among the simplifications, the number of duplications per cell is considered independent of the cell affinity. It has been, however, shown that an affinity correlates with GC dark zone dwelling time and number of divisions (Gitlin et al., 2015). This phenomenon introduces an effective fitness difference, which is in practice qualitatively accounted for by the selection terms in our model. Moreover, we consider the distribution of affinityaffecting mutations ${K}_{\text{aa}}(\mathrm{\Delta}\u03f5)$ to be independent of the clone’s affinity, similarly to Wang et al., 2015; Wang, 2017; Zhang and Shakhnovich, 2010. In reality, independence holds only away from affinity peaks in the Ab sequence space; close to these peaks, affinityincreasing mutations become rare, and it is expected that Ag affinity of clones eventually saturate, while the binding energy can take arbitrarily low values in our model. However, in the regime defined by the values of the parameters inferred on our experimental data, MCs and PCs generated by our stochastic model accumulate on average very few mutations in the course of evolution (appendix, Quantifying beneficial and deleterious mutation events and Appendix 1—figure 10), with the maximum number of beneficial mutations accumulated being compatible with experimental evidence (Gérard et al., 2020) ( appendix Quantifying beneficial and deleterious mutation events). In this regime, mutations account for only a part of the maturation, the rest being achieved through selection of highaffinity founder clones ( appendix Quantifying beneficial and deleterious mutation events). This is in line with the limited maturation observed in our experiments. In cases where the saturation effect may become relevant, other approaches to model the effect of affinityaffecting mutations might be more appropriate, for example the introduction of a ‘shape space’ representation (Shaffer et al., 2016; Wang et al., 2016). The model and results reported here do not include Abfeedback (Wang et al., 2015), the phenomenon by which GC Bcells not only have to compete amongst themselves for Ag acquisition but also with Abs produced earlier in maturation (Bannard and Cyster, 2017; Mesin et al., 2016; Zhang et al., 2013), which could prevent Bcells from internalizing Ag by binding to it. We did not include Abfeedback in our model, however preliminary investigations (not shown) suggest that it would not affect the existence of an optimal dosage range. GC lifetimes reported in literature vary considerably, from 1 to 2 weeks for soluble protein boosting to several months or longer for certain infections (Victora and Mouquet, 2018; Mesin et al., 2016). In alum immunizations GC lifetimes of 3–4 weeks have been observed (Takahashi et al., 1998). In our simulations, a long lifetime for GCs is observed and for a high dose of Ag they can have an effective lifetime lasting up to 3 months (Appendix 1—figure 2E). The concentration of Ag is crucial in determining the strength of selection and the lifetime of the GC in our model. In reality, Ag dosage value also controls the initiation of the GC and AM. In particular, one could expect that for very low dosages the GC reaction would not be initiated at all. For simplicity, we avoid including this phenomenon in our model, and GC reaction takes place in our simulations even at very low Ag dosages, with the result that very few, highly affine MC are produced in this regime. To avoid a discontinuity with respect to the case of null Ag dosage, $D=0\phantom{\rule{thinmathspace}{0ex}}\mu g$, in which we expect the measured Bcell population to originate directly from naive precursors, we perform differentiation at the beginning of the simulation round, before mutations and selection (see appendix 'Model definition and parameters choice'). This generates a core of lowaffinity MCs keeping the average affinity of the population close to ${\mu}_{\text{naive}}$, even when few additional highaffinity MCs are added. However, this might be an unnecessary caution, since when looking at the data we observe that even the lowest tested dosage ($D=0.01\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ TT, Figure 5) shows the hallmark of maturation when compared to the the case of zero dosage ($D=0\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ TT, Figure 5). This signals that in the dosage range considered in our experiments we expect maturation to occur. Furthermore, in our model Ag inputs, for example resulting from a new injection, cannot enter a GC while the maturation process is ongoing. Our choice is partly justified by the observation that injecting an Ag bolus when a GC maturation process is in place mostly results in disruption of the ongoing GC reaction (Victora and Nussenzweig, 2012; Pulendran et al., 1995; Shokat and Goodnow, 1995; Han et al., 1995; Victora et al., 2010). We only model a single ‘average’ GC, whose output is assumed to be representative of the outcome of AM. In reality, MC and PC populations are generated by many parallel GC reactions, which could in principle weakly interact via invasion of clones from one GC to another (Mesin et al., 2016; Victora and Mouquet, 2018). Last of all, to test the robustness of some of our hypothesis we performed the inference procedure under slightly different conditions. In particuar, we considered the effect of increasing the Ag decay rate, of setting ${p}_{\text{mem}}$ to be a constant and not depend on the number of MCs accumulated during evolution, and also of considering the MC/PC timeswitch to be only partial, with a residual production of MCs all along the evolution. We verified that even in these case the model is in good agreement with the data. The results are reported in appendix sect. 6.
Outlooks
As shown above our model for AM is simple enough to be amenable to detailed mathematical analysis and, yet, is able to accurately reproduce the full affinity distributions of AbSCs generated during the immunization process. This finding suggests several extensions to the current work. First our model could be used to predict the outcome of more complex immunization protocols than the ones investigated experimentally in this work. In particular, it would be interesting to consider the case of continuous delivery methods (osmotic pumps, repeated injections…) (Tam et al., 2016; Cirelli et al., 2019), through which the Ag concentration can be precisely controlled over time, and make predictions for the optimal delivery process. Secondly, the quantitative fit of the model parameters was made here possible thanks to the maximumlikelihood algorithm we have introduced, which is flexible and robust. Our inference procedure, whose code is made available with the publication (see Materials and methods code and data availability), could be readily applied to to different measurements, as well as to variants of the present models, with extra parameters corresponding to features of the affinity maturation process that are hardly experimentally accessible, such as selection permissiveness. The combination of quantitative modeling with inference appears as a promising tool to understand the mechanisms governing the immune response and to guide the development of strategies to control and direct it.
Materials and methods
Experimental procedure
Observation chamber assembly
Request a detailed protocolFor the 2D observation chamber, we used glass microscopy slides as top and bottom covers (76 × 26×1 mm, Marienfeld). Two access holes of 1 mm diameter were generated in the top glass slide using laser ablation (C180II, Axys Laser). Afterwards, both slides were thoroughly cleaned using soap, water and ethanol, and the two glass slides were exposed to air plasma (60 W) for 10 min (Femto, Diener Electronics). After plasma treatment, double sided thermosresponsive tape (series 1375, Orafol), beforehand cut into shape using a cutting plotter (CE6000–40, Graphtec), was stuck onto the glass slides and the chamber sealed. The chamber was heated to 150° C and pressed with 7 bar for 5 min to reduce the height to enable a monolayer of droplets only. Next, two nanoports (N33301, Idex) were glued to the access holes. Subsequently, the surface of the 2D chamber was treated using fluorosilane (Aquapel, Aquapel) to render the surface hydrophobic. Lastly, the chamber was dried under nitrogen, and subsequently filled with fluorinated oil (Novec HFE7500, 3M) and sealed until used. The chamber was reused multiple times, and when properly stored, was used for up to 2 months. Cleaning was performed after each experiment by flushing fluorinated oil to remove droplets, and the chamber was stored filled with HFE7500 until the next use.
Droplet generator
Request a detailed protocolMicrofluidic PDMS chip for droplet generation were fabricated as previously described (Eyer et al., 2017).
Aqueous phase I
Request a detailed protocolPreparation of cells for droplet creation. For droplet generation, cellular suspensions were centrifuged (300 g, 5 min). and washed once in droplet media comprising RPMI w/o phenol red with supplemented 5% KnockOut Serum Replacement (both ThermoFisher), 0.5% recombinant human serum albumin (A9986, Sigma), 25 mM HEPES pH 7.4, 1% Pen/Strep and 0.1% Pluronic F137 (all ThermoFisher). The cells were resuspended in droplet media to achieve a $\lambda $ (mean number of cells per droplet) of 0.2–0.4.
Aqueous phase II
Request a detailed protocolBeads and reagents. Paramagnetic nanoparticles were prepared as described before (Eyer et al., 2020). Before use, the nanoparticles were resuspended thoroughly.
Data acquisition
Request a detailed protocolDroplets were generated as previously described (Eyer et al., 2017), and the emulsion was directly injected into the 2D observation chamber. After chamber filling was complete, the chamber was gently closed and mounted onto an inverted fluorescence microscope (Ti Eclipse, Nikon). Two neodymium magnets (BZX082, K and J Magnetics) were placed on each side of the chamber during observation to hold the bead lines in place. Excitation light was provided by a LED source (SOLA light engine, Lumencor Inc). Fluorescence for the specific channels were recorded using appropriate band pass filters (GFP and TRITC filter sets, Nikon, and Cy5 filter set, Semrock) and camera settings (Orca Flash 4, Hamamatsu) at room temperature (25° C) and ambient oxygen concentration. Images were acquired using a 10x objective (NA 0.45). An array of 10 × 10 images were acquired for each experiment, every 7.5 min in all channels over 37.5 min (five measurements total).
Data analysis
Request a detailed protocolData was analysed using a custommade Matlab script (Mathworks). The resulting raw data were exported to Excel (Microsoft), and sorted for droplets that showed an increase in antiIgG relocation over time above a threshold (Eyer et al., 2017). The selected droplets were controlled visually for the presence of a cell, and the absence of any fluorescent particles, relocation on cells (i.e. dead cells) or droplet movement. The soselected droplets were analyzed to calculate dissociation constants as described previously (Eyer et al., 2017). The limit of detection of the instrument allows for the resolution of dissociation constants $K}_{d}\le 500\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$ (see Eyer et al., 2017), therefore measurements with lower affinity were discarded. Moreover, cells with very high affinity $K}_{d}<0.1\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$ could be observed, but their affinity could not be determined more precisely (see also Eyer et al., 2017) and was set to $K}_{d}=0.1\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$.
Immunization of mice
Request a detailed protocolThe mice used herein were part of the study as published elsewhere (Eyer et al., 2020). In short, BALBC mice were purchased from Janvier Labs (age 6–8 weeks at start, female) and housed in the animal facilities of Institute Pasteur during experimentation. All immunizations were made intraperitoneal. Each condition was replicated three times in the same cohort ($n=3,N=1$); except when explicitly stated otherwise. From each mouse, between 20’−100’000 cells were assayed in an experimental run.
Extraction of IgGSCs
Request a detailed protocolSpleens were harvested at the indicated time points of the immunization schedule. Spleen cell suspensions were recovered following disassociating using a 40 µm cell strainer. Cellular suspensions were pelleted at 300 g for 5 min, and red blood cell lysis was performed for 1 min using BD Pharm Lyse (BD). Cells were washed twice with MACS buffer and resuspended in 3 ml of MACS buffer. These cells were further processed according to the manufacturer’s protocol using the Pan B Cell Isolation Kit II (Miltenyi) on a MultiMACS Cell24 Separator Plus (Miltenyi, program depletion). Purity of Bcell lineage was usually above 90% (data not shown).
Antigen dynamics
Request a detailed protocolAg concentration dynamically changes in parallel with the evolution of the GC. Initially an amount ${C}_{\text{inj}}$ of Ag is administered through injection (Figure 2A). The value of ${C}_{\text{inj}}$ determines the initial amount of Ag trapped in the adjuvant matrix, setting the initial value of the Ag reservoir concentration (Equation 5, right). For the sake of comparison with experiments ${C}_{\text{inj}}$ is proportional to the injected Ag dosage $D$ up to a conversion factor $\alpha $, ${C}_{\text{inj}}=D/\alpha $, inferred through maximum likelihood fit of the data. The available (${C}_{\text{av}}$, appearing in the selection probabilities in Equations 1 and 2) and reservoir (${C}_{\text{res}}$) concentrations then evolve as described in the main text (Figure 2A) under the action of release, decay and consumption according to the following equations:
During GC formation ($t<{T}_{\text{GC formation}}=6\phantom{\rule{thinmathspace}{0ex}}\mathrm{d}$) the number of Bcells, ${N}_{t}^{B}$, appearing in the rate of Ag consumption increases exponentially up to the maximal size ${N}_{i}^{B}=2,500$. More details on the concentration evolution can be found in appendix Model definition and parameters choice.
Deterministic evolution
Request a detailed protocolIn the deterministic/infinite size approximation, the stochastic processes that model one round of GC maturation can be written as operators acting on the distribution $\rho $ of binding energies $\u03f5$.
Cell duplication is represented by the amplification operator, consisting in a simple multiplication:
Mutations are encoded by convolution of the distribution of energies with a mutation kernel ${K}_{\text{eff}}$ that includes the effect of silent, affinity affecting and lethal mutations (see Equation 26 and appendix sect. 3 'Theoretical solution and eigenvalue equation'):
Selection for Ag binding (Equation 9) and Tcell help (Equation 10) are encoded simply by a product with the respective probabilities (Equations 1 and 2), where for the latter the probability depends on $\overline{\u03f5}$ which in turns depends on the distribution of binding energies, making the operator not linear:
Finally, the carrying capacity (Equation 11) and the differentiation (Equation 12) processes correspond to multiplications:
The distribution of binding energies at round $t$ then evolves through ${\rho}_{t+1}=\mathbf{\mathbf{E}}[{\rho}_{t}]$, where the complete operator is $\mathbf{\mathbf{E}}=\mathbf{\mathbf{D}}\mathbf{\mathbf{N}}{\mathbf{\mathbf{S}}}_{\text{T}}{\mathbf{\mathbf{S}}}_{\text{Ag}}\mathbf{\mathbf{R}}$, we indicate with $\mathbf{\mathbf{R}}=\mathbf{\mathbf{M}}\mathbf{\mathbf{A}}\mathbf{\mathbf{M}}\mathbf{\mathbf{A}}$ the operator encoding for two rounds of mutations and amplification. The evolution operator features, in order of application, two rounds of amplification and mutation, Agbinding selection, Tcell help selection, carrying capacity and differentiation. Notice that for variant (C), there is no Agbinding selection, and ${\mathbf{\mathbf{S}}}_{\text{Ag}}$ is replaced with the identity operator.
Eigenvalue equation and phase diagram
Request a detailed protocolThe growth rate $\varphi $ and the maturation velocity $u$ shown in Figure 4 are characteristic of the travelling wave nature of the distribution of energies $\rho $ at large ‘times’. When Agbinding selection is irrelevant (as is the case at large times if $u<0$) and the carrying capacity constraint is omitted, the evolution operator simplifies into
In one round of maturation, we expect the travelling distribution ${\rho}^{*}(\u03f5)$ to be shifted by $u$ along the energy axis, and to be multiplied by ${e}^{\varphi}$. Without loss of generality, we may choose ${\rho}^{*}$ such that $\overline{\u03f5}=0$ ; any other choice would merely consists in a translation of ${\rho}^{*}$ along the energy axis. Hence, $\mathbf{\mathbf{E}}$ is now a linear operator, and ${\rho}^{*}$ satisfies the eigenvalue Equation 4. In other words, the operator $\mathbf{\mathbf{\Sigma}}(u)\cdot \mathbf{\mathbf{E}}$, where $\mathbf{\mathbf{\Sigma}}(u)$ is the shift operator $\u03f5\to \u03f5+u$, has for largest eigenvalue ${e}^{\varphi}$ and associated eigenvector ${\rho}^{*}$. As all the entries of $\mathbf{\mathbf{\Sigma}}(u)\cdot \mathbf{\mathbf{E}}$ are positive, the PerronFrobenius theorem ensures that ${e}^{\varphi}$ is the top eigenvalue associated to the unique eigenvector ${\rho}^{*}$ with all its components positive.
In practice, given a guess value for $u$, one can iterate $\mathbf{\mathbf{\Sigma}}(u)\cdot \mathbf{\mathbf{E}}$ a sufficient number of times to determine its top eigenvector $v(\u03f5;u)$, and compute $\overline{\u03f5}(u)$ through
The value of $u$ is then tuned until $\overline{\u03f5}(u)=0$. For a graphical representation of the resolution procedure and details on the numerical scheme used, see Appendix 1—figure 4 and appendix Theoretical solution and eigenvalue equation.
Maximum likelihood parameters determination
Request a detailed protocolNine parameters of the model have been obtained through maximum likelihood fit of the data:
the conversion factor $\alpha $, which allows for conversion between experimental administered Ag dosage $D$, measured in micrograms, and the dimensionless administered Ag concentration of our model, $C=D/\alpha $.
the Ag consumption rate per Bcell ${k}_{B}^{}$, which controls the GC lifetime and also the extent of the affinity maturation.
the mean ${\mu}_{\text{naive}}$ and variance ${\sigma}_{\text{naive}}^{2}$ of the Gaussian binding energy distribution for the GC seeder clones, elicited directly from the naive population.
the binding energy threshold ${\u03f5}_{\text{Ag}}$ for a Bcell to be able to bind Ag with sufficient affinity to internalize it (cf Equation 1). This parameter does not appear in variant (C), where selection is mediated by Thelper cells only.
The Tcell selection characteristic coefficients, $a$ and $b$, encoding respectively the baseline probabilities to survive or not survive selection, see Equation 2 and Appendix 1—figure 1.D.
The weight parameters ${g}_{\text{recall}}$, ${g}_{\text{imm}}$, representing the MC fraction in the measured population of IgGSCs for the two protocols, respectively for schemes 2 and 3 with measurement one day after boost, and scheme 1 with measurement 4 days after second injection.
We use a procedure that maximizes the average likelihood of experimental affinity measurements. To do so, we perform the following steps:
For each of the 15 different experimental conditions $\mathcal{S}$ (five different dosages in scheme 1, plus seven different dosages in scheme 2, plus four different injection delays in scheme 3, minus the experiment at dosage 10 $\mu \mathrm{g}$ TT and 4 weeks delay between injection which is repeated, being present in both schemes 2 and 3) we evaluate the loglikelihood of the experimental measurements through
 (15) $\mathrm{ln}\mathcal{L}(\mathcal{S})=\sum _{s\in \mathcal{S}}\mathrm{ln}{\rho}_{\text{AbSC}}({\u03f5}_{s},\mathcal{S})$
where ${\{{\u03f5}_{s}\}}_{s\in \mathcal{S}}$ are the binding energy ($\mathrm{log}{K}_{D}$) singlecell measurements performed in condition $\mathcal{S}$, and ${\rho}_{\text{AbSC}}({\u03f5}_{s},\mathcal{S})$ is the normalized distribution of binding energies of AbSC predicted by the deterministic version of the model, and defined as a weighted sum of the normalized MC and PC distributions with MC fraction $g$: ${\rho}_{\text{AbSC}}({\u03f5}_{s},\mathcal{S})=g{\rho}_{\text{MC}}({\u03f5}_{s},\mathcal{S})+(1g){\rho}_{\text{PC}}({\u03f5}_{s},\mathcal{S})$. This fraction is either ${g}_{\text{recall}}$ or ${g}_{\text{imm}}$, depending on the condition $\mathcal{S}$ considered (scheme 2,3 or scheme 1). For good comparison with the data the final normalization is done for the part of the distribution inside the experimental sensitivity range $23.03={\u03f5}_{\mathrm{min}}<\u03f5<{\u03f5}_{\mathrm{max}}=14.51$. Notice that a measurement equal to ${\u03f5}_{\mathrm{min}}$ could in truth originate from any lower value of the energy, a situation not taken into account in the above expression for the loglikelihood. In our dataset, however, only four such measurements are present; they have a very weak influence on the results.
Last of all we sum the loglikelihoods over all the conditions $\mathcal{S}$ considered for the three different schemes to get the total loglikelihood:
 (16) $\mathrm{ln}{\mathcal{L}}_{tot}=\sum _{\mathcal{S}}\mathrm{ln}\mathcal{L}(\mathcal{S})$
We maximize this global loglikelihood over the space of the nine parameters through the implementation of the parallel tempering algorithm, whose details are specified in appendix section Maximum likelihood fit procedure and Appendix 1—figure 5 and 6. We chose this algorithm because it ensures an effective search of the maximum even in a rugged parameter landscape.
Notice that the total loglikelihood $\mathrm{ln}{\mathcal{L}}_{tot}$ is sensitive to the number of measurements, which can vary considerably between different conditions. As such when performing the maximization the algorithm favors accuracy over the distributions with the higher number of measurements. Notice also that by evaluating the total likelihood in this manner we neglect the fact that multiple single cell measurements can come from the same stochastic realization of the process and can present some degree of correlation. To validate this inference procedure we generated 10 synthetic datasets using our stochastic model (see Appendix 1—figure 11), with the same number of measurements per scheme as in the experimental dataset. We then inferred, for each synthetic dataset, the values of the parameters, and compared them to their groundtruth. On average all values of the parameters were correctly recovered, see appendix section Validation of inference procedure on artificially generated data and Appendix 1—table 1.
Code and data availability
Request a detailed protocolThe code containing the implementation of our stochastic and deterministic model is made publicly available in the following repository: https://github.com/mmolari/affinity_maturation; (Molari, 2020; copy archived at https://github.com/elifesciencespublications/affinity_maturation). The repository also includes the experimental dataset, the code to run the inference procedure and the code to reproduce the figures of the main paper (Figures 2–6). Please refer to README.md file for further details.
Appendix 1
1. Model definition and parameters choice
Mature GCs usually appear 5–7 days after Ag administration. During this time a population of up to hundreds different founder clones colonizes the GC and expands to a total size of a few thousand Bcells. The first mutations in the repertoire are observed around day 6 (Jacob et al., 1993; McHeyzerWilliams et al., 1993). Early GCs are highly polyclonal and contain 50 to 200 clones according to Tas et al., 2016. In agreement with these experimental findings at the time of Ag injection we pick a population of ${N}_{\text{found}}=100$ founder clones. The affinities of these clones are extracted independently from an initial gaussian distribution whose mean and variance are chosen via the maximumlikelihood procedure described in appendix sect. 4 ('Maximum likelihood fit procedure') and it matches the experimental distribution of germline responders (i.e. splenic IgGSCs that are observed 1 day after boost of pure Ag, Appendix 1—figure 7 in scheme two and Ag dosage $D=0$). During the time of GC formation the founder clones expand uniformly without mutating. We chose to start our simulation at ${T}_{\text{GC}}=6$ days after Ag injection. At this point, the GCs are almost fully formed (De Silva and Klein, 2015). The simulation starts with the GC at its maximal size, set to ${N}_{i}={N}_{\text{max}}=2500$ clones. The maximal size is in agreement with (Eisen, 2014) which reports around 3000 cells per GC, or (Tas et al., 2016) in which GCs are said to contain up to a few thousands Bcells. However, we stress that GCs are heterogeneous in size (Wittenbrink et al., 2011).
From here the model proceeds in evolution rounds. Similarly to Wang et al., 2015 we set the duration of a round to $T}_{\text{turn}}=12\phantom{\rule{thinmathspace}{0ex}}\mathrm{h$. This number is consistent with timing of cell migration (Victora et al., 2010; Mesin et al., 2016). We neglect the fact that high affinity cells are found to dwell longer in the GC dark zone (Gitlin et al., 2014) undergoing additional divisions. In addition to this the fact that the average cellcycle time is 12 hr or longer (Allen et al., 2007b) indicates that 12 hr is probably a lower limit for the round duration.
As described in the main text each round consists in cell division with somatic hypermutation, selection for Ag binding, selection for Tcell help and differentiation. In our simulations before starting the first round we perform only once differentiation. This is done in order to recover the good average energy limit at low Ag concentrations. In fact when Ag dosage is small the population quickly goes extinct, while at the same time maturating very fast. Performing differentiation first provides a nucleus of lowaffinity germlinelike clones whose binding energy controls the average binding energy of the MC population, even if few highaffinity clones are added later. Notice that this does not change the asymptotic behavior of the model, since it would be equivalent to simply changing the order of operations in the round.
Proceeding with the standard turn order then the first operation performed is cell division and somatic hypermutation. During a round we consider cells to divide twice (Mesin et al., 2016). In GC dark zone cells upregulate their expression of ActivationInduced Cytidine Deaminase. This enzyme increases the DNA mutation rate, inducing mutations in the region coding for the BCR and possibly changing the affinity for the Ag. Mutation rate has been estimated to an average of 10^{3} mutations per base pair per division (McKean et al., 1984; Kleinstein et al., 2003). Similarly to Wang et al., 2015 in which the total binding energy consisted in the sum of contributions from 46 different residues, we consider ${N}_{\text{res}}=50$ residues to contribute to the binding energy. The probability that upon division at least a mutation occurs in any of the 150 bp coding for these residues can be estimated as ${p}_{\text{mut}}=1{(1{10}^{3})}^{150}\sim 0.14$. As done in Wang et al., 2015; Zhang and Shakhnovich, 2010; Wang, 2017 at every division and for each daughter cell independently we consider a ${p}_{\text{sil}}=.5$ probability of developing a silent mutation, in which case the binding energy of the daughter cell remains unchanged, a probability ${p}_{\text{let}}=.3$ of undergoing a lethal mutation, in which case the cell is removed, and finally a probability ${p}_{\text{aa}}=.2$ of developing an affinityaffecting mutation. These change the binding energy of the daughter cell by adding a variation $\u03f5\to \u03f5+\mathrm{\Delta}\u03f5$. As done in Wang, 2017 the variation follows a lognormal distribution ${K}_{\text{aa}}(\mathrm{\Delta}\u03f5)$ (Appendix 1—figure 1A)
The parameters of the distribution are chosen so that only 5% of the mutations confer an increase in affinity, while the vast majority causes an affinity decrease. As a result of this process after the two mutations the population size increases almost 4fold in size (two duplications but some cells are eliminated due to lethal mutations) and the average affinity decreases slightly due to the mainly negative effect of mutations (cf Figure 1 main text, histograms 1 to 2).
After duplication we implement selection. In order to avoid apoptosis cells must bind and internalize a sufficient amount of Ag. The amount of Ag internalized depends both on the affinity of the BCR and on the availability of Ag on the surface of the FDC (Nowosad et al., 2016; Knežević et al., 2018; Batista and Neuberger, 2000). We model this process by expressing the probability of survival of a cell with BCR having binding energy $\u03f5$ as described in the main text:
A sketch of this function is shown in Appendix 1—figure 1C. The value of the threshold binding energy has been obtained via maximum likelihood fit of the data, which yields for example ${\u03f5}_{\text{Ag}}=13.59$ for variant A. This selection is not in present variant C of the model.
At the second step of selection, the one leading maturation in our model, Bcells compete to receive a survival signal from Tcells. Tcells in GCs are motile and continuously scan the surface of Bcells, sensing for density of pMHCII complexes (Shulman et al., 2014). Cells with the highest pMHCII density receive survival signal preferentially (Depoil et al., 2005; Victora and Nussenzweig, 2012). We again express the probability of survival through
The parameters $a$ and $b$ in Equation 20 represent, respectively, the probability of survival at very high energy and the deficit in probability of survival at very low binding energy. Their effect is better discussed in appendix section (Permissive and stochastic selection: effect of a, b parameters). The formula interpolates smoothly between these two values, as depicted in Appendix 1—figure 1D. The threshold binding energy $\overline{\u03f5}$ depends on the population’s binding energy distribution, introducing competition between the cells; the symbol ${\u27e8\cdot \u27e9}_{GC}$ indicates the average of the quantity over the current GC population.
Cells that are able to survive selection can either reenter the dark zone and start a new round of evolution or differentiate into Abproducing PCs or quiescent MCs that can be reactivated upon future Ag injection. There is evidence that MC/PC output undergoes a temporal switch: MCs are preferentially produced early in the response (Weisel et al., 2016). Moreover there seems to be an affinity bias in differentiation (Shinnakasu and Kurosaki, 2017). Even though experiments show that affinity plays a role in deciding fate (Shinnakasu et al., 2016) simply by implementing a timeswitch in the MC/PC differentiation probability (respectively ${\mu}_{\text{MC}}$, ${\mu}_{\text{PC}}$, Appendix 1—figure 1B) we effectively recover both of these observations. The parameters of these functions (${\tau}_{\text{diff}}=11d$, $\mathrm{\Delta}{\tau}_{\text{diff}}=2d$) are chosen so as to be compatible with Weisel et al., 2016:
Notice that the sum of the two is constant ${\mu}_{\text{MC}}(t)+{\mu}_{\text{PC}}(t)={p}_{\text{diff}}=10\%$, compatible with seminal studies (Oprea and Perelson, 1997) that estimated that around 90% of the cells recirculate in the dark zone. In the model we consider for simplicity a complete switch, meaning that for $t\gg {\tau}_{\text{diff}}$ the probability of generating MCs decreases asymptotically to zero. In appendix section (Permissive and stochastic selection: effect of a, b parameters), we discuss the more realistic case of a partial switch, in which there is a residual probability of MC production even for $t\gg {\tau}_{\text{diff}}$.
If new Ag is administered, we consider a new GCR to start. The new GC is colonized partly by new Bcells coming from the naive pool and partly by reactivated MCs (Inoue et al., 2018). We allow only MCs that have already been generated at time of the second injection to colonize the new GC. This is done by picking a set of ${N}_{i}=2500$ cells from the naive pool, with binding energies extracted from the same initial Gaussian distribution, and adding to them all the MCs generated up to the time of second injection. The founder clones of the new GC will consist of ${N}_{found}=100$ cells randomly extracted from this cumulative population. Notice that the probability of extracting a MC from the cumulative population is an increasing function of the number ${N}_{\text{MC}}$ of MCs extracted at time of injection: $p={N}_{\text{MC}}/({N}_{i}+{N}_{\text{MC}})$. In appendix sect. 12 we discuss instead the case in which the probability of extracting a seeder clone from the memory pool is set to a constant $p=0.3$.
The concentration of Ag evolves as explained in the main text according to the differential Equations 5 and 6 (main text). These equations account for Ag release, decay and consumption. The release rate was evaluated considering a halflife of 17 hr for Ag in CFA (MacLean et al., 2001), which gives a value for the release rate of $k}^{+}=\mathrm{ln}2/{\tau}_{1/2}\sim 0.98\phantom{\rule{thinmathspace}{0ex}}/\mathrm{d$. Ag on FDCs can be maintained for a long time, up to a year (Heesters et al., 2014), through a mechanism of endocytosis and recycling of immune complexes (Heesters et al., 2013). To reproduce this long clearance time, we take Ag lifetime to be 8.1 weeks, as measured in popliteal lymph nodes of mice (Tew and Mandel, 1979). This results in a Ag decay rate of $k}_{\varnothing}^{}=\mathrm{ln}2/{\tau}_{1/2}\sim 0.012\phantom{\rule{thinmathspace}{0ex}}/\mathrm{d$. The case of a faster Agdecay is discussed in appendix sect. 6 ('Possible model variations'). Finally, the consumption rate per Bcell $k}_{B}^{}=2.07\times {10}^{5}\phantom{\rule{thinmathspace}{0ex}}/\mathrm{d$ (variant C, see main text) is obtained via the maximum likelihood fit procedure described in appendix sect. 4 ('Maximum likelihood fit procedure'). This quantity controls both the GC lifetime and the extent of AM at the end of evolution. For the range of Ag dosages considered simulated GCs have an effective lifetime that vary between 1 or 2 weeks and 3 months (Appendix 1—figure 2E), compatible with lifetimes of real GCs (Victora and Mouquet, 2018). Equations 5 and 6 (main text) are continuous in time. To include them in our discrete timestep model, we perform an update of the values of the reservoir and available concentrations ${C}_{\text{av}}(t)$, ${C}_{\text{res}}(t)$ at each round $t=0,1,\mathrm{\dots}$ after selection for Tcell help and before differentiation. The Ag removal rate is given by the cumulative effect of decay and consumption: ${k}_{t}^{}={k}_{\mathrm{\varnothing}}^{}+{N}_{t}^{B}{k}_{B}^{}$, and changes at each evolution round due to its dependence on the number of Bcells ${N}_{t}^{B}$ at this stage of the round. The values of the concentrations at the next round $t+1$ are obtained by evolving the corresponding quantities at round $t$ for a time $T=12\phantom{\rule{thinmathspace}{0ex}}\mathrm{h}$ equivalent to the duration of the round:
At times smaller than the GC formation time $T}_{\text{GC}}=6\phantom{\rule{thinmathspace}{0ex}}\mathrm{d$ we do not account for GC evolution but we account for the evolution of concentration. This is done as in the previous equations but in this case the total consumption rate is evaluated considering an exponentially increasing number of cells, that starting from one at injection exponentially grows to ${N}_{\text{max}}$ at the time of GC formation. In particular concentration update at the end of round $t=0,1,\mathrm{\dots},11$ is done considering the following number of Bcells consuming Ag:
In our simulations, GC evolution stops either naturally when Ag depletion leads to population extinction, or when the total simulation time is elapsed and cells are harvested, in which case the simulation is stopped irrespective of the population size and only cells produced up to that point are considered. The total simulation time depends on the immunization scheme considered and is set to match the time elapsed between injection and experimental measurement.
2. Stochastic model analysis
In order to have some insight on the way our stochastic model evolves and to gauge the magnitude of stochastic effects in Appendix 1—figure 2A to D we report the average evolution of 1000 independent GC Reaction (GCR) simulations, performed at an injected Ag dosage of $D=1\mu \mathrm{g}$. The average trajectory is reported as a black dashed line and shaded area covers one standard deviation around the mean. Increase of noise in the average binding energy of GC Bcells as a function of time is due to the fact that at each time the average is performed only over the surviving GCs, thus as progressively GCRs end the average becomes more noisy (and also becomes biased to represent only surviving trajectories). We compare the evolution of the stochastic model with the theoretical prediction (orangle lines). As observed in the main text the theoretical prediction performs well at high population size, and loses accuracy for small population sizes (Appendix 1—figure 2A, C). However, since most of the MC and PC population is generated at time of high population expansion the average energy of these two populations is always well estimated (Appendix 1—figure 2B, D). The inaccuracy at small population sizes comes mainly from an overestimation of the selection pressure in our theoretical solution. In fact, the threshold binding energy for Tcell selection $\overline{\u03f5}$ (cf appendix Equation 20) is sensitive to the highaffinity tail of the population affinity distribution. As the population size diminishes this tail gets progressively less populated and the value of $\overline{\u03f5}$ deviates from its theoretical prediction, evaluated under the infinitesize limit. This slight decrease of selection pressure at the end of the GC lifetime increases slightly the survival time and generates a slight slowdown in maturation. Moreover, in order to estimate the lifetime of GCs in our model we evaluate average and standard deviation of lifetimes of 1000 independent GC simulations for different values of injected Ag dosage. Since in the simulations GCs can also have a more or less long period of small population size prior to extinction (Appendix 1—figure 2A) we also evaluate an ‘effective’ lifetime, considering the GC effectively extinguished when its size reaches 1% of its original size. These lifetimes (Appendix 1—figure 2E) depend on the amount of Ag administered and can vary between few weeks to few months. The same overestimation of the selection pressure at small population sizes leads the theory to slightly underestimate the lifetime of stochastic simulations.
Recent experiments estimated the number of different clones in early GC to be between 50 and 200 (Tas et al., 2016). In our stochastic model, we consider the population of founder clones to be composed of 100 cells. The limited number of founders controls the diversity of the initial population and increases the stochasticity in evolution. However, it does not strongly influence the average outcome. To verify this we compare 1000 stochastic simulations of the standard model (single Ag injection of $D=1\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ of Ag, model scenario C) with a modified version in which the number of founder clones was set equal to the number of cells in the initial population (2500 cells). Results are reported in Appendix 1—figure 3A to D. We observe that limiting the initial population diversity increases stochasticity in evolution, but does not impact much the average evolution trajectory and outcome. This is especially evident when observing MC/PC population evolution (panels B and D). The final average binding energies of these populations are very similar, but the standard deviation around the mean is halved in for the initial population with more founders.
This observation raises the question of how much the outcome of evolution is controlled by the particular initial choice of the founder clones. In Appendix 1—figure 3E to H we quantify this by comparing 1000 stochastic GC evolutions of the standard model (injected Ag dosage $D=1\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$, model scenario C), in which the founder population was reextracted every time, with a modified version in which the founder population was kept the same amongst all stochastic trials. In the latter case, we observe a considerable reduction in stochasticity, indicating that the outcome depends strongly on the initial founder clones choice. This is also in line with the observations made in section 'Maturation induces progressive loss of clonality' and Figure 3D (main text), where we show that the presence of a highaffinity founder clones correlates with a stronger homogenizing selection.
3. Theoretical solution and eigenvalue equation
As described in the main text the theoretical solution of the model is obtained by performing the limit of infinite size ${N}_{B}\to \mathrm{\infty}$, upon which the evolution of the system becomes deterministic. All the stochastic processes can be implemented via an operator, whose explicit expression is provided in Materials and methods, and which acts on the distribution $\rho (\u03f5)$. This function is the product between the binding energy distribution of the population and the population size. In this formalism, the total evolution operator is a combination of the duplication and mutation, selection, normalization and differentiation operators: $\mathbf{\mathbf{E}}=\mathbf{\mathbf{D}}\mathbf{\mathbf{N}}{\mathbf{\mathbf{S}}}_{\text{T}}{\mathbf{\mathbf{S}}}_{\text{Ag}}\mathbf{\mathbf{R}}$, where the operator $\mathbf{\mathbf{R}}=\mathbf{\mathbf{M}}\mathbf{\mathbf{A}}\mathbf{\mathbf{M}}\mathbf{\mathbf{A}}$ encodes for two rounds of duplication with mutation. The mutation operator $\mathbf{\mathbf{M}}$ in particular consists in a convolution of the distribution $\rho $ with a mutation kernel ${K}_{\text{eff}}(\mathrm{\Delta}\u03f5)$ lethal, silent and affinityaffecting nature of the mutations. This kernel is defined as follows:
The first term corresponds to affinityaffecting mutations, whose probability is the product between the probability of developing a mutation and the probability for this mutation to be affinityaffecting ${p}_{\text{mut}}{p}_{\text{aa}}$. The expression for the affinityaffecting mutation probability ${K}_{\text{aa}}(\mathrm{\Delta}\u03f5)$ is the one in Equation 18. The second term encodes silent mutations, occurring with probability ${p}_{\text{mut}}{p}_{\text{s}}$, and also absence of mutations, with probability $1{p}_{\text{mut}}$. Lethal mutations occurs with probability ${p}_{\text{mut}}{p}_{\text{l}}$ but since their effect is the removal of cells in the population this contribution is multiplied by zero and is not present in the kernel expression. The contribution of lethal mutation makes so that the normalization of this kernel is not unitary: $\int \mathit{d}\mathrm{\Delta}\u03f5{K}_{\text{eff}}(\mathrm{\Delta}\u03f5)=1{p}_{\text{mut}}{p}_{\text{l}}$. In the main text, we show how under constant Ag concentration the affinity distribution of the population behaves as a traveling wave whose velocity and growth rate can be found via an eigenvalue equation. This eigenvalue equation reads $\mathbf{\mathbf{\Sigma}}(u)\mathbf{\mathbf{E}}\rho ={e}^{\varphi}\rho $, where $\mathbf{\mathbf{\Sigma}}(\mathrm{\Delta})$ is the translation operator that shifts the distribution of a value $\u03f5\to \u03f5+\mathrm{\Delta}$ and we consider the restricted evolution operator $\mathbf{\mathbf{E}}=\mathbf{\mathbf{D}}{\mathbf{\mathbf{S}}}_{\text{T}}\mathbf{\mathbf{R}}$.
To verify the correctness of our eigenvalue equation theoretical prediction, we solve the eigenvalue problem at a given Ag concentration $C=10$, graphically illustrating the procedure, and show that the theoretical prediction matches the asymptotic behavior of the system. As a first step we set the value of $\overline{\u03f5}=0$ in the Tcell help selection operator. This choice constitutes simply a gaugefixing that removes the translational invariance of our solution, and it also linearizes the evolution operator. Since we do not a priori know the value of the shift $\mathrm{\Delta}$ we solve the eigenvalue equation $\mathbf{\mathbf{\Sigma}}(\mathrm{\Delta})\mathbf{\mathbf{E}}\rho ={e}^{\varphi}\rho $ for different values of the shift. In Appendix 1—figure 4 we plot the maximum eigenvalue eigenvectors (distributions in A, color encodes the value of $\mathrm{\Delta}$) and their corresponding logeigenvalues (C, representing the growth rate) as a function of the shift $\mathrm{\Delta}$. In order for our solution to be consistent it must satisfy the condition $\overline{\u03f5}=0$. Therefore we evaluate $\overline{\u03f5}$ after performing mutations for all the solutions at varying values of the shift (Appendix 1—figure 4B) and we pick the one (${\mathrm{\Delta}}^{*}$) for which this condition is satisfied as the eigenproblem solution. Upon repeated application of the restricted evolution operator we expect the population to asymptotically grow and shift at the values of ${\varphi}^{*}$ and $u={\mathrm{\Delta}}^{*}$ corresponding to this solution. In Appendix 1—figure 4D, we verify this by plotting the evolution of the normalized affinity distribution of the population, reshifted on its mean, upon repeated application of the evolution operator, and compare it with the eigenproblem solution (black dashed lines). Moreover, in E and F we compare the instantaneous growth rate and energy shift with the eigenproblem solution predictions. Color in the three plots encodes to the evolution round. We observe that in all three cases the asymptotic prediction is matched.
To numerically solve the eigenvalue equation and obtain the results displayed in Appendix 1—figure 4, operators were implemented as square matrices by discretizing the interval of energy $[10,20]{k}_{B}T$ with a discretization step of $0.002{k}_{B}T$. The maximum eigenvalue and corresponding eigenvector were obtained by repeated application of the restricted evolution and shift operators on an initially normal distribution with zero mean and unit variance. The application was repeated until the L1 distance between the normalized distributions before and after application of the operator was less than 10^{5}. This numerical procedure however is computationally expensive, since solving the eigenproblem for a particular value of the Ag concentration $C$ requires the creation and repeated application of large matrices for many values of the shift $\mathrm{\Delta}$. A less demanding numerical method to obtain the value of μ and $\varphi$ consists in simply simulating the evolution of the population under constant Ag concentration $C$, and without carrying capacity constraint and Agbinding selection, until convergence to the asymptotic travellingwave state is reached with sufficient precision. This second technique was used to evaluate the values of $u$ and $\varphi$ displayed in Figure 4B. In this case, the simulation domain was set to the interval $[100,50]{k}_{B}T$, with a discretization step of $0.01{k}_{B}T$. Evolution of the distribution of binding energies was repeated until the following three conditions were met at the same time. First, the L1 distance between the normalized distributions before and after evolution, once they were recentered around their mean, was less than 5 × 10^{5}. Second, the relative change of the growth rate and wave speed between two rounds of evolution was less than 5 × 10^{5}. Finally, as a safety check we also require that at the moment of convergence the mean of the distribution is more than five standard deviations away from the boundaries of the simulation domain.
4. Maximum likelihood fit procedure
Nine model parameters $\mathbf{\mathbf{p}}$ = (${\mu}_{\text{naive}}$, ${\sigma}_{\text{naive}}$, ${\u03f5}_{\text{Ag}}$, ${k}_{B}^{}$, $\alpha $, $a$, $b$, ${g}_{\text{recall}}$, ${g}_{\text{imm}}$) were inferred via the maximum likelihood procedure described in Materials and methods. This procedure makes use of the full experimental affinity distribution. Here, we give a more detailed description of the procedure and add considerations on the variation range of the parameters.
The stochastic maximization procedure is based on an implementation of the Parallel Tempering technique. This technique, used in the context of molecular dynamics simulations (Sugita and Okamoto, 1999), consists in simulating different copies of a system at different temperatures, and then allowing the copies to exchange their states with adequate probabilities so that lowenergy states are correctly sampled at low temperatures. This is particularly advantageous when the energy landscape is rugged, and lowtemperature simulations tend to get stuck in local energy minima, while hightemperature simulation explore the whole space without being able to locate the minima precisely. Allowing for stateexchange between different temperature simulations makes so that hightemperature simulations can help lowtemperature ones exit local minima in the energy space and converge to the global optimum, Appendix 1—figure 5A.
Here, we consider the space of all possible values of the parameters as our configuration space, and use the loglikelihood (see Materials and methods for definition) as a proxy for minus the energy. Our algorithm can be summarized as follows. A number $N=10$ of copies of the parameter set is initialized, and at each copy is assigned a simulation temperature $T$ logarithmically evenly spaced between 10^{3} and 10^{3}. The maximization procedure consists in 10,000 rounds of iterative parameter changes and temperature exchanges. For each proposed parameter change, the likelihood difference $\mathrm{\Delta}\mathrm{log}\mathcal{L}$ between the new and the original set of parameters is evaluated, and the change is accepted with probability $\mathrm{min}\{\mathrm{exp}\{\mathrm{\Delta}\mathrm{log}\mathcal{L}/T\},1\}$, where $T$ is the temperature associated to the parameter set. In the exchange phase the difference in loglikelihood $\mathrm{\Delta}\mathrm{log}\mathcal{L}$ and in inverse temperature $\mathrm{\Delta}\beta $ is evaluated for any two parameters sets with consecutive temperatures. An exchange of the two parameters sets is then performed with probability $\mathrm{min}\{\mathrm{exp}\{\mathrm{\Delta}\beta \mathrm{\Delta}\mathrm{log}\mathcal{L}\},1\}$. At the end of the last round the value of the parameters ${\mathbf{\mathbf{p}}}_{\text{best}}$ that maximized the likelihood is returned. In Appendix 1—figure 5B we report the trajectories in energy space of all the parameter sets for the inference performed using variant C of selection (see main text), in which eight parameters are inferred (all but the threshold binding energy ${\u03f5}_{\text{Ag}}$, which is removed in this variant). The energy for each parameter set is evaluated from the difference in loglikelihood with the best value, $\mathrm{\Delta}E=\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{\text{best}})\mathrm{log}\mathcal{L}(\mathbf{\mathbf{p}})$. Notice how trajectories at high temperature explore the space by being able to visit lowlikelihood (highenergy) zones of the parameter space. Conversely, lowtemperature trajectories gradually converge to the value of the parameters that maximizes the likelihood.
The likelihoodmaximization procedure is algorithmically described by the following pseudocode:
Algorithm: Stochastic likelihood maximization procedure 
Given the initial parameters choice ${\mathbf{\mathbf{p}}}_{\mathbf{\mathbf{i}\mathbf{n}\mathbf{i}\mathbf{t}}}$; Initialize 10 copies of the system with parameter value ${\mathbf{\mathbf{p}}}_{i}^{0}={\mathbf{\mathbf{p}}}_{\mathbf{\mathbf{i}\mathbf{n}\mathbf{i}\mathbf{t}}}$ for $i=1\mathrm{\dots}10$; Set the simulation temperature of each copy of the system at ${T}_{i}={10}^{(112i)/3}$, so that ${T}_{1}={10}^{3}$ and ${T}_{10}={10}^{3}$; for $t=1$ to 10'000 do: for $i=1$ to 10 do: Generate a new randomly mutated parameter set ${\mathbf{\mathbf{p}}}_{i}^{\prime}={\mathbf{\mathbf{p}}}_{i}^{t1}+\mathrm{\Delta}{\mathbf{\mathbf{p}}}_{i}$ according to the rule specified in the text; Evaluate the loglikelihood difference induced by the new set of parameters $\mathrm{\Delta}\mathrm{log}\mathcal{L}=\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{i}^{\prime})\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{i}^{t1})$ ; With probability $\mathrm{min}\{\mathrm{exp}\{\mathrm{\Delta}\mathrm{log}\mathcal{L}/{T}_{i}\},1\}$ accept $\mathbf{p}}_{i}^{t}\leftarrow {\mathbf{p}}_{i}^{\mathrm{\prime}$ or else keep $\mathbf{p}}_{i}^{t}\leftarrow {\mathbf{p}}_{i}^{t1$ ; for for $i$ to 9 do Evaluate the likelihood difference $\mathrm{\Delta}\mathrm{log}\mathcal{L}=\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{i+1}^{t})\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{i}^{t})$ between two adjacent copies of the model; Evaluate the inverse temperature difference $\mathrm{\Delta}\beta =1/{T}_{i+1}1/{T}_{i}$; With probability $\mathrm{min}\{\mathrm{exp}\{\mathrm{\Delta}\beta \mathrm{\Delta}\mathrm{log}\mathcal{L}\},1\}$ perform the state exchange ${\mathbf{\mathbf{p}}}_{i}^{t}\leftrightarrow {\mathbf{\mathbf{p}}}_{i+1}^{t}$; Find $({i}^{*},{t}^{*})=\mathrm{arg}{\mathrm{max}}_{(i,t)}\{\mathrm{log}\mathcal{L}({\mathbf{\mathbf{p}}}_{i}^{t})\}$; return ${\mathbf{\mathbf{p}}}_{\text{best}}={\mathbf{\mathbf{p}}}_{{i}^{*}}^{{t}^{*}}$ 
Where the initial parameters choice was set to ${\mathbf{p}}_{\mathbf{i}\mathbf{n}\mathbf{i}\mathbf{t}}=({\mu}_{\text{naive}}=14.6$, ${\sigma}_{\text{naive}}=1.6$, ${\u03f5}_{\text{Ag}}=13.6$, $k}_{B}^{}=2\times {10}^{5}\phantom{\rule{thinmathspace}{0ex}}/\mathrm{d$, $\alpha =0.025\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$, $a=b=0.2$, ${g}_{\text{recall}}={g}_{\text{imm}}=0.5)$. Single parameter changes are generated as a function of noise level $\eta $:
For ${\mu}_{\text{naive}}$, ${\u03f5}_{\text{Ag}}$ variation is performed by adding a random number extracted with uniform probability in the interval $[10\eta ,+10\eta ]$.
For positive parameters ${\sigma}_{\text{naive}}$, $\alpha $, ${k}_{B}^{}$ the variation is performed multiplicatively by introducing a percentage change of the parameter uniformly extracted in the interval $[\eta ,\eta ]$.
For the fractions ${g}_{\text{recall}}$, ${g}_{\text{imm}}$, $a$ and $b$ variations are performed by adding a random number uniformly extracted in the interval $[\eta ,+\eta ]$. After the addition some constraints are enforced: the resulting number is constrained in the interval [0, 1], and as a consequence of the definition of the survival probability (Equations 19, 20) also $a+b\le 1$ is imposed.
We set the noise level to depend on the temperature of the system considered, so that highertemperature simulations also have a higher level of noise, allowing them a faster exploration of the parameter space, while low temperature simulation will perform only a finetuning of the parameters. This allows for a more precise convergence. In particular we set $\eta $ to be logarithmically evenly spaced between 10^{2} and 10^{1}. Furthermore we propose changes for all the parameters for the four highertemperature simulations, while changes affect only one randomly chosen parameter for the four lowertemperature simulations.
In Appendix 1—figure 6, we display the evolution of the parameter set that reaches the highest loglikelihood during the maximization procedure. In Appendix 1—figure 6A we report the loglikelihood and the temperature as a function of the round of maximization. Notice how hightemperature states correlate with big fluctuations in the loglikelyhood and in the values of parameters. The peak likelihood value is reached at round 9970, when the trajectory was at the lowest temperature. In Appendix 1—figure 6B we report the evolution of the nine parameters during the maximization rounds. Orange shaded area cover one standard deviation of the posterior distribution around the maximumlikelihood estimate (MLE) of the parameters. This was obtained by approximating the posterior with a Gaussian distribution around the ML value, with a quadratic fit of the loglikelihood variation $\mathrm{\Delta}\mathrm{log}\mathcal{L}$ generated by small variations (±5%) of single parameters around the MLE (Appendix 1—figure 6C).
For completeness in Appendix 1—figure 7, we report the comparison between the experimental measurements (orange histograms) and the maximumlikelihood fit of the theoretical model (blue curves) for all the different immunization schemes and all different values of the injected dosage $D$ and time delay between injections $\mathrm{\Delta}T$ used for the fit. All these distributions were used for the likelihood evaluation. The normalization of the distributions is done considering only the part inside the experimental sensitivity range. We find good agreement under all different schemes. Moreover we also report the comparison between the theoretical solution and the stochastic simulations of the model (green histograms, average over 1000 stochastic simulations). This comparison shows that for all regimes considered the theoretical solution is a very good approximation to the stochastic model.
This likelihood maximization procedure is very general and can be easily extended to the inference of any set of parameters in our model, or to other experimental datasets.
5. Permissive and stochastic selection: effect of $a$, $b$ parameters
Parameters $a$ and $b$ in Equations 19, 20 represent respectively the probability for a Bcell to pass or to fail a selection step irrespective from their affinity. Parameter $a$ can be related to the ‘permissiveness’ of selection, quantifying how likely is for a cell to be positively selected even if its affinity is small. Parameter $b$ conversely encodes the stochasticity in selection, by virtue of which even high affinity cells are not granted survival (e.g. if they don’t manage to encounter enough Tcells). For simplicity we define these parameters as constants, but one could immagine that their value may change over time, for example it may be related to the availability of Tcell help. Here we investigate the effect of these parameters on the asymptotic wavelike behavior of the system. This asymptotic behavior is characterized by two quantities: the asymptotic growth rate $\varphi (C)$ and the asymptotic maturation speed $u(C)$, as defined in the main text Equation 3. These quantities are functions of the Ag concentration $C$. In Appendix 1—figure 8 we report how these functions change when the parameters $a$ and $b$ are progressively increased. In these tests, we consider only the effect of one parameter at a time and we set the value of the other to its standard value $a=0.13$, $b=0.66$. By making the selection more permissive and allowing for survival of even lowaffinity cells, parameter $a$ has a double effect on the asymptotic behavior: on the one hand it decreases the asymptotic wave velocity and slows down maturation (Appendix 1—figure 8E), and on the other hand it increases the growth rate of the population (Appendix 1—figure 8C). On the contrary, increasing parameter $b$ corresponds to increasing the chance that highaffinity cells are selected out of the population. This both decreases the growth rate (Appendix 1—figure 8D) and also the maturation speed (Appendix 1—figure 8F).
The selection process in affinity maturation has both a purifying and promoting effect. On the one hand it must negatively select clones that accumulated negative mutations, purifying the population from lowfitness individuals. On the other hand, it must also grant the survival and amplification of the clones that developed affinityimproving mutations. These two properties of selection are weakened by parameters $a$ and $b$ in our model, since they respectively grant survival of lowaffinity clones and can cause the removal of highaffinity ones. According to our inference procedure parameters $a$ and $b$ together seem to account for 79% of the selection probability, making so that affinity can make the survival probability vary of only about 21%. This slows down maturation considerably, since it removes any deterrent against accumulating deleterious mutations. The fact that the inference procedure indicated a high value for these parameters suggests that selection in GCs may be permissive, at least for complex Ags, as suggested in Murugan et al., 2018.
6. Possible model variations
In order to test the relative importance of different model parameters we performed the inference procedure using three different variants for selection (see main text). Variant A corresponds to the inference of all nine inferred model parameters (${\mu}_{\text{naive}}$, ${\sigma}_{\text{naive}}$, ${k}_{B}^{}$, $\alpha $, $a$, $b$, ${g}_{\text{recall}}$, ${g}_{\text{imm}}$, ${\u03f5}_{\text{Ag}}$). Variant B corresponds to the case in which stochasticity and permissivity parameters $a$ and $b$ are set to zero and only the remaining seven parameters are inferred. In variant C instead Agbinding selection is neglected, and all eight parameters with the exclusion of ${\u03f5}_{\text{Ag}}$ are inferred. The resulting maximum likelihood estimate (MLE) of the parameters, along with the corresponding value of the likelihood, is reported for the three cases in Appendix 1—figure 9. The result of the inference procedure show that the removal of Agbinding selection (variant A vs C, 9 vs 8 parameters) causes only a very modest decrease in loglikelihood, while the removal of stochasticity in Tcell help selection (variant A vs B, 9 vs 7 parameters) generates a consistent loglikelihood decrease. As described in the main text, both the Bayesian Information Criterion (BIC) (Schwarz, 1978) and Akaike Information Criterion (AIC) (Akaike, 1974) are in support of removing the former but not the latter, and accept variant C.
Moreover, to show that the model is robust under minor modifications of the hypotheses we consider three minor variations, keeping variant C of selection, and show that they generate similar MLE predictions for the model parameters. First, we test the effect of introducing a residual asymptotic rate of MC/PC production. This case is labelled soft MC/PC timeswitch. For simplicity in the model we introduced a complete timeswitch between MC and PC production in GCs, making so that asymptotically only PCs are produced for $t\gg {\tau}_{\text{diff}}$ (cf appendix Equations 21, 22 and Appendix 1—figure 1B). In this modification instead we introduce a residual rate of MC/PC production ${\mu}_{\text{res}}=10\%$ modifying appendix Equations 21, 22 as:
This makes so that the fraction of MCs in the differentiated population interpolates between ∼90% at small times and ∼10% at big times, granting some residual production of MCs at all times. Applying the inference procedure on this more realistic version of the model results in a better final likelihood than the standard (variant C) version. The inferred values of the parameters are on average similar to the ones obtained with the standard version of the model, with the difference of ${g}_{\text{recall}}$ and ${g}_{\text{imm}}$. While the inequality ${g}_{\text{recall}}>{g}_{\text{imm}}$ still holds, the MLE for these parameter is higher than in the standard case. This can be expected since these parameters control the fraction of MCs in the elicited AbSC population, and in this version of the model the MC population contains differentiated cells that would have belonged to the PC compartment in the standard version.
A further modification involves the fraction of seeder clones extracted from the MC population when colonizing a GC. At the second injection some of the seeder clones for the new GC are extracted from the MC population generated following the first injection. The probability of extracting a seeder clone from the MC pool and not from the initial germline distribution depends in the standard version of the model on the number of accumulated memory cells ${N}_{\text{mem}}$ as ${p}_{\text{mem}}={N}_{\text{mem}}/({N}_{\text{mem}}+{N}_{i})$ (cf main text section Stochastic model for affinity maturation). This should account for the fact that intuitively if more MCs were produced in the previous maturation then also more should be recalled. However one could more simply suppose this probability to be constant. We test this case by setting ${p}_{\text{mem}}=0.3$. This change generates only a very small likelihood decrease with respect to the standard version of the model, while the MLE for all parameters is almost unchanged.
Finally, we also test the effect of increasing the rate of Ag decay, multiplying it by a factor three (case labelled faster Ag decay). This results in a slight increase in the maximum likelihood, and the values of all the model parameters are again compatible with the one of the standard version of the model, with the exception of the Ag consumption rate ${k}_{B}^{}$ which decreases to compensate the faster decay rate.
7. Quantifying beneficial and deleterious mutation events
To quantify the number and impact of mutation events in our simulations we execute 1000 stochastic simulations of a single GC, at an injected Ag dosage of $D=1\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$. In each simulation and for each cell we keep track of the number of beneficial and deleterious mutations that each cell accumulates during the course of evolution on the residues we consider (${N}_{\text{res}}=50$, see appendix sect. 1 Model definition and parameters choice). Results are reported in Appendix 1—figure 10. In the top row we display the average number of cells for any value of beneficial and deleterious mutations number and at different times: 10, 30 and 50 days after Ag injection. To have an idea of the population size and maturation state at these timepoints one can refer to Appendix 1—figure 2, in which stochastic simulations are performed under the same conditions. In our simulations after the first days of maturation deleterious mutations start to appear (see Appendix 1—figure 10, t = 10). These are the first mutations to appear since they are much more likely than beneficial mutations (95% vs 5%, see Appendix 1—figure 1A). However during the course of evolution these are gradually removed by selection, until eventually beneficial mutations, despite being much rarer, start to dominate (see Appendix 1—figure 10, t = 50).
In the bottom row of Appendix 1—figure 10 we display in the same way the number of mutations in the MC and PC population. The former is composed of cells that differentiate early ( Appendix 1—figure 1B and Equations 21, 22) and therefore bear less mutations than the PC population. However, in both cases the vast majority of cells harbor very few mutations, with the average number of mutations per cell being 0.13 for MCs and 0.54 for PCs. The accumulation of more than 4–5 beneficial mutations in a single cell is very rare. These numbers are compatible with experiments performed in a recent work (Gérard et al., 2020), in which mice were immunized against Tetanus Toxoid following a protocol similar to the one used in our experiments. The analysis of highaffinity binders showed an average of 6 nonsynonymous mutations on the antibody heavychain variable region ${V}_{H}$ and three mutations in the lightchain variable region ${V}_{L}$.
Our model neglects saturation of beneficial mutations, that is the phenomenon by which beneficial mutations cannot be accumulated indefinitely but become rarer as the cell approaches maximum possible affinity. This is partly justified here by the observation that, at least for the inferred value of model parameters, few beneficial mutations are found to accumulate in our simulations. Even when considering clones with the highest number of beneficial mutations, the number of mutations accumulated in our model is compatible with experiments (Gérard et al., 2020). As a final remark, notice that even though MCs are not as strongly skewed towards beneficial mutations as PCs, their average affinity is higher than the one of the starting population (cf Appendix 1—figure 2B). This is because amongst the founder clones selection will expand the ones having higher affinity (cf Figure 3), which will then be overlyrepresented in the MC population. This shows that in our model maturation is achieved only partially by accumulation of beneficial mutations, the rest being obtained through selective expansion of highaffinity precursors, as also shown in section 'Maturation induces progressive loss of clonality' of the main paper, and confirmed by the strong dependence of the maturation outcome on the initial founder clones population (see Appendix 1—figure 3E to H).
8. Validation of inference procedure on artificially generated data
To test the reliability of our inference algorithm we generate 10 artificial datasets using our stochastic model and we apply to them the inference procedure. We then compare the inferred values of the parameters with the real value used to generate the data. To verify that the experimental measurements at our disposal are sufficient to infer the model parameters, when generating the data we took into account the size and composition of the experimental dataset. In particular, we generate each artificial dataset as follows. For every experimentally tested conditions (15 conditions in total, consisting in five tested dosages for scheme 1, seven dosages for scheme 2 and 4 delays for scheme 3, with condition $D=10\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ and $\mathrm{\Delta}T$ = 4 weeks shared between scheme 2 and 3) we run as many stochastic simulations as mice tested for that particular condition. Then from every simulation we extract from the responders population a number of cells equal to the one obtained from each mouse. Extraction of cells is done keeping into account the experimental detection range, therefore we exclude cells having affinity lower that $K}_{d}=500\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$, and set any affinity higher than the highaffinity threshold $K}_{d}=0.1\phantom{\rule{thinmathspace}{0ex}}\mathrm{n}\mathrm{M$ equal to the threshold. Stochastic simulations of each scheme are done in model scenario C, using the standard value of the parameters with one exception: to account for the fact that each mouse contains multiple GCs we raised the number of founder clones in each GC to 2500 instead of 100. This amounts to introducing a greater diversity in the initial population, which in turns reduces the stochasticity in the evolution outcome (see also Appendix 1—figure 3A to D and appendix sect. 2 'Stochastic model analysis') and is similar in spirit to averaging between multiple GCs, as it is the case for the experimental measurements of cells extracted from the spleen of mice. This generation procedure was reexecuted 10 times, resulting in 10 different datasets. As an example, in Appendix 1—figure 11B we show the binding energy distribution of the 10 generated datasets for condition $D=0.5\phantom{\rule{thinmathspace}{0ex}}\mu \mathrm{g}$ of Ag in scheme 2 (histograms in gray). The histograms are close to the prediction of the deterministic model (blue curves), but with some deviations due to stochastic sampling. The average binding energy of the population for all considered condition is reported in Appendix 1—figure 11A. Again, the average binding energy of the generated populations (gray crosses) is close to the prediction of the deterministic model (blue dot), and as expected the noise is higher for the conditions where a smaller amount of experimental measurement was performed (compare with number of measurements displayed in Appendix 1—figure 7).
We then run the inference procedure on each artificially generated dataset, using the same setup and initial condition as the ones used to infer model parameters on the real data, under scenario C. The average results of the inference are reported in Appendix 1—table 1. For every model parameter, the average inferred value is close to the real value used to generate the data, demonstrating that the amount of experimental measurements at our disposal are sufficient for a good recovery of the model parameters.
Data availability
All the data analysed in this work are reported in the supporting excel file attached to the submission. These data come from (1) new experiments reported in the present work, and (2) previously published experiments, see Eyer et al., 2017 (referenced in manuscript). The code containing the implementation of our stochastic and deterministic model is made publicly available in the following repository: https://github.com/mmolari/affinity_maturation (copy archived at https://github.com/elifesciencespublications/affinity_maturation). The repository also includes the experimental dataset, the code to run the inference procedure and the code to reproduce the figures of the main paper (Figures 2 to 6). Please refer to README.md file for further details.
References

BookA new look at the statistical model identificationIn: Parzen E, Tanabe K, Kitagawa G, editors. Selected Papers of Hirotugu Akaike. Springer. pp. 215–222.https://doi.org/10.1007/9781461216940

Mechanisms of Action of AdjuvantsFrontiers in Immunology 4:114.https://doi.org/10.3389/fimmu.2013.00114

The effect of the dose of bacterial polysaccharide antigen on antibody production in miceJournal of Bacteriology 67:123–124.https://doi.org/10.1128/JB.67.1.123124.1954

Germinal centers: programmed for affinity maturation and antibody diversificationCurrent Opinion in Immunology 45:21–30.https://doi.org/10.1016/j.coi.2016.12.004

Calculating germinal centre reactionsCurrent Opinion in Systems Biology 18:1–8.https://doi.org/10.1016/j.coisb.2019.10.004

Cutting edge: longterm B cell memory in humans after smallpox vaccinationThe Journal of Immunology 171:4969–4973.https://doi.org/10.4049/jimmunol.171.10.4969

Dynamics of B cells in germinal centresNature Reviews Immunology 15:137–148.https://doi.org/10.1038/nri3804

Multiple layers of B cell memory with different effector functionsNature Immunology 10:1292–1299.https://doi.org/10.1038/ni.1814

Inferring processes underlying Bcell repertoire diversityPhilosophical Transactions of the Royal Society B: Biological Sciences 370:20140243.https://doi.org/10.1098/rstb.2014.0243

Specific in vivo and in vitro antibody response to tetanus toxoid immunizationClinical and Experimental Immunology 49:552.

Singlecell deep phenotyping of IgGsecreting cells for highresolution immune monitoringNature Biotechnology 35:977–982.https://doi.org/10.1038/nbt.3964

The quantitative assessment of the secreted IgG repertoire after recall to evaluate the quality of immunizationsThe Journal of Immunology In press.

Germinal center responses to complex antigensImmunological Reviews 284:42–50.https://doi.org/10.1111/imr.12661

The effect of antigen dose and time after immunization on the amount and affinity of antihapten antibodyThe Journal of Immunology 100:371–375.

The contribution of vaccination to global health: past, present and futurePhilosophical Transactions of the Royal Society B: Biological Sciences 369:20130433.https://doi.org/10.1098/rstb.2013.0433

Follicular dendritic cells: dynamic antigen librariesNature Reviews Immunology 14:495–504.https://doi.org/10.1038/nri3689

Generation of memory B cells and their reactivationImmunological Reviews 283:138–149.https://doi.org/10.1111/imr.12640

In situ studies of the primary immune response to (4hydroxy3nitrophenyl)acetyl. III. the kinetics of V region mutation and selection in germinal center B cellsThe Journal of Experimental Medicine 178:1293–1307.https://doi.org/10.1084/jem.178.4.1293

Estimating hypermutation rates from clonal tree dataThe Journal of Immunology 171:4639–4649.https://doi.org/10.4049/jimmunol.171.9.4639

Active tuning of synaptic patterns enhances immune discriminationPhysical Review Letters 121:238101.https://doi.org/10.1103/PhysRevLett.121.238101

Selection in the germinal centerCurrent Opinion in Immunology 63:29–34.https://doi.org/10.1016/j.coi.2019.11.001

Monitoring the retention of a protein antigen in complete Freund's adjuvant, alum, and pluronic F127 gel formulations by Xray fluorescencePharmaceutical Development and Technology 6:241–246.https://doi.org/10.1081/PDT100002200

Antigendriven B cell differentiation in vivoThe Journal of Experimental Medicine 178:295–307.https://doi.org/10.1084/jem.178.1.295

Classswitched memory B cells remodel BCRs within secondary germinal centersNature Immunology 16:296–305.https://doi.org/10.1038/ni.3095

The wages of original antigenic sinEmerging Infectious Diseases 16:1023–1024.https://doi.org/10.3201/eid1606.100453

Antihapten antibody specificity and L chain typeThe Journal of Experimental Medicine 126:727–743.https://doi.org/10.1084/jem.126.4.727

Somatic mutation leads to efficient affinity maturation when centrocytes recycle back to centroblastsJournal of Immunology 158:5155–5162.

Dose finding for new vaccines: the role for immunostimulation/immunodynamic modellingJournal of Theoretical Biology 465:51–55.https://doi.org/10.1016/j.jtbi.2019.01.017

Estimating the dimension of a modelThe Annals of Statistics 6:461–464.https://doi.org/10.1214/aos/1176344136

A dynamic T celllimited checkpoint regulates affinitydependent B cell entry into the germinal centerJournal of Experimental Medicine 208:1243–1252.https://doi.org/10.1084/jem.20102477

Regulated selection of germinalcenter cells into the memory B cell compartmentNature Immunology 17:861–869.https://doi.org/10.1038/ni.3460

Regulation of memory B and plasma cell differentiationCurrent Opinion in Immunology 45:126–131.https://doi.org/10.1016/j.coi.2017.03.003

Plasma cell and memory B cell differentiation from the germinal centerCurrent Opinion in Immunology 45:97–102.https://doi.org/10.1016/j.coi.2017.03.006

Replicaexchange molecular dynamics method for protein foldingChemical Physics Letters 314:141–151.https://doi.org/10.1016/S00092614(99)011239

Replica monte carlo simulation of spin glassesPhysical Review Letters 57:2607–2609.https://doi.org/10.1103/PhysRevLett.57.2607

Prolonged antigen halflife in the lymphoid follicles of specifically immunized miceImmunology 37:69.

Clonal and cellular dynamics in germinal centersCurrent Opinion in Immunology 28:90–96.https://doi.org/10.1016/j.coi.2014.02.010

What are the primary limitations in BCell affinity maturation, and how much affinity maturation can we drive with vaccination?Cold Spring Harbor Perspectives in Biology 10:a029389.https://doi.org/10.1101/cshperspect.a029389

Germinal centersAnnual Review of Immunology 30:429–457.https://doi.org/10.1146/annurevimmunol020711075032

Optimal sequential immunization can focus antibody responses against diversity loss and distractionPLOS Computational Biology 13:e1005336.https://doi.org/10.1371/journal.pcbi.1005336

Germinal center B cells govern their own fate via antibody feedbackThe Journal of Experimental Medicine 210:457–464.https://doi.org/10.1084/jem.20120150

Optimality of mutation and selection in germinal centersPLOS Computational Biology 6:e1000800.https://doi.org/10.1371/journal.pcbi.1000800
Decision letter

Armita NourmohammadReviewing Editor; University of Washington, United States

Naama BarkaiSenior Editor; Weizmann Institute of Science, Israel

Andreas MayerReviewer; Princeton University, United States

William S DeWitt IIIReviewer; Fred Hutchinson Cancer Research Center, United States
In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.
Acceptance summary:
This manuscript presents a mathematical model of affinity maturation, which quantitatively fits single cell measurements of Bcell affinities during maturation. The main experimental finding is that maturation speed has an optimum at intermediate antigen dosage. This phenomenon is elegantly explained in the model by a tradeoff between selection strength, which is stronger at small antigen dosage, and length of maturation, which is prolonged at high dosage. Overall, this work introduces a novel theoretical framework for Bcell maturation and brings an intuitive insight into the underlying forces that drive the affinity maturation of Bcells.
Decision letter after peer review:
Thank you for submitting your article "Quantitative modeling of the effect of antigen dosage on Bcell affinity distributions in maturating germinal centers" for consideration by eLife. Your article has been reviewed by Naama Barkai as the Senior Editor, a Reviewing Editor, and two reviewers. The following individuals involved in review of your submission have agreed to reveal their identity: Andreas Mayer (Reviewer #1); William S DeWitt III (Reviewer #3).
The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.
This manuscript presents a mathematical model of affinity maturation, which quantitatively fits single cell measurements of B cell affinity dynamics. The main experimental finding is that maturation speed has an optimum at intermediate antigen dosage. This phenomenon is elegantly explained in the model by a tradeoff between selection strength, which is stronger at small antigen dosage, and length of maturation, which is prolonged at high dosage. More broadly, a notable contribution of the work is to introduce a novel theoretical framework, which provides intuitive insight into what drives maturation dynamics and allows more rigorous parameter inference than in prior work.
The reviewers agree that the manuscript presents an interesting approach to address Bcell maturation, but they raise major concerns that we would like to see addressed.
Essential revisions:
1) One major concern is about the compatibility of the proposed dynamics with a number of recent experiments that show a rapid emergence of clonal dominance in a significant fraction of germinal centers (e.g. Tas et al., 2016, Abbott et al., 2018). This incompatibility is certainly concerning. However, we also agree that the data presented in the paper is not a product of a single germinal center (GC) but rather are cells harvested from spleens, which can contain tens of GCs at a given time point. In other words, despite the current claim, which needs to be revised, the manuscript is presenting an effective model for multiple GCs in one spleen. Each of these GCs may contain homogenized populations of cells (consistent with Tas et al.,), but the spleen data may show maintenance of diversity arising from distinct clonal populations established in different GCs.
Given this discrepancy, there are multiple issues that need to be addressed:
1.1) Simulation and modeling extension should be added to systematically include heterogeneous GC structures within a spleen.
1.2) The picture presented in the current work in which the stochastic dynamics within a germinal center is welldescribed by a deterministic traveling wave dynamics in affinity space seems to be in contradiction with the earlier findings (Tas et al., 2016). Importantly, as evolutionary trajectories approach affinity fitness peaks, it will become increasingly difficult for affinityincreasing mutations to occur. Subsection 'Model limitations and discussion' states "we believe this saturation effect is not relevant to model the limited maturation observed in experiments". This needs more justification, considering the convergent outcomes found in some studies (e.g. Tas et al.,). It's not obvious that the traveling wave asymptote is obtained in GC dynamics.
We propose that the authors explicitly demonstrate a specific scenario (e.g. through simulations) that their model provides at least a correct effective description for evolution of cells harvested from a spleen. Traveling wave approach might be a more realistic effective model for multiple GCs than for affinity maturation in a single GC, as currently presented.
2) The lack of any validation for ML inference procedure is a serious limitation. The manuscript describes a rugged likelihood surface for which convex optimization would be inadequate for arriving at the maximum likelihood estimation (MLE). The authors use parallel tempering to cope with this, which allows sampling across multiple local minima. However, there is no attempt to validate that model parameters can be accurately recovered by this procedure. It is not enough to say that the data are fit well as many points in the high dimensional parameter space may fit the data well. Therefore, the authors should demonstrate that model parameters can reliably be recovered from simulated data for a range of parameter values. It would be more convincing if the authors can further show that recovery is not severely impacted by model assumptions that were adopted for analytical tractability but can be violated in simulations (i.e. model misspecification). Without such validation on simulated data, it is difficult to reliably trust the parameter inference from experimental data.
3) The manuscript describes a computational method for simulation and for inferring parameters from affinity data, but the computational implementation is not made available. Access to the implementation is needed for several reasons: (1) more complete peer review will be possible if reviewers are able to assess the implementation details and even run the code, (2) reproducibility of the results, (3) upon publication, it will be more feasible for other researchers to use or build on this work. We ask the authors to make their code available to the reviewers for the next revision.
https://doi.org/10.7554/eLife.55678.sa1Author response
Essential revisions:
1) One major concern is about the compatibility of the proposed dynamics with a number of recent experiments that show a rapid emergence of clonal dominance in a significant fraction of germinal centers (e.g. Tas et al., 2016, Abbott et al., 2018). This incompatibility is certainly concerning. However, we also agree that the data presented in the paper is not a product of a single germinal center (GC) but rather are cells harvested from spleens, which can contain tens of GCs at a given time point. In other words, despite the current claim, which needs to be revised, the manuscript is presenting an effective model for multiple GCs in one spleen. Each of these GCs may contain homogenized populations of cells (consistent with Tas et al.,), but the spleen data may show maintenance of diversity arising from distinct clonal populations established in different GCs.
Given this discrepancy, there are multiple issues that need to be addressed:
1.1) Simulation and modeling extension should be added to systematically include heterogeneous GC structures within a spleen.
1.2) The picture presented in the current work in which the stochastic dynamics within a germinal center is welldescribed by a deterministic traveling wave dynamics in affinity space seems to be in contradiction with the earlier findings (Tas et al., 2016). Importantly, as evolutionary trajectories approach affinity fitness peaks, it will become increasingly difficult for affinityincreasing mutations to occur. Subsection 'Model limitations and discussion' states "we believe this saturation effect is not relevant to model the limited maturation observed in experiments". This needs more justification, considering the convergent outcomes found in some studies (e.g. Tas et al.,). It's not obvious that the traveling wave asymptote is obtained in GC dynamics.
We propose that the authors explicitly demonstrate a specific scenario (e.g. through simulations) that their model provides at least a correct effective description for evolution of cells harvested from a spleen. Traveling wave approach might be a more realistic effective model for multiple GCs than for affinity maturation in a single GC, as currently presented.
The reviewers are concerned by the incompatibility of our stochastic evolution model, which gives rise (on average and at 'long' times) to a travelling maturation wave, with recent experimental evidence that GCs can be quickly dominated by single clones. This is an important concern, and we would like to answer comment 1.1 in four points.
First, we fully agree with the reviewers on the relevance of the experiments by Tas et al., (2016) and Abbott et al., (2018), showing various degrees of homogenizing selection (some GCs are quickly dominated by a single clone others stay heterogeneous throughout evolution). To demonstrate that our model can account for this phenomenon we have introduced a minimal modification, consisting in seeding the GC with 100 founder clones (rather than 2,500 as in the previous manuscript). This number was chosen based on Tas et al., (2016)’s estimate ranging from 50 to 200 clones in early GCs. The binding energy of each founder clone is independently extracted from the Gaussian distribution of 'naive' binding energies. During the time of GC formation these clones expand uniformly without mutating, up to a total population of 2,500 cells at day 6 after injection, at which point the GC simulation starts. This modification reduces the diversity of the initial population (but not its size) to a more realistic level. It also allows us to follow the evolution of different clonal families, which was not done in the first version of the manuscript. We observe that this evolution is compatible with the experimental evidence cited above. In particular, in Figure 3 we demonstrate that stochastic simulations of our GCs show different degrees of homogenizing selection (Figure 3A, B), with half of the simulation featuring a clonal family that, by day 28, expands to and 30% of the total GC population (Figure 3C). Moreover, we show that homogenization correlates with the presence of a highaffinity founder (Figure 3D).
Second, considering that GC is seeded by 'only' 100 founder clones rather than 2500 distinct clones drawn from the same naive distribution, as was done in the previous manuscript, has no impact on the average evolution of GCs, but it increases the level of stochasticity of the outcome of the maturation process (cf Appendix 1—Figure 3A to D). Therefore, our deterministic evolution model remains valid and correctly describes the average evolution of one GC.
Third, as rightly pointed out by the reviewers, the cells we measure from spleens are the cumulative outcome of many different GC reactions. While the physical and biological defining constants may vary from GC to GC, this structural variability cannot be inferred from our experimental data that give access to the population averaged affinity distribution. We thus omit this variability and assume that all GCs are defined with the same effective model parameters, but are seeded with different, independently drawn founder clones. This population of heterogeneous GC mature independently from each other, and we collect PCs and MCs at the end of the process. Considering multiple GCs rather than a single one does not have any impact on the average distribution of affinities, which is again given by our deterministic evolution model. Therefore, it is licit to use the average distribution in our inference procedure to extract the effective model parameters from the set of experimentally measured affinities, as explain in the Materials and methods section. Notice that the level of noise (fluctuations around this average distribution) is reduced when averaging over multiple GCs; We take this effect into account through the rescaled level of noise corresponding to the average over 20 different stochastic simulations (see Figure 6).
Fourth, we also agree with the reviewers that the 'traveling wave' description we employ in our paper is exact for the deterministic evolution model only. In other words, the traveling wave is true only on average over the stochastic evolution of one or more GCs.
As a summary, in the amended manuscript, we have changed the initial population of our GC to make it more realistic. Consequently, our stochastic maturation model does show homogenizing selection and the resulting affinity distribution is described on average by a traveling wave. We have made these two essential points much clearer in the new manuscript. We would also like to thank the reviewers for their important comment. We believe that the changes that were introduced following their recommendation, in particular the addition of Figure 3 and of the corresponding paragraph, substantially improved our paper.
We now discuss comment 1.2 and potential saturation effect in mutations. We have quantified the numbers of mutations accumulated by MCs and PCs during the course of evolution in our stochastic model (see Appendix 1—Figure 10 and Appendix 1 subsection 'Quantifying beneficial and deleterious mutation events'). For both populations these numbers are small on average (< 1, Appendix 1 subsection 'Quantifying beneficial and deleterious mutation events'), with very few cells accumulating more than 45 beneficial mutations. This is especially true for the MC population, in which most of the mutations accumulated are deleterious. This observation shows that maturation in our model mainly comes from simple selection of highaffinity precursor, and only partially by additional mutations increasing their affinity. Consequently, we believe that neglecting the saturation effect of beneficial mutations is an acceptable approximation, at least in the regime of the inferred values of the parameters. In addition, the maximum number of accumulated beneficial mutations (45) is also compatible with recent experiments [G´erard et al., 2020], in which mice were immunized against Tetanos Toxoid with a protocol similar to the ones we consider. The authors quantified the mutational load on highaffinity binders (K_{d} ∼ 1 nM) and found an average of 9 nonsynonymous mutations on the antibody heavy and light chain variable regions. These experimental results confirm that the number of mutation events considered in our model is not unrealistically high despite the absence of saturation mechanism.
2) The lack of any validation for ML inference procedure is a serious limitation. The manuscript describes a rugged likelihood surface for which convex optimization would be inadequate for arriving at the maximum likelihood estimation (MLE). The authors use parallel tempering to cope with this, which allows sampling across multiple local minima. However, there is no attempt to validate that model parameters can be accurately recovered by this procedure. It is not enough to say that the data are fit well as many points in the high dimensional parameter space may fit the data well. Therefore, the authors should demonstrate that model parameters can reliably be recovered from simulated data for a range of parameter values. It would be more convincing if the authors can further show that recovery is not severely impacted by model assumptions that were adopted for analytical tractability but can be violated in simulations (i.e. model misspecification). Without such validation on simulated data, it is difficult to reliably trust the parameter inference from experimental data.
We certainly agree that our likelihood is a complicated function of the parameters to be inferred, and there is no guarantee that the absolute maximum is found, despite the use of parallel tempering and the care brought to the numerics. Following the reviewers’ advice:
We generated multiple synthetic datasets (cf Appendix 1—Figure 11 and Appendix 1 subsection. 'Validation of inference procedure on artificially generated data'). Each dataset was generated from our stochastic maturation model with the set of parameters inferred from the experimental data and reported in the manuscript. The simulations were carried out under the same immunization schemes as in the experimental dataset, and we extracted the same number of (synthetic) cells from the simulated responders as in the mice we have experimentally studied. In this way, the size and format of each synthetic dataset was identical to the experimental one. Notice that, to gain time, we did not introduce 100 founder clones per GC and averaged over multiple GCs, but rather considered 2500 founder clones; this does not affect the mean affinity distribution and the amplitude of the fluctuations is comparable to what is expected from the average over tens of GC, see Figure 6 and Appendix 1— Figure 3A to D.
The inference procedure was then run on each synthetic dataset. In Appendix 1—table 1 we report the average and standard deviation of the values of the inferred parameters. We find a good match between the results of the multiple inferences and the ground truth values of the parameters (that is, their values inferred from the experimental data and used to generate the synthetic data).
These results, reported in the appendix of the new manuscript, show that our inference procedure is consistent and reliable, despite the roughness of the likelihood and the limited number of available data.
3) The manuscript describes a computational method for simulation and for inferring parameters from affinity data, but the computational implementation is not made available. Access to the implementation is needed for several reasons: (1) more complete peer review will be possible if reviewers are able to assess the implementation details and even run the code, (2) reproducibility of the results, (3) upon publication, it will be more feasible for other researchers to use or build on this work. We ask the authors to make their code available to the reviewers for the next revision.
All the code necessary to produce the figures in the main paper will be made available in the following online repository: https://github.com/mmolari/affinity_maturation. This includes the library to simulate immunization schemes, with both the stochastic and deterministic model, and the inference algorithm. The repository contains a file (parallel tempering.py) that executes the maximumlikelihood inference procedure and recovers the values of parameters reported in the paper. The code that reproduces the figures of the main paper is included in the form of Jupyter notebooks. We also added a short tutorial on how to implement custom immunization scheme simulations, import new datasets and run the inference procedure on them (see readme and docs folder). To maximize readability the code is extensively commented.
https://doi.org/10.7554/eLife.55678.sa2Article and author information
Author details
Funding
H2020 European Research Council (80336)
 Klaus Eyer
Agence Nationale de la Recherche (ANR17CE300021 RBMPro)
 Rémi Monasson
Agence Nationale de la Recherche (ANR10LABX31)
 Jean Baudry
Agence Nationale de la Recherche (ANR 10EQPX34)
 Jean Baudry
Agence Nationale de la Recherche (ANR10IDEX000102 PSL)
 Jean Baudry
 Simona Cocco
 Rémi Monasson
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work was supported by the CELLIGO project funded by the French government through BPIFrance under the frame ‘Programme d’Investissements d’Avenir’ (PIA), the ‘Institut PierreGilles de Gennes’ through the laboratoire d’excellence, ‘Investissements d’avenir’ programs ANR10IDEX0001–02 PSL, ANR10EQPX34, ANR10LABX31 and ANR CE30002101 (RBMPro). EK acknowledges generous funding from the ‘The Branco Weiss Fellowship  Society in Science’ and received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant agreement No. 80336). We would like to further acknowledge the help of Dr. C Castrillon and Dr. P Bruhns for the work with the murine model system.
Ethics
Animal experimentation: Experiments using mice were validated by the CETEA ethics committee number 89 (Institut Pasteur, Paris, France) under #20130103, and by the French Ministry of Research under agreement #00513.02.
Senior Editor
 Naama Barkai, Weizmann Institute of Science, Israel
Reviewing Editor
 Armita Nourmohammad, University of Washington, United States
Reviewers
 Andreas Mayer, Princeton University, United States
 William S DeWitt III, Fred Hutchinson Cancer Research Center, United States
Publication history
 Received: February 2, 2020
 Accepted: June 12, 2020
 Accepted Manuscript published: June 15, 2020 (version 1)
 Version of Record published: July 14, 2020 (version 2)
Copyright
© 2020, Molari et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 1,067
 Page views

 171
 Downloads

 3
 Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.