Research Article

Eco-evolutionary dynamics of nested Darwinian populations and the emergence of community-level heredity

Laboratoire de Génétique de l'Evolution, Chimie Biologie et Innovation, Université PSL, France
Institut de Biologie de l’École Normale Supérieure (IBENS), École Normale Supérieure, Université PSL, France
Laboratoire de Probabilités, Statistique et Modélisation (LPSM), Sorbonne Université, CNRS, France
Center for Interdisciplinary Research in Biology (CIRB), Collège de France, Université PSL, CNRS, INSERM, France
Department of Evolutionary Theory, Max Planck Institute for Evolutionary Biology, Germany
Department of Microbial Population Biology, Max Planck Institute for Evolutionary Biology, Germany

Jul 7, 2020

Open access
Copyright information

Abstract
Introduction
Results
Discussion
Methods
Appendix 1
Appendix 2
Appendix 3
Data availability
References
Article and author information
Metrics

Abstract

Interactions among microbial cells can generate new chemistries and functions, but exploitation requires establishment of communities that reliably recapitulate community-level phenotypes. Using mechanistic mathematical models, we show how simple manipulations to population structure can exogenously impose Darwinian-like properties on communities. Such scaffolding causes communities to participate directly in the process of evolution by natural selection and drives the evolution of cell-level interactions to the point where, despite underlying stochasticity, derived communities give rise to offspring communities that faithfully re-establish parental phenotype. The mechanism is akin to a developmental process (developmental correction) that arises from density-dependent interactions among cells. Knowledge of ecological factors affecting evolution of developmental correction has implications for understanding the evolutionary origin of major egalitarian transitions, symbioses, and for top-down engineering of microbial communities.

Introduction

Thirty years ago, in an article arguing the importance of the ‘superorganism’, Wilson and Sober expressed surprise that biologists had not recognised that communities — in the laboratory — ‘could be treated as entities with heritable variation and selected accordingly’ (Wilson and Sober, 1989). That they might be treated as such, stemmed from recognition that the eukaryotic cell is a tight-knit community of two once free-living microbes (Margulis, 1970), but also from observations in nature of social insect colonies (Wilson, 1985), cellular slime molds (Bonner, 1982; Buss, 1982), and especially of phoretic insect communities (Wilson and Knollenberg, 1987).

Phoretic insect communities comprise a focal organism — often an insect such as a beetle — that moves between patchily distributed ephemeral resources carrying with it a myriad of associated organisms, including mites, nematodes and microbes. Communities associated with each insect differ by virtue of the composite members, with the conceivable possibility that some associations may harm the carrier insect, while others may bring benefit. Given that the role of dispersal is loosely analogous to a community-level reproduction event, Wilson and Sober argued that selection at the level of insect communities was likely to trump within-community selection leading to communities ‘becoming organised into an elaborate mutualistic network that protects the insect from its natural enemies, gathers food, and so on’.

If this might happen in nature, then why might this not be realised even more potently in the laboratory? Indeed, the logic of Darwinism says it should. Provided there exists heritable variance in fitness at the level of communities, then communities will participate as units (in their own right) in the process of evolution by natural selection (Lewontin, 1970; Godfrey-Smith, 2009). In nature, the necessary conditions are likely rare (Goodnight and Stevens, 1997), but ecological circumstances can sometimes conspire to ensure that variation among communities is discrete, that communities replicate and that offspring communities show some resemblance to parental communities. Phoretic insect communities are a plausible case in point. In the laboratory, however, the experimenter can readily construct conditions that ensure communities (or any collective of cells) are units of selection (Johnson and Boerlijst, 2002; Day et al., 2011; Xie and Shou, 2018; Xie et al., 2019). A critical requirement is a birth-death process operating over a time scale longer than the doubling time of individual cells (Hammerschmidt et al., 2014; Rainey et al., 2017; Black et al., 2020).

Empirical support for the prediction that selection really can shape communities was provided by Swenson and colleagues who performed two studies in which artificial selection was imposed on microbial communities from soil (Swenson et al., 2000a; Swenson et al., 2000b). In the first, they selected communities that affected plant growth. In the second, they selected communities for ability to degrade the environmental pollutant 3-chloroaniline. In both instances, communities at extreme values of community function were repeatedly propagated. In both studies, a significant response was measured at the level of the community.

Although the finding was a surprise (Goodnight, 2000), it is consistent with expectations that communities of entities — no matter their identity — will participate in the process of evolution by natural selection provided communities are discrete, they replicate, and that offspring communities resemble parental communities (Godfrey-Smith, 2009). Discreteness is conferred by simply compartmentalising communities via their placement in independent vessels. Replication is achieved by taking a sample of the selected communities with transfer to a new vessel. Heredity, however, is less tangible, especially in the Swenson experiments, where the selected communities were pooled before redistribution into fresh vessels. Nonetheless, intuition says that heredity becomes established through interactions (Wilson and Sober, 1989; Goodnight, 2000). Understanding the mechanistic bases of community-level heredity and its emergence motivates our study.

We begin by posing a thought experiment realisable via ever improving capacity to manipulate small volumes of liquid (Baraban et al., 2011; Sackmann et al., 2014; Cottinet et al., 2016). Consider a millifluidic device that controls the composition of emulsions. Consider thousands of microlitre-sized droplets each harbouring communities comprised of two types of microbes that differ solely in the colour of a fluorescent protein: one type encodes a red fluorescent protein and the other a blue fluorescent protein. Interest is in the evolution of communities that are of the colour purple (an equal ratio of red-to-blue cells). Within each droplet, red and blue microbes replicate with growth rate and interaction rates being subject to evolutionary change. In the mean time, the experimenter, via lasers installed on the device, has determined the precise colour of each droplet and a priori decided that half of the droplets with composition furthest from an equal ratio of red-to-blue will be eliminated, whilst the fraction whose colour is closest to purple will be allowed to replicate. Replication involves a dilution step during which an aliquot of cells are sampled and nutrients replenished. A further round of growth then ensues along with a further round of droplet-level selection. The protocol continues thereafter with selection taking place at the level of communities via a birth-death process. In essence the schema, outlined in Figure 1 and inherent in the work of Swenson and colleagues, involves exogenous imposition of ecological conditions sufficient to cause droplets to function as units of selection. The concept, elaborated in detail elsewhere, is referred to as ‘ecological scaffolding’ (Black et al., 2020).

Figure 1

Download asset Open asset

Nested model of evolution.

Collectives (large circles) follow a birth-death process (grey) with non-overlapping generations. Collectives are composed of particles (small spheres) that also follow a birth-death process (*growth*, represented by thick green arrows). Offspring collectives are founded by sampling particles from parent collectives (*dilution*, represented by thin green arrows, first and third rows). Survival of collectives depends on colour. Collectives that contain too many blue (second row) or red (fourth row) particles are marked for extinction. The number of collectives is kept constant. Mutation affects particle traits (see main text for details).

Under this scaffolded-regime, communities within droplets are endowed with Darwinian-like properties (we use this term to convey the fact that removal of the scaffold leads, at least initially, to complete loss of community-level individuality). Collective-level variation is discretised by virtue of the bounds provided by the immiscibility of oil and water (communities are thus confined to droplets). Additionally, the device ensures that droplets engage in a birth-death process: droplets furthest from the collective-level trait are extinguished, whereas those closest to the colour purple are diluted and split, thus effecting collective-level reproduction. Not determined by the device however is the relationship between parent and offspring droplets. Because the trait of the parent community depends on properties of the cellular constituents, there is — in the absence of interactions between red and blue cells — little chance that purple-coloured communities will reliably give rise to purple-coloured offspring. This is in part due to the stochastic nature of the dilution phase (a droplet with an equal ratio of red to blue is unlikely to give rise to offspring droplets founded with the same equal ratio of types) but also to within-droplet selection favouring fast growing types. Purple-coloured droplets can be maintained, as envisioned by the ‘stochastic corrector’ model (Maynard Smith and Szathmary, 1995; Grey et al., 1995; Johnston and Jones, 2015), provided only those communities with the correct colour are propagated. However, within-droplet selection favours rapidly growing cells resulting in successive reduction of the number of viable droplets.

Here, we show that when cellular interactions are also allowed to evolve, selection imposed at the collective level, leads to evolution of a developmental-like process, which ensures that offspring communities resemble parental communities, irrespective of the initial phenotype at the moment of birth. We illustrate the evolutionary process by means of stochastic simulations for nested populations of cells (particles) and communities (collectives) undergoing a death-birth process. In order to generalise our findings we derive a deterministic approximation, which we then use to show how selection on community phenotype drives the evolution of ecological interactions that are the basis of community-level heredity.

Results

A nested model of collective evolution

As described above and depicted in Figure 1, we consider a nested model in which particles are discretised into a population of collectives. Each collective is comprised of two kinds of self-replicating particle (red and blue) that together determine collective colour. Colour is important because it is the phenotype upon which collectives succeed or fail. Collectives that are too far from an optimal colour face extinction, whereas those within acceptable bounds persist with the possibility of reproduction. Birth-death at the level of collectives affects the eco-evolutionary dynamics of particles as particle-level traits that give rise to unfit collectives are eliminated.

We firstly present numerical simulations where particles undergo a stochastic birth-death process (Champagnat et al., 2006; Doebeli et al., 2017) and collectives are selected based on colour. The details of the model are described in Appendix 1, but we introduce the main assumptions and underlying principles here. Each particle of type $i \in {0, 1}$ is characterised by four traits (hereafter particle traits): colour ( $c_{i}$ , red or blue), net maximum growth rate $r_{i}$ , and two competition parameters ( $a_{i}^{intra}$ and $a_{i}^{inter}$ ). At any particular instant particles either reproduce or die. Particles of type i reproduce with a constant birth rate $r_{i}$ and die as a consequence of competition. The rate of death is density-dependent such that each particle of type increases the death rate of $i$ -type particles by $r_{i} a_{j}^{intra}$ if they share the same colour ( $c_{j} = c_{i}$ ), or by $r_{i} a_{j}^{inter}$ when colours are different ( $c_{j} \neq c_{i}$ ). All transition rates can be found in Appendix 1, paragraph 'particle-level ecology'. Competition rates are referred to as ‘interaction’ traits or parameters. We expand on more general types of interaction — from exploitative to mutualistic — in the Discussion and in Appendix 3.

Mutations are introduced at the level of particles. Mutation affects either particle maximum growth rate ( $r$ ) or the inter-colour competition parameter ( $a^{inter}$ ) by a small random quantity. In the spirit of adaptive dynamics (Geritz et al., 1998), the particle type carrying the new set of traits is referred to as a mutant, and the existing type is designated the resident. Within every collective and at any time, there are four populations composed of resident and mutant types of the two colours. Mutations are assumed to be rare. In order to accelerate numerical simulations, one mutant individual is introduced every time one population of a given colour goes extinct in one of the collectives. The newly added type has the the same colour as the extinct type.

Collectives also undergo a birth-death process. The number of collectives $D$ is constant and collective generations are discrete and non-overlapping. Each collective generation begins at time $t = 0$ with offspring collectives containing $B$ founding particles. Particles replicate, interact and evolve according to the particle traits. After duration $T$ , collectives attain ‘adult’ stage, and a fixed proportion of collectives $ρ$ is marked for extinction. This allows the possibility of selection on collectives based on their properties (the collective phenotype), which is derived from the composing particles. Our focus is collective colour, which is defined as the proportion $ϕ$ of red particles.

Initially, collectives contain red and blue particles in uniformly distributed ratios. Collectives are subject to evolution under two contrasting regimes: one neutral and the other selective. Under the neutral regime, the pool of collectives marked for extinction is sampled at random, whereas under the selective regime, collectives marked for extinction are those whose adult colour departs most from an arbitrarily fixed optimal colour $\hat{ϕ}$ . Extinguished collectives are replaced by offspring from uniformly sampled extant collectives (Figure 1). All other collectives are replaced by their own offspring. Reproduction involves uniformly sampling $B$ particles from the parent collective. Particles from one collective never mix with particles from any other. This establishes an unambiguous parent-offspring relationship (De Monte and Rainey, 2014). The adult colour of offspring collectives depends on the founding frequencies of particles (whose variance is negatively related to bottleneck size $B$ ), and on ensuing particle-level population dynamics.

Selection on collectives drives the evolution of particle traits

In the absence of collective-level selection (neutral regime), collectives converge to a monochromatic phenotype (Figure 2A). Once collectives are composed of either all-red or all-blue particles, the contrasting colour cannot be rescued (colour change by mutation or migration is not possible). The distribution of collective colour becomes biased toward faster-growing particle types, with selection driving a gradual increase in particle growth rate (Figure 2C). The inter-colour competition trait (Figure 2E) is irrelevant once collectives become monochromatic (evolution is then governed by drift).

Figure 2

Download asset Open asset

Evolutionary dynamics of collectives and particles.

A population of $D$ = 1000 D collectives was allowed to evolve for $M$ = 10,000 generations under the stochastic birth-death model described in the main text (see Appendix 1 for details on the algorithm used for the numerical simulations). Initially, each collective was composed of $B = 15$ particles of two types: red ( $r_{0} = 6, a_{0}^{intra} = 0.8 / K, a_{0}^{inter} = 0.15 / K, c_{0} = red$ ) and blue ( $r_{1} = 4, a_{1}^{intra} = 0.3 / K, a_{1}^{inter} = 0.15 / K, c_{1} = blue$ ), with $K$ = 1500. The proportions at generation 0 were randomly drawn from a uniform distribution. At the beginning of every successive collective generation, each offspring collective was seeded with founding particles sampled from its parent. Particles were then grown for a duration of $T$ = 1. When the adult stage was attained, 200 collectives ( $ρ = 20 %$ ) were extinguished, allowing opportunity for extant collectives to reproduce. Collectives were marked for extinction either uniformly at random (*neutral regime*, panels *A, C, E*, as well as Appendix 1—figures 1A and 4A), or based on departure of the adult colour from the optimal purple colour ( $\hat{ϕ} = 0.5$ ) (*selective regime*, panels *B, D, F*, as well as Appendix 1—figures 1B and 4B). Panels A and B, respectively, show how the distribution of the collective phenotype changes in the absence and presence of selection on collective colour. The first 30 collective generations (before the grey line) are magnified in order to make apparent early rapid changes. In the absence of collective-level selection purple collectives are lost in fewer than 10 generations leaving only red collectives (A) whereas purple collectives are maintained in the selective regime (B). Panels C-F illustrate time-resolved variation in the distribution of underlying particle traits. A diversity of traits is maintained in the population because every lineage harbours two sets of traits for every colour (see Appendix 1). Selection for purple-coloured collectives drives evolutionary increase in particle growth rate (D) compared to the neutral regime (C). In the neutral regime, inter-colour evolution of competition traits is driven by drift (E), whereas with collective-level selection density-dependent interaction rates between particles of different colours rapidly achieve evolutionarily stable values, with one colour loosing its density-dependence on the other (F).

The dynamic is very different once selection is imposed at the level of collectives. By rewarding collectives closest to the colour purple (a fixed $\hat{ϕ} = 0.5$ ratio of red to blue particles), it is possible to prevent fixation of either colour (Figure 2B). Starting, as above, from collectives containing red and blue particles in uniformly distributed ratios, mean collective colour shifts toward red. The time scale is, as in the neutral case, a consequence of the faster initial growth rate of red particles. For a few tens of generations, the population of collectives remains strongly biased towards red. The optimal phenotype is maintained by selection for the least worse collective colour precisely as envisaged by the stochastic corrector model (Maynard Smith and Szathmary, 1995; Appendix 1—figure 5). Subsequently, however, the trend reverses and mean collective colour progressively approaches purple. From generation 1000, variance in the distribution of colour decreases, as a consequence of improvement in the ability of purple-parent collectives to give rise to offspring collectives that at adult age resemble parental types. This is associated with escalating particle growth rate (Figure 2D) and a saturating increase in between-colour competition (Figure 2F). The latter reflects directional selection that moves the average phenotype in the population of collectives towards the optimal colour $\hat{ϕ}$ (reached by generation 7000).

By affecting particle traits, selection on colour also modifies dynamics within collectives. Figure 3 shows variation of colour within a single collective growth phase at generation 3 and generation 9000. Prior to selection shaping particle traits, both red and blue particle types follow approximately exponential growth (Figure 3C). The resulting adult collective colour is thus biased towards the faster-growing red type (Figure 3A). In contrast, at generation 9000 (Figure 3B), both particle types reach a saturating steady state that ensures that adult colour is purple. Initial departures from a 1:1 ratio — caused by the stochasticity of collective reproduction and/or particle growth dynamics — are compensated for during the growth phase (Figure 3D). Compensation is a consequence of the evolution of inter-colour competition traits (Figure 2F). Population expansion is in turn dependent upon earlier increases in particle growth rate (Figure 2D). Moreover, selection favours competition trait values for which blue types have no effect on red types: $a^{i n t e r}$ of blue types is close to zero by generation 5000 (Figure 2F).

Figure 3

Download asset Open asset

Ecological dynamics of particles.

A sample of 300 (from a total of 1000) collectives were taken from each of generations 3 (**A,C**) and 9000 (**B,D**) in the evolutionary trajectory of Figure 2. The dynamic of particles was simulated through a single collective generation ( $0 \leq t \leq T = 1$ ), based on the particle traits of each collective. Each grey line denotes a single collective. The frequency distribution of adult collective colour (the fraction of red particles at time $T$ ), is represented in the panel to the right. The grey area indicates the fraction $ρ$ of collectives whose adult colour is furthest from $\hat{ϕ} = 0.5$ , that will be eliminated in the following collective generation. Single orange lines indicate collectives whose growth dynamic — number of individual particles — is shown in C and D, respectively. Dotted lines show the deterministic approximation of the particle numbers during growth (Appendix 2 Equation 1). Initial trait values result in exponential growth of particles (C), leading to a systematic bias in collective colour towards fast growing types (A). Derived trait values after selection yield a saturating growth toward an equilibrium (B) leading to the re-establishment of the purple colour by the end of the generation, despite initial departure (A). This is associated to the transition from a skewed distribution of collective colour, where almost all collectives are equally bad, to a narrow distribution centered on the target colour.

Key features of the evolutionary trajectory discussed so far are representative of replicate realisations of the stochastic individual-based nested model. In the section ‘Variability of the derived particle traits’ of Appendix 1 we show that in repeated simulations, the average adult collective colour always falls within a few percentage of the target colour. Moreover, collective-level selection applies more stringently to interaction parameters than to growth rates, with the latter showing a broader distribution of derived values. These conclusions also hold when the target colour $\hat{ϕ}$ is different from 0.5, with broader variation from one realisation to the other and slower convergence to the target as colour ratios become more extreme (see Appendix 1, paragraph ‘Different target colours’).

Ability of offspring collectives to correct departures from the optimal colour during the course of growth is akin to a developmental, or canalising process: irrespective of the phenotype of the newborn (which will likely be different to that of the adult) the child — as it grows to adulthood — develops a phenotype that closely resembles that of the parent. Evidence of this apparent canalising process can be seen upon removal of collective-level selection (Figure 4). Collectives founded by particles with ancestral traits become composed of a single (red or blue) colour in less than 10 generations (Figure 4A). In contrast, derived collectives are comprised of particles whose traits ensure that collectives continue to express phenotypes narrowly distributed around the optimal (purple) phenotype (as long as there is no mutation [Figure 4B]). Even when mutation is allowed to drive within- and between-collective dynamics, stability of phenoytpe holds for more than 200 generations (Appendix 1—figure 6).

Figure 4

Download asset Open asset

Dynamics of ancestral and derived collectives in the neutral regime.

Comparison of the dynamics of the colour distribution after removing selection (neutral regime). The population of 1000 collectives is initially composed of collectives with a colour distribution identical to that at generation 10,000 in Figure 2B. Particle traits are: (A) as in generation 1 of Figure 2; (B) derived after 10,000 generations of collective-level selection for purple. In both instances, particle mutation was turned off in order to focus on ecological dynamics, otherwise parameters are the same as in Figure 2A. Appendix 1—figure 6 shows the outcome with particle mutation turned on. The first 10 collective generations are magnified in order to make apparent the initial rapid changes. The particle traits derived after evolution are such that the majority of collectives maintains a composition close to the optimum $\hat{ϕ}$ even when the selective pressure is removed. This feature is instead rapidly lost in populations of collectives with the same initial colour, but with particle traits not tuned by evolution.

From particle ecology to collective phenotype

To understand the mechanistic basis of the canalising process, particle traits must be linked to the evolutionary emergence of collective-level inheritance, which we define as the capacity of collectives to re-establish the parental collective colour. Figure 5 shows the relationship between the initial colour of collectives at the moment of birth (the moment immediately following dilution, $t = 0$ [the newborn colour]), and collective colour after a single particle growth cycle (the moment immediately preceding dilution, $t = T$ [the adult colour]). Figure 5A shows this relationship at generation 3 while Figure 5B shows this relationship at generation 9000.

Figure 5

Download asset Open asset

Effect of collective-level selection on newborn-to-adult colour.

The adult colour of collectives as a function of their newborn colour is displayed for collectives of uniformly distributed initial colour. Stochastic simulations are realized by using particle traits representative of: (A) generation 3 and (B) generation 9000 (as in Figure 3). Dots indicate the mean adult colour from 50 simulations and its standard deviation. The orange line depicts the growth function $G$ for the corresponding deterministic approximation (see main text and Appendix 2). The dashed line traces the discrete-time deterministic dynamics of the collective colour, starting from $ϕ = \frac{1}{B}$ , and across cycles of growth and noise-less dilution. For ancestral particle traits (A), collective colour converges towards the red monochromatic fixed point. After selection for collective colour (B), the growth function is such that the optimum colour ( $\hat{ϕ}$ ) is reliably produced within a single generation for virtually the whole range of possible founding colour ratios. The latter mechanism ensures efficient correction of alea occurring at birth and during development.

At generation 3, the proportion of red particles increases (within a collective generation), irrespective of the initial proportion. This is because red particles grow faster than blue and the primary determinant of particle success is growth rate (interactions are negligible in exponential growth). Thus, the only way that purple collectives can be maintained is if the collective phenotype is sufficiently noisy, to ensure that some collectives happen by chance to be purple, due to, for example, stochastic effects at dilution. Even if offspring collectives do not resemble their parents, purple colour is maintained via strong purifying selection that purges collectives that are either too red or too blue. The mechanism is stochastic correction (Maynard Smith and Szathmary, 1995; Grey et al., 1995; Johnston and Jones, 2015).

This is in marked contrast to the situation at generation 9000. After a single growth cycle, the proportion of red particles increases when the initial proportion is below, and decreases when it is above, the optimal proportion 0.5. Thus, at generation 9000, irrespective of initial conditions, the adult colour of any given collective will be closer to $\hat{ϕ} = 0.5$ than it was on founding. Accordingly, extreme purifying selection is no longer required to maintain the parent-offspring relationship. Indeed, offspring collectives return to the parent phenotype even when the phenotype at birth departs significantly from the parent (adult) phenotype. ‘‘Correction’’ stems from the ecological dynamics of the particles and resembles a developmental process. Hereafter we refer to this correction process as the developmental corrector.

The relationship between newborn and adult colour of collectives shown in Figure 5 can be used to follow the fate of collectives over several cycles of growth and reproduction, provided the stochastic effects associated with the dilution phase are momentarily ignored. The iteration using particle trait values from generation 3 is shown by the dotted line in Figure 5A (the adult colour of a collective is the newborn colour for the next cycle, following a 'staircase' geometric procedure). Because red particles grow faster than blue, it takes just six collective generations for red particles to fix within collectives. Conversely, after particle trait evolution (Figure 5B), the same staircase approach applied to newborn collectives of any colour shows rapid convergence to the colour purple (0.5) irrespective of the starting point. The difference in the relationship between initial and final colour at generation 3 and 9000 is evidence of the emergence of a mechanism for developmental correction.

In order to systematically explore the possible newborn-to-adult colour map and to understand how it changes through the evolution of particle traits, we use a deterministic approximation (orange line in Figure 5). This approximation is denoted $G$ or growth function (Appendix 2, Definition 2) and stems from an ordinary differential equation model often referred to as the competitive Lotka-Volterra system (Appendix 2, Equation 1). This model is the limit for vanishing noise of the stochastic particle ecology, and provides a good approximation of the simulations (Dotted lines in Figure 3C–D). The growth function $G$ captures the outcome of the ecological dynamics (i.e. the fraction of red particles) after founding populations are allowed to grow for a finite time interval $T$ . We note similarity between the $G$ function and the recently proposed ‘community-function landscape’ (Xie and Shou, 2018). The shape of $G$ depends on the value of particle traits $θ$ (growth rates $r_{0}$ and $r_{1}$ , and competition parameters $a_{00} = a_{0}^{intra}$ , $a_{10} = a_{0}^{inter}$ , $a_{01} = a_{1}^{inter}$ , $a_{11} = a_{1}^{intra}$ ), but also on the bottleneck size at dilution $B$ and the collective generation duration $T$ . The fixed points of $G$ (i.e. $ϕ$ such that $G (ϕ) = ϕ$ ) are of particular interest: in the deterministic model, these represent colours that are left unchanged during a generation. Such a fixed point is stable if the colours of collectives starting in its neighbourhood all converge to it ( $ϕ = 1$ in Figure 5A, $ϕ = 0.5$ in Figure 5B), and unstable otherwise ( $ϕ = 0$ in Figure 5A, $ϕ = 0$ and $ϕ = 1$ in Figure 5B).

Under collective-level selection for colour, $T$ and $B$ are constant and particle traits evolve so that $G$ eventually has a stable fixed point, corresponding to the target colour $\hat{ϕ}$ . Progressive change in shape of the $G$ function across collective generations in a simulated lineage (Figure 2B) is illustrated in Figure 6. Note that these changes are continuous: small mutations in particle traits reflect as small changes in the shape of $G$ .

Figure 6

Download asset Open asset

Evolutionary variation of the growth function under collective selection.

function associated with the resident types for a single lineage of collectives from the simulation of Figure 2B, plotted every 20 collective generations from 0 to 9000. The result of iterations of $G$ gradually changes from fixation of the fast growing particle (Figure 5A) to convergence toward the colour purple (Figure 5B).

The evolutionary trajectory of Figure 2B can now be understood in terms of the progressive evolution of particle traits (see Appendix 2 for a detailed description). At the beginning, particles compete mostly during exponential phase, so that adult colour is biased towards the fast-growing type. Initial improvement in transmission of colour from parent to offspring arises as exponential growth rates $r_{i}$ of the particles align. Correspondingly, the $G$ function approaches linearity. A successive increase in maximal growth rate separates particle and collective time scales, allowing particles to experience density-dependent interactions. Eventually, such interactions evolve towards a regime where the $G$ function is nonlinear and fluctuations are readily compensated, thus developmental correction ensures a reliable colour inheritance.

The $G$ function, which allows characterisation of particle ecology, can now be used as a guide to optimise the ‘life cycle’ of growth and dilution that acts as a scaffold for the evolutionary process. In a typical experiment of community-level evolution, collective generation duration $T$ and bottleneck size $B$ are fixed. Some choices of these collective-level parameters are however likely to lead to collective phenotypes that are so far from the optimum that collective lineages go extinct. For instance, if in the first-generation competitive exclusion occurs rapidly, then distinguishing collectives based on collective colour may be impossible. Intuition suggests that the closer the fixed point of the $G$ function is to the target colour, the more efficient collective-level selection will be, and the faster the evolutionary dynamic. It is thus possible to use the distance between the fixed point of $G$ and the target composition $\hat{ϕ}$ as a proxy for the probability that collective lineages will go extinct before attaining the desired colour. Below, we examine how the position of the fixed point of $G$ changes as a function of collective generation duration $T$ and bottleneck size $B$ .

Effect of collective generation duration and bottleneck size

The growth function $G$ is readily computed from the particle traits and collective parameters even though it has in general no analytic expression (but see Appendix 2 for limit cases of exponential and saturating particle growth). There are four possible qualitative shapes of $G$ , that differ in the position and stability of the fixed points (illustrated in Appendix 2—figure 3-1 to 3-4).

The qualitative dependence of $G$ and its fixed points on collective-level parameters varies with the underpinning particle ecology, making it easier for some communities to be starting points for the successful evolution of inheritance. Particle traits can be classified in four broad classes, based of the nature of the corresponding ecological equilibrium. For each of these classes, and when red particles grow faster than blue $r_{0} > r_{1}$ , the fixed points of $G$ are illustrated in Appendix 2—figure 3-A to 3-D as a function of the collective-level parameters $B$ and $T$ . Figure 7 refers to the situation where inter-colour interaction traits are smaller than intra-colour interaction traits. Here, particle populations converge in the long term to a coexistence equilibrium, where collective colour is $ϕ^{*} = \frac{a_{11} - a_{01}}{a_{11} - a_{01} + a_{00} - a_{10}}$ (in general, different from the optimum). This equilibrium can be approached within a single collective generation if $T$ and $B$ are large (top right corner). On the other hand, when $T$ and $B$ are small (red region), the only stable fixed point invovles collectives composed solely of fast-growing particles. This corresponds to cases where individual and collective time scales (quantified by $r^{- 1}$ and $T$ , respectively) are insufficiently separated, or newborn size is too small, so that particle demography is essentially exponential and interactions cannot provide sufficient correction. For rapid evolution of collective colour, the most favourable starting position is one where the fixed point is closest to the optimal colour (for $\hat{ϕ} = 0.5$ this occurs for intermediate collective generation duration and bottleneck size for the trait values in Figure 7). Knowledge of the exact values requires, however, some preliminary measure of the ecological dynamics. Even in the absence of such information, the diagram in Figure 7 can be used to optimise experimental design by revealing intrinsic trade-offs. A decrease in generation time, necessary for practical reasons, may for instance, be compensated by an increase in bottleneck size, without affecting the average collective phenotype.

Figure 7

Download asset Open asset

Stable fixed point of $G$ as a function of collective-level parameters.

Classification of the qualitative shape of the growth function and dependence on collective parameters B (bottleneck size) and T (growth phase duration). Considered here are particle traits that allow coexistence ( $a_{01} < a_{11}$ and $a_{10} < a_{00}$ , $r_{0} > r_{1}$ , see Appendix 2—figure 3 for the other possible parameter regions). The black line represents the limit of the region of stability of the fixed point of G, separating the two qualitatively different scenarios illustrated in the inset (see Appendix 2, Proposition 4 for its analytic derivation): for short collective generations and small bottleneck size, the faster growing red type competitively excludes the blue type over multiple collective generations. In order for particle types to coexist over the long term, growth rate and the initial number of particles must both be large enough for density-dependent effects to manifest at the time that selection is applied.

Even when collective-level parameters are optimised so that the attractor of the $G$ function is initially close to the target colour, collective-level selection will keep acting on the particle traits, and affect phenotypic variability within the population of collectives. As stability of the fixed point increases, so to does fidelity of phenotype transmission from parent to offspring collectives. Once collective-level processes are set as to minimise the probability of collective extinction, the main obstacles to evolving higher inheritance come from constrains acting on particle traits, which may limit the range of attainable $G$ functions. Trade-offs on particle ecology may prevent the $G$ function to attain an internal fixed point. We discuss two examples on constrained evolution in the following paragraph.

Constrained trajectories

Thus far, we have considered evolution within a four-dimensional parameter space defined by maximum growth rates and inter-colour competition parameters. In real systems, however, constrains and trade-offs may limit the range of achievable variations in particle traits. For instance, even though faster growing particles will always experience positive selection, cell replication rate cannot increase boundlessly. Here, we consider two instances of constrained evolution, where only a subset of particle traits are allowed to mutate.

First, we consider the case where competition parameters are vanishingly small, so that $G$ has no internal fixed point. Under such conditions, particle growth rates evolve to be identical (Figure 8A). In the absence of interactions, this is the only available solution to maintain collectives with an equal number of red and blue type particles. Under these circumstances, $G$ converges to the identity function. In the deterministic approximation, collective composition remains constant in time, but stochastic fluctuations that cause colour to deviate from the optimum are amplified across collective generations. These deviations are nonetheless corrected in the collective population by propagating only those collectives whose colour is closest to the optimum. Such stochastic correction (Maynard Smith and Szathmary, 1995), however, has a high risk of failure if selection is strong and collective population size is small.

Figure 8

Download asset Open asset

Constrained evolutionary trajectories.

Dynamics through time of resident particle traits (black dots, whose size measures their abundance in the collective population) along simulated evolutionary trajectories of 300 generations, when particle-level traits are constrained. For both panels $D = 1000$ , $\hat{ϕ} = 0.5, ρ = 20 %$ , $B = 15$ , and $T = 1$ . The trajectory of the average resident traits is shown in white. The heatmap represents the value of $G (0.5)$ as a function of the evolvable traits, and the white dotted line indicates where collective colour is optimum. (A) Particle growth rates evolve and particles do not compete ( $a^{inter} = a^{i n t r a} = 0$ ). The evolutionary dynamics leads to alignment of growth rates ( $r_{0} = r_{1}$ ). (B) Inter-colour competition traits evolve and particle growth rates are constant ( $r_{0} = r_{1} = 25$ ). The evolutionary dynamics first converge toward the optimality line. In a second step, asymmetric competition evolves: $a_{1}^{inter} \to 0$ and $a_{0}^{inter} \to a_{0}^{intra} - a_{1}^{intra}$ . This results in a flatter $G$ function around the fixed point, providing a faster convergence to optimum colour across collective generations (Appendix 2—figure 6). Similar results are obtained for non-identical, but sufficiently high, growth rates.

Second, we consider the case when mutations only affect the two inter-type competition parameters, while growth rates are held constant (to sufficiently high values, so that particles experience density-dependent effects in the growth phase). The evolutionary trajectory can be visualised in the plane of competition parameters $(a_{01}, a_{10})$ . Figure 8B shows the result of a stochastic simulation superimposed to the value of $G (0.5)$ . Independent of the initial values of the interaction parameters, evolution draws the system to the manifold associated with the optimal proportion $\hat{ϕ}$ (white dashed line). Evolution within this manifold is neutral in the deterministic approximation, but the presence of stochastic fluctuations drives further improvement of the fitness landscape. Correction is indeed more efficient and the distribution of collective phenotypic diversity narrower when the gradient of $G$ in the fixed point is smaller. The condition on particle traits for the latter to vanish only depends on the carrying capacities of the two particle types, and corresponds to the type with smallest carrying capacity having zero interaction rate (see Appendix 2). A similar outcome is observed when, along an evolutionary trajectory, growth rates no longer influence adult colour (Figure 2). Developmental correction thus selects for maximal asymmetry in interactions, whereby one particle type drives the ecological dynamics of the other type, but is itself only affected by its own type (this is fully elaborated in Appendix 2).

Discussion

In nature, communities rarely ever qualify as units of selection in the traditional sense (Lewontin, 1970; Godfrey-Smith, 2009), because communities in nature rarely manifest heritable variance in fitness. In the laboratory, however, experimenters can exogenously impose (scaffold) Darwinian-like properties on communities such that they have no choice, but to become units of selection (Wilson and Sober, 1989; Xie et al., 2019; Black et al., 2020). This typically involves placement of communities in some kind of container (pot, test-tube, flask, droplet, etc.) so they are bounded and variation at the community level is thus discrete. Communities are then allowed time for individual members to replicate and interact. At the end of the 'growth' period, community function is assessed based on pre-determined criteria. The experimenter then effects replication of successful communities while discarding those that under-perform. Replication typically involves transferring a sample of individuals from a successful community to a new container replete with a fresh supply of nutrients.

Experimental and theoretical studies indicate that artificial selection on microbial communities results in rapid functional improvement (Swenson et al., 2000a; Swenson et al., 2000b; Goodnight, 2000; Wade, 2016; Xie et al., 2019). This is not unexpected given that experimental manipulations ensure that communities engage directly in the process of evolution by (artificial) selection as units in their own right. However, for such effects to manifest there must exist a mechanism of community-level inheritance.

Consideration of both the effectiveness of artificial selection and the problem of heredity has led to recognition that the answer likely lies in interactions (Wilson and Sober, 1989; Swenson et al., 2000a; Swenson et al., 2000b; Goodnight, 2000; Rainey et al., 2017). The intuition stems from the fact that in the absence of interactions, communities selected to reproduce because of their beneficial phenotype will likely fail to produce offspring communities with similar functionality. If so, then these communities will be eliminated at the next round. Consider, however, an optimal community in which interactions emerge among individuals that increase the chance that offspring communities resemble the parental type. Such an offspring community will then likely avoid extinction at the next round: selection at the level of communities is thus expected to favour the evolution of interactions because inheritance of phenotype is now the primary determinant of the success (at the community level). Indeed, simulations of multi-species assemblages have shown that evolution of interaction rates not only improves diversity-dependent fitness, but also increases collective ‘heritability’, defined as the capacity of randomly seeded offspring communities to reach the same dynamical state as their parents (Ikegami and Hashimoto, 2002; Penn, 2003). Further studies have stressed the role of the extracellular environment and of specific interaction networks, pointing out that microscopic constrains can affect the capacity of communities to participate in evolutionary dynamics at the higher level (Williams and Lenton, 2007; Xie and Shou, 2018; Xie et al., 2019).

Here, inspired by advances in millifluidics, we have developed a minimal mechanistic model containing essential ingredients of multi-scale evolution and within-community competition. We considered collectives composed of two types of particles (red and blue) that interact by density-dependent competition. By explicitly modelling demographic processes at two levels of organisation, we have obtained mechanistic understanding of how selection on collective character affects evolution of composing particle traits. Between-collective selection fuels changes in particle-level traits that feedback to affect collective phenotype. Selection at the level of communities thus drives the evolution of interactions among particles to the point where derived communities, despite stochastic effects associated with sampling at the moment of birth, give rise to offspring communities that reliably recapitulate the parental community phenotype. Such is the basis of community-level inheritance. Significantly, it has arisen from the simplest of ingredients and marks an important initial step in the endogenisation of Darwinian properties: properties externally imposed stand to become endogenous features of the evolving system (Black et al., 2020).

The mechanism by which particles interact to establish community phenotype is reminiscent of a development process. We have refered to this as the ‘developmental corrector’. In essence, it is akin to canalisation, a central feature of development in complex living systems (Buss, 1987), and the basis of inheritance (Griesemer, 2002). Developmental correction solves the problem of implementing specific protocols for mitigating non-heritable variations in community function (Xie et al., 2019).

Developmental correction can be viewed as an evolutionary refinement of the stochastic corrector mechanism (Maynard Smith and Szathmary, 1995; Grey et al., 1995; Johnston and Jones, 2015). Both stochastic and developmental correctors solve the problem of producing enough well-formed collectives at each successive generation to prevent community-level extinction. The stochastic corrector mechanism relies on a low-fidelity reproduction process coupled to high population sizes. Deviations from successful collective states are corrected by purging collectives that depart significantly from the optimal collective phenotype. However, in the absence of strong collective-level selection the optimal community phenotype is rapidly lost. In contrast, the developmental corrector mechanism ensures that the optimal community phenotype is maintained without need for hard selection. Regardless of perturbations introduced by demography or low initial particle number, most collectives reliably reach a successful adult state. In our simulations, we show that community phenotype is maintained even in the absence of community-level selection, although ultimately mutational processes affecting particle dynamics result in eventual loss of the developmental corrector mechanism.

An operationally relevant question concerns the conditions (the initial state of the population, the nature of the scaffold and of particle-level interactions) for selection on a collective character to result in evolution of developmental correction. While we did not detail the probability of collective lineage extinction, it is possible that collectives become monochromatic before evolution has had time to act on particle traits. In such cases, which are more likely if particle-level traits are far from the region of coexistence, and if time-scales of particle and collective generations are not well separated, then collective-level evolution will grind to a halt. In all other cases, provided there are no other evolutionary constraints, selection will eventually lead the system toward regions of particle trait-space where the collective phenotype becomes reliably re-established. The efficiency of this selective process and its transient behaviour depend on collective-level parameters that control growth and reproduction.

From our individual-based simulations and ensuing deterministic approximation, it is clear that once density-dependent interactions govern the adult state, then collective-level selection for colour is promptly effected. This happens provided the intra-collective ecology lasts long enough for nonlinear effects to curb particle growth. When this is not the case, for example when the bottleneck at birth is small, or collective-level generation time is too short, evolution of developmental correction will be impeded. The latter favours rapidly growing particles (Abreu et al., 2019) and offers little possibility for the evolution of developmental correction. When the ecological attractor within collectives leads to the extinction of one of the two types, long collective-level generation times are incompatible with the maintenance of diversity (van Vliet and Doebeli, 2019). However, in our model, particle-level evolution changes the nature of the attractor from extinction of one of two types to stable coexistence, and concomitantly particle and collective time-scales become separated. Even before developmental correction becomes established, evolution can transiently rely on stochastic correction to ensure the maintenance of particle co-existence.

There are two aspects to heredity: resemblance — the extent to which reproduction and development maintain the average offspring phenotype — and fidelity (or determination) — a measure of phenotypic variance (Jacquard, 1983; Bourrat, 2017). In our model, resemblance is established once density-dependent interactions counter the bias toward fast replicating particles: when the $G$ function has an internal fixed point in $\hat{ϕ}$ , systematic drift of average collective colour is prevented. The increase in resemblance is associated with progressive divergence of particle and collective demographic time scales. As a consequence, the collective phenotype is placed under the control of particle traits rather than demographic stochasticity. On a longer time scale, fidelity improves by subsequent changes in interaction parameters under the constraint that they do not affect average adult colour. The variance of the phenotype around the optimum is reduced by increasing canalisation (flattening of the $G$ function). This is best achieved by a strong asymmetry in the competition traits, whereby one type has a logistic, uncoupled, dynamic, and the second type adjusts its growth to the former’s density. Interestingly, it is always the type with the lower carrying capacity, regardless of its relative growth rate, that acts as the driver.

The relationship between parameters on very long time scales, when the adult colour is essentially dependent on interaction rates, depends critically on the space of possible values particle traits can assume. For instance, our analysis took into account only competitive intractions between colours. Extension of the deterministic approximation to cases when ecological interactions between colours are exploitative or mutualistic indicates that selection for collective coulour can drive changes in the very nature of the interactions so as to make them progress towards less and less reciprocally harmful coexistence (for full elaboration see Appendix 3).

Our goal has been to produce a simple, tractable scenario for studying the effects of artificial selection on collectives, which while theoretical, is firmly connected to plausible biological experiments. The model could be extended in multiple ways in order to analyse the effects of additional factors, including impact of non-overlapping generations and variation in the timing of reproduction (which would introduce an element of bet-hedging), of migration and mixing between collectives (which could be akin to gamete production and zygote formation), and inclusion of more than two kinds of particle types. More complex selective regimes can also be envisaged, such as those that reward collectives based on absolute population size of particle types, which would allow less abstract collective functions to be considered. However, regardless of these refinements, we suspect that our core conclusion will stand firm: collective-level selection favours particle dynamics that improve collective-level heredity. The ability to reliably re-establish successful adult states of past-generations from simpler and potentially noisy initial conditions is adaptive at the collective level.

The mechanism of developmental correction is broadly relevant and extends beyond cells and communities to particles of any kind that happen to be nested within higher-level self-replicating structures. As such, the mechanism of developmental correction may be relevant to the early stages in each of the major (egalitarian) evolutionary transitions in individuality (Queller, 1997; Maynard Smith and Szathmary, 1995), where maintenance of particle types in optimal proportions was likely an essential requirement. For example, it is hard to see how protocells cells evolved from lower level components (Takeuchi and Hogeweg, 2009; Baum and Vetsigian, 2017), chromosomes from genes (Smith and Szathmáry, 1993), and the eukaryotic cell from independent bacterial entities (Martin and Müller, 1998) without some kind of self-correcting mechanism acting at the collective level.

Beyond these fundamental considerations, the mechanism of developmental correction and the ecological factors underpinning its evolution have important implications for top-down engineering of microbial communities for discovery of new chemistries, new functions, and even new organisms. The minimal recipe involves partitioning communities into discrete packages, provision of a period of time for cell growth, selective criteria that lead to purging of sub-optimal collectives and reproduction of optimal collectives to establish the next generation of collectives. These manipulations are readily achieved using millifluidic devices that can be engineered to operate in a Turing-like manner allowing artificial selection on community-level traits across thousands of independent communities. As mentioned above, critical tuneable parameters beyond number of communities, mode of selection and population size, are duration of collective generation time and bottleneck size at the moment of birth.

The extent to which the conclusions based on our simple abstract model are generally applicable to the evolution of more complex associations, such as symbioses leading to new forms of life, will require future exploration of a broader range of particle-level ecologies. Possibilities to make community dynamics more realistic by complexifying mathematical descriptions of particle-level processes are plentiful (Williams and Lenton, 2007; Zomorrodi and Segrè, 2016). Of particular interest for the evolution of efficient developmental correction are cases when community ecology has multiple attractors (Penn and Harvey, 2004), is highly sensitive to initial conditions (Swenson et al., 2000b), or presents finite-effect mutations sustaining ‘eco-evolutionary tunnelling’ (Kotil and Vetsigian, 2018). Besides enlarging the spectrum of possible within-collective interactions, future relevant extensions might explore the role of physical coupling among particles and of horizontal transmission between collectives (van Vliet and Doebeli, 2019) in enhancing or hampering efficient inheritance of collective-level characters.

Methods

Methods are described in Appendix 1, 2 and 3, interspersed with more technical descriptions of the results presented in the main text.

Appendix 1

Stochastic model

This appendix presents an outline for the approximated stochastic simulation of nested population dynamics described in the main text. We first attend to the case where particle populations are monomorphic without mutation and then move to consider the role of particle-level mutation. Full implementation of the model is available as Source code 1 and at https://gitlab.com/ecoevomath/estaudel (Doulcier, 2020).

Parameters

First, we list the parameters of the numerical model introduced in the main text. The collective selection regime is specified by a set of collective-level parameters that are kept constant along the evolutionary trajectory.

\begin{array}{ll} / / P a r a m e t e r s \\ D \leftarrow 1000 & / / N u m b e r o f c o l l e c t i v e s \\ M \leftarrow 10, 000 & / / N u m b e r o f c o l l e c t i v e g e n e r a t i o n s \\ B \leftarrow 15 & / / B o t t l e n e c k s i z e \\ T \leftarrow 1.0 & / / D u r a t i o n o f a c o l l e c t i v e g e n e r a t i o n \\ r e g i m e \leftarrow s e l e c t i v e & / / S e l e c t i v e o r N e u t r a l r e g i m e \\ ρ \leftarrow 0.2 & / / F r a c t i o n o f e x t i n g u i s h e d c o l l e c t i v e s \\ \hat{ϕ} \leftarrow 0.5 & / / O p t i m a l c o l l e c t i v e c o l o u r (f o r s e l e c t i v e r e g i m e) \end{array}

Collectives are comprised of two kinds of self-replicating particle (red and blue) that carry a different set of traits. Traits can mutate (see the mutation section below), and are represented as global variables.

\begin{array}{ll} / / P a r t i c l e t r a i t s \\ / / C a r r i e d b y r e d p a r t i c l e s \\ r_{0} / / M a x i m u m g r o w t h r a t e \\ a_{0}^{i n t r a} / / C o m p e t i t i o n w i t h r e d p a r t i c l e s \\ a_{0}^{i n t e r} / / C o m p e t i t i o n w i t h b l u e p a r t i c l e s \\ / / C a r r i e d b y b l u e p a r t i c l e s \\ r_{1} / / M a x i m u m g r o w t h r a t e \\ a_{1}^{i n t r a} / / C o m p e t i t i o n w i t h b l u e p a r t i c l e s \\ a_{1}^{i n t e r} / / C o m p e t i t i o n w i t h r e d p a r t i c l e s \end{array}

The state variables ( $D x M$ matrices) store the adult state of collectives along a trajectory.

\begin{array}{ll} / / S t a t e v a r i a b l e s \\ N_{0} / / n u m b e r o f b l u e i n d i v i d u a l s i n e a c h c o l l e c t i v e a t e a c h g e n e r a t i o n \\ N_{1} / / n u m b e r o f r e d i n d i v i d u a l s i n e a c h c o l l e c t i v e a t e a c h g e n e r a t i o n \\ Φ / / p r o p o r t i o n o f r e d i n d i v i d u a l s i n e a c h c o l l e c t i v e a t e a c h g e n e r a t i o n \end{array}

Initial conditions

Initial conditions consist in defining the number of red and blue particles in each collective at the beginning of generation 0.

\begin{array}{ll} p r o c e d u r e I N I T I A L C O N D I T I O N S \\ x_{0} \leftarrow 0.5 / / I n i t i a l r e d - b l u e r a t i o \\ f o r d f r o m 1 t o D d o \\ N_{0} [d, 0] \leftarrow R a n d o m B i n o m i a l (B, x_{0}) \\ N_{1} [d, 0] \leftarrow B - N_{0} [d, 0] \end{array}

Outline of the main loop

The main loop of the algorithm applies the sequence growth-selection-reproduction for each generation.

\begin{array}{ll} p r o c e d u r e M A I N L O O P \\ f o r m f r o m 1 t o M d o \\ / / P a r t i c l e G r o w t h \\ f o r d f r o m 1 t o D d o \\ N_{0} [d, m], N_{1} [d, m] \leftarrow G R O W T H (N_{0} [d, m], N_{1} [d, m], r_{0}, r_{1}, a_{0}^{i n t r a} a_{0}^{i n t e r}, a_{1}^{i n t r a} a_{1}^{i n t e r}) \\ Φ [d, m] \leftarrow N_{1} [d, m] / (N_{0} [d, m] + N_{1} [d, m]) \\ / / C o l l e c t i v e - l e v e l s e l e c t i o n \\ p a r e n t s \leftarrow S E L E C T_C O L L E C T I V E S (Φ [d, m], ρ, \hat{ϕ}) \\ / / C o l l e c t i v e - l e v e l r e p r o d u c t i o n \\ f o r d f r o m 1 t o D d o \\ N_{0} [d, m + 1] \leftarrow R a n d o m B i n o m i a l (B, Φ [parents [d], m]) \\ N_{1} [d, m + 1] \leftarrow B - N_{0} [d, m + 1] \end{array}

Particle-level ecology

The ecological dynamics of particles is expressed by a multi-type birth-death process with a linear birth rate and a linearly density-dependent death rate. Each type of particle $i$ is characterised by four traits: colour ( $c_{i}$ , red or blue), maximum growth rate $r_{i}$ , and two density-dependent interaction parameters. Particles of the same colour interact according to $a_{i}^{intra}$ , whereas particles of different colour interact according to $a_{i}^{inter}$ . Interaction terms are in the order of 0.1 and scaled by a carrying capacity term $K$ . The dynamic is modelled by a continuous-time Markov jump process with rates:

Each particle of type i . . .	With rate. . .
Reproduces (add a particle of type i) Dies (remove a particle of type i)	$r_{i}$ $r_{i} (\sum_{j} δ_{c_{i} = c_{j}} x_{j} a_{j}^{intra} K^{- 1} + \sum_{j} δ_{c_{i} \neq c_{j}} x_{j} a_{j}^{inter} K^{- 1})$

$δ_{i = i} = 1$ if $i = j$ or 0 if $i \neq j$ . Additionally $δ_{i \neq i} = 1$ if $i \neq j$ or 0 if $i = j$ .

The stochastic trajectory of the system is simulated using a Poissonian approximation used in the basic $τ -leap$ algorithm (Gillespie, 2001), $d t$ is chosen to be small enough so that population size never becomes negative.

\begin{array}{ll} f u n c t i o n G R O W T H (n_{0}, n_{1}, r_{0}, r_{1}, a_{0}^{i n t r a} a_{0}^{i n t e r}, a_{1}^{i n t r a} a_{1}^{i n t e r}) \\ / / S t o c h a s t i c s i m u l a t i o n o f t h e p o p u l a t i o n d y n a m i c s \\ w h i l e t < T d o \\ b i r t h 0 \leftarrow R a n d o m P o i s s o n (d t \times n_{0} r_{0}) \\ b i r t h 1 \leftarrow R a n d o m P o i s s o n (d t \times n_{1} r_{1}) \\ d e a t h 0 \leftarrow R a n d o m P o i s s o n (d t \times n_{0} r_{0} (n_{0} a_{0}^{intra} + n_{1} a_{1}^{inter})) \\ d e a t h 1 \leftarrow R a n d o m P o i s s o n (d t \times n_{1} r_{1} (n_{0} a_{0}^{inter} + n 1 a_{1}^{intra})) \\ n_{1} \leftarrow n_{1} + b i r t h 1 - d e a t h 1 \\ n_{0} \leftarrow n_{0} + b i r t h 0 - d e a t h 0 \\ t \leftarrow t + d t \\ R e t u r n n_{0}, n_{1} \end{array}

Early tests using an exact stochastic simulation algorithm (Doob-Gillespie SSA, Gillespie, 1976) did not exhibit qualitative changes in the trajectory, but greatly increased the computation duration.

Collective-level selection

The collective-level selection phase consists in associating each of the D new collectives from generation $m + 1$ with a single parent at generation m. In the main text we contrast two regimes: colour-neutral and colour-selective. In both cases, a fixed proportion $ρ$ of the collective population at generation $m$ is marked for extinction. In the neutral regime, collectives to be eliminated are selected uniformly at random (Appendix 1—figure 1A), whereas in the selective regime they are those that rank the highest in their distance to the optimal colour $\hat{ϕ}$ (Appendix 1—figure 1B). Each surviving collective produces offspring. Moreover, the remaining collectives from generation $m + 1$ are generated by a parent chosen uniformly at random from the set of surviving collectives.

Appendix 1—figure 1

Download asset Open asset

Collective-level selection regimes.

Each ring represents a collective. The blue section of the ring represents the proportion of blue particles at the adult stage of the collective. Parent and offspring are linked by a black line. (A) One generation of the neutral regime. (B) One generation of the selective regime. In both cases $M = 1, D = 40, ρ = 0.4$ .

\begin{array}{ll} f u n c t i o n S E L E C T_C O L L E C T I V E S (ϕ, ρ, \hat{ϕ}, r e g i m e) \\ / / R e t u r n t h e i n d i c e s o f t h e n e w c o l l e c t i v e s^{'} p a r e n t s \\ s u r v i v i n g \leftarrow e m p t y l i s t / / i n d i c e s o f t h e s u r v i v i n g c o l l e c t i v e s \\ r e p r o d u c i n g \leftarrow e m p t y l i s t / / i n d i c e o f t h e r e p r o d u c i n g c o l l e c t i v e s \\ p a r e n t s \leftarrow e m p t y l i s t / / i n d i c e s o f t h e p a r e n t c o l l e c t i v e s \\ i f r e g i m e i s s e l e c t i v e t h e n \\ t h r e s h o l d \leftarrow P e r c e n t i l e ((ϕ - \hat{ϕ})^{2}, ρ) \\ f o r d f r o m 1 t o D d o \\ i f (ϕ [d] - \hat{ϕ})^{2} < t h r e s h o l d t h e n \\ A d d d t o s u r v i v i n g \\ e l s e i f r e g i m e i s n e u t r a l t h e n \\ s u r v i v i n g = R a n d o m M u l t i n o m i a l W i t h o u t R e p l a c e m e n t (1... d, n = (1 - ρ) D) \\ / / E x t i n c t c o l l e c t i v e s a r e r e p l a c e d b y t h e o f f s p r i n g o f a r a n d o m l y d r a w n s u r v i v i n g c o l l e c t i v e \\ f o r 1 t o D - L e n g t h (s u r v i v i n g) d o \\ A d d R a n d o m C h o i c e (s u r v i v i n g) t o r e p r o d u c i n g \\ / / S u r v i v i n g c o l l e c t i v e s h a v e a t l e a s t o n e o f f s p r i n g, a n d t h e p o p u l a t i o n \\ s i z e i s k e p t c o n s t a n t b y a d d i t i o n a l r e p r o d u c t i o n e v e n t s . \\ p a r e n t s \leftarrow C o n c a t e n a t e (s u r v i v i n g, r e p r o d u c i n g) \\ R e t u r n p a r e n t s \end{array}

Other selection procedures can be implemented, such as randomly sampling $ρ D$ collectives with weight based on the colour-deviation to the optimal colour. A non-exhaustive exploration of other selection rules indicates that the qualitative results of the model are robust to changes in the selective regime, as long as collectives with an optimal colour are favoured and the collective population does not go extinct.

Collective reproduction is implemented by seeding an offspring collective with a sample of B particles drawn according to the proportion of the parent collective. We assume that the final particle population sizes are big enough so that each reproduction event can be modelled as an independent binomial sample. Smaller population sizes might require simultaneous multinomial sampling of all offspring.

Mutation of particle traits

The complete model adds the possibility for particle trait ( $r, a^{i n t e r}$ ) to mutate. Each collective contains two variants of each colour. Whenever a variant goes extinct, the remaining type is called the ‘resident’, and a mutant type is created as follows. First, traits of the resident are copied in one newborn particle, then one of the mutable traits — either the growth rate ( $r$ ) or the inter-colour competition trait ( $a_{inter}$ ) — is chosen at random, and finally a random value is added that is taken from a uniform distribution over $[- ε, ε]$ (in Figure 2, $ε = 0.1$ ). Traits are kept positive by taking the absolute value of the result. This process is in the spirit of adaptive dynamics in which invasion of a single new mutant is repeatedly assessed in a monomorphic population.

We checked that relaxing this assumption (i.e. allowing more than two types of each colour in each collective), or waiting for rare mutations to appear did not change the qualitative results. The pseudo-code outlined above was modified in order to track the trait value of both resident and mutant types in each collective, rather than having the trait values as global variables.

Variability of the derived particle traits

The single trajectory of the stochastic model discussed in the main text (Figure 2) is obtained by setting initial conditions for both collective composition (fraction of red and blue particles in each collective at the beginning of the first collective generation) and for the value of particle-level parameters that are subjected to mutations. We used this specific trajectory to illustrate key features of the evolutionary outcome, that are then explained by the deterministic approximation (Appendix 2). Such approximation, discussed below, allows exhaustive exploration of parameter space, that would otherwise prove impossible because of computation demands. However, it provides only indirect insight on the expected variance of the corresponding particle-based stochastic process. Here, we address variability of the evolutionary outcome of stochastic simulations in a few relevant cases.

Appendix 1—figure 2

Download asset Open asset

Distribution of average mutable traits values across several simulations.

Three parameters sets are represented in which red and blue types have respectively equal carrying capacity ( $a_{0}^{intra} = a_{1}^{intra} = 0.7 / K$ ), red types have a higher carrying capacity ( $a_{0}^{intra} = 0.4$ ) and lower carrying capacity ( $a_{0}^{intra} = 0.8$ ). The results of 20 independent simulations for each of the parameters sets are shown. For each simulation, $D = 100$ collectives, $M = 10, 000$ generations, $B = 15$ particles, the optimal collective colour is $\hat{ϕ} = 0.5$ and initial particle traits are $(r_{1} = r_{0} = 5, a_{1}^{intra} = 0.7 / K, a_{0}^{inter} = a_{1}^{inter} = 0.3 / K)$ , with $K = 1500$ .

Appendix 1—figure 2 illustrates the distribution of average colour in a population of collectives (A) and of the average associated traits (interaction rates [B]; growth rates [C]) after $M = 10, 000$ collective generations for three different values of the red type’s carrying capacity. For each set of parameters, 20 trajectories where simulated. In none of the 60 simulations do populations became entirely monochromatic.

The evolutionary outcome of the stochastic model is highly reproducible, with only a small percentage variation in the average collective colour achieved in different realizations of the stochastic process. Apart from a small systematic bias toward the type with the higher carrying capacity (i.e. the lower $a^{i n t r a}$ ), changing the carrying capacity does not affect the ability of selection to achieve the target colour (Appendix 1—figure 2A).

The effects of collective selection on particle traits instead change depending on the role of such traits in determining the collective colour. Figure 2 of the main text illustrates the convergence, over one single evolutionary trajectory, of the inter-colour interaction parameters to specific values. Correspondingly, the average of these parameters in the population also changes little across multiple realizations of the stochastic evolutionary process (Appendix 1—figure 2B). As expected, the values depend on the parameters that do not evolve, that in the cases illustrated here, are the carrying capacities. However, one can notice that as long as interaction rates are bounded to be positive, one interaction (in the specific case where carrying capacities are equal) will in the long run vanish, indicating that one of the types drives the intra-collective dynamics. This corresponds to predictions, as discussed in Appendix 2 and 3.

Maximal growth rates, that were observed to change within one single realization of the evolutionary trajectory, also vary considerably across realizations (Appendix 1—figure 2C). This is a consequence of their quasi-neutrality with respect to collective selection: once the particle population approaches a steady-state within any collective generation, the speed at which it grows at low density is less important.

Different target colours

In the main text, we have considered that the target of selection was a situation when collectives are composed of half red and half blue particles. Here, we repeated the numerical simulations for different target proportions of the two types and discuss how the choice of $\hat{ϕ}$ affects the outcome of the evolutionary trajectory. We performed ten independent simulations for 10,000 collective generations, starting from the same initial conditions and parameter values, but varying the target of selection.

Appendix 1—figure 3A shows that different target colours, that is, compositions of the collectives, can be selected with an overall accuracy of a few percent. However, the variability among simulations is larger when the target is strongly skewed toward one or another monochromatic state. This reflects an increased variability in the selected particle traits, which manifests when the derived interaction rates are considered (Appendix 1—figure 3B) and maximal growth rate (Appendix 1—figure 3B). While maintaining the previously observed lower variability in interaction rates than in growth rates, all derived traits change more from run to run when the target is extreme. This is likely the consequence of a lower effectiveness in the action of collective-level selection, as a considerable part of the population ends up being monochromatic just because of sampling at birth. As a consequence, convergence towards the target is also considerably slower.

Appendix 1—figure 3

Download asset Open asset

Distribution of the final traits across several experiments for different optimal colours.

Ten independent simulations are performed for each value of $\hat{ϕ}$ . In all simulations, $D = 100$ collectives, $M =$ 10,000 generations, $B = 15$ particles, and initial particle traits are $(r_{0} = r_{1} = 5, a_{0}^{intra} = a_{1}^{intra} = 0.7 / K, a_{0}^{inter} = a_{1}^{inter} = 0.3 / K)$ , with $K = 1500$ .

Appendix 1—figure 4

Download asset Open asset

Example of collective genealogy (Supplement of Figure 2).

Symbols and colours are as in Appendix 1—figure 1 and extinct lineages are marked transparent. Collective-level parameters in this simulation are $M = 30, D = 20, ρ = 0.1$ . A. Neutral regime: at the final generation, collectives are monochromatic and most likely composed of the faster-growing type. B. Selective regime: at the final generation, collectives contain both red and blue particles.

Appendix 1—figure 5

Download asset Open asset

The stochastic-corrector mechanism can maintain both types of particles in the absence of mutations (Supplement of Figure 2).

Collective phenotype distribution through time in the selective regime with ancestral particle traits and no mutations. Without collective-level mutation, the only mechanism maintaining both types within the population is the stochastic corrector, whereby a fraction of the collectives with colour closer to the target are propagated to the next collective generation. This means that at every generation the distribution of collective phenotypes is skewed towards the colour that has higher maximal growth rate, and the target colour is realized, in a small fraction of collective population, thanks to stochastic fluctuations in the composition at birth. Parameters are $D = 1000$ , $M = 1000$ , $\hat{ϕ} = 0.5$ , $B = 15$ and initial traits $(r_{0} = 6, a_{0}^{intra} = 0.8 / K, a_{0}^{inter} = 0.15 / K, c_{0} = red)$ for red particles and $(r_{1} = 4, a_{1}^{intra} = 0.3 / K, a_{1}^{inter} = 0.15 / K, c_{1} = blue)$ for blue particles, with $K = 1500$ . The initial proportions at generation 0 were randomly drawn from a uniform distribution.

Appendix 1—figure 6

Download asset Open asset

Particle trait mutations lead to slow loss of optimal collective colour after removal of collective-level selection (Supplement of Figure 4).

Modification of the collective phenotype distribution when particle traits mutate and no selection for colour is applied, starting from the particle traits after 10,000 generations of selection for purple colour (as in Figure 4B). Collectives continue to produce purple offspring for more than 200 generations, before drift of particle traits erodes developmental correction. In contrast, for the ancestral particle traits, lineages become monochromatic in less than 10 generations (Figure 4A).

Appendix 2

Lotka-Volterra deterministic particle ecology

Model for intra-collective dynamics

The stochastic ecological dynamics of red ( $N_{0}$ ) and blue ( $N_{1}$ ) particles within a collective simulated by the algorithm described in Appendix 1 is approximated (see Figure 3) by the deterministic competitive Lotka-Volterra Ordinary Differential Equation:

{\begin{matrix} \frac{d N_{0}}{d t} = r_{0} N_{0} (1 - \frac{a_{00}}{K} N_{0} - \frac{a_{01}}{K} N_{1}) \\ \frac{d N_{1}}{d t} = r_{1} N_{1} (1 - \frac{a_{10}}{K} N_{0} - \frac{a_{11}}{K} N_{1}) \end{matrix}

Here, $𝐫 = (r_{0}, r_{1})$ is the pair of maximal growth rates for red and blue particles. Since the system is symmetric, we consider only the case where red particles grow faster than blue particles ( $r_{0} > r_{1}$ ). The effect of pairwise competitive interactions between cells are encoded in the matrix $𝐀 = {(a_{i j})}_{i, j \in {0, 1}^{2}}$ . All competitive interactions are considered harmful or neutral ( $0 \leq a_{i j}$ ) (see Appendix 3 for more general types of interactions). Here and in the main text, we consider that the four free parameters can evolve at the same time. In the last section of the Results in the main text we explore cases when their variation is constrained by trade-offs.

So as to explore the space of all possible interaction intensities, no specific mechanism of interaction is assumed, and thus qualitatively different ecological dynamics of the particle populations. Evolutionary trajectories constrained by particle traits are briefly discussed in the last section of the Results (main text).

The carrying capacity of a monochromatic collective is $\frac{K}{a_{00}}$ for red particles and $\frac{K}{a_{11}}$ for blue particles. $K$ is a scaling factor for the intensity of pairwise interactions that can be used to rescale the deterministic system to match the stochastic trajectories. Without loss of generality, we thus assume that $K = 1$ .

A natural set of alternate coordinates for the system in Equation 1 are total population size $N := N_{0} + N_{1}$ and collective colour, defined as the frequency of red individuals $x := \frac{N_{0}}{N}$ . In these coordinates, the deterministic dynamics are the solution to the following ODE.

{\begin{matrix} \frac{d N}{d t} & = N g (x, N) \\ \frac{d x}{d t} & = x (1 - x) h (x, N) \end{matrix}

The functions $g$ and $h$ are polynomials in $x$ and $N$ , of coefficients:

Monomial	Coefficient in $h$	Monomial	Coefficient in $g$
1	$r_{0} - r_{1}$	1	$r_{1}$
$N$	$a_{11} r_{1} - a_{01} r_{0}$	$N$	$- a_{11} r_{1}$
$N x$	$r_{1} (a_{10} - a_{11}) + r_{0} (a_{01} - a_{00})$	$x$	$r_{0} - r_{1}$
		$x N$	$r_{1} (2 a_{11} - a_{10}) - r_{0} a_{01}$
		$x^{2} N$	$r_{0} (a_{01} - a_{00}) + r_{1} (a_{10} - a_{11})$

Appendix 2—figure 1 shows an example of the ODE flow in both coordinate systems. Two unstable trivial equilibria and a stable coexistence equilibrium are located at the intersection of the isoclines. Within one collective generation, the dynamics follow such flows for duration $T$ , starting from initial conditions on the line $N_{0} = B - N_{1}$ (that is, $N = B$ ).

Appendix 2—figure 1

Download asset Open asset

Left: A Lotka-Volterra flow (Equation 1 ) in $(N_{0}, N_{1})$ coordinates.

Right: The same flow in $(N, x)$ coordinates. Coloured lines are the null isoclines. Empty (resp. filled) circles mark unstable (resp. stable) equilibria.

Even though Equation 1 is more directly related to the individual-based stochastic simulation, the dynamics of collective colour are understood more easily using Equation 2. Therefore, in the following we will use the latter formulation.

The dynamics of particle types across collective generations are modelled as a piecewise continuous time change (Appendix 2—figure 2), where $x^{m} (t)$ is the fraction of red particles at time $t \in [0, T]$ during collective generation $m$ .

Appendix 2—figure 2

Download asset Open asset

Piecewise continuous trajectory.

Iterating the deterministic model yields a piecewise continuous trajectory in the $(N_{0}, N_{1})$ space. The growth phase (continuous lines) alternates with the dilution (dotted lines). In (**A, B**) traits are taken from generation 3 and in (**C,D**) from generation 9000 of the main simulation with selection (Figure 2). Successive adult states can be computed using the $G_{θ}$ function as a recurrence map (see Figure 5 in the main text).

We focus in particular on the succession $N^{m} (T), x^{m} (T)$ of collective ‘‘adult’’ states at the end of each successive generation $m$ . In the following we note $ϕ^{m} = x^{m} (T)$ , which is the adult colour of the collective at the end of the growth phase. At the beginning of each collective generation, we impose that, regardless of the number of cells in the parent, every collective contains the same number of cells $N^{m} (0) = B \in ℝ \forall m$ . In contrast, the newborn collective colour $x^{m} (0)$ depends on the colour of the parent. In this deterministic model, we consider that there is no stochastic variation or bias due to sampling at birth, so the collective colour of the newborn is equal to that of its parent: $x^{m} (0) = x^{m - 1} (T) = ϕ^{m - 1}$ . In the first generation ( $m = 0$ ), the population size is B in every collective and the fraction of red particles is chosen uniformly at random between 0 and 1.

The proportion of red particles at adult stage $ϕ^{m}$ is obtained from these initial conditions $(B, ϕ^{m - 1})$ by integrating Equation 2. Since these equations are not explicitly solvable, there is no analytic expression for the result of the transient dynamics. However, having constrained the initial conditions to a single dimension, the adult colour is a single-valued function of the initial composition of the collective, defined as follows.

Definition (Growth function)

Given the set of particle traits $θ := (𝐫, 𝐀) \in E := {[0, \infty)}^{2} \times {[0, \infty)}^{4}$ , the bottleneck size $B \in (0, \infty)$ and the duration of the growth phase $T \in (0, \infty)$ , the growth function $G_{θ}$ is defined as the application that maps an initial proportion of red particles $ϕ$ to the proportion of red particles after duration $T$ . Thus, $G_{θ} (ϕ, T, B) = x (T)$ , with $x (t)$ is the unique solution to the following Cauchy problem:

{\begin{matrix} \frac{d N}{d t} & = N g (x, N) \\ \frac{d x}{d t} & = x (1 - x) h (x, N) \\ N (0) & = B \\ x (0) & = ϕ \end{matrix}

To simplify notations in the main text, we set $G (ϕ) = G_{θ} (ϕ, B, T)$ .

Relation with the stochastic evolutionary model

As explained in the main text, the growth function $G_{θ}$ defines the recurrence relation between the colour of the newborn offspring and its colour at adulthood. If the reproduction process entails no stochasticity, the latter also defines the composition of collectives at the next generation. As a consequence, the iterative application of $G_{θ}$ approximates the change in time of the adult colour when a population with a given, fixed, set of parameters and traits is transferred across collective generations.

The fixed points of this discrete-time system allow understanding and classifcation of behaviours observed along stochastic evolutionary trajectories. When mutation rate of particle traits is sufficiently small and growth rates are not vanishing, collectives approach such fixed points in a few collective generations by iteration of the $G_{θ}$ function (Figure 5). The evolutionary trajectory can thus be seen as a succession of fixed points of $G_{θ}$ . The surface of the fixed points of $G_{θ}$ as a function of the particle parameters can be computed numerically, as well as its dependence on the collective generation duration $T$ and bottleneck size $B$ . A small number of qualitatively different configurations are possible for the fixed points (illustrated in Appendix 2—figure 3 1-4). In particular, the case in which $G_{θ}$ possesses an internal, stable fixed point (Appendix 2—figure 3) constitutes the optimal solution to constant selection for collective colour, in that it ensures the highest degree of colour reproducibility, on average, across collective generations.

Appendix 2—figure 3

Download asset Open asset

Qualitative behaviours of the growth function $G_{θ}$ .

Panels 1–4 represent the possible qualitative shapes, differing in the position and stability of the fixed points, of the growth function $G_{θ}$ that approximates the within-collective particle dynamics (orange line in Figure 5). (1) $ϕ = 1$ is the only stable fixed point (Figure 5A), and iteration of the red $G_{θ}$ function leads to fixation of red particles. (2) $ϕ = 0$ is the only stable fixed point, and iteration of the blue $G_{θ}$ function leads to fixation of blue particles. (3) $ϕ = 0$ and $ϕ = 1$ are two stable fixed points, and iteration of the grey $G_{θ}$ function leads to fixation of either red or blue particles depending on initial conditions. (4) $ϕ = 0$ and $ϕ = 1$ are unstable and there is a stable fixed point between 0 and 1. Iteration of the grey $G_{θ}$ function leads to coexistence of both particle types. Panels (**A-D**) show that when red particles are the fast growing types ( $r_{0} > r_{1}$ ), the shape of $G_{θ}$ and the position of its fixed points depend on the collective-level parameters $B$ (bottleneck size) and $T$ (growth phase duration). Particle interaction traits generically belong to one of the four intervals (A) $a_{01} < a_{11}$ and $a_{00} < a_{10}$ ; (B) $a_{11} < a_{01}$ and $a_{10} < a_{00}$ ; (C) $a_{11} < a_{01}$ and $a_{00} < a_{10}$ ; (D) $a_{01} < a_{11}$ and $a_{10} < a_{00}$ (qualitative nature of the corresponding ecological equilibria is indicated in the titles of the panels, see also Appendix 2). Lines represent the limit of the region of stability of the fixed point of $G_{θ}$ , as derived by Proposition 4: blue lines for the ‘all blue’ state $ϕ = 0$ and red lines for the ‘all red’ state $ϕ = 1$ .

The parameter values that separate regions with qualitatively different fixed points correspond to transcritical bifurcations, where one of the monochromatic fixed points changes its stability. These lines are analytically computed below, thus allowing generalisation of the conclusions drawn from analysing the representative trajectory of Figure 2. In the following, we detail analysis of how the fixed points of the $G_{θ}$ function depend on particle- and collective-level parameters.

It is worth stressing here that the deterministic model provides a good quantitative approximation of the system with particle-level and collective-level stochasticity provided that fluctuations at both levels are small. This is the case if populations of particles are large (as for instance in the case of bacterial populations) and if mutations of particle traits are rare and of small magnitude. However, in the numerical simulations we performed, the conclusions drawn from ensuing analysis held qualitatively also in the case of large fluctuations.

Fixed Points of the $G_{θ}$ function and their stability

In this paragraph, we list the key properties of the $G_{θ}$ function, that determine how the asymptotic collective colour depends on particle and collective parameters. Proofs of the propositions are provided in the following paragraph.

Proposition 1 (Fixed points of $G_{θ}$ )

Let $θ \in E$ be a set of particle traits, $T \in (0, \infty)$ the duration of the growth phase and $B \in (0, \infty)$ the bottleneck size.

Then, $G_{θ} (0, T, B) = 0$ , and $G_{θ} (1, T, B) = 1$ , hence $ϕ = 0$ and $ϕ = 1$ are fixed points of $G_{θ}$ $\forall θ$ .

Moreover, if the stability with respect to $ϕ$ of 0 and 1 is the same, then $G_{θ}$ has at least one fixed point $ϕ \in (0, 1)$ .

The stability of the monochromatic fixed points with respect to the fraction $ϕ$ can be numerically assessed. The number and stability of the fixed points as a function of collective-level parameters B and T are illustrated in Appendix 2—figure 3. Four different cases are considered, corresponding to the four qualitatively different outcomes of particle-level ecology (competitive exclusion by one or the other type, bistability, coexistence).

The fixed points can be analytically calculated in certain limit cases, corresponding to parameter values when within-collective particle dynamics are exponential or saturating.

Proposition 2 (Quasi-exponential growth)

When T is close to 0 and $B a_{𝑚𝑎𝑥} ≪ 1$ with $a_{m a x} = {m a x}_{i, j} a_{i j}$ the highest element of the competition matrix $A$ , then $G_{θ}$ has only two fixed points $ϕ = 0$ and $ϕ = 1$ .

Moreover, the monochromatic fixed point $ϕ = 1$ , corresponding to a population completely composed of the (faster) red type of particle, is stable, whereas the fixed point $ϕ = 0$ , corresponding to a population composed of the slow growing type of particle, is unstable.

Proposition 3 (Saturating growth)

As $T \to \infty$ the fixed points $ϕ^{*}$ of $G_{θ}$ and their stability correspond to the equilibria $x^{*}$ of Equation 1. These equilibria and their stability range are listed below.

	Red alone	Blue alone	Coexistence
Equilibrium $x^{*}$	1	0	$\frac{a_{11} - a_{01}}{T r (A) - C o T r (A)}$
Stability range	$a_{00} < a_{10}$	$a_{11} < a_{01}$	$a_{11} > a_{01}$ and $a_{00} > a_{10}$

Here $T r (A) := a_{00} + a_{11}$ is the sum of the diagonal (or trace) of $A$ , and $C o T r (A) := a_{10} + a_{01}$ denotes the sum of the anti-diagonal elements of $A$ .

By linearising the system in proximity of the fixed points, it is possible to find exactly the bifurcation parameters where one equilibrium changes stability, thus the limit of the region where there exists an interior fixed point $ϕ^{*}$ . The bifurcation values in the space of the collective parameters $T$ and $B$ delimit the region in Figure 7 where the $G_{θ}$ function has an internal fixed point.

Even when the fixed point is different from the optimal value $\hat{ϕ}$ , it can nonetheless provide a starting point for evolution to optimise collective colour. Extinction of one of the two colours of particles happens instead very rapidly in the region when the monochromatic fixed points are stable, so that collectives have a higher risk of being extinct before inheritance-increasing mutations appear.

Proposition 4 (Bifurcations of the monochromatic fixed points of $G_{θ}$ )

The stability of 0 changes at $(T_{B}^{*}, B_{B}^{*})$ and the stability of 1 at $(T_{R}^{*}, B_{R}^{*})$ such that:

\begin{array}{lll} B_{R}^{*} & = \frac{e^{- α_{1} T_{R}^{*}} - e^{r_{0} T_{R}^{*}}}{a_{00} (1 - e^{- α_{1} T_{R}^{*}})} & w i t h α_{1} = r_{0} r_{1} \frac{a_{00} - a_{10}}{r_{0} a_{00} - r_{1} a_{10}} \\ B_{B}^{*} & = \frac{e^{- α_{0} T_{B}^{*}} - e^{r_{1} T_{B}^{*}}}{a_{11} (1 - e^{- α_{0} T_{B}^{*}})} & w i t h α_{0} = r_{0} r_{1} \frac{a_{11} - a_{01}}{r_{1} a_{11} - r_{0} a_{01}} \end{array}

These results allow understanding of the interplay between time scales of particle-level ecology and collective reproduction, whose relationship changes along an evolutionary trajectory. Appendix 2—figure 4 illustrates the change of the fixed point of $G_{θ}$ with the collective generation duration T for typical particle traits corresponding to the four qualitative classes of asymptotic equilibria for particle ecology. Of particular relevance for understanding the stochastic trajectory illustrated in Figure 2 is panel D.

Appendix 2—figure 4

Download asset Open asset

Bifurcation diagrams showing the position and stability of the fixed points of $G_{θ}$ as a function of the duration of the collective generation T.

(**A-D**) Particle traits are representative of the scenarios illustrated in Figure 7A–D. Of particular interest is the case illustrated in panel D, where the $G_{θ}$ function acquires — for a sufficiently large separation between the particle maximum division time and the collective generation time — a stable internal fixed point.

When the time scale of exponential particle growth is comparable to T, (such as at the beginning of the evolutionary trajectory displayed in Figure 2) Proposition 2 indicates that the system is expected to converge to an all-red solution ( $ϕ = 1$ is the only stable equilibrium). However, at the same time as this fast dynamic occurs, the growth rates change by mutation. Selection during the exponential phase generally favours fast growing mutants, which means that particle populations achieve high-density conditions in a shorter time. The system then effectively behaves as if T had increased, thus leading selection to ’see’ interaction traits.

When the time scale of collective reproduction is sufficiently slow with respect to the intra-collective dynamics, the system crosses the bifurcation point $T_{R}^{*}$ (Proposition 4), so that the function $G_{θ}$ now has an internal fixed point (Figure 6). In the stochastic simulations, this means that more collectives are reproducibly found close to the optimal colour. It takes a relatively short time to adjust the particle traits so that the fixed point is close to the optimum $\hat{ϕ}$ . In this case, the deterministic approximation produces a close to perfect inheritance of the collective colour. However, fluctuations in particle numbers and in composition at birth still result in a large variance of colours among collectives in the stochastic system.

Appendix 2—figure 5

Download asset Open asset

Stable equilibria of the particle ecology as a function of inter-colour competition traits.

These equilibria correspond to the limit of the fixed points of the $G_{θ}$ function when particle-level and collective-level time scales are well separated ( $r ≫ \frac{1}{T}$ ), derived in proposition 3. Other interaction parameters are $a_{00} = 0.7$ and $a_{11} = 0.8$ , and the result is independent of growth rates. The grey area indicates bistability.

Here, starts the last and slowest phase of the evolutionary trajectory, which results in colour variance reduction through improvement of the ability of particles to correct variations in colour. This is achieved by attaining faster the particle ecological equilibrium, so that fluctuations are more efficiently dampened by demographic dynamics. As a consequence, the conditions described by Proposition 3 will be met. This allows identification of a surface in parameter space, where the fixed point of the $G_{θ}$ function $ϕ^{*}$ identifies with the ecological equilibrium $x^{*}$ , that contains evolutionary equilibria. The ecological equilibrium is displayed in Appendix 2—figure 4 as a function of the cross-colour interaction parameters $a_{01}$ and $a_{10}$ . In the regime where particle and collective time scales are well separated ( $r ≫ 1 / T$ ), then interaction parameters that correspond to the optimal colour satisfy the following relationship:

a_{00} - a_{10} + (1 - \frac{1}{x^{*}}) (a_{11} - a_{01}) = 0 .

This relation identifies the white dotted line in Appendix 2—figure 4 (and in Figure 8B). Once it is attained, mutations cause the deterministic system to move neutrally on this surface. As the stochastic simulation shows, particle parameters keep evolving directionally so as to reduce phenotypic variance. This is achieved by making $G_{θ}$ increasingly flatter in the vicinity of the fixed point, so that the target colour is not only more stable, but it is reached in fewer collective generations.

Successive events of mutation and substitution progressively lead to a growing asymmetry in the ecological relationship between the two types of particles: that with smaller carrying capacity becomes insensitive to the other colour; the latter instead experiences competition, so that its growth is curbed and optimal proportion of colours is eventually realized (see Figure 3D). As illustrated by Appendix 2—figure 6, this conclusion is independent of what is the maximum growth rate, that only affects the advantage of one type at initial stages of growth. Indeed, the position on the intercept between the optimality line and the y axis in Appendix 2—figure 5 and Appendix 2—figure 6 only depends on the difference between intra-type competition parameters. A consequence of this is that fast-growing types systematically display, when they are also those with a larger carrying capacity, a population overshoot.

Appendix 2—figure 6

Download asset Open asset

Asymmetric interaction ensures fastest convergence toward the ecological equilibrium.

Particle population dynamics are illustrated for increasingly asymmetric values of $(a_{01}, a_{10})$ , keeping the ecological equilibrium fix at $x^{*} = 0.5$ (along white manifold, in the direction of the arrow). The top panels correspond to cases when the faster-growing particles have a higher carrying capacity ( $(a_{00}, a_{11}) = (0.7, 0.8)$ ), the bottom panels to the opposite ( $(a_{00}, a_{11}) = (0.8, 0.5)$ ). In both cases $r_{0} = 60$ , $r_{1} = 40$ , $T = 1$ , $B = 0.001$ .

Proofs

In this section, we present the proof of propositions 2–4 above.

Proof of Proposition 1

In the $(N, x)$ coordinates we have seen that $\frac{d f (t)}{d t} = g (x (t), N (t))$ and that $x (t) = 0$ and $x (t) = 1$ are trivial roots of the polynomial $g$ (Equation 2). Hence 0 and 1 are always fixed points of $G_{θ}$ .

Since $g$ and $h$ (from Equation 2) are polynomials of $(N, x)$ , they are smooth (of differentiability class $C_{\infty}$ ) on $ℝ^{2}$ . Thus, the global flow corresponding to the Cauchy problem is also smooth on $R^{2}$ is the partial application of the global flow to the case where $N_{0} = B$ . Therefore, $G_{θ}$ is continuous on $[0, 1]$ .

Moreover, let us suppose that 0 and 1 are both unstable. Then $G_{θ}^{'} (0, T, B) > 1$ and $G_{θ}^{'} (1, T, B) > 1$ , with $G_{θ}^{'}$ the derivative of $G_{θ}$ with respect to its first variable. As a consequence there is an $ε \in ℝ$ such that $G_{θ} (ε, T, B) > ε$ and $G_{θ} (1 - ε, T, B) < 1 - ε$ . Since $G_{θ}$ is continuous, there is at least one $c \in [0, 1]$ such that $G_{θ} (c, T, B) = c$ by virtue of the intermediate value theorem.

In practice, we never encountered cases when more than one internal fixed point was present. However multistability is expected to occur if the equations describing particle ecology had higher-order nonlinearities.

Proof of Proposition 2

Since the nonlinear terms in Equation 3 are smaller than $B a_{max}$ , and this is negligible with respect to 1, particle ecology is approximated by its linearization as long as the population size remains close to the bottleneck value. Around $t = 0$ , the Cauchy problem can be written as:

{\begin{matrix} \frac{d N_{0}}{d t} = r_{0} B x \\ \frac{d N_{1}}{d t} = r_{1} B (1 - x) \\ N_{0} (0) = x B \\ N_{1} (0) = (1 - x) B \end{matrix}

In the $(N, x)$ coordinates, the total population size grows exponentially and is decoupled from the colour. On the other hand, $x (t)$ follows the logistic differential equation:

\frac{d x}{d t} = \frac{d}{d t} \frac{N_{0}}{N_{0} + N_{1}} = (r_{0} - r_{1}) x (1 - x)

which can be integrated.

For T sufficiently small for the population to be in exponential growth phase, the growth map $G_{θ}$ can be approximated by the solution ${\tilde{G}}_{θ}$ of Equation 5:

G_{θ} (x, T, B) \approx \frac{1}{1 + (\frac{1}{x} - 1) e^{- (r_{0} - r_{1}) T}} := {\tilde{G}}_{θ} (x, T, B)

This function is strictly convex (or concave) on (0, 1) depending on the sign of $r_{0} - r_{1}$ :

\frac{\partial^{2} {\tilde{G}}_{θ} (x, T, B)}{\partial x^{2}} = \frac{2 [1 - e^{(r_{0} - r_{1}) t}]}{{(x e^{(r_{0} - r_{1}) t} + 1 - x)}^{3}}

Since $0 < x < 1$ and $t > 0$ , $\frac{\partial^{2} {\tilde{G}}_{θ} (x, T)}{\partial x^{2}}$ is of the same sign as $1 - e^{t (r_{0} - r_{1})}$ , that is strictly positive if $r_{1} > r_{0}$ , or strictly negative if $r_{0} > r_{1}$ .

Thus, $\tilde{G}$ is strictly convex on $(0, 1)$ if $r_{1} > r_{0}$ , and strictly concave on $(0, 1)$ if $r_{0} > r_{1}$ . In the first case, red colour $x = 0$ is an unstable equilibrium and blue colour $x = 1$ a stable one, and vice-versa in the second case. Note that the segment $s = [(0, 0), (1, 1)]$ is a chord of $\tilde{G}$ . Therefore, the strictly convex (resp. concave) $\tilde{G}$ do not intersect $s$ except in $(0, 0)$ and $(1, 1)$ .

Proof of Proposition 3

When the collective generation time T is much longer than the demographic time scale, the populations within droplets at the adult stage are well approximated by the equilibrium solution of the Lotka-Volterra Equation 1. Solving simultaneously equations $\frac{d N_{0}}{d t} = 0$ and $\frac{d N_{1}}{d t} = 0$ (or equivalently $\frac{d N}{d t} = 0$ , $\frac{d x}{d t} = 0$ ) yields the four equilibria listed below in both coordinate systems. Linear stability analysis allows one to determine the parameter intervals where these are stable, listed below.

Name	Red alone	Blue alone	Coexistence	Extinction
Position in $[N_{0}, N_{1}]$	$[\frac{1}{a_{00}}, 0]$	$[0, \frac{1}{a_{11}}]$	$[\frac{a_{11} - a_{01}}{d e t (A)}, \frac{a_{00} - a_{10}}{d e t (A)}]$	[0,0]
Position in $[N, f]$	$[\frac{1}{a_{00}}, 1]$	$[\frac{1}{a_{11}}, 0]$	$[\frac{T r (A) - C o T r (A)}{d e t (A)}, \frac{a_{11} - a_{01}}{T r (A) - C o T r (A)}]$	Undefined
Condition for stability	$a_{00} < a_{10}$	$a_{11} < a_{01}$	$a_{11} > a_{01}$ and $a_{00} > a_{10}$	Never

Proof of Proposition 4

We consider the case when the fixed point 0 changes stability. The stability of the fixed point 1 can be studied analogously.

We aim at identifying the values of the collective parameters $(T, B)$ where a fixed point with $x = 0$ changes stability through a transcritical bifurcation. The difficulty lies in the fact that one needs to estimate the dynamics of the second variable $N$ in order to study the stability of the 2-D system. Luckily, this can be done in the limit when the collective contains almost exclusively particles of one single colour (in this case, blue).

Total population size is in this case decoupled from colour and Equation 2 can be integrated with initial condition $(N_{0} x_{0}) = (B, 0)$ , yielding the following trajectory:

\tilde{N} (t, B) = \frac{1}{a_{11} - (a_{11} - \frac{1}{B}) e^{- r_{1} t}}

As long as $x$ is small, the time derivative is approximated by the non-autonomous system:

\frac{d x}{d t} \approx x h (x, \tilde{N} (t, B))

with $h$ as defined in Equation 2:

h (0, \tilde{N} (t, B)) = (r_{0} - r_{1}) + \tilde{N} (t, B) (a_{11} r_{1} - a_{01} r_{0})

Solving this equation allows computation of the adult colour as a function of the parameters $T$ and $B$ . At the bifurcation point $(T^{*}, B^{*})$ , where stability of the 0 fixed point changes, the newborn colour is the same as the adult colour: $x (T^{*}, B^{*}) = x (0, B^{*})$ . $(T^{*}, B^{*})$ are then solutions of the integral equation:

\begin{array}{ll} 0 = & \int_{0}^{T^{*}} h (0, \tilde{N} (s, B^{*})) d s \\ 0 = & (r_{0} - r_{1}) + (a_{11} r_{1} - a_{01} r_{0}) \int_{0}^{T^{*}} \tilde{N} (s, B^{*}) d s \\ 0 = & T^{*} r_{0} (1 - \frac{a_{01}}{a_{11}}) + (1 - \frac{r_{0}}{r_{1}} \frac{a_{01}}{a_{11}}) \ln (\frac{B^{*} a_{11} + e^{- r_{1} T^{*}}}{B^{*} a_{11} + 1}) \end{array}

Solving for $B^{*}$ we get:

B^{*} = \frac{e^{- α T^{*}} - e^{r_{0} T^{*}}}{a_{00} (1 - e^{- α T^{*}})}

With $α = r_{0} r_{1} \frac{a_{00} - a_{10}}{r_{0} a_{00} - r_{1} a_{10}}$

Figure 7 shows that this approximation retrieves accurately the numerically computed bifurcation lines.

Appendix 3

Beyond competitive interactions

In the main text, the model is limited to deleterious (competitive) interactions, whereby the inter-colour interactions are such that one colour always has a negative density-dependent effect on the growth of the other colour. This choice reflects the expectation that, as in the example of the droplet experiment, competition would be the main driver of interactions among two previously unconnected bacterial species growing on a common resource.

However, it is interesting to consider what happens if interactions of other types are taken into account. This section presents two additional interaction classes: exploitative (e.g. predator-prey or parasitic) interactions ( $a_{01} < 0 < a_{10}$ or $a_{10} < 0 < a_{01}$ ), and mutualism ( $a_{01} < 0$ and $a_{10} < 0$ ). Note that exploitative interactions correspond to non-obligate predation (or parasitism): the predator (or the parasite) can sustain a non-null population density even in the absence of the prey (or host). Obligate interactions can be modelled in the limit where the carrying capacity of the exploiters tends to zero. Similarly, unless the carrying capacities of both types tend to zero, mutualism is also not obligate.

The deterministic model (Appendix 2 Equation 1) can be straightforwardly extended to these larger parameter ranges, allowing prediction of the outcome of the evolutionary dynamics. Appendix 2—figure 5 presents the position of the stable fixed point of $G_{θ}$ for negative inter-colour interaction parameters when the time scale of collective reproduction is sufficiently slow with respect to the intra-collective dynamic $(r ≫ \frac{1}{T})$ . Appendix 3—figure 1 represents the same fixed point for extended values of the interaction parameters. Each quadrant corresponds to a different kind of ecological interaction (competition, exploitation and mutualism). While competition is discussed in the main text, other kinds of interactions are discussed below.

Whenever evolution leads to separation in time-scales between particle and collective dynamics (typically by increasing particle growth rates), the evolutionary dynamic within each quadrant will be akin to the competition case: first, successive invasions of mutants bring the system on the manifold of interaction parameters where the equilibrium colour $x^{*}$ corresponds to the selected colour $\hat{ϕ}$ (Appendix 2 Equation 4); second, the system evolves on this manifold toward regions of faster ecological convergence.

Appendix 3—figure 1

Download asset Open asset

Asymptotic colour of the particle ecology as a function of inter-colour competition traits.

These equilibria correspond to the limit of the fixed points of the $G_{θ}$ function when particle-level and collective-level time scales are well separated ( $r ≫ \frac{1}{T}$ ), derived in proposition 3. Other interaction parameters are $a_{00} = 0.7$ and $a_{11} = 0.8$ , and the result is independent of growth rates. The grey area indicates bistability. This figure extends Appendix 2—figure 5.

Exploitative interactions

Consider first that $a_{01} < 0 < a_{10}$ , so that red individuals (type 0) are the exploiters (predators or parasites) and blue individuals (type 1) are the exploited (prey or hosts). This corresponds to the bottom-right quadrant of Appendix 3—figure 1.

When the exploiter competes with the exploited more than with other exploiters ( $a_{00} < a_{10}$ ), the stable equilibrium for Appendix 2 Equation 1 is monochromatic red (see Appendix 2 Proposition 3). However, when the the competitive interaction is stronger among exploiters ( $a_{00} > a_{10}$ ), the coexistence equilibrium is stable and correspond to a colour of $\frac{a_{11} - a_{01}}{T r (A) - C o T r (A)}$ (see Appendix 2 Proposition 3). In the coexistence region of the bottom-left quadrant, the collective colour can take up values in the range $[\frac{a_{11}}{a_{11} + a_{00}}, 1]$ bounded on one side by the extinction of the exploited type, and on the other side by the ratio of carrying capacity obtained when there is no competitive interactions. This range does not contain the target colour $\hat{ϕ} = 0.5$ in the example illustrated in Appendix 3—figure 1 because the exploiter has a higher carrying capacity than the exploited $(\frac{1}{a_{11}} < \frac{1}{a_{00}})$ . It is thus impossible to achieve the target colour $\hat{ϕ} = 0.5$ in the lower right quadrant. Unless the nature of ecological interactions changes, over evolutionary times the population of collectives will move towards the absence of interactions. Here, collectives of colour close to the optimum can still manifest in the stochastic individual-based model as the effect of sampling at dilution and fluctuations during growth, but the average colour will remain off target.

In the upper left quadrant, where $a_{10} < 0 < a_{01}$ , blue individuals (type 0) are the exploiters (predators or parasites) and red individuals are the exploited (prey or hosts). In the coexistence region (i.e., when the competition is stronger among exploiters than between exploiters and exploited $a_{01} < a_{11}$ ), the collective colour can take up values in the range $[0, \frac{a_{11}}{a_{11} + a_{00}}]$ , that contains the target $\hat{ϕ} = 0.5$ in the example illustrated in Appendix 3—figure 1 because the exploiter has a lower carrying capacity than the exploited $(\frac{1}{a_{11}} < \frac{1}{a_{00}})$ . Within the boundaries of this quadrant, long-term evolution will tend to reduce the (positive) interaction $a_{01}$ , thus mitigating exploitation, while at the same time making the (negative) interaction term $a_{10}$ smaller, that is increasing the advantage provided by the exploited to the exploiter. Again, if the nature of ecological interactions does not change, the system will evolve towards a case where one particle type (in this case, the exploiter, that also has smaller carrying capacity), gets decoupled from the demography of the other type.

Mutualistic interactions

Consider now that red and blue individuals have non-obligate, mutualistic interactions. This corresponds to both inter-colour competition traits $a_{01}$ and $a_{10}$ being negative, and can be visualised in the bottom-left quadrant of Appendix 3—figure 1.

When interactions are mutualistic, the equilibria of Appendix 2 Equation 1 resulting from the extinction of one type or the other are never stable ( $a_{00} < a_{10}$ or $a_{11} < a_{01}$ are never fulfilled since $a_{01} < 0 < a_{00}$ and $a_{01} < 0 < a_{11}$ respectively, see Appendix 2 Proposition 3) and the solution is always coexistence.

Depending on the sign of the determinant of the interaction matrix $𝐀$ , the dynamics within a collective generation can have two qualitatively different behaviours. When mutualistic interactions have small intensity, the intra-collective dynamics attains an equilibrium, even though the population size of one of the two particle types is larger than their respective carrying capacities (because of the positive contribution of the other type). However, when $\frac{a_{00} a_{11}}{a_{01} a_{10}} < 1$ (white line in Appendix 3—figure 1), the populations would undergo unbounded growth if they were not embedded in collectives of finite lifetime.

This unrealistic feature of simplified Lotka-Volterra models, that makes them not well fit to describe mutualistic interactions, is not particularly problematic in our case, since the fraction $x$ of red particles converges to its equilibrium value even though the population size $N$ diverges. Appendix 3—figure 1 illustrates how the within-collective particle dynamics changes along an evolutionary trajectory towards increasingly strong mutualistic interactions. If no physical or biological constraint keeps parameters in the region of bounded growth, then adherence of the model predictions from reality would need to be tested by studying their robustness to inclusion of other sources of co-limitation, such as, for instance, nutrient exhaustion.

Appendix 3—figure 2

Download asset Open asset

Mutualistic interaction can lead to non-saturating population growth.

Particle population dynamics are illustrated for increasingly mutualistic values of $(a_{01}, a_{10})$ , keeping the ecological equilibrium fixed at $x^{*} = 0.5$ (moving along the white manifold, in the direction of the arrow). When the determinant of $𝐀$ is negative, population growth is unbounded in the limit of infinitely long duration of the collective generation. As long as $T$ is finite, however, the adult proportion of red and blue particles can be reached even though both populations grow exponentially (with growth rates that depend on the interaction parameters). The top panels correspond to cases when the faster growing particles have a higher carrying capacity ( $(a_{00}, a_{11}) = (0.5, 0.8)$ ), the bottom panels is the opposite ( $(a_{00}, a_{11}) = (0.8, 0.5)$ ). In both cases $r_{0} = 30$ , $r_{1} = 30$ , $T = 1$ , $B = 0.001$ .

Transition between classes of ecological interactions

So far, we have examined different ecological interactions separately, as they are usually considered to belong to separate categories. It is, however, conceivable that mutations induce a competitive interaction to become exploitative, or an exploitative interaction to become mutualistic (Sørensen et al., 2019), which in our case would be the consequence of the inter-colour interaction parameters changing sign. In this case, the prediction of the deterministic model is that, as long as there are no constraints that limit the variation of the interaction parameters, selection at the collective level should lead particles to become more and more benign towards each other, and eventually reach a regime where their exchanges are mutualistic.

Data availability

The source code for all simulations and figures in the manuscript is available as a zip file uploaded with the manuscript and in a public git repository (https://gitlab.com/ecoevomath/estaudel; copy archived at https://github.com/elifesciences-publications/estaudel).

References

(2019) Mortality causes universal changes in microbial community composition
Nature Communications 10:1–9.

https://doi.org/10.1038/s41467-019-09925-0
- PubMed
- Google Scholar
1. Baraban L
2. Bertholle F
3. Salverda ML
4. Bremond N
5. Panizza P
6. Baudry J
7. de Visser JA
8. Bibette J
(2011) Millifluidic droplet analyser for microbiology
Lab on a Chip 11:4057–4062.

https://doi.org/10.1039/c1lc20545e
- PubMed
- Google Scholar
1. Baum DA
2. Vetsigian K
(2017) An experimental framework for generating evolvable chemical systems in the laboratory
Origins of Life and Evolution of Biospheres 47:481–497.

https://doi.org/10.1007/s11084-016-9526-x
- PubMed
- Google Scholar
(2020) Ecological scaffolding and the evolution of individuality
Nature Ecology & Evolution 4:426–436.

https://doi.org/10.1038/s41559-019-1086-9
- PubMed
- Google Scholar
1. Bonner JT
(1982) Evolutionary strategies and developmental constraints in the cellular slime molds
The American Naturalist 119:530–552.

https://doi.org/10.1086/283930
- Google Scholar
Preprint
1. Bourrat P
(2017) Evolutionary transitions in heritability and individuality
bioRxiv.

https://doi.org/10.1101/192443
- Google Scholar
1. Buss LW
(1982) Somatic cell parasitism and the evolution of somatic tissue compatibility
PNAS 79:5337–5341.

https://doi.org/10.1073/pnas.79.17.5337
- PubMed
- Google Scholar
Book
1. Buss LW
(1987)
The Evolution of Individuality

Princeton: Princeton University Press.
- Google Scholar
(2006) Unifying evolutionary dynamics: from individual stochastic processes to macroscopic models
Theoretical Population Biology 69:297–321.

https://doi.org/10.1016/j.tpb.2005.10.004
- PubMed
- Google Scholar
(2016) Lineage tracking for probing heritable phenotypes at Single-Cell resolution
PLOS ONE 11:e0152395.

https://doi.org/10.1371/journal.pone.0152395
- PubMed
- Google Scholar
1. Day MD
2. Beck D
3. Foster JA
(2011) Microbial communities as experimental units
BioScience 61:398–406.

https://doi.org/10.1525/bio.2011.61.5.9
- PubMed
- Google Scholar
1. De Monte S
2. Rainey PB
(2014) Nascent multicellular life and the emergence of individuality
Journal of Biosciences 39:237–300.

https://doi.org/10.1007/s12038-014-9420-5
- PubMed
- Google Scholar
(2017) Towards a mechanistic foundation of evolutionary theory
eLife 6:e23804.

https://doi.org/10.7554/eLife.23804
- PubMed
- Google Scholar
Software
1. Doulcier G
(2020) estaudel, version b3cd2904
GitLab.

https://gitlab.com/ecoevomath/estaudel
(1998) Evolutionarily singular strategies and the adaptive growth and branching of the evolutionary tree
Evolutionary Ecology 12:35–57.

https://doi.org/10.1023/A:1006554906681
- Google Scholar
1. Gillespie DT
(1976) A general method for numerically simulating the stochastic time evolution of coupled chemical reactions
Journal of Computational Physics 22:403–434.

https://doi.org/10.1016/0021-9991(76)90041-3
- Google Scholar
1. Gillespie DT
(2001) Approximate accelerated stochastic simulation of chemically reacting systems
The Journal of Chemical Physics 115:1716–1733.

https://doi.org/10.1063/1.1378322
- Google Scholar
Book
1. Godfrey-Smith P
(2009) Darwinian Populations and Natural Selection
Oxford: Oxford university Press.

https://doi.org/10.1086/656856
- Google Scholar
1. Goodnight CJ
(2000) Heritability at the ecosystem level
PNAS 97:9365–9366.

https://doi.org/10.1073/pnas.97.17.9365
- PubMed
- Google Scholar
1. Goodnight CJ
2. Stevens L
(1997) Experimental studies of group selection: what do they tell Us about group selection in nature?
The American Naturalist 150 Suppl 1:S59–S79.

https://doi.org/10.1086/286050
- PubMed
- Google Scholar
(1995) A re-examination of the stochastic corrector model
Proceedings of the Royal Society B: Biological Sciences 262:29–35.

https://doi.org/10.1098/rspb.1995.0172
- Google Scholar
1. Griesemer J
(2002) What is "epi" about epigenetics?
Annals of the New York Academy of Sciences 981:97–110.

https://doi.org/10.1111/j.1749-6632.2002.tb04914.x
- PubMed
- Google Scholar
(2014) Life cycles, fitness decoupling and the evolution of multicellularity
Nature 515:75–79.

https://doi.org/10.1038/nature13884
- PubMed
- Google Scholar
1. Ikegami T
2. Hashimoto K
(2002) Dynamical systems approach to Higher-level heritability
Journal of Biological Physics 28:799–804.

https://doi.org/10.1023/A:1021215511897
- PubMed
- Google Scholar
1. Jacquard A
(1983) Heritability: one word, three concepts
Biometrics 39:465–477.

https://doi.org/10.2307/2531017
- PubMed
- Google Scholar
1. Johnson CR
2. Boerlijst MC
(2002) Selection at the level of the community: the importance of spatial structure
Trends in Ecology & Evolution 17:83–90.

https://doi.org/10.1016/S0169-5347(01)02385-0
- Google Scholar
1. Johnston IG
2. Jones NS
(2015) Closed-form stochastic solutions for non-equilibrium dynamics and inheritance of cellular components over many cell divisions
Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 471:20150050.

https://doi.org/10.1098/rspa.2015.0050
- Google Scholar
1. Kotil SE
2. Vetsigian K
(2018) Emergence of evolutionarily stable communities through eco-evolutionary tunnelling
Nature Ecology & Evolution 2:1644–1653.

https://doi.org/10.1038/s41559-018-0655-7
- PubMed
- Google Scholar
1. Lewontin RC
(1970) The units of selection
Annual Review of Ecology and Systematics 1:1–18.

https://doi.org/10.1146/annurev.es.01.110170.000245
- Google Scholar
Book
1. Margulis L
(1970)
Origin of Eukaryotic Cells: Evidence and Research Implications for a Theory of the Origin and Evolution of Microbial, Plant, and Animal Cells on the Precambrian Earth

New Haven, USA: Yale University Press.
- Google Scholar
1. Martin W
2. Müller M
(1998) The hydrogen hypothesis for the first eukaryote
Nature 392:37–41.

https://doi.org/10.1038/32096
- PubMed
- Google Scholar
Book
1. Maynard Smith J
2. Szathmary E
(1995)
The Major Transitions in Evolution

Oxford: Freeman.
- Google Scholar
Book
1. Penn A
(2003) Modelling artificial ecosystem selection: A preliminary investigation
In: Banzhaf W, Ziegler J, Christaller T, Dittrich P, Kim J. T, editors. European Conference on Artificial Life. Springer. pp. 659–666.

https://doi.org/10.1007/978-3-540-39432-7_71
- Google Scholar
Conference
1. Penn A
2. Harvey I
(2004)
The role of non-genetic change in the heritability, variation, and response to selection of artificially selected ecosystems

Artificial Life IX: Proceedings of the Ninth International Conference on theSimulation and Synthesis of Artificial Life.
- Google Scholar
Book
1. Queller DC
(1997) Cooperators Since Life Began
University of Chicago Press.

https://doi.org/10.1086/419766
- Google Scholar
1. Rainey PB
2. Remigi P
3. Farr AD
4. Lind PA
(2017) Darwin was right: where now for experimental evolution?
Current Opinion in Genetics & Development 47:102–109.

https://doi.org/10.1016/j.gde.2017.09.003
- PubMed
- Google Scholar
(2014) The present and future role of microfluidics in biomedical research
Nature 507:181–189.

https://doi.org/10.1038/nature13118
- PubMed
- Google Scholar
1. Smith JM
2. Szathmáry E
(1993) The origin of chromosomes. I. selection for linkage
Journal of Theoretical Biology 164:437–446.

https://doi.org/10.1006/jtbi.1993.1165
- PubMed
- Google Scholar
(2019) The role of exploitation in the establishment of mutualistic microbial symbioses
FEMS Microbiology Letters 366:fnz148.

https://doi.org/10.1093/femsle/fnz148
- PubMed
- Google Scholar
(2000a) Artificial selection of microbial ecosystems for 3-chloroaniline biodegradation
Environmental Microbiology 2:564–571.

https://doi.org/10.1046/j.1462-2920.2000.00140.x
- PubMed
- Google Scholar
(2000b) Artificial ecosystem selection
PNAS 97:9110–9114.

https://doi.org/10.1073/pnas.150237597
- PubMed
- Google Scholar
1. Takeuchi N
2. Hogeweg P
(2009) Multilevel selection in models of prebiotic evolution II: a direct comparison of compartmentalization and spatial self-organization
PLOS Computational Biology 5:e1000542.

https://doi.org/10.1371/journal.pcbi.1000542
- PubMed
- Google Scholar
1. van Vliet S
2. Doebeli M
(2019) The role of multilevel selection in host microbiome evolution
PNAS 116:20591–20597.

https://doi.org/10.1073/pnas.1909790116
- PubMed
- Google Scholar
Book
1. Wade MJ
(2016) Adaptation in Metapopulations
Chicago: University of Chicago Press.

https://doi.org/10.7208/chicago/9780226129877.001.0001
- Google Scholar
1. Williams HT
2. Lenton TM
(2007) Artificial selection of simulated microbial ecosystems
PNAS 104:8918–8923.

https://doi.org/10.1073/pnas.0610038104
- PubMed
- Google Scholar
1. Wilson EO
(1985) The sociogenesis of insect colonies
Science 228:1489–1495.

https://doi.org/10.1126/science.228.4707.1489
- PubMed
- Google Scholar
1. Wilson DS
2. Knollenberg WG
(1987) Adaptive indirect effects: the fitness of burying beetles with and without their phoretic mites
Evolutionary Ecology 1:139–159.

https://doi.org/10.1007/BF02067397
- Google Scholar
1. Wilson DS
2. Sober E
(1989) Reviving the superorganism
Journal of Theoretical Biology 136:337–356.

https://doi.org/10.1016/S0022-5193(89)80169-9
- PubMed
- Google Scholar
1. Xie L
2. Yuan AE
3. Shou W
(2019) Simulations reveal challenges to artificial community selection and possible strategies for success
PLOS Biology 17:e3000295.

https://doi.org/10.1371/journal.pbio.3000295
- PubMed
- Google Scholar
Preprint
1. Xie L
2. Shou W
(2018) Community function landscape and steady state species ratio shape the eco-evolutionary dynamics of artificial community selection
bioRxiv.

https://doi.org/10.1101/264697
- Google Scholar
1. Zomorrodi AR
2. Segrè D
(2016) Synthetic ecology of microbes: mathematical models and applications
Journal of Molecular Biology 428:837–861.

https://doi.org/10.1016/j.jmb.2015.10.019
- PubMed
- Google Scholar

Article and author information

Author details

Guilhem Doulcier
1. Laboratoire de Génétique de l'Evolution, Chimie Biologie et Innovation, Université PSL, Paris, France
2. Institut de Biologie de l’École Normale Supérieure (IBENS), École Normale Supérieure, Université PSL, Paris, France
Contribution
Software, Formal analysis, Visualization, Methodology

For correspondence
guilhem.doulcier@ens.fr

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0003-3720-9089
Amaury Lambert
1. Laboratoire de Probabilités, Statistique et Modélisation (LPSM), Sorbonne Université, CNRS, Paris, France
2. Center for Interdisciplinary Research in Biology (CIRB), Collège de France, Université PSL, CNRS, INSERM, Paris, France
Contribution
Formal analysis, Supervision, Methodology

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0002-7248-9955
Silvia De Monte
1. Institut de Biologie de l’École Normale Supérieure (IBENS), École Normale Supérieure, Université PSL, Paris, France
2. Department of Evolutionary Theory, Max Planck Institute for Evolutionary Biology, Plön, Germany
Contribution
Resources, Formal analysis, Supervision, Methodology

Contributed equally with
Paul B Rainey

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0001-7953-5494
Paul B Rainey
1. Laboratoire de Génétique de l'Evolution, Chimie Biologie et Innovation, Université PSL, Paris, France
2. Department of Microbial Population Biology, Max Planck Institute for Evolutionary Biology, Plön, Germany
Contribution
Conceptualization, Resources, Supervision, Funding acquisition

Contributed equally with
Silvia De Monte

Competing interests
Reviewing editor, eLife and founding member of MilliDrop

"This ORCID iD identifies the author of this article:" 0000-0003-0879-5795

Funding

Agence Nationale de la Recherche (ANR-10-IDEX-001-02)

Guilhem Doulcier
Paul B Rainey

Agence Nationale de la Recherche (ANR-10-LABX-54)

Silvia De Monte

Agence Nationale de la Recherche (ANR-11-IDEX-0001-02)

Silvia De Monte

Max-Planck-Gesellschaft

Paul B Rainey

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Acknowledgements

We thank Wenying Shou, Sara Mitri and Alvaro Sanchez for review of the manuscript and valuable comments. We also thank Benjamin Kerr, Will Ratcliff, Eric Libby, Michael Doebeli, Pierrick Bourrat and Philippe Nghe as well as the members of our respective teams for their feedback. GD was funded by the Origines et Conditions d’Apparition de la Vie (OCAV) programme, PSL University (ANR-10-IDEX-001–02), awarded to PBR, SDM and AL; SDM was supported by the French Government under the program Investissements d’Avenir (ANR-10-LABX-54 MEMOLIFE and ANR-11-IDEX-0001-02PSL), AL thanks the Center for Interdisciplinary Research in Biology (CIRB) for funding.

Copyright

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

3,198

views
504

downloads
52

citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Article PDF

Open citations (links to open the citations from this article in various online reference manager services)

Mendeley

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Guilhem Doulcier
Amaury Lambert
Silvia De Monte
Paul B Rainey

(2020)

Eco-evolutionary dynamics of nested Darwinian populations and the emergence of community-level heredity

eLife 9:e53433.

https://doi.org/10.7554/eLife.53433

Share this article

Cite this article

Nested model of evolution.

Evolutionary dynamics of collectives and particles.

Ecological dynamics of particles.

Dynamics of ancestral and derived collectives in the neutral regime.

Effect of collective-level selection on newborn-to-adult colour.

Evolutionary variation of the growth function under collective selection.

Stable fixed point of G as a function of collective-level parameters.

Constrained evolutionary trajectories.

Collective-level selection regimes.

Distribution of average mutable traits values across several simulations.

Distribution of the final traits across several experiments for different optimal colours.

Example of collective genealogy (Supplement of Figure 2).

The stochastic-corrector mechanism can maintain both types of particles in the absence of mutations (Supplement of Figure 2).

Particle trait mutations lead to slow loss of optimal collective colour after removal of collective-level selection (Supplement of Figure 4).

Left: A Lotka-Volterra flow (Equation 1 ) in (N0,N1) coordinates.

Piecewise continuous trajectory.

Qualitative behaviours of the growth function Gθ.

Bifurcation diagrams showing the position and stability of the fixed points of Gθ as a function of the duration of the collective generation T.

Stable equilibria of the particle ecology as a function of inter-colour competition traits.

Asymmetric interaction ensures fastest convergence toward the ecological equilibrium.

Asymptotic colour of the particle ecology as a function of inter-colour competition traits.

Mutualistic interaction can lead to non-saturating population growth.

Author details

Guilhem Doulcier

Contribution

For correspondence

Competing interests

Amaury Lambert

Contribution

Competing interests

Silvia De Monte

Contribution

Contributed equally with

Competing interests

Paul B Rainey

Contribution

Contributed equally with

Competing interests

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Categories and tags

Further reading

Stable fixed point of $G$ as a function of collective-level parameters.

Left: A Lotka-Volterra flow (Equation 1 ) in $(N_{0}, N_{1})$ coordinates.

Qualitative behaviours of the growth function $G_{θ}$ .

Bifurcation diagrams showing the position and stability of the fixed points of $G_{θ}$ as a function of the duration of the collective generation T.