The dominant–egalitarian transition in species-rich communities
Abstract
Diverse communities of competing species are generally characterized by substantial niche overlap and strongly stochastic dynamics. Abundance fluctuations are proportional to population size, so the dynamics of rare populations is slower. Hence, once a population becomes rare, its abundance gets stuck at low values. Here, we analyze the effect of this phenomenon on community structure. We identify two distinct phases: a dominance phase, in which a tiny number of species constitute most of the community, and an egalitarian phase, where it takes a finite fraction of all species to constitute most of the community. Using empirical data from microbial, planktonic, and macroorganismal systems, we demonstrate the relevance of this transition and show how demographic stochasticity and immigration critically determine phase behavior. Our results suggest that even slight changes in noise strength or immigration rates can lead to abrupt shifts in community diversity.
Editor's evaluation
This valuable paper explores the question of when complex ecosystems will be dominated by a few species. The authors present compelling, general arguments for a phase transition from what they call a dominance phase (few species dominate biomass) to an egalitarian phase (no species dominates the biomass).
https://doi.org/10.7554/eLife.103999.sa0Introduction
Many ecological systems contain numerous competing species, strains, or types (Hutchinson, 1961; Stomp et al., 2011; ter Steege et al., 2013; Connolly et al., 2014; Fierer et al., 2007). In such systems, it can be assumed a priori that the structure of the community essentially reflects resource competition among species (Gause, 2003; Tilman, 1982), with factors such as niche overlap and fitness differences playing a central role in the community assembly (Chesson, 2000; Chesson, 2003). Analyzing these factors and their impact is crucial for understanding the dynamics of these systems, and consequently, for our ability to intervene in these dynamics to achieve desired outcomes – from maintaining biodiversity in a changing world to successfully altering the state of the gut microbiome (David et al., 2014; Grilli, 2020; Eguíluz et al., 2019; Cooper et al., 2024; Callaghan et al., 2021).
Unfortunately, progress in this area has been quite difficult. The coexistence of many species remains largely puzzling, especially given the competitive exclusion principle (Tilman, 1982) and the strict constraints on the stability and feasibility of such complex systems (May, 1972). Moreover, quantifying the relevant parameters in diverse communities is extremely challenging, particularly considering the high level of stochasticity typically present in ecological dynamics. As a result, approaches inspired by statistical physics, which examine generic models through a few summary statistics, have gained significant popularity in recent years (Fisher and Mehta, 2014; Kessler and Shnerb, 2015; Bunin, 2017; Barbier et al., 2018; Grilli, 2020; van Nes et al., 2024).
Broadly speaking, attempts to present a generic analysis of diverse communities can be divided into two main approaches that differ in their interpretation of what determines dominance. In one class of models, the identity of the high-abundance species reflects intrinsic fitness differences (whether through growth rates, competitive advantage, or resource-use efficiency) so that the dominant species are effectively the ‘fittest’ (Fisher and Mehta, 2014; Bunin, 2017; Barbier et al., 2018; Azaele and Maritan, 2023; Marcus et al., 2022). In contrast, an alternative view holds that dominance arises from contingent stochastic dynamics: species happen to be abundant not because they are intrinsically superior, but as a result of random historical trajectories. These trajectories may reflect demographic noise, environmental stochasticity, or even deterministic chaos in systems with complex interactions.
The prototype of this second class of approaches was introduced in the neutral model proposed by Crow and Kimura, 1970 and Hubbell, 2001. In the original neutral models, demographic stochasticity – the inherent randomness in the birth–death process at the individual level – is the sole driver of abundance variations. Analytical solutions to these models are relatively easy to obtain (Volkov et al., 2003; Azaele et al., 2015) and have been quite successful in explaining the observed species abundance distributions (SADs), as well as other static patterns, in both regional and local communities (Rosindell et al., 2011). However, pure demographic stochasticity cannot account for dynamic patterns, whether evolutionary (such as the time to the most recent common ancestor) (Nee, 2005; Ricklefs, 2006) or ecological (such as the dynamics of abundance variation and similarity indices) (Leigh, 2025; Chisholm and O’Dwyer, 2014; Kalyuzhny et al., 2014b; Kalyuzhny et al., 2014a). Demographic stochasticity results in relatively slow and weak abundance variations, whereas observed variability is much stronger and occurs more rapidly (Kalyuzhny et al., 2014b; Chisholm et al., 2014).
The time-averaged neutral model (Kalyuzhny et al., 2015) addresses these limitations by relaxing the assumption of time-independent fitness. In this model, the relative fitness of each species fluctuates over time, but all species share the same mean fitness. The analysis of the time-averaged neutral model is more complex, as environmental stochasticity can facilitate coexistence through the storage effect (Chesson and Warner, 1981). However, the significance of this effect diminishes in highly diverse systems (Dean et al., 2017; Danino and Shnerb, 2018; Pande and Shnerb, 2022; Meyer et al., 2022).
Recent studies have highlighted a notable effect of environmental stochasticity in competitive communities, known as ‘stickiness’ (van Nes et al., 2024) or ‘diffusive trapping’ (Dean and Shnerb, 2020). Under environmental stochasticity, abundance variations are proportional to population size, meaning that the dynamics of rare species is slow, causing them to linger near the extinction point for extended periods. van Nes et al., 2024 suggested that this stickiness enables time-averaged neutral models to produce patterns – such as changes in abundance over time, dominant species turnover, and community egality – that closely resemble those observed in real ecological communities. Similar results were found by Mallmin et al., 2024 in a system of competing species for which the overall dynamics are chaotic. This makes sense, given that the relative fitness of a specific species depends on the abundances of its competitors, so if these abundances fluctuate strongly over time, as they do in the chaotic phase, the community will likely reach a state that resembles time-averaged neutrality.
Our main goal in this article is to identify a previously unrecognized phase transition between dominant and egalitarian communities. To describe this transition, we define the number of dominant species, , as the minimum number of species that must be grouped together at a given moment to account for more than half of the total population. The level of equality in the community is then measured by the egality ratio, , where is the total species richness. We show that in the dominance phase, the growth of with is sublinear, so the egality parameter approaches zero as , whereas in the egalitarian phase, grows linearly with , and the egality parameter converges to a finite value. We demonstrate the existence of these two phases through analysis of empirical data on patterns of commonness and rarity across a wide range of ecological systems, from tropical forest trees to the human microbiome.
During the analysis and comparisons with the empirical data, we also arrived at two important insights.
The basic model presented by van Nes et al., 2024 includes only growth, competition, and environmental stochasticity. We show that this dynamics alone leads to monodominance, where all populations except one decline below any finite abundance level. Coexistence requires a mechanism, such as immigration, that imposes a lower bound on species abundances. Therefore, immigration – which was considered only in the supplementary materials of van Nes et al., 2024 – is a crucial ingredient, and so even small changes in the immigration rate can shift the system between ecological phases.
An additional factor not included in the model of van Nes et al., 2024 is demographic stochasticity. We will show that for populations of macroorganisms, the abundance distribution of relatively rare species is significantly affected by demographic stochasticity, and to properly describe it, this mechanism must also be taken into account.
The dominant–egalitarian phase transition has practical implications. A small decrease in the immigration rate or, alternatively, a small increase in the level of stochasticity can lead to a sharp decline of the diversity within a given community. Moreover, in the section ‘Materials and methods’, we have examined cases in which neutrality is broken, including fitness differences and asymmetry in the competitive interaction matrix. The results of this study demonstrate that the phase transition between the egalitarian and dominance regimes is not an artifact of perfect neutrality, but remains robust over a finite region of parameter space near the neutral point.
Results
As we have already mentioned, without external immigration, the stickiness will eventually cause the abundance of all species, except one, to drop below any finite threshold, leading the community to a state of monodominance. To avoid disrupting the continuity of the main discussion, we detail and demonstrate this claim in ‘SI A’ (see also the supplement to Figure 1). Therefore, the basic model we study is given by
where , is the abundance of the ith species. sets the overall carrying capacity. The growth rate of the ith species is , where is an independently fluctuating variable, with a correlation time , driven by the white noise . The immigration rates of all species are identical and given by Further details on the model are given in the ‘Materials and methods’ section.
Probability distribution of species abundance.
Red circles: results of a simulation of the process described in Equation 1 with parameters , , , and . The values of the extracted parameters for Equation 4 are and . The solid line in blue is the expression of Equation 4 with parameters and .
is an independently fluctuating variable, with a correlation time , driven by the white noise . The immigration rates of all species are identical and given by Further details on the model are given in the ‘Materials and methods’ section.
Stickiness and species abundance distribution
Without immigration, the carrying capacity parameter plays no role in the dynamics. Actually, by defining one may rescale Equation 1 to . When immigration is introduced, the parameter expresses the ratio between the carrying capacity and the typical minimum level of population size. The larger this ratio, the stronger the stickiness effect.
On top of that, since stickiness arises from environmental stochasticity, it becomes stronger as increases. Dimensional analysis reveals that the dimensionless parameter that governs stickiness is
The larger is, the stronger is the stickiness, and the community approaches monodominance when ; for example, when .
In order to advance in the analysis, we are interested in replacing Equation 1, which provides us with a description of an -dimensional system where each species can affect every other species, with an effective, one-dimensional equation for a focal species, considering all others as a single rival species. In the classical neutral theory, with pure demographic stochasticity, this can be done trivially, as the species identity of a particular individual plays no role in the dynamics. In the time-averaged neutral theory, however, the situation is much more subtle.
The distinction between neutral and time-averaged neutral models – as it arises in the attempt to derive an effective one-species description – was clarified in Danino and Shnerb, 2018 and Steinmetz et al., 2020, and has to do with the difference between the time-averaged growth rate of a given species and the population-averaged growth rate of the community. In Equation 1, the linear growth rate of each species is . Since the process is symmetric around zero, the time-average growth rate of each species is unity. Nevertheless, the instantaneous growth rate of the community is, on average, greater than 1. At any given moment, the fitter species are growing faster, so that on average more than 50% of the individuals belong to instantaneously beneficial species. As a result, the typical value of , and therefore the dynamics of a single species satisfies the effective one-dimensional stochastic differential equation,
where . The noise in the net growth rate of the ith species arises from two sources, the first being the direct effect of , and the second being the fluctuations in the competition term, . The two parameters and may be measured, for any given values of , , and , from long simulations of Equation 1. Unless we are looking at the most abundant species, the correlations between the competition term and are small, and the two contributions are roughly independent. Thus, the overall effect of these two contributions is
Here, is the time integral of the two-time correlation function of and equals . For example, for , , , , we have and , in line with Equation 3. The Stratonovich term expresses the fact that for a population that sometimes grows exponentially and sometimes declines, even if its average growth rate is zero, the arithmetic mean still increases over time. Once this term is introduced, the standard Ito calculus may be applied to Equation 2.
Once the relevant parameters are calibrated, the distribution for may be extracted from Equation 2, see ‘SI 2’. The resulting distribution is
where , and is a normalization factor. Figure 1 illustrates the success of the approximation and the validity of Equation 4 in a simulation of a community of interacting species governed by Equation 1.
A similar result was presented a few months ago by Mallmin et al., 2024, who dealt with a system of competing species where the community dynamics is chaotic (but without external stochasticity). In such a case, one can consider, for each focal species, all other species as an effective external environment whose fluctuations generate stochasticity in the instantaneous growth rate of the focal species. A discussion of the similarities and differences between our case and the chaotic model will be presented below.
The egalitarian transition
The most striking implication of Equation 4 is the sharp shift in the compositional properties of the community at . When , abundant species are relatively rare, resulting in an ‘egalitarian’ community. Conversely, when , the community composition is dominated by a few exceptionally abundant species.
To quantify the egality of the community, one may use the criterion suggested by van Nes et al., 2024, which involves comparing the total number of species, , to the minimal number of species required to make up half of the community, . In a more egalitarian community, the fraction is finite, indicating that the number of dominant species is proportional to the total number of species. In contrast, in a community dominated by only a few species, the ratio approaches zero as increases, meaning the number of dominant species is sublinear in .
In Appendix C, we provide the relevant mathematical analysis, demonstrating that, as decreases towards 2, monotonically decreases, and in the limit ,
Thus, this egality parameter vanishes in a singular manner in that limit, indicating the transition out of the egalitarian phase.
The numerical results presented in Figure 2A illustrate this phenomenon and offer several additional interesting insights. Beyond the positive indication regarding the result in the limit where , Figure 2A shows that the value of depends only weakly on so it can be considered approximately constant. Moreover, as seen in Figure 2B, for the dependence of on follows a power law, with an exponent approaching unity from below at the phase transition point .
The egaility parameter as a function of the number of species.
Left panel (A): the egality parameter is plotted against , the total number of species, for (blue) 0.02 (red) 0.04 (orange) and 0.08 (green). For all these simulations , and . The values of the parameter , as extracted from the simulation, are plotted (again, vs. ) in the inset. As expected, for (blue) the egality parameter extrapolates, at , to a finite value, meaning that the fraction of high-abundance species is finite and the community is egalitarian. This feature is also reflected in the right panel (B), where at large , for (red) and for (blue). On the other hand, when (green), the value of approaches 1.8 and is definitely smaller than two. In addition, the egality parameter extrapolates to zero at large , meaning that the community is dominated by a small number of species. The results shown in the right panel suggest . The case (orange) represents a near marginal case, for which extrapolates to values slightly smaller than 2, and it would appear that is tending toward zero. Indeed, the right panel shows a power law with exponent smaller than unity and decreasing with increasing .
Of course, there are other quantities one could employ to quantify the egality. One such possibility is the inverse participation ratio, , defined as . This varies from 1 in the limit of single species dominance to for an egalitarian community. Our measurements (not shown) indicate that, similarly to , increases with , though the exponents controlling the growth are slightly lower. For example, for , , as opposed to , and for , , while .
Comparison with empirical results and the impact of demographic stochasticity
Let us now examine the SAD in several cases of diverse communities, assess their degree of alignment with the results presented above, and attempt to differentiate between dominance and egalitarian communities, linking the results to the fundamental characteristics of each system.
We analyze the community structure in four systems: the human gut microbiome (David et al., 2014), marine prokaryotes (Eguíluz et al., 2019), tropical trees (Cooper et al., 2024), and bird species (Callaghan et al., 2021). All of these communities are hyperdiverse, with thousands of species, making them reflective of the limit where is very close to zero – a limit where the distinction between egalitarian and dominance systems is clearly defined, with the relevant values of being those shown in Figure 2.
Figure 3a shows the excellent agreement between the empirical data for the gut microbiome and our model prediction (Equation 4). In the case of ocean prokaryotes, presented in panel (b), only a pure power law is observed, perhaps because the sampling strength is insufficient. Weak sampling shifts the distribution leftward, thus hiding the true characteristics of the SAD for small abundance populations (Maruvka et al., 2010). In both cases , indicating that these systems are in the dominant phase, consistent with the very small values of observed in the data.
Species abundance distributions, as obtained for a few diverse communities.
The gut microbial community (OTUs of subject A from David et al., 2014) fits our formula Equation 4 quite well. Immigration is extremely weak, but the sampling power is strong enough to reveal some of the effects of the decrease in the number of species at low densities due to immigration. The corresponding distribution for the oceanic prokaryote population Eguíluz et al., 2019 is very close to a pure power law, possibly because the sampling is not deep enough (see text). In both cases, , indicating that the community is dominated by only a few species. The distributions for the global bird population (Callaghan et al., 2021) and tropical trees in the Amazon Basin (Cooper et al., 2024) show a clear transition between two power-law behaviors. As explained in the text, for these macroorganisms the effect of demographic stochasticity must be taken into account. When this is done (see ‘SI D’), we obtain an excellent fit for the results using the corrected formula. Equation 6. For birds, we find , placing them on the margin between egalitarian and dominance communities. For tropical trees in the Amazon Basin, is definitely larger than two, indicating that the community is indeed egalitarian. Note the similarities between the values of in the empirical results and the numerical experiments in Figure 2. For more information, see ‘SI E’.
In contrast, in Figure 3c and d, for birds and Amazon basin trees, respectively, the empirical distribution does not fit Equation 4. Instead, the population size distribution shows a pronounced crossover between two descending power laws, without a maximum point at a finite abundance.
To explain this, we note that trees and birds differ from microorganisms in two important ways. First, since macroorganisms tend to have larger body sizes and longer lifespans, their metabolism buffers them against environmental fluctuations. Additionally, since populations of macroorganisms often span wide geographic ranges, most environmental variations appear uncorrelated across populations. Environmental variation that affects individuals, or small groups within the population, in an uncorrelated manner contributes to demographic stochasticity rather than to environmental stochasticity, which, by definition, affects entire populations coherently. Therefore, for macroorganisms we need to account for demographic stochasticity.
In ‘SI D’, we consider the case of a time-averaged neutral community with demographic stochasticity in addition to the previously considered immigration and environmental stochasticity. The expected distribution for species abundances now takes the form
with parameterizing the strength of demographic stochasticity. Equation 6 converges to Equation 4 for values of satisfying and predicts a different power-law for smaller values of . With this new formula, one can now successfully fit the empirical data in Figure 3c and d. It is noteworthy that the transition point between the two power-laws happens for values of the abundance which are quite large, reinforcing our above comments about the effect of the large spatial and temporal scales of macroorganisms on reducing and increasing .
Even with the inclusion of demographic stochasticity, the distinction between dominant and egalitarian communities depends solely on the decay of the tail and its corresponding exponent , which, for Equation 6, remains as . Figure 3 thus illustrates the three types of behavior demonstrated in the numerical experiments shown in Figure 2: the microorganism communities are in the dominance phase, the tropical tree community is in the egalitarian phase, and the bird community appears to fall in between.
A comparison between the values of the egality parameter in Figure 2 and the values of in van Nes et al., 2024 (for the same range of species richness ) also shows that some communities fall within the dominance phase, while others fall within the egalitarian phase. On the other hand, the results for plankton (Ser-Giacomi et al., 2018), in which , appear to suggest that these microorganismal communities are all in the dominance phase.
Relaxing the assumption of neutrality
So far, we have analyzed the properties of a system that is fully neutral in the deterministic limit – that is, all species have exactly the same fitness. In this section, we aim to explore, or at least provide a glimpse of, the outcomes that arise when this assumption is relaxed; in particular, we assess the robustness of our analysis in the vicinity of the neutral point.
To break perfect neutrality, we introduce heterogeneity into the interaction matrix. Specifically, we replace Equation 1 by
where are zero-mean, unit-variance Gaussian random numbers, and is independent of , so the interaction matrix is asymmetric. For , this reduces to our original time-averaged neutral model. The additional term ensures that species compete most strongly against themselves, as is commonly assumed in ecological models, since the niche overlap between individuals of the same species is maximal.
The results are presented in Figure 4, which shows as a function of for two different values of the environmental stochasticity . As , the system may reside either in the egalitarian phase (if is small) or in the dominance phase under strong environmental stochasticity. In contrast, for large values of , becomes independent of .
From stochasticity-driven to chaotic dynamics.
, as obtained from simulations of Equation 7, is plotted against , for , and . For (blue circles), the system is in the egalitarian phase and the main effect of the transition to chaos is an effective enhancement of the strength of stochasticity that makes the system less egalitarian, hence decreases. The inverse effect is observed for (red squares). For large values of , the effect of becomes negligible and the dependence of on weakens significantly. The data was obtained by averaging over at least 20 different realizations of the interaction matrix .
To understand these results, note that in the absence of environmental stochasticity, the heterogeneous and asymmetric interactions lead to chaotic dynamics of the trajectories, as discussed in Arnoulx de Pirey and Bunin, 2024. Illustrations of fluctuation dynamics dominated by stochasticity versus those dominated by deterministic chaos are provided in ‘SI F’. Under chaotic dynamics, the system supports, at any instant of time, a clique of abundant species. This clique is stable in the sense that if all the species within it are placed together in a community, they will reach an equilibrium state in which all of them persist. However, the clique is invadable, meaning that at any given moment, there exist species outside the clique that are capable of invading and reaching high abundance (Kessler and Shnerb, 2025). Such a clique gives rise to a ‘shoulder’ at high abundance values (see Figure 5), since at any given moment there are several species with high abundance. In contrast, the hierarchical structure under pure environmental stochasticity leads to a simple power law, as seen earlier in Figure 1.
vs. for , .
The distribution for is typical of the egalitarian phase with a large slope for large . The distribution for , however, has the slower falloff characteristic of the dominance phase. In addition, there is a shoulder for very large , which is due to the existence of multiple sets of several transient quasi-stable species, arising from the chaotic dynamics present in the absence of environmental stochasticity.
As increases from zero to a finite value, the neutral-stochastic system discussed throughout this article transforms into a system where the dominant factor is deterministic chaos. In the chaotic phase, the dynamics still appears stochastic, but not due to fluctuations in external parameters, but rather as a result of the inherent characteristics of the deterministic dynamics.
Figure 4 demonstrates that the transition to chaos affects in opposite ways in the two phases. In the egalitarian phase, the main effect of chaos is to increase the effective stochasticity, leading to a decline of . In the dominance phase, by contrast, increases. This is due to the ‘shoulder’ in the abundance distribution described in Figure 5, that is, because dominance in the chaotic regime is associated with a clique rather than a single species.
Discussion
Hyperdiverse communities, like those analyzed in this article, are extremely important and frequently occur in nature. However, quantifying their specific parameters is an impossible task. Therefore, the attempt to understand the factors that dictate the community structure in these systems requires the use of models, which should preferably be as generic as possible.
Broadly speaking, there are three generic scenarios for the dynamics of multispecies systems: those involving a stable clique of resident species; those in which the composition of the group of high-abundance species changes over time due to chaotic dynamics; and those assuming neutral dynamics.
In the first case, the set of high-abundance species is determined by their relative fitness (which reflects their intrinsic growth rate and interspecific interactions), which remains fixed over time. In the second, the composition of the dominant cliques varies intermittently over time, but this turnover is governed by deterministic factors, and at any given moment, only a specific set of low-abundance species is capable of exponential growth. Moreover, the system admits a characteristic timescale, the time required for one of these rare species to invade. This timescale depends logarithmically on the migration rate .
In the third case, discussed here, the identity of the high-abundance species at any given moment is a random outcome of environmental stochasticity. As in the chaotic case, there is no sharp separation between core species and low-abundance ones, and the fundamental timescale of the system is determined by the stickiness phenomenon described above.
As far as can be judged from the empirical SADs of Figure 2, it appears that they cannot be explained by the first scenario. Two of its main features are a gap between species with abundance of and those with abundance of , and a truncated Gaussian-shaped SAD for the high-abundance species – both of which are not observed in our distributions.
The chaotic case yields SADs that more closely resemble those we have reviewed here: they exhibit no gap and display a power-law behavior. In fact, when attempting to derive an effective equation for a single species, one arrives, as noted above, at the very same equation. As is well known, it is often possible to identify multiple underlying models that give rise to the same abundance distribution. Therefore, matching the SAD is a necessary condition for considering a model a plausible candidate, but leaves open the possibility of alternative explanations.
To tell apart chaos from environmental stochasticity, it may be necessary to focus specifically on the dynamics of the most abundant species. If the noise is intrinsic, originating from chaotic fluctuations, then a species that has reached dominance is expected to exhibit fluctuation patterns that differ markedly from those observed when the same species is rare. In contrast, if the fluctuations stem from external factors such as weather or precipitation, we would expect the statistical properties of abundance fluctuations to be independent of the species’ current abundance level, as has been observed empirically (Kalyuzhny et al., 2014b).
Another test that may help distinguish between a chaotic and a stochastic system relates to the emergence of a fundamental timescale (Arnoulx de Pirey and Bunin, 2024) in chaotic dynamics – one associated with the invasion of rare species. Such a timescale does not appear in systems driven by external stochasticity. Like the previous approach, this too requires one to examine dynamic properties of the system, rather than relying solely on static features such as the abundance distribution.
Whatever the underlying mechanism, the net result, as we have demonstrated herein, is that in the limit of strong interspecies coupling, a transition occurs between an egalitarian phase and a dominance phase. When the immigration rate is reduced, total carrying capacity increases, or when environmental stochasticity increases, the system can suddenly lose a significant amount of diversity at the transition point. The dependence on the total population size is particularly interesting and has to do with the dispute about the relationships between productivity and species richness (Waide et al., 1999; Kadmon and Benjamini, 2006).
We will now discuss some potential extensions of the model described here and explore their possible implications.
Our model assumed an uncorrelated response of species to environmental variations. This treatment can be easily extended to include correlated responses, using techniques similar to those implemented by Loreau and de Mazancourt, 2008. In general, under correlated responses, the effective number of species in the community decreases.
Another interesting point relates to the interplay between the stickiness mechanism, through which environmental stochasticity causes populations to spend long periods in a state of rarity, and mechanisms such as the storage effect or relative nonlinearity (Chesson, 1982; Chesson, 2000; Ellner et al., 2016; Letten et al., 2018) that allow rare populations to invade due to environmental stochasticity. It is likely that these mechanisms weaken as the number of species increases (for storage, this has been demonstrated in several studies; Chesson and Huntly, 1989; Pande and Shnerb, 2022), and therefore, at least in diverse communities of competing species, the dominant effect will actually be that of stickiness.
The time-averaged neutral dynamic considered here assumes that the differences in average fitness between species are negligible, at least to a first approximation. This assumption is necessary in situations where niche overlap is large; otherwise, fitness differences would cause the extinction of most species. The justification for this can come from processes leading to emergent neutrality (Holt, 2006; Vergnon et al., 2012), or from the fact that environmental stochasticity itself is also a mechanism that ‘neutralizes’ fitness differences (Pande and Shnerb, 2022). Extending our model as we have done above to include weak deviations from time-averaged neutrality, perhaps using the dynamic mean-field approximation (Roy et al., 2019) , is a critical first step, which remains to be explored in more detail.
Species coexistence has long been, and remains, a theoretical puzzle of immense importance for understanding the dynamics of biological systems, with far-reaching practical implications. The research conducted in recent years has provided powerful theoretical tools that allow us to focus the discussion and understand the generic implications of community structure and the nature of species interactions on the range of possible outcomes. We believe that the parameter range we have addressed in this article – (nearly-) neutral dynamics and significant environmental stochasticity – is relevant for a wide variety of ecological systems, and we hope that our work will serve as a foundation for further studies that explain the wide range of diversity levels (for example, between a tropical forest and a tundra, or between different types of microbiome) in relation to the phase transition described here.
Materials and methods
Data compilation and analysis
Request a detailed protocolAs explained below, the phase transition we analyze in this paper manifests itself in two characteristics: the SAD and the egality parameter . Like any phase transition in complex systems, the distinction between the two phases becomes sharper as the system grows larger, so that increases. To test our predictions, we used several recent large databases on communities with thousands of species: human microbiome (David et al., 2014), marine prokaryotes (Eguíluz et al., 2019), tropical forest trees (Cooper et al., 2024), and birds (worldwide) (Callaghan et al., 2021).
The (noise-free) neutral model
Request a detailed protocolWe consider a community of populations, with differential responses to environmental variations. is the abundance of the ith species, and the carrying capacity parameter is denoted by . With no stochasticity and no immigration, satisfies the equation
As all species admit the same growth rate and interact in a symmetric manner, the model is neutral. In particular, any solution that satisfies is a steady state of the system.
The time-averaged neutral model
Request a detailed protocolTo allow for nontrivial dynamics, one would like to add environmental stochasticity and immigration to the process described in Equation 8. The rate of immigration is denoted by , and the growth rate of each species fluctuates in time, undergoing an Ornstein–Uhlenbeck process with a correlation time . The corresponding set of stochastic differential equations, as set out in Equation 1.
where is a white-noise process of unit strength. The index i of indicates that each of the species responds to the environmental variations in an independent manner. The correlation function of is
The equivalent white-noise strength of the environmental stochasticity, twice the diffusion constant of , is then given by , the time integral of the correlation function.
Fokker–Planck (FP) equations
Request a detailed protocolThe main analytical results presented in this article are based on solving FP equations. To derive these equations, we assumed a relatively short correlation time τ for the environmental stochasticity, which allows the use of a single effective equation for the process described in Equation 8. The relevant considerations are detailed in ‘SI B’.
Demographic stochasticity
Request a detailed protocolThis refers to the intrinsic randomness of the birth–death process at the individual level. This stochasticity also manifests in erratic abundance variations, but the intensity of these fluctuations is weaker (compared to environmental stochasticity) when the population is large, and therefore it was not included in Equation 8 or in the analyses of van Nes et al., 2024 and Mallmin et al., 2024. However, demographic stochasticity is crucially important in small populations and in extinction processes; as we have seen, it must be considered outside the microorganism realm. To include demographic stochasticity in the treatment, one must add a term to the relevant equation that expresses noise whose amplitude scales with the square root of the population size, as opposed to environmental stochasticity, whose amplitude scales linearly with population size. The technical details can be found in ‘SI D.
Appendix 1
Supporting information
SI A: The necessity of immigration
van Nes et al., 2024 have considered various models that were proposed for a diverse community in which all species have the same mean fitness. Most cases were reviewed in the supplemental material of the aforementioned article, but the version analyzed in detail in the main text is
where is a white noise process. Ito calculus is applied, so the numerical integration procedure satisfies
where is a random variable drawn (independently for each and each species) from a normal distribution with zero mean and unit variance.
However, in the absence of an immigration term, that is, when , such a process leads to monodominance, the state where only one species survives and the abundance of all other species drops below any finite value. Figure 1—figure supplement 1 demonstrates numerically this behavior. The results presented in our main text explain this phenomenon. First, if then in our solution, Equation 4. The resulting species abundance distribution diverges at zero abundance and cannot be normalized. The interpretation of such non-normalizable abundance distribution is that the abundance of all species will drop below any finite threshold as time goes to infinity.
One may arrive at the same conclusion from a different perspective (Dean and Shnerb, 2020). Let’s assume we have two species in a community with a fixed and rigid carrying capacity (i.e., they are playing a zero-sum game) and environmental stochasticity that determines their relative fitness.
Denoting by the fraction of the focal species, its dynamics satisfies , where reflects the effect of the fluctuating environment. Therefore, the population undergoes a balanced walk in the logit space . In this type of random walk, a species that ‘gets stuck’ in the low-density region will remain there for increasing periods, as described in Section 5 of Dean and Shnerb, 2020. This is the ‘diffusive trapping’, or the stickiness of low-abundance states, that causes the system to be dominated at any given moment by a single species.
Now we can easily generalize this argument for species: the relative fitness of each species (i.e., its fitness relative to the average fitness of the community) is a zero-mean random variable. Therefore, in the log-abundance space, it undergoes a random walk, and so all species except one will fall below any threshold of abundance over time. Thus, as seen in Figure 1—figure supplement 1, the system in the long run is dominated by a single species, and the abundance of all other species is negligible.
SI B: Derivation of Equation 4
The FP equation that corresponds to Equation 2 is
In steady state, is time-independent and so its time derivative vanishes, leaving one to solve the exact ordinary differential equation (after first integration),
Here, we have put the integration constant to zero to avoid diverging solutions that yield non-normalizable functions. Therefore,
That yields Equation 4 of the main text.
SI C: From egalitarian community to hyperdominant species
Let us consider a community of individuals, whose species richness is . By definition,
and
From Equation 4 of the main text, we take and plug it into Equation SC1. First, we implement the condition on to determine the normalization factor , and find
Now let us assume . In that case, the integral in (S2) converges so that
As a metric for the egality of the community, let us take the one used in van Nes et al., 2024. First, we will check the richness of the minimum set of species required to contain at least 50% of the entire community population. If the species within this set with the smallest abundance is represented by individuals, this implies (implementing Equation SC4).
When then and hence,
therefore
so the ratio approaches zero as
The fraction of species whose abundance is equal or greater than is obtained as
In particular, as ,
SI D: Demographic stochasticity
Every group of living organisms is influenced by various types of stochasticity. The literature (Kalyuzhny et al., 2014b; Lande and Engen, 2003) usually distinguishes between environmental stochasticity, which affects populations coherently, and demographic stochasticity, which affects the fitness of individuals or small groups of individuals in an incoherent manner, so that the overall reproductive success of the population reflects the sum of many random events. Weather (such as temperature or precipitation) fluctuations that are correlated over a large area and simultaneously affect entire populations contribute to environmental stochasticity, while the degree of success or failure of individuals in finding food or avoiding predators relative to its population mean contributes to demographic stochasticity.
Environmental stochasticity is represented in equations by noise that is proportional to the population size. Thus, in Equation 1 of the main text, the term , which varies stochastically, multiplies . This mathematical expression reflects the situation where, in a good year, the average number of offspring for each individual increases, and in a bad year, it decreases. Demographic stochasticity, on the other hand, represents the success or failure of individuals, so that the overall result, according to the Central Limit Theorem, is fluctuations that are proportional to the square root of the population size. The corresponding term in the Langevin equation is .
In an FP equation, the term that represents demographic stochasticity is
We denote the strength of demographic stochasticity (i.e., the variance in the number of offspring per individual) by , distinguishing it from , which represents the strength of environmental stochasticity.
The extended version of Equation SD1 thus takes the form
Again, in steady state, is time-independent,
and therefore the species abundance distribution is given by
SI E: Figure 3 information
For each dataset, the data was log-binned (scaled by the inverse of the width of the bin), then the log-log histogram was fitted with the relevant expression.
Summary of fitted models and parameter estimates (with 1σ uncertainties) for the four systems analyzed.
| System (panel) | Fitted equation | Fitted parameters (±1σ) |
|---|---|---|
| Gut microbiome (a) | Fit to Equation 4 with , , A normalization factor | ; ; |
| Plankton (b) | Fit to Equation 4 with , , A normalization factor | ; ; |
| Birds (c) | Fit to Equation 6 with , , , A normalization factor | ; ; ; |
| Amazon trees (d) | ; , , , A normalization factor | ; ; ; |
SI F: Stochastic and chaotic dynamics
This figure shows the abundance of 200 species over time, in the purely stochastic case () and in the case dominated by chaotic dynamics (). We observe that chaotic dynamics introduce a new element into the system: a clique of species that are “dominant” at any given moment. Although there is always a species that can invade this clique and drive one or more of its members to low abundance levels, this process takes time. As a result, the number of highly abundant species is larger compared to the stochastic case, where we see a strong dominance of a single species at each moment.
Data availability
The current manuscript is a computational study, so no data have been generated for this manuscript. The simulation code can be accessed at https://github.com/kesslerda11/Sticky (copy archived at Kessler, 2024). The data analyzed was obtained from presvious published works, as indicated in the References.
-
European Nucleotide ArchiveID PRJEB6518. Host lifestyle affects human microbiota on daily timescales - Subject A gut counts.
-
GitHubID OTUtable_Salazar_etal_2015_Molecol.txt. MolEcol_2015.
-
figshareCooper consistent patterns of common species across tropical forest tree communities.https://doi.org/10.6084/m9.figshare.21670883.v1
References
-
Towards a unified descriptive theory for spatial ecology: predicting biodiversity patterns across spatial scalesMethods in Ecology and Evolution 6:324–332.https://doi.org/10.1111/2041-210X.12319
-
Ecological communities with Lotka-Volterra dynamicsPhysical Review E 95:042414.https://doi.org/10.1103/PhysRevE.95.042414
-
Environmental variability promotes coexistence in lottery competitive systemsThe American Naturalist 117:923–943.https://doi.org/10.1086/283778
-
ConferenceThe storage effect in stochastic competition modelsMathematical Ecology: Proceedings, Trieste.
-
Short-term instabilities and long-term community dynamicsTrends in Ecology & Evolution 4:293–298.https://doi.org/10.1016/0169-5347(89)90024-4
-
Mechanisms of maintenance of species diversityAnnual Review of Ecology and Systematics 31:343–366.https://doi.org/10.1146/annurev.ecolsys.31.1.343
-
Quantifying and testing coexistence mechanisms arising from recruitment fluctuationsTheoretical Population Biology 64:345–357.https://doi.org/10.1016/S0040-5809(03)00095-9
-
Species ages in neutral biodiversity modelsTheoretical Population Biology 93:85–94.https://doi.org/10.1016/j.tpb.2014.02.002
-
Fluctuating selection in the moranGenetics 205:1271–1283.https://doi.org/10.1534/genetics.116.192914
-
How to quantify the temporal storage effect using simulations instead of mathEcology Letters 19:1333–1342.https://doi.org/10.1111/ele.12672
-
Metagenomic and small-subunit rRNA analyses reveal the genetic diversity of bacteria, archaea, fungi, and viruses in soilApplied and Environmental Microbiology 73:7059–7066.https://doi.org/10.1128/AEM.00358-07
-
Emergent neutralityTrends in Ecology & Evolution 21:531–533.https://doi.org/10.1016/j.tree.2006.08.003
-
BookThe Unified Neutral Theory of Biodiversity and Biogeography, Monographs in Population BiologyPrinceton University Press.
-
Effects of productivity and disturbance on species richness: a neutral modelThe American Naturalist 167:939–946.https://doi.org/10.1086/504602
-
Niche versus neutrality: a dynamical analysisThe American Naturalist 184:439–446.https://doi.org/10.1086/677930
-
Generalized model of island biodiversityPhysical Review E 91:042705.https://doi.org/10.1103/PhysRevE.91.042705
-
Interaction network structures in competitive ecosystemsPhysical Review. E 111:034408.https://doi.org/10.1103/PhysRevE.111.034408
-
Neutral theory: a historical perspectiveJournal of Evolutionary Biology 20:2075–2091.https://doi.org/10.1111/j.1420-9101.2007.01410.x
-
Species synchrony and its drivers: neutral and nonneutral community dynamics in fluctuating environmentsThe American Naturalist 172:E48–E66.https://doi.org/10.1086/589746
-
Local and collective transitions in sparsely-interacting ecological communitiesPLOS Computational Biology 18:e1010274.https://doi.org/10.1371/journal.pcbi.1010274
-
Universal features of surname distribution in a subsample of a growing populationJournal of Theoretical Biology 262:245–256.https://doi.org/10.1016/j.jtbi.2009.09.022
-
The neutral theory of biodiversity: do the numbers add up?Functional Ecology 19:173–176.https://doi.org/10.1111/j.0269-8463.2005.00922.x
-
How temporal environmental stochasticity affects species richness: Destabilization, neutralization and the storage effectJournal of Theoretical Biology 539:111053.https://doi.org/10.1016/j.jtbi.2022.111053
-
The unified neutral theory of biodiversity and biogeography at age tenTrends in Ecology & Evolution 26:340–348.https://doi.org/10.1016/j.tree.2011.03.024
-
Ubiquitous abundance distribution of non-dominant plankton across the global oceanNature Ecology & Evolution 2:1243–1249.https://doi.org/10.1038/s41559-018-0587-2
-
BookResource Competition and Community StructurePrinceton University Press.https://doi.org/10.2307/j.ctvx5wb72
-
Emergent neutrality leads to multimodal species abundance distributionsNature Communications 3:663.https://doi.org/10.1038/ncomms1663
-
The relationship between productivity and species richnessAnnual Review of Ecology and Systematics 30:257–300.https://doi.org/10.1146/annurev.ecolsys.30.1.257
Article and author information
Author details
Funding
Israeli Ministry of Innovation, Science and Technology (Israel-Italy Cooperation Program)
- Nadav M Shnerb
Israel Science Foundation (1614/21)
- Nadav M Shnerb
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Emil Mallmin and Egbert van Nes for the interesting exchange of ideas that contributed to the shaping of this work. NMS acknowledges funding from the Israeli Ministry of Innovation, Science and Technology (MOST), under the framework of the Israel–Italy Cooperation Program. DAK acknowledges funding from the Israel Science Foundation, Grant 1614/21.
Copyright
© 2025, Kessler and Shnerb
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 765
- views
-
- 34
- downloads
-
- 0
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.