Can Hamilton’s rule be violated?

  1. Matthijs van Veelen  Is a corresponding author
  1. University of Amsterdam, The Netherlands

Abstract

How generally Hamilton’s rule holds is a much debated question. The answer to that question depends on how costs and benefits are defined. When using the regression method to define costs and benefits, there is no scope for violations of Hamilton’s rule. We introduce a general model for assortative group compositions to show that, when using the counterfactual method for computing costs and benefits, there is room for violations. The model also shows that there are limitations to observing violations in equilibrium, as the discrepancies between Hamilton’s rule and the direction of selection may imply that selection will take the population out of the region of disagreement, precluding observations of violations in equilibrium. Given what it takes to create a violation, empirical tests of Hamilton’s rule, both in and out of equilibrium, require the use of statistical models that allow for identifying non-linearities in the fitness function.

https://doi.org/10.7554/eLife.41901.001

Introduction

Hamilton’s rule (Hamilton, 1964a; Hamilton, 1964b) states that pro-social, altruistic behaviour will be selected for if rb>c, where b are the benefits to the recipient, c the costs to the donor, and r is the relatedness between them. There is however no consensus concerning how generally this rule applies. Some claim that Hamilton’s rule is completely general (Abbot et al., 2011). Others claim that is almost always wrong (Nowak et al., 2010). Recently it has been suggested that the reason why there is disagreement about the generality of Hamilton’s rule, is that different participants in the debate have different definitions of costs and benefits (Birch, 2014; Birch and Okasha, 2015; van Veelen et al., 2017). Some define costs and benefits using the regression method (Gardner et al., 2011; Marshall, 2011). With this definition, Hamilton’s rule is claimed to always hold, and this version of Hamilton’s rule therefore is also referred to as the general version of Hamilton’s rule, or HRG (Birch, 2014). Others use the counterfactual method to determine costs and benefits (Karlin and Matessi, 1983; Matessi and Karlin, 1984; Matessi and Karlin, 1986; van Veelen et al., 2017). With this definition, Hamilton’s rule is claimed to hold only if the interaction is characterized by ‘generalized equal gains from switching’, or, in other words, if the fitness effects of one individual changing from defection to cooperation are independent of the behaviour of the others, including the recipient (van Veelen et al., 2017).

In what follows, we will consider both definitions, and explore the scope for violations. With the regression method, we will see that there is an identification problem; there are cases in which there are actually multiple linear specifications, leading to multiple Hamilton’s rules, all of which hold. Hamilton’s rule, using the regression method, therefore is not necessarily uniquely defined. For every given specification, however, Hamilton’s rule cannot be violated. This is a short summary of a point made in Section 4 of van Veelen et al., 2017.

In the main part of the paper, we will present a general model of assortative group compositions, which we combine with the counterfactual method for computing costs and benefits. For this model, we define population structure profiles, which reflect the distribution of group compositions that the population structure puts typical mutants in. In combination with the shape of the fitness function, these population structure profiles determine whether invading co-operators, or invading defectors, have a selective advantage. We will find that this allows for violations of Hamilton’s rule. Part of the reason why these violations can occur, is that relatedness r in Hamilton’s rule is a one-dimensional measure for population structure, while the population structure profile that is relevant for the direction of selection is a richer description of population structure. Violations in equilibrium, however, may not always be possible, because selection can also take a population out of the region where Hamilton’s rule and the direction of selection disagree. This happens, for instance, in examples with synergies.

In the final section, we discuss implications for empirical tests of Hamilton’s rule. The empirical literature is regularly lacking a precise description of what violations would look like, or how to identify them in the data. Because the regression method does not allow for violations, an empirical test of Hamilton’s rule, using the regression method, is not a meaningful exercise. With the counterfactual method, violations are possible, although observing them either requires studying out-of-equilibrium dynamics, or studying systems that allow for in-equilibrium violations. In both cases non-linear statistical models should be allowed for.

The regression method

The regression method defines costs and benefits according to an ordinary least squares regression. The fitness of individuals is regressed on two or more variables. One of those variables is their own level of cooperation, which may be a binary value, in case there are only co-operators and defectors. We will denote this variable by xse – with se for self – and minus the regression coefficient of that variable is then defined as the cost of cooperation. The other variables are levels of cooperation for different types of interactants – such as, for instance, xsi for siblings and xco for cousins. The benefits of having a cooperative sibling then is the regression coefficient of xsi, and the benefits of having a cooperative cousin is the regression coefficient of xco. Many models and many empirical studies focus on one type of interaction – such as interactions between siblings only – but here we also want to discuss the issue of model specification, and therefore it will be useful to allow for the possibility that there are different types of interactions happening at the same time – as Hamilton did in the original paper (Hamilton, 1964a; Hamilton, 1964b). This allows us to consider different specifications. In what follows, we will think of an example in which both siblings and cousins may have an effect, where roman numeral I refers to a linear specification that includes siblings only, and II to a linear specification that includes both siblings and cousins.

The relatedness between siblings in this version of Hamilton’s rule is the covariance of xse and xsi, divided by the variance of xse, and the relatedness between cousins is defined in the same way. With this definition of costs, benefits and relatedness, Hamilton’s rule always holds, but it is important to realize that it does so regardless of the linear specification that is chosen (van Veelen et al., 2017). In our example, with siblings and cousins, that means that for any two time periods, be it in a model or in a dataset, the change in average cooperativeness Δx¯ equals both

Δx¯=rsibsi,IcI

and

Δx¯=rsibsi,II+rcobco,IIcII

The costs and benefits of cooperation carry and index I or II in the subscript, because the value of the regression coefficients may depend on the specification (see Figure 1). Not including cousins in the specification means that bco,I is set to 0. It is important to realize that Hamilton’s rule holding does not mean that the specification chosen accurately reflects the way in which fitness’s depend on whether one is a co-operator oneself, and on how many siblings and how many cousins are co-operators. Neither specification might represent the true fitness function, and still Hamilton’s rule will hold for both. Relatednesses here do not depend on the model specification (see Section 4 of van Veelen et al., 2017 for a formal derivation).

The value of coefficients βse and βsi may depend on the specification chosen.

If xco is included (as in specification II), these values will be different from when xco is not included (specification I). Including an interaction term (III) or a quadratic term (IV) will also make a difference for the value of βse and βsi. All specifications that are linear, result in Hamilton’s rules, all of which agree with the direction of selection. Hamilton’s rule with specification I says that rsibsi,IcI>0 if and only if Δx¯>0 – where bsi,I is the value of βsi, and cI is minus the value of βse in this specification. Hamilton’s rule with specification II says that rsibsi,II+rcobco,IIcII>0 if and only if Δx¯>0 – where bsi,II is the value of βsi, bco,II is the value of βco, and cII is minus the value of βse in this specification.

https://doi.org/10.7554/eLife.41901.002

Hamilton’s rule according to the regression method therefore is not necessarily uniquely defined; only if it happens to be the case that bco,II=0 do both versions coincide in this example. To make it uniquely defined, the regression method would need to be combined with a way to choose between specifications – and with data, applying statistical tests seems to be a natural way to do that. Such a way to choose should then also be applied, not just when choosing between linear specifications, but also when choosing between linear and non-linear ones, and between different non-linear ones. Hamilton’s rule according to the regression method therefore cannot both be uniquely defined, and fully general, because having it well-defined would imply that in some cases non-linear specifications would have to be chosen, while Hamilton’s rule being general crucially depends on the specification being linear. But even if Hamilton’s rule is not always uniquely defined, it still holds for any given linear specification. Whichever linear specification is chosen, this should therefore never lead to a violation.

The counterfactual method, applied to a general model of assortment in groups of equal size

With the counterfactual method, the cost of cooperation is defined as the difference between an individual’s fitness if it defects, and its fitness if it cooperates. Similarly, the benefits to another individual are defined as the difference cooperation makes for that other individual’s fitness. In the relatively simple setup considered here, we assume that individuals interact within groups of size n, which implies that a model of dyadic interactions would mean n=2. Their fitnesses will depend on the number of co-operators in their interaction group, and on whether they are a co-operator or a defector themselves; πC(i) is the fitness of a co-operator in a group that contains i co-operators, including the individual itself, and πD(i) is the fitness of a defector in a group that contains i co-operators. The cost of cooperation an individual faces, as well as the benefits cooperation confers on the others, thereby may also depend on what the rest of the group it finds itself in consists of.

A population structure here is a function that represents how the composition of the population depends on the overall frequency p of co-operators; fi(p) is the fraction of groups with i co-operators in it, at overall frequency p. These have to be defined consistently, so that these frequencies always add up to one (i=0nfi(p)=1), and so that p is indeed the overall frequency of co-operators (i=0ninfi(p)=p). The cost of cooperation in a population is now the average cost, given the distribution of group types, and these may very well vary with p.

The counterfactual method dates back to Karlin and Matessi, 1983, Matessi and Karlin, 1984, and Matessi and Karlin, 1986, who in their evaluation of whether or not Hamilton’s rule holds moreover did not allow for costs to vary with p. We do allow for costs and benefits to depend on p. Section 3 in van Veelen et al., 2017 also discusses some additional differences between the original definition and the one used here.

Selection

In order to answer the question whether or not mutant co-operators will be able to invade a population of defectors, one would have to consider the type of group the average mutant co-operator would find itself in, given the population structure. The probability that a mutant co-operator finds itself in a group with in total i co-operators is

u_i=limp0infi(p)p,i=0,...,n

The vector u_, with elements as defined above, could be called the “population structure profile” at p=0. Its counterpart u¯ at p=1 will be defined in the same way:

u¯i=limp1ninfi(p)1p,i=0,...,n

Co-operators can invade defectors if their average fitness at p=0 is larger than the average fitness of defectors, who at p=0 only find themselves in groups with defectors only, for any population structure.

(1) i=1n u_iπC(i)>πD(0)

Defectors on the other hand can invade co-operators if their average fitness at p=1 is larger than the average fitness of co-operators, who at p=1 only find themselves in groups with co-operators only.

(2) i=0n1 u¯iπD(i)>πC(n)

Hamilton’s rule

Hamilton’s rule says that cooperation will be selected for if rb>c. We will rewrite this, at p=0 and at p=1, so as to get inequalities that look more like Equations 1 and 2. Relatedness r measures how much more likely co-operators are to be matched with other co-operators, compared to how likely defectors are to be matched with co-operators; r=P(C|C)P(C|D). In the limit of p0, the share of defectors that is matched with co-operators goes to 0, whatever the population structure. With population structure, the average mutant co-operator however might encounter fellow mutant co-operators. This therefore reduces to r=P(C|C), which one can rewrite as r=i=0n1u_ii1n1. With the counterfactual method, aggregate benefits at p=0 are (n1)[ πD(1)πD(0) ], while costs are πD(0)πC(1). With those, one can rewrite Hamilton’s rule at p=0 as follows (see Appendix 1 for more details):

(3) i=1n u_i{πC(1)+(i1)[πD(1)πD(0)]}>πD(0)

Comparing the equation that indicates when cooperation is selected for (Equation 1) and the one for Hamilton’s rule (Equation 3), we first of all find that they are one and the same equation if the fitness function satisfies πC(i)=πC(1)+(i1)[ πD(1)πD(0) ]. In this case, every additional co-operator increases the payoff of a fellow co-operator by just as much as the first co-operator increased the payoff of the defectors in an otherwise all-defector group. Hamilton’s rule will then hold at p=0 for any population structure profile u_.

If the fitness function satisfies πC(i)πC(1)+(i1)[ πD(1)πD(0) ] for all i=1,...,n, then Hamilton’s rule can be violated at p=0. Many cases with synergies would fall under this category. In this case Hamilton’s rule can, however, still not be violated by a population that is in equilibrium at p=0. If cooperation is selected against at p=0, then that by definition means that Equation 1 does not hold. The left hand side of Equation 3 now is even smaller than the left hand side of Equation 1, so if Equation 1 does not hold, and co-operators are selected against at p=0, also Equation 3 does not hold, and rb<c. This implies that there is no violation. If, on the other hand, cooperation is selected for at p=0, then, by definition, Equation 1 does hold. Now it is possible that Equation 3 does not hold, and rb<0, but since cooperation is selected for, the population moves away from p=0, and therefore it moves away from where the violation is. Therefore the violation at p=0 cannot be observed in equilibrium.

At the other end, where p=1, Hamilton’s rule can be rewritten in a similar way. Here, rb<c if

(4) i=0n1 u¯i{πD(n1)(ni1)[πC(n)πC(n1)]}>πC(n)

Here, Equation 2 and Equation 4 are one and the same equation if the fitness function satisfies πD(i)=πD(n1)(ni1)[ πC(n)πC(n1) ]. In this case, every additional defector decreases the payoff of a fellow defector by just as much as the first defector did to the co-operators in an otherwise all-co-operator group. If this is true, then Hamilton’s rule will hold at p=1 for any population structure profile u¯.

If the fitness function satisfies πD(i)πD(n1)(ni1)[ πC(n)πC(n1) ] for all i=0,...,n1, then Hamilton’s rule can be violated at p=1, but, again, not in equilibrium. If defection is selected against at p=1, then Equation 2 by definition does not hold. Under the condition on the fitness function, the left hand side of Equation 4 is now even smaller than the left hand side of Equation 2, so if defectors are selected against at p=1, then also Equation 4 does not hold, and rb>c. This, again, implies that there is no violation. If, on the other hand, defection is selected for at p=1, there can be a violation, but this cannot be observed in equilibrium, because defectors being selected for means that the population actually moves away from where the violation is.

So far we have an inequality that prevents violations in equilibrium at p=0, and another one that prevents violations at p=1. Both concern only the fitness function. If, on top of that, the population structure and the fitness function combined imply that the difference in fitness between co-operators and defectors increases in p, then the system does not allow for any violations in equilibrium. The reason is that the latter condition would imply that there simply are no stable interior equilibria. Many systems with synergies will satisfy all three conditions, and therefore preclude in-equilibrium violations of Hamilton’s rule. Systems with anti-synergies are much more conducive to violations in equilibrium, especially in mixed equilibria, in which co-operators and defectors coexist. Both Figures 2 and 3 illustrate that.

Within each panel, the fitness functions are depicted in the upper part.

In panels A, B and C the bottom part depicts population structure profiles of mutant co-operators at p=0 (blue) and of mutant defectors at p=1 (red). In panel D the bottom part depicts the distribution of what group types co-operators (blue) and defectors (red) find themselves in, both at the same intermediate equilibrium value for p. No violations of Hamilton’s rule with equal gains from switching. In panels A and B, the fitness function is πC(i)=0.6+2(i/n) and πD(i)=1+2(i/n). In panel A the difference in average fitness between co-operators and defectors is π¯Cπ¯D=0.128, both at p=0 and at p=1. Cooperation therefore is selected against at both ends. Inclusive fitness is also 0.128 at both ends. Panel B has a more assorted population structure, for which this difference, as well as inclusive fitness, is +0.16 at both ends, and cooperation is selected for. No violations in equilibrium with synergies. Panel C has the same population structure profiles as panel B, but a different fitness function: πC(i)=0.5+2(i/n)2 and πD(i)=1+2(i/n)2. Here cooperation is selected against at p=0, where π¯Cπ¯D=0.33, and selected for at p=1, where π¯Cπ¯D=+0.45. Inclusive fitness is 0.48 at p=0 and +0.6 at p=1. Violation in a mixed equilibrium. In panel D, the fitness function is πC(i)=0.5+2(i/n)0.5 and πD(i)=1+2(i/n)0.5. Here, π¯Cπ¯D=0 at p=0.473 – which makes it an equilibrium – while inclusive fitness is 0.1130. Details are in Appendix 1, as are computations of inclusive fitness with costs and benefits according to the regression method instead of the counterfactual method.

https://doi.org/10.7554/eLife.41901.003
Dynamics for two 2-player games.

Every point in the simplex represents a population state (f0,f1,f2). The left down corner is (1,0,0), which has only groups with 0 co-operators; the right down corner is (0,0,1), which has only groups with 2 co-operators; the top corner is (0,1,0), which has only groups with 1 co-operator. The grey lines represent different population structures, all with constant relatedness. Any given grey line gives a population state for every overall frequency p of co-operators. Dynamics make populations move along the line that represents the population structure it faces. All grey lines go through the left down corner, where p=0, and the right down corner, where p=1. The straight line on the bottom reflects a totally assorted population that has no mixed groups. The higher up, the more mixed groups there are, and the less assortment there is. The highest up grey line represents a well-mixed population. No violations of Hamilton’s rule in equilibrium with synergies. In panel A, πC(1)=0.1, πC(2)=3, πD(0)=2 and πD(1)=3.1. The regions where cooperation is selected for (green), and where inclusive fitness is positive (blue) are not the same, but selection always takes populations out of the parts where they disagree. Violations with anti-synergies. In panel B πC(1)=1.9, πC(2)=3, πD(0)=2 and πD(1)=4.9. Here populations can settle at mixed equilibria, while inclusive fitness is not 0. Violations at p=0 and p=1 are also possible for more extreme choices of r.

https://doi.org/10.7554/eLife.41901.004

The fitness function used in panels A and B of Figure 2 is linear in the number of co-operators in the group. This makes Equation 1 and Equation 3 coincide, as well as Equation 2 and Equation 4. With the quadratic fitness function in panel C, both πC(i)πC(1)+(i1)[ πD(1)πD(0) ] and πD(i)πD(n1)(ni1)[ πC(n)πC(n1) ] hold, which implies that there can be no violation in equilibrium, either at p=0 or at p=1. This fitness function would be unambiguously synergistic; benefits from cooperation increase, and costs decrease with i. Combined with a simple population structure, elaborated on in Appendix 1, π¯C(p)π¯D(p) moreover increases in p, precluding any in-equilibrium violation. Panel D gives an example of a fitness function with anti-synergies, where cooperation is selected for at p=0, and selected against at p=1, and where there is an equilibrium frequency of co-operators in between 0 and 1. At that equilibrium p, inclusive fitness is not 0, which makes Hamilton’s rule disagree with the direction of selection.

Games with 2 players and 2 actions are naturally subsumed under this framework, and they allow for whole trajectories to be depicted (Figure 3). A natural way to define population structures with 2 players and constant relatedness r would be to choose f0(p)=(1r)(1p)2+r(1p); f1(p)=(1r)2p(1p); and f2(p)=(1r)p2+rp. In this case u_=[0,1r,r] – implying that a mutant co-operator never finds itself in a group with 2 defectors, obviously; faces a defector with probability 1r; and another co-operator with probability r – and u¯=[r,1r,0]. This is combined with two prisoners dilemma’s; one with synergies for panel A:

CDC30.1D3.12

and one with the opposite for panel B:

CDC31.9D4.92

In the first one, selection always takes the population out of the region where inclusive fitness disagrees with the direction of selection. In the second one there are mixed equilibria, where neither co-operators or defectors are selected for, while inclusive fitness is not 0.

A similar point is made with Figures 30 and 31 in van Veelen et al. (2017). The conclusion there – that there is ‘no scope for finding violations in equilibria where either one has gone to fixation’ – is too strong though; with anti-synergies, violations at p=0 and p=1 are possible.

Whether or not Hamilton’s rule will hold, with costs and benefits defined according to the counterfactual method, depends on the combination of fitness function and population structure. How often we should expect Hamilton’s rule to hold therefore depends on what we think the distribution of fitness functions and population structures is. Whether reasonable assumptions concerning these distributions lead to many or not so many violations of Hamilton’s rule is an interesting question for further research that we do not pursue here.

Implications for empirical tests of Hamilton’s rule

There is a number of studies that explicitly set out to test Hamilton’s rule empirically. A recent survey by Bourke (2014) includes Bourke (1997); Emlen and Wrege (1989); Gadagkar (2010); Hogendoorn and Leys (1993); Krakauer (2005); Loeb (2003); Metcalf and Whitt (1977); Nonacs and Reeve (1995); Noonan (1981); Pfennig et al. (1999); Queller and Strassmann (1988); Richards et al. (2005) and Stark (1992). These studies typically consider a behaviour that is present, and therefore presumably selected for, estimate its benefits and costs by linear regression, estimate relatedness, and decide that Hamilton’s rule holds if rb>c, and is violated if rb<0, where the r, b and c now refer to the estimated values of relatedness, costs and benefits. Although intuitively appealing, it is worth realizing that this does not constitute a test of either of the two versions of Hamilton’s rule – where it should be noted that these empirical studies were done before it was even recognized that there are different ways to define costs and benefits to begin with.

If we think of Hamilton’s rule with costs and benefits defined according to the regression method, then we have seen that this version of Hamilton’s rule will hold for any linear specification, applied to any thinkable way in which fitnesses in reality could depend on the behaviour of individuals themselves, and on the behaviour of those they interact with. In other words, if we were to treat Hamilton’s rule being valid as the hypothesis, then the hypothesis covers everything, and the null hypothesis is void, as no true way in which fitness would be determined by the behaviour of self and others would go with Hamilton’s rule not holding (see also Nowak et al., 2017). This would also inevitably hamper a good statistical analysis, because, given that there is no true model for which Hamilton’s rule does not hold, there is no meaningful way to define the distribution of inclusive fitnesses (values of rbc) under the null hypothesis, which one then would want to use to test if rbc really is larger than 0.

On the other hand, if we think of Hamilton’s rule with costs and benefits defined according to the counterfactual method, then estimating costs and benefits in a linear model without considering the possibility of non-linearities would not allow us to uncover violations, because those, as we have seen, require the fitnesses to be non-linear. One solid way to decide that Hamilton’s rule is not violated would be to allow for a non-linear model, and reject all non-linearities, in favour of a linear model. That, however, is not what these papers do.

Our observations therefore first of all imply that meaningful empirical tests would have to consider the version of Hamilton’s rule that uses the counterfactual method for computing costs and benefits, and that they should use statistical models that allow for non-linearities. Our observations moreover indicate where to look for violations, and where not to look, as there is a variety of settings in which violations are not expected. First of all, one should look at systems where how much being a co-operator instead of a defector contributes to the fitness of others, and takes away from the fitness of oneself, depends on what the others do. Moreover, if we consider a system that is in equilibrium, we would not observe violations if the three 'synergy-conditions’ are satisfied, while systems that (also) have anti-synergies do allow for in-equilibrium violations (see Figure 4). The presence of polymorphisms, where co-operators and defectors coexist, can be a good indication that such anti-synergies are present.

A road map for empirical tests of Hamilton’s rule.

The three synergy conditions are that πC(i)πC(1)+(i1)[ πD(1)πD(0) ] for all i=1,...,n, that πD(i)πD(n1)(ni1)[ πC(n)πC(n1) ] for all i=0,...,n1, and that π¯C(p)π¯D(p) increases with p.

https://doi.org/10.7554/eLife.41901.005

Distinct types

We would also not expect violations in cases where the level of help is a continuous trait, the fitness function is smooth, and where the levels of cooperation across individuals are relatively homogeneous, making fitness effects approximately linear. In models with continuous levels of help, populations can then settle at an equilibrium value of cooperation, where Hamilton’s rule is satisfied, provided that there are no branching events (see Section 6 in van Veelen et al., 2017). What is needed for violations, therefore, is that there are distinct types; co-operators and defectors. Some behaviours or properties are binary by nature; one either jumps into a river in an effort to save someone, or not. Also eating a fellow brood member is an all or nothing trait (Pfennig et al., 1999). When the level of cooperation is a continuous trait, one can however also get distinct types to evolve after a branching event (Doebeli et al., 2004). Notice that also at a singular point where the system branches, Hamilton’s rule, which predicts no change, does not agree with what happens (Doebeli and Hauert, 2006).

Spurious violations

When b and c are estimated linearly, we should not expect violations of Hamilton’s rule. This makes it all the more surprising that 4 out of the 12 explicit tests of Hamilton’s rule, surveyed in (Bourke, 2014), all of which estimate costs and benefits with a linear model, do find apparent violations. A natural question to ask is where those violations come from. One prime candidate has to do with the fact that the result that Hamilton’s rule always holds, if costs and benefits are defined using the regression method, depends on using the cooperativenesses of the individuals involved, not just for computing costs and benefits, but also in the formula for relatedness. The relatedness between siblings, for instance, in this version of Hamilton’s rule, would be cov(xse,xsi)/var(xse), where xse refers to the cooperativeness of self and xsi to the cooperativeness of the sibling. Here it is good to notice that if these variables refer to data, this is best described, not as relatedness itself, but as an estimator of relatedness. If a different estimator of relatedness is used, for instance based on gene sequencing, then that would include genes for traits other than cooperative behaviour. The difference between these two estimators can make for a violation. The probability of this happening decreases as sample size increases. For all sample sizes, large and small, Hamilton’s rule, using cov(xse,xsi)/var(xse) for relatedness, will hold. With small samples, costs, benefits, and relatedness may all vary quite a bit – although only in concert, because Hamilton’s rule will still have to hold – and with cov(xse,xsi)/var(xse) possibly being far away from the true relatedness, the discrepancy between it and another estimator for relatedness might be large enough to create an apparent violation of Hamilton’s rule. Other reasons for finding violations when estimating costs and benefits linearly are also possible (see Section 8 of van Veelen et al., 2017), and all of them are spurious.

Smith et al., 2010

In order to be able to find violations of Hamilton’s rule, with benefits and costs defined according to the counterfactual method, one must allow for a non-linear statistical model. The study that comes closest to that ideal is Smith et al., 2010 (see also Chuang et al., 2009; Chuang et al., 2010). This experiment does a non-linear estimation of sporulation efficiency of Myxococcus xanthus, resulting in fitness functions that would imply that, already in a well-mixed population, co-operators can invade defectors, and defectors can invade co-operators. Combined with a range of population structures, this would make a population settle at mixed overall frequencies of co-operators. This study however also has a few conceptual imperfections. Most of the non-linearity it picks up, results from considering Wrightian fitness’s (numbers of offspring) rather than Malthusian fitness’s (growth rates); see Wu et al. (2013). For small fitness effects that would not matter too much, but the aggregate fitness effects are not small here. Another drawback is that the experiment does not include an independent observation of a population structure. For the experiment, a combination of group compositions is chosen. The growth rates at these different group compositions are used to estimate the fitness function – which it is perfect for. The group compositions themselves, as chosen by the experimenter, are also the sole input for calculations characterizing population structure, which makes it not a proper empirical observation of a population structure. In spite of these drawbacks, this study is the closest to a proper empirical test of Hamilton’s rule.

Polymorphisms

While systems of microorganisms with mixed equilibria seem good candidates, one will have to be careful with identifying the reasons for polymorphisms. In systems where one type can invade the other, and vice versa, already in a well-mixed population (Smith et al., 2010; MacLean and Gudelj, 2006; MacLean et al., 2010; Gore et al., 2009), the reason for stable coexistence may have nothing to do with population structure. If fitness is moreover maximized at intermediate mixtures, it also hard to unambiguously qualify one strain as cooperative and the other as defecting (MacLean et al., 2010). Systems like this might nonetheless point to possible candidates, if there is in fact structure in the population. With microorganisms, one would then naturally want to switch from counting discrete numbers of co-operators to a continuous variable for group compositions, measuring the within group frequency of co-operators. Appendix 1 provides a continuous version that allows for all the equivalent computations needed to establish whether or not Hamilton’s rule is violated empirically.

Wang and Lu, 2018

A study that does look at polymorphisms is Wang and Lu (2018). In this study, players have one of two different roles; there are breeding pairs, which are the potential recipients of help, and potential helpers. This implies that there is no room for the strategic interaction that could create the non-linearities needed for possible violations; costs and benefits of helping at the nest cannot depend on the recipient type, because the recipient is not facing the same choice. Also in this study, therefore, there is no scope for violations of Hamilton’s rule.

Appendix 1

I. Introduction

If one would want to test the validity of Hamilton’s rule empirically, it would be essential to know if Hamilton’s rule can be violated at all, and if it can, it would be essential to know what violations would look like. Whether or not violations are theoretically possible depends on how costs and benefits are defined. Violations are not possible if the costs and benefits in Hamilton’s rule are defined according to the "regression method". In that case there can only be spurious reasons for finding social behaviour that is selected for, while the data would seem to suggest that br<c, or vice versa. The version of Hamilton’s rule that uses the regression method is also referred to as the general version of Hamilton’s rule, or HRG; see Birch (2014).

If costs and benefits are defined according to the "counterfactual method", violations are possible. This is the method we will use here, for a variety of reasons. One is that is seems true to the original idea to define for instance the costs of a social act as the difference between an individual’s fitness if it performs the social act, and its fitness if does not. A reason not to use the regression method is also that this method is incomplete, and as such not well-defined; it ignores the issue of model specification, and therefore there are cases where different specifications would result in different Hamilton’s rules, with different values for costs and benefits; see the main text and Section 4 of van Veelen et al. (2017). While the version of Hamilton’s rule that uses the regression method is also referred to as HRG by Birch, 2014, the version of Hamilton’s rule that uses the counterfactual method is not what Birch, 2014 calls the special version of Hamilton’s rule, of HRS. See Section 9 of van Veelen et al., 2017 for details.

Although the counterfactual method allows for violations, it off course also allows for non-violations. If the interaction is characterized by ‘equal gains from switching’ then violations should not occur. Equal gains from switching means that the fitness effects (the costs and benefits) of the social behaviour are independent of who else contributes, and also independent of whether or not the recipient performs the behaviour. With equal gains from switching, the costs and benefits therefore are also independent of the current share of co-operators in the population. Violations are only possible if the interaction does not have equal gains from switching, and in that case costs and benefits will vary with the current frequency of co-operators.

The fact that cost and benefits are frequency-dependent in those cases can make it harder to derive claims that hold for all frequencies. We will therefore begin by focusing on two specific frequencies: p=0 and p=1. At, or close to those frequencies, we will compare the direction of selection – which here will indicate whether or not one strategy can invade the other, and vice versa – with the value of rbc at those frequencies. For that, it will be useful to define a "population structure profile" at p=0, and one at p=1. This will be useful for rewriting both inclusive fitness and the direction of selection, and for comparing these to each other. Later on, when looking at cases with equilibrium mixtures of co-operators and defectors, we will also consider frequencies p in between 0 and 1, and revisit this more generally.

II. Relatedness at the edges

A. Close to p=0

Performing a cooperative act is assumed to be costly. Not all cooperative acts are costly, because there are also mutualistic forms of cooperation, but in this context, we will mostly focus on costly cooperation, hence the assumption. The benefits of being a co-operator – benefits that may or may not outweigh the costs – we assume comes from the structure in the population. This structure might make co-operators also be on the receiving end more often, as they might be matched with co-operators more often than defectors are. This difference is captured by relatedness. Relatedness is defined as the difference in probabilities (between a co-operator and a defector) of being matched with a co-operator: P(C|C)P(C|D). Both of these conditional probabilities will typically depend on the current overall frequency of co-operators, denoted by p, but for a variety of population structures, the difference between them will not depend on p.

In order to compute that difference, we think of a simple chance experiment. First draw an individual from the population, with every individual being equally likely to be drawn. Then randomly select a partner. In our case, we will use a simple setup, where individuals live in groups of equal size. In this case, the second draw simply returns to the group that the first draw happened to come from, and draws a random other group member, with all (other) group members having equal probability of being drawn.

In this setup with groups of equal size, a population structure is defined by functions fi(p), i=0,...,n, that specify the frequency of groups with i co-operators and ni defectors in it, at an overall frequency p of co-operators. Using this notation, and Bayes' rule, the difference in conditional probabilities can be written as

r(p)=P(C|C)P(C|D)=i=0n ini1n1fi(p)i=0n infi(p)i=0n ninin1fi(p)i=0n ninfi(p)

Close to p=0, the second term on the right hand side goes to 0, because if there are almost no co-operators around, the chance that a random defector runs into a co-operator must go to 0. In other words, the enumerator goes to 0, because

limp0fi(p)={0ifi>01ifi=0

and because f0(p) is multiplied by 0n1. These limits for p0 follow from the fact that i=0n infi(p)=p; this implies that infi(p)<p for each i>0, and hence fi(p)<nip. Therefore limp0fi(p)=0 for i>0, and since i=0n fi(p)=1, moreover limp0f0(p)=1.

The denominator goes to 1 because

limp0i=0n ninfi(p)=limp0(1p)=1

Therefore we can write

limp0r(p)=limp0P(C|C)=limp0i=0n ini1n1fi(p)i=0n infi(p)=limp0i=0n ini1n1fi(p)p

While relatedness is a one-dimensional measure that characterizes a population state, or a population structure to some extent, a richer measure will be useful too. This measure captures how likely co-operators are to find themselves in groups of different types at low frequencies p.

u_i=limp0infi(p)j=0n jnfj(p)=limp0infi(p)p,i=0,...,n

With this definition, u_i is the share of mutant co-operators that find themselves in a group with i co-operators. Relatedness then becomes the inner product of a vector u_ with u_i as its ith element, and a vector with i1n1 as its ith element:

limp0r(p)=i=0n u_ii1n1=i=2n u_ii1n1

The vector u_ could be labelled the ‘population structure profile’ in the limit of p0, and it is clear that there is typically a variety of profiles u_ that produces one and the same relatedness.

B. Close to p=1

Close to p=1, it is easier to use the equivalent definition of relatedness, reversing the roles of co-operators and defectors:

r(p)=P(D|D)P(D|C)=i=0n ninni1n1fi(p)i=0n ninfi(p)i=0n innin1fi(p)i=0n infi(p)

The second term on the right hand side goes to 0 again; the enumerator goes to 0, because

limp1fi(p)={0ifi<n1ifi=n

and because fn(p) is multiplied by 0n1, while the denominator goes to 1 because

limp1i=0n infi(p)=limp1p=1

Therefore we can write

limp1r(p)=limp1P(D|D)=limp1i=0n ninni1n1fi(p)i=0n ninfi(p)=limp1i=0n ninni1n1fi(p)1p

We can furthermore define a measure that captures how likely defectors are to find themselves in groups of different types at low frequencies 1p of defectors (which means high frequencies p of co-operators).

u¯i=limp1ninfi(p)j=0n njnfj(p)=limp1ninfi(p)1p,i=0,...,n

Here u¯i is the share of mutant defectors that finds itself in a group with i co-operators. In many models it would be reasonable to assume that mutant defectors face similar numbers of fellow defectors in their group as mutant co-operators face fellow co-operators. If they do, the population structure profiles at p=0 and p=1 would be each other’s mirror images: u_i=u¯ni. Relatedness at p=1 again becomes the inner product of a vector u¯ with u¯i as its ith element, and a vector with ni1n1 as its ith element.

limp1r(p)=i=0n u¯ini1n1=i=0n2 u¯ini1n1

If indeed u_i=u¯ni, then limp1r(p)=limp0r(p).

These population structure profiles, u_ at p=0 and u¯ at p=1, will be useful for rewriting when cooperation can invade defection (p=0), and when defection can invade cooperation (p=1), as well as when inclusive fitness is positive or negative at these two frequencies.

Appendix 1—figure 1
Population structure profiles u_ (blue) for co-operator invaders at p0, and u¯ (red) for defector invaders at p1.

Defectors at p0 only find themselves in groups with 0 defectors, co-operators at p1 only find themselves in groups with n co-operators (not depicted in the figures). In the lower panel mutants assort more than in the upper one, and random matching would result in a population structure profile u¯ with single spike at 1, and a single spike at n1 for u¯. Section IX describes the population structures that result in these population structure profiles. For this population structure u_i=u¯ni is satisfied, which means that the red bars are the mirror image of the blue ones.

https://doi.org/10.7554/eLife.41901.008

III. When cooperation/defection can/cannot invade

A. Close to p=0

Mutant C’s can invade a resident D if they have higher fitness close to p=0:

limp0π¯C>limp0π¯D

The game between co-operators and defectors is defined by πC(i) for co-operators and πD(i) for defectors that determine the payoff they get as a function of the number of co-operators in the group they are in (for co-operators: including themselves). We assume a dynamic that linearly translates payoffs into fitness, like the replicator dynamics. This allows us to use payoffs and fitness interchangeably; see van Veelen, 2011.

In the limit of p0, all defectors find themselves in groups with other defectors only, whatever the population structure is, which makes limp0π¯D=πD(0). The condition for a C invader to do better than a D resident then becomes:

limp0i=1n infi(p)πC(i)i=1n infi(p)>πD(0)

With the shorthand notation introduced in Section II, this can be written as:

i=1n u_iπC(i)>πD(0)

where u_i is the share of mutant co-operators that find themselves in groups that contain i co-operators.

B. Close to p=1

Mutant D’s cannot invade a resident C if the resident has higher fitness at p=1:

limp1π¯C>limp1π¯D

In the limit of p1, all co-operators find themselves in groups with only co-operators, which makes limp1π¯C=πC(n). The condition for C to drive out D invaders then becomes:

πC(n)>limp1i=0n1 ninfi(p)πD(i)i=0n1 ninfi(p)

With the shorthand notation introduced above, this can be written as:

πC(n)>i=0n1 u¯iπD(i)

where u¯i is the share of mutant defectors that find themselves in groups that contain i co-operators.

IV. When inclusive fitness is positive/negative

A. Close to p=0

At full defection (p=0), inclusive fitness is positive if:

limp0r(p)b(p)>c(p)

The costs of cooperation at p=0 – according to the counterfactual method – are πD(0)πC(1)=(πC(1)πD(0)). This is minus the difference between the payoff a co-operator gets in a group where everyone else is a defector, and the payoff gets if it were a defector instead. The aggregate benefits are (n1)[ πD(1)πD(0) ], which is n1 times how much every defector in that group benefits from the agent being a co-operator instead of a defector. Inclusive fitness being positive at p=0 therefore can be rewritten as

limp0i=1n ini1n1fi(p)i=1n infi(p)(n1)[πD(1)πD(0)]>πD(0)πC(1)

With a little rewriting, this inequality becomes

πC(1)+limp0i=1n i(i1)fi(p)i=1n ifi(p)[πD(1)πD(0)]>πD(0)

With i=1n ifi(p)i=1n ifi(p)=1, this can be rewritten as:

limp0i=1n ifi(p){πC(1)+(i1)[πD(1)πD(0)]}i=1n ifi(p)>πD(0)

In shorthand notation, inclusive fitness at p=0 is positive if:

i=1n u_i{πC(1)+(i1)[πD(1)πD(0)]}>πD(0)

B. Close to p=1

At full cooperation (p=1), inclusive fitness is positive if:

limp1r(p)b(p)>c(p)

The costs of cooperation at p=1 – according to the counterfactual method – are πD(n1)πC(n)=(πC(n)πD(n1)). This is minus the difference between the payoff a co-operator gets in a group where everyone else is a co-operator too, and the payoff it gets if it were a defector instead. The aggregate benefits are (n1)[πC(n)πC(n1)], which is n1 times how much every other co-operator in that group benefits from the agent being a co-operator instead of a defector. Inclusive fitness being positive at p=0 therefore can be rewritten as

limp1i=0n1 ninni1n1fi(p)i=0n1 ninfi(p)(n1)[πC(n)πC(n1)]>πD(n1)πC(n)

With a little rewriting, this inequality becomes

πC(n)>πD(n1)limp1i=0n1 (ni)(ni1)fi(p)i=0n1 (ni)fi(p)[πC(n)πC(n1)]

With i=0n1 (ni)fi(p)i=0n1 (ni)fi(p)=1, this can be rewritten as:

πC(n)>limp1i=0n1 (ni)fi(p){πD(n1)(ni1)[πC(n)πC(n1)]}i=0n1 (ni)fi(p)

In shorthand notation, inclusive fitness at p=1 is positive if:

πC(n)>i=0n1 u¯i{πD(n1)(ni1)[πC(n)πC(n1)]}

V. (Not) observing violations in equilibrium

Now that we have the criteria, both at p=0 and at p=1, for co-operators to be selected for, as well as for inclusive fitness to be positive, we can compare them to each other, and find out what it takes to observe a violation.

At p=0, co-operators can invade if i=1n u_iπC(i)>πD(0). If we observe a population at p=0, and if we assume, or have reason to believe, that this population is in equilibrium, then that means that co-operators can apparently not invade at p=0, and the opposite is true:

(1) i=1nu_iπC(i)<πD(0)

Inclusive fitness at p=0 is negative if

(2) i=1n u_i{πC(1)+(i1)[πD(1)πD(0)]}<πD(0)

Now there is a variety of ways in which the left hand sides of these two equations can be different from each other, while they are still both smaller than the right hand side that they share. In that case inclusive fitness is not the right criterion, but we would still not observe a violation in equilibrium. This will most certainly be the case if each and every term in the second equation that replaces a πC(i)–term from the first one is smaller, making the left hand side of the second equation even smaller than the left hand side of the first. In other words, a sufficient condition for the left hand side of the second equation to be lower than, or at most equal to, the left hand side of the first, is that

(3) πC(1)+(i1)[ πD(1)πD(0) ]πC(i)

for all i1,...,n. This would then imply that

i=1n u_i{πC(1)+(i1)[πD(1)πD(0)]}i=1n u_iπC(i)<πD(0)

and therefore that inclusive fitness is certainly negative whenever cooperation is selected against. A πC and πD for which this is true thereby precludes observing a violation of Hamilton’s rule in equilibrium at p=0.

Observing violations in equilibrium at p=0 would require that at least for one i,

πC(1)+(i1)[ πD(1)πD(0) ]>πC(i)

and that these differences are sufficiently large to make the left hand side of Equation 2 larger than the right hand side, leading to a positive inclusive fitness, while the behaviour is selected against.

This is mirrored at p=1, where defectors cannot invade if

(4) πC(n)>i=0n1 u¯iπD(i)

Inclusive fitness at p=1 is positive if

(5) πC(n)>i=0n1 u¯i{πD(n1)(ni1)[πC(n)πC(n1)]}

Again there is a variety of ways in which the right hand sides of these two equations can be different from each other, while they are both smaller than the left hand side that they share. In that case inclusive fitness is not the right criterion, but we would not observe a violation in equilibrium. That will certainly be the case if the game is such that

(6) πD(n1)(ni1)[πC(n)πC(n1)]πD(i)

for all i0,...,n1. This would be a sufficient condition for the right hand side of the second equation to be lower than, or at most equal to, the right hand side of the first, so that

πC(n)>i=0n1 u¯iπD(i)i=0n1 u¯i{πD(n1)(ni1)[πC(n)πC(n1)]}

For games that satisfy this condition, observing violations in equilibrium at p=1 therefore is impossible, because inclusive fitness is certainly positive if cooperation is selected for.

Observing violations in equilibrium at p=1 would require that at least for one i,

πD(n1)(ni1)[ πC(n)πC(n1) ]>πD(i)

and that these differences are sufficiently large to make the right hand side of Equation 5 larger than the left hand side, leading to a negative inclusive fitness, while the behaviour is selected for.

A. Not observing violations in equilibrium, also in the interior

While inequalities (Equation 3) and (Equation 6) preclude violations of Hamilton’s rule at p=0 and p=1, respectively, they do not necessarily also preclude violations in the interior. In order to see why in general they do not, we can first look at a simple special case where they do, and that is if n=2, and if, moreover, relatedness is constant.

For n=2, inequalities (Equation 3) and (Equation 6) are the same; they both require πD(1)πD(0) to be less or equal to πC(2)πC(1). If these two differences would be equal, then that would be the classical ‘equal gains from switching’, so one could perhaps call it ‘increasing gains from switching’ if the latter is larger.

A population structure with constant relatedness and n=2 can only be

f0(p)=(1r)(1p)2+r(1p)f1(p)=(1r)2p(1p)f0(p)=(1r)p2+rp

We can compute and rewrite the average payoffs of co-operators and defectors for n=2 as follows:

π¯C(p)=πC(2)[(1r)p+r]+πC(1)[(1r)(1p)]=rπC(2)+(1r)πC(1)+(1r)p[πC(2)πC(1)]

and

π¯D(p)=πD(0)[(1r)(1p)+r]+πD(1)[(1r)p]=πD(0)+(1r)p[πD(1)πD(0)]

Since the terms between square brackets in the second line of both are the ‘gains from switching’, increasing gains from switching here implies that the difference in average fitness between co-operators and defectors π¯C(p)π¯D(p) is increasing in the frequency of co-operators p. Therefore, at n=2, inequality (Equation 3) and/or (Equation 6), combined with constant relatedness, implies that if co-operators are selected for at p=0, they will be selected all the way to p=1, and if they are selected against at p=1, they will be selected against all the way to p=0. This implies that there are no stable interior equilibria, and therefore are there not only no in-equilibrium violations possible at p=0 and p=1, but also not in between. This is illustrated in Figure 3a in the main text.

If we go to group sizes n larger than 2, there are many degrees of freedom that make things much more complicated. First of all, conditions (Equation 3) and (Equation 6) do not imply increased gains from switching in some more general, across the board sense. Inequality (Equation 3) only puts limitations on how πC(i)πC(1) relates to πD(1)πC(0), but not, for instance, on how πC(i)πC(i1) relates to πC(i1)πC(i2) or to πD(i1)πD(i2). One can therefore construct payoff functions that satisfy both inequalities, and yet have gains from switching that sometimes increase and sometimes decrease, depending on how many co-operators there currently are.

Second, one can also tinker with the population structure to create internal stable equilibria. While the grey lines in Figure 3a in the main text represent population structures with fixed r, it is clear that if r is allowed to vary with p, one can create grey lines (population structures) that have multiple intersections with the green line that separates the region where co-operators are selected for and selected against, thereby creating stable and unstable equilibria. This can happen, in spite of the fact that, for n=2, inequalities (Equation 3) and (Equation 6) are as global as it gets. Moreover, with n>2 there are enough degrees of freedom in the notion of a population structure to expect that, when combined with almost any fitness function, one might be able to cook up populations structures that result in stable interior equilibria, even with constant r. In any case it is clear that conditions on the fitness function alone are not enough to preclude violations of Hamilton’s rule in stable interior equilibria.

For many examples, however, it is more straightforward to directly check the key property that would be relevant to preclude stable interior equilibria, and that is that population structure and fitness function combine in a way that makes π¯C(p)π¯D(p) non-decreasing in p – as we did for the case of n=2 and fixed relatedness. If inequalities (Equation 3) and (Equation 6) are satisfied, and this ‘relative synergies’ property also holds, then all in-equilibrium violations of Hamilton’s rule are ruled out. Just to make sure: this relative synergies property is symmetric, in the sense that π¯C(p)π¯D(p) is non-decreasing in p if and only if π¯D(p)π¯C(p) is non-decreasing in 1p.

VI. Examples

The two conditions from Section V, one for p=0, one for p=1, allow us to easily make examples of strategic interactions that do not allow for any observations that violate Hamilton’s rule, as long as the population is in equilibrium. Take for instance payoff functions of the following form:

πC(i)=1+g(i)KπD(i)=1+g(i)

This can be interpreted as a situation where co-operators can produce a public good. How much is produced depends on how many individuals contribute, and that is reflected by g(i). Besides affecting the payoffs through the public good, contributing always lowers the payoff of an agent by a fixed amount K, which is why co-operators always get a payoff that is K below what their defecting fellow group members get. (The costs, according to the counterfactual method, are typically of the form πD(i)πC(i+1)=K+(g(i)g(i+1)). These also take the difference in payoffs due to the public good production into account, of which the agent itself also benefits, and those are not assumed to be constant.)

A sufficient condition on g(i) to prevent violations of Hamilton’s rule in equilibrium at p=0 and p=1 is that there should be synergies – or at least no dis-synergies – in the production of the public good:

g(i)g(i1)g(i1)g(i2)

for i=1,...,n. This implies that

πC(1)+(i1)[πD(1)πD(0)]=1+g(1)K+(i1)[g(1)g(0)]1+g(i)K=πC(i)

for i=1,...,n. In Section V we saw that this prevents violations of Hamilton’s rule at p=0. Moreover,

πD(n1)(ni1)[πC(n)πC(n1)]=1+g(n1)(ni1)[g(n)g(n1)]1+g(i)=πD(i)

for i=0,...,n1, which we saw prevents violations of Hamilton’s rule at p=1.

A few specific choices for g(i) can also help illustrate a few possible situations.

Equal gains

If g(i)=2(in) and K=0.4, then

πC(i)=0.6+2(in)πD(i)=1+2(in)

Combined with a population structure elaborated on in Section IX, this results in π¯Cπ¯D=0.16, both at p=0 and at p=1. Inclusive fitness is also r(p)b(p)c(p)=14482532100=0.16, also both at p=0 and at p=1. Cooperation therefore will be selected for at both extremes (and everywhere in between) and inclusive fitness agrees with the direction of selection. This is always the case with equal gains from switching. Details about the computations can be found in Section IX.

Appendix 1—figure 2
The population structure profiles are depicted in the lower half of the figure, the payoffs in the upper half.
https://doi.org/10.7554/eLife.41901.009

Synergies

If g(i)=2(in)2 and K=0.5, then

πC(i)=0.5+2(in)2πD(i)=1+2(in)2

Combined with the same population structure elaborated on in Section IX, this results in π¯Cπ¯D=0.33 at p=0 and π¯Cπ¯D=0.45 at p=1. Cooperation therefore will be selected against at p=0, and selected for at p=1, which makes both p=0 and p=1 stable equilibria. Inclusive fitness is 0.48 at p=0 and 0.6 at p=1. Inclusive fitness therefore is more negative than π¯Cπ¯D at p=0, and more positive at p=1, which prevents observing violations at equilibrium. Details of the computations, as well as the computation of costs and benefits for the regression method, can be found in Section IX.

Appendix 1—figure 3
The population structure profiles are depicted in the lower half of the figure, the payoffs in the upper half.
https://doi.org/10.7554/eLife.41901.010

Anti-synergies

If g(i)=2(in)12 and K=0.5, then

πC(i)=0.5+2(in)12πD(i)=1+2(in)12

Combined with the same population structure elaborated on in Section IX, this results in π¯Cπ¯D=0.55 at p=0 and π¯Cπ¯D=0.19 at p=1. Cooperation therefore will be selected for at p=0, and selected against at p=1, which makes neither p=0 nor p=1 an equilibrium. Inclusive fitness is 2.3 at p=0 and 0.22 at p=1. Inclusive fitness therefore is more positive than π¯Cπ¯D at p=0, and more negative than π¯Cπ¯D at p=1. This particular combination of a payoff function and a population structure would not lead to observations of violations in equilibrium at p=0 or p=1, but if we simply increase K, or choose a population structure with less assortment, we could make π¯Cπ¯D drop below 0 at p=0, while inclusive fitness is still positive. At the other end, we could decrease K, or increase assortment, to make π¯Cπ¯D positive, while inclusive fitness is still below 0, also creating a violation in equilibrium. Moreover, and more importantly, since co-operators invade defectors and defectors invade co-operators, we can expect violations at a mixed equilibrium, which is what Section VII is about. Details of the computations, as well as the computation of costs and benefits for the regression method, can be found in Section IX.

Appendix 1—figure 4
The population structure profiles are depicted in the lower half of the figure, the payoffs in the upper half.
https://doi.org/10.7554/eLife.41901.011

VII. Mixed equilibria

When co-operators can invade defectors and defectors can invade co-operators, there for sure must be at least one equilibrium mixture of co-operators and defectors. Also other games without equal gains from switching may have stable frequencies p at which co-operators and defectors coexist. At those frequencies, we can compare the direction of selection with inclusive fitness. In Sections III, IV and V we did this comparison at p=0 and p=1 only, now we will need to also do it at the equilibrium frequency, which may be anywhere between 0 and 1.

A. Population structure profiles and relatedness

Similar to before, we can define the probability that a randomly chosen co-operator finds itself in a group in which there are i co-operators:

ui,C(p)=infi(p)j=0n jnfj(p)=infi(p)p

and the probability that a randomly chosen defector finds itself in a group in which there are i co-operators:

ui,D(p)=ninfi(p)j=0n njnfj(p)=ninfi(p)1p

This makes u_i=limp0ui,C(p) and u¯i=limp1ui,D(p). Relatedness now becomes

r(p)=i=0nui,C(p)i1n1i=0nui,D(p)in1

B. Equilibrium

An interior equilibrium is a frequency p(0,1) such that the average payoff of co-operators and the average payoff of defectors are equal:

π¯C(p)=π¯D(p)

This can be written as

i=0n ui,C(p)πC(i)=i=0n ui,D(p)πD(i)

Here we assume that it is clear that average payoffs π¯C(p) and π¯D(p) depend on the frequency p of co-operators in the overall population, whereas game payoffs πC(i) and πD(i) depend on the number of co-operators in the group. An equilibrium is stable, if co-operators have a higher average payoff than defectors do for p<p, and defectors have a higher payoff than co-operators for p>p.

At p=0, all defectors find themselves in groups with no co-operators, and co-operators cannot invade if their average payoff is lower than that of defectors. This gave us the criterion that we used before:

limp0i=0n ui,C(p)πC(i)=i=0n u_iπC(i)<πD(0)

At p=1, all co-operators find themselves in groups with no defectors, and defectors cannot invade if their average payoff is lower than that of co-operators. This gave us the criterion that we used before:

πC(i)>i=0n u¯iπD(i)=limp1i=0n ui,D(p)πD(i)

C. Costs and benefits

The costs and benefits an individual faces may depend on the type of group an individual finds itself in. The composition of the population fi(p), indicating what the frequencies of the different types of groups will be, depends on the overall frequency p of co-operators. The average costs and benefits therefore may also depend on this frequency p. The counterfactual method, as originally suggested by Karlin and Matessi (1983), Matessi and Karlin (1984) and Matessi and Karlin (1986) only considers the costs actually bore by co-operators, and the benefits actually conferred by them onto others. In Section 3 of van Veelen et al. (2017) we show that the costs and benefits of cooperation (compared to defection) then are not necessarily minus the costs and benefits of defection (compared to cooperation). We therefore suggested to include all individuals that faced the opportunity to cooperate, whether they ended up cooperating or defecting. This definition is consistent, and this is also the definition we use here. The cost for a co-operator – comparing its payoffs when it cooperates to its payoffs had it defected – then is πD(i1)πC(i); the cost for a defector is πD(i)πC(i+1). Average costs then become

c(p)=i=0n fi(p)[in(πD(i1)πC(i))+nin(πD(i)πC(i+1))]

Aggregate average benefits similarly become

b(p)=i=0n fi(p)[in{(i1)(πC(i)πC(i1)))+(ni)(πD(i)πD(i1))}+nin{(i)(πC(i+1)πC(i))+(ni1)(πD(i+1)πD(i))}]

D. Comparison

Previously, in Section V, we have seen that inclusive fitness r(p)b(p)c(p) may have a sign that is different from the sign of π¯C(p)π¯D(p), at p=0 and/or at p=1, even though that may not always be observable in equilibrium. In a mixed equilibrium p, where π¯C(p)π¯D(p)=0, there is also no reason why r(p)b(p)c(p) would be 0 too – unless there is equal gains from switching. Here this discrepancy would be observable (see Appendix 1—figure 5). Note that equal gains would be at odds with there being a stable mixed equilibrium at 0<p<1. Details of the computations, as well as the computation of costs and benefits for the regression method, can be found in Section IX. With equal gains, πC(i)πC(i1))=πD(j)πD(j1)) for all i,j{1,...,n} and πD(i1)πC(i))=πD(j1)πC(j)) for all i,j{1,...,n}. If we denote these constants by b and c, then inclusive fitness becomes r(p)(n1)bc – where (n1)b is the aggregate benefits. This is found by filling in the constants in the formulas at subsection C above.

Appendix 1—figure 5
The previous figures depicted u_, which is the population structure profile at p=0, and u¯, which is the population structure profile at p=1.

The payoffs co-operators get, when they find themselves in groups according to u_ would be compared to the payoffs defectors get when they are in a group of defectors only in order to determine whether co-operators can invade defectors, at p=0, and the mirror image of that in order to determine whether defectors can invade co-operators, at p=1. The ui,C(p) and ui,D(p) depicted here all pertain to one and the same equilibrium p, at which π¯C(p)π¯D(p)=0. With the same payoff function as at Appendix 1—figure 4, we find an equilibrium frequency of co-operators of p=0.473, at which inclusive fitness is 14(2.103)(0.412)0.1130.

https://doi.org/10.7554/eLife.41901.012

E. If πD and πC are linear, but not parallel, they still violate ‘equal gains from switching’

Equal gains from switching means that the effect of any given individual changing from defection to cooperation on the fitness of other individuals and on her own fitness is independent of what these other individuals choose. The examples of violations above, depicted in Appendix 1—figures 37, all have non-linear πD and πC. Violations can also occur when πD and πC are linear, but not parallel – in which case the fitness effects depend on whether the recipient is a co-operator or defector itself.

An example would be πD=1+3in and πC=2+in. Both of these are linear in the number of co-operators, but they are not equally steep. Switching to cooperation benefits the other more if the other is a defector, compared to if the other is a co-operator. The total benefit one can confer to others therefore is higher in a group in which most of the others are defectors, and it is lower in a group in which most of the other group members are co-operators. If we choose the same population structure as for Appendix 1—figures 25, then there is a mixed equilibrium – at p=89 – at which Hamilton’s rule is violated; 14(8875)(23)0.3730.

F. An aside about the regression method

It might also be good to illustrate how the regression method would have treated this fitness function. The regression method chooses α, β and γ so as to minimize

i=0n fi(p)(in(πC(i)(α+βi1n1γ))2+nin(πD(i)(α+βin1))2),

where α is the intercept, β is interpreted as n1 times the benefit of being matched with one additional co-operator and γ is interpreted as the cost of being a co-operator oneself. It is easier to illustrate this without population structure, so the figures on the next page show what this would result in for the fitness function of the last example, combined with the well mixed population, and a group size of n=25. In Section IX we will also consider a case with population structure.

The α, β and γ are computed in the limit of p0 (top panel), at p=12 (middle panel), and in the limit of p1 (bottom panel). For the well mixed population, it is not too hard to compute these in general at p0 and p1. In the limit of p0, the regression method always results in α=πD(0). The reason is that limp0f0(p)=1, and limp0fi(p)=0 for all i>0. Therefore, in the limit, for sure (πD(0)α)2 must be minimized. Because f1(p) is of the order p, while fi(p) is of the order p2 or higher, for i>1, β and γ must, in the limit, also minimize 1n(πC(1)(αγ))2+n1n(πD(1)(α+β1n1))2. This can be done here by simply choosing γ=απC(1)=πD(0)πC(1), and β=(n1)(πD(1)α)=(n1)(πD(1)πD(0)). The ‘estimated’ πD at p0 therefore is always a straight line, the steepness of which derives from the first step, from i=0 to i=1, in πD(i). The ‘estimated’ πC is a line parallel to πD, but then shifted up by πD(0)πC(1), and to the right by 1n1.

In this particular case, the squared difference at p=12 is minimized by choosing γ=0, making the ‘estimated’ πC and πD coincide. With population structure, this will all be a bit different, but what remains true is that the ‘estimated’ πC and πD will always be parallel straight lines, whether the true πC and πD are straight and parallel or not. The slope and positions of these straight parallel lines typically changes with p. The reason why this particular choice for (mis)specifying πC and πD would lead to Hamilton’s rule always holding, is given in Section 4 of van Veelen et al. (2017).

Appendix 1—figure 6
The πD according to the regression method coincides the true πD at p0 (top panel, red), but the πC according to the regression method (dotted blue) differs from the true πC (solid blue).

The πD and πC according to the regression method coincide with each other at p=0.5 (middle panel, dotted lines) but do not coincide with the true πD (solid red) and πC (solid blue). The πC according to the regression method coincides the true πC at p1 (bottom panel, blue), but the πD according to the regression method (dotted red) differs from the true πD (solid red).

https://doi.org/10.7554/eLife.41901.013

VIII. Continuous frequencies

For proper large group sizes it can be easier, and more natural, to work with continuous distributions of within-group frequencies, instead of functions fi(p), which are only defined for i=0,...,n. In this section we will therefore introduce the continuous counterparts of definitions from previous sections.

A. Relatedness at the edges

Let {Fp}p[0,1] be a set of cumulative distribution functions Fp:[0,1][0,1], one for every frequency p of co-operators in the population as a whole. Fp(x) is the probability, at frequency p, that the share of co-operators in a randomly chosen group is smaller than or equal to x. Consistency requires that 01xdFp(x)=p, and therefore that Fp converges weakly to the Dirac measure at 0 for p0, and to the Dirac measure at 1 as p1. If Fp has a density, then one can write 01g(x)dFp(x) as 01g(x)fp(x)dx.

To relate this to the setting in previous sections, with discrete within-group frequencies, one would normalize those group types to be values in [0,1], and let them be {0,1n,...,1} instead of {0,...,n}. Furthermore, one would turn a population structure characterized by functions fi(p), i=0,...,n, into one characterized by a cumulative distributions by choosing Fp(x)=j=0ifj(p) if i1n<xin. For cumulative distributions Fp with a density fp, this density is the natural counterpart of the vector with fi(p) as its ith element. The notation is a bit different, though; the overall frequency p is a subscript in the one, and an argument in the other case, while group composition x is an argument in the one, and its counterpart i is a subscript in the other.

Now define cumulative distribution functions U_ and U¯ as follows:

U_(x)=limp00x ydFp(y)p

and

U¯(x)=limp10x ydFp(y)p

and assume that these limits exist.

Again, this one could relate to earlier sections; we can get the vectors u_ and u¯ back by simply ‘uncumulating’ U_ and U¯; define u_i=U_(in)U_(i1n) and u¯i=U¯(in)U¯(i1n).

The fitness functions here will also be defined on [0,1]. They will be denoted by πC(x) for the fitness of a co-operator in a group with frequency of co-operators x, and πD(x) for its defector counterpart. Analogous to the derivation in Section II, relatedness at p=0 is 01 xdU_(x), and at p=1 it is 01 (1x)dU¯(x). Moreover, it would be natural to assume that U¯(x)=U_(1x), and therefore that relatedness at 0 and 1 are equal.

B. Invasions and inclusive fitness

At p=0

The more general version of Equation 1 is that cooperation cannot invade at p=0 if their average payoff is less than that of defectors:

(7) 01 πC(x)dU_(x)<πD(0)

Aggregate benefits according to the counterfactual method are defined analogously to Section IV. There they were defined at p=0 as n1 times the difference between the payoff of a defector that finds itself in a group with one co-operator and defector that finds itself in a group with zero co-operators. In normalized terms, that would be b(0)=(n1)[πD(1n)πD(0)], which, if n were to go to infinity, would amount to b(0)=d+πDdx(0), where d+πDdx(0) is the right derivative of πD at 0. Similarly at p=1, where aggregate benefits are b(1)=dπCdx(1), which is the left derivative of πC at 1. (Discrete population structures, with finite group size, are subsumed under the more general case with distribution functions. Computation of costs and benefits there, however, do differ from how they are computed here, because here one individual changing strategies has no effect on within group frequency x, while in the finite case that is not true.)

With those benefits, we can write the continuous version of Equation 2. At p=0 inclusive fitness is negative if

01 xdU_(x)×d+πDdx(0)<πD(0)πC(0)

which can be rewritten as

(8) 01 (πC(0)+xd+πDdx(0))dU_(x)<πD(0)

If πC(0)+xd+πDdx(0)=πC(x), then the left hand sides of Equations 7 and 8 are the same, and inclusive fitness will always agree with the direction of selection at p=0. If πC(0)+xd+πDdx(0)<πC(x) the left hand sides of Equations 7 and 8 will not be the same, but a violation in equilibrium at p=0 will not be observed; if inequality Equation 7 holds, and co-operators cannot invade, then certainly Equation 8 will hold, making inclusive fitness negative, as its left hand side is even smaller than the left hand side of Equation 7.

At p=1

Similarly, defection cannot invade at p=1 if

(9) 01 πD(x)dU¯(x)<πC(1)

while inclusive fitness at p=1 is positive if

01 (1x)dU¯(x)×dπCdx(1)>πD(1)πC(1)

which can be rewritten as

(10) 01 (πD(1)(1x)dπCdx(1))dU_(x)<πC(1)

If πD(1)(1x)dπCdx(1)=πD(x), then the left hand sides of Equations 9 and 10 are the same. If πD(1)(1x)dπCdx(1)<πD(x), the left hand sides of Equations 9 and 10 will not be the same, but a violation in equilibrium at p=1 will not be observed; if inequality Equation 9 holds, and defectors cannot invade, then certainly Equation 10 will hold, making inclusive fitness positive, as its left hand side is even smaller than the left hand side of Equation 9.

C. Mixed equilibria

Again, when co-operators can invade defectors and defectors can invade co-operators, then for sure there must be at least one equilibrium mixture of co-operators and defectors. Also other games without equal gains from switching may have stable frequencies p at which co-operators and defectors coexist. At those frequencies, we can again compare the direction of selection with inclusive fitness. Here we will assume that at the equilibrium frequency p, Fp(x) has a density fp(x), which allows us to write fp(x)dx for dFp(x).

Equilibrium

An equilibrium is a frequency p for which the average payoff of co-operators and defectors are equal; π¯C(p)=π¯D(p), that is,

01xfp(x)πC(x)dxp=01(1x)fp(x)πD(x)dx1p
Inclusive Fitness

Relatedness, benefits and costs are computed as before, in Section VII, but now with a continuous fp.

r(p)=01x2fp(x)dxp01x(1x)fp(x)dx1p
b(p)=01(xddxπC(x)+(1x)ddxπD(x))fp(x)dx
c(p)=01(πD(x)πC(x))fp(x)dx

Again, there is no reason why in equilibrium, where π¯C(p)π¯D(p)=0, also r(p)b(p)c(p) would be equal to 0.

Example

Consider the following payoff function

πC(x)=1+βxαγπD(x)=1+βxα

Then p is an equilibrium frequency if

β(01 x1+αfp(x)dxp01 (1x)xαfp(x)dx1p)γ=0

Inclusive fitness is

β01αxα1fp(x)dx(01x2fp(x)dxp01(1x)xfp(x)dx1p)γ

and unless α=1, the last expression is typically not 0 for p=p.

Appendix 1—figure 7
With parameters α=12, β=2 and γ=0.4, the equilibrium frequency of co-operators, at which π¯C(p)=π¯D(p), is p=0.465.

Inclusive fitness there is 14(1.82)(0.4)0.0550. Section X specifies the fp(x) for this example.

https://doi.org/10.7554/eLife.41901.014

IX. Discrete population structures

The population structure used in the examples is not meant to be realistic or reflect any particular real population structure; it is just a convenient vehicle to generate a variety of structures. Imagine a parent group that is assembled by randomly drawing m parents from a large population, a share p of which are co-operators. A parent group consisting of k co-operators and mk defectors is drawn with probability

(mk)(1p)mkpk

Then an offspring group is made by drawing – with replacement – n times a parent who reproduces. The probability that a parent group with k co-operators reproduces an offspring group with i co-operators is

qi(k)=(ni)(km)i(mkm)ni

This then implies the following population structure, with

fi(p)=k=0m(mk)(1p)mkpkqi(k)

for i=0,...,n. This is a consistent population structure. Firstly, the frequencies of different group types add up to one.

i=0n fi(p)=i=0n k=0m (mk)(1p)mkpkqi(k)=k=0m (mk)(1p)mkpki=0n (ni)(km)i(mkm)ni=k=0m (mk)(1p)mkpk=1

Here we use twice that the probabilities of the binomial distribution add up to 1. Also, the frequency of co-operators in the offspring population is consistent with p.

i=0ninfi(p)=i=0nink=0m(mk)(1p)mkpkqi(k)=k=0m(mk)(1p)mkpki=0nin(ni)(km)i(mkm)ni=k=0m(mk)(1p)mkpk(km)i=1n(n1i1)(km)i1(mkm)ni=pk=1m(m1k1)(1p)mkpk1=p

Again we twice use that the probabilities of the binomial distribution add up to 1.

Relatedness is

r(p)=P(C|C)P(C|D)

We first compute P(C|C) in a straightforward, but somewhat elaborate way.

P(C|C)=1pi=2nfi(p)ini1n1=1pi=2nk=0m(mk)(1p)mkpk(ni)(km)i(mkm)niini1n1=1pk=0m(mk)(1p)mkpki=2n(n2i2)(km)i(mkm)ni=1pk=0m(mk)(1p)mkpk(km)2i=2n(n2i2)(km)i2(mkm)ni=1pk=0m(mk)(1p)mkpk(km)2=1mk=1mk(m1k1)(1p)mkpk1=1mk=1m(1+(k1))(m1k1)(1p)mkpk1=1m(1+(m1)p)=1m+(11m)p

Here we used twice that the probabilities in the binomial distribution add up to 1, again, and once that the expectation of the binomial distribution, with m1 trials and probability p, is (m1)p.

This answer makes perfect sense, because if an individual is a C itself, then its parent is one too, while the other m1 individuals in the parent group are random draws, with probability p of also being a C. The probability that a randomly drawn other offspring is also a C therefore is 1m+(11m)p. Similarly, one can compute P(C|D) to be (11m)p, which makes r(p)=P(C|C)P(C|D)=1m, which is actually independent of p.

The population structure profile at p=0 for a population structure from this family is u_0=0 and

u_i=limp0infi(p)p=(n1i1)(1m)i1(m1m)ni,i=1,...,n

This can be found by simply evaluating the limits. The easier intuition is that in the limit of p0, all co-operator parents find themselves in parent groups in which they are the only one, and all others are defector parents. This means that, conditional on being a co-operator offspring, the composition of the remainder of its offspring group follows a binomial distribution, with the probability of any draw being a co-operator equal to 1m.

Similarly, the population structure profile at p=1 for a population structure from this family is u_n=0 and

u¯i=limp1ninfi(p)1p=(n1i)(m1m)i(1m)ni1,i=0,...,n1

Now, conditional on being a defector offspring, the composition of the remainder of the offspring group it is in follows a binomial distribution, with the probability of any draw being a co-operator equal to m1m.

The population structures used for Appendix 1—figures 15 all have n=25 for the size of the offspring group. Appendix 1—figures 1a has m=10 for the size of the parent group, and hence relatedness 110, as does Figure 2a in the main text. Appendix 1—figures 1b through 5 here, and their corresponding figures in the main text, feature a parent group size of m=4, and hence relatedness 14. All computations of π¯C(p)π¯D(p) and all computations of inclusive fitness are done by combining these population structures with the different payoff functions from Sections III, IV and V, as described below. Mathematica files with further computational details can be obtained from the author.

Figure 2a in the main text

At p=0, and with m=10, i=125u_iπC(i)= i=125(251i1)(1m)i1(m1m)25i(0.6+2(i25)) =0.872, while πD(0)=1+2(025)=1, and therefore i=125 u_iπC(i)πD(0)=0.128. According to the counterfactual method, benefits are (n1)(πD(1)πD(0))= 24(1+2(125)(1+2(025))) =4825, costs are πD(0)πC(1)=1+2(025)(0.6+2(125)) =825 and inclusive fitness is 1104825825=0.128.

At p=1, and with m=10, πC(25)=0.6+2(2525)=2.6, while i=0251 u¯iπD(i)= i=0251 (251i)(m1m)i(1m)25i1(1+2(i25)) =2.728, and therefore πC(25)i=0251 u¯iπD(i)=0.128. According to the counterfactual method, benefits are (n1)(πC(25)πC(24))= 24(0.6+2(2525)(0.6+2(2425))) =4825, costs are πD(24)πC(25)= 1+2(2425)(0.6+2(2525)) =825, and inclusive fitness is 1104825825=425=0.128.

Because the true fitness function is linear, the regression method would give the same costs and benefits, both at p=0 and at p=1.

Appendix 1—figure 2 (Figure 2b in the main text)

At p=0, and with m=4, i=125u_iπC(i)= i=125(251i1)(1m)i1(m1m)25i(0.6+2(i25)) =1.16, while πD(0)=1+2(025)=1, and therefore i=125u_iπC(i)πD(0)=0.16. Benefits and costs according to the counterfactual method are the same as in Figure 2a in the main text, which makes inclusive fitness equal to 144825825=425=0.16.

At p=1, and with m=4, πC(25)=0.6+2(2525)=2.6, while i=0251 u¯iπD(i)= i=0251 (251i)(m1m)i(1m)25i1(1+2(i25)) =2.44, and therefore πC(25)i=0251 u¯iπD(i)=0.16. Benefits and costs according to the counterfactual method are the same as in Figure 2a in the main text, which makes inclusive fitness equal to 144825825=425=0.16.

Because the true fitness function is linear, the regression method would give the same costs and benefits, both at p=0 and at p=1.

Appendix 1—figure 3 (Figure 2c in the main text)

At p=0, i=125u_iπC(i)= i=125 (251i1)(1m)i1(m1m)25i(0.5+2(i25)2) =0.6712, while πD(0)=1+2(025)2=1, and therefore i=125u_iπC(i)πD(0)=0.3288.

According to the counterfactual method, benefits at p=0 are (n1)(πD(1)πD(0))= 24(1+2(125)2(1+2(025)2)) =48625. Costs at p=0 are πD(0)πC(1)= 1+2(025)2(0.5+2(125)2) =122625 and inclusive fitness is 144862512+2625=0.4776.

In the limit of p0, all groups are groups with defectors only. The regression method therefore would imply that α=πD(0)=1 (see also Section VII F). Furthermore, minimizing the squared difference between true fitness’s and the fitness’s according to a linear model, given the relative weights of all frequencies of groups with i co-operators, with i1, would then amount to

minβ,γi=1nu_i[(πC(i)(1+β(i1n1)γ))2+nii(πD(i)(1+β(in1)))2]

resulting in b=β=0.586971, and c=γ=0.475543. This makes inclusive fitness rbc=0.3288.

At p=1, πC(25)=0.5+2(2525)2=2.5, while i=0251 u¯iπD(i)= i=0251 (251i)(m1m)i(1m)25i1(1+2(i25)2) =2.0512, and therefore πC(25)i=0251 u¯iπD(i)=0.4488.

According to the counterfactual method, benefits at p=1 are (n1)(πC(25)πC(24))= 24(0.5+2(2525)2(0.5+2(2425)2)) =2352625=3.7632. Costs at p=1 are πD(24)πC(25)= 1+2(2425)2(0.5+2(2525)2) =1298625, and inclusive fitness is 14235262512+98625=0.5976.

Because in the limit of p1, all groups are groups with co-operators only, the regression method would imply that α+βγ=πC(25)=2.5 (see also Section VII F). Minimizing the squared difference between true fitness’s and the fitness’s according to a linear model, considering all frequencies of groups with less than n co-operators, would then amount to

minβ,γi=0n1 u¯i[ini(πC(i)(2.5β(nin1)))2+(πD(i)(2.5β(ni1n1)+γ))2]

resulting in b=β=3.25303, and c=γ=0.364457. This makes inclusive fitness rbc=0.4488.

Appendix 1—figure 4

At p=0, i=125u_iπC(i)= i=125 (251i1)(1m)i1(m1m)25i(0.5+2(i25)0.5) =1.54546, while πD(0)=1+2(025)0.5=1, and therefore i=125u_iπC(i)πD(0)=0.54546. According to the counterfactual method, benefits are (n1)(πD(1)πD(0))= 24(1+2(125)0.5(1+2(025)0.5)) =485, costs are πD(0)πC(1)= 1+2(025)0.5(0.5+2(125)0.5) =1225 and inclusive fitness is 1448512+25=2.3. According to the regression method, as for Figure 3, but now with the fitness function of Figure 4, costs are 0.350649, benefits are 3.58443, and inclusive fitness is 0.54546.

At p=1, πC(25)=0.5+2(2525)0.5=2.5, while i=0251 u¯iπD(i)= i=0251 (251i)(m1m)i(1m)25i1(1+2(i25)0.5) =2.69403, and therefore πC(25)i=0251 u¯iπD(i)=0.19403. According to the counterfactual method, benefits are (n1)(πC(25)πC(24))= 24(0.5+2(2525)0.5(0.5+2(2425)0.5)) 0.9698, costs are πD(24)πC(25)= 1+2(2425)0.5(0.5+2(2525)0.5) 0.4596, and inclusive fitness is 140.96980.45960.217. According to the regression method, as for Figure 3, but now with the fitness function of Figure 4, costs are 0.45629, benefits are 1.04905, and inclusive fitness is 0.19403.

Appendix 1—figure 5 (Figure 2d in the main text)

At p=0.473 and n=25,

π¯C(p)=1pi=0n infi(p)πC(i)=1pi=0n ink=0m (mk)(1p)mkpk(ni)(km)i(mkm)ni(0.5+2(in)0.5)=2.04617

and

π¯D(p)=11pi=0n ninfi(p)πD(i)=11pi=0n nink=0m (mk)(1p)mkpk(ni)(km)i(mkm)ni(1+2(in)0.5)=2.04619

which, with 3-digit precision in the solution variable, makes p=0.473 the equilibrium frequency.

According to the counterfactual method, aggregate average benefits, at p=0.473 and n=25 are

b(p)=i=0nfi(p)[in{(i1)(πC(i)πC(i1))+(ni)(πD(i)πD(i1))}+nin{(i)(πC(i+1)πC(i))+(ni1)(πD(i+1)πD(i))}]=i=0nfi(p)[in{(n1)(2(in)0.52(i1n)0.5)}+nin{(n1)(2(i+1n)0.52(in)0.5)}]=2.10255

Average costs, similarly computed, are

c(p)=i=0n fi(p)[in(πD(i1)πC(i))+nin(πD(i)πC(i+1))]=0.412394

This makes inclusive fitness at p=0.473 and n=25 equal to rb(p)c(p)= 14(2.10255)0.412394=0.1129435

According to the regression method, aggregate benefits as well as costs, at p=0.473 and n=25, follow from the following minimization

minα,β,γi=0n fi(p)[in(πC(i)(α+β(i1n1)γ))2+nin(πD(i)(α+β(in1)))2]

which results in α=1.43807, b=β=1.71421, and c=γ=0.428575. This makes rbc=0.

Mathematica files with further computational details can be obtained from the author.

Notice that in these examples, the costs and benefits according to the regression method are uniquely defined, because – unlike the example in the main text – there is only one type of interactant here. Any specification that includes it, will therefore result in the same regression coefficients. In Appendix 1—figures 3, 4 and 5 it does however still misspecify the shape of the payoff function, in the sense that it replaces a non-linear function by a linear one.

X. Continuous population structures

Also the continuous population structure we use for the examples is meant to be convenient rather than realistic. Here we use the Beta distribution with parameters ap and a(1p):

fp(x)=Γ(a)Γ(ap)Γ(a(1p))xap1(1x)a(1p)1

This is a consistent population structure. Firstly, the frequencies of different group types, by definition of the Gamma function, integrate to one.

Also, the frequency of co-operators – which is just the first moment of the Beta distribution – is consistent with p.

01xfp(x)dx=apap+a(p1)=p

Relatedness is

r(p)=P(C|C)P(C|D)=01 x2fp(x)dxp01 x(1x)fp(x)dx1p

This makes P(C|C) the second moment of the Beta distribution, over p, while P(C|D) is the first minus the second moment, over 1p. Relatedness therefore is

r(p)=ap(ap+1)(a+1)appap(ap+1)(a+1)a1p=p(ap+1)a+1ppp(ap+1)a+11p=p(ap+1)a+1pp(a+1)a+1p(ap+1)a+11p=ap+1a+1apa+1=1a+1

This is independent of p. The population structure used for Appendix 1—figure 6 has a=3, and hence relatedness 14. The computations of π¯C(p)π¯D(p) and of inclusive fitness are done by combining this population structure with the payoff function from the example, in the way suggested in Section VIII.

https://doi.org/10.7554/eLife.41901.007

Data availability

This is a theoretical paper and all relevant information is provided in the manuscript and supporting files.

References

    1. Abbot P
    2. Abe J
    3. Alcock J
    4. Alizon S
    5. Alpedrinha JA
    6. Andersson M
    7. Andre JB
    8. van Baalen M
    9. Balloux F
    10. Balshine S
    11. Barton N
    12. Beukeboom LW
    13. Biernaskie JM
    14. Bilde T
    15. Borgia G
    16. Breed M
    17. Brown S
    18. Bshary R
    19. Buckling A
    20. Burley NT
    21. Burton-Chellew MN
    22. Cant MA
    23. Chapuisat M
    24. Charnov EL
    25. Clutton-Brock T
    26. Cockburn A
    27. Cole BJ
    28. Colegrave N
    29. Cosmides L
    30. Couzin ID
    31. Coyne JA
    32. Creel S
    33. Crespi B
    34. Curry RL
    35. Dall SR
    36. Day T
    37. Dickinson JL
    38. Dugatkin LA
    39. El Mouden C
    40. Emlen ST
    41. Evans J
    42. Ferriere R
    43. Field J
    44. Foitzik S
    45. Foster K
    46. Foster WA
    47. Fox CW
    48. Gadau J
    49. Gandon S
    50. Gardner A
    51. Gardner MG
    52. Getty T
    53. Goodisman MA
    54. Grafen A
    55. Grosberg R
    56. Grozinger CM
    57. Gouyon PH
    58. Gwynne D
    59. Harvey PH
    60. Hatchwell BJ
    61. Heinze J
    62. Helantera H
    63. Helms KR
    64. Hill K
    65. Jiricny N
    66. Johnstone RA
    67. Kacelnik A
    68. Kiers ET
    69. Kokko H
    70. Komdeur J
    71. Korb J
    72. Kronauer D
    73. Kümmerli R
    74. Lehmann L
    75. Linksvayer TA
    76. Lion S
    77. Lyon B
    78. Marshall JA
    79. McElreath R
    80. Michalakis Y
    81. Michod RE
    82. Mock D
    83. Monnin T
    84. Montgomerie R
    85. Moore AJ
    86. Mueller UG
    87. Noë R
    88. Okasha S
    89. Pamilo P
    90. Parker GA
    91. Pedersen JS
    92. Pen I
    93. Pfennig D
    94. Queller DC
    95. Rankin DJ
    96. Reece SE
    97. Reeve HK
    98. Reuter M
    99. Roberts G
    100. Robson SK
    101. Roze D
    102. Rousset F
    103. Rueppell O
    104. Sachs JL
    105. Santorelli L
    106. Schmid-Hempel P
    107. Schwarz MP
    108. Scott-Phillips T
    109. Shellmann-Sherman J
    110. Sherman PW
    111. Shuker DM
    112. Smith J
    113. Spagna JC
    114. Strassmann B
    115. Suarez AV
    116. Sundström L
    117. Taborsky M
    118. Taylor P
    119. Thompson G
    120. Tooby J
    121. Tsutsui ND
    122. Tsuji K
    123. Turillazzi S
    124. Ubeda F
    125. Vargo EL
    126. Voelkl B
    127. Wenseleers T
    128. West SA
    129. West-Eberhard MJ
    130. Westneat DF
    131. Wiernasz DC
    132. Wild G
    133. Wrangham R
    134. Young AJ
    135. Zeh DW
    136. Zeh JA
    137. Zink A
    (2011) Inclusive fitness theory and eusociality
    Nature 471:E1–E4.
    https://doi.org/10.1038/nature09831
    1. Birch J
    (2014) Hamilton's rule and its discontents
    The British Journal for the Philosophy of Science 65:381–411.
    https://doi.org/10.1093/bjps/axt016
  1. Book
    1. Bourke AFG
    (1997)
    Sociality and kin selection in insects
    In: Krebs J. R, Davies N. B, editors. Behavioural Ecology: An Evolutionary Approach (4th edition). Oxford: Blackwell Science. pp. 203–227.
    1. Bourke AF
    (2014) Hamilton's rule and the causes of social evolution
    Philosophical Transactions of the Royal Society B: Biological Sciences 369:20130362.
    https://doi.org/10.1098/rstb.2013.0362
  2. Book
    1. Gadagkar R
    (2010)
    The Social Biology of Ropalidia Marginata: Towards Understanding the Evolution of Eusociality
    Cambridge, MA: Harvard University Press.
  3. Book
    1. Matessi C
    2. Karlin S
    (1986)
    Altruistic behavior in sibling groups with unrelated intruders
    In: Karlin S, Nevo E, editors. Evolutionary Processes and Theory. New York: Academic Press. pp. 689–724.
  4. Book
    1. Noonan KM
    (1981)
    Individual strategies of inclusive fitness-maximizing in Polistes fuscatus foundresses
    In: Alexander R. D, Tinkle D. W, editors. Natural Selection and Social Behavior: Recent Research and New Theory. New York, NY: Chiron Press. pp. 18–44.
  5. Book
    1. Queller DC
    2. Strassmann JE
    (1988)
    Reproductive success and group nesting in the paper wasp Polistes annularis
    In: Clutton-Brock T. H, editors. Reproductive Success. Chicago, IL: University of Chicago Press. pp. 76–96.

Article and author information

Author details

  1. Matthijs van Veelen

    CREED, University of Amsterdam, Amsterdam, The Netherlands
    Contribution
    Conceptualization, Formal analysis, Writing—original draft, Writing—review and editing
    For correspondence
    c.m.vanveelen@uva.nl
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8290-9212

Funding

The authors declare that there was no funding for this work.

Acknowledgements

I would like to thank Peter Spreij, Ben Allen, Carl Veller, and the reviewers.

Version history

  1. Received: September 10, 2018
  2. Accepted: October 10, 2018
  3. Accepted Manuscript published: October 15, 2018 (version 1)
  4. Version of Record published: November 22, 2018 (version 2)

Copyright

© 2018, van Veelen et al.

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,912
    views
  • 220
    downloads
  • 4
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Matthijs van Veelen
(2018)
Can Hamilton’s rule be violated?
eLife 7:e41901.
https://doi.org/10.7554/eLife.41901

Share this article

https://doi.org/10.7554/eLife.41901

Further reading

    1. Evolutionary Biology
    2. Immunology and Inflammation
    Mark S Lee, Peter J Tuohy ... Michael S Kuhns
    Research Advance

    CD4+ T cell activation is driven by five-module receptor complexes. The T cell receptor (TCR) is the receptor module that binds composite surfaces of peptide antigens embedded within MHCII molecules (pMHCII). It associates with three signaling modules (CD3γε, CD3δε, and CD3ζζ) to form TCR-CD3 complexes. CD4 is the coreceptor module. It reciprocally associates with TCR-CD3-pMHCII assemblies on the outside of a CD4+ T cells and with the Src kinase, LCK, on the inside. Previously, we reported that the CD4 transmembrane GGXXG and cytoplasmic juxtamembrane (C/F)CV+C motifs found in eutherian (placental mammal) CD4 have constituent residues that evolved under purifying selection (Lee et al., 2022). Expressing mutants of these motifs together in T cell hybridomas increased CD4-LCK association but reduced CD3ζ, ZAP70, and PLCγ1 phosphorylation levels, as well as IL-2 production, in response to agonist pMHCII. Because these mutants preferentially localized CD4-LCK pairs to non-raft membrane fractions, one explanation for our results was that they impaired proximal signaling by sequestering LCK away from TCR-CD3. An alternative hypothesis is that the mutations directly impacted signaling because the motifs normally play an LCK-independent role in signaling. The goal of this study was to discriminate between these possibilities. Using T cell hybridomas, our results indicate that: intracellular CD4-LCK interactions are not necessary for pMHCII-specific signal initiation; the GGXXG and (C/F)CV+C motifs are key determinants of CD4-mediated pMHCII-specific signal amplification; the GGXXG and (C/F)CV+C motifs exert their functions independently of direct CD4-LCK association. These data provide a mechanistic explanation for why residues within these motifs are under purifying selection in jawed vertebrates. The results are also important to consider for biomimetic engineering of synthetic receptors.

    1. Evolutionary Biology
    Robert Horvath, Nikolaos Minadakis ... Anne C Roulin
    Research Article

    Understanding how plants adapt to changing environments and the potential contribution of transposable elements (TEs) to this process is a key question in evolutionary genomics. While TEs have recently been put forward as active players in the context of adaptation, few studies have thoroughly investigated their precise role in plant evolution. Here, we used the wild Mediterranean grass Brachypodium distachyon as a model species to identify and quantify the forces acting on TEs during the adaptation of this species to various conditions, across its entire geographic range. Using sequencing data from more than 320 natural B. distachyon accessions and a suite of population genomics approaches, we reveal that putatively adaptive TE polymorphisms are rare in wild B. distachyon populations. After accounting for changes in past TE activity, we show that only a small proportion of TE polymorphisms evolved neutrally (<10%), while the vast majority of them are under moderate purifying selection regardless of their distance to genes. TE polymorphisms should not be ignored when conducting evolutionary studies, as they can be linked to adaptation. However, our study clearly shows that while they have a large potential to cause phenotypic variation in B. distachyon, they are not favored during evolution and adaptation over other types of mutations (such as point mutations) in this species.