Inferring genetic interactions from comparative fitness data
Abstract
Darwinian fitness is a central concept in evolutionary biology. In practice, however, it is hardly possible to measure fitness for all genotypes in a natural population. Here, we present quantitative tools to make inferences about epistatic gene interactions when the fitness landscape is only incompletely determined due to imprecise measurements or missing observations. We demonstrate that genetic interactions can often be inferred from fitness rank orders, where all genotypes are ordered according to fitness, and even from partial fitness orders. We provide a complete characterization of rank orders that imply higher order epistasis. Our theory applies to all common types of gene interactions and facilitates comprehensive investigations of diverse genetic interactions. We analyzed various genetic systems comprising HIV1, the malariacausing parasite Plasmodium vivax, the fungus Aspergillus niger, and the TEMfamily of $\beta $lactamase associated with antibiotic resistance. For all systems, our approach revealed higher order interactions among mutations.
https://doi.org/10.7554/eLife.28629.001Introduction
The fitness of an individual with a particular genotype is a measure of its expected contribution to the next generation of the population. The collection of all fitness values for all genotypes, referred to as the fitness landscape, is a central concept in evolutionary biology (Wright, 1932; Orr, 2009). The fitness landscape can have a strong impact on the fate of the evolving population, such as, for example, the risk of a pathogen population to develop drug resistance and to survive under drug treatment (de Visser and Krug, 2014).
Genetic interactions, or epistasis, are abundant in nature. They can have many causes and occur at various scales, for instance, among mutations of a proteincoding sequence or between sequences coding for different genes. Unless there are genetic interactions, we assume that fitness is additive, that is, the fitness effects of individual mutations sum. An additive fitness landscape is determined by the wildtype and singlemutant fitness values.
If the fitness landscape is determined by the wildtype, singlemutant, and doublemutant fitness values, then we say that it has no higher order epistasis. Intuitively, higher order epistasis means that the fitness of a multiple mutant is unexpected given the fitness of the wild type and all single and double mutants. For example, Weinreich et al. (2006) showed that five mutations jointly increase antibiotic resistance considerably more than expected.
Measuring fitness experimentally is challenging. Fitness measurements tend to come with high uncertainty and they are often obtained only for a subset of genotypes. Moreover, fitness can sometimes not be measured directly at all. Instead, phenotypes are considered that can be measured and are believed to approximate fitness well. For instance, antimicrobial drug resistance is the dominating survival factor for a bacterial population under drug exposure, so that the degree of resistance is a good substitute measure of fitness. Several such fitness proxies are used in microbiology, including survival as measured by disc diffusion tests. Although it is possible to study epistasis of the proxy data, in general, presence or absence of epistasis in the proxy landscape does not imply presence or absence of epistasis in the fitness landscape itself.
Experimentally, epistatic interactions have been measured in several genetic systems, including E. coli (Khan et al., 2011; Weinreich et al., 2006; Poelwijk et al., 2007), HIV1 (da Silva et al., 2010; Segal et al., 2004), and other viruses (Wylie and Shakhnovich, 2011; Sanjuán, 2010). These and similar studies involve the analysis of standing genetic variation or spontaneous mutations (Bonhoeffer et al., 2004; Bershtein et al., 2006), engineered sitedirected mutations (Sanjuán et al., 2004; Weinreich et al., 2006), and combinations of both (Sanjuán et al., 2005; Poon and Chao, 2006). Competition experiments are also frequently employed to learn mutational fitness effects. For example, Sanjuán et al. (2004) studied the distribution of deleterious mutational effects in RNA viruses using this approach. Such experiments are typically run on singlenucleotide substitution mutants produced by sitedirected mutagenesis. The data produced in competition experiments is informative about pairwise comparisons of genotypes with respect to their fitness. However, little is known about whether or not it is possible to learn higher order genetic interactions from such fitness comparison data.
Due to the rapid growth of the number of possible interactions with the number of loci, all interactions can exhaustively be studied only for a small number of loci. At the human genome scale, for example, a complete study of only pairwise gene interactions would already require hundreds of millions of experiments. On the other hand, for smaller organisms, such as yeast, all pairwise and several threeway gene interactions have been measured experimentally (Costanzo et al., 2010). Only when restricting to a small set of preselected loci, can one assess all combinations of mutations and hence all epistatic interactions. This approach has been pursued, for example, by Weinreich et al. (2006) for a fivelocus system associated with bacterial drug resistance.
Historically, the study of genetic interactions was mostly restricted to pairwise epistasis. According to Crow and Kimura, 1970 (p. 224) higher order interactions were generally believed not to be significant in nature, with references to Fisher, Haldane, and Wright. More recent arguments for the same view have been stated in the context of protein folding (Gupta and Adami, 2016). On the other hand, empirical findings suggest that the opposite is true for many other systems (Szendro et al., 2013; Neidhart et al., 2013; Sailer and Harms, 2017a). For example, Weinreich et al. (2013) argue that threeway and fourway interactions can be as strong as pairwise epistasis referring to various empirical fitness studies, and Knies et al. (2017) find many epistatic interactions in a numerically nearadditive fitness landscape, reducing dramatically the number of accessible evolutionary trajectories. Although the significance of higher order interactions may vary between systems, the topic has not been thoroughly investigated. This is partly due to lack of adequate methodology to quantitatively assess the interactions underlying an observed empirical fitness landscape. Improved mathematical and statistical tools for detecting higher order interactions, as well as more empirical results, are necessary for more conclusive answers regarding the importance of higher order interactions.
In this paper, we consider fitness data that comes in the form of pairwise comparisons. Such data are frequent in practice and can arise in different ways. First, some assays rely on comparing the fitness of two genotypes, for example, by letting them grow in direct competition. Each competition experiment is informative about which of the two genotypes has higher fitness, without estimating the fitness values themselves. Second, direct but uncertain fitness measurements are also often summarized as pairwise fitness relations by recording only whether two genotypes displayed significantly different fitness values or not. Third, rather than fitness itself, a fitness proxy, that is, a phenotype closely related to fitness, may be considered. Fitness proxies cannot be used directly to measure epistasis, because they generally do not preserve fitness linearity (Gong et al., 2013), but if proxy data preserves pairwise comparisons, they may be used instead. Lists of mutants found in a new environment, such as, for example, a new host for a pathogen or a drug environment can be utilized similarly. Assuming that the capability to transition to and survive in the new environment is an indication of higher fitness, this type of observational data also provides pairwise fitness comparisons. Similarly, the population frequency of genotypes can sometimes be used to draw conclusions about fitness. For example, by employing a specific model of viral evolution, fitness was inferred computationally from deep sequencing data of an HIV1 population, and pairwise credible fitness differences were reported (Seifert et al., 2015).
Irrespective of how they were obtained, any consistent set of pairwise fitness relations can be regarded as a partial order of the genotypes with respect to fitness. Two specific types of partial orders play important roles for fitness landscapes. First, if comparisons are available for all pairs of genotypes, then the partial order is a total order, or rank order. In this case, all genotypes are ordered according to fitness. Second, several studies compare fitness only between mutational neighbors, that is, genotypes which differ at exactly one locus. The resulting partial orders are referred to as fitness graphs and have recently been used extensively (Ogbunugafor et al., 2016; Wu et al., 2016; Smith and Cobey, 2016; Mira et al., 2015).
The question addressed in the present study is whether higher order interactions can be inferred from rank orders, fitness graphs, and general partial orders. Connections between rank orders and fitness graphs to epistasis and global properties of fitness landscapes have been observed repeatedly (Greene and Crona, 2014; Crona et al., 2013; Poelwijk et al., 2011; Weinreich et al., 2006; Weinreich et al., 2005). Most recently, Wu et al. (2016) discussed an example of a fitness graph that implies higher order epistasis. The significance of rank orders of genotypes for epistasis was recognized by Weinreich et al. (2005). The authors introduced the concept of sign epistasis. By definition, a system has sign epistasis if the sign of the effect of a mutation, whether positive or negative, depends on genetic background. Importantly, sign epistasis implies that the rank order of the genotypes is not compatible with additive fitness. In this paper, we develop a related approach based on rank orders that applies to higher order epistasis as well as other measures of gene interactions. For instance, if the rank order of the genotypes implies threeway epistasis for a threelocus system, then one has a signed variant of threeway epistasis. Similarly, one can consider signed variants of almost any type of gene interaction. The theory of sign epistasis stands as a model for development in the area, and there is a potential for understanding global properties of fitness landscapes in terms of (local) signed interactions, similar to results for sign epistasis.
In addition to the theoretical work mentioned above, rank order arguments have been used for developing antimicrobial treatment strategies (Smith and Cobey, 2016; Nichol et al., 2015; Mira et al., 2015; Goulart et al., 2013). However, the full potential of rank order consideration for the comprehensive analysis of epistatic gene interactions in general $n$locus genetic systems has not been exploited. Furthermore, to the best of our knowledge the general case of arbitrary partial fitness orders has yet to be considered.
Here, we develop quantitative tools to detect any type of gene interactions measured by linear forms, including epistasis as described by Fourier coefficients, Walsh coefficients, and circuits (Beerenwinkel et al., 2007; Weinreich et al., 2013). In particular, our approach applies to total $n$way epistasis, conditional epistasis, and marginal epistasis. We used our approach to analyze genetic interactions in HIV1, the parasite Plasmodium vivax, the fungus Asbergillus niger, and $\beta $lactamase antibiotic resistance systems. In all cases, we detect higher order interactions based only on partial information about the fitness order of genotypes, without knowing or estimating the actual fitness values.
Results
We consider genetic systems consisting of $n$ biallelic loci. A genotype can then be represented as a binary string of zeros and ones of length $n$, where $0$ denotes the wildtype allele and $1$ the alternative allele. We assume that fitness is additive in the absence of epistasis. The fitness of a genotype $g$ is denoted by ${w}_{g}$, and we assume that the fitness landscape $w$ is generic in the sense that no two genotypes have exactly the same fitness.
A complete analysis of all epistatic interactions would require fitness measurements of all ${2}^{n}$ genotypes. However, this level of completeness is rarely available in empirical data sets due to experimental design or an infeasible number of genotypes. To address this limitation, we developed methods that are applicable to partial orders of genotypes according to fitness. For example, the two fitness relations ${w}_{01}>{w}_{00}$ and ${w}_{10}>{w}_{11}$ together define a partial order. One can always extend a partial order to a rank order, that is, a total order of the genotypes in the system from highest to lowest fitness. For example, the total order ${w}_{10}>{w}_{11}>{w}_{01}>{w}_{00}$ extends the partial order above. Our goal is to understand what fitness rank orders and more generally partial fitness orders of genotypes reveal about gene interactions.
Twolocus case
We first consider epistasis for a biallelic twolocus population consisting of the unmutated genotype, or wild type, $00$, the two single mutants $01$ and $10$, and the double mutant $11$. In this case, epistasis is denoted by ${\epsilon}_{2}$, where the index two refers to the number of loci. It is defined as the deviation from additivity,
The system has no epistasis if ${\epsilon}_{2}=0$, positive epistasis if ${\epsilon}_{2}>0$ and negative epistasis if ${\epsilon}_{2}<0$.
We first assume that the available information on fitness is a rank order of the genotypes (Figure 1). The rank order is sometimes sufficient for determining that the system has epistasis. For instance, the rank order ${w}_{11}>{w}_{00}>{w}_{10}>{w}_{01}$ (Figure 1 rank order 3), implies ${w}_{00}+{w}_{11}>{w}_{01}+{w}_{10}$, so ${\epsilon}_{2}>0$. It follows that the rank order alone allows one to detect positive epistasis without knowledge of the actual fitness values. There are 24 rank orders of the biallelic twolocus system. Among these, eight imply positive epistasis, eight imply negative epistasis, and eight do not permit any inference regarding epistasis. In total two thirds of the rank orders imply epistasis. Each rank order that implies epistasis also determines the sign of ${\epsilon}_{2}$ (Figure 1).
Sometimes even a partial order of the genotypes is sufficient for determining that the system has epistasis. For instance, if we know that ${w}_{01}>{w}_{00}$ and ${w}_{10}>{w}_{11}$, then we can infer that the system has negative epistasis (Figure 2a). To see this, we consider all rank orders that extend the partial order. There are six such total extensions, namely rank orders 9, 10, 12, 13, 14, and 16 in Figure 1, and all imply negative epistasis. We conclude that the partial order implies epistasis, based on only two fitness comparisons and without knowing any of the actual fitness values. This observation holds in general: If all total extensions imply epistasis then the same is true for the partial order. We will use this argument repeatedly.
A partial order can also be compatible with several rank orders, some of which might imply epistasis while others do not. In this case, the information is not sufficient to detect epistasis from the partial order alone. For example, the partial order $w}_{00}>{w}_{01}>{w}_{10},{w}_{11$ is compatible with the two rank orders ${w}_{00}>{w}_{01}>{w}_{11}>{w}_{10}$ and ${w}_{00}>{w}_{01}>{w}_{10}>{w}_{11}$ (Figure 2b). The first rank order implies positive epistasis, but the other one does not. Consequently, the partial order does not reveal whether or not the system has epistasis, and further comparisons are needed for a conclusion. A more detailed treatment of partial fitness orders can be found in Lienkaemper et al. (2017).
Fitness graphs constitute an important subclass of partial orders, as they often are the reported result of experiments, and because of their relevance for evolutionary processes (Figure 3). Briefly, the nodes of a fitness graph represent genotypes and for each pair of mutational neighbors, that is, genotypes which differ at exactly one locus, an arrow points toward the genotype of higher fitness (Section Partial orders and fitness graphs).
A fitness graph implies epistasis exactly when all rank orders compatible with the graph do, as is the case for partial orders in general. For example, Figure 3 shows the four fitness graphs where genotype $00$ has lowest fitness in the in the system. The graphs (b), (c) and (d) imply epistasis, whereas (a) is compatible with additive fitness.
A couple of observations from Figure 3 are useful for determining if a system is compatible with additive fitness. First, any rank order compatible with the graph (a) has the following property: For each genotype, replacing $0$ by $1$ results in a genotype of higher fitness. If the genotype $00$ has minimal fitness in the system, then rank orders are compatible with graph (a) exactly if they satisfy this property. The second observation is that a fitness graph where $00$ has minimal fitness is compatible with additive fitness exactly if all arrows point up. Both observations generalize to any number of loci, and can be phrased in full generality (one can reduce the general problem to the case when $0\mathrm{\dots}0$ has lowest fitness in the system by a relabeling argument). In particular, only 384 out of $({2}^{3})!$ = 40,320 rank orders are compatible with fitness graphs with all arrows up (after relabeling) for the threelocus system, which we consider next (Materials and methods, Section Partial orders and fitness graphs).
Threelocus case
The biallelic threelocus system consists of the eight genotypes $000$, $001$, $010$, $011$, $100$, $101$, $110$, and $111$. The system has total threeway epistasis if
For the threelocus system, we distinguish between fitness landscapes with no epistasis (fitness is additive), with pairwise but not higher order epistasis (fitness is not additive but ${\epsilon}_{3}=0$), and with threeway epistasis (${\epsilon}_{3}\ne 0$).
Some rank orders imply threeway epistasis, similar to our observation of epistasis in the twolocus case. The condition for when a rank order implies threeway epistasis is remarkably simple, and we demonstrate it with an example. Consider the rank order
We can represent this rank order by a word in the letters $e$ and $o$ using the following procedure. The genotype $110$ with the highest fitness is represented by $e$ because it has an even number of $1$’s, the genotype $111$ with the second highest fitness is represented by $o$ because it has an odd number of $1$’s, and so forth. Working from highest to lowest fitness, we obtain the word
If one reads the word letter by letter from left to right, then one has never encountered more $o$’s than $e$’s. This property means that $eoeeooeo$ is a Dyck word (Stanley, 1999).
For a biallelic threelocus system, a rank order implies threeway epistasis exactly if its associated word (where the role of $e$ and $o$ can be interchanged) is a Dyck word (Proposition 1). This simple rule allows us to conclude that an empirical system has threeway epistasis. As in the twolocus case, a landscape may have threeway epistasis even if the rank order does not imply it. For biallelic threelocus systems, there are in total $40,320$ rank orders, of which $16,128$ ($40\%$) imply threeway epistasis (Proposition 1).
Fitness graphs can be analyzed by using our results on rank orders as in the twolocus case. Figure 4 shows three fitness graphs for threelocus systems. The fitness graph (a) implies threeway epistasis, the graph (b) pairwise but not higher order epistasis, and the graph (c) is compatible with additive fitness.
There are in total $1,862$ fitness graphs for the biallelic threelocus system, of which $698$ graphs ($37\%$) imply threeway epistasis. In principle one can check a particular threelocus system for higher order epistasis using this result. However, it is not convenient to work with a list of over one thousand graphs. In order to make the problem more tractable, we can utilize the fact that some fitness graphs are isomorphic (Figure 5). There are $54$ distinct isomorphism classes of graphs for the threelocus system, of which $20$ imply higher order epistasis (Mathematical framework and proofs, Section Partial orders and fitness graphs). Consequently, to detect threeway epistasis, one can find the isomorphism class and then check $54$ graphs, namely one for each isomorphism class (Figure 6 ).
We complete the consideration of the threelocus case by analyzing partial orders. Again, in favorable cases one can infer threeway epistasis. Indeed, if there exists a partition of all eight genotypes into four pairs $({g}_{e},{g}_{o})$, where $e$ and $o$ are as above, and ${w}_{{g}_{e}}>{w}_{{g}_{o}}$ for each pair, then one can conclude threeway epistasis ( Proposition 7).
General $n$locus case
The results on rank orders and higher order epistasis for $n=3$ generalize to any number of loci. The definition of $n$way epistasis in an $n$locus system is analogous to the threelocus case, as is the condition for when rank orders imply $n$way epistasis. Accordingly, a characterization of rank orders that imply $n$way epistasis can be phrased in terms of Dyck words (Proposition 1). From this result it follows that the fraction of rank orders that imply $n$way epistasis is $2/({2}^{n1}+1)$ ( Corollary 2) and that it can be determined in a computationally efficient manner whether or not a rank order implies $n$way epistasis.
Rank order methods are useful for analyzing the total $n$way epistasis for an $n$locus system, as demonstrated. However, a single quantity cannot capture all possible gene interactions. Rank order approaches have the capacity to reveal finer interactions as well.
We start with a general description of gene interactions before exploring what rank orders can reveal about these interactions. We define an additive dependence relation as a linear form that is zero on additive fitness landscapes. Interaction coordinates and circuits (Beerenwinkel et al., 2007), as well as Walsh coefficients of order two or more (Weinreich et al., 2013), are additive dependence relations. For simplicity, we restrict our analysis to the threelocus system, although the arguments used are readily extendable to any number of loci $n$.
First, we consider additive dependence relations that directly correspond to the twolocus case by fixing one allele at the third locus. For example, if we fix the third locus at $0$, then
measures pairwise epistasis between the first and second locus. Similarly, if we set the third locus to $1$, then
measures pairwise epistasis between the first and second locus.
An example of an additive dependence relation with no correspondence in the twolocus setting is
which compares the fitness of the triple mutant $111$ to the three single mutants. This expression is negative if the triple mutant has higher fitness than one would expect based on the fitness effects of the three single mutations. An example of an additive dependence relation with eight nonzero terms is
One can verify that ${u}_{110}$ is twice the average of $a$ and $b$. For a systematic approach to a comprehensive set of gene interactions, one can take advantage of circuits, that is, minimal additive dependence relations. In contrast, ${u}_{110}$ is not minimal, because it can be derived from $a$ and $b$. There are 20 circuits for the threelocus system, including $a$, $b$, and $m$ (Mathematical framework and proofs, Section Circuits).
The interactions described by $a$ and $b$ are referred to as conditional epistasis, that is, interactions that measure the total epistasis of subsystems obtained by fixing some loci at 0 or 1. If the interactions $a$ and $b$ differ substantially, it may be important to consider both of them. However, if we are rather interested in the average interaction for the first two loci over all genetic backgrounds, then ${u}_{110}$ is the right measure.
In general, relations that measure average effects, such as ${u}_{110}$, are referred to as interaction coordinates. The interaction coordinates ${u}_{110}$ differs from the Walsh coefficient ${E}_{110}$ (Weinreich et al., 2013) only by a constant scaling factor. Provided that average effects are sufficient for the purpose of a study, one can analyze higher order epistasis by considering interaction coordinates, or Walsh coefficients, (Weinreich et al., 2013) (Mathematical framework and proofs).
One interesting class of circuits compares the effect of replacing pairs of loci with different backgrounds. For instance,
compares the effect of replacing 00 by 11 if the third coordinate is fixed at 0, versus if the third coordinate is fixed at 1. We refer to $k$ as a circuit measuring marginal epistasis between two pairs of loci as in Beerenwinkel et al. (2007).
Arguments based on Dyck words can be used for analyzing rank orders and additive dependence relations in general. The letters are determined by the signs of the coefficients in the linear form, as for threeway epistasis (Theorem 3).
For each circuit and interaction coordinate, we identify all rank orders that determine its sign. The characterization is given in terms of general Dyck word conditions. We found that for each interaction coordinate, $2/5$ of all rank orders determine its sign; for each circuit corresponding to either conditional twoway interaction or marginal epistasis between two pairs of loci, $2/3$ of all rank orders determine its sign; and for each circuit relating the threeway interaction to the total twoway epistasis, $1/2$ of all rank orders determine its sign ( Corollary 4 and 6).
Importantly, if a rank order implies that the sign of an additive dependence relation, such as a circuit or an interaction coordinates, is determined, then the system has sign epistasis.
One can ask if it possible to decompose the word obtained for analyzing $n$way epistasis into subunits, so as to learn about circuits or properties for subsystems of the genotypes. In general, no such decompositions are possible unless one has information in addition to the word itself. For instance, suppose that a rank order is mapped to $ooeeeooe$. The first half of the word, namely $ooee$, does not necessarily reveal any interesting information about the system. (Mathematical framework and proofs, Section Circuits).
The signs of all twenty circuits determines the polyhedral shape of the fitness landscape (Beerenwinkel et al., 2007). The shape combines the circuit information into a more manageable object. However, no rank order determines a shape for $n=3$ (Mathematical framework and proofs, Section Circuits).
Our tools for detecting gene interactions work for total $n$way epistasis, interaction coordinates and circuits. Moreover, our approach applies to any type of gene interaction that can be expressed by a linear form (Theorem 3), such as Fourier coefficients (Beerenwinkel et al., 2007) and Walsh coefficients (Weinreich et al., 2013). We have implemented algorithms for detecting the gene interactions described in this section, both for rank orders and partial orders, specifically, algorithms for $n$way epistasis, threeway and fourway interaction coordinates, and threeway circuit interactions (https://github.com/gavruskin/fitlands#fitlands). The most computationally demanding task of our algorithms is reading the rank order from disk. The run time complexity is proportional to the number of nonzero coefficients in the linear form.
Analysis of empirical fitness data
As proof of principle, we applied our tools to fitness data from a diverse set of biological systems, ranging from HIV1 (Segal et al., 2004), malaria (Ogbunugafor and Hartl, 2016), antibiotic resistance (Mira et al., 2015), to the fungus Aspergillus Niger (Franke et al., 2011). Our approach reveals higher order epistasis for all of these systems, only by considering rank orders and partial orders of genotypes, without the need to access direct fitness measurements or estimates.
Our first application is to the HIV1 data published by Segal et al., 2004. Following Beerenwinkel et al. (2007), we consider the threelocus biallelic system that consists of the mutation $\mathrm{L90M}$ in the protease and mutations $\mathrm{M184V}$ and $\mathrm{T215Y}$ in the reverse transcriptase of HIV1. Fitness was measured as the number of offspring in a single replication cycle of the virus in the original study, and was reported relative to the wildtype strain NL43 on a logarithmic scale. The data consist of $288$ fitness measurements, including between $5$ and $214$ replicates per genotype.
The following rank order was obtained by comparing the mean fitness of the eight genotypes:
where $000$ corresponds to the sequence of amino acids $\mathrm{LMT}$ and $111$ to $\mathrm{MVY}$ comprising the three selected loci. This rank order implies positive threeway epistasis because the associated word
is a Dyck word. It follows that the three mutations under consideration together have a stronger effect on fitness than one would predict from single and double mutants. A closer inspection of the word reveals more information. If we swap any two adjacent letters in the word, then we still have a Dyck word, with the single exception of the first two letters. In other words, only one pair of adjacent genotypes in the rank order, namely $000$ and $100$, could violate the conclusion if transposed.
If the experiment was to continue, our analysis could be used to direct the data collection process. Indeed, the argument above suggests that the position of the genotype $100$ may violate the conclusion of positive threeway epistasis. To quantify the uncertainty in the ranking of $100$ with respect to the wild type $000$, we employed the Wilcoxon rank sum test on the replicate fitness measurements. The pvalue of the test is $0.47$ for the relation ${w}_{000}>{w}_{100}$, which implies considerable uncertainty and justifies our recommendation of further experiments to clarify the position of $100$. Importantly, the suggested experiment reduces the number of measurements required to make a more robust conclusion about epistasis considerably, namely to one out of $28$ possible comparisons.
We proceeded by considering other types of gene interactions in this data set. When considering all $20$ circuits, the rank order implies interactions for $55\%$ of the circuits, with positive sign for $30\%$ and negative for $25\%$ of the circuits. This result is consistent with the conventional statistical approaches that use direct fitness measurements. Indeed, since the empirical study of Segal et al., 2004 provided multiple fitness measurements of each genotype, it was possible to compare our conclusion based on rank orders with statistical tests based on fitness estimates.
The results for fitness measurements were confirmed by the conventional Wilcoxon rank sum test. We computed interaction coordinates and circuit interactions for the summary statistics reported in (Beerenwinkel et al., 2007). Figure 7 shows that our rank order methods detected the majority of circuit interactions identified by using the summary statistics. Specifically, both approaches detected threeway epistasis. Furthermore, $11$ of the $20$ circuit interactions have been detected by our method and confirmed by Wilcoxon rank sum test.
We also applied Student’s ttest to detect interactions and quantify the significance of the estimates. In addition to the $11$ interactions, the ttest found $6$ circuit interactions as significant (Table 2). We emphasize that the rank order approach required much less information to arrive at the same conclusions, thus demonstrating the power of the method.
We conclude that the three sites in the HIV1 genome under consideration are prone to a diverse set of interactions. Specifically, the strong support for the threeway epistasis, along with the $55\%$ of informative circuit interactions, imply that the three loci together interact in a complex manner, meaning that the interactions cannot be explained using pairwise interactions alone. Thus, in this data set, higher order interactions have a strong impact on the fitness landscape.
Our second application is to a study of antimicrobial drug resistance in malaria (Ogbunugafor and Hartl, 2016). The authors measured growth rates for several mutants of Plasmodium vivax under exposure to the antimalarial drug pyrimethamine. We identified higher order epistasis by analyzing rank orders. More precisely, we considered a threelocus subsystem of the study that consists of mutations N50I, S58R, and S117N, in the context of T173L, a fixed mutation, under nine different concentrations of pyrimethamine. The genotypes comprising positions 50, 58, and 117 are labeled $000$ (NSS), $100$, $010$, $001$, $110$, $101$, $011$, and $111$ (IRN). The three highest concentrations of the drug resulted in the following rank orders:
The corresponding words are $oeoeooee$ for the first rank order, obtained under the highest concentration of the drug, and $oeoooeee$ for the second and third rank orders. Since we obtain Dyck words in all cases, the system has negative threeway epistasis for the three highest concentrations of the drug. This consistency among pyrimethamine concentrations shows that the result is robust.
Using our software, we also analyzed all interaction coordinates for this data set (https://github.com/gavruskin/fitlands/blob/master/Fourway_interaction_coordinates_and_total_nway_interaction.ipynb). Our analysis revealed that for the two highest concentrations of the drug, the rank order implies that the interaction coordinate denoted ${u}_{0111}$(Mathematical framework and proofs) is negative.
Next, we applied our tools to a study of the TEMfamily of $\beta $lactamase, associated with antibiotic resistance (Mira et al., 2015). The study measured growth rates for $16$ genotypes exposed to $15$ different antibiotics. Specifically, all $16$ genotypes that combine subsets of the four amino acid substitutions M69L, E104K, G238S, N276D found in TEM50, including eight known enzymes, were created using sitedirected mutagenesis. We considered the fitness graph obtained when the system was exposed to the antibiotic FEP Cefepime at a concentration of $0.0156\text{}\mu$g/ml (Figure 8). The fitness graph implies higher order epistasis (Proposition 7), that is, the fitness of TEM50 cannot be predicted even with complete knowledge of the fitness values of the remaining genotypes in the system. The fitness graphs for the other 14 antibiotics do not share this property. We conclude that even though some of the single and triple mutants confer low antibiotic resistance, a large population of triple mutants alone is more prone to become antibiotic resistant due to the epistatic fitness advantage of TEM50, as compared to a setting with no higher order epistasis.
Finally, we investigated a study of the filamentous fungus Aspergillus Niger (Franke et al., 2011). We considered a system consisting of the wild type and all combinations of the four individually deleterious mutations fwnA1, leuA1, oliC2 and crnB12 (Figure 9). Fitness was estimated with twofold replication by measuring the linear mycelium growth rate in the original study. The fitness graph implies higher order epistasis (Proposition 7).
All four arrows incident to $0000$ point towards the genotype, so that the genotype $0000$ is a peak in the landscape. The same is true for the genotypes $1100$, $0011$, and $1001$. Because of the four peaks, it is possible that the fungus population gets stranded at a suboptimal peak during the course of evolution (we do not necessarily assume that the starting point for an evolutionary process is at $0000$). In contrast, an additive fitness landscape is single peaked. This example illustrates that epistasis may have an impact on the evolutionary dynamics. Several peaks can make the evolutionary process less predictable, depending also on other factors such as population size, mutation rate, etc. More generally, for threelocus fitness graphs, we analyzed the impact of higher order epistasis versus only pairwise epistasis systematically. We found that higher order epistasis correlates with more peaks as well as other features that can lead to involved evolutionary dynamics (Mathematical framework and proofs, Section Graph theoretical aspects).
We completed our analysis of this data set by considering the $5$locus system of mutations fwnA1, argH12, pyrA5, leuA1, and pheA1, conditioning on mutations lysD25, oliC2, and crnB12 all being absent. The original study does not contain any measurements for the two genotypes $11010$ and $10111$. Furthermore, two pairs of genotypes in the system have identical ranks, namely $(11000,\mathrm{\hspace{0.17em}10010})$ and $(10011,\mathrm{\hspace{0.17em}11101})$. We obtained the following word for the total fiveway epistasis ${u}_{11111}$,
where the two $x$’s correspond to genotypes $11000$ and $10010$, the $y$’s to $10011$ and $11101$, and two letters are missing. Whether one can draw conclusions about fiveway epistasis or not, depends on the positions of the two missing genotypes, as well as the genotypes represented by $y$’s, whereas it is independent of the genotypes represented by $x$’s. Specifically, if genotype $11101$ has higher fitness than $10011$, genotype $10111$ has rank between 1 and 15, and genotype $11010$ has rank between 20 and 32, then the resulting rank order implies positive fiveway epistasis, that is, ${u}_{11111}>0$, for both possible options to resolve the ranking of genotypes $11000$ and $10010$ (Table 3).
Discussion
Gene interactions play a critical role in evolutionary processes. Important features of fitness landscapes, such as the number of peaks, and accessible evolutionary trajectories, depend on epistatic gene interactions. The importance of higher order versus pairwise epistasis, within and among genes or in noncoding regions, as well as the impact of higher order epistasis on evolutionary dynamics, remains a central research topic (Sailer and Harms, 2017b; Wu et al., 2016; Weinreich et al., 2013). Progress in all of these areas requires adequate mathematical and statistical approaches, in addition to empirical studies.
Here, we have developed new quantitative tools for detecting gene interactions from empirical data. The main advantage of our tools is that they can reveal gene interactions from the types of data frequently generated in empirical studies, specifically rank orders, fitness graphs, and general partial orders of genotypes. The reasons why, in practice, these types of data are available more often than precise fitness measurements for each genotype are manifold. They include restricted comparative experimental designs and known and unknown confounding factors in measuring fitness that can result in uncertain and biased estimates. The methods presented here allow for studying epistatic interactions even when direct fitness measurements are lacking or only a subset of pairwise fitness comparisons is available, either as the immediate outcome of the experiment or the reported summary.
We provide a complete characterization of rank orders that imply higher order epistasis, along with precise results for fitness graphs of threelocus systems. In principle, our approach applies to general partial orders as well, and we have implemented algorithms accordingly. However, because of the increasing computational complexity it would be desirable to have theoretical results for handling large systems. In particular, a characterization of fitness graphs that imply higher order epistasis is of independent mathematical interest.
We found that for biallelic threelocus systems, 40% of all possible rank orders and 37% of all possible fitness graphs imply higher order epistasis. These fractions suggest that our methods have a good capacity to detect higher order epistasis among three loci, even if exact and complete fitness measurements or estimates are not available.
The fraction of rank orders that imply $n$way epistasis decreases rapidly with increasing number of loci, $n$. However, many rank orders are informative regarding other additive dependence relations, for instance some circuits measuring conditional epistasis. This is clear from the observation that the proportion of rank orders that are compatible with additive fitness decreases rapidly with $n$.
Moreover, the power of our methods was demonstrated for a diverse set of biological systems. We detected higher order epistasis for HIV, malaria, the fungus Aspergillus Niger, and antibiotic resistance systems. Our findings suggest that genetic interactions beyond twoway epistasis shape the fitness landscapes of these genetic systems and may play an important role in determining their evolutionary trajectories. We also exhaustively investigated various types of higher order interactions in HIV1 and discovered a complex pattern of interactions, confirming that our approach is powerful enough to detect finer gene interactions. Specifically, we identified over twenty interactions by conventional approaches, and rank order methods detected about half of them.
Another important application of our method is to experimental design. When the information available in the data does not contradict an interaction, but is not conclusive enough to claim the interaction, for example because the number of performed competition experiments is too small, then the method allows for prioritizing further experiments by suggesting additional comparisons of genotypes. This feature may prove useful in guiding fitness experiments that aim for testing specific interactions and allow for iteration. We have developed this idea further in Lienkaemper et al. (2017), where we consider partial fitness orders of genotypes and develop efficient algorithms to detect genetic interactions, as well as study the geometry of such partial orders. Evolutionary aspects of partial orders and gene interactions are studied in Crona and Luo, 2017.
Genetic interactions, especially those of higher order, are particularly difficult to detect in highdimensional systems, where complete fitness measurements of all genotypes are infeasible. Human genomewide association studies (GWAS) are a prime example. Here, already the number of loci, $n$, and certainly the number of possible genotypes, ${2}^{n}$, is much larger than the actual number of genotyped and phenotyped individuals, even if the genotype data is summarized on the level of genes or haplotype blocks. Since most diseases are polygenic, rather than monogenic, genetic interactions play an important role, and accounting for them may explain some of the missing heritability and improve genetic disease models. Several methods have been proposed for detecting pairwise interactions in GWAS, most of them relying on scanning all or a prioritized subset of pairs of loci (Wei et al., 2014), but little is known about higher order interactions in these landscapes.
The methods presented in the present study may help addressing this challenge as they can sometimes reveal higher order interactions from a small number of comparisons, and the choice of genotypes to compare can be optimized if particular interactions are to be tested. Another advantage is the flexibility of our approach regarding the type of epistatic interaction analyzed. While we have focused on analyzing complete genetic systems, that is, $n$dimensional hypercubes, for small values of $n$ in this work, genotype spaces consisting of subsets of the ${2}^{n}$ possible genotypes have different sets of interactions, such as circuits, that are natural to consider. Towards this end, Huggins et al. (2007) have explored circuits and their sign patterns for genotype data from the HapMap project in two ENCODE regions. The Dyck word approach will be particularly useful if quantitative data on the phenotype is difficult to obtain, but rank order information is more accessible, for example by considering disease indicators, rather than the condition itself.
For a more theoretical perspective, we emphasize the distinction between rank orderinduced gene interactions, and interactions that do not change the rank order of genotypes. This distinction was pointed out by Weinreich et al., 2005 who introduced the term sign epistasis. If a system has sign epistasis, then the rank order of the genotypes is not compatible with additive fitness. Rank orderinduced gene interactions of any type can thus be regarded as analogues to sign epistasis.
There exist a number of possible ways to quantify and interpret higher order interactions (Weinreich et al., 2013; Beerenwinkel et al., 2007; Hallgrímsdóttir and Yuster, 2008), and our rank order approach applies to any type of gene interactions measured by linear forms. In particular, we can detect interactions as described by Fourier coefficients and Walsh coefficients. From our general argument based on Dyck words we investigated threelocus systems, and determined the number of rank orders that imply circuit interactions, including conditional and marginal epistasis, and similarly for interactions coordinates. The method works equally well for other interactions.
Further investigation of rank orderinduced interaction has the potential to relate global and local properties of fitness landscapes, similarly to results on sign epistasis (Weinreich et al., 2005; Poelwijk et al., 2011; Crona et al., 2013). Global properties concern peaks and mutational trajectories in the fitness landscape, whereas local properties concern, for instance, fitness graphs for small system. The relation between global and local properties is important since only local properties can be easily observed in experiments or nature.
A very useful feature of sign epistasis is that one can identify, or rule out, sign epistasis in a system from inspection of twolocus subsystems only. The theoretical significance and applicability of sign epistasis depends on its local nature. Fortunately, the signed versions of other gene interactions are sometimes local as well. For instance, it seems plausible that the absence of rank order induced conditional epistasis of specified orders (a local property) correlates with few peaks and good peak accessibility. In this spirit we explore some evolutionary consequences of higher order epistasis in Crona and Luo, 2017. Theory for sign epistasis stands as a model for further development in this area.
Although we have applied our method here only to fitness, any other continuous phenotype of interest can be analyzed in exactly the same manner. The fitness landscape $w$ is then replaced by a more general genotypetophenotype map. For example, rather than using it as a fitness proxy, one may be concerned about the drug resistance phenotype itself and its genetic architecture.
In summary, rank order methods have potential for the interpretation of empirical data, as well as for relating higher order gene interactions and evolutionary dynamics. Our approach facilitates detecting higher order epistasis from a very broad range of empirical data, and will therefore contribute to enhancing our general understanding of empirical fitness landscapes and epistatic gene interactions.
Materials and methods
Mathematical framework and proofs
Here we provide proofs for the results in the main text, and give a brief background on the discrete Fourier transform, Dyck words, and Catalan numbers. Catalan numbers (Stanley, 1999) have rarely been used in biology, so we describe them briefly without assuming any knowledge. Several arguments in the Materials and methods depend on elementary combinatorics, and the reader may consult a general text, such as Grimaldi (2006).
We start with rank orders and the total $n$way epistasis, followed by more general results on rank orders, circuits and other linear forms. The next topic is epistasis and fitness graphs, including some related graph theory. Finally we provide a few observations on epistasis and partial orders.
Gene interactions for a biallelic $n$locus system can be described in terms of the Fourier transform for ${({\mathbb{Z}}_{2})}^{n}$ defined as
By abuse of notation we will ignore the scaling factor $\frac{1}{{2}^{n1}}.$ We define interaction coordinates as the elements ${u}_{{i}_{1}{i}_{2}\mathrm{\dots}{i}_{n}}$ such that at least two entries in ${i}_{1}{i}_{2}\mathrm{\dots}{i}_{n}$ are 1. The interaction coordinate ${u}_{1\mathrm{\dots}1}$ measures the total $n$way epistasis,
In particular,
and
as defined in Equations 1 and 2 in the main text. A biallelic threelocus system has threeway epistasis exactly if ${u}_{111}\ne 0$. Otherwise the system has only pairwise interactions. Similarly, a biallelic $n$locus system has (total) $n$way epistasis exactly if ${u}_{1\mathrm{\dots}1}\ne 0$.
The remaining interaction coordinates of the threelocus system are
Weinreich et al. (2013) characterize epistatic interactions using Walsh coefficients, which are closely related to interaction coordinates. Specifically, the Walsh coefficients ${E}_{111}$, ${E}_{110}$, ${E}_{101}$, ${E}_{011}$ differ from the interaction coordinates ${u}_{111}$, ${u}_{110}$, ${u}_{101}$, ${u}_{011}$ only by a scalar. Here we ignore scalars, since we focus on the signs of the interactions coordinates only. It follows that all our results on interaction coordinates hold for Walsh coefficients as well.
Rank orders
Request a detailed protocolWe will determine the number of rank orders which imply $n$way epistasis. The proof depends on Catalan numbers and Dyck words (Stanley, 1999). Let ${C}_{i}$ denote the $i$^{th} Catalan number for $i\ge 0$, that is, ${C}_{i}=\frac{(2i)!}{(i+1)!i!}$. In particular, ${C}_{0}={C}_{1}=1,{C}_{2}=5$, ${C}_{3}=14$ and ${C}_{4}=42$. A Dyck word of length $2n$ in the letters $X$ and $Y$ is a string consisting of $n\phantom{\rule{thinmathspace}{0ex}}X$’s and $n\phantom{\rule{thinmathspace}{0ex}}Y$’s such that no initial segment of the string has more $Y$’s than $X$’s. For instance, the Dyck words of length $4$ are $XXYY$ and $XYXY$. The initial segments of $XXYY$ are $X$, $XX$, $XXY$, and $XXYY$.
Proposition 1. Consider a biallelic $n$locus system. The number of rank orders which imply $n$way epistasis is
Proof. There are $({2}^{n})!$ rank orders in total. Let ${e}_{i}$ denote the fitnesses of genotypes with an even number of $1$’s in the subscripts (${w}_{0\mathrm{\dots}0}$, ${w}_{110\mathrm{\dots}0}$, and so forth) and ${o}_{i}$ the fitnesses of genotypes with an odd number of $1$’s, ordered in such a way that ${e}_{i}>{e}_{i+1}$ and ${o}_{i}>{o}_{i+1}$ for all $i$. We will refer to even and odd elements from now on. Let ${u}_{1\mathrm{\dots}1}$ denote the interaction coordinate as defined above. Notice that ${u}_{1\mathrm{\dots}1}=0$ exactly if ${\sum}_{i}{e}_{i}{\sum}_{i}{o}_{i}=0$. Consequently a rank order implies positive $n$way epistasis (${u}_{1\mathrm{\dots}1}>0$) when the sum ${\sum}_{i}\left({e}_{i}{o}_{i}\right)$ is positive for all fitness landscapes compatible with the rank order. It is therefore sufficient to count such rank orders.
We define a map from fitness rank orders to words in the alphabet $\{e,o\}$ as follows: ${e}_{i}\mapsto e,{o}_{i}\mapsto o$. For instance, the order ${w}_{00}>{w}_{11}>{w}_{10}>{w}_{01}$ is mapped to $eeoo$. We claim that a rank order satisfies ${\sum}_{i}\left({e}_{i}{o}_{i}\right)>0$ exactly when it is mapped to a Dyck word (where $e$ precedes $o$).
It is immediate that ${\sum}_{i}\left({e}_{i}{o}_{i}\right)>0$ holds if the rank order is mapped to a Dyck word. Conversely, suppose that a rank order is not mapped to a Dyck word. Let $s$ be the least number such that the number of $o$’s exceeds the number of $e$’s for an initial segment of length $s$ (note that $s$ has to be odd in this case) and let $j=\frac{s+1}{2}$. Clearly one can make the sum of ${\sum}_{i=1}^{j}\left({e}_{i}{o}_{i}\right)$ negative for a particular choice of ${e}_{i}$ and ${o}_{i}$. By choosing the remaining numbers ${e}_{i},{o}_{i}$ sufficiently small, we get ${\sum}_{i}\left({e}_{i}{o}_{i}\right)<0$, which proves the claim.
It remains to count the rank orders where ${\sum}_{i}\left({e}_{i}{o}_{i}\right)>0$. Such rank orders are mapped to Dyck words (where $e$ precedes $o$) consisting of ${2}^{n1}\phantom{\rule{thinmathspace}{0ex}}X$’s and ${2}^{n1}\phantom{\rule{thinmathspace}{0ex}}Y$’s. There are ${C}_{{2}^{n1}}$ such Dyck words (Stanley, 1999). For each word there are $({2}^{n1})!\times ({2}^{n1})!$ fitness rank orders which map to the word. Indeed, one can choose the ordering of even and odd elements each in $({2}^{n1})!$ different ways.
In total there are ${C}_{{2}^{n1}}\times ({2}^{n1})!\times ({2}^{n1})!$ fitness rank orders such that ${\sum}_{i}\left({e}_{i}{o}_{i}\right)>0$ for all landscapes. By symmetry, the same number of fitness rank orders satisfy the negative epistasis condition ${\sum}_{i}\left({e}_{i}{o}_{i}\right)<0$. One verifies that
which completes the proof.□
A few observations in the proof of Proposition 1 are of interest. Importantly, the proof gives a computationally efficient method (linear in the number of genotypes) for checking if a rank order implies $n$way epistasis. Indeed, the rank order implies higher order epistasis exactly if it is mapped to a Dyck word. Moreover, the proposition states that $\frac{({2}^{n})!\times 2}{({2}^{n1}+1)}$ orders imply $n$way epistasis. From the proof it is clear that half of these orders imply positive $n$way epistasis (${u}_{1\mathrm{\dots}1}>0$) and the other half negative $n$way epistasis (${u}_{1\mathrm{\dots}1}<0$). Also, the proof points out some symmetries. If a rank order implies epistasis, then the same is true for rank orders obtained by (i) any permutation of the even elements, (ii) any permutation of the odd elements, and (iii) the flip obtained by replacing every “$<$” by “$>$” in the rank order. It follows that each rank order that implies threeway epistasis belongs to a class of $1152(=4!\cdot 4!\cdot 2)$ elements, which differ by the operations (i)–(iii) only.
Corollary 2. The fraction of rank orders that imply $n$way epistasis among all rank orders is
Proof. Since the number of all rank orders is $({2}^{n})!$, the result follows. □
The results on rank orders and epistasis for $2\le n\le 4$ are summarized in Table 1. Notice that the expression in the corollary approaches $\frac{1}{{2}^{n2}}$ for large $n$.
Interestingly, no integer sequence that starts with 16, $\mathrm{16\hspace{0.17em}128}$, $\mathrm{\dots}$ is available at The OnLine Encyclopedia of Integer Sequences (2016).
Circuits
Request a detailed protocolThe proof of Proposition 1 depends on the map defined from the rank orders to words in the alphabet $\{e,o\}$. We will use a generalization of the map in subsequent proofs. The starting point is a given linear form. The form determines a map from rank orders to words. Although the idea is closely related to the previous proof, we will work with positive and negative coefficients in the linear forms. For that reason, we will use $P$ and $N$ rather than $e$ and $o$ (even and odd is no longer meaningful).
We start with a clarifying example. Assume that a given linear form has integer coefficients and that the sum of its coefficients is zero. For instance, the form
defines a map ${\phi}^{m}$ as follows: Each of the variables ${w}_{001},{w}_{010},{w}_{100}$ corresponds to the letter $P$ (for positive), and the variable ${w}_{111}$ corresponds to $N$ (for negative). The variable ${w}_{000}$ corresponds to $NN$, because of the coefficient $2$. In this case, the rank order
is mapped to $NPNNPP$ under ${\phi}^{m}$. Specifically, starting from left ${w}_{111}$ corresponds to $N$, ${w}_{001}$ to $P$, ${w}_{000}$ to $NN$, ${w}_{100}$ to $P$, and ${w}_{100}$ to $P$. The remaining variables ${w}_{110},{w}_{101},{w}_{011}$ do not impact the word, since their coefficients are zero for the form $m$.
Definition 1. Let $f$ be a linear form with integer coefficients. Assume that the sum of its coefficients is zero. Let ${\phi}^{f}$ denote the map from a total order on the variables (a rank order) to words in the alphabet $\{P,N\}$ defined as follows: Each variable of $f$ with a positive integer coefficient $c$ corresponds to a substring of $c$ letters $P$. Each variable in $f$ with a negative integer coefficient ${c}^{\prime}$ corresponds to a substring of ${c}^{\prime}$ letters $N$. A rank order of the variables is mapped to the word consisting of the substrings obtained for each variable with nonzero coefficient in $f$. Specifically, the substrings (from left to right) of the word correspond to the variables in the rank order (from highest to lowest fitness).
The proof of Proposition 1 uses $e$ and $o$ instead of $P$ and $N$. However, notice that the map from rank orders to words in $e$’s and $o$’s is exactly ${\phi}^{{u}_{1\mathrm{\dots}1}}$ (modulo the labeling). The next result is a generalization of Proposition 1. The proof is similar in every step with the modification that ${\phi}^{{u}_{1\mathrm{\dots}1}}$ is replaced by ${\phi}^{f}$ for an arbitrary form $f$, so we omit the details.
Theorem 3. Let $f$ be a linear form with integer coefficients. Assume that the sum of its coefficients is zero. Then a rank order implies that $f$ is not zero if and only if it is mapped to a Dyck word by ${\phi}^{f}$.
We define additive dependence relations as linear forms that are zero for all additive landscapes. Theorem 3 applies to all additive dependence relations, because the coefficients of an additive dependence relation sum to zero. This fact explains why our Dyck wordbased method applies broadly. All we require is that an epistasis measure is defined by linear forms, as any such measure is zero on additive fitness landscapes. In particular, Theorem 1 applies to $n$way epistasis, interaction coordinates, and circuits. However, some approaches to epistasis are of a completely different type, for instance the approach based on Shannon entropy (Moore et al., 2006), in which case rank order methods may not apply.
Recall from the main text that $a={w}_{000}{w}_{010}{w}_{100}+{w}_{110}$ is a circuit. In particular, $a=0$ for all additive fitness landscapes. Moreover, $a$ is minimal with this property, in the sense that no linear form in a proper subset of $\{{w}_{000}$, ${w}_{010}$, ${w}_{100}$, ${w}_{110}\}$ equals zero for all additive landscapes. In general, circuits are defined as minimal (additive) dependence relations, in the sense that the set of ${w}_{g}$ which appear with nonzero coefficient is minimal with respect to inclusion.
There are $20$ circuits $a,\mathrm{\dots},t$ for the threelocus system (Beerenwinkel et al., 2007), namely
Before describing applications of Theorem 3 in more detail, we will compare different approaches to epistasis. As already noted, interaction coordinates (Beerenwinkel et al., 2007) and Walsh coefficients of order two or more (Weinreich et al., 2013) differ only by a scalar. However, circuits provide information of a different type. To see this, we consider the two circuits
which measure epistasis between the first and the second locus conditional on the third locus being fixed to 0 and 1, respectively. If $a=b$ for a system, then ${u}_{110}=0$ (and the Walsh coefficient ${E}_{110}=0$ as well), because ${u}_{110}=a+b$. If, in addition, $a=b$ is a large number, then the first and second loci have substantial interactions as measured by $a$ and $b$, yet the interaction coordinate ${u}_{110}$ captures only the average effect which is zero and would indicate no interaction.
Even if one knows the signs of all interaction coordinates ${u}_{111}$, ${u}_{110}$, ${u}_{101}$, and ${u}_{011}$, one may still be ignorant about important gene interactions. In contrast, the signs of all 20 circuits provide a more complete description of the gene interactions from a qualitative point of view. In this sense, it is natural to say that two fitness landscapes have similar gene interactions if their circuit sign patterns agree.
One type of circuits measures conditional epistasis, and they relate to interaction coordinates in an interesting way. More precisely, conditional epistasis concerns subsystem obtained by fixing a subset of coordinates at $0$ or $1$ and varying the remaining loci. Conditional epistasis for an $n$locus subsystem agrees with the total $n$way epistasis for the subsystem. In particular, the circuits $a$ and $b$ measure conditional epistasis. The circuit $a$ measures epistasis for the twolocus subsystem of genotypes with last coordinate $0$, and the circuit $b$ measures epistasis for the twolocus subsystem of genotypes with last coordinate at $1$. As mentioned, the interaction coordinate ${u}_{110}$ is the average of $a$ and $b$ (modulo a constant).
The relation between interaction coordinates and circuits is similar for larger systems. For instance, the circuit
measures conditional epistasis for the twolocus subsystem obtained by fixing the last two coordinates at zero. The interaction coordinate ${u}_{1100}$ measures the average effect of four different circuits that measure conditional epistasis. In summary, all interaction coordinates can be interpreted as averages of circuits expressing conditional epistasis.
Technically, the 20 circuits can be obtained as linear combinations of the interaction coordinates ${u}_{111}$, ${u}_{110}$, ${u}_{101}$, and ${u}_{011}$. However, none of the interaction coordinates are themselves circuits, since they do not satisfy the condition of being minimal.
The circuits $a,\mathrm{\dots},f$ all measure conditional twoway epistasis between two loci when the allele at the third locus is fixed. But there are other types of circuits. The circuits $g,\mathrm{\dots},l$ relate marginal epistasis of two pairs of loci, and the circuits $m,\mathrm{\dots},t$ relate the threeway interaction to the total twoway epistasis (Beerenwinkel et al., 2007).
For a given circuit, some rank orders imply that the circuit is positive, that is, the circuit is positive for all fitness values compatible with the rank order. Similarly, some rank orders imply that the circuit is negative, whereas the sign cannot be determined from other rank orders. We will use Theorem 3 to check whether a rank order determines the sign of a circuit or not.
Corollary 4. For the circuits $a\mathrm{,}\mathrm{\dots}\mathit{}l$, two thirds of all possible rank orders determine the sign of the circuit. For the circuits $m\mathrm{,}\mathrm{\dots}\mathrm{,}t$, one half of all possible rank orders determine the sign of the circuit.
Proof. Fix one of the circuits from $a$ to $l$ and a rank order. The circuit has exactly four variables with nonzero coefficients (for instance, for the circuit $a$ the variables are ${w}_{000}$, ${w}_{100}$, ${w}_{010}$, ${w}_{110}$, so that ${\phi}^{a}$ maps rank orders to fourletter words). By Theorem 3, the rank order implies that the circuit differs from zero when it is mapped to one of the Dyck words $PPNN$, $PNPN$, $NNPP$ or $NPNP$ under $\phi $, whereas the sign of the circuit is not determined when the word is $PNNP$ or $NPPN$. One concludes that the sign of a given circuit from $a$ to $l$ is determined for $2/3$ of the rank orders.
Using a similar argument, we consider words of length $6$ for the circuits labeled $m$ to $t$. There are in total $20$ words consisting of $3\phantom{\rule{thinmathspace}{0ex}}P$’s and $3\phantom{\rule{thinmathspace}{0ex}}N$’s. Ten of them are Dyck words. We conclude that the sign of a given circuit from $m$ to $t$ is determined for $1/2$ of the rank orders. □
In general, it is not possible to decompose the word obtained for analyzing $n$way epistasis into informative subunits. For example, as mentioned in the main text, the first half of the word $ooeeeooe$ is $ooee$, and it does not appear to reveal any interesting information about the system. On the other hand, if one knows that the word $ooeeeooe$ was obtained from the rank order
then one can identify meaningful parts of the word. For instance, consider the subsystem of genotypes with last coordinate $0$. The corresponding letters (the first, third, sixth and eighth letter of the word $ooeeeooe$) form the fourletter word $oeoe$, which implies that the corresponding subsystem has sign epistasis. Moreover, there is no connection between words used for analyzing threeway epistasis and the words representing Walshcoefficients. For instance, in order to analyze ${u}_{110}$ one maps the rank order above to $NPPNNNPP$, but the two words $ooeeeooe$ and $NPPNNNPP$ are unrelated.
The gene interactions for a biallelic threelocus system can be classified in terms of shapes of the fitness landscape, or triangulations of the 3cube (Beerenwinkel et al., 2007). There are $74$ shapes for the $3$cube. The shape of the fitness landscapes is determined by the signs of the 20 circuits. It follows that rank orders provide some information about possible shapes. However, the following result shows that rank orders do not determine shapes.
Proposition 5. Consider a threelocus biallelic system. No rank order determines the shape of a fitness landscape.
Proof. The result follows from the characterization of shapes for the 3cube in (Beerenwinkel et al., 2007), where each shape is described in terms of a circuit sign pattern. We verified computationally that no rank order implies that all the circuits have the signs which describe a particular shape (https://github.com/gavruskin/fitlands#analysisofrankorders) . More precisely, for every circuit $a,\mathrm{\dots},t$, we determined the set of all rank orders that imply that the circuit is positive or negative.
For every rank order, we then considered the circuit signs determined by the order. In no case did a rank order determine all the circuit signs necessary for describing a particular shape.□
The fact that rank orders do not determine the shape of a fitness landscape over a threelocus system is not surprising. Shapes reflect interactions in a very fine scaled way, whereas rank orders provide only coarse information.
Corollary 6. For each of the interaction coordinates ${u}_{\mathrm{110}}$, ${u}_{\mathrm{101}}$, and ${u}_{\mathrm{011}}$, the number of rank orders which determines its sign is 16,128.
Proof. The linear form for each interaction coordinate consists of $8$ elements, $4$ with positive signs and $4$ with negative signs. Notice that $16,128$ rank orders imply threeway epistasis, by Proposition 1. By Theorem 3 the problem can be reduced to counting Dyck words of length $8$. It follows that the number of rank orders is $16,128$ for each interaction coordinate.□
Note that the sign of a given interaction coordinate is determined for $16,128$ out of $40,320$ rank orders, that is $2/5$ or all rank orders. As mentioned, the Walsh coefficients ${E}_{110}$, ${E}_{101}$, ${E}_{011}$ differ from the interaction coordinates ${u}_{110}$, ${u}_{101}$, ${u}_{011}$ only by a scalar, so that Corollary 6 applies to the coefficients as well.
Partial orders and fitness graphs
Request a detailed protocolWe now consider partial orders, for instance,
for a threelocus system. Arguing as in the proof of Proposition 1, the (unknown) total order is mapped to the word $oxxxxeee$ under ${\phi}^{{u}_{1\mathrm{\dots}1}}$, where $xxxx$ is some permutation of $eooo$. For any such permutation we get a Dyck word. It follows that the system has threeway epistasis. This condition can be stated and proved in a more general form.
Proposition 7. Consider an $n$locus biallelic system. Let ${e}_{i}$ and ${o}_{i}$ be defined as in the proof of Proposition 1. If there exists a partition of the total set of fitness values into pairs $\mathrm{(}{e}_{i}\mathrm{,}{o}_{i}\mathrm{)}$, where ${e}_{i}\mathrm{>}{o}_{i}$ for all $i$, then one can conclude $n$way epistasis. By symmetry, the same is true for a partition where ${e}_{i}\mathrm{<}{o}_{i}$ for each pair.
Proof. We will verify that the existence of a partition as described is equivalent to the order being mapped to a Dyck word under the map ${\phi}^{{u}_{1\mathrm{\dots}1}}$. It is immediate that the existence of such a partition implies that the order is mapped to a Dyck word. Conversely, if the rank order is mapped to a Dyck word under ${\phi}^{{u}_{1\mathrm{\dots}1}}$, then one can construct a partition as follows. One pair in the partition corresponds to the first $e$ and the first $o$ in the Dyck word, a second pair corresponds to the second $e$ and the second $o$ in the word, and so forth. This partition has the desired property.□
A fitness graph is a directed acyclic graph where each node represents a genotype, and arrows connect each pair of mutational neighbors, directed toward the node representing the genotype of higher fitness. Moreover, fitness graphs are structured so that the node labeled $0\mathrm{\dots}0$ is at the bottom, genotypes with exactly one $1$ on the level above, and so forth (see Figure 6).
Our systematic analysis of fitness graphs takes advantage of the fact that some graphs are isomorphic, that is, there exists an edge preserving bijection between the nodes of the graphs. In biological terms, an isomorphism can be considered a relabeling of the genotypes such that mutational neighbors stay neighbors and the direction of arrows indicating higher fitness is preserved. For example, Figure 5 shows two isomorphic fitness graphs.
The analysis of the twolocus case is straightforward. An arbitrary fitness graph is isomorphic to a graph where $00$ has the lowest fitness. There are four fitness graphs satisfying the assumption. Indeed, two of the arrows point up, so that there are in total $2\times 2=4$ possible fitness graphs depending on the directions of the remaining arrows (Figure 3). By inspection, two of the graphs in the figure are isomorphic. Consequently, there are three different fitness graphs for twolocus systems up to isomorphism.
Some fitness graphs imply epistasis, whereas other fitness graphs are compatible with additive fitness. As illustrated in the twolocus case, a fitness graph is compatible with additive fitness if all arrows point up, that is toward a higher level. More generally, a fitness graph implies epistasis unless it is isomorphic to a graph where all arrows point up. Indeed, the graph implies sign epistasis unless such an isomorphism exists. (Weinreich et al., 2005; Crona et al., 2013).
Accordingly, we can characterize rank orders that are compatible with fitness graphs with all arrows up. After relabeling genotypes, we can assume that the genotype $0\mathrm{\dots}0$ has the lowest fitness in the system. Then a rank order is compatible with a fitness graph with all arrows up, exactly if for each genotype replacing $0$ by $1$ results in higher fitness. For instance, ${w}_{00}<{w}_{10}<{w}_{01}<{w}_{11}$ is compatible with such a graph whereas the rank order ${w}_{00}<{w}_{11}<{w}_{01}<{w}_{10}$ is not.
If $000$ has the lowest fitness in the system, one can verify that exactly 48 rank orders are compatible with the fitness graph with all arrows up. It follows that in total $8\times 48=384$ rank orders are compatible with such graphs since there are eight genotypes in a threelocus system, each of which can have lowest fitness.
Interestingly, the same result can be obtained from theory on houseofcards landscapes. Since all rank orders are equally likely under this statistical fitness landscape model, the fraction of rank orders that imply sign epistasis agrees with the probability of sign epistasis. This probability is $\frac{104}{105}$ (Schmiegelt and Krug 2014, Table 2). It follows that $8!\times \frac{1}{105}=384$ rank orders are compatible with fitness graphs with all arrows up, that is, the total number of rank orders multiplied by the fraction of rank orders compatible with such graphs.
As we have already seen, rank orders have potential far beyond detecting whether or not there is epistasis in a system. The same is true for fitness graphs, and we proceed with higher order interactions. In order to analyze fitness graphs and threeway epistasis, we consider the set of rank orders compatible with a given fitness graphs. For instance, the fitness graph in Figure 10 is compatible with the following two rank orders:
The first order implies threeway epistasis (it is mapped to $oeoooeee$ under ${\phi}^{{u}_{1,\mathrm{\dots},1}}$) and the second does not (it is mapped to $eooooeee$ under ${\phi}^{{u}_{1,\mathrm{\dots},1}}$). We conclude that in this case, the fitness graph does not imply higher order epistasis. However, if every rank order compatible with the fitness graph implies higher order epistasis, then the fitness graph itself does imply higher order epistasis. More generally, the same observation holds for any partial order.
Remark. A partial order implies higher order epistasis exactly if all its total extensions imply higher order epistasis.
Indeed, if all total extensions imply higher order epistasis, then in particular the (unknown) rank order does. The converse holds by definition.
Consequently, one can in principle determine if a fitness graph implies higher order epistasis by checking all of the compatible rank orders. For a systematic study of the threelocus case, it is convenient to reduce the problem to isomorphic graphs. Figure 5 shows two isomorphic fitness graphs.
As mentioned in the main text, there are in total $1,862$ fitness graphs for threelocus systems, and the number of fitness graphs that imply higher order epistasis is $698$ (37 percent). Up to isomorphism there are in total $54$ fitness graphs, and $20$ graphs imply higher order epistasis. This result was verified by reducing the study of all $1,862$ graphs for threelocus systems to a nonredundant list of 54 graphs, such that no two graphs in the list are isomorphic. The fact that the total number of graphs is $1,862$ follows from general theory on acyclic graphs (Stanley, 2006), or can be verified computationally (see below).
Isomorphisms between threelocus systems have a geometric interpretation. The fitness graph can be regarded as a threedimensional cube, with vertices corresponding to genotypes and edges corresponding to arrows. The group of isomorphisms (see below) then corresponds to the symmetry group of the three dimensional cube (Coxeter, 1973). Indeed, it was by way of this equivalence that we carried out the enumeration described above.
For clarity, we give a more explicit description of the cube isomorphisms. Any isomorphism can be constructed as a composition of the following two transformations: (i) interchange of labels of the pair of alleles at a locus, and (ii) change of order of the loci in the bitstring representation of a genotype. There are in total fortyeight isomorphisms of the cube, including the identity transformation which leaves the cube unchanged. Figure 5 is an example of such a transformation, where at the first locus the labels 0 and 1 have been swapped, and the second and third loci have been interchanged. The code used for verifying the isomorphisms is available at https://github.com/devingreene/3cubepartialordercount.git.
A cube has 12 edges, so that the total number graphs on the cube (graphs similar to fitness graphs, but cycles are allowed) is ${2}^{12}=4096$. After exclusion of graphs with cycles, $1,862$ graphs remain. An arbitrary graph is isomorphic to a graph where $000$ has the lowest fitness. This relabeling reduces the number of graphs one has to consider substantially, as in the twolocus case. The list of remaining graphs can be reduced further using the isomorphisms described above to finally obtain 54 graphs (Figure 3).
Graph theoretical aspects
Request a detailed protocolAs mentioned in the main text, the $20$ graphs which imply higher order epistasis (see Figure 6) constitute a diverse category. We analyzed the category from a graph theoretical point of view, but could not see that the graphs have any property which singles them out.
Recall that a unique sink orientation is a graph where each face has no more than one sink. Equivalently, there is no subsystems with reciprocal sign epistasis (Crona et al., 2013; Poelwijk et al., 2007). The category of 20 graphs includes unique sink orientations (also called USO or AOF graph s), as well as nonUSO’s. Moreover, in the terminology of Gärtner and Kaibel, 1998, the category includes separable and nonseparable graphs, as well as realizable and nonrealizable graphs.
There were some indications of higher complexity for the category, but only in a statistical sense. Indeed, as can be verified from Figure 6, the graphs in the category have on average 1.8 sinks (a sink corresponds to a peak in the landscape), whereas the average number of sinks for all graphs is 1.6. Moreover, $5$ out of the $20$ graphs (25 percent) in the category are unique sink orientations, whereas in total $19$ out of the $54$ graphs (35 percent) are unique sink orientations.
Even though the category of fitness graphs which implies epistasis is diverse, it is still possible that a characterization exists. This is an open problem.
Software and HIV1 study
Request a detailed protocolWe have implemented algorithms based on our theoretical results in an open source software package (https://github.com/gavruskin/fitlands#fitlands). The package provides software for detecting gene interactions as described in the main text for two and threelocus systems. Furthermore, algorithms for detecting total $n$way epistasis, three and fourway interaction coordinates and threeway circuit interactions have been implemented. The documentation also explains how to reproduce results for our application to HIV1 data described in the main text.
The results of Student’s ttest explained in the main text are summarized in Table 1, and for related code see https://github.com/gavruskin/fitlands/blob/master/HIV_2007_conventional_analysis.ipynb
References

Evidence for positive epistasis in HIV1Science 306:1547–1550.https://doi.org/10.1126/science.1101786

The peaks and geometry of fitness landscapesJournal of Theoretical Biology 317:1–10.https://doi.org/10.1016/j.jtbi.2012.09.028

Empirical fitness landscapes and the predictability of evolutionNature Reviews Genetics 15:480–490.https://doi.org/10.1038/nrg3744

Evolutionary accessibility of mutational pathwaysPLoS Computational Biology 7:e1002134.https://doi.org/10.1371/journal.pcbi.1002134

The changing geometry of a fitness landscape along an adaptive walkPLoS Computational Biology 10:e1003520.https://doi.org/10.1371/journal.pcbi.1003520

ReportAbstract Objective Function Graphs on the 3Cube: A Classification by RealizabilityUniversity of Cologne.

Toward the human genotopeBulletin of Mathematical Biology 69:2723–2735.https://doi.org/10.1007/s1153800792447

Enzyme Efficiency but Not Thermostability Drives Cefotaxime Resistance Evolution in TEM1 βLactamaseMolecular Biology and Evolution 34:1040–1054.https://doi.org/10.1093/molbev/msx053

Exact results for amplitude spectra of fitness landscapesJournal of Theoretical Biology 332:218–227.https://doi.org/10.1016/j.jtbi.2013.05.002

Steering Evolution with Sequential Therapy to Prevent the Emergence of Bacterial Antibiotic ResistancePLoS Computational Biology 11:e1004493.https://doi.org/10.1371/journal.pcbi.1004493

Adaptive landscape by environment interactions dictate evolutionary dynamics in models of drug resistancePLOS Computational Biology 12:e1004710.https://doi.org/10.1371/journal.pcbi.1004710

Fitness and its role in evolutionary geneticsNature Reviews Genetics 10:531–539.https://doi.org/10.1038/nrg2603

Reciprocal sign epistasis is a necessary condition for multipeaked fitness landscapesJournal of Theoretical Biology 272:141–144.https://doi.org/10.1016/j.jtbi.2010.12.015

Functional origins of fitness effectsizes of compensatory mutations in the DNA bacteriophage phiX174Evolution; International Journal of Organic Evolution 60:2032–2043.

Highorder epistasis shapes evolutionary trajectoriesPLOS Computational Biology 13:e1005541.https://doi.org/10.1371/journal.pcbi.1005541

Mutational fitness effects in RNA and singlestranded DNA viruses: common patterns revealed by sitedirected mutagenesis studiesPhilosophical Transactions of the Royal Society B: Biological Sciences 365:1975–1982.https://doi.org/10.1098/rstb.2010.0063

Relating HIV1 Sequence Variation to Replication Capacity via Trees and ForestsStatistical Applications in Genetics and Molecular Biology 3:1–18.https://doi.org/10.2202/15446115.1031

BookEnumerative combinatorics, 2Cambridge: Cambridge University Press.https://doi.org/10.1017/CBO9780511609589

Acyclic orientations of graphsDiscrete Mathematics 306:905–909.https://doi.org/10.1016/j.disc.2006.03.010

Quantitative analyses of empirical fitness landscapesJournal of Statistical Mechanics: Theory and Experiment 2013:P01005.https://doi.org/10.1088/17425468/2013/01/P01005

Detecting epistasis in human complex traitsNature Reviews Genetics 15:722–733.https://doi.org/10.1038/nrg3747

Should evolutionary geneticists worry about higherorder epistasis?Current Opinion in Genetics & Development 23:700–707.https://doi.org/10.1016/j.gde.2013.10.007

The roles of mutation, inbreeding, crossbreeding, and selection in evolutionProc 6th Int. Cong. Genet 1:356–366.
Article and author information
Author details
Funding
No external funding was received for this work
Acknowledgements
KC would like to thank Mr Dong Zhou for his study on published malaria data. We thank the reviewers for their comments, in particular regarding houseofcards landscapes. This work was done in part while the authors were visiting the Simons Institute for the Theory of Computing.
Version history
 Received: May 15, 2017
 Accepted: November 21, 2017
 Version of Record published: December 20, 2017 (version 1)
Copyright
© 2017, Crona et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics

 2,629
 Page views

 286
 Downloads

 21
 Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading

 Cell Biology
 Computational and Systems Biology
Computer models of the human ventricular cardiomyocyte action potential (AP) have reached a level of detail and maturity that has led to an increasing number of applications in the pharmaceutical sector. However, interfacing the models with experimental data can become a significant computational burden. To mitigate the computational burden, the present study introduces a neural network (NN) that emulates the AP for given maximum conductances of selected ion channels, pumps, and exchangers. Its applicability in pharmacological studies was tested on synthetic and experimental data. The NN emulator potentially enables massive speedups compared to regular simulations and the forward problem (find drugged AP for pharmacological parameters defined as scaling factors of control maximum conductances) on synthetic data could be solved with average rootmeansquare errors (RMSE) of 0.47 mV in normal APs and of 14.5 mV in abnormal APs exhibiting early afterdepolarizations (72.5% of the emulated APs were alining with the abnormality, and the substantial majority of the remaining APs demonstrated pronounced proximity). This demonstrates not only very fast and mostly very accurate AP emulations but also the capability of accounting for discontinuities, a major advantage over existing emulation strategies. Furthermore, the inverse problem (find pharmacological parameters for control and drugged APs through optimization) on synthetic data could be solved with high accuracy shown by a maximum RMSE of 0.22 in the estimated pharmacological parameters. However, notable mismatches were observed between pharmacological parameters estimated from experimental data and distributions obtained from the Comprehensive in vitro Proarrhythmia Assay initiative. This reveals larger inaccuracies which can be attributed particularly to the fact that small tissue preparations were studied while the emulator was trained on single cardiomyocyte data. Overall, our study highlights the potential of NN emulators as powerful tool for an increased efficiency in future quantitative systems pharmacology studies.

 Computational and Systems Biology
 Neuroscience
Closedloop neuronal stimulation has a strong therapeutic potential for neurological disorders such as Parkinson’s disease. However, at the moment, standard stimulation protocols rely on continuous openloop stimulation and the design of adaptive controllers is an active field of research. Delayed feedback control (DFC), a popular method used to control chaotic systems, has been proposed as a closedloop technique for desynchronisation of neuronal populations but, so far, was only tested in computational studies. We implement DFC for the first time in neuronal populations and access its efficacy in disrupting unwanted neuronal oscillations. To analyse in detail the performance of this activity control algorithm, we used specialised in vitro platforms with high spatiotemporal monitoring/stimulating capabilities. We show that the conventional DFC in fact worsens the neuronal population oscillatory behaviour, which was never reported before. Conversely, we present an improved control algorithm, adaptive DFC (aDFC), which monitors the ongoing oscillation periodicity and selftunes accordingly. aDFC effectively disrupts collective neuronal oscillations restoring a more physiological state. Overall, these results support aDFC as a better candidate for therapeutic closedloop brain stimulation.