Quantifying concordant genetic effects of de novo mutations on multiple disorders
Abstract
Exome sequencing on tens of thousands of parent-proband trios has identified numerous deleterious de novo mutations (DNMs) and implicated risk genes for many disorders. Recent studies have suggested shared genes and pathways are enriched for DNMs across multiple disorders. However, existing analytic strategies only focus on genes that reach statistical significance for multiple disorders and require large trio samples in each study. As a result, these methods are not able to characterize the full landscape of genetic sharing due to polygenicity and incomplete penetrance. In this work, we introduce EncoreDNM, a novel statistical framework to quantify shared genetic effects between two disorders characterized by concordant enrichment of DNMs in the exome. EncoreDNM makes use of exome-wide, summary-level DNM data, including genes that do not reach statistical significance in single-disorder analysis, to evaluate the overall and annotation-partitioned genetic sharing between two disorders. Applying EncoreDNM to DNM data of nine disorders, we identified abundant pairwise enrichment correlations, especially in genes intolerant to pathogenic mutations and genes highly expressed in fetal tissues. These results suggest that EncoreDNM improves current analytic approaches and may have broad applications in DNM studies.
Editor's evaluation
Lu et al. provide a powerful statistical method that measures excess sharing of de novo mutations between pairs of disorders. This method extends the concept of 'genetic correlation' to disorders caused by de-novo mutations, measuring the correlation in excess de-novo mutations in genome-wide genes for different classes of mutations. The authors apply the method to nine disorders including a developmental disorder, autism spectrum disorder, congenital heart disease, schizophrenia, and intellectual disability, finding a statistically significant overlap between 12 pairs of disorders in de novo mutations that cause a loss of gene function. This method will be of interest to researchers working on disorders caused by de-novo mutations.
https://doi.org/10.7554/eLife.75551.sa0Introduction
De novo mutations (DNMs) can be highly deleterious and provide important insights into the genetic cause for disease (Veltman and Brunner, 2012). As the cost of sequencing continues to drop, whole-exome sequencing (WES) studies conducted on tens of thousands of family trios have pinpointed numerous risk genes for a variety of disorders (Lelieveld et al., 2016; Kaplanis et al., 2020; Satterstrom et al., 2020). In addition, accumulating evidence suggests that risk genes enriched for pathogenic DNMs may be shared by multiple disorders (Hoischen et al., 2014; Fromer et al., 2014; Homsy et al., 2015; Li et al., 2016; Nguyen et al., 2020). These shared genes could reveal biological pathways that play prominent roles in disease etiology and shed light on clinically heterogeneous yet genetically related diseases (Homsy et al., 2015; Li et al., 2016; Nguyen et al., 2020).
Most efforts to identify shared risk genes directly compare genes that are significantly associated with each disorder (Nguyen et al., 2017; Willsey et al., 2018). There have been some successes with this approach in identifying shared genes and pathways (e.g. chromatin modifiers) underlying developmental disorder (DD), autism spectrum disorder (ASD), and congenital heart disease (CHD), thanks to the large trio samples in these studies (Kaplanis et al., 2020; Satterstrom et al., 2020; Jin et al., 2017), whereas findings in smaller studies remain suggestive (Allen et al., 2013; Jin et al., 2020b). Even in the largest studies to date, statistical power remains moderate for risk genes with weaker effects (Kaplanis et al., 2020; Howrigan et al., 2020). It is estimated that more than 1000 haploinsufficient genes contributing to developmental disorder risk have not yet achieved statistical significance in large WES studies (Kaplanis et al., 2020). Therefore, analytic approaches that only account for top significant genes cannot capture the full landscape of genetic sharing in multiple disorders. Recently, a Bayesian framework named mTADA was proposed to jointly analyze DNM data of two diseases and improve risk gene mapping (Nguyen et al., 2020). Although mTADA produces estimates for the proportion of shared risk genes, the statistical property of these parameter estimates has not been studied. There is a pressing need for powerful, robust, and interpretable methods that quantify concordant DNM association patterns for multiple disorders using exome-wide DNM counts.
Recent advances in estimating genetic correlations using summary data from genome-wide association studies (GWAS) may provide a blueprint for approaching this problem in DNM research (Zhang et al., 2021a). Modeling ‘omnigenic’ associations as independent random effects, linear mixed-effects models leverage genome-wide association profiles to quantify the correlation between additive genetic components of multiple complex traits (Lee et al., 2012; Bulik-Sullivan et al., 2015; Lu et al., 2017; Ning et al., 2020). These methods have identified ubiquitous genetic correlations across many human traits and revealed significant and robust genetic correlations that could not be inferred from significant GWAS associations alone (Shi et al., 2017; Brainstorm, 2018; Guo et al., 2021; Zhang et al., 2021b).
Here, we introduce EncoreDNM (Enrichment correlation estimator for De Novo Mutations), a novel statistical framework that leverages exome-wide DNM counts, including genes that do not reach exome-wide statistical significance in single-disorder analysis, to estimate concordant DNM associations between disorders. EncoreDNM uses a generalized linear mixed-effects model to quantify the occurrence of DNMs while accounting for de novo mutability of each gene and technical inconsistencies between studies. We demonstrate the performance of EncoreDNM through extensive simulations and analyses of DNM data of nine disorders.
Results
Method overview
DNM counts in the exome deviate from the null (i.e. expected counts based on de novo mutability) when mutations play a role in disease etiology. Disease risk genes will show enrichment for deleterious DNMs in probands and non-risk genes may be slightly depleted for DNM counts. Our goal is to estimate the correlation of such deviation between two disorders, which we refer to as the DNM enrichment correlation. More specifically, we use a pair of mixed-effects Poisson regression models (Munkin and Trivedi, 1999) to quantify the occurrence of DNMs in two studies.
Here, are the DNM counts for the i-th gene and are the number of parent-proband trios in two studies, respectively. The log Poisson rates of DNM occurrence are decomposed into three components: the elevation component, the background component, and the deviation component. The elevation component () is a fixed effect term adjusting for systematic, exome-wide bias in DNM counts. One example of such bias is the batch effect caused by different sequencing and variant calling pipelines in two studies. The elevation parameter tends to be positive when DNMs are over-called with higher sensitivity and negative when DNMs are under-called with higher specificity (Wei et al., 2015). The background component is a gene-specific fixed effect that reflects the expected mutation counts determined by the genomic sequence context under the null (Samocha et al., 2014). is the de novo mutability for the i-th gene, and and are the expected DNM counts in the i-th gene under the null in two studies. The deviation component is a gene-specific random effect that quantifies the deviation of DNM profile from what is expected under the null (i.e. no risk genes for the disorder). and follow a multivariate normal distribution with dispersion parameters and and a correlation . A larger value of the dispersion parameter indicates a more substantial deviation from the null. That is, DNM counts show strong enrichment in some genes and depletion in other genes compared to the expectation based on de novo mutability. A smaller value of suggests that the DNM count data is well in line with what is expected based on the null model. DNM enrichment correlation is denoted by and is our main parameter of interest. It quantifies the concordance of DNM burden in two disorders.
Parameters in this model can be estimated using a Monte Carlo maximum likelihood estimation (MLE) procedure. Standard errors of the estimates are obtained through inversion of the observed Fisher information matrix. In practice, we use annotated DNM data as input and fit mixed-effects Poisson models for each variant class separately: loss of function (LoF), deleterious missense (Dmis, defined as MetaSVM-deleterious), tolerable missense (Tmis, defined as MetaSVM-tolerable), and synonymous (Figure 1). More details about model setup and parameter estimation are discussed in Materials and methods.
Simulation results
We conducted simulations to assess the parameter estimation performance of EncoreDNM in various settings. We focused on two variant classes, that is, Tmis and LoF variants, since they have the highest and lowest median mutabilities in the exome. We used EncoreDNM to estimate the elevation parameter , dispersion parameter , and enrichment correlation (Materials and methods). Under various parameter settings, EncoreDNM always provided unbiased estimation of the parameters (Figure 2 and Figure 2—figure supplements 1–2). Furthermore, the 95% Wald confidence intervals achieved coverage rates close to 95% under all simulation settings, demonstrating the effectiveness of EncoreDNM to provide accurate statistical inference.

Parameter estimation results of EncoreDNM.
(a) Boxplot of estimates in single-trait analysis with fixed at 0.75. (b) Boxplot of estimates in single-trait analysis with fixed at –0.25. (c) Boxplot of estimates in cross-trait analysis with and fixed at –0.25 and 0.75. True parameter values are marked by dashed lines. The number above each box represents the coverage rate of 95% Wald confidence intervals. Each simulation setting was repeated 100 times.
Next, we compared the performance of EncoreDNM with mTADA (Nguyen et al., 2020), a Bayesian framework that estimates the proportion of shared risk genes for two disorders. First, we simulated DNM data under the mixed-effects Poisson model. We evaluated two methods across a range of combinations of elevation parameter, dispersion parameter, and sample size for two disorders. The false positive rates for our method were well-calibrated in all parameter settings, but mTADA produced false positive findings when the observed DNM counts were relatively small (e.g. due to reduced elevation or dispersion parameters or a lower sample size; Figure 3a). We also assessed the statistical power of two approaches under a baseline setting where false positives for both methods were controlled. As enrichment correlation increased, EncoreDNM achieved universally greater statistical power compared to mTADA (Figure 3b).

Comparison of EncoreDNM and mTADA.
(a) False positive rates under a mixed-effects Poisson regression model. (b) Statistical power of two methods under a mixed-effects Poisson regression model as the enrichment correlation increases. Parameters () were fixed at (–0.25, 0.75, 5000) for both disorders. (c) False positive rates under a multinomial model. (d) Statistical power under a multinomial model with varying proportion of shared causal genes. Parameters () were fixed at (0.95, 0.25, 5000) for both disorders. Each simulation setting was repeated 100 times.
To ensure a fair comparison, we also considered a mis-specified model setting where we randomly distributed the total DNM counts for each disorder into all genes with an enrichment in causal genes (Materials and methods). EncoreDNM showed well-controlled false positive rate across all simulation settings, whereas severe inflation of false positives arose for mTADA when the total mutation count, the proportion of probands that can be explained by DNMs, or the sample size were small (Figure 3c). Furthermore, we compared the statistical power of two methods under this model in a baseline setting where false positive rate was controlled. EncoreDNM showed higher statistical power compared to mTADA as the fraction of shared causal genes increased (Figure 3d).
Pervasive enrichment correlation of damaging DNMs among developmental disorders
We applied EncoreDNM to DNM data of nine disorders (Supplementary file 1-STable 1; Materials and methods): developmental disorder (n=31,058; number of trios; Kaplanis et al., 2020), autism spectrum disorder (n=6430; Satterstrom et al., 2020), schizophrenia (SCZ; n=2772; Howrigan et al., 2020), congenital heart disease (n=2645; Jin et al., 2017), intellectual disability (ID; n=820; Lelieveld et al., 2016), Tourette disorder (TD; n=484) Willsey et al., 2017, epileptic encephalopathies (EP; n=264; Allen et al., 2013), cerebral palsy (CP; n=250; Jin et al., 2020b), and congenital hydrocephalus (CH; n=232; Jin et al., 2020a). In addition, we also included 1789 trios comprising healthy parents and unaffected siblings of autism probands as controls (Krumm et al., 2015).
We first performed single-trait analysis under the mixed-effects Poisson model for each disorder. The estimated elevation parameters (i.e. ) were negative for almost all disorders and variant classes (Figure 4a), with LoF variants showing particularly lower parameter estimates. This may be explained by more stringent quality control in LoF variant calling (Jin et al., 2017) and potential survival bias (Lek et al., 2016). It is also consistent with a depletion of LoF DNMs in healthy control trios (Homsy et al., 2015). The dispersion parameter estimates (i.e. ) were higher for LoF variants than other variant classes (Figure 4b), which is consistent with our expectation that LoF variants have stronger effects on disease risk and should show a larger deviation from the null mutation rate in disease probands. We also compared the goodness of fit of our proposed mixed-effects Poisson model to a simpler fixed-effects model without the deviation component (Materials and methods). The expected distribution of recurrent DNM counts showed substantial and statistically significant improvement under the mixed-effects Poisson model (Figure 4c–f, Figure 4—figure supplement 1, and Supplementary file 1-STable 2).

Model fitting results for nine disorders.
(a, b) Estimation results of and for nine disorders and four variant classes. Error bars represent 1.96*standard errors. Sample sizes of DNM datasets for each disorder are provided in Supplementary file 1-STable 1. (c–f) Distribution of DNM events per gene in four variant classes for developmental disorder. Red and green bars represent the expected frequency of genes under the fixed-effects and mixed-effects Poisson regression models, respectively. Blue bars represent the observed frequency of genes.
Next, we estimated pairwise DNM enrichment correlations for 9 disorders. In total, we identified 25 pairs of disorders with significant correlations at a false discovery rate (FDR) cutoff of 0.05 (Figure 5 and Figure 5—figure supplement 1), including 12 significant correlations for LoF variants, 7 for Dmis variants, 5 for Tmis variants, and only 1 significant correlation for synonymous variants. Notably, all significant correlations are positive (Supplementary file 1-STable 3). No significant correlation was identified between any disorder and healthy controls (Figure 5—figure supplement 2). This is consistent with our expectation, since DNMs in the control groups will distribute proportionally according to the de novo mutability without showing enrichment in certain genes. The number of identified significant correlations for each disorder was proportional to the sample size in each study (Spearman correlation = 0.70) with controls being a notable outlier (Figure 5—figure supplement 3).

EncoreDNM identifies pervasive enrichment correlations of damaging DNMs among nine disorders.
(a) Shows sample size (for example, number of trios) for each disease. X-axis denotes sample size on the log scale. (b) Heatmap of enrichment correlations for LoF (upper triangle) and synonymous (lower triangle) DNMs among nine disorders. Larger squares represent more significant p-values, and deeper color represents stronger correlations. Significant correlations (FDR <0.05) are shown as full-sized squares marked by asterisks.
We identified highly concordant and significant LoF DNM enrichment among developmental disorder, autism, intellectual disability, and congenital heart disease, which is consistent with previous reports (Li et al., 2016; Nguyen et al., 2020; Nguyen et al., 2017; Hormozdiari et al., 2015). Schizophrenia shows highly significant LoF correlations with developmental disorder (p=2.0e-3) and intellectual disability (3.7e-5). The positive enrichment correlation between autism and cerebral palsy in LoF variants (=0.81, p=3.3e-3) is consistent with their co-occurrence (Christensen et al., 2014). The high enrichment correlation between intellectual disability and cerebral palsy in LoF variants (=0.68, p=1.0e-4) is consistent with the associations between intellectual disability and motor or non-motor abnormalities caused by cerebral palsy (Reid et al., 2018). A previous study also suggested significant genetic sharing of intellectual disability and cerebral palsy by overlapping genes harboring rare damaging variants (Jin et al., 2020b). Here, we obtained consistent results after accounting for de novo mutabilities and potential confounding bias.
Some significant correlations identified in our analysis are consistent with phenotypic associations in epidemiological studies, but have not been reported using genetic data to the extent of our knowledge. For example, the LoF enrichment correlation between congenital heart disease and cerebral palsy (=0.88, p=1.7e-3) is consistent with findings that reduced supply of oxygenated blood in fetal brain due to cardiac malformations may be a risk factor for cerebral palsy (Garne et al., 2008). The enrichment correlation between intellectual disability and congenital hydrocephalus in LoF variants (=0.63, p=2.4e-3) is consistent with lower intellectual performance in a proportion of children with congenital hydrocephalus (Lumenta and Skotarczak, 1995).
Genes showing pathogenic DNMs in multiple disorders may shed light on the mechanisms underlying enrichment correlations (Supplementary file 1-STable 4). We identified five genes (CTNNB1, NBEA, POGZ, SPRED2, and KMT2C) with LoF DNMs in five different disorders and 21 genes had LoF DNMs in four disorders (Supplementary file 1-STable 5). These 26 genes with LoF variants in at least four disorders were significantly enriched for 63 gene ontology (GO) terms with FDR <0.05 (Supplementary file 1-STable 6). Chromatin organization (p=7.8e-11), nucleoplasm (p=2.8e-10), chromosome organization (p=6.8e-10), histone methyltransferase complex (p=1.4e-9), and positive regulation of gene expression (p=2.2e-9) were the most significantly enriched GO terms. One notable example consistently included in these gene sets is CTNNB1 (Figure 5—figure supplement 4). It encodes -catenin, is one of the only two genes reaching genome-wide significance in a recent WES study for cerebral palsy (Jin et al., 2020b), and also harbors multiple LoF variants in developmental disorder, intellectual disability, autism, and congenital heart disease. It is a fundamental component of the canonical Wnt signaling pathway which is known to confer genetic risk for autism (O’Roak et al., 2012). Genes with recurrent damaging DNMs in multiple disorders also revealed shared biological function across these disorders (Rees et al., 2021). We identified 30 recurrent cross-disorder LoF mutations that were not recurrent in developmental disorder alone (Supplementary file 1). FBXO11, encoding the F-box only protein 31, shows two recurrent p.Ser831fs LoF variants in autism and congenital hydrocephalus (Figure 5—figure supplement 5; p=1.9e-3; Materials and methods). The F-box protein constitutes a substrate-recognition component of the SCF (SKP1-cullin-F-box) complex, an E3-ubiquitin ligase complex responsible for ubiquitination and proteasomal degradation (Cardozo and Pagano, 2004). DNMs in FBXO11 have been previously implicated in severe intellectual disability individuals with autistic behavior problem (Jansen et al., 2019) and neurodevelopmental disorder (Gregor et al., 2018).
For comparison, we also applied mTADA to the same nine disorders and control trios. In total, mTADA identified 117 disorder pairs with significant genetic sharings at an FDR cutoff of 0.05 (Supplementary file 1-STable 8 and Figure 5—figure supplement 6). Notably, we identified significant synonymous DNM correlations for all 36 disorder pairs and between all disorders and healthy controls (Figure 5—figure supplement 7). These results are consistent with the simulation results and suggest a substantially inflated false positive rate in mTADA.
Partitioning DNM enrichment correlation by gene set
To gain biological insights into the shared genetic architecture of nine disorders, we repeated EncoreDNM correlation analysis in several gene sets. First, we defined genes with high/low probability of intolerance to LoF variants using pLI scores (Karczewski et al., 2020), and identified genes with high/low brain expression (HBE/LBE) (Werling et al., 2020; Materials and methods; Supplementary file 1-STable 9). We identified 11 and 12 disorder pairs showing significant enrichment correlations for LoF DNMs in high-pLI genes and HBE genes, respectively (Figure 6a–b). We observed fewer significant correlations for Dmis and Tmis variants in these gene sets (Figure 6—figure supplements 1–2). All identified significant correlations were positive (Supplementary file 1-STables 10 -11). No significant correlations were identified for synonymous variants (Figure 6—figure supplements 1–2) or between disorders and controls (Figure 6—figure supplements 3–4).

DNM enrichment correlations in disease-relevant gene sets.
(a) Enrichment correlations in high-pLI genes (upper triangle) and low-pLI genes (lower triangle) for LoF variants. Here, pLI is the probability of being loss-of-function intolerant (see Materials and methods). (b) Enrichment correlations in HBE genes (upper triangle) and LBE genes (lower triangle) for LoF variants. (c) Enrichment correlations in HHE genes (upper triangle) and LHE genes (lower triangle) for LoF variants. (d) Enrichment correlations in CHD-related pathways for LoF and synonymous variants. Larger squares represent more significant p-values, and deeper color represents stronger correlations. Significant correlations (FDR <0.05) are shown as full-sized squares marked by asterisks.
We observed a clear enrichment of significant correlations in disease-relevant gene sets. Overall, high-pLI genes showed substantially stronger correlations across disorders than genes with low pLI (one-sided Kolmogorov-Smirnov test; p=2.3e-6). Similarly, enrichment correlations were stronger in HBE genes than in LBE genes (p=8.8e-7). Among the 11 disorder pairs showing significant enrichment correlations in high-pLI genes, two pairs, that is, autism-schizophrenia (=0.68, p=2.4e-3) and developmental disorder-congenital hydrocephalus (=0.43, p=1.5e-3), were not identified in the exome-wide analysis. We also identified four novel disorder pairs with significant correlations in HBE genes, including developmental disorder-cerebral palsy (=0.80, p=9.5e-5), developmental disorder-congenital hydrocephalus (=0.67, p=1.4e-3), autism-congenital hydrocephalus (=0.82, p=4.7e-4), and schizophrenia-epileptic encephalopathies (=0.66, p=2.0e-3). These novel enrichment correlations are consistent with known comorbidities between these disorders (Kielinen et al., 2004; Kilincaslan and Mukaddes, 2009) and findings based on significant risk genes (Li et al., 2016; Jin et al., 2020a; Kume et al., 1998; Cao and Wu, 2015).
Furthermore, we estimated DNM enrichment correlations in genes with high/low expression in mouse developing heart (HHE/LHE) (Homsy et al., 2015; Materials and methods; Supplementary file 1-STable 9). We identified 9 significant enrichment correlations for LoF variants in HHE genes (Figure 6c). Strength of enrichment correlations did not show a significant difference between HHE and LHE genes (p=0.846), possibly due to a lack of cardiac disorders in our analysis. Finally, we estimated enrichment correlations between congenital heart disease and other disorders in known pathways for congenital heart disease (Zaidi and Brueckner, 2017; Materials and methods; Supplementary file 1-STable 9). We identified five significant correlations for LoF variants (Figure 6d), including a novel correlation between congenital heart disease and Tourette disorder (=0.93, p=3.3e-9). Of note, arrhythmia caused by congenital heart disease is a known risk factor for Tourette disorder (Gulisano et al., 2011). In these analyses, all significant enrichment correlations were positive (Supplementary file 1) and other variant classes showed generally weaker correlations than LoF variants (Figure 6—figure supplements 5–6). We did not observe significant correlations in these gene sets between disorders and controls (Figure 6—figure supplements 7–8).
Discussion
In this paper, we introduced EncoreDNM, a novel statistical framework to quantify correlated DNM enrichment between two disorders. Through extensive simulations and analyses of DNM data for nine disorders, we demonstrated that our proposed mixed-effects Poisson regression model provides unbiased parameter estimates, shows well-controlled false positive rate, and is robust to exome-wide technical biases. Leveraging exome-wide DNM counts and genomic context-based mutability data, EncoreDNM achieves superior fit for real DNM datasets compared to simpler models and provides statistically powerful and computationally efficient estimation of DNM enrichment correlation. Further, EncoreDNM can quantify concordant genetic effects for user-defined variant classes within pre-specified gene sets, thus is suitable for exploring diverse types of hypotheses and can provide crucial biological insights into the shared genetic etiology in multiple disorders. In comparison, the Bayesian approach implemented in mTADA can produce false positives findings, especially when the DNM count is low, possibility due to the overestimated proportion of risk genes. We still observed inflation in false positive rates under a more stringent significance cutoff or using posterior probability threshold strategy (Supplementary file 1-STables 14-17).
Multi-trait analyses of GWAS data have revealed shared genetic architecture among many neuropsychiatric traits (Brainstorm, 2018; Lee et al., 2013; Gratten et al., 2014; Abdellaoui and Verweij, 2021). These findings have led to the identification of pleiotropic variants, genes, and hub genomic regions underlying many traits and have revealed multiple psychopathological factors jointly affecting human neurological phenotypes (Lee, 2019; Wang et al., 2015). Although emerging evidence suggests that causal DNMs underlying several disorders with well-powered studies (e.g. congenital heart disease and neurodevelopmental disorders; Homsy et al., 2015) may be shared, our understanding of the extent and the mechanism underlying such sharing remains incomplete. Applied to DNM data for nine disorders, EncoreDNM identified pervasive enrichment correlations of DNMs. We observed particularly strong correlations in pathogenic variant classes (e.g. LoF and Dmis variants) and disease-relevant genes (e.g. genes with high pLI and genes highly expressed in relevant tissues). Genes underlying these correlations were significantly enriched in pathways involved in chromatin organization and modification and gene expression regulation. The DNM correlations were substantially attenuated in genes with lower expression and genes with frequent occurrences of LoF variants in the population. A similar attenuation was observed in less pathogenic variant classes (e.g., synonymous variants). Further, no significant correlations were identified between any disorder and healthy controls. We also compared DNM enrichment correlations of five disorders with genetic correlations estimated from GWAS summary statistics (Supplementary file 1-STable 18). We had consistent findings from GWAS and DNM data (Spearman correlation = 0.70; Figure 5—figure supplement 8 and Supplementary file 1-STable 19). These results lay the groundwork for future investigations of pleiotropic mechanisms of DNMs.
Our study has some limitations. First, EncoreDNM assumes probands from different input studies to be independent. In rare cases when two studies have overlapping proband samples, enrichment correlation estimates may be inflated and must be interpreted with caution. Second, genetic correlation methods based on GWAS summary data provided key motivations for the mixed-effects Poisson regression model in our study. Built upon genetic correlations, a plethora of methods have been developed in the GWAS literature to jointly model more than two GWAS (Turley et al., 2018), identify and quantify common factors underlying multiple traits (Grotzinger et al., 2019; Grotzinger et al., 2020), estimate causal effects among different traits (Pickrell et al., 2016), and identify pleiotropic genomic regions through hypothesis-free scans (Guo et al., 2021). Future directions of EncoreDNM include using enrichment correlation to improve gene discovery, learning the directional effects and the causal structure underlying multiple disorders, and dynamically searching for gene sets and annotation classes with shared genetic effects without pre-specifying the hypothesis.
Taken together, we provide a new analytic approach to an important problem in DNM studies. We believe EncoreDNM improves the statistical rigor in multi-disorder DNM modeling and opens up many interesting future directions in both method development and follow-up analyses in WES studies. As trio sample size in WES studies continues to grow, EncoreDNM will have broad applications and can greatly benefit DNM research.
Materials and methods
Statistical model
Request a detailed protocolFor a single study, we assume that DNM counts in a given variant class (for example, synonymous variants) follow a mixed-effects Poisson model:
where is the DNM count in the i-th gene, is the number of trios, is the de novo mutability for the i-th gene (for example, mutation rate per chromosome per generation) which is known a priori (Samocha et al., 2014), and is the total number of genes in the study. The elevation parameter quantifies the global elevation of mutation rate compared to mutability estimates based on genomic sequence alone. Gene-specific deviation from expected DNM rate is quantified by random effect with a dispersion parameter . Here, the are assumed to be independent across different genes, in which case the observed DNM counts of different genes are independent. There is no constraint on the value of , and the dispersion parameter can be any positive value.
Next, we describe how we expand this model to quantify the shared genetics of two disorders. We adopt a flexible Poisson-lognormal mixture framework that can accommodate both overdispersion and correlation (Munkin and Trivedi, 1999). We assume DNM counts in a given variant class for two diseases follow:
where are the DNM counts for the i-th gene and are the trio sizes in two studies, respectively. Similar to the single-trait model, is the mutability for the i-th gene. are the elevation parameters, and are the gene-specific random effects with dispersion parameters , for two disorders respectively. is the enrichment correlation which quantifies the concordance of the gene-specific DNM burden between two disorders. Here, are unknown parameters. The gene specific effects for two disorders are assumed to be independent for different genes. We also assume that there is no shared sample for two disorders, in which case is independent with given .
Parameter estimation
Request a detailed protocolWe implement an MLE procedure to estimate unknown parameters. For single-trait analysis, the log-likelihood function can be expressed as follows:
where , , , and . Note that there is no closed form for the integral in the log-likelihood function. Therefore, we use Monte Carlo integration to evaluate the log-likelihood function. Let , where the are independently and identically distributed random variables following a standard normal distribution. We have
where , and is the Monte Carlo sample size which is set to be 1,000. Then, we could obtain the MLE of through maximization of . We obtain the standard error of the MLE through inversion of the observed Fisher information matrix. However, when the DNM count is small, the Fisher information may be non-invertible and the parameter vector is not numerically identifiable. In this case, we employ group-wise jackknife using 100 randomly partitioned gene groups to obtain standard errors for parameter estimates. This approach produces consistent standard errors compared to the Fisher information approach (Figure 5—figure supplement 9).
The estimation procedure can be generalized to multi-trait analysis. Log-likelihood function can be expressed as follows:
where , , , , , and . We use Monte Carlo integration to evaluate the log-likelihood function. Let and , where the and are independently and identically distributed random variables following a standard normal distribution. We have
where and . Then, we obtain the MLE of through maximization of . Standard error of MLE can be obtained either through inversion of the observed Fisher information matrix or group-wise jackknife if non-invertibility issue occurs.
Computation time
Request a detailed protocolAnalysis of a typical pair of disorders with 18,000 genes takes about 10 min on a 2.5 GHz cluster with 1 core.
DNM data and variant annotation
Request a detailed protocolWe obtained DNM data from published studies (Supplementary file 1-STable 1). DNM data for epileptic encephalopathies from the original release (Allen et al., 2013) were not in an editable format and were instead collected from denovo-db (Turner et al., 2017). We used ANNOVAR (Wang et al., 2010) to annotate all DNMs. Synonymous variants were determined based on the ‘synonymous SNV’ annotation in ANNOVAR; Variants with ‘startloss’, ‘stopgain’, ‘stoploss’, ‘splicing’, ‘frameshift insertion’, ‘frameshift deletion’, or ‘frameshift substitution’ annotations were classified as LoF; Dmis variants were defined as nonsynonymous SNVs predicted to be deleterious by MetaSVM Dong et al., 2015; nonsynonymous SNVs predicted to be tolerable by MetaSVM were classified as Tmis. Other DNMs which did not fall into these categories were removed from the analysis. For each variant class, we estimated the mutability of each gene using a sequence-based mutation model (Samocha et al., 2014) while adjusting for the sequencing coverage factor based on control trios as previously described (Jin et al., 2017; Supplementary file 1-STable 20). We included 18,454 autosomal protein-coding genes in our analysis. TTN was removed due to its substantially larger size.
Description and implementation of mTADA
Request a detailed protocolThe method mTADA employs a Bayesian framework and estimates the proportion of shared risk genes. Specifically, mTADA assigns all genes into four groups: genes that are not relevant for either disorder, risk genes for the first disorder alone, risk genes for the second disorder alone, and risk genes shared by both disorders. The proportion of these groups are parametrized as , respectively. In particular, parameter quantifies the extent of genetic sharing between two disorders, with a larger value indicating stronger genetic overlap (Nguyen et al., 2020). The 95% credible interval constructed through MCMC is used to measure the uncertainty in estimates.
The software mTADA requires the following parameters as inputs: proportion of risk genes (), mean relative risks (), and dispersion parameters () for both disorders. We used extTADA (Nguyen et al., 2017 )to estimate these parameters as suggested by the mTADA paper (Nguyen et al., 2020). mTADA reported the estimated proportion of shared risk genes (posterior mode of ) and its corresponding 95% credible interval . We considered as the expected proportion of shared risk genes, and there is significant genetic sharing between two disorders when . We quantify statistical evidence for genetic sharing by comparing the posterior distribution of with ,
where is the i-th MCMC iteration sample, is the number of iterations, and is the indicator function. This is also equivalent to performing two-sided inference using posterior probability P . Number of MCMC chain was set as 2 and number of iterations was set as 10,000.
Simulation settings
Request a detailed protocolWe assessed the performance of EncoreDNM under the mixed-effects Poisson model. We performed simulations for two variant classes: Tmis and LoF variants, which have the largest and the smallest median mutability values across all genes. First, we performed single-trait simulations to assess estimation precision of elevation parameter and dispersion parameter . We set the true values of to be −0.5,–0.25, and 0, and the true values of to be 0.5, 0.75, and 1. These values were chosen based on the estimated parameters in real DNM data analyses and ensured simulation settings to be realistic. Next, we performed simulations for cross-trait analysis to assess estimation precision of enrichment correlation , whose true values were set to be 0, 0.2, 0.4, 0.6, and 0.8. Sample size for each disorder was set to be 5000. Coverage rate was calculated as the percentage of simulations that the 95% Wald confidence interval covered the true parameter value. Each parameter setting was repeated 100 times.
We also carried out simulations to compare the performance of EncoreDNM and mTADA. False positive rate and statistical power for EncoreDNM were calculated as the proportion of simulation repeats that p-value for enrichment correlation was smaller than 0.05. and the proportion of simulation repeats that p-value for estimated proportion of shared risk genes was smaller than 0.05 was used for mTADA. We aggregated all variant classes together, so mutability for each gene was determined as the sum of mutabilities across four variant classes (i.e. LoF, Dmis, Tmis, and synonymous).
First, we simulated DNM data under the mixed-effects Poisson model. To see whether two methods would produce false positive findings, we performed simulations under the null hypothesis that the enrichment correlation is zero. We compared two methods under a range of parameter combinations of () for both disorders: (–0.25, 0.75, 5000) for the baseline setting, (–1, 0.75, 5000) for a setting with small , (–0.25, 0.5, 5000) for a setting with small , and (–0.25, 0.75, 1000) for a setting with small sample size. We also assessed the statistical power of two methods under the alternative hypothesis. True value of enrichment correlation was set to be 0.05, 0.1, 0.15, and 0.2. In the power analysis, parameters () were fixed at (–0.25, 0.75, 5000) as in the baseline setting when both methods had well-controlled false positive rate.
To ensure a fair comparison, we also compared EncoreDNM and mTADA under a multinomial model, which is different from the data generation processes for the two approaches. For each disorder (), we randomly selected causal genes of proportion . A proportion (i.e. ) of causal genes overlap between two disorders. We assumed that the total DNM count to follow a Poisson distribution: , where represents an elevation factor to represent systematic bias in the data. Let denote the vector of DNMs counts in the exome, denote the vector of mutability values for all genes, and denote the vector of mutability with values set to be 0 for non-causal genes of disorder . We assumed that a proportion of the probands could be attributed to DNMs burden in causal genes, and of the probands obtained DNMs by chance:
To check whether false positive findings could arise, we performed simulations under the null hypothesis that across a range of parameter combinations of () for both disorders: (0.95, 0.25, 5000) for the baseline setting, (0.75, 0.25, 5000) for a setting with small (i.e., reduced total mutation count), (0.95, 0.15, 5000) for a setting with small (fewer probands explained by DNMs), and (0.95, 0.25, 1000) for a setting with smaller sample size. and were set as 0.1. We also assessed the statistical power of two methods under the alternative hypothesis that . In power analysis, () were fixed at (0.95, 0.25, 5000) as in the baseline setting when false positive rate for both methods were well-calibrated.
Comparison to the fixed-effects Poisson model
Request a detailed protocolFor single-trait analysis, the fixed-effects Poisson model assumes that
Note that the fixed-effects Poisson model is a special case of our proposed mixed-effects Poisson model when . We compared the two models using likelihood ratio test. Under the null hypothesis that , asymptotically, where and represent the log likelihood of the fitted mixed-effects and fixed-effects Poisson models respectively.
Recurrent genes and DNMs
Request a detailed protocolWe used FUMA (Watanabe et al., 2017) to perform GO enrichment analysis for genes harboring LoF DNMs in multiple disorders. Due to potential sample overlap between the studies of developmental disorder (Kaplanis et al., 2020) and intellectual disability (Lelieveld et al., 2016), we excluded intellectual disability from the analysis of recurrent DNMs. We calculated the probability of observing two identical DNMs in two disorders using a Monte Carlo simulation method. For each disorder, we simulated exome-wide DNMs profile from a multinomial distribution, where the size was fixed at the observed DNM count and the per-base mutation probability was determined by the tri-nucleotide base context. We repeated the simulation procedure 100,000 times to evaluate the significance of recurrent DNMs. Lollipop plots for recurrent mutations were generated using MutationMapper on the cBio Cancer Genomics Portal (Cerami et al., 2012).
Implementation of cross-trait LD score regression
Request a detailed protocolWe used cross-trait LDSC (Bulik-Sullivan et al., 2015) to estimate genetic correlations between disorders. LD scores were computed using European samples from the 1000 Genomes Project Phase 3 data (Auton et al., 2015). Only HapMap 3 SNPs were used as observations in the explanatory variable with the --merge-alleles flag. Intercepts were not constrained in the analyses.
Estimating enrichment correlation in gene sets
Request a detailed protocolGenes with a high/low probability of intolerance to LoF variants (high-pLI/low-pLI) were defined as the 4,614 genes in the upper/lower quartiles of pLI scores (Karczewski et al., 2020). Genes with high/low brain expression (HBE/LBE) were defined as the 4,614 genes in the upper/lower quartiles of expression in the human fetal brain (Werling et al., 2020). Genes with high/low heart expression (HHE/LHE) were defined as the 4,614 genes in the upper/lower quartiles of expression in the developing heart of embryonic mouse (Zaidi et al., 2013). Five biological pathways have been reported to be involved in congenital heart disease: chromatin remodeling, Notch signaling, cilia function, sarcomere structure and function, and RAS signaling (Zaidi and Brueckner, 2017). We extracted 1730 unique genes that belong to these five pathways from the gene ontology database (Ashburner et al., 2000) and referred to the union set as CHD-related genes. We repeated EncoreDNM enrichment correlation analysis in these gene sets. One-sided Kolmogorov-Smirnov test was used to assess the statistical difference between enrichment correlation signal strength in different gene sets.
URLs
GWAS summary statistics data of autism spectrum disorder, schizophrenia, and Tourette disorder were downloaded on the PGC website, https://www.med.unc.edu/pgc/download-results/; Summary statistics of cognitive performance were downloaded on the SSGAC website, https://thessgac.com/; Summary statistics of epilepsy were downloaded on the epiGAD website, https://www.epigad.org/; pLI scores were downloaded from gnomAD v3.1 repository https://gnomad.broadinstitute.org/downloads; mTADA, https://github.com/hoangtn/mTADA, Nguyen et al., 2021; denovo-db, https://denovo-db.gs.washington.edu/denovo-db/; MutationMapper on cBioPortal, https://www.cbioportal.org/mutation_mapper; LDSC, https://github.com/bulik/ldsc; Schorsch, 2020.
Code availability
Request a detailed protocolEncoreDNM software is available at https://github.com/ghm17/EncoreDNM; Guo, 2022.
Data availability
The current manuscript is a computational study, so no data have been generated for this manuscript.
References
-
Dissecting polygenic signals from genome-wide association studies on human behaviourNature Human Behaviour 5:686–694.https://doi.org/10.1038/s41562-021-01110-y
-
Gene Ontology: tool for the unification of biologyNature Genetics 25:25–29.https://doi.org/10.1038/75556
-
Analysis of shared heritability in common disorders of the brainScience (New York, N.Y.) 360:aap875.https://doi.org/10.1126/science.aap875
-
An atlas of genetic correlations across human diseases and traitsNature Genetics 47:1236–1241.https://doi.org/10.1038/ng.3406
-
The SCF ubiquitin ligase: insights into a molecular machineNature Reviews. Molecular Cell Biology 5:739–751.https://doi.org/10.1038/nrm1471
-
Prevalence of cerebral palsy, co-occurring autism spectrum disorders, and motor functioning - Autism and Developmental Disabilities Monitoring Network, USA, 2008Developmental Medicine and Child Neurology 56:59–65.https://doi.org/10.1111/dmcn.12268
-
Cerebral palsy and congenital malformationsEuropean Journal of Paediatric Neurology 12:82–88.https://doi.org/10.1016/j.ejpn.2007.07.001
-
Large-scale genomics unveils the genetic architecture of psychiatric disordersNature Neuroscience 17:782–790.https://doi.org/10.1038/nn.3708
-
De Novo Variants in the F-Box Protein FBXO11 in 20 Individuals with a Variable Neurodevelopmental DisorderAmerican Journal of Human Genetics 103:305–316.https://doi.org/10.1016/j.ajhg.2018.07.003
-
Cardiovascular safety of aripiprazole and pimozide in young patients with Tourette syndromeNeurological Sciences 32:1213–1217.https://doi.org/10.1007/s10072-011-0678-1
-
Detecting local genetic correlations with scan statisticsNature Communications 12:2033.https://doi.org/10.1038/s41467-021-22334-6
-
Prioritization of neurodevelopmental disease genes by discovery of new mutationsNature Neuroscience 17:764–772.https://doi.org/10.1038/nn.3703
-
De novo mutations in congenital heart disease with neurodevelopmental and other congenital anomaliesScience (New York, N.Y.) 350:1262–1266.https://doi.org/10.1126/science.aac9396
-
De novo variants in FBXO11 cause a syndromic form of intellectual disability with behavioral problems and dysmorphismsEuropean Journal of Human Genetics 27:738–746.https://doi.org/10.1038/s41431-018-0292-2
-
Pervasive developmental disorders in individuals with cerebral palsyDevelopmental Medicine and Child Neurology 51:289–294.https://doi.org/10.1111/j.1469-8749.2008.03171.x
-
Excess of rare, inherited truncating mutations in autismNature Genetics 47:582–588.https://doi.org/10.1038/ng.3303
-
Meta-analysis of 2,104 trios provides support for 10 new genes for intellectual disabilityNature Neuroscience 19:1194–1196.https://doi.org/10.1038/nn.4352
-
A Powerful Approach to Estimating Annotation-Stratified Genetic Covariance via GWAS Summary StatisticsAmerican Journal of Human Genetics 101:939–964.https://doi.org/10.1016/j.ajhg.2017.11.001
-
Long-term follow-up in 233 patients with congenital hydrocephalusChild’s Nervous System 11:173–175.https://doi.org/10.1007/BF00570260
-
Intellectual disability in cerebral palsy: a population-based retrospective studyDevelopmental Medicine and Child Neurology 60:687–694.https://doi.org/10.1111/dmcn.13773
-
A framework for the interpretation of de novo mutation in human diseaseNature Genetics 46:944–950.https://doi.org/10.1038/ng.3050
-
Local Genetic Correlation Gives Insights into the Shared Genetic Architecture of Complex TraitsAmerican Journal of Human Genetics 101:737–751.https://doi.org/10.1016/j.ajhg.2017.09.022
-
denovo-db: A compendium of human de novo variantsNucleic Acids Research 45:D804–D811.https://doi.org/10.1093/nar/gkw865
-
De novo mutations in human genetic diseaseNature Reviews. Genetics 13:565–575.https://doi.org/10.1038/nrg3241
-
Functional mapping and annotation of genetic associations with FUMANature Communications 8:1–11.https://doi.org/10.1038/s41467-017-01261-5
-
A Bayesian framework for de novo mutation calling in parents-offspring triosBioinformatics (Oxford, England) 31:1375–1381.https://doi.org/10.1093/bioinformatics/btu839
-
Genetics and Genomics of Congenital Heart DiseaseCirculation Research 120:923–940.https://doi.org/10.1161/CIRCRESAHA.116.309140
-
Comparison of methods for estimating genetic correlation between complex traits using GWAS summary statisticsBriefings in Bioinformatics 22:bbaa442.https://doi.org/10.1093/bib/bbaa442
Decision letter
-
Alexander YoungReviewing Editor; University of California, Los Angeles, United States
-
Molly PrzeworskiSenior Editor; Columbia University, United States
Our editorial process produces two outputs: (i) public reviews designed to be posted alongside the preprint for the benefit of readers; (ii) feedback on the manuscript for the authors, including requests for revisions, shown below. We also include an acceptance summary that explains what the editors found interesting or important about the work.
Decision letter after peer review:
Thank you for submitting your article "Quantifying concordant genetic effects of de novo mutations on multiple disorders" for consideration by eLife. Your article has been reviewed by two peer reviewers, and the evaluation has been overseen by a Reviewing Editor and Molly Przeworski as the Senior Editor. The reviewers have opted to remain anonymous.
The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.
Essential revisions:
1) The manuscript needs to explain better the different approaches taken by encoreDNM and mTADA, and the corresponding strengths and weaknesses. The authors focus on power in frequentist hypothesis testing for non-zero genetic overlap between disorders, but mTADA takes a Bayesian approach. Clarification is needed here on whether the statistical basis of the comparison is fair.
2) Greater clarification of the model fitting procedure is needed: how the de-novo mutability parameter is used and the computational complexity of optimizing the likelihood function.
3) The heatmaps that present the results of the empirical analysis show only statistical significance levels. Since the authors' method's primary parameter is the correlation parameter, it would be helpful to display estimates of this parameter in the main text and to focus discussion on that parameter more and on statistical significance less.
Reviewer #1 (Recommendations for the authors):
Here, I have the following comments.
1. Authors proposed a mixed-effect Poisson model with overdispersion. I have a few questions regarding this model. First, it is not clear whether the de novo mutability m_i is a parameter or a given estimation in the model. Authors mentioned on line 110 that the background component is a gene-specific fixed effect but in the Methods they do not treat it as a parameter in the section of parameter estimation. Second, to treat overdispersion in Poisson model, negative binomial distribution is usually applied. Here, authors added an overdispersion variable \phi_i in the model. It will be helpful to discuss on this point. Third, a MCMC algorithm was used to solve the EncoreDNM model. How is the computational efficiency? On line 431, authors used the inversion of Fisher information matrix to obtain the covariance for parameters. Is there any non-invertibility problem here?
2. In the data analysis, authors used Figure 4c-f to suggest better fit of mixed-effect model. It is better to use a table to summarize the goodness of fit test instead of using bar plots in Supplementary Figure 3. On line 197, before reading the whole paragraph, it is not clear at the beginning whether single-trait analysis refers to mixed-effect or fixed-effect. Next, authors discovered that no significant correlation as identified between any disorders and control groups. Discussions about this should be helpful.
3. In Figure 5, panel b and c can be simplified with upper triangle for LoF and lower triangle for synoymous. Moreover, the heatmaps here only reflect the significance of correlations but no information regarding the correlation magnitude itself. It would be helpful to include this in the same figure. This point could be applied to other heatmaps in the supplement. In addition, Figure 5b shows more significant correlations for diseases with larger sample sizes. This is consistent with common sense. So including correlation magnitudes in this figure would be more informative.
Reviewer #2 (Recommendations for the authors):
1. I felt the introduction and discussion lacked a more in-depth comparison between EncoreDNM and other similar methods (specifically mTADA). In particular, what are the differences in parameters between these two methods and why do you see such an increase in false positives (Figure 3) for mTADA over EncoreDNM?
2. L66: The technical wording of this statement could be improved. The paper cited was commenting on remaining haplo-insufficient genes yet to be discovered. I also do not believe "undetected" to be the correct word here as this refers to a statistical test for enrichment rather than a clinical association. There are several genes (e.g. in Kaplanis et al. Supp Table 2) that are known to cause developmental disorders clinically but do not pass p. value thresholds suggesting a statistical enrichment in studies like DDD.
3. In Figure 1, is there a vertical line missing? On the left, there are squares representing genes, but there is also one rectangle.
4. L103-117: Could the derivation of the dispersion parameter Φ be explained in better lay-terms somewhere? I understand that it is attempting to quantify the random nature of DNM counts one expects when sequencing a subset of individuals with a given disorder, but the maths in the methods section is a bit impenetrable for somebody who is not well-versed in calculus. This is especially crucial considering the major role it plays in interpreting the various results presented, and in comparison, to mTADA. It will be difficult for some readers of a journal with a broad range of topics such as eLife to understand how this parameter, particularly σ, was estimated.
5. L108: Further to point 4, what are reasonable values of the parameters used to fit your model? Additionally, the authors state that β "tends to be larger… and smaller…" under various conditions, but based on Figure 3, it appears that it shifts between positive and negative?
6. L151: The word "could estimate" is loaded and represents an opinion and should be removed in favour of "estimates".
7. L184-187: The excessive use of acronyms for various disorders makes for difficult reading. While I am familiar with acronyms for developmental disorders, autism spectrum, and schizophrenia because these are my field, I constantly had to refer back to the definitions is it possible to just use the actual disorder names throughout the manuscript where possible?
8. Figure 3: I think it is relevant to put the various simulated parameters that constitute Φ (e.g. σ, ρ) into context with actual data as presented in Figure 4. i.e. do the simulated parameters used here represent reasonable assumptions of these values and are they within the expectations of mTADA? Could the range of parameters have an outsized effect on the differences between mTADA and EncoreDNM? Or does it have to do with p. value thresholding (see below). Furthermore, I would appreciate it if x-axis labels included the actual parameter setting rather than the less descriptive "small" and plots A and C had labels which described which parameters were fixed in those respective analyses.
9. L246: "i.e." should be removed. There are five genes and you listed all five.
10. L267-272: Are the authors certain the thresholding on the mTADA results is reasonable? Whilst the FDR cutoff the authors have applied may suggest "significance", the p. values for the mTADA synonymous variant analysis seem very similar across all disorder combinations. Furthermore, the general pattern of p. values for LoFs seems similar to that shown for EncoreDNM. I suspect that the correlation between p. values of EncoreDNM and mTADA will be high and one could generate similar results by adjusting significance thresholds independently for each tool.
Additionally, as mTADA is based on a Bayesian approach, shouldn't the authors threshold based on posterior probabilities rather than p. values? I am unsure if comparing the π values from the different mTADA results is a valid approach as described in the methods? How do the authors conclusions change when using thresholds based on those the authors of mTADA suggest (e.g. PP > 0.8)?
11. Figure 6: Could a visual cue/text be added to differentiate between the analyses in the upper and lower triangles?
12. What is the overall rank of genes identified between different disorders when comparing between mTADA and EncoreDNM? Could the authors plot relative p/PP values for genes identified to be significantly enriched between disorders?
13. L228-229: Do not use the terms "hints at correlation" or "correlate strongly". It either does or does not meet your p. value threshold and/or correlate.
14. L257-260: Are the recurrent LoF mutations found in developmental disorders any different than those already identified by Kaplanis et al.? If so, how do your results increase understanding of the mechanisms underlying developmental disorders? I would perhaps shift the focus of this section to identifying recurrent mutations across disorders (and perhaps cite/refer to Rees et al. in Nature Communications; PMID: 34504065).
15. L274-280: I do not feel the LD score analysis constitutes a new analysis and should be moved to the discussion. A similar result was recently published in by Abdellaoui and Verweij in Nature Human Behaviour (PMID: 33986517) that covers many of these traits.
16. Throughout: Could the term "Type I Error" be avoided? I would prefer false-discovery/false-positive be used as it is a much clearer term and immediately recognisable by the majority of readers.
17. L365-366: I do not think identifying gene-disease associations is a goal of EncoreDNM so I do not consider it a limitation of the study.
18. L584: I think the hyperlink is broken? I was able to find the repository for EncoreDNM in ghm17's github account, so this was not a major issue.
https://doi.org/10.7554/eLife.75551.sa1Author response
Essential revisions:
1) The manuscript needs to explain better the different approaches taken by encoreDNM and mTADA, and the corresponding strengths and weaknesses. The authors focus on power in frequentist hypothesis testing for non-zero genetic overlap between disorders, but mTADA takes a Bayesian approach. Clarification is needed here on whether the statistical basis of the comparison is fair.
2) Greater clarification of the model fitting procedure is needed: how the de-novo mutability parameter is used and the computational complexity of optimizing the likelihood function.
3) The heatmaps that present the results of the empirical analysis show only statistical significance levels. Since the authors' method's primary parameter is the correlation parameter, it would be helpful to display estimates of this parameter in the main text and to focus discussion on that parameter more and on statistical significance less.
We really appreciate the thoughtful and constructive comments from the editor and both reviewers. In this revision, we have provided additional justifications for the comparison between EncoreDNM and mTADA, and clarified statistical details in the model fitting and parameter estimation procedure. We also present the enrichment correlation estimates in addition to significance levels in the updated heatmaps as suggested. The new analyses have produced highly consistent results compared to our initial submission and have strengthened the manuscript. We provide details of these analyses in the point-by-point response below.
Reviewer #1 (Recommendations for the authors):
Here, I have the following comments.
1. Authors proposed a mixed-effect Poisson model with overdispersion. I have a few questions regarding this model. First, it is not clear whether the de novo mutability m_i is a parameter or a given estimation in the model. Authors mentioned on line 110 that the background component is a gene-specific fixed effect but in the Methods they do not treat it as a parameter in the section of parameter estimation.
Thank you for the comment. The de novo mutability is given a priori rather than being a parameter to be estimated. There is extensive literature on estimating de novo mutability from genomic sequence context. In this paper, we used mutability values estimated from a tri-nucleotide-based model proposed by Samocha and colleagues1.
Second, to treat overdispersion in Poisson model, negative binomial distribution is usually applied. Here, authors added an overdispersion variable \phi_i in the model. It will be helpful to discuss on this point.
We thank the reviewer for pointing this out. It is true that negative binomial distribution as a Poisson-γ mixture is commonly used for handling overdispersion in count data. This is because Poisson distribution and γ distribution are a conjugate pair, and their compound model can be expressed in closed form. However, the main goal of our study is to quantify the shared genetic component of two disorders, and there is no trivial way to parametrize the bivariate extension of negative binomial distribution for this purpose. Marshall and Olkin proposed a bivariate Poisson-γ mixture (negative binomial) model with a restriction that both count variables share the same γ distribution component2. The mixture model has closed form solution but assumes the dispersion of two count variables to be identical and limits the unconditional correlation of two count variables to be positive.
In this paper, we adopted a Poisson-lognormal mixture framework, which is another commonly used Poisson mixture model that accommodates overdispersion (see Chapter 4.2 in Cameron, A.C. et al.3). Unlike the Poisson-γ mixture, this model does not have the computational convenience of having closed-form solutions. Instead, we implemented the Monte Carlo integration method to calculate the likelihood which is computationally more intensive but still obtained accurate and robust results. A major reason why we chose to use the Poisson-lognormal mixture is that it can be easily generalized to bivariate count model by replacing its univariate normal component with a bivariate normal distribution. This flexible bivariate count model was initially proposed by Munkin and Trivedi in econometrics, and has been demonstrated to accommodate both overdispersion and correlation, which suits our main goal very well4. In general, finding a computationally simpler approach to parametrize correlation in bivariate count data remains an interesting methodological question, but we are content with the excellent empirical performance of the Poisson-lognormal mixture model in our analyses. We have added some clarifications and discussions into the Methods-statistical model section of our revised manuscript.
Third, a MCMC algorithm was used to solve the EncoreDNM model. How is the computational efficiency?
Our Monte Carlo integration method is computationally efficient. Analysis of a typical trait pair with 18,000 genes takes about 10 minutes on a 2.5GHz cluster with 1 core. We have added these details into the Methods-computation time section in the revised manuscript.
On line 431, authors used the inversion of Fisher information matrix to obtain the covariance for parameters. Is there any non-invertibility problem here?
Thank you for raising this important point. We double checked our previous analyses and found that the non-invertibility issue indeed occurred when the DNM count is small (mostly happened when analyzing synonymous variants). In this revision, we newly implemented a group-wise jackknife method to obtain standard errors for parameter estimates when the Fisher information matrix is noninvertable. More specifically, we randomly partitioned all genes into 100 groups with equal size. Each time, we left one group out and estimated the parameters using the DNM data of the remaining genes. We then repeated the procedure 100 times and calculated the jackknife standard errors. This approach produced similar standard error estimates compared to the Fisher information approach in our analysis, as illustrated in Figure 5—figure supplement 9 in the revised manuscript. We have also incorporated the new method details into the Methods-parameter estimation section in our revised manuscript.
2. In the data analysis, authors used Figure 4c-f to suggest better fit of mixed-effect model. It is better to use a table to summarize the goodness of fit test instead of using bar plots in Supplementary Figure 3.
Thank you for your great suggestion. We have added Supplementary Table 2 in our revised manuscript to show the results of likelihood ratio tests.
On line 197, before reading the whole paragraph, it is not clear at the beginning whether single-trait analysis refers to mixed-effect or fixed-effect.
Thank you for your comment. We have added the word “under the mixed-effects Poisson model” for clarification.
Next, authors discovered that no significant correlation as identified between any disorders and control groups. Discussions about this should be helpful.
For disorders, DNMs will be enriched in risk genes and slightly depleted in non-risk genes. For control groups (these are healthy siblings recruited in a study for autism), DNMs are expected to distribute proportionally according to the de novo mutability (determined by the genomic sequence context) without showing enrichment in certain genes. Therefore, we expect the enrichment correlation, characterized by concordant enrichment of DNMs in the exome, to be near zero between disorders and the control group. Our results are consistent with our expectation. We have added some related discussions into the Results section of our revised manuscript.
3. In Figure 5, panel b and c can be simplified with upper triangle for LoF and lower triangle for synoymous. Moreover, the heatmaps here only reflect the significance of correlations but no information regarding the correlation magnitude itself. It would be helpful to include this in the same figure. This point could be applied to other heatmaps in the supplement. In addition, Figure 5b shows more significant correlations for diseases with larger sample sizes. This is consistent with common sense. So including correlation magnitudes in this figure would be more informative.
Thank you for this great suggestion. We have incorporated the enrichment correlation estimates into heatmaps (Figures 5-6). Figure 6—figure supplements 1-8 in the revised manuscript have also been updated accordingly. We also included the updated Figure 5 below for your convenience.
Reviewer #2 (Recommendations for the authors):
1. I felt the introduction and discussion lacked a more in-depth comparison between EncoreDNM and other similar methods (specifically mTADA). In particular, what are the differences in parameters between these two methods and why do you see such an increase in false positives (Figure 3) for mTADA over EncoreDNM?
Thank you for the comment. To quantify shared genetic effects between two disorders, EncoreDNM assumes a mixed-effects Poisson model and estimates the correlation of deviation components across two disorders, whereas mTADA employs a Bayesian framework and estimates the proportion of shared risk genes. We have provided statistical details of EncoreDNM in the Methods section of our manuscript. Here, we briefly introduce mTADA.
The mTADA method assigns all genes into four groups: genes that are not relevant for either disorder, risk genes for the first disorder alone, risk genes for the second disorder alone, and risk genes shared by both disorders. The proportion of these groups are parametrized as , respectively. In particular, parameter quantifies the extent of genetic sharing between two disorders, with a larger value indicating stronger genetic overlap (for example, see Figures 4a-b in the mTADA paper5). The 95% credible interval constructed through MCMC is used to measure the uncertainty in estimates.
Through extensive simulations and analysis of nine disorders, we demonstrated that EncoreDNM provides accurate statistical inference, but mTADA can produce false positives findings when following the author-recommended procedure, especially when the DNM count is small. One possible reason is that when there is not sufficient DNM counts, mTADA tends to overestimate . Nguyen et al. also reported this phenomenon in their simulation settings with small mean relative risks5 (see Supplementary Figure 3 in the mTADA paper). Further, although the inflation of false positive rate for mTADA may be alleviated by inducing a more stringent significance threshold, researchers will not know how to select such a threshold in practice. We will provide more details on this in our response to Comment #10 below. Related discussions have also been incorporated into the revised manuscript.
2. L66: The technical wording of this statement could be improved. The paper cited was commenting on remaining haplo-insufficient genes yet to be discovered. I also do not believe "undetected" to be the correct word here as this refers to a statistical test for enrichment rather than a clinical association. There are several genes (e.g. in Kaplanis et al. Supp Table 2) that are known to cause developmental disorders clinically but do not pass p. value thresholds suggesting a statistical enrichment in studies like DDD.
We have replaced the word “more than 1,000 genes associated with DD remain undetected” with “more than 1,000 haploinsufficient genes contributing to DD risk have not yet achieved statistical significance”.
3. In Figure 1, is there a vertical line missing? On the left, there are squares representing genes, but there is also one rectangle.
We use squares to represent different genes. The rectangle in the middle represents many other genes that are omitted due to limited space.
4. L103-117: Could the derivation of the dispersion parameter Φ be explained in better lay-terms somewhere? I understand that it is attempting to quantify the random nature of DNM counts one expects when sequencing a subset of individuals with a given disorder, but the maths in the methods section is a bit impenetrable for somebody who is not well-versed in calculus. This is especially crucial considering the major role it plays in interpreting the various results presented, and in comparison, to mTADA. It will be difficult for some readers of a journal with a broad range of topics such as eLife to understand how this parameter, particularly σ, was estimated.
We appreciate the suggestion. The main goal of EncoreDNM is to quantify correlated DNM enrichment between two disorders. The statistical framework is parametrized as follows. We have described the statistical details of this framework in the Methods section of our manuscript. Briefly, in this model, DNM rate is affected by the elevation component , the background component , and the deviation component . The component in question, , is modeled as a random effect that follows a bivariate normal distribution. More specifically, quantifies the degree to which DNM counts look different from what we expect to see under the null (i.e., no risk genes for the disorder). A larger value of the dispersion parameter indicates a more substantial deviation from the null. That is, DNM counts show strong enrichment in some genes and depletion in other genes compared to the expectation based on de novo mutability. If has a small value, it means the DNM count data is largely consistent with the null. Parameter further allows such deviation of two disorders to be correlated and is a key parameter of interest in our framework. We have added some clarifications into the Results-method overview section in the revised manuscript.
5. L108: Further to point 4, what are reasonable values of the parameters used to fit your model? Additionally, the authors state that β "tends to be larger… and smaller…" under various conditions, but based on Figure 3, it appears that it shifts between positive and negative?
In our mixed-effects Poisson regression model, there is no constraint on what value the elevation parameter can be. A positive value of represents over-calling DNMs while a negative value represents under-calling. The dispersion parameter can be any positive value. A larger indicates that DNM counts show a strong deviation compared to the expectation rate determined by de novo mutability. The enrichment correlation quantifies the concordance of DNM enrichments between two disorders and can be any value between -1 and 1. Applying EncoreDNM to nine disorders, we found that the estimates of were almost always negative across variant classes, which may be explained by strict quality control in DNM calling pipelines. We also note that the empirical estimates of these parameters are affected by noise in the data, especially when the sample size is small.
6. L151: The word "could estimate" is loaded and represents an opinion and should be removed in favour of "estimates".
Thank you for the suggestion. We have replaced the word "could estimate" with “estimates”.
7. L184-187: The excessive use of acronyms for various disorders makes for difficult reading. While I am familiar with acronyms for developmental disorders, autism spectrum, and schizophrenia because these are my field, I constantly had to refer back to the definitions is it possible to just use the actual disorder names throughout the manuscript where possible?
We have replaced the acronyms with the actual names of disorders throughout the revised manuscript.
8. Figure 3: I think it is relevant to put the various simulated parameters that constitute Φ (e.g. σ, ρ) into context with actual data as presented in Figure 4. i.e. do the simulated parameters used here represent reasonable assumptions of these values and are they within the expectations of mTADA? Could the range of parameters have an outsized effect on the differences between mTADA and EncoreDNM? Or does it have to do with p. value thresholding (see below). Furthermore, I would appreciate it if x-axis labels included the actual parameter setting rather than the less descriptive "small" and plots A and C had labels which described which parameters were fixed in those respective analyses.
In the real DNM data analysis using EncoreDNM, the mean(SD) of the estimated and were -0.54(0.25) and 0.99(0.36), respectively. In our simulations, was chosen as -1, -0.5, or 0, and was chosen as 0.5, 0.75, or 1. Therefore the parameter values used in simulations would be reasonable and not have outsized effects on the performance of two methods. We have also added the parameter values into the x-axis labels of Figure 3.
9. L246: "i.e." should be removed. There are five genes and you listed all five.
We have removed “i.e.” from the sentence.
10. L267-272: Are the authors certain the thresholding on the mTADA results is reasonable? Whilst the FDR cutoff the authors have applied may suggest "significance", the p. values for the mTADA synonymous variant analysis seem very similar across all disorder combinations. Furthermore, the general pattern of p. values for LoFs seems similar to that shown for EncoreDNM. I suspect that the correlation between p. values of EncoreDNM and mTADA will be high and one could generate similar results by adjusting significance thresholds independently for each tool.
Additionally, as mTADA is based on a Bayesian approach, shouldn't the authors threshold based on posterior probabilities rather than p. values? I am unsure if comparing the π values from the different mTADA results is a valid approach as described in the methods? How do the authors conclusions change when using thresholds based on those the authors of mTADA suggest (e.g. PP > 0.8)?
This is an important point, and we appreciate the comment. In the paper that introduced the mTADA approach, Nguyen et al. used the proportion of shared risk genes to assess genetic overlaps between disorders5. They argued that a larger value of compared to 0 indicates stronger genetic sharing (for example, see Figures 4a-b in the mTADA paper5), and importantly, used credible intervals for to quantify the imprecision in their estimates. It is true that a PP cutoff of 0.8 was used to identify disease risk genes but this was not the approach for studying genetic overlaps in their paper.
To compare the performance of mTADA with EncoreDNM, we followed Nguyen et al. and performed posterior inference for . We used the same 95% credible interval approach to quantify the imprecision in estimates, and compared it with which quantifies the expected proportion of shared risk genes if two disorders are genetically independent. Here, and are the estimated proportions of risk genes for two disorders respectively. We compared the posterior distribution of with and used the following metric to quantify the statistical evidence:
p = .
Here, is the -th MCMC iteration sample and is the indicator function. If the lower bound of the 95% credible interval for exactly equals , then the corresponding p will be 0.05. This is also equivalent to using a (two-sided) 0.95 posterior probability cutoff on P() to claim statistical significance. Importantly, we once again highlight an adjustment we made in the posterior inference. Instead of comparing with 0 (this is what Nguyen et al. did in the mTADA paper), comparing with the expected proportion will lead to more conservative inference results for since is always greater than 0. Therefore, the posterior inference approach we used for mTADA is largely based on but statistically more conservative than what Nguyen et al. used for analyzing shared genetics between disorders.
Further, we investigated whether varying the significance threshold for mTADA would substantially change its performance in simulations under a mixed-effects Poisson regression model. At the significance cutoff 0.05, mTADA produced substantial proportion of false positive findings in the small , small , and small settings (Supplementary Table 14). Under a more stringent significance cutoff of 0.01, mTADA still produced a substantial inflation in false positive rates when and are small. We also employed a multinomial model instead of Poisson regression to simulate DNM counts. We obtained consistent results (Supplementary Table 15).
Although it is not the analytic approach used in the mTADA paper, we also investigated an alternative strategy which makes inference based on whether two disorders share at least one risk gene with PP>0.8. This strategy produced substantial inflation in false positive rates in the baseline setting (Supplementary Tables 16-17).
The discussions above have been incorporated into the revised manuscript.
11. Figure 6: Could a visual cue/text be added to differentiate between the analyses in the upper and lower triangles?
Thank you for the constructive suggestion. We have added the text for different gene sets in Figure 6. As suggested by Comment 8 from reviewer #1, we depicted correlation estimates rather than significance levels. Figure 6—figure supplements 1-8 have also been updated accordingly.
12. What is the overall rank of genes identified between different disorders when comparing between mTADA and EncoreDNM? Could the authors plot relative p/PP values for genes identified to be significantly enriched between disorders?
EncoreDNM does not prioritize disease risk genes, but instead estimates the enrichment correlation which quantifies concordant DNM effects between two disorders. This is conceptually similar to genetic correlation which can be estimated from GWAS data. Similarly, genetic correlation quantifies the overall shared additive genetic components between two traits but does not prioritize specific SNP associations. Therefore, we are not able to compare the rank of genes between mTADA and EncoreDNM.
13. L228-229: Do not use the terms "hints at correlation" or "correlate strongly". It either does or does not meet your p. value threshold and/or correlate.
We have deleted the statement to avoid confusion.
14. L257-260: Are the recurrent LoF mutations found in developmental disorders any different than those already identified by Kaplanis et al.? If so, how do your results increase understanding of the mechanisms underlying developmental disorders? I would perhaps shift the focus of this section to identifying recurrent mutations across disorders (and perhaps cite/refer to Rees et al. in Nature Communications; PMID: 34504065).
This is a great suggestion. We identified 30 recurrent cross-disorder LoF mutations that were not recurrent in developmental disorder alone (see Supplementary Table 7 ). We have now shifted the focus of this section to cross-disorder findings. In particular, we have highlighted the gene FBXO11 that shows recurrent LoF variants in autism and congenital hydrocephalus as an example. The Rees et al. paper has also been added as a reference in our revised manuscript.
15. L274-280: I do not feel the LD score analysis constitutes a new analysis and should be moved to the discussion. A similar result was recently published in by Abdellaoui and Verweij in Nature Human Behaviour (PMID: 33986517) that covers many of these traits.
We have moved the LD score regression analysis into the Discussion section.
16. Throughout: Could the term "Type I Error" be avoided? I would prefer false-discovery/false-positive be used as it is a much clearer term and immediately recognisable by the majority of readers.
We have replaced the word “type-I error” with “false positive rate” throughout the manuscript.
17. L365-366: I do not think identifying gene-disease associations is a goal of EncoreDNM so I do not consider it a limitation of the study.
We have removed this point from the Discussion section.
18. L584: I think the hyperlink is broken? I was able to find the repository for EncoreDNM in ghm17's github account, so this was not a major issue.
Thank you for pointing this out. The hyperlink has been fixed.
References
1. Samocha, K.E. et al. A framework for the interpretation of de novo mutation in human disease. Nature genetics 46, 944-950 (2014).
2. Marshall, A.W. & Olkin, I. Multivariate distributions generated from mixtures of convolution and product families. Lecture Notes-Monograph Series , 371-393 (1990).
3. Cameron, A.C. & Trivedi, P.K. Regression analysis of count data, (Cambridge university press, 2013).
4. Munkin, M.K. & Trivedi, P.K. Simulated maximum likelihood estimation of multivariate mixed‐Poisson regression models, with application. The Econometrics Journal 2, 29-48 (1999).
5. Nguyen, T.-H. et al. mTADA is a framework for identifying risk genes from de novo
mutations in multiple traits. Nature Communications 11, 2929 (2020).
https://doi.org/10.7554/eLife.75551.sa2Article and author information
Author details
Funding
National Science Foundation of China (No. 12071243)
- Lin Hou
Shanghai Municipal Science and Technology Major Project (No. 2017SHZDZX01)
- Lin Hou
Wisconsin Alumni Research Foundation
- Qiongshi Lu
Waisman Center pilot grant program at University of Wisconsin-Madison
- Qiongshi Lu
National Institutes of Health (No. R03HD100883 and R01GM134005)
- Hongyu Zhao
National Science Foundation (DMS 1902903)
- Hongyu Zhao
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
LH acknowledges research support from the National Science Foundation of China (Grant No. 12071243) and Shanghai Municipal Science and Technology Major Project (Grant No. 2017SHZDZX01). QL acknowledges research support from the University of Wisconsin-Madison Office of the Chancellor and the Vice Chancellor for Research and Graduate Education with funding from the Wisconsin Alumni Research Foundation and the Waisman Center pilot grant program at University of Wisconsin-Madison. HZ acknowledges research support from the National Institutes of Health (Grant No. R03HD100883 and R01GM134005) and the National Science Foundation (DMS 1902903).
Senior Editor
- Molly Przeworski, Columbia University, United States
Reviewing Editor
- Alexander Young, University of California, Los Angeles, United States
Publication history
- Preprint posted: June 14, 2021 (view preprint)
- Received: November 14, 2021
- Accepted: June 1, 2022
- Accepted Manuscript published: June 6, 2022 (version 1)
- Version of Record published: June 22, 2022 (version 2)
Copyright
© 2022, Guo et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 712
- Page views
-
- 171
- Downloads
-
- 1
- Citations
Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Genetics and Genomics
The b-hemoglobinopathies, such as sickle cell disease and b-thalassemia, are one of the most common genetic diseases worldwide and are caused by mutations affecting the structure or production of β-globin subunits in adult hemoglobin. Many gene editing efforts to treat the β-hemoglobinopathies attempt to correct β-globin mutations or increase γ-globin for fetal hemoglobin production. δ-globin, the subunit of adult hemoglobin A2, has high homology to β-globin and is already pan-cellularly expressed at low levels in adult red blood cells. However, upregulation of δ-globin is a relatively unexplored avenue to increase the amount of functional hemoglobin. Here, we use CRISPR-Cas9 to repair non-functional transcriptional elements in the endogenous promoter region of δ-globin to increase overall expression of adult hemoglobin 2 (HbA2). We find that insertion of a KLF1 site alone is insufficient to upregulate δ-globin. Instead, multiple transcription factor elements are necessary for robust upregulation of δ-globin from the endogenous locus. Promoter edited HUDEP-2 immortalized erythroid progenitor cells exhibit striking increases of HBD transcript, from less than 5% to over 20% of total β-like globins in clonal populations. Edited CD34+ hematopoietic stem and progenitors (HSPCs) differentiated to primary human erythroblasts express up to 46% HBD in clonal populations. These findings add mechanistic insight to globin gene regulation and offer a new therapeutic avenue to treat β-hemoglobinopathies.
-
- Genetics and Genomics
Principal Component Analysis (PCA) and the Linear Mixed-effects Model (LMM), sometimes in combination, are the most common genetic association models. Previous PCA-LMM comparisons give mixed results, unclear guidance, and have several limitations, including not varying the number of principal components (PCs), simulating simple population structures, and inconsistent use of real data and power evaluations. We evaluate PCA and LMM both varying number of PCs in realistic genotype and complex trait simulations including admixed families, subpopulation trees, and real multiethnic human datasets with simulated traits. We find that LMM without PCs usually performs best, with the largest effects in family simulations and real human datasets and traits without environment effects. Poor PCA performance on human datasets is driven by large numbers of distant relatives more than the smaller number of closer relatives. While PCA was known to fail on family data, we report strong effects of family relatedness in genetically diverse human datasets, not avoided by pruning close relatives. Environment effects driven by geography and ethnicity are better modeled with LMM including those labels instead of PCs. This work better characterizes the severe limitations of PCA compared to LMM in modeling the complex relatedness structures of multiethnic human data for association studies.