Abstract
Experimental detection of residues critical for protein-protein interactions (PPI) is a timeconsuming, costly, and labor-intensive process. Hence, high-throughput PPI-hot spot prediction methods have been developed, but they have been validated using relatively small datasets, which may compromise their predictive reliability. Here, we introduce PPI-hotspotID, a novel method for identifying PPI-hot spots using the free protein structure, and validated it on the largest collection of experimentally confirmed PPI-hot spots to date. We explored the possibility of detecting PPI-hot spots using (i) FTMap in the PPI mode, which identifies hot spots on protein-protein interfaces from the free protein structure, and (ii) the interface residues predicted by AlphaFold-Multimer. PPI-hotspotID yielded better performance than FTMap and SPOTONE, a webserver for predicting PPI-hotspots given the protein sequence. When combined with the AlphaFold-Multimer-predicted interface residues, PPI-HotspotID, also yielded better performance than either method alone. Furthermore, we experimentally verified several PPI-hot spots of eukaryotic elongation factor 2 predicted by PPI-hotspotID. Notably, PPI-hotspotID unveils PPI-hot spots that are not obvious from complex structures, which only reveal interface residues, thus overlooking PPI-hot spots in indirect contact with binding partners. Thus, PPI-hotspotID serves as a valuable tool for understanding the mechanisms of PPIs and facilitating the design of novel drugs targeting these interactions. A freely accessible web server is available at https://ppihotspotid.limlab.dnsalias.org/ and the source code for PPI-hotspotID at https://github.com/wrigjz/ppihotspotid/.
eLife assessment
The manuscript presents a machine-learning method to predict protein hotspot residues. The validation is incomplete, along with the misinterpretation of the results with other current methods like FTMap.
Strength of evidence
incomplete: Main claims are only partially supported
- exceptional
- compelling
- convincing
- solid
- incomplete
- inadequate
During the peer-review process the editor and reviewers write an eLife assessment that summarises the significance of the findings reported in the article (on a scale ranging from landmark to useful) and the strength of the evidence (on a scale ranging from exceptional to inadequate). Learn more about eLife assessments
Introduction
Protein-protein interactions (PPIs) play a crucial role in cellular physiology, and their dysregulation is associated with various diseases1 such as cancer,2 infectious diseases, and neurodegenerative diseases.3 Identifying residues critical for PPIs (termed PPI-hot spots) is important for elucidating protein function and designing targeted biomedical interventions.4,5 Conventionally, PPI-hot spots are defined as residues whose mutations to alanine cause ≥ 2 kcal/mol drop in the protein binding free energy.6–11 However, this definition, based on measuring the binding free energy change upon mutation to alanine, limits the number of experimentally determined PPI-hot spots. Hence, PPI-hot spots have been more broadly defined to include residues whose mutations, not necessarily to alanine, significantly impair/disrupt PPIs,12,13 as detected by experimental methods such as coimmunoprecipitation and yeast two-hybrid screening. As each mutant must be purified and analyzed separately, experimental detection of PPI-hot spots is time-consuming, costly, and labor-intensive.
To enable large-scale detection of PPI-hot spots, high-throughput PPI-hot spot prediction methods have been developed. They generally fall into 2 categories:14 (1) Methods that compute the binding energy/free energy difference between the wild-type protein and a mutant using classical force fields or empirical scoring functions.11,15–23 (2) Methods that employ classifiers such as nearest neighbor, support vector machines, decision trees, Bayesian/neural networks, random forest, and ensemble machine-learning models using various features including conservation, secondary structure, solvent-accessible surface area, and atom density.14,24–36 Most of the PPI-hot spot prediction methods rely on the protein complex structure and some are accessible via webservers; e.g., Hotpoint,37 KFC2,38 PredHS,39 and PredHS2.40 Fewer methods use only the free protein structure41–45 or sequence,34,46–54 and SPOTONE (hot SPOTs ON protein complexes with Extremely randomized trees) is available as a web server. SPOTONE53 predicts PPI-hot spots from the protein sequence using residuespecific features such as atom type, amino acid (aa) properties, secondary structure propensity, and mass-associated values to train an ensemble of extremely randomized trees.
The PPI-hot spot prediction methods have mostly been trained, validated, and tested on data from the Alanine Scanning Energetics database (ASEdb)55 and/or the Structural Kinetic and Energetic database of Mutant Protein Interactions (SKEMPI) 2.0 database.56 However, antibody-antigen interactions have different sequence and structural characteristics compared to non-antibody PPIs.57 Therefore, our focus is exclusively only on non-antibody proteins in this study. The ASEdb contains 96 PPI-hot spots from 26 proteins. SKEMPI 2.0, which includes single-point mutations not necessarily to alanine that decrease the protein binding free energy by ≥ 2 kcal/mol, has 343 PPI-hot spots from 117 distinct proteins, 40 of which overlap with ASEdb. Altogether, ASEdb and SKEMPI contain 399 distinct PPI-hot spots in 132 proteins. To increase this number of distinct PPI-hot spots, we have expanded the definition of PPI-hot spots to include mutations in UniProtKB58 that have been manually curated as significantly impairing/disrupting PPIs.13 This expanded definition led to the creation of the PPI-HotspotDB database, which contains 4,039 experimentally determined PPI-hot spots in 1,893 proteins. To calibrate PPI-hot spot prediction methods using the free protein structure, a benchmark was derived from PPI-HotspotDB.13 This benchmark called PPI-Hotspot+PDBBM contains nonredundant proteins with free structures and known PPI-hot spots. The proteins in PPI-Hotspot+PDBBM share < 60% sequence identity, which has been shown to be a reasonable threshold for grouping domains with similar functions.13
Our aim is to develop a method for identifying PPI-hot spots in non-antibody proteins using free protein structures. First, we updated the PPI-Hotspot+PDBBM benchmark and constructed a dataset comprising 158 nonredundant proteins with free structures harboring 414 experimentally known PPI-hot spots and 504 PPI-nonhot spots (see Methods). Using this dataset, we applied an automatic machine-learning framework that automates the machinelearning pipeline to detect PPI-hot spots using the aa type as well as structural, energetic, and evolutionary features of each residue in a protein. The resulting prediction model, named PPI-HotspotID, identifies PPI-hot spots using an ensemble of classifiers and only 4 residue features (conservation, aa type, solvent-accessible surface area (SASA), and gas-phase energy, ΔGgas). We explored the possibility of detecting PPI-hot spots using the FTMap server in the PPI mode, which identifies hot spots on protein—protein interfaces from free protein structures.45 These hot spots are identified by consensus sites - regions that bind multiple probe clusters.42,45,59 Such regions are deemed to be important for any interaction involving that region of the target, independent of partner protein.42 PPI-hot spots were identified as residues in van der Waals (vdW) contact with probe ligands within the largest consensus site containing the most probe clusters. We also explored the possibility of detecting PPI-hot spots using the interface residues predicted by AlphaFold-Multimer,60 which has been shown to outperform current docking methods in predicting protein-protein complexes. Finally, we illustrated the utility of PPI-HotspotID by applying it to detect PPI-hot spots of eukaryotic elongation factor 2 (eEF2), a translation factor essential for peptide elongation, and experimentally verified the predictions.
Results
Evaluating the Performance of PPI-Hot Spot Detection Methods.
The goal of PPI-hotspotID is to detect true PPI-hot spots rather than true PPI-nonhot spots in proteins. Hence, we assessed the performance of PPI-hotspotID by computing the sensitivity/recall (the fraction of true PPI-hot spots correctly identified),
the fraction of predicted PPI-hot spots that are true PPI-hot spots; i.e.,
and the F1-score, which combines recall and precision:
Since our dataset also contains true PPI-nonhot spots, we calculated the specificity (the fraction of true PPI-nonhot spots correctly identified):
In eqs 1–4, TP (true positives) or TN (true negatives) is the number of correctly predicted PPI-hot spots or PPI-nonhot spots, and FP (false positives) or FN (false negatives) is the number of wrongly predicted PPI-hot spots or PPI-nonhot spots.
Performance of PPI-hotspotID vs. FTMap and SPOTONE.
We compared the performance of PPI-HotspotID, FTMap,45 and SPOTONE53 using a dataset containing 414 true PPI-hot spots and 504 nonhot spots (see Methods). Note that the 414 true PPI-hot spots represent only 2% of the total number of residues (21,722) in the 158 proteins. Given the free protein structure, PPI-HotspotID and SPOTONE53 predict PPI-hot spots based on a probability threshold (> 0.5). FTMap, in the PPI mode, detects PPI-hot spots as consensus sites/regions on the protein surface that bind multiple probe clusters.59 Residues in vdW contact with probe molecules within the largest consensus site were compared with PPI-hotspotID/SPOTONE predictions. Residues not classified as PPI-hot spots by each method were considered as PPI-nonhot spots. Table 1 summarizes the results for our dataset, with the F1 score in parentheses representing the mean validation F1 score. Compared to FTMap/SPOTONE, PPI-HotspotID detected a much higher fraction of true positives (0.67 vs. 0.07/0.10) and achieved a significantly higher F1 score (0.71 vs. 0.13/0.17).
To elucidate the differences between the PPI-hot spots predicted by PPI-HotspotID and those by FTMap or SPOTONE, we compared their respective true positive predictions. The Venn diagram in Table 1 shows a substantial overlap in true positives between FTMap or SPOTONE and PPI-HotspotID: FTMap shared 23/30 true positives with PPI-HotspotID, whereas SPOTONE shared 34/40 with PPI-HotspotID, but only 3 with FTMap. Only 3 true positives were predicted by all 3 methods. PPI-HotspotID identified many true positives that were not detected by FTMap or SPOTONE probably because it employed aspects not considered by FTMap or SPOTONE such as the gas-phase energy, ΔGgas (see Discussion). Furthermore, SPOTONE defined true negatives as residues whose mutation to alanine led to protein binding free energy changes (ΔΔGbind) of ≤ 2.0 kcal/mol, whereas we defined true negatives as residues whose alanine/nonalanine mutations resulted in negligible protein binding free energy changes (ΔΔGbind < 0.5 kcal/mol) or did not perturb PPIs in immunoprecipitation or GST pull-down assays (see Methods).
Interface vs. Noninterface PPI-hotspots.
We can estimate the fraction of PPI-hotspots at the protein interface for 74 of the 158 nonredundant proteins in our dataset with complex structures. These 74 proteins harboring 243 true PPI-hotspots form 78 PPI pairs. Using the UniProt codes of each protein and its binding partner, we identified all complex structures in the PDB. Based on the complex structures of each PPI pair, we classified a PPI-hotspot as an interface one if it formed hydrogen bonds or vdW contacts with the partner protein,61 otherwise it was deemed a noninterface PPI-hotspot. Among the 243 true PPI-hotspots, 67 (27.6%) lacked such contacts across the protein interface. For these 74 proteins, PPI-hotspotID predicted 240 PPI-hot spots, out of which 43 (18%) are noninterface PPI-hot spots, SPOTONE identified only 5 noninterface PPI-hot spots, whereas FTMap did not predict any. For example, the complex structure of interleukin-4 bound to interleukin-4 receptor subunit α (PDB: 1IAR)62 in Figure 1 revealed 3 interface PPI-hot spots (E13, R92 and N93) and 2 noninterface ones (K127 and Y128). Based on the free structure of interleukin-4 (PDB: 1BBN),63 PPI-HotspotID identified all 5 true positives, SPOTONE detected an interfacial PPI-hot spot (N93), whereas FTMAP failed to identify any true positives.
Performance of AlphaFold-Multimer, PPI-HotspotID and Their Combination in Predicting PPI-Hot Spots.
To assess the possibility of detecting PPI-hot spots using the interface residues predicted by AlphaFold-Multimer60 as PPI-hot spots when complex structures are unavailable, we focused on 48 “unsolved” AB complex structures involving 47 proteins in the PPI-Hotspot+PDBBM(1.1), as one of the proteins, human neurotrophin (UniProtID P20783, PDB 1nt30A) interacted with two different proteins (UniProtID Q16288 and P17643). These 48 unsolved complex structures contain 90 PPI-hot spots and 45 nonhot spots. We employed the protein A structure sequence from the PPI-Hotspot+PDBBM(1.1) and the entire protein B sequence from UniProtKB58 as inputs for the AlphaFold-Multimer module in ColabFold.64 This generated model structures for each AB complex. Interface residues were defined based on the AMBER-relaxed model structure with the highest pTM score using a cutoff distance of 5 Å reflecting residues in close contact. Interface residues were predicted as PPI-hot spots and noninterface residues as nonhot spots.
In identifying PPI-hot spots using PPI-HotspotID, we first excluded 90 true PPI-hot spots and 45 nonhot spots belonging to 47 proteins lacking complex PDB structures from our dataset. We then used an automatic machine-learning framework to train an ensemble of machine learning models using 4 features (kC, aa residue type, SASAi, and ) on the true PPI-hot spots and nonhot spots in the remaining 111 proteins in our dataset. The final ensemble model was used to identify PPI-hot spots in the 47 proteins lacking complex structures in our dataset. The resulting sensitivity (0.58) and F1 score (0.66) were lower than those in Table 1 using the full dataset. Nevertheless, they were greater than those achieved using AlphaFold-Multimer-predicted interface residues as PPI-hot spots (0.41). When we combined the PPI-HotspotID- predicted PPI-hot spots with the AlphaFold-Multimer-predicted interface residues, the resulting sensitivity (0.70) and F1 values (0.72) were higher than those obtained by each method alone. This indicates that PPI-HotspotID can identify true PPI-hot spots that reside outside the protein-protein interface.
Experimental Verification of PPI-HotspotID’s Predictions in Human eEF2.
We experimentally verified predictions made by PPI-HotspotID by using it to detect the PPI-hot spots of eEF2, an essential translation factor that hydrolyzes GTP to catalyze peptide elongation. Binding of cytoplasmic polyadenylation element-binding protein-2 (CPEB2) to eEF2 may interfere with conformational changes of eEF2 on ribosomes, thereby affecting the efficiency of eEF2-mediated GTP hydrolysis, and slowing down translation of hypoxiainducible factor (HIF)-1a mRNA.65 No eEF2-CPEB2 complex structure has been solved, but a 5-Å electron microscopy structure of eEF2 (PDB 4v6x-A)66 is available. Using the CPEB2 N-terminus for a yeast two-hybrid screen, a positive clone containing the eEF2 residues 717–803 had been identified and subsequent co-IP assay revealed a CPEB2-binding domain comprising eEF2 residues 743–817.65 Thus, we focused on this domain, which shares ≤20% sequence identity with the 158 nonredundant proteins in our dataset, in predicting PPI-hot spots. Based on the free eEF2 structure (PDB 4v6x-A),66 PPI-hotspotID predicted F794 as the PPI-hot spot with the highest probability of 0.67. So, we chose to test F794 and 7 other predicted PPI-hot spots (L763, R767, G768, G778, T779, R801, A808) that were > 12 Å from F794, as well as 4 predicted PPI-nonhot spots (E773, P789, V790, Q807).
To validate PPI-HotspotID’s predictions, we mutated the aforementioned predicted PPI-hot spots and PPI-nonhot spots in mouse eEF2 (meEF2), which shares 99% sequence identity with human eEF2. The generated eEF2 mutants (L763A, 766AAA768, E773Q, 778AAA780, 789AA790, F794A, R801A, Q807E, A808S, and D815A) along with wild-type eEF2 and negative control (enhanced green fluorescent protein, EGFP), were then screened for interaction with CPEB2 by co-immunoprecipitation (co-IP). This assay identified F794 as a critical eEF2 residue for binding to CPEB2. To confirm the initial screening result, we selected 3 mutants (778AAA780, F794A, and D815A designated as mut1, mut2, and mut3) for further analysis (Figure 2a). The interaction of wild-type and mutant eEF2 with CPEB2 was analyzed again by reciprocal co-IP. The results in Figure 2b show that the F794A mutation (mut2) abolished binding to CPEB2.
Next, we investigated whether disrupting the association between CPEB2 and eEF2 affects HIF-1α expression in vivo. Because eEF2 is an essential and abundant translational factor, its ectopic expression alone was insufficient to override the function of endogenous eEF2. Thus, we tested the F794A mutant under knockdown of endogenous eEF2 condition. HeLa cells were transfected with plasmids lacking (siCtrl) or containing a short hairpin sequence for human eEF2 (siheEF2) and subjected to puromycin selection. Both shRNA sequences, specifically knocking down human but not mouse eEF2, decreased endogenous eEF2 after 4 days (Figure 2c). HeLa cells were then transfected with the siheEF2 and flag-meEF2 (wild-type, mut2, or mut3) plasmids and subjected to puromycin and G418 selection for four days. Cells that survived were incubated with S35-methionine/cysteine to metabolically label synthesized proteins. The expression of the F794A or D815A mutant did not affect general protein synthesis (Figure 2d). However, the level of HIF-1a, but not CPEB2 or β-actin, was selectively increased in HeLa cells reconstituted with the F794A mutant (Figure 2e). Supplementary Figure S1 shows the uncropped immunoblot images. Thus, the eEF2 F794A mutation influences the translation of CPEB2-targeted HIF-1α mRNA without affecting general translation function.
Discussion
Identifying PPI-hot spots is challenging especially when the complex structure is lacking. A key hurdle is the lack of experimental data on PPI-hot spots, which hampers the training of accurate machine-learning models for their prediction. Here, we have introduced two novel elements that have helped to identify PPI-hot spots using the unbound structure. First, we have constructed a dataset comprising 414 experimentally known PPI-hot spots and 504 nonhot spots, and carefully checked that PPI-hot spots have no mutations resulting in ΔΔGbind < 0.5 kcal/mol, whereas nonhot spots have no mutations resulting in ΔΔGbind ≥ 0.5 kcal/mol or impact binding in immunoprecipitation or GST pull-down assays (see Methods). In contrast, SPOTONE53 employed nonhot spots defined as residues that upon alanine mutation resulted in ΔΔGbind < 2.0 kcal/mol. Notably, previous PPI-hot spot prediction methods did not employ PPI-hot spots whose mutations have been curated to significantly impair/disrupt PPIs in UniProtKB (see Introduction). Second, we have introduced novel features derived from unbound protein structures such as the gas-phase energy of the target protein relative to its unfolded state. The importance test results indicated the gas-phase energy as an important feature. This finding can be rationalized by considering how PPI-hot spots make significant contributions to the overall binding free energy, ΔGbind. PPI-hot spots can enhance favorable enthalpic contributions to the ΔGbind through hydrogen bonds or vdW contacts across the protein’s interface. This makes them energetically unstable in the absence of the protein’s binding partner and solvent, hence the gas-phase energy was found to be an important input feature. Alternatively, PPI-hot spots can counteract unfavorable entropic loss upon protein binding by maintaining an optimal binding scaffold, hence they are energetically stable.
Methods that rely on complex structures generally predict residues that make multiple contacts across the protein-protein interface as PPI-hot spots. Some of these methods assume that PPI-hot spots are exclusively located at the interface and aim to spot them among the interface residues.40 In contrast, PPI-HotspotID leverages evolutionary conservation, residue type, and stability principles based on the free protein structure to detect PPI-hot spots, including those lacking direct contact with the partner protein. Such noninterface PPI-hot spots may serve to maintain an optimal scaffold for protein binding, and are not uncommon: from our analysis of the 243 true PPI-hot spots in proteins with the complex structures, we found 67 “noninterface” PPI-hot spots with no hydrogen bonds and/or vdW contacts across the protein interface. PPI-HotspotID identified 43 of these 67 noninterface PPI-hot spots. An illustrative
example is the binding of Golgi resident protein (GCP60) with phosphatidylinositol 4-kinase β (PI4K—β). PPI-HotspotID correctly predicted all 4 experimentally known GCP60 PPI-hot spots including F19 and Y46, which do not form hydrogen bonds across the interface with PI4K—β (Figure 3). These results highlight the ability of PPI-HotspotID to identify PPI-hot spots involved in indirect interactions with partner proteins.
Proteins typically interact with multiple partners, but their PPI-hot spots may have been experimentally characterized for only a few partners. In some cases where PPI-HotspotID predicted residues that were absent in the PPI-Hotspot+PDBBM(1.1) as PPI-hot spots, the protein’s complex structures with other binding partners show intermolecular hydrogen bonds between PPI-HotspotID-predicted residues and residues of the respective partner proteins. This suggests that some of the PPI-HotspotID-predicted residues might be potential PPI-hot spots for other binding partners. For example, the death domain of CRADD (caspase-recruitment domain and death domain-containing adaptor protein) contains 7 experimentally known PPI-hot spots (N121, Q125, Y146, R147, K149, V156, Q169) critical for its interaction with PIDD (p53-induced death domain-containing protein). Based on the free crystal structure of CRADD (PDB 2O71-A),67 PPI-HotspotID correctly predicted 3 true positives (Y146, R147, and Q169) as well as G128. In the oligomeric structure (PDB 2OF5)68 of 7 CRADD proteins in complex with 5 PIDD proteins, G128 shows no hydrogen-bonding interactions, but its neighbor, L127, forms a backbone---side chain hydrogen bond with R147 in another CRADD chain (Figure 4). A positively charged G128R mutation would repel the nearby positively charged R147 in another CRADD chain, thus disrupting the CRADD—CRADD interface and decreasing CRADD’s affinity for PIDD. Experimental data showed that the G128R CRADD mutant did not co-immunoprecipitate the PIDD death domain, and patients who have non-syndromic mental retardation possess the G128R mutant.69 Thus, PPI-HotspotID could unveil a PPI-hot spot, G128, that is not apparent from the 2OF5 complex structure: although G128 does not directly interact with PIDD, its mutation, especially to an Arg, might perturb the CRADD—CRADD interface and thus CRADD’s oligomeric structure and binding affinity for PIDD.
The ability of PPI-HotspotID to detect PPI-hot spots provides biologists with a useful tool, as alanine-scanning mutagenesis and protein-protein complex structure determination to identify PPI-hot spots are laborious, time-consuming, and costly. Conventional methods based on complex structures might miss nonobvious PPI-hot spots with no direct interactions with the protein’s partner. AlphaFold-multimer and future improved protein-protein complex prediction methods require knowledge of interacting partners and independent calculations for each known partner, which reduces the overall efficiency. Moreover, solved/modeled proteinprotein complex structures only reveal the interface residues. In contrast, PPI-HotspotID can reveal nonobvious PPI-hot spots as well as potential PPI-hot spots for other protein partners, thus helping to elucidate the different PPI mechanisms.
Methods
Dataset. True PPI-hot spots.
We updated the PPI-Hotspot+PDBBM benchmark by removing 2 fused protein structures and adding new PPI-hot spots by (i) reviewing references in ASEdb55 to include nonalanine mutations with ΔΔGbind > 2 kcal/mol, and (ii) checking the experimental data of certain mutations in UniProtKB.58 For example, the PPI-Hotspot+PDBBM benchmark included R43A in aprataxin (UniProtlD Q7Z2E3), annotated as “loss of interaction with MDC1”, but not K52A, annotated as “impairs interaction with MDC1”. However, when we checked the experimental data in the UniProtKB reference, the binding bands were absent for both R43A and K52A mutants, therefore we added K52A as a PPI-hot spot. The updated benchmark, termed PPI-Hotspot+PDBBM(1.1)), contains 414 PPI-hot spots. Among these, 104 PPI-hot spots in 32 nonredundant proteins are based on mutations resulting in ΔΔGbind ≥ 2 kcal/mol from ASEdb55 and SKEMPI2.056 with no known mutations resulting in ΔΔGbind < 0.5 kcal/mol. The remaining 310 PPI-hot spots in 128 nonredundant proteins are based on mutations that are manually curated in UniProtKB58 to significantly impair/disrupt PPIs. Two of the proteins have PPI-hot spots from ASEdb/SKEMPI2.0 and UniProtKB, resulting in a total of 158 nonredundant proteins with free structures harboring 414 PPI-hot spots (Supplementary Tables S1 and S2).
True PPI-nonhot spots.
To obtain PPI-nonhot spots for the 158 nonredundant proteins with true PPI-hot spots, we identified residues from ASEdb55 and SKEMPI2.056 databases where mutations to alanine/nonalanine resulted in protein ΔΔGbind < 0.5 kcal/mol. We also identified residues in the UniProtKB where mutations to alanine/nonalanine were curated not to perturb PPIs. We manually checked each reference to ensure that mutations of these residues did not lead to ΔΔGbind changes ≥ 0.5 kcal/mol or impact binding in immunoprecipitation or GST pull-down assays. PPI-nonhot spots in non-native proteins or regions with missing structures were excluded. Supplementary Table S1 lists the 504 PPI-nonhot spots found in 75 proteins with free structures.
Input features.
To distinguish PPI-hot spots from PPI-nonhot spots, we input sequence, structural, and stability features of each residue in the protein for training various machine learning classifiers. The input features for each residue i of a protein included its aa type, conservation score, secondary structure, SASA, gas-phase energy, and respective components, polar solvation free energy, and nonpolar solvation free energy. The secondary structure, SASA, and energy components of each residue were computed using the DSSP program,70 FreeSasa71 and AmberTools version 20,72 respectively, using default parameters.
Per-Residue Free Energy Contributions.
For a given free protein structure, the Reduce program73 was used to add hydrogens and assign the protonation states of ionizable residues. Additional missing heavy and hydrogen atoms were added using the AmberTools version 2072 and the Amber FF19SB forcefield.74 To eliminate any steric clashes, we performed a conjugate gradients minimization with constraints on the heavy atoms using the Generalized Born model for 500 steps. The resulting structure was used to compute the per-residue energy/free energy contributions using the MMPBSA (Molecular Mechanics Poisson-Boltzmann Surface Area) module in AmberTools.72 For each residue i in the protein, we computed the (i) molecular mechanics energy , where includes contributions from bonded terms, is the vdW interaction energy, and is the electrostatic interaction energy as well as (ii) the polar () and nonpolar () solvation free energies relative to the corresponding values of residue i in an extended reference state where the residues do not interact with one another.75
Per-Residue Conservation Score.
To calculate the conservation score, , of residue i in a protein, we implemented a method similar to ConSurf76,77 to run in parallel with the energy evaluation code. First, we searched the UNIREF-90 database78 using HMMER79 to find sequences similar to the target sequence. Near-duplicates were removed by clustering matched sequences with ≥95% pairwise sequence identity using CD-hit80 and keeping only one representative. Since HMMER79 may only find good matches for a small proportion of the target sequence, we compared the HMMER sequences with the target sequence. We kept only those with > 60% overlap with the target sequence, and discarded sequences that were dissimilar (≤ 35% sequence identity) or nearly identical (≥ 95% sequence identity). Next, we pairwise aligned the remaining sequences, and if two sequences overlapped by > 10% of the sequence, we rejected the shorter sequence. After this filtering process, the resulting HMMER hits were used or if the number of hits exceeded 300, we selected the top 300 hits. These sequences were then aligned to the target sequence using MAFFT-LINSi.81 We then used the Rate4Site program82 to compute position-specific evolutionary rates from the generated multiple sequence alignment. These rates were normalized and grouped into ConSurf grades ranging from 1 to 9, where kC = 1 represents the most rapidly evolving residues, and kC = 9 indicates the most conserved residues.
Generating PPI-hot spot Predictive Model using AutoGluon.
We provided all the aforementioned residue features including the conservation score, , aa type, DSSP secondary structure, SASAi, , , , , , and to the Tabular module in AutoGluon v0.8.2 (https://auto.gluon.ai/stable/index.html). AutoGluon was chosen for model training and validation due to its robustness and user-friendly interface, allowing for the simultaneous and automated exploration of various machine-learning approaches and their combinations. Instead of using a single training set to train the model and a separate test set to evaluate its performance, we employed cross-validation, as it utilizes the entire dataset for both training and testing, making efficient use of the limited data on PPI-hot spots and PPI-nonhot spots. AutoGluon-Tabular automatically chose a random partitioning of our dataset into multiple subsets/folds for training and validation. Notably, the training and validation data share insignificant homology, as the average pairwise sequence identity in our dataset is 26%. Each fold was used once as a test set, while the remaining folds served as the training set. For each test set, the model’s performance was measured using the F1 score.
AutoGluon then trained individual “base” models, including LightGBM, CatBoost, XGBoost, random forests, extremely randomized trees, neural networks, and K-nearest neighbours. Using the aggregated predictions of the base models as features in addition to the original features, AutoGluon trained multiple “stacker” models, whose predictions were fed as inputs to additional higher layer stacker models in an iterative process called multi-layer stacking. The output layer used ensemble selection to aggregate the predictions of the stacker models. To improve stacking performance, AutoGluon used all the data for both training and validation through repeated k-fold bagging of all models at all layers of the stack, where k is determined by best precision. We refer the reader to the original study by Erikson et al.,83 which provides details on the methodology including the types of “base” models, multi-layer stack ensembling, and repeated k-fold bagging. Based on the highest mean F1 score, AutoGluon yielded a final PPI-hot spot predictive model that is a weighted regularized ensemble comprising more than a dozen different models (https://auto.gluon.ai/dev/api/autogluon.tabular.models.html).
Selecting Key Features.
Next, we evaluated the importance of each feature by performing a permutation-based test (part of the AutoGluon package), in which a feature in a column was randomly shuffled across different residues (rows), and the F1 score was evaluated. The importance test results revealed the four most important residue features, which in order of their importance, are (i) kC, (ii) aa residue type, (iii) SASAi, and (iv) . These four features were used to train an ensemble of machine-learning models using the entire data set, consisting of 414 true PPI-hot spots and 504 nonhot spots. The resulting PPI-hot spot prediction model, named PPI-HotspotID, yielded a F1 score comparable to the F1 score obtained using the initial set of 10 features. PPI-HotspotID was implemented as a freely accessible web server (https://github.com/wrigjz/ppihotspotid) with access to 4 virtual CPUs and 8 GB of memory. Calculations for a 539-residue protein (PDB 1c2bA) took 35 minutes.
Detecting PPI-hot spots Using the AlphaFold-Multimer-predicted Interface.
In cases where experimental complex structures are unavailable, can the protein—protein complexes modeled by AlphaFold-Multimer60 be used to identify PPI-hot spots using the predicted interface residues? To address this, we first identified PPI-hot spots within the PPI-Hotspot+PDBBM(1.1) dataset that lack experimentally determined protein complex structures. Not all the 414 PPI-hot spots in the PPI-Hotspot+PDBBM(1.1) have sequence information and thus UniProtID of the respective binding partners (see Supplementary Table S1), leaving 360 PPI-hot spots in 135 proteins associated with 155 pairs of PPIs, as some proteins are involved in multiple PPIs. Ninety of the 155 PPI pairs have complex structures in the PDB. For the 65 PPI pairs lacking complex structures, 17 pairs contain > 1,100 residues, exceeding the current size limit of AlphaFold-Multimer.60 Thus, we generated structural models for the remaining 48 complexes using the AlphaFold-Multimer module in the ColabFold version 1.3.064 with default settings. For each AB complex, the input sequence for protein A was based on the free structure sequence in the PPI-Hotspot+PDBBM(1.1), whereas that for protein B was retrieved in its entirety from the UniProtKB,58 as the binding region in protein B was unknown. Based on the AMBER-relaxed model structure with the highest pTM score, interface residues were defined as residues of protein A with ≥1 atom within a 5 Å cutoff of any protein B atom.
Experimental Verification of Predicted eEF2 PPI-hot spots. Plasmid construction.
The predicted PPI-hot spots and PPI-nonhot spots were mutated by QuikChange Site-Directed Mutagenesis Kit (Stratagene). The pcDNA3.1-flag-meEF2 plasmid was used as the PCR template and the sets of sense and antisense primers for mutagenesis are listed in Supplementary Figure S2. All constructs were sequenced to confirm the mutations. The shRNA clones, #1 TRCN0000047908 (GCGATCATGAATTTCAAGAAA) and #2: TRCN0000047910 (GCAGTACCTCAACGAGATCAA) against human eEF2 mRNA were obtained from the RNAi Core Facility (Academia Sinica).
Testing eEF2-CPEB2 interactions using co-immunoprecipitation (co-IP) and reciprocal co-IP.
HEK-293T cells obtained from American Type Culture Collection (ATCC, # CRL-3216) were cultured in DMEM with 10% fetal bovine serum (FBS). For reciprocal co-IP, the 8 μg DNA mixture containing 3 μg myc-CPEB2 and 5 μg flag-eEF2 (or a negative control, GFP) plasmids was transfected into a 10-cm dish of 293T cells using lipofectamine 2000. We transfected more flag-eEF2 plasmid DNA than myc-CPEB2 plasmid because myc-CPEB2 is expressed more abundantly than flag-eEF2. Overnight transfected cells were lysed in 500 μ1 IP buffer (20 mM Hepes, pH 7.4, 100 mM NaCl, 1 mM MgCl2, 0.1% TritonX-100, 10% glycerol, 0.5 mM DTT, 1X protease inhibitor cocktail and 100 μg/ml RNaseA) and centrifuged at 10,000 xg for 3 min at 4°C. The supernatant was equally divided and incubated with Protein G beads bound with myc or flag antibody for 3 hours at 4°C to respectively pull down myc-CPEB2 and flag-eEF2. The beads were washed five times with 300 μl IP buffer. If myc-CPEB2 and flag-eEF2 interact, myc-CPEB2 can co-precipitate with flag-eEF2 on flag antibody-beads, whereas flag-eEF2 can co-precipitate with myc-CPEB2 on myc antibodybeads. GFP was used as a negative control to ensure that the signals on the beads were caused by binding between flag-eEF2 and myc-CPEB2. The precipitated proteins were separated on a sodium dodecyl sulfate polyacrylamide gel electrophoresis (SDS-PAGE) for western blot analysis. Similarly, for the initial co-IP screening, the 4 μg DNA mixture containing 1.5 μg myc-CPEB2 and 2.5 μg flag-eEF2 (or a negative control, EGFP) plasmids was transfected into a 6-cm dish of 293T cells, harvested in 200 μ1 IP buffer and immunoprecipitated by using flag antibody-bound beads.
Functional impact of eEF2 mutants on HIF-1a and global protein synthesis.
HeLa cells obtained from ATCC (# CCL-2) were cultured in DMEM with 10% FBS. Each 6-cm plate of HeLa cells was transfected with 2 μg human eEF2 knockdown plasmid and 2 μg flag-meEF2 wild-type/mutant plasmid. Overnight transfected cells were selected with 0.5 μg/ml puromycin and 600 μg/ml G418 for three days to knock down endogenous eEF2 and maintain the expression of flag-meEF2, respectively. The selected cells were incubated with 10 μM MG132 for 4 hours before harvesting for western blotting of HIF-1a or replaced with 2 ml Met/Cys-lacking DMEM with 1% FBS and 60 μCi35S-Met/Cys (Perkin Elmer, cat# NEG772002MC) for 2 hours before separation on an SDS-PAGE.
Acknowledgements
This research was supported by Academia Sinica (AS-IA-107-L03) and the Ministry of Science and Technology (MOST-98-2113-M-001-011), Taiwan.
Competing interests
The authors declare no competing interests.
Additional Declarations:
The authors declare no competing interests.
Supplementary Information
References
- 1.Protein—protein interaction sites are hot spots for disease-associated nonsynonymous SNPsHuman Mutat 33:359–363
- 2.Oncogenic protein interfaces: small molecules, big challengesNat. Rev. Cancer 14:248–262
- 3.Small molecule protein—protein interaction inhibitors as CNS therapeutic agents: current progress and future hurdlesNeuropsychopharmacology 34:126–141
- 4.Hot spots in protein—protein interfaces: Towards drug discoveryProg. Biophys. Mol. Biol 116:165–173
- 5.Hot-spot analysis for drug discovery targeting protein-protein interactionsExpert Opin. Drug Discov 13:327–338
- 6.A hot spot of binding energy in a hormone-receptor interfaceScience 267:383–386
- 7.Anatomy of hot spots in protein interfacesJ. Mol. Biol 280:1–9
- 8.Unraveling hot-spots in binding interfaces: progress and challengesCurr. Opin. Struct. Biol 12:14–20
- 9.Protein-protein interactions: hot spots and structurally conserved residues often locate in complemented pockets that pre-organized in the unbound states: implications for dockingJ. Mol. Biol 344:781–795
- 10.Hot regions in protein-protein interactions: the organization and contribution of structurally conserved hot spot residuesJ. Mol. Biol 345:1281–1294
- 11.Computational alanine scanning mutagenesis - An improved methodological approachJ. Comput. Chem 28:644–654
- 12.The binding interface database (BID): a compilation of amino acid hot spots in protein interfacesBioinformatics 19:1453–1454
- 13.PPI-HotspotDB: Database of Protein—Protein Interaction Hot SpotsJ. Chem. Inf. Model 62:1052–1060
- 14.Using machine-learning-driven approaches to boost hot-spot’s knowledgeWiley Interdiscip. Rev. Comput. Mol. Sci
- 15.Computational alanine scanning to probe proteinprotein interactions: A novel approach to evaluate binding free energiesJ. Am. Chem. Soc 121:8133–8143
- 16.Computational alanine scanning of the 1: 1 human growth hormone—receptor complexJ. Comput. Chem 23:15–27
- 17.Predicting changes in the stability of proteins and protein complexes: a study of more than 1,000 mutationsJ. Mol. Biol 320:369–387
- 18.A simple physical model for binding energy hot spots in protein—protein complexesProc. Natl. Acad. Sci. USA 99:14116–14121
- 19.Targeting protein-protein interactions with small molecules: challenges and perspectives for computational binding epitope detection and ligand findingCurr. Med. Chem 13:2607–2625
- 20.Identification of hot-spot residues in proteinprotein interactions by computational dockingBMC Bioinfo 9:447–459
- 21.Restricted mobility of conserved residues in protein-protein interfaces in molecular simulationsBiophys. J 94:3475–3485
- 22.Flex ddG: Rosetta ensemble-based estimation of changes in protein—protein binding affinity upon mutationJ. Phys. Chem. B 122:5389–5399
- 23.Predicting and experimentally validating hot-spot residues at protein-protein interfacesACS Chem. Biol 14:2252–2263
- 24.An automated decision-tree approach to predicting protein interaction hot spotsProteins 68:813–823
- 25.A feature-based approach to modeling protein—protein interaction hot spotsNucleic Acids Res 37:2672–2687
- 26.PCRPi: presaging critical residues in protein interfaces, a new computational tool to chart hot spots in protein interfacesNucleic Acids Res 38
- 27.APIS: accurate prediction of hot spots in protein interfaces by combining protrusion index with solvent accessibilityBMC Bioinform 11:174–187
- 28.Predictions of hot spot residues at protein-protein interfaces using support vector machinesPLoS one 6
- 29.Prediction of hot spots in protein interfaces using a random forest model with hybrid featuresProtein Eng. Des. Sel 25:119–126
- 30.Prediction of hot spots residues in protein—protein interface using network feature and microenvironment featureChemom. Intell. Lab. Syst 131:16–21
- 31.Solvent accessible surface area-based hot-spot detection methods for protein-protein and protein-nucleic acid interfacesJ. Chem. Inf. Model 55:1077–1086
- 32.A machine learning approach for hot-spot detection at protein-protein interfacesInt. J. Mol. Sci 17
- 33.SpotOn: high accuracy identification of protein-protein interface hot-spotsSci Rep 7
- 34.Protein-protein interface hot spots prediction based on a hybrid feature selection strategyBMC Bioinform 19:14–29
- 35.Robust principal component analysis-based prediction of protein-protein interaction hot spotsProteins: Structure, Function, and Bioinformatics 89:639–647
- 36.Artificial intelligence based methods for hot spot predictionCurr. Opin. Struct. Biol 72:209–218
- 37.HotPoint: hot spot prediction server for protein interfacesNucleic Acids Res 38:W402–W406
- 38.KFC2: a knowledge-based hot spot prediction method based on interface solvation, atomic density, and plasticity featuresProteins 79:2671–2683
- 39.PredHS: a web server for predicting protein-protein interaction hot spots by using structural neighborhood propertiesNucleic Acids Res 42:W290–W295
- 40.Enhanced prediction of hot spots at protein-protein interfaces using extreme gradient boostingSci. Rep 8
- 41.Prediction of binding hot spot residues by using structural and evolutionary parametersGenet. Mol. Biol 32:626–633
- 42.Relationship between hot spot residues and ligand binding hot spots in protein—protein interfacesJ. Chem. Inf. Model 52:2236–2244
- 43.Hot spots in a network of functional sitesPloS one 8
- 44.A computational tool to predict the evolutionarily conserved protein—protein interaction hot-spot residues from the structure of the unbound proteinFEBS letters 588:326–333
- 45.The FTMap family of web servers for determining and characterizing ligand-binding hot spots of proteinsNat. Protoc 10:733–755
- 46.Protein-protein interaction hotspots carved into sequencesPLoS Comput. Biol 3:1169–1176
- 47.Accurate prediction of hot spot residues through physicochemical characteristics of amino acid sequencesProteins 81:1351–1362
- 48.Protein interaction hotspot identification using sequence-based frequency-derived featuresIEEE Transactions on Biomedical Engineering 60:2993–3002
- 49.An improved ensemble learning method with SMOTE for protein interaction hot spots prediction2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) :1584–1589
- 50.Protein binding hot spots prediction from sequence only by a new ensemble learning methodAmino acids 49:1773–1785
- 51.Prediction of protein hotspots from whole protein sequences by a random projection ensemble systemInt. J. Mol. Sci 18
- 52.Hot spot prediction in protein-protein interactions by an ensemble systemBMC Syst. Biol 12:89–99
- 53.SPOTONE: Hot Spots on protein complexes with extremely randomized trees via sequence-only featuresInternational Journal of Molecular Sciences 21
- 54.A two-step ensemble learning for predicting protein hot spot residues from whole protein sequenceAmino Acids 54:765–776
- 55.ASEdb: a database of alanine mutations and their effects on the free energy of binding in protein interactionsBioinformatics 17:284–285
- 56.SKEMPI 2.0: an updated benchmark of changes in protein—protein binding energy, kinetics and thermodynamics upon mutationBioinformatics 35:462–469
- 57.Local and global anatomy of antibody-protein antigen recognitionJ. Molec. Recognit 31
- 58.UniProt: the universal protein knowledgebaseNucleic Acids Res 46
- 59.Structural conservation of druggable hot spots in protein—protein interfacesProc. Natl. Acad. Sci. U.S.A 108:13528–13533
- 60.Protein complex prediction with AlphaFold-MultimerbioRxiv https://doi.org/10.1101/2021.10.04.463034
- 61.PDBsum: Structural summaries of PDB entriesProtein Sci 27:129–134
- 62.Crystal structure of the interleukin-4/receptor a chain complex reveals a mosaic binding interfaceCell 97:271–281
- 63.Three-dimensional solution structure of human interleukin-4 by multidimensional heteronuclear magnetic resonance spectroscopyScience 256:1673–1677
- 64.ColabFold: making protein folding accessible to allNat Methods 19:679–682
- 65.CPEB2-eEF2 interaction impedes HIF-1alpha RNA translationEMBO J 31:959–971
- 66.Structures of the human and Drosophila 80S ribosomeNature 497:80–85
- 67.Crystal structure of RAIDD death domain implicates potential mechanism of PIDDosome assemblyJ. Mol. Biol 357:358–364
- 68.Death domain assembly mechanism revealed by crystal structure of the oligomeric PIDDosome core complexCell 128:533–546
- 69.Genetic mapping and exome sequencing identify variants associated with five novel diseasesPLoS One 7
- 70.Dictionary of protein secondary structure: Pattern recognition of hydrogen-bonded and geometrical featuresBiopolymers 22:2577–2637
- 71.FreeSASA: An open source C library for solvent accessible surface area calculationsF1000Research
- 72.AMBER 2020Amber
- 73.Asparagine and glutamine: Using hydrogen atom contacts in the choice of side-chain amide orientationJ. Mol. Biol 285:1735–1747
- 74.ff19SB: Amino-Acid-Specific Protein Backbone Parameters Trained against Quantum Mechanics Energy Surfaces in SolutionJ. Chem. Theory Comput 16:528–552
- 75.Predicting DNA-binding amino acid residues from electrostatic stabilization upon mutation to Asp/Glu and evolutionary conservationProteins-Structure Function and Bioinformatics 67:671–680
- 76.ConSurf: Identification of Functional Regions in Proteins by Surface-Mapping of Phylogenetic InformationBioinformatics 19:163–164
- 77.ConSurf 2005: the projection of evolutionary conservation scores of residues on protein structuresNucleic Acids Res 33:299–302
- 78.The Universal Protein Resource (UniProt): an expanding universe of protein informationNucleic Acids Res 34:D187–191
- 79.Hidden Markov model speed heuristic and iterative HMM search procedureBMC Bioinformatics 11
- 80.Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequencesBioinformatics 22:1658–1659
- 81.Parallelization of MAFFT for large-scale multiple sequence alignmentsBioinformatics 34:2490–2492
- 82.Rate4Site: An algorithmic tool for the identification of functional regions in proteins by surface mapping of evolutionary determinants within their homologuesBioinformatics (Oxford, England) 18:S71–7
- 83.AutoGluon-Tabular: Robust and Accurate AutoML for Structured DataarXiv https://doi.org/10.48550/arXiv.2003.06505
- 84.Structural insights and in vitro reconstitution of membrane targeting and activation of human PI4KB by the ACBD3 proteinSci. Rep 6
Article and author information
Version history
- Sent for peer review:
- Preprint posted:
- Reviewed Preprint version 1:
- Reviewed Preprint version 2:
- Version of Record published:
Copyright
© 2024, Chen et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
- views
- 896
- downloads
- 42
- citations
- 0
Views, downloads and citations are aggregated across all versions of this paper published by eLife.