research papers\(\def\hfill{\hskip 5em}\def\hfil{\hskip 3em}\def\eqno#1{\hfil {#1}}\)

Journal logoSTRUCTURAL
BIOLOGY
ISSN: 2059-7983

Using graphlet degree vectors to predict atomic displacement parameters in protein structures

crossmark logo

aFaculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Glagoljaška 8, Koper, Slovenia, and bDepartment of Biochemistry, Molecular and Structural Biology, Institute Jožef Stefan, Jamova 39, Ljubljana, Slovenia
*Correspondence e-mail: jure.praznikar@upr.si

Edited by K. Diederichs, University of Konstanz, Germany (Received 26 June 2023; accepted 17 October 2023; online 21 November 2023)

In structural biology, atomic displacement parameters, commonly used in the form of B values, describe uncertainties in atomic positions. Their distribution over the structure can provide hints on local structural reliability and mobility. A spatial macromolecular model can be represented by a graph whose nodes are atoms and whose edges correspond to all interatomic contacts within a certain distance. Small connected subgraphs, called graphlets, provide information about the wiring of a particular atom. The multiple linear regression approach based on this information aims to predict a distribution of values of isotropic atomic displacement parameters (B values) within a protein structure, given the atomic coordinates and molecular packing. By modeling the dynamic component of atomic uncertainties, this method allows the B values obtained from experimental crystallographic or cryo-electron microscopy studies to be reproduced relatively well.

1. Introduction

In experimental methods such as macromolecular crystallo­graphy and cryo-electron microscopy (cryo-EM), uncertainty in atomic positions is described by the atomic displacement parameter (ADP), commonly in the form of a B value (Trueblood et al., 1996[Trueblood, K. N., Bürgi, H.-B., Burzlaff, H., Dunitz, J. D., Gramaccioli, C. M., Schulz, H. H., Shmueli, U. & Abrahams, S. C. (1996). Acta Cryst. A52, 770-781.]; Parthasarathy & Murthy, 1997[Parthasarathy, S. & Murthy, M. R. N. (1997). Protein Sci. 6, 2561-2567.]; Radivojac et al., 2004[Radivojac, P., Obradovic, Z., Smith, D. K., Zhu, G., Vucetic, S., Brown, C. J., Lawson, J. D. & Dunker, A. K. (2004). Protein Sci. 13, 71-80.]; Carugo, 2018a[Carugo, O. (2018a). Amino Acids, 50, 775-786.]; Sun et al., 2019[Sun, Z., Liu, Q., Qu, G., Feng, Y. & Reetz, M. T. (2019). Chem. Rev. 119, 1626-1665.]). In fact, this parameter includes both the actual atomic mobility, which is the subject of our interest, and variation of the atomic position over the sample, i.e. static uncertainties. The ADPs are refined before deposition in the Protein Data Bank (PDB; Berman et al., 2000[Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., Shindyalov, I. N. & Bourne, P. E. (2000). Nucleic Acids Res. 28, 235-242.]). At medium resolution, the ratio of the number of observations to the number of parameters is low and the experimental data are insufficient, so restraints and constraints are needed to refine the coordinates and ADPs. A simple restraint used in modern crystallographic software is that bonded atoms tend to have similar ADPs (Hirshfeld, 1976[Hirshfeld, F. L. (1976). Acta Cryst. A32, 239-244.]; Konnert & Hendrickson, 1980[Konnert, J. H. & Hendrickson, W. A. (1980). Acta Cryst. A36, 344-350.]; Tronrud, 1996[Tronrud, D. E. (1996). J. Appl. Cryst. 29, 100-104.]; Merritt, 2011[Merritt, E. A. (2011). Acta Cryst. A67, 512-516.], 2012[Merritt, E. A. (2012). Acta Cryst. D68, 468-477.]). However, refinement also depends on the crystallo­grapher, who determines the strength of the restraints and the constraints; for example, the minimum and maximum B values allowed. The accuracy of ADPs and their maximal values in protein models were the subjects of studies by Carugo (2018b[Carugo, O. (2018b). BMC Bioinformatics, 19, 61.], 2022[Carugo, O. (2022). Acta Cryst. D78, 69-74.]). These studies showed that very large ADPs were deposited more frequently in the PDB after 2008 and that there has been no improvement in ADP errors over the last two decades.

Recently, Masmaliyeva & Murshudov (2019[Masmaliyeva, R. C. & Murshudov, G. N. (2019). Acta Cryst. D75, 505-518.]) and Masmaliyeva et al. (2020[Masmaliyeva, R. C., Babai, K. H. & Murshudov, G. N. (2020). Acta Cryst. D76, 926-937.]) suggested a very interesting method for analyzing and validating isotropic ADPs. It was shown that the distribution of isotropic ADPs in a protein structure follows a shifted inverse gamma distribution (SIGD), which was defined as

[P(B \semi B_0, \alpha, \beta) = {{\beta^\alpha} \over {\Gamma(\alpha)}}(B - B_0)^{-\alpha - 1}\exp\left(- {\beta \over {B - B_0}} \right), \eqno(1)]

where α, β and B0 are shape, scale and shift parameters, respectively. Note that B0 is defined as 90% of the minimum B value in the protein model. The statistics for the shape and scale parameters of the SIGD were obtained from a large PDB data set. By estimating the shape and scale parameters of the SIGD, information can be obtained on whether the ADP distribution of the query protein is an outlier that requires further validation. At the same time, this method cannot be used to predict ADPs.

Instead, several methods to predict the isotropic ADPs of macromolecules have been suggested using the amino-acid sequence (Yuan et al., 2005[Yuan, Z., Bailey, T. L. & Teasdale, R. D. (2005). Proteins, 58, 905-912.]; Schlessinger & Rost, 2005[Schlessinger, A. & Rost, B. (2005). Proteins, 61, 115-126.]; Schlessinger et al., 2006[Schlessinger, A., Yachdav, G. & Rost, B. (2006). Bioinformatics, 22, 891-893.]; Pan & Shen, 2009[Pan, X.-Y. & Shen, H.-B. (2009). Protein Pept. Lett. 16, 1447-1454.]), packing density (Halle, 2002[Halle, B. (2002). Proc. Natl Acad. Sci. USA, 99, 1274-1279.]), graph-theory parameters (Jacobs et al., 2001[Jacobs, D. J., Rader, A. J., Kuhn, L. A. & Thorpe, M. F. (2001). Proteins, 44, 150-165.]; Gohlke et al., 2004[Gohlke, H., Kuhn, L. A. & Case, D. A. (2004). Proteins, 56, 322-337.]; Yin et al., 2011[Yin, H., Li, Y.-Z. & Li, M.-L. (2011). Protein Pept. Lett. 18, 450-456.]), elastic networks of Cα atoms (Kundu et al., 2002[Kundu, S., Melton, J. S., Sorensen, D. C. & Phillips, G. N. (2002). Biophys. J. 83, 723-732.]), local structure-assembly variations (Yang et al., 2016[Yang, J., Wang, Y. & Zhang, Y. (2016). J. Mol. Biol. 428, 693-701.]) and advanced machine-learning algorithms (Bramer & Wei, 2018[Bramer, D. & Wei, G.-W. W. (2018). J. Chem. Phys. 149, 134107.]).

To our knowledge, none of these methods is widely used in practice. A review of the cited scientific papers shows that (i) some scripts or software are not available, (ii) the prediction is based on the sequence and not on the atomic model and (iii) the predicted B values are constant for all atoms in a given residue. To address all of these issues, and to further develop the prediction of B values, the method introduced by Weiss (2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]) was chosen, where a linear model was introduced in which the B values depend on the parameters of the close atomic contacts. Therefore, by adding parameters describing the local wiring patterns, the linear model was extended into a multiple linear model that is relatively simple and intuitive to construct.

From the perspective of graph theory each contact can be considered as an edge between two nodes (atoms), and the number of contacts per atom is called the node degree in graph theory. This local graph parameter can be used to classify or to sort the nodes. This single measure seems to be insufficient to determine whether two nodes are (dis)similar. The degree of a node indicates how many connections a particular node has, but it does not contain information about how these neighboring nodes are connected themselves. Therefore, additional local graph parameters are needed to better define both close and deep contacts of a given node, which are expected to estimate the ADP for the respective atom.

An extension of the node degree or the number of connections per node was introduced by Pržulj (2007[Pržulj, N. (2007). Bioinformatics, 23, e177-e183.]). In this work, small (2–4 nodes) subgraphs, called graphlets, were introduced. Similar to counting the number of edges per node, one can also count the number of graphlets per node. Thus, by counting the graphlets (or small motifs) per node in the graph, we can extract the local topology of the node. This topological description of the nodes contains information about the number of connections as well as information about how neighboring nodes are connected.

In the work presented here, the graphlet degree vector (GDV) was used to build a multiple linear regression model to predict the distribution of protein isotropic ADPs (B values). It was shown that the multiple linear regression model using the GDV to predict the distribution of B values performs better than the linear model based on only the atomic contact number (Weiss, 2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]). The multiple linear model is independent of resolution and is only based on the geometry of the model. It can be useful to predict the distribution of B values for macromolecular models obtained by macromolecular crystallography, cryo-EM or structure prediction (Jumper et al., 2021[Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., Bridgland, A., Meyer, C., Kohl, S. A. A., Ballard, A. J., Cowie, A., Romera-Paredes, B., Nikolov, S., Jain, R., Adler, J., Back, T., Petersen, S., Reiman, D., Clancy, E., Zielinski, M., Steinegger, M., Pacholska, M., Berghammer, T., Bodenstein, S., Silver, D., Vinyals, O., Senior, A. W., Kavukcuoglu, K., Kohli, P. & Hassabis, D. (2021). Nature, 596, 583-589.]; Baek et al., 2021[Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., Millán, C., Park, H., Adams, C., Glassman, C. R., DeGiovanni, A., Pereira, J. H., Rodrigues, A. V., van Dijk, A. A., Ebrecht, A. C., Opperman, D. J., Sagmeister, T., Buhlheller, C., Pavkov-Keller, T., Rathinaswamy, M. K., Dalwadi, U., Yip, C. K., Burke, J. E., Garcia, K. C., Grishin, N. V., Adams, P. D., Read, R. J. & Baker, D. (2021). Science, 373, 871-876.]).

2. Methods

2.1. Graphlet degree vector

Graphlets are small induced subgraphs of a larger graph (Fig. 1[link]). Graphlet G0 is the smallest graphlet and contains two topologically equal nodes labeled `0' (Fig. 1[link]). Graphlet G1 has two topologically distinct nodes labeled `1' and `2'. When two or more nodes are topologically the same, we say that they belong to the same orbit. Thus, the nodes at the ends of graphlet G1 belong to orbit O1, while the node in the middle belongs to orbit O2. In total, graphlets of size 2, 3 and 4 contain 15 topologically distinct nodes called orbits, labeled 0, 1, 2, 3, …, 14 (Fig. 1[link]).

[Figure 1]
Figure 1
Graphlets of size 2 (G0), 3 (G1 and G2) and 4 (G3G8). Orbits, i.e. topologically different nodes, are labeled 0, 1, 2, 3, …, 14.

Visual inspection of the graph shown in Fig. 2[link](a) shows that node C has three edges. We obtain the same result if we count the number of edges with which node C touches orbit O0 (the term `touch' is taken from the work of Pržulj, 2007[Pržulj, N. (2007). Bioinformatics, 23, e177-e183.]). For example, node C touches orbit O0 three times, via edges DC, BC and FC (Fig. 2[link]a). It follows that the degree of orbit O0 for node C is three. In the same way, we can now count how many times node C touches orbits O1, O2, …, O14. In other words, this is an extension of a node's degree.

[Figure 2]
Figure 2
An illustration of the degree for all 15 orbits for a graph with nine nodes and ten edges. (a) A graph with nine nodes and ten edges; the graphlets G3 where node C touches orbit O5 are listed next to the graph; (b) the corresponding GDVs.

For illustration, the degrees for all 15 orbits for a graph with nine nodes and ten edges are shown as a colored table (Fig. 2[link]b). Thus, node C touches orbit O1 five times, via EDC, ABC, GFC, HFC and IFC. Node F touches orbit O0 four times (CF, GF, HF and IF), while it touches orbit O1 only twice (DCF and BCF). Only nodes F, G, H and I touch orbit O3: `triangle'. The highest degree (10) corresponds to node C and orbit O5. All corresponding graphlets G3, where node C touches orbit O5, are listed next to the graph in Fig. 2[link](a).

Therefore, for each query protein we obtain a matrix of size N × M, where N is the number of atoms and M is 15 (the total number of orbits). Thus, each element of the matrix contains the degree of a particular orbit for each node (atom).

2.2. Multiple linear regression

A multiple linear regression model has been used to predict the B values of protein atoms from the atomic GDV considering atoms as nodes of a graph, as described above. To enable comparison between the B values of different protein structures, the B values of each protein structure were independently normalized so that the mean B value was set to 0 and the standard deviation of the B value was set to 1. Multiple linear regression searches for a linear relationship between explanatory variables and the dependent variable. In this study, the explanatory variables were the components of the GDV and the dependent variable was the B value. Since the degree of orbits per atom can vary and it is more likely to find a higher degree for orbit O0 than for orbit O14, the columns of the matrix N × M, where N is the total number of atoms in the given protein and M is the length of the GDV, were normalized so that the mean of all columns equals 0 and the standard deviation equals 1. The multiple regression model (GDV model) with 15 explanatory variables and N protein atoms is written as

[B_n = b_0 + \beta_0 O_{n,0} + \beta_1 O_{n,1} + \ldots + \beta_k O_{n,k}, \eqno(2)]

where Bn is the dependent variable, n = 1, 2, …, N, b0 is the intercept, On,k, k = 0, 1, 2, …, 14 are explanatory variables and βk are the coefficients of the vector of regression. The orbit O0 contains information about the number of contacts per atom. For comparison with the GDV model, a linear model (contact model) with an independent variable O0 was also used,

[B_n = b_0 + \beta_0 O_{n,0}. \eqno(3)]

To calculate the efficiency of the contact and GDV models, the correlation between the predicted B values and those deposited in the PDB-REDO database (Joosten et al., 2009[Joosten, R. P., Salzemann, J., Bloch, V., Stockinger, H., Berglund, A.-C., Blanchet, C., Bongcam-Rudloff, E., Combet, C., Da Costa, A. L., Deleage, G., Diarena, M., Fabbretti, R., Fettahi, G., Flegel, V., Gisel, A., Kasam, V., Kervinen, T., Korpelainen, E., Mattila, K., Pagni, M., Reichstadt, M., Breton, V., Tickle, I. J. & Vriend, G. (2009). J. Appl. Cryst. 42, 376-384.], 2014[Joosten, R. P., Long, F., Murshudov, G. N. & Perrakis, A. (2014). IUCrJ, 1, 213-220.]) was calculated.

2.3. Software

The R package (version 4.2.1; R Core Team, 2022[R Core Team (2022). The R Project for Statistical Computing. https://www.r-project.org/.]) was used for data analysis with the following packages: orca (version 1.1-1; Hočevar & Demšar, 2014[Hočevar, T. & Demšar, J. (2014). Bioinformatics, 30, 559-565.], 2016[Hočevar, T. & Demšar, J. (2016). J. Stat. Softw. 71(10), 1-24.]), netdist (version 0.4.9100; Ali et al., 2014[Ali, W., Rito, T., Reinert, G., Sun, F. & Deane, C. M. (2014). Bioinformatics, 30, i430-i437.]), bio3d (version 2.4-2; Grant et al., 2006[Grant, B. J., Rodrigues, A. P. C., ElSawy, K. M., McCammon, J. A. & Caves, L. S. D. (2006). Bioinformatics, 22, 2695-2696.]), igraph (version 1.2.6; Csardi & Nepusz, 2006[Csardi, G. & Nepusz, T. (2006). InterJ. Complex Syst., 1695.]), caret (version 6.0-90; Kuhn, 2008[Kuhn, M. (2008). J. Stat. Softw. 28(5), 1-26.]), MASS (version 7.3-58.1; Venables & Ripley, 2002[Venables, W. N. & Ripley, B. D. (2002). Modern Applied Statistics with S, 4th ed. New York: Springer.]) and invgamma (version 1.1).

A simplified algorithm for constructing the graph and counting the orbits is presented below.

Step 1. The bio3d package is used to read the PDB file and extract the atomic coordinates.

Step 2. The distance matrix between all pairs of atoms is calculated.

Step 3. The adjacency matrix is created (a link exists if the distance is less than a certain threshold).

Step 4. The adjacency matrix as input data and the igraph package are used to create a graph.

Step 5. The graph from step 4 and the orca (inside netdist) package are used to count the number of orbits (degree) for each node.

The final result is a matrix of dimensions N × M, where N is the number of atoms and M is 15, with orbits O0, O1, …, O14. The R scripts for reading in the protein coordinates, creating the graph, counting the orbits and predicting B values can be found at https://github.com/jure-praznikar/Graphlets-B-value.

To order the variables in the multiple linear regression according to their importance, the varImp function (R package caret) was used. In general, the most important variable is the one that explains most of the variance of the response variable. The R function varImp uses the absolute value of the t-statistic to measure the importance of the variables.

All figures containing a ribbon representation of the 3D protein model were created using Visual Molecular Dynamics (Humphrey et al., 1996[Humphrey, W., Dalke, A. & Schulten, K. (1996). J. Mol. Graph. 14, 33-38.]).

3. Results and discussion

3.1. Data set

The PISCES protein-sequence culling server (Wang & Dunbrack, 2003[Wang, G. & Dunbrack, R. L. Jr (2003). Bioinformatics, 19, 1589-1591.]) was used to obtain a Protein Data Bank identification (PDBid) list of protein structures with the following characteristics: maximum mutual sequence identity of 40%, X-ray resolution range of 1.6–2.6 Å, crystallographic R value less than or equal to 0.25 and protein size between 50 and 500 residues. After retrieving the PDBid list, the following filters were applied: exclusion of assemblies with more than 10 000 atoms, exclusion of proteins with missing B values, exclusion of assemblies with B values greater than 200 Å2, exclusion of assemblies with an extremely low B-value standard deviation (below 0.1) and exclusion of assemblies with low Ramachandran and rotamer Z-scores (less than −2). Assembly here refers to all chains identified in biological assembly 1. The Ramachandran and rotamer Z-score data were obtained from the PDB-REDO database available at https://pdb-redo.eu/download. The PDBid list was then used to retrieve 2107 entries from the PDB-REDO database (Joosten et al., 2009[Joosten, R. P., Salzemann, J., Bloch, V., Stockinger, H., Berglund, A.-C., Blanchet, C., Bongcam-Rudloff, E., Combet, C., Da Costa, A. L., Deleage, G., Diarena, M., Fabbretti, R., Fettahi, G., Flegel, V., Gisel, A., Kasam, V., Kervinen, T., Korpelainen, E., Mattila, K., Pagni, M., Reichstadt, M., Breton, V., Tickle, I. J. & Vriend, G. (2009). J. Appl. Cryst. 42, 376-384.], 2014[Joosten, R. P., Long, F., Murshudov, G. N. & Perrakis, A. (2014). IUCrJ, 1, 213-220.]).

The distribution of B values for each entry was analyzed using SIGD as proposed by Masmiliyeva and Murshudov (Masmaliyeva & Murshudov, 2019[Masmaliyeva, R. C. & Murshudov, G. N. (2019). Acta Cryst. D75, 505-518.]; Masmaliyeva et al., 2020[Masmaliyeva, R. C., Babai, K. H. & Murshudov, G. N. (2020). Acta Cryst. D76, 926-937.]). For each entry, the SIGD parameters, namely the shape (α) and scale (β), were calculated and plotted against resolution (Supplementary Fig. S1). PDB-REDO database entries with low or high α and β values that fell outside the 95% prediction interval were excluded from further analysis. Thus, the final data set included 1957 PDB-REDO models. Since the B values in crystallographic models depend on the packing of atoms, symmetry-related residues were added to the PDB-REDO model. For this purpose, WHAT IF was used (Vriend, 1990[Vriend, G. (1990). J. Mol. Graph. 8, 52-56.]; Rodriguez et al., 1998[Rodriguez, R., Chinea, G., Lopez, N., Pons, T. & Vriend, G. (1998). Bioinformatics, 14, 523-528.]). It adds all symmetry-related residues that possess at least one atom which makes a contact with an atom in the original protein structure. Two symmetry-related atoms are considered to be in contact when the distance between their van der Waals surfaces is smaller than 5.0 Å. Supplementary Fig. S2 shows an example of a PDB-REDO structure with symmetry-related residues used in this work.

3.2. Optimization of the cutoff distance

To calculate the GDV, the 3D protein model must first be converted into a graph where nodes represent protein atoms. Two nodes are connected by an edge if the respective atoms are at a distance shorter than a prescribed value, referred to below as the cutoff distance. The graph edges do not distinguish between covalently and noncovalently bonded atoms.

During crystallographic refinement, various restraints are used principally to ensure that chemically bonded atoms have similar B values. Similar restraints were applied to GDVs. To do so, a new smoothed value was assigned to a given atom as the sum of the current value and the average value of all neighboring nodes within a 2.0 Å radius. We need to distinguish between the cutoff distance used to create the graph and the 2.0 Å distance used in the smoothing procedure. This smoothing distance, being slightly above the length of covalent bonds, was kept constant while the optimal cutoff distance used to generate the graph was searched for.

To define this distance, we first randomly selected 50 entries that were used to train and validate the (multi)linear model. The model was built on 90% of the structures, which were then used to predict the test set (10% of protein structures). In the frame of tenfold cross-validation, this procedure was repeated ten times. For each entry, the correlation coefficient between the predicted and the PDB-REDO B values was calculated and used to find the optimal cutoff distance. Fig. 3[link] shows the correlation between the predicted and PDB-REDO B values. Its behavior was similar for all tested models, allowing us to make some conclusions.

[Figure 3]
Figure 3
Correlation between PDB-REDO and predicted B values as a function of the cutoff distance for 50 randomly selected structures from our database. (a) GDV model, (b) contact model; the red line represents the average value.

In the case of the GDV model, the lowest correlation was found at the shortest cutoff distance that we tried, 3.0 Å (Fig. 3[link]a), while the highest correlation values were found in the interval 5.0–8.0 Å, with no significant difference in this interval. Therefore, a cutoff distance of 5.0 Å, which minimizes the calculations, was considered to be the best choice and was used in further analysis.

For comparison, we repeated the same procedure with the contact model. Here, the optimal cutoff distance (Fig. 3[link]b) was different from that for the GDV model, agreeing with the value of 7.0 Å determined previously by Weiss (2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]). The overall correlation obtained by the GDV model is higher than that obtained by the contact model.

The reason why the correlation in the case of the GDV model reaches a plateau at a shorter cutoff distance is that the GDV incorporates information about `deep contacts', i.e. a neighbor of the neighbor. For example, graphlet G3 could represent a Cα–Cα wiring between two adjacent residues, the distance of which is typically ∼3.8 Å for a trans peptide. A quick estimate of the average distance of deep contacts lying outside the spherical radii is half of 3.8 Å, i.e.1.9 Å. If we add the GDV model cutoff distance of 5.0 Å and the estimated deep contact distance of 1.9 Å, we obtain a distance of 6.9 Å, which is consistent with the cutoff distance of the contact model.

3.3. Prediction of the B-value distribution

Fig. 4[link](a) shows a box plot of all correlation values between PDB-REDO and predicted B values for 1957 entries using the contact model defined by equation (3)[link] and the GDV model defined by equation (2)[link], each with its own cutoff distance: 7.0 and 5.0 Å, respectively. Both models, contact and GDV, were validated using the same procedure (tenfold cross-validation) as described in §3.2[link].

[Figure 4]
Figure 4
(a) Box plots of correlations between PDB-REDO and predicted B values for the contact and GDV models. The pairwise delta correlation GDV–contact box plot represents the difference between the GDV and contact models. (b) Correlation versus resolution for the contact model, (c) correlation versus resolution for the GDV model, (d) correlation versus number of atoms (protein size) for the contact model and (e) correlation versus number of atoms (protein size) for the GDV model.

The GDV model performed better than the contact model, with the average correlation increased by 0.08 (0.73 versus 0.65) and the largest correlation increased by 0.17. The average value does not indicate in how many cases the GDV model was better compared with the contact model. Therefore, the delta correlation (GDV–contact) was calculated, defined as the GDV–model correlation minus the contact–model correlation. The box plot shows (Fig. 4[link]a) that the GDV model performs better than the contact model for the vast majority, 1943 (or 99.3%), of the PDB-REDO entries used in the tests.

Thus, the introduction of additional variables and information in comparison with the contact model improves the results. It should be emphasized that both models predict the distribution of B values, i.e. normalized values, and not the absolute B values (in Å2). Their rescaling to predict non-normalized B values is also possible, but only to some extent. To do so, the mean B value and the standard deviation of the B value of the model are needed. These values are resolution-dependent (Carugo, 2018b[Carugo, O. (2018b). BMC Bioinformatics, 19, 61.]; Masmaliyeva & Murshudov, 2019[Masmaliyeva, R. C. & Murshudov, G. N. (2019). Acta Cryst. D75, 505-518.]; see also Supplementary Fig. S3), and the width of the distribution for a given resolution is quite large. For example, at a resolution of 2.0 Å the mean B value ranges from 15 to 50 Å2 and the standard deviation ranges from 5 to 20 Å2, and using an incorrect combination of these values may result in wrongly predicted absolute B values.

The data set used in this study contains protein structures that have been solved at different resolutions and have quite different sizes. The correlation versus resolution plot and the correlation versus the number of atoms show that the accuracy of both the contact and GDV models does not depend on these parameters (Fig. 4[link]). This is expected since the model is fully based on the molecular geometry. Thus, we can assume that the B values are not completely independent parameters but are related to the atomic coordinates: the molecular geometry. The first studies to indicate that B values are not completely independent parameters were presented by Halle (2002[Halle, B. (2002). Proc. Natl Acad. Sci. USA, 99, 1274-1279.]) and Weiss (2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]). The former study showed that B values are inversely proportional to contact density, while the latter study showed that there is a linear relationship between atom contact numbers and B values. The GDV, or rather the graph, is also based on atomic coordinates. Thus, this study supports the assumption that the B values are not completely independent of the coordinates.

3.4. Final (multi)linear model

The final contact model built on all data, i.e. all atoms of all PDB-REDO entries (∼5.8 × 106 atoms), is given as

[B_{\rm p} = - 0.64{O_0} \eqno(4)]

and the GDV model is given as

[\eqalignno {B_{\rm p} & = 0.33{O_0} - 2.48{O_1} + 0.30{O_2} - 1.30{O_3} - 0.71{O_4} + 1.17{O_5} \cr &\ \quad +\ 0.35{O_6} - 0.28{O_7} + 0.10{O_8} + 0.50{O_9} + 0.68{O_{10}} \cr &\ \quad -\ 0.08{O_{11}} +\ 0.43{O_{12}} + 0.04{O_{13}} + 0.28{O_{14}}, &(5)}]

where Bp refers to the normalized predicted B value and O0, O1, … O14 are the degrees of node orbits. Note that the intercept value in equation (4)[link] is 0 and the linear regression coefficient is equal to −0.64, which means that the larger the number of contacts the lower the B value (Halle, 2002[Halle, B. (2002). Proc. Natl Acad. Sci. USA, 99, 1274-1279.]; Weiss, 2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]).

A linear model (equation 4[link]) is easier to interpret than a multiple linear model (equation 5[link]), especially since its variables are highly correlated. Indeed, the correlation matrix (Fig. 5[link]a) shows that there is a high collinearity between orbits and that all orbits are negatively correlated with the B value. The B value is most negatively correlated with orbits O1 (−0.63) and O4 (−0.66). Therefore, instead of analyzing the magnitude and the sign of the regression coefficients in equation (5)[link], an analysis of the most important variables was performed. The first three most important variables are O4, O1 and O5 (Fig. 5[link]b). These three orbits correspond to two graphlets, G1 and G3 (Fig. 1[link]). It is interesting to note that orbit O0 (the number of contacts) appears to be one of the less important variables; however, it is highly correlated with several other orbits. This suggests that the types of connections of neighboring atoms are more important than the number of contacts in itself. The first three most important variables (O4, O1 and O5) correspond to the `unbranched' graphlets G1 and G3, while the next four important variables are O9, O12, O10 and O6, which correspond to the `branched' graphlets, namely G4, G6 and G7 (Fig. 1[link]), and thus contain information about the internal connection between nodes.

[Figure 5]
Figure 5
(a) Correlation matrix. Pairwise correlation of B value and orbits O0, O1, … O14. (b) Variable importance of the GDV model. The importance of the variables is normalized so that the most important variable has a value of 100.

3.5. The bimodal distribution of B values and its relationship to normalization

Approximately 15% of PDB structures exhibit multimodality of B values (Masmaliyeva et al., 2020[Masmaliyeva, R. C., Babai, K. H. & Murshudov, G. N. (2020). Acta Cryst. D76, 926-937.]), and attention should be paid to how these B values are normalized. Two examples from our data set that have a bimodal distribution of B values are shown in Supplementary Fig. S4. The performance of the GDV model and its relationship to the normalization of B values is presented below.

3.5.1. A heterotrimeric protein

A detailed examination of the results of the contact and GDV models revealed that the lowest correlation (∼0.20) for both models occurred in the case of PDB entry 7upo, which is also seen as an outlier in the box plot (Fig. 4[link]a). The structure of this obligate ABC-type heterotrimeric protein is a de novo design determined at 2.1 Å resolution (Bermeo et al., 2022[Bermeo, S., Favor, A., Chang, Y.-T., Norris, A., Boyken, S. E., Hsia, Y., Haddox, H. K., Xu, C., Brunette, T. J., Wysocki, V. H., Bhabha, G., Ekiert, D. C. & Baker, D. (2022). Nat. Struct. Mol. Biol. 29, 1266-1276.]). Each monomer consists of two helices of about 35 residues in length connected by short loops, with two loops on the same side (chains A and B) and one loop on the opposite side (chain C) of the heterotrimer (Fig. 6[link]a). Visual inspection shows that chains A, B and C have a similar spatial structure (Fig. 6[link]b). The template-modeling score (TM-score; Zhang & Skolnick, 2005[Zhang, Y. & Skolnick, J. (2005). Nucleic Acids Res. 33, 2302-2309.]) of the aligned chains ranges from 0.64 to 0.79, while the pairwise sequence identity between chains A, B and C is less than 35% (Supplementary Table S1).

[Figure 6]
Figure 6
(a) An ABC-type heterotrimeric protein; chains A, B and C are in black, blue and red, respectively. (b) Aligned chains. (c) Chain A in the red–white–blue color scale according to the B values from the PDB-REDO model and scaled with the minimum value equal to −1 standard deviation and the maximum value equal to +1 standard deviation. Chains B and C are shown as ribbons in gray. The dashed ellipse marks solvent-exposed side chains located in the middle of the helix. (d) The same as (c) with the model colored according to the predicted B values.

Analysis of the B values shows that the chains with the same orientation (chains A and B) have similar B values, while chain C, which has the opposite orientation, has values that are significantly higher (Fig. 7[link]a). The B values of chain A vary rather smoothly over neighboring atoms compared with those of chain B and especially those of chain C. The correlation coefficients between the predicted and PDB-REDO B values are 0.48, 0.46 and 0.52 for chains A, B and C, respectively (Supplementary Fig. S5). Thus, the accuracy of the predicted B values per each chain was modest (∼0.50), and was low (∼0.20) for all three chains considered together.

[Figure 7]
Figure 7
B values of an ABC-type heterotrimeric protein (PDB entry 7upo). (a) PDB-REDO and (b) predicted B values. B values were normalized so that the mean B value was set to 0 and the standard deviation of the B value was set to 1.

Another notable difference between the predicted and deposited B values is that the covalently bonded atoms of the PDB-REDO structure have very similar B values (Fig. 7[link]a), whereas the predicted B values vary considerably (Fig. 7[link]b), i.e. they are less smoothed. In general, for all three chains we can see that the PDB-REDO and predicted B values are higher at the chain termini and in the loop region. Individual high predicted B values correspond to side-chain atoms exposed to solvent (Fig. 6[link]d), as expected, while solvent-exposed side chains located in the middle of the helix of the PDB-REDO structure do not have high B values (Fig. 6[link]c). A brief examination of the crystal contacts revealed that the solvent-exposed side chains in the middle of the helix, indicated by a dashed ellipse in Figs. 6[link](c) and 6[link](d), are not involved in a large number of crystal contacts.

The main reason for the significant difference between global (asymmetric unit) and local (chain) accuracy is the magnitude of the B values. When the chains or domains have significantly different mean B values, it is more reasonable to perform normalization for each unit (chain or domain) separately and then calculate the correlation between the predicted and deposited B values to evaluate the efficiency of the GDV model. It is interesting to note that chains A, B and C of the examined heterotrimeric protein correspond to three translation–libration–screw (TLS) groups. Thus, as an alternative to manual selection, it is also possible to perform normalization according to the predefined (large) TLS groups (Schomaker & Trueblood, 1968[Schomaker, V. & Trueblood, K. N. (1968). Acta Cryst. B24, 63-76.]).

3.5.2. Two monomers in the asymmetric unit

The structure of the obligate enzyme–adenylate complex (PDB entry 4d05), determined at 1.65 Å resolution (Williamson et al., 2014[Williamson, A., Rothweiler, U. & Leiros, H.-K. S. (2014). Acta Cryst. D70, 3043-3056.]), was obtained in space group C2 with two monomers per asymmetric unit (Fig. 8[link]a). This protein has an adenylation domain (AD domain) and an oligonucleotide-binding domain (OB domain). Superposition of the two monomers using the larger AD domain for alignment shows that they have different conformations (Fig. 8[link]b). When the domains are aligned separately, the root-mean-square deviation (on Cα atoms) for each domain is below 1 Å. Thus, the short contacts (∼5 Å) remain very similar when comparing the two monomers. This suggests that the predicted B values should also be similar. Indeed, the correlation of the predicted B values between the monomers is 0.83 (Fig. 8[link]d). On the other hand, the correlation of the deposited B values between the monomers is only 0.37 (Fig. 8[link]c). Also, the magnitude of the B values in chain B is much higher compared with that in chain A. The correlation between the PDB-REDO and predicted B values was 0.65 for chain A, while the correlation for chain B was significantly lower at ∼0.40 (Supplementary Fig. S6). It should be noted that the authors (Williamson et al., 2014[Williamson, A., Rothweiler, U. & Leiros, H.-K. S. (2014). Acta Cryst. D70, 3043-3056.]) used chain A, defined as biological assembly 1, as a reference for further discussion because it has more complete density and a lower mean B value compared with chain B (biological assembly 2).

[Figure 8]
Figure 8
(a) Two monomers of the enzyme–adenylate complex in the asymmetric unit (PDB entry 4d05); chain A is in blue and chain B is in orange. (b) Superimposed monomers of the enzyme–adenylate complex. (c) PDB-REDO B values. (d) Predicted B values. B values were normalized so that the mean B value was set to 0 and the standard deviation of the B value was set to 1.

This and the previous example of a heterotrimeric protein demonstrate that if the B values in the protein model have a multimodal distribution and we want to evaluate the performance of the GDV model, the B values should be normalized with respect to the modes. The modes or clusters of B values in a given protein model are of course case-dependent and correspond, for example, to chains, domains or large TLS groups.

3.6. Application to electron microscopy structures

Finally, the contact and GDV models (equations 4[link] and 5[link]) were tested on several structures determined by cryo-EM at a resolution higher than 2.5 Å and containing fewer than 10 000 non-H atoms per independent component. Previously, Wlodawer et al. (2017[Wlodawer, A., Li, M. & Dauter, Z. (2017). Structure, 25, 1589-1597.]) pointed out that the B values in almost all deposited cryo-EM models were meaningless. All cryo-EM structures used in our study were deposited in the period from 2019 to 2022, and it appears that quality control has improved.

The correlation coefficient between the predicted and the deposited B values for the contact and GDV models is shown in Fig. 9[link]. In the case of the GDV model, the average correlation between the PDB and predicted B values was ∼0.64 for 26 cryo-EM structures, which is better on average by ∼0.15 than for the contact model. The largest difference was for PDB entry 7rzq, with correlations of 0.64 and 0.38, respectively. One can speculate that for this apparently difficult structure the GDV method is still capable of predicting some information about atomic mobility, even if far from being perfect, while the contact model essentially fails.

[Figure 9]
Figure 9
The correlation coefficient between the predicted and deposited B values for 26 cryo-EM structures. Correlations for the GDV model and the contact model are shown in red and blue, respectively.

4. Conclusions

This study presents an improved approach for predicting the distribution of B values over a protein structure. This approach uses the graphlet degree vector (GDV). The components of the GDV describe the complexity of the wiring for a given atom in a macromolecule considering not only its number of direct contacts but also information about the contacts of its neighbors. A multiple linear regression model was developed using GDV components as explanatory variables. The tests showed that this model outperforms the linear model (Weiss, 2007[Weiss, M. S. (2007). Acta Cryst. D63, 1235-1242.]) based only on direct atomic contacts. Since the GDV model is built on purely geometric considerations, the B values are not completely independent parameters, and its performance does not depend on the resolution of the experimental data.

A disagreement between the predicted and the experimentally obtained B values may be attributed both to imperfections in the method and the presence of static errors in the experimental values, since the deposited models also reflect variation of the structures over samples. In particular, this second component is responsible for the dependence of the B value on the resolution of the data. An obvious imperfection of the suggested model is the difficulty in obtaining the B values on an absolute scale and not on the normalized scale.

Despite the incompleteness and imperfection of such modeling, it is the dynamic aspect of protein structure that most interests structural biologists, and this improved method to predict it can help to both obtain an idea about atomic mobility and provide one with starting values for accurate B-value refinement. It should be mentioned that a certain degree of caution is required when using deposited or predicted crystallographic B values to analyze the dynamics of the protein structure, as the B values of the exterior residues may be biased by close crystal contacts. Nevertheless, the GDV model is an important complementary tool to structure-prediction software such as AlphaFold and RoseTTAFold (Jumper et al., 2021[Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., Bridgland, A., Meyer, C., Kohl, S. A. A., Ballard, A. J., Cowie, A., Romera-Paredes, B., Nikolov, S., Jain, R., Adler, J., Back, T., Petersen, S., Reiman, D., Clancy, E., Zielinski, M., Steinegger, M., Pacholska, M., Berghammer, T., Bodenstein, S., Silver, D., Vinyals, O., Senior, A. W., Kavukcuoglu, K., Kohli, P. & Hassabis, D. (2021). Nature, 596, 583-589.]; Baek et al., 2021[Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., Millán, C., Park, H., Adams, C., Glassman, C. R., DeGiovanni, A., Pereira, J. H., Rodrigues, A. V., van Dijk, A. A., Ebrecht, A. C., Opperman, D. J., Sagmeister, T., Buhlheller, C., Pavkov-Keller, T., Rathinaswamy, M. K., Dalwadi, U., Yip, C. K., Burke, J. E., Garcia, K. C., Grishin, N. V., Adams, P. D., Read, R. J. & Baker, D. (2021). Science, 373, 871-876.]).

Future research could focus on using the model to validate protein models deposited in the PDB and also on including non­protein atoms; for example, nucleic acids and ligands. The low correlation between predicted and deposited B values could be due to either a multimodal distribution of B values or a partially incorrect model. The former means that normalization per domain/chain or TLS group should be reconsidered. The latter means that the positions of some atoms or loops should be corrected. Therefore, future work will consider applying the GDV model to the entire PDB and identifying potentially incorrectly modeled regions in protein models. However, local errors in protein structure are not the only source of differences between deposited and predicted B values. The cause of the discrepancy between deposited and predicted B values can also be radiation damage, for example (Gerstel et al., 2015[Gerstel, M., Deane, C. M. & Garman, E. F. (2015). J. Synchrotron Rad. 22, 201-212.]; Shelley et al., 2018[Shelley, K. L., Dixon, T. P. E., Brooks-Bartlett, J. C. & Garman, E. F. (2018). J. Appl. Cryst. 51, 552-559.]).

In addition to validating and applying the model to large databases, the model can be improved by using advanced prediction methods or by combining the GDV model with other proven approaches. For example, the hierarchical disorder model introduced by Pearce & Gros (2021[Pearce, N. M. & Gros, P. (2021). Nat. Commun. 12, 5493.]), which uses a set of TLS parameters to represent structural disorder at different structural levels, can be combined with the GDV model to create a multivariate multiple linear model in which the response variables are partial B values at the chain, secondary-structure, residue and atom levels. An alternative way to further analyze the B values is to also cluster B values in search of typical vectors for main chains, side chains, inner or outer atoms.

Supporting information


Acknowledgements

D. Turk is acknowledged for critical review of the manuscript, helpful discussion and long-term support.

Funding information

This work was supported by Structural Biology grant P1-0048 and Infrastructure Programme grant I0-0035-2790 provided by the Slovenian Research Agency.

References

First citationAli, W., Rito, T., Reinert, G., Sun, F. & Deane, C. M. (2014). Bioinformatics, 30, i430–i437.  CrossRef CAS Google Scholar
First citationBaek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., Millán, C., Park, H., Adams, C., Glassman, C. R., DeGiovanni, A., Pereira, J. H., Rodrigues, A. V., van Dijk, A. A., Ebrecht, A. C., Opperman, D. J., Sagmeister, T., Buhlheller, C., Pavkov-Keller, T., Rathinaswamy, M. K., Dalwadi, U., Yip, C. K., Burke, J. E., Garcia, K. C., Grishin, N. V., Adams, P. D., Read, R. J. & Baker, D. (2021). Science, 373, 871–876.  Web of Science CrossRef CAS PubMed Google Scholar
First citationBerman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., Shindyalov, I. N. & Bourne, P. E. (2000). Nucleic Acids Res. 28, 235–242.  Web of Science CrossRef PubMed CAS Google Scholar
First citationBermeo, S., Favor, A., Chang, Y.-T., Norris, A., Boyken, S. E., Hsia, Y., Haddox, H. K., Xu, C., Brunette, T. J., Wysocki, V. H., Bhabha, G., Ekiert, D. C. & Baker, D. (2022). Nat. Struct. Mol. Biol. 29, 1266–1276.  CrossRef CAS Google Scholar
First citationBramer, D. & Wei, G.-W. W. (2018). J. Chem. Phys. 149, 134107.  CrossRef Google Scholar
First citationCarugo, O. (2018a). Amino Acids, 50, 775–786.  Web of Science CrossRef CAS PubMed Google Scholar
First citationCarugo, O. (2018b). BMC Bioinformatics, 19, 61.  Google Scholar
First citationCarugo, O. (2022). Acta Cryst. D78, 69–74.  CrossRef IUCr Journals Google Scholar
First citationCsardi, G. & Nepusz, T. (2006). InterJ. Complex Syst., 1695.  Google Scholar
First citationGerstel, M., Deane, C. M. & Garman, E. F. (2015). J. Synchrotron Rad. 22, 201–212.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationGohlke, H., Kuhn, L. A. & Case, D. A. (2004). Proteins, 56, 322–337.  Web of Science CrossRef PubMed CAS Google Scholar
First citationGrant, B. J., Rodrigues, A. P. C., ElSawy, K. M., McCammon, J. A. & Caves, L. S. D. (2006). Bioinformatics, 22, 2695–2696.  Web of Science CrossRef PubMed CAS Google Scholar
First citationHalle, B. (2002). Proc. Natl Acad. Sci. USA, 99, 1274–1279.  Web of Science CrossRef PubMed CAS Google Scholar
First citationHirshfeld, F. L. (1976). Acta Cryst. A32, 239–244.  CrossRef IUCr Journals Web of Science Google Scholar
First citationHočevar, T. & Demšar, J. (2014). Bioinformatics, 30, 559–565.  Google Scholar
First citationHočevar, T. & Demšar, J. (2016). J. Stat. Softw. 71(10), 1–24.  Google Scholar
First citationHumphrey, W., Dalke, A. & Schulten, K. (1996). J. Mol. Graph. 14, 33–38.  CrossRef CAS PubMed Web of Science Google Scholar
First citationJacobs, D. J., Rader, A. J., Kuhn, L. A. & Thorpe, M. F. (2001). Proteins, 44, 150–165.  Web of Science CrossRef PubMed CAS Google Scholar
First citationJoosten, R. P., Long, F., Murshudov, G. N. & Perrakis, A. (2014). IUCrJ, 1, 213–220.  Web of Science CrossRef CAS PubMed IUCr Journals Google Scholar
First citationJoosten, R. P., Salzemann, J., Bloch, V., Stockinger, H., Berglund, A.-C., Blanchet, C., Bongcam-Rudloff, E., Combet, C., Da Costa, A. L., Deleage, G., Diarena, M., Fabbretti, R., Fettahi, G., Flegel, V., Gisel, A., Kasam, V., Kervinen, T., Korpelainen, E., Mattila, K., Pagni, M., Reichstadt, M., Breton, V., Tickle, I. J. & Vriend, G. (2009). J. Appl. Cryst. 42, 376–384.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationJumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., Bridgland, A., Meyer, C., Kohl, S. A. A., Ballard, A. J., Cowie, A., Romera-Paredes, B., Nikolov, S., Jain, R., Adler, J., Back, T., Petersen, S., Reiman, D., Clancy, E., Zielinski, M., Steinegger, M., Pacholska, M., Berghammer, T., Bodenstein, S., Silver, D., Vinyals, O., Senior, A. W., Kavukcuoglu, K., Kohli, P. & Hassabis, D. (2021). Nature, 596, 583–589.  Web of Science CrossRef CAS PubMed Google Scholar
First citationKonnert, J. H. & Hendrickson, W. A. (1980). Acta Cryst. A36, 344–350.  CrossRef CAS IUCr Journals Web of Science Google Scholar
First citationKuhn, M. (2008). J. Stat. Softw. 28(5), 1–26.  Google Scholar
First citationKundu, S., Melton, J. S., Sorensen, D. C. & Phillips, G. N. (2002). Biophys. J. 83, 723–732.  CrossRef CAS Google Scholar
First citationMasmaliyeva, R. C., Babai, K. H. & Murshudov, G. N. (2020). Acta Cryst. D76, 926–937.  Web of Science CrossRef IUCr Journals Google Scholar
First citationMasmaliyeva, R. C. & Murshudov, G. N. (2019). Acta Cryst. D75, 505–518.  Web of Science CrossRef IUCr Journals Google Scholar
First citationMerritt, E. A. (2011). Acta Cryst. A67, 512–516.  Web of Science CrossRef IUCr Journals Google Scholar
First citationMerritt, E. A. (2012). Acta Cryst. D68, 468–477.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationPan, X.-Y. & Shen, H.-B. (2009). Protein Pept. Lett. 16, 1447–1454.  CrossRef CAS Google Scholar
First citationParthasarathy, S. & Murthy, M. R. N. (1997). Protein Sci. 6, 2561–2567.  CrossRef CAS PubMed Web of Science Google Scholar
First citationPearce, N. M. & Gros, P. (2021). Nat. Commun. 12, 5493.  Web of Science CrossRef PubMed Google Scholar
First citationPržulj, N. (2007). Bioinformatics, 23, e177–e183.  Google Scholar
First citationRadivojac, P., Obradovic, Z., Smith, D. K., Zhu, G., Vucetic, S., Brown, C. J., Lawson, J. D. & Dunker, A. K. (2004). Protein Sci. 13, 71–80.  Web of Science CrossRef PubMed CAS Google Scholar
First citationR Core Team (2022). The R Project for Statistical Computing. https://www.r-project.org/Google Scholar
First citationRodriguez, R., Chinea, G., Lopez, N., Pons, T. & Vriend, G. (1998). Bioinformatics, 14, 523–528.  Web of Science CrossRef CAS PubMed Google Scholar
First citationSchlessinger, A. & Rost, B. (2005). Proteins, 61, 115–126.  Web of Science CrossRef PubMed CAS Google Scholar
First citationSchlessinger, A., Yachdav, G. & Rost, B. (2006). Bioinformatics, 22, 891–893.  CrossRef CAS Google Scholar
First citationSchomaker, V. & Trueblood, K. N. (1968). Acta Cryst. B24, 63–76.  CrossRef CAS IUCr Journals Web of Science Google Scholar
First citationShelley, K. L., Dixon, T. P. E., Brooks-Bartlett, J. C. & Garman, E. F. (2018). J. Appl. Cryst. 51, 552–559.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationSun, Z., Liu, Q., Qu, G., Feng, Y. & Reetz, M. T. (2019). Chem. Rev. 119, 1626–1665.  Web of Science CrossRef CAS PubMed Google Scholar
First citationTronrud, D. E. (1996). J. Appl. Cryst. 29, 100–104.  CrossRef CAS Web of Science IUCr Journals Google Scholar
First citationTrueblood, K. N., Bürgi, H.-B., Burzlaff, H., Dunitz, J. D., Gramaccioli, C. M., Schulz, H. H., Shmueli, U. & Abrahams, S. C. (1996). Acta Cryst. A52, 770–781.  CrossRef CAS Web of Science IUCr Journals Google Scholar
First citationVenables, W. N. & Ripley, B. D. (2002). Modern Applied Statistics with S, 4th ed. New York: Springer.  Google Scholar
First citationVriend, G. (1990). J. Mol. Graph. 8, 52–56.  CrossRef CAS PubMed Web of Science Google Scholar
First citationWang, G. & Dunbrack, R. L. Jr (2003). Bioinformatics, 19, 1589–1591.  Web of Science CrossRef PubMed CAS Google Scholar
First citationWeiss, M. S. (2007). Acta Cryst. D63, 1235–1242.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationWilliamson, A., Rothweiler, U. & Leiros, H.-K. S. (2014). Acta Cryst. D70, 3043–3056.  CrossRef IUCr Journals Google Scholar
First citationWlodawer, A., Li, M. & Dauter, Z. (2017). Structure, 25, 1589–1597.  Web of Science CrossRef CAS PubMed Google Scholar
First citationYang, J., Wang, Y. & Zhang, Y. (2016). J. Mol. Biol. 428, 693–701.  Web of Science CrossRef CAS PubMed Google Scholar
First citationYin, H., Li, Y.-Z. & Li, M.-L. (2011). Protein Pept. Lett. 18, 450–456.  CrossRef CAS Google Scholar
First citationYuan, Z., Bailey, T. L. & Teasdale, R. D. (2005). Proteins, 58, 905–912.  Web of Science CrossRef PubMed CAS Google Scholar
First citationZhang, Y. & Skolnick, J. (2005). Nucleic Acids Res. 33, 2302–2309.  Web of Science CrossRef PubMed CAS Google Scholar

This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.

Journal logoSTRUCTURAL
BIOLOGY
ISSN: 2059-7983
Follow Acta Cryst. D
Sign up for e-alerts
Follow Acta Cryst. on Twitter
Follow us on facebook
Sign up for RSS feeds