On vital aid: the why, what and how of validation

Community recommendations on cryoEM data archiving and validation

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for the deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and the resulting consensus recommendations. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

Community recommendations on cryoEM data archiving and validation: Outcomes of a wwPDB/EMDB workshop on cryoEM data management, deposition and validation

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and consensus recommendations resulting from the workshop. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

Virtual Model Compound Approach for Calculating Redox Potentials of [Fe2S2]-Cys4 Centers in Proteins - Structure Quality Matters

The midpoint potential of the [Fe2S2]-Cys4-cluster in proteins is known to vary between -200 and -450 mV. This variation is caused by the different electrostatic environment of the cluster in the respective proteins. Continuum electrostatics can quantify the impact of the protein environment on the redox potential. Thus, if the redox potential of a [Fe2S2]-Cys4-cluster model compound in aqueous solution would be known, then redox potentials in various protein complexes could be calculated. However, [Fe2S2]-Cys4-cluster models are not water-soluble, and thus, their redox potential can not be measured in aqueous solution. To overcome this problem, we introduce a method that we call Virtual Model Compound Approach (VMCA) to extrapolate the model redox potential from known redox potentials of proteins. We carefully selected high-resolution structures for our analysis and divide them into a fit set, for fitting the model redox potential, and an independent test set, to check the validity of the model redox potential. However, from our analysis, we realized that the some structures can not be used as downloaded from the PDB but had to be re-refined in order to calculate reliable redox potentials. Because of the re-refinement, we were able to significantly reduce the standard deviation of our derived model redox potential for the [Fe2S2]-Cys4-cluster from 31 mV to 10 mV. As the model redox potential, we obtained -184 mV. This model redox potential can be used to analyze the redox behavior of [Fe2S2]-Cys4-clusters in larger protein complexes.

Learning Correlations between Internal Coordinates to Improve 3D Cartesian Coordinates for Proteins

We consider a generic representation problem of internal coordinates (bond lengths, valence angles, and dihedral angles) and their transformation to 3-dimensional Cartesian coordinates of a biomolecule. We show that the internal-to-Cartesian process relies on correctly predicting chemically subtle correlations among the internal coordinates themselves, and learning these correlations increases the fidelity of the Cartesian representation. We developed a machine learning algorithm, Int2Cart, to predict bond lengths and bond angles from backbone torsion angles and residue types of a protein, which allows reconstruction of protein structures better than using fixed bond lengths and bond angles or a static library method that relies on backbone torsion angles and residue types in a local environment. The method is able to be used for structure validation, as we show that the agreement between Int2Cart-predicted bond geometries and those from an AlphaFold 2 model can be used to estimate model quality. Additionally, by using Int2Cart to reconstruct an IDP ensemble, we are able to decrease the clash rate during modeling. The Int2Cart algorithm has been implemented as a publicly accessible python package at https://github.com/THGLab/int2cart.

The Good, the Bad, and the Twisted Revisited: An Analysis of Ligand Geometry in Highly Resolved Protein-Ligand X-ray Structures

An analysis of the rotatable bond geometry of drug-like ligand models is reported for high-resolution (<1.1 Å) crystallographic protein-ligand complexes. In cases where the ligand fit to the electron density is very good, unusual torsional geometry is rare and, most often, though not exclusively, associated with strong polar, metal, or covalent ligand-protein interactions. It is rarely associated with a torsional strain of greater than 2 kcal mol^-1 by calculation. An unusual torsional geometry is more prevalent where the fit to electron density is not perfect. Multiple low-strain conformer bindings were observed in 21% of the set and, it is suggested, may also lie behind many of the 35% of single-occupancy cases, where a poor fit to the e-density was found. It is concluded that multiple conformer ligand binding is an under-recognized phenomenon in structure-based drug design and that there is a need for more robust crystallographic refinement methods to better handle such cases.

Structural and dynamical description of the enzymatic reaction of a phosphohexomutase

Enzymes are known to adopt various conformations at different points along their catalytic cycles. Here, we present a comprehensive analysis of 15 isomorphous, high resolution crystal structures of the enzyme phosphoglucomutase from the bacterium Xanthomonas citri. The protein was captured in distinct states critical to function, including enzyme-substrate, enzyme-product, and enzyme-intermediate complexes. Key residues in ligand recognition and regions undergoing conformational change are identified and correlated with the various steps of the catalytic reaction. In addition, we use principal component analysis to examine various subsets of these structures with two goals: (1) identifying sites of conformational heterogeneity through a comparison of room temperature and cryogenic structures of the apo-enzyme and (2) a priori clustering of the enzyme-ligand complexes into functionally related groups, showing sensitivity of this method to structural features difficult to detect by traditional methods. This study captures, in a single system, the structural basis of diverse substrate recognition, the subtle impact of covalent modification, and the role of ligand-induced conformational change in this representative enzyme of the α-D-phosphohexomutase superfamily.

Nucleobase carbonyl groups are poor Mg2+ inner-sphere binders but excellent monovalent ion binders-a critical PDB survey

Precise knowledge of Mg²⁺ inner-sphere binding site properties is vital for understanding the structure and function of nucleic acid systems. Unfortunately, the PDB, which represents the main source of Mg²⁺ binding sites, contains a substantial number of assignment issues that blur our understanding of the functions of these ions. Here, following a previous study devoted to Mg²⁺ binding to nucleobase nitrogens, we surveyed nucleic acid X-ray structures from the PDB with resolutions ≤2.9 Å to classify the Mg²⁺ inner-sphere binding patterns to nucleotide carbonyl, ribose hydroxyl, cyclic ether, and phosphodiester oxygen atoms. From this classification, we derived a set of "prior-knowledge" nucleobase Mg²⁺ binding sites. We report that crystallographic examples of trustworthy nucleobase Mg²⁺ binding sites are fewer than expected since many of those are associated with misidentified Na⁺ or K⁺ We also emphasize that binding of Na⁺ and K⁺ to nucleic acids is much more frequent than anticipated. Overall, we provide evidence derived from X-ray structures that nucleobases are poor inner-sphere binders for Mg²⁺ but good binders for monovalent ions. Based on strict stereochemical criteria, we propose an extended set of guidelines designed to help in the assignment and validation of ions directly contacting nucleobase and ribose atoms. These guidelines should help in the interpretation of X-ray and cryo-EM solvent density maps. When borderline Mg²⁺ stereochemistry is observed, alternative placement of Na⁺, K⁺, or Ca²⁺ must be considered. We also critically examine the use of lanthanides (Yb³⁺, Tb³⁺) as Mg²⁺ substitutes in crystallography experiments.

13C Chemical Shifts in Proteins: A Rich Source of Encoded Structural Information

Despite the formidable progress in Nuclear Magnetic Resonance (NMR) spectroscopy, quality assessment of NMR-derived structures remains as an important problem. Thus, validation of protein structures is essential for the spectroscopists, since it could enable them to detect structural flaws and potentially guide their efforts in further refinement. Moreover, availability of accurate and efficient validation tools would help molecular biologists and computational chemists to evaluate quality of available experimental structures and to select a protein model which is the most suitable for a given scientific problem. The ¹³C^α nuclei are ubiquitous in proteins, moreover, their shieldings are easily obtainable from NMR experiments and represent a rich source of encoded structural information that makes ¹³C^α chemical shifts an attractive candidate for use in computational methods aimed at determination and validation of protein structures. In this chapter, the basis of a novel methodology of computing, at the quantum chemical level of theory, the ¹³C^α shielding for the amino acid residues in proteins is described. We also identify and examine the main factors affecting the ¹³C^α-shielding computation. Finally, we illustrate how the information encoded in the ¹³C chemical shifts can be used for a number of applications, viz., from protein structure prediction of both α-helical and β-sheet conformations, to determination of the fraction of the tautomeric forms of the imidazole ring of histidine in proteins as a function of pH or to accurate detection of structural flaws, at a residue-level, in NMR-determined protein models.

Structural biology data archiving - where we are and what lies ahead

For almost 50 years, structural biology has endeavoured to conserve and share its experimental data and their interpretations (usually, atomistic models) through global public archives such as the Protein Data Bank, Electron Microscopy Data Bank and Biological Magnetic Resonance Data Bank (BMRB). These archives are treasure troves of freely accessible data that document our quest for molecular or atomic understanding of biological function and processes in health and disease. They have prepared the field to tackle new archiving challenges as more and more (combinations of) techniques are being utilized to elucidate structure at ever increasing length scales. Furthermore, the field has made substantial efforts to develop validation methods that help users to assess the reliability of structures and to identify the most appropriate data for their needs. In this Review, we present an overview of public data archives in structural biology and discuss the importance of validation for users and producers of structural data. Finally, we sketch our efforts to integrate structural data with bioimaging data and with other sources of biological data. This will make relevant structural information available and more easily discoverable for a wide range of scientists.

Conformation Generation: The State of the Art

The generation of conformations for small molecules is a problem of continuing interest in cheminformatics and computational drug discovery. This review will present an overview of methods used to sample conformational space, focusing on those methods designed for organic molecules commonly of interest in drug discovery. Different approaches to both the sampling of conformational space and the scoring of conformational stability will be compared and contrasted, with an emphasis on those methods suitable for conformer sampling of large numbers of drug-like molecules. Particular attention will be devoted to the appropriate utilization of information from experimental solid-state structures in validating and evaluating the performance of these tools. The review will conclude with some areas worthy of further investigation.

Anions in Nucleic Acid Crystallography

Nucleic acid crystallization buffers contain a large variety of chemicals fitting specific needs. Among them, anions are often solely considered for pH-regulating purposes and as cationic co-salts while their ability to directly bind to nucleic acid structures is rarely taken into account. Here we review current knowledge related to the use of anions in crystallization buffers along with data on their biological prevalence. Chloride ions are frequently identified in crystal structures but display low cytosolic concentrations. Hence, they are thought to be distant from nucleic acid structures in the cell. Sulfate ions are also frequently identified in crystal structures but their localization in the cell remains elusive. Nevertheless, the characterization of the binding properties of these ions is essential for better interpreting the solvent structure in crystals and consequently, avoiding mislabeling of electron densities. Furthermore, understanding the binding properties of these anions should help to get clues related to their potential effects in crowded cellular environments.

Bond distances in polypeptide backbones depend on the local conformation

By combining quantum-mechanical analysis of small model peptides and statistical surveys of high-resolution protein structures, a systematic conformational dependence of bond lengths in polypeptide backbones has been unveiled which involves both the peptide bond (C—O and C—N) and those bonds centred on the Cα atom. All of these bond lengths indeed display a systematic variability in the ψ angle according to both calculations and surveys of protein structures. The overall agreement between the computed and the statistical data suggests that these trends are essentially driven by local effects. The dependence of Cα distances on ψ is governed by interactions between the σ system of the Cα moiety and the C—O π system of the peptide bond. Maximum and minimum values for each bond distance are found for conformations with the specific bond perpendicular and parallel to the adjacent CONH peptide plane, respectively. On the other hand, the variability of the C—O and C—N distances is related to the strength of the interactions between the lone pair of the N atom and the C—O π* system, which is modulated by the ψ angle. The C—O and C—N distances are related but their trends are not strictly connected to peptide-bond planarity, although a correlation amongst all of these parameters is expected on the basis of the classical resonance model.

Crystallization of lysozyme with (R)-, (S)- and (RS)-2-methyl-2,4-pentanediol

Chiral control of crystallization has ample precedent in the small-molecule world, but relatively little is known about the role of chirality in protein crystallization. In this study, lysozyme was crystallized in the presence of the chiral additive 2-methyl-2,4-pentanediol (MPD) separately using the R and S enantiomers as well as with a racemic RS mixture. Crystals grown with (R)-MPD had the most order and produced the highest resolution protein structures. This result is consistent with the observation that in the crystals grown with (R)-MPD and (RS)-MPD the crystal contacts are made by (R)-MPD, demonstrating that there is preferential interaction between lysozyme and this enantiomer. These findings suggest that chiral interactions are important in protein crystallization.

ValidatorDB: database of up-to-date validation results for ligands and non-standard residues from the Protein Data Bank

Following the discovery of serious errors in the structure of biomacromolecules, structure validation has become a key topic of research, especially for ligands and non-standard residues. ValidatorDB (freely available at http://ncbr.muni.cz/ValidatorDB) offers a new step in this direction, in the form of a database of validation results for all ligands and non-standard residues from the Protein Data Bank (all molecules with seven or more heavy atoms). Model molecules from the wwPDB Chemical Component Dictionary are used as reference during validation. ValidatorDB covers the main aspects of validation of annotation, and additionally introduces several useful validation analyses. The most significant is the classification of chirality errors, allowing the user to distinguish between serious issues and minor inconsistencies. Other such analyses are able to report, for example, completely erroneous ligands, alternate conformations or complete identity with the model molecules. All results are systematically classified into categories, and statistical evaluations are performed. In addition to detailed validation reports for each molecule, ValidatorDB provides summaries of the validation results for the entire PDB, for sets of molecules sharing the same annotation (three-letter code) or the same PDB entry, and for user-defined selections of annotations or PDB entries.

NMR structure validation in relation to dynamics and structure determination

NMR spectroscopy is a key technique for understanding the behaviour of proteins, especially highly dynamic proteins that adopt multiple conformations in solution. Overall, protein structures determined from NMR spectroscopy data constitute just over 10% of the Protein Data Bank archive. This review covers the validation of these NMR protein structures, but rather than describing currently available methodology, it focuses on concepts that are important for understanding where and how validation is most relevant. First, the inherent characteristics of the protein under study have an influence on quality and quantity of the distinct types of data that can be acquired from NMR experiments. Second, these NMR data are necessarily transformed into a model for use in a structure calculation protocol, and the protein structures that result from this reflect the types of NMR data used as well as the protein characteristics. The validation of NMR protein structures should therefore take account, wherever possible, of the inherent behavioural characteristics of the protein, the types of available NMR data, and the calculation protocol. These concepts are discussed in the context of 'knowledge based' and 'model versus data' validation, with suggestions for questions to ask and different validation categories to consider. The principal aim of this review is to stimulate discussion and to help the reader understand the relationships between the above elements in order to make informed decisions on which validation approaches are the most relevant in particular cases.

MotiveValidator: interactive web-based validation of ligand and residue structure in biomolecular complexes

Structure validation has become a major issue in the structural biology community, and an essential step is checking the ligand structure. This paper introduces MotiveValidator, a web-based application for the validation of ligands and residues in PDB or PDBx/mmCIF format files provided by the user. Specifically, MotiveValidator is able to evaluate in a straightforward manner whether the ligand or residue being studied has a correct annotation (3-letter code), i.e. if it has the same topology and stereochemistry as the model ligand or residue with this annotation. If not, MotiveValidator explicitly describes the differences. MotiveValidator offers a user-friendly, interactive and platform-independent environment for validating structures obtained by any type of experiment. The results of the validation are presented in both tabular and graphical form, facilitating their interpretation. MotiveValidator can process thousands of ligands or residues in a single validation run that takes no more than a few minutes. MotiveValidator can be used for testing single structures, or the analysis of large sets of ligands or fragments prepared for binding site analysis, docking or virtual screening. MotiveValidator is freely available via the Internet at http://ncbr.muni.cz/MotiveValidator.

Determination of antibody structures

While antibodies share a conserved structural framework, their complementarity-determining region loops are highly variable in size and sequence. Even more variable are the potential ways these loops can be used to interact with antigen. Thus, X-ray crystal structures of antibody Fab fragments and Fab-antigen complexes are critical for a detailed understanding of the antibody-antigen recognition process. This chapter describes the basic procedures necessary for the crystallization and structure determination of antibody Fab fragments by X-ray crystallography.

Factors correlating with significant differences between X-ray structures of myoglobin

Validation of general ideas about the origins of conformational differences in proteins is critical in order to arrive at meaningful functional insights. Here, principal component analysis (PCA) and distance difference matrices are used to validate some such ideas about the conformational differences between 291 myoglobin structures from sperm whale, horse and pig. Almost all of the horse and pig structures form compact PCA clusters with only minor coordinate differences and outliers that are easily explained. The 222 whale structures form a few dense clusters with multiple outliers. A few whale outliers with a prominent distortion of the GH loop are very similar to the cluster of horse structures, which all have a similar GH-loop distortion apparently owing to intermolecular crystal lattice hydrogen bonds to the GH loop from residues near the distal histidine His64. The variations of the GH-loop coordinates in the whale structures are likely to be owing to the observed alternative intermolecular crystal lattice bond, with the change to the GH loop distorting bonds correlated with the binding of specific `unusual' ligands. Such an alternative intermolecular bond is not observed in horse myoglobins, obliterating any correlation with the ligands. Intermolecular bonds do not usually cause significant coordinate differences and cannot be validated as their universal cause. Most of the native-like whale myoglobin structure outliers can be correlated with a few specific factors. However, these factors do not always lead to coordinate differences beyond the previously determined uncertainty thresholds. The binding of unusual ligands by myoglobin, leading to crystal-induced distortions, suggests that some of the conformational differences between the apo and holo structures might not be `functionally important' but rather artifacts caused by the binding of `unusual' substrate analogs. The causes of P6 symmetry in myoglobin crystals and the relationship between crystal and solution structures are also discussed.

Report of the wwPDB Small-Angle Scattering Task Force: data requirements for biomolecular modeling and the PDB

This report presents the conclusions of the July 12-13, 2012 meeting of the Small-Angle Scattering Task Force of the worldwide Protein Data Bank (wwPDB; Berman et al., 2003) at Rutgers University in New Brunswick, New Jersey. The task force includes experts in small-angle scattering (SAS), crystallography, data archiving, and molecular modeling who met to consider questions regarding the contributions of SAS to modern structural biology. Recognizing there is a rapidly growing community of structural biology researchers acquiring and interpreting SAS data in terms of increasingly sophisticated molecular models, the task force recommends that (1) a global repository is needed that holds standard format X-ray and neutron SAS data that is searchable and freely accessible for download; (2) a standard dictionary is required for definitions of terms for data collection and for managing the SAS data repository; (3) options should be provided for including in the repository SAS-derived shape and atomistic models based on rigid-body refinement against SAS data along with specific information regarding the uniqueness and uncertainty of the model, and the protocol used to obtain it; (4) criteria need to be agreed upon for assessment of the quality of deposited SAS data and the accuracy of SAS-derived models, and the extent to which a given model fits the SAS data; (5) with the increasing diversity of structural biology data and models being generated, archiving options for models derived from diverse data will be required; and (6) thought leaders from the various structural biology disciplines should jointly define what to archive in the PDB and what complementary archives might be needed, taking into account both scientific needs and funding.

Physics-based method to validate and repair flaws in protein structures

A method that makes use of information provided by the combination of (13)C(α) and (13)C(β) chemical shifts, computed at the density functional level of theory, enables one to (i) validate, at the residue level, conformations of proteins and detect backbone or side-chain flaws by taking into account an ensemble average of chemical shifts over all of the conformations used to represent a protein, with a sensitivity of ∼90%; and (ii) provide a set of (χ1/χ2) torsional angles that leads to optimal agreement between the observed and computed (13)C(α) and (13)C(β) chemical shifts. The method has been incorporated into the CheShift-2 protein validation Web server. To test the reliability of the provided set of (χ1/χ2) torsional angles, the side chains of all reported conformations of five NMR-determined protein models were refined by a simple routine, without using NOE-based distance restraints. The refinement of each of these five proteins leads to optimal agreement between the observed and computed (13)C(α) and (13)C(β) chemical shifts for ∼94% of the flaws, on average, without introducing a significantly large number of violations of the NOE-based distance restraints for a distance range ≤ 0.5 , in which the largest number of distance violations occurs. The results of this work suggest that use of the provided set of (χ1/χ2) torsional angles together with other observables, such as NOEs, should lead to a fast and accurate refinement of the side-chain conformations of protein models.

Outcome of the first electron microscopy validation task force meeting

This Meeting Review describes the proceedings and conclusions from the inaugural meeting of the Electron Microscopy Validation Task Force organized by the Unified Data Resource for 3DEM (http://www.emdatabank.org) and held at Rutgers University in New Brunswick, NJ on September 28 and 29, 2010. At the workshop, a group of scientists involved in collecting electron microscopy data, using the data to determine three-dimensional electron microscopy (3DEM) density maps, and building molecular models into the maps explored how to assess maps, models, and other data that are deposited into the Electron Microscopy Data Bank and Protein Data Bank public data archives. The specific recommendations resulting from the workshop aim to increase the impact of 3DEM in biology and medicine.

Implementing an X-ray validation pipeline for the Protein Data Bank

There is an increasing realisation that the quality of the biomacromolecular structures deposited in the Protein Data Bank (PDB) archive needs to be assessed critically using established and powerful validation methods. The Worldwide Protein Data Bank (wwPDB) organization has convened several Validation Task Forces (VTFs) to advise on the methods and standards that should be used to validate all of the entries already in the PDB as well as all structures that will be deposited in the future. The recommendations of the X-ray VTF are currently being implemented in a software pipeline. Here, ongoing work on this pipeline is briefly described as well as ways in which validation-related information could be presented to users of structural data.

To B or not to B: a question of resolution?

A simple rule of thumb based on resolution is not adequate to identify the best treatment of atomic displacements in macromolecular structural models. The choice to use isotropic B factors, anisotropic B factors, TLS models or some combination of the three should be validated through statistical analysis of the model refinement.

In choosing and refining any crystallographic structural model, there is tension between the desire to extract the most detailed information possible and the necessity to describe no more than what is justified by the observed data. A more complex model is not necessarily a better model. Thus, it is important to validate the choice of parameters as well as validating their refined values. One recurring task is to choose the best model for describing the displacement of each atom about its mean position. At atomic resolution one has the option of devoting six model parameters (a ‘thermal ellipsoid’) to describe the displacement of each atom. At medium resolution one typically devotes at most one model parameter per atom to describe the same thing (a ‘B factor’). At very low resolution one cannot justify the use of even one parameter per atom. Furthermore, this aspect of the structure may be described better by an explicit model of bulk displacements, the most common of which is the translation/libration/screw (TLS) formalism, rather than by assigning some number of para­meters to each atom individually. One can sidestep this choice between atomic displacement parameters and TLS descriptions by including both treatments in the same model, but this is not always statistically justifiable. The choice of which treatment is best for a particular structure refinement at a particular resolution can be guided by general considerations of the ratio of model parameters to the number of observations and by specific statistics such as the Hamilton R-­factor ratio test.

The good, the bad and the twisted: a survey of ligand geometry in protein crystal structures

The protein databank now contains the structures of over 11,000 ligands bound to proteins. These structures are invaluable in applied areas such as structure-based drug design, but are also the substrate for understanding the energetics of intermolecular interactions with proteins. Despite their obvious importance, the careful analysis of ligands bound to protein structures lags behind the analysis of the protein structures themselves. We present an analysis of the geometry of ligands bound to proteins and highlight the role of small molecule crystal structures in enabling molecular modellers to critically evaluate a ligand model's quality and investigate protein-induced strain.

X-ray crystallography: Assessment and validation of protein-small molecule complexes for drug discovery

INTRODUCTION: Crystallography is the key initial component for structure-based and fragment-based drug design and can often generate leads that can be developed into high potency drugs. Therefore, huge sums of money are committed based on the outcome of crystallography experiments and their interpretation. AREAS COVERED: This review discusses how to evaluate the correctness of an X-ray structure, focusing on the validation of small molecule-protein complexes. Various types of inaccuracies found within the PDB are identified and the ramifications of these errors are discussed. The reader will gain an understanding of the key parameters that need to be inspected before a structure can be used in drug discovery efforts, as well as an appreciation of the difficulties of correctly interpreting electron density for small molecules. The reader will also be introduced to methods for validating small molecules within the context of a macromolecular structure. EXPERT OPINION: One of the reasons that ligand identification and positioning, within a macromolecular crystal structure, is so difficult is that the quality of small molecules widely varies in the PDB. For this reason, the PDB can not always be considered a reliable repository of structural information pertaining to small molecules, and this makes the derivation of general principles that govern small molecule-protein interactions more difficult.

The Protein Data Bank in Europe (PDBe): bringing structure to biology

The Protein Data Bank in Europe (PDBe) is the European partner in the Worldwide PDB and as such handles depositions of X-ray, NMR and EM data and structure models. PDBe also provides advanced bioinformatics services based on data from the PDB and related resources. Some of the challenges facing the PDB and its guardians are discussed, as well as some of the areas on which PDBe activities will focus in the future (advanced services, ligands, integration, validation and experimental data). Finally, some recent developments at PDBe are described.

A quality metric for homology modeling: the H-factor

BACKGROUND

The analysis of protein structures provides fundamental insight into most biochemical functions and consequently into the cause and possible treatment of diseases. As the structures of most known proteins cannot be solved experimentally for technical or sometimes simply for time constraints, in silico protein structure prediction is expected to step in and generate a more complete picture of the protein structure universe. Molecular modeling of protein structures is a fast growing field and tremendous works have been done since the publication of the very first model. The growth of modeling techniques and more specifically of those that rely on the existing experimental knowledge of protein structures is intimately linked to the developments of high resolution, experimental techniques such as NMR, X-ray crystallography and electron microscopy. This strong connection between experimental and in silico methods is however not devoid of criticisms and concerns among modelers as well as among experimentalists.

RESULTS

In this paper, we focus on homology-modeling and more specifically, we review how it is perceived by the structural biology community and what can be done to impress on the experimentalists that it can be a valuable resource to them. We review the common practices and provide a set of guidelines for building better models. For that purpose, we introduce the H-factor, a new indicator for assessing the quality of homology models, mimicking the R-factor in X-ray crystallography. The methods for computing the H-factor is fully described and validated on a series of test cases.

CONCLUSIONS

We have developed a web service for computing the H-factor for models of a protein structure. This service is freely accessible at http://koehllab.genomecenter.ucdavis.edu/toolkit/h-factor.

Validation of crystallographic models containing TLS or other descriptions of anisotropy

The use of TLS (translation/libration/screw) models to describe anisotropic displacement of atoms within a protein crystal structure has become increasingly common. These models may be used purely as an improved methodology for crystallographic refinement or as the basis for analyzing inter-domain and other large-scale motions implied by the crystal structure. In either case it is desirable to validate that the crystallographic model, including the TLS description of anisotropy, conforms to our best understanding of protein structures and their modes of flexibility. A set of validation tests has been implemented that can be integrated into ongoing crystallographic refinement or run afterwards to evaluate a previously refined structure. In either case validation can serve to increase confidence that the model is correct, to highlight aspects of the model that may be improved or to strengthen the evidence supporting specific modes of flexibility inferred from the refined TLS model. Automated validation checks have been added to the PARVATI and TLSMD web servers and incorporated into the CCP4i user interface.

Detection of unrealistic molecular environments in protein structures based on expected electron densities

Understanding the relationship between protein structure and biological function is a central theme in structural biology. Advances are severely hampered by errors in experimentally determined protein structures. Detection and correction of such errors is therefore of utmost importance. Electron densities in molecular structures obey certain rules which depend on the molecular environment. Here we present and discuss a new approach that relates electron densities computed from a structural model to densities expected from prior observations on identical or closely related molecular environments. Strong deviations of computed from expected densities reveal unrealistic molecular structures. Most importantly, structure analysis and error detection are independent of experimental data and hence may be applied to any structural model. The comparison to state-of-the-art methods reveals that our approach is able to identify errors that formerly remained undetected. The new technique, called RefDens, is accessible as a public web service at http://refdens.services.came.sbg.ac.at.

Quality assessment of protein model-structures using evolutionary conservation

Motivation: Programs that evaluate the quality of a protein structural model are important both for validating the structure determination procedure and for guiding the model-building process. Such programs are based on properties of native structures that are generally not expected for faulty models. One such property, which is rarely used for automatic structure quality assessment, is the tendency for conserved residues to be located at the structural core and for variable residues to be located at the surface.

Results: We present ConQuass, a novel quality assessment program based on the consistency between the model structure and the protein's conservation pattern. We show that it can identify problematic structural models, and that the scores it assigns to the server models in CASP8 correlate with the similarity of the models to the native structure. We also show that when the conservation information is reliable, the method's performance is comparable and complementary to that of the other single-structure quality assessment methods that participated in CASP8 and that do not use additional structural information from homologs.

Availability: A perl implementation of the method, as well as the various perl and R scripts used for the analysis are available at http://bental.tau.ac.il/ConQuass/.

Contact:nirb@tauex.tau.ac.il

Supplementary information:Supplementary data are available at Bioinformatics online.

Protein flexibility: coordinate uncertainties and interpretation of structural differences

Valid interpretations of conformational movements in protein structures determined by X-ray crystallography require that the movement magnitudes exceed their uncertainty threshold. Here, it is shown that such thresholds can be obtained from the distance difference matrices (DDMs) of 1014 pairs of independently determined structures of bovine ribonuclease A and sperm whale myoglobin, with no explanations provided for reportedly minor coordinate differences. The smallest magnitudes of reportedly functional motions are just above these thresholds. Uncertainty thresholds can provide objective criteria that distinguish between true conformational changes and apparent 'noise', showing that some previous interpretations of protein coordinate changes attributed to external conditions or mutations may be doubtful or erroneous. The use of uncertainty thresholds, DDMs, the newly introduced CDDMs (contact distance difference matrices) and a novel simple rotation algorithm allows a more meaningful classification and description of protein motions, distinguishing between various rigid-fragment motions and nonrigid conformational deformations. It is also shown that half of 75 pairs of identical molecules, each from the same asymmetric crystallographic cell, exhibit coordinate differences that range from just outside the coordinate uncertainty threshold to the full magnitude of large functional movements. Thus, crystallization might often induce protein conformational changes that are comparable to those related to or induced by the protein function.

Assessing the accuracy of protein structures by quantum mechanical computations of 13C(alpha) chemical shifts

Two major techniques have been used to determine the three-dimensional structures of proteins: X-ray diffraction and NMR spectroscopy. In particular, the validation of NMR-derived protein structures is one of the most challenging problems in NMR spectroscopy. Therefore, researchers have proposed a plethora of methods to determine the accuracy and reliability of protein structures. Despite these proposals, there is a growing need for more sophisticated, physics-based structure validation methods. This approach will enable us to (a) characterize the "quality" of the NMR-derived ensemble as a whole by a single parameter, (b) unambiguously identify flaws in the sequence at a residue level, and (c) provide precise information, such as sets of backbone and side-chain torsional angles, that we can use to detect local flaws. Rather than reviewing all of the existing validation methods, this Account describes the contributions of our research group toward a solution of the long-standing problem of both global and local structure validation of NMR-derived protein structures. We emphasize a recently introduced physics-based methodology that makes use of observed and computed (13)C(alpha) chemical shifts (at the density functional theory (DFT) level of theory) for an accurate validation of protein structures in solution and in crystals. By assessing the ability of computed (13)C(alpha) chemical shifts to reproduce observed (13)C(alpha) chemical shifts of a single structure or ensemble of structures in solution and in crystals, we accomplish a global validation by using the conformationally averaged root-mean-square deviation, ca-rmsd, as a scoring function. In addition, the method enables us to provide local validation by identifying a set of individual amino acid conformations for which the computed and observed (13)C(alpha) chemical shifts do not agree within a certain error range and may represent a nonreliable fold of the protein model. Although it is computationally intensive, our validation method has several advantages, which we illustrate through a series of applications. This method makes use of the (13)C(alpha) chemical shifts, not shielding, that are ubiquitous to proteins and can be computed precisely from the phi, psi, and chi torsional angles. There is no need for a priori knowledge of the oligomeric state of the protein, and no knowledge-based information or additional NMR data are required. The primary limitation at this point is the computational cost of such calculations. However, we anticipate that enhancements in the speed of calculating these chemical shifts coupled with the ever-increasing computational power should soon make this a standard method accessible to the general NMR community.

Case-controlled structure validation

Although many factors influence the quality of a macromolecular crystal structure, validation criteria are usually only calibrated using one of these factors, the resolution. For many purposes this is sufficient, but there are times when one wishes to compare one set of structures with another and the comparison may be invalidated by systematic differences between the sets in factors other than resolution. This problem can be circumvented by borrowing from medicine the idea of the case-matched control: each structure of interest is matched with a control structure that has similar values for all relevant factors considered in this study. In addition to resolution, these include the size of the structure (as measured by the volume of the asymmetric unit) and the year of deposition. This approach has been applied to address two questions: whether structures from structural genomics efforts reach the same level of quality as structures from traditional sources and whether the impact factor of the journal in which a structure is published correlates with structure quality. In both cases, once factors influencing quality have been controlled in the comparison, there is little evidence for a systematic difference in quality.