Advances in Xmipp for Cryo-Electron Microscopy: From Xmipp to Scipion

Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysis

In single-particle cryo-electron microscopy (cryo-EM), efficient determination of orientation parameters for particle images poses a significant challenge yet is crucial for reconstructing 3D structures. This task is complicated by the high noise levels in the datasets, which often include outliers, necessitating several time-consuming 2D clean-up processes. Recently, solutions based on deep learning have emerged, offering a more streamlined approach to the traditionally laborious task of orientation estimation. These solutions employ amortized inference, eliminating the need to estimate parameters individually for each image. However, these methods frequently overlook the presence of outliers and may not adequately concentrate on the components used within the network. This paper introduces a novel method using a 10-dimensional feature vector for orientation representation, extracting orientations as unit quaternions with an accompanying uncertainty metric. Furthermore, we propose a unique loss function that considers the pairwise distances between orientations, thereby enhancing the accuracy of our method. Finally, we also comprehensively evaluate the design choices in constructing the encoder network, a topic that has not received sufficient attention in the literature. Our numerical analysis demonstrates that our methodology effectively recovers orientations from 2D cryo-EM images in an end-to-end manner. Notably, the inclusion of uncertainty quantification allows for direct clean-up of the dataset at the 3D level. Lastly, we package our proposed methods into a user-friendly software suite named cryo-forum, designed for easy access by developers.

A deep learning approach to the automatic detection of alignment errors in cryo-electron tomographic reconstructions

Electron tomography is an imaging technique that allows for the elucidation of three-dimensional structural information of biological specimens in a very general context, including cellular in situ observations. The approach starts by collecting a set of images at different projection directions by tilting the specimen stage inside the microscope. Therefore, a crucial preliminary step is to precisely define the acquisition geometry by aligning all the tilt images to a common reference. Errors introduced in this step will lead to the appearance of artifacts in the tomographic reconstruction, rendering them unsuitable for the sample study. Focusing on fiducial-based acquisition strategies, this work proposes a deep-learning algorithm to detect misalignment artifacts in tomographic reconstructions by analyzing the characteristics of these fiducial markers in the tomogram. In addition, we propose an algorithm designed to detect fiducial markers in the tomogram with which to feed the classification algorithm in case the alignment algorithm does not provide the location of the markers. This open-source software is available as part of the Xmipp software package inside of the Scipion framework, and also through the command-line in the standalone version of Xmipp.

Local defocus estimation in single particle analysis in cryo-electron microscopy

Single Particle analysis (SPA) aims to determine the three-dimensional structure of proteins and macromolecular complexes. The current state of the art has allowed us to achieve near-atomic and even atomic resolutions. To obtain high-resolution structures, a set of well-defined image processing steps is required. A critical one is the estimation of the Contrast Transfer Function (CTF), which considers the sample defocus and aberrations of the microscope. Defocus is usually globally estimated; in this case, it is the same for all the particles in each micrograph. But proteins are ice-embedded at different heights, suggesting that defocus should be measured in a local (per particle) manner. There are four state-of-the-art programs to estimate local defocus (Gctf, Relion, CryoSPARC, and Xmipp). In this work, we have compared the results of these software packages to check whether the resolution improves. We have used the Scipion framework and developed a specific program to analyze local defocus. The results produced by different programs do not show a clear consensus using the current test datasets in this study.

A new algorithm for particle weighted subtraction to decrease signals from unwanted components in single particle analysis

Single particle analysis (SPA) in cryo-electron microscopy (cryo-EM) is highly used to obtain the near-atomic structure of biological macromolecules. The current methods allow users to produce high-resolution maps from many samples. However, there are still challenging cases that require extra processing to obtain high resolution. This is the case when the macromolecule of the sample is composed of different components and we want to focus just on one of them. For example, if the macromolecule is composed of several flexible subunits and we are interested in a specific one, if it is embedded in a viral capsid environment, or if it has additional components to stabilize it, such as nanodiscs. The signal from these components, which in principle we are not interested in, can be removed from the particles using a projection subtraction method. Currently, there are two projection subtraction methods used in practice and both have some limitations. In fact, after evaluating their results, we consider that the problem is still open to new solutions, as they do not fully remove the signal of the components that are not of interest. Our aim is to develop a new and more precise projection subtraction method, improving the performance of state-of-the-art methods. We tested our algorithm with data from public databases and an in-house data set. In this work, we show that the performance of our algorithm improves the results obtained by others, including the localization of small ligands, such as drugs, whose binding location is unknown a priori.

Computational methods for in situ structural studies with cryogenic electron tomography

Cryo-electron tomography (cryo-ET) plays a critical role in imaging microorganisms in situ in terms of further analyzing the working mechanisms of viruses and drug exploitation, among others. A data processing workflow for cryo-ET has been developed to reconstruct three-dimensional density maps and further build atomic models from a tilt series of two-dimensional projections. Low signal-to-noise ratio (SNR) and missing wedge are two major factors that make the reconstruction procedure challenging. Because only few near-atomic resolution structures have been reconstructed in cryo-ET, there is still much room to design new approaches to improve universal reconstruction resolutions. This review summarizes classical mathematical models and deep learning methods among general reconstruction steps. Moreover, we also discuss current limitations and prospects. This review can provide software and methods for each step of the entire procedure from tilt series by cryo-ET to 3D atomic structures. In addition, it can also help more experts in various fields comprehend a recent research trend in cryo-ET. Furthermore, we hope that more researchers can collaborate in developing computational methods and mathematical models for high-resolution three-dimensional structures from cryo-ET datasets.

Sorzano CO. Performance and Quality Comparison of Movie Alignment Software for Cryogenic Electron Microscopy

Cryogenic electron microscopy (Cryo-EM) has been established as one of the key players in structural biology. It can reconstruct a 3D model of a sample at a near-atomic resolution. With the increasing number of facilities, faster microscopes, and new imaging techniques, there is a growing demand for algorithms and programs able to process the so-called movie data produced by the microscopes in real time while preserving a high resolution and maximal information. In this article, we conduct a comparative analysis of the quality and performance of the most commonly used software for movie alignment. More precisely, we compare the most recent versions of FlexAlign (Xmipp v3.23.03), MotionCor2 (v1.6.4), Relion MotionCor (v4.0-beta), Warp (v1.0.9), and CryoSPARC (v4.0.3). We tested the quality of the alignment using generated phantom data, as well as real datasets, comparing the alignment precision, power spectra density, and performance scaling of each program.

Structural mobility tunes signalling of the GluA1 AMPA glutamate receptor

AMPA glutamate receptors (AMPARs), the primary mediators of excitatory neurotransmission in the brain, are either GluA2 subunit-containing and thus Ca2+-impermeable, or GluA2-lacking and Ca2+-permeable1. Despite their prominent expression throughout interneurons and glia, their role in long-term potentiation and their involvement in a range of neuropathologies2, structural information for GluA2-lacking receptors is currently absent. Here we determine and characterize cryo-electron microscopy structures of the GluA1 homotetramer, fully occupied with TARPγ3 auxiliary subunits (GluA1/γ3). The gating core of both resting and open-state GluA1/γ3 closely resembles GluA2-containing receptors. However, the sequence-diverse N-terminal domains (NTDs) give rise to a highly mobile assembly, enabling domain swapping and subunit re-alignments in the ligand-binding domain tier that are pronounced in desensitized states. These transitions underlie the unique kinetic properties of GluA1. A GluA2 mutant (F231A) increasing NTD dynamics phenocopies this behaviour, and exhibits reduced synaptic responses, reflecting the anchoring function of the AMPAR NTD at the synapse. Together, this work underscores how the subunit-diverse NTDs determine subunit arrangement, gating properties and ultimately synaptic signalling efficiency among AMPAR subtypes.

Enabling cryo-EM density interpretation from yeast native cell extracts by proteomics data and AlphaFold structures

In the cellular context, proteins participate in communities to perform their function. The detection and identification of these communities as well as in-community interactions has long been the subject of investigation, mainly through proteomics analysis with mass spectrometry. With the advent of cryogenic electron microscopy and the "resolution revolution," their visualization has recently been made possible, even in complex, native samples. The advances in both fields have resulted in the generation of large amounts of data, whose analysis requires advanced computation, often employing machine learning approaches to reach the desired outcome. In this work, we first performed a robust proteomics analysis of mass spectrometry (MS) data derived from a yeast native cell extract and used this information to identify protein communities and inter-protein interactions. Cryo-EM analysis of the cell extract provided a reconstruction of a biomolecule at medium resolution (∼8 Å (FSC = 0.143)). Utilizing MS-derived proteomics data and systematic fitting of AlphaFold-predicted atomic models, this density was assigned to the 2.6 MDa complex of yeast fatty acid synthase. Our proposed workflow identifies protein complexes in native cell extracts from Saccharomyces cerevisiae by combining proteomics, cryo-EM, and AI-guided protein structure prediction.

MDTOMO method for continuous conformational variability analysis in cryo electron subtomograms based on molecular dynamics simulations

Cryo electron tomography (cryo-ET) allows observing macromolecular complexes in their native environment. The common routine of subtomogram averaging (STA) allows obtaining the three-dimensional (3D) structure of abundant macromolecular complexes, and can be coupled with discrete classification to reveal conformational heterogeneity of the sample. However, the number of complexes extracted from cryo-ET data is usually small, which restricts the discrete-classification results to a small number of enough populated states and, thus, results in a largely incomplete conformational landscape. Alternative approaches are currently being investigated to explore the continuity of the conformational landscapes that in situ cryo-ET studies could provide. In this article, we present MDTOMO, a method for analyzing continuous conformational variability in cryo-ET subtomograms based on Molecular Dynamics (MD) simulations. MDTOMO allows obtaining an atomic-scale model of conformational variability and the corresponding free-energy landscape, from a given set of cryo-ET subtomograms. The article presents the performance of MDTOMO on a synthetic ABC exporter dataset and an in situ SARS-CoV-2 spike dataset. MDTOMO allows analyzing dynamic properties of molecular complexes to understand their biological functions, which could also be useful for structure-based drug discovery.

Scipion3: A workflow engine for cryo-electron microscopy image processing and structural biology

Image-processing pipelines require the design of complex workflows combining many different steps that bring the raw acquired data to a final result with biological meaning. In the image-processing domain of cryo-electron microscopy single-particle analysis (cryo-EM SPA), hundreds of steps must be performed to obtain the three-dimensional structure of a biological macromolecule by integrating data spread over thousands of micrographs containing millions of copies of allegedly the same macromolecule. The execution of such complicated workflows demands a specific tool to keep track of all these steps performed. Additionally, due to the extremely low signal-to-noise ratio (SNR), the estimation of any image parameter is heavily affected by noise resulting in a significant fraction of incorrect estimates. Although low SNR and processing millions of images by hundreds of sequential steps requiring substantial computational resources are specific to cryo-EM, these characteristics may be shared by other biological imaging domains. Here, we present Scipion, a Python generic open-source workflow engine specifically adapted for image processing. Its main characteristics are: (a) interoperability, (b) smart object model, (c) gluing operations, (d) comparison operations, (e) wide set of domain-specific operations, (f) execution in streaming, (g) smooth integration in high-performance computing environments, (h) execution with and without graphical capabilities, (i) flexible visualization, (j) user authentication and private access to private data, (k) scripting capabilities, (l) high performance, (m) traceability, (n) reproducibility, (o) self-reporting, (p) reusability, (q) extensibility, (r) software updates, and (s) non-restrictive software licensing.

Improvement of cryo-EM maps by simultaneous local and non-local deep learning

Cryo-EM has emerged as the most important technique for structure determination of macromolecular complexes. However, raw cryo-EM maps often exhibit loss of contrast at high resolution and heterogeneity over the entire map. As such, various post-processing methods have been proposed to improve cryo-EM maps. Nevertheless, it is still challenging to improve both the quality and interpretability of EM maps. Addressing the challenge, we present a three-dimensional Swin-Conv-UNet-based deep learning framework to improve cryo-EM maps, named EMReady, by not only implementing both local and non-local modeling modules in a multiscale UNet architecture but also simultaneously minimizing the local smooth L1 distance and maximizing the non-local structural similarity between processed experimental and simulated target maps in the loss function. EMReady was extensively evaluated on diverse test sets of 110 primary cryo-EM maps and 25 pairs of half-maps at 3.0-6.0 Å resolutions, and compared with five state-of-the-art map post-processing methods. It is shown that EMReady can not only robustly enhance the quality of cryo-EM maps in terms of map-model correlations, but also improve the interpretability of the maps in automatic de novo model building.

MDSPACE: Extracting Continuous Conformational Landscapes from Cryo-EM Single Particle Datasets Using 3D-to-2D Flexible Fitting based on Molecular Dynamics Simulation

This article presents an original approach for extracting atomic-resolution landscapes of continuous conformational variability of biomolecular complexes from cryo electron microscopy (cryo-EM) single particle images. This approach is based on a new 3D-to-2D flexible fitting method, which uses molecular dynamics (MD) simulation and is embedded in an iterative conformational-landscape refinement scheme. This new approach is referred to as MDSPACE, which stands for Molecular Dynamics simulation for Single Particle Analysis of Continuous Conformational hEterogeneity. The article describes the MDSPACE approach and shows its performance using synthetic and experimental datasets.

Protein Structural Analysis by Cryogenic Electron Microscopy

Cryogenic electron microscopy (cryo-EM) is constantly developing and growing as a major technique for structure determination of protein complexes. Here, we detail the first steps of any cryo-EM project: specimen preparation and data collection. Step by step, a list of material needed is provided and the sequence of actions to carry out is given. We hope that these protocols will be useful to all people getting started with cryo-EM.

ContinuousFlex: Software package for analyzing continuous conformational variability of macromolecules in cryo electron microscopy and tomography data

ContinuousFlex is a user-friendly open-source software package for analyzing continuous conformational variability of macromolecules in cryo electron microscopy (cryo-EM) and cryo electron tomography (cryo-ET) data. In 2019, ContinuousFlex became available as a plugin for Scipion, an image processing software package extensively used in the cryo-EM field. Currently, ContinuousFlex contains software for running (1) recently published methods HEMNMA-3D, TomoFlow, and NMMD; (2) earlier published methods HEMNMA and StructMap; and (3) methods for simulating cryo-EM and cryo-ET data with conformational variability and methods for data preprocessing. It also includes external software for molecular dynamics simulation (GENESIS) and normal mode analysis (ElNemo), used in some of the mentioned methods. The HEMNMA software has been presented in the past, but not the software of other methods. Besides, ContinuousFlex currently also offers a deep learning extension of HEMNMA, named DeepHEMNMA. In this article, we review these methods in the context of the ContinuousFlex package, developed to facilitate their use by the community.

Higher resolution in cryo-EM by the combination of macromolecular prior knowledge and image-processing tools

Single-particle cryo-electron microscopy has become a powerful technique for the 3D structure determination of biological molecules. The last decade has seen an astonishing development of both hardware and software, and an exponential growth of new structures obtained at medium-high resolution. However, the knowledge accumulated in this field over the years has hardly been utilized as feedback in the reconstruction of new structures. In this context, this article explores the use of the deep-learning approach deepEMhancer as a regularizer in the RELION refinement process. deepEMhancer introduces prior information derived from macromolecular structures, and contributes to noise reduction and signal enhancement, as well as a higher degree of isotropy. These features have a direct effect on image alignment and reduction of overfitting during iterative refinement. The advantages of this combination are demonstrated for several membrane proteins, for which it is especially useful because of their high disorder and flexibility.

Protein dynamics developments for the large scale and cryoEM: case study of ProDy 2.0

Cryo-electron microscopy (cryoEM) has become a well established technique with the potential to produce structures of large and dynamic supramolecular complexes that are not amenable to traditional approaches for studying structure and dynamics. The size and low resolution of such molecular systems often make structural modelling and molecular dynamics simulations challenging and computationally expensive. This, together with the growing wealth of structural data arising from cryoEM and other structural biology methods, has driven a trend in the computational biophysics community towards the development of new pipelines for analysing global dynamics using coarse-grained models and methods. At the centre of this trend has been a return to elastic network models, normal mode analysis (NMA) and ensemble analyses such as principal component analysis, and the growth of hybrid simulation methodologies that make use of them. Here, this field is reviewed with a focus on ProDy, the Python application programming interface for protein dynamics, which has been developed over the last decade. Two key developments in this area are highlighted: (i) ensemble NMA towards extracting and comparing the signature dynamics of homologous structures, aided by the recent SignDy pipeline, and (ii) pseudoatom fitting for more efficient global dynamics analyses of large and low-resolution supramolecular assemblies from cryoEM, revisited in the CryoDy pipeline. It is believed that such a renewal and extension of old models and methods in new pipelines will be critical for driving the field forward into the next cryoEM revolution.

TomoFlow: Analysis of Continuous Conformational Variability of Macromolecules in Cryogenic Subtomograms based on 3D Dense Optical Flow

Cryogenic Electron Tomography (cryo-ET) allows structural and dynamics studies of macromolecules in situ. Averaging different copies of imaged macromolecules is commonly used to obtain their structure at higher resolution and discrete classification to analyze their dynamics. Instrumental and data processing developments are progressively equipping cryo-ET studies with the ability to escape the trap of classification into a complete continuous conformational variability analysis. In this work, we propose TomoFlow, a method for analyzing macromolecular continuous conformational variability in cryo-ET subtomograms based on a three-dimensional dense optical flow (OF) approach. The resultant lower-dimensional conformational space allows generating movies of macromolecular motion and obtaining subtomogram averages by grouping conformationally similar subtomograms. The animations and the subtomogram group averages reveal accurate trajectories of macromolecular motion based on a novel mathematical model that makes use of OF properties. This paper describes TomoFlow with tests on simulated datasets generated using different techniques, namely Normal Mode Analysis and Molecular Dynamics Simulation. It also shows an application of TomoFlow on a dataset of nucleosomes in situ, which provided promising results coherent with previous findings using the same dataset but without imposing any prior knowledge on the analysis of the conformational variability. The method is discussed with its potential uses and limitations.