Flexible workflows for on-the-fly electron-microscopy single-particle image processing using Scipion

Automated pipelines for rapid evaluation during cryoEM data acquisition

Cryo-electron microscopy (cryoEM) has become a popular method for determining high-resolution structures of biomolecules. However, data processing can be time-consuming, particularly for new researchers entering the field. To improve data quality and increase data collection efficiency, several software packages have been developed for on-the-fly data processing with various degrees of automation. These software packages allow researchers to perform tasks such as motion correction, CTF estimation, 2D classification, and 3D reconstruction in real-time, with minimal human input. On-the-fly data processing can not only improve data collection efficiency but also increase the productivity of instrumentation in high demand. However, the various software packages available differ in their performance, computational requirements, and levels of automation. In this review, we describe the minimal metrics used to assess data quality during data collection, outline the features of an ideal on-the-fly data processing software systems, and provide results from using three of these systems.

TomoTwin: generalized 3D localization of macromolecules in cryo-electron tomograms with structural data mining

Cryogenic-electron tomography enables the visualization of cellular environments in extreme detail, however, tools to analyze the full amount of information contained within these densely packed volumes are still needed. Detailed analysis of macromolecules through subtomogram averaging requires particles to first be localized within the tomogram volume, a task complicated by several factors including a low signal to noise ratio and crowding of the cellular space. Available methods for this task suffer either from being error prone or requiring manual annotation of training data. To assist in this crucial particle picking step, we present TomoTwin: an open source general picking model for cryogenic-electron tomograms based on deep metric learning. By embedding tomograms in an information-rich, high-dimensional space that separates macromolecules according to their three-dimensional structure, TomoTwin allows users to identify proteins in tomograms de novo without manually creating training data or retraining the network to locate new proteins.

Cryo-EM structure of MsbA in saposin-lipid nanoparticles (Salipro) provides insights into nucleotide coordination

The ATP-binding cassette transporter MsbA is a lipid flippase, translocating lipid A, glycolipids, and lipopolysaccharides from the inner to the outer leaflet of the inner membrane of Gram-negative bacteria. It has been used as a model system for time-resolved structural studies as several MsbA structures in different states and reconstitution systems (detergent/nanodiscs/peptidiscs) are available. However, due to the limited resolution of the available structures, detailed structural information on the bound nucleotides has remained elusive. Here, we have reconstituted MsbA in saposin A-lipoprotein nanoparticles (Salipro) and determined the structure of ADP-vanadate-bound MsbA by single-particle cryo-electron microscopy to 3.5 Å resolution. This procedure has resulted in significantly improved resolution and enabled us to model all side chains and visualise detailed ADP-vanadate interactions in the nucleotide-binding domains. The approach may be applicable to other dynamic membrane proteins.

Advances in Xmipp for Cryo-Electron Microscopy: From Xmipp to Scipion

Xmipp is an open-source software package consisting of multiple programs for processing data originating from electron microscopy and electron tomography, designed and managed by the Biocomputing Unit of the Spanish National Center for Biotechnology, although with contributions from many other developers over the world. During its 25 years of existence, Xmipp underwent multiple changes and updates. While there were many publications related to new programs and functionality added to Xmipp, there is no single publication on the Xmipp as a package since 2013. In this article, we give an overview of the changes and new work since 2013, describe technologies and techniques used during the development, and take a peek at the future of the package.

Image Processing in Cryo-Electron Microscopy of Single Particles: The Power of Combining Methods

Cryo-electron microscopy has established as a mature structural biology technique to elucidate the three-dimensional structure of biological macromolecules. The Coulomb potential of the sample is imaged by an electron beam, and fast semi-conductor detectors produce movies of the sample under study. These movies have to be further processed by a whole pipeline of image-processing algorithms that produce the final structure of the macromolecule. In this chapter, we illustrate this whole processing pipeline putting in value the strength of "meta algorithms," which are the combination of several algorithms, each one with different mathematical rationale, in order to distinguish correctly from incorrectly estimated parameters. We show how this strategy leads to superior performance of the whole pipeline as well as more confident assessments about the reconstructed structures. The "meta algorithms" strategy is common to many fields and, in particular, it has provided excellent results in bioinformatics. We illustrate this combination using the workflow engine, Scipion.

SINGLE: Atomic-resolution structure identification of nanocrystals by graphene liquid cell EM

Analysis of the three-dimensional (3D) structures of nanocrystals with solution-phase transmission electron microscopy is beginning to reveal their unique physiochemical properties. We developed a "one-particle Brownian 3D reconstruction method" based on imaging of ensembles of colloidal nanocrystals using graphene liquid cell electron microscopy. Projection images of differently rotated nanocrystals are acquired using a direct electron detector with high temporal (<2.5 ms) resolution and analyzed to obtain an ensemble of 3D reconstructions. Here, we introduce computational methods required for successful atomic-resolution 3D reconstruction: (i) tracking of the individual particles throughout the time series, (ii) subtraction of the interfering background of the graphene liquid cell, (iii) identification and rejection of low-quality images, and (iv) tailored strategies for 2D/3D alignment and averaging that differ from those used in biological cryo-electron microscopy. Our developments are made available through the open-source software package SINGLE.

TranSPHIRE: automated and feedback-optimized on-the-fly processing for cryo-EM

Single particle cryo-EM requires full automation to allow high-throughput structure determination. Although software packages exist where parts of the cryo-EM pipeline are automated, a complete solution that offers reliable on-the-fly processing, resulting in high-resolution structures, does not exist. Here we present TranSPHIRE: A software package for fully-automated processing of cryo-EM datasets during data acquisition. TranSPHIRE transfers data from the microscope, automatically applies the common pre-processing steps, picks particles, performs 2D clustering, and 3D refinement parallel to image recording. Importantly, TranSPHIRE introduces a machine learning-based feedback loop to re-train its picking model to adapt to any given data set live during processing. This elegant approach enables TranSPHIRE to process data more effectively, producing high-quality particle stacks. TranSPHIRE collects and displays all metrics and microscope settings to allow users to quickly evaluate data during acquisition. TranSPHIRE can run on a single work station and also includes the automated processing of filaments.

SIMPLE 3.0. Stream single-particle cryo-EM analysis in real time

We here introduce the third major release of the SIMPLE (Single-particle IMage Processing Linux Engine) open-source software package for analysis of cryogenic transmission electron microscopy (cryo-EM) movies of single-particles (Single-Particle Analysis, SPA). Development of SIMPLE 3.0 has been focused on real-time data processing using minimal CPU computing resources to allow easy and cost-efficient scaling of processing as data rates escalate. Our stream SPA tool implements the steps of anisotropic motion correction and CTF estimation, rapid template-based particle identification and 2D clustering with automatic class rejection. SIMPLE 3.0 additionally features an easy-to-use web-based graphical user interface (GUI) that can be run on any device (workstation, laptop, tablet or phone) and supports a remote multi-user environment over the network. The new project-based execution model automatically records the executed workflow and represents it as a flow diagram in the GUI. This facilitates meta-data handling and greatly simplifies usage. Using SIMPLE 3.0, it is possible to automatically obtain a clean SP data set amenable to high-resolution 3D reconstruction directly upon completion of the data acquisition, without the need for extensive image processing post collection. Only minimal standard CPU computing resources are required to keep up with a rate of ∼300 Gatan K3 direct electron detector movies per hour. SIMPLE 3.0 is available for download from simplecryoem.com.

Integration of Cryo-EM Model Building Software in Scipion

Advances in cryo-electron microscopy (cryo-EM) have made it possible to obtain structures of large biological macromolecules at near-atomic resolution. This "resolution revolution" has encouraged the use and development of modeling tools able to produce high-quality atomic models from cryo-EM density maps. Unfortunately, many practical problems appear when combining different packages in the same processing workflow, which make difficult the use of these tools by non-experts and, therefore, reduce their utility. We present here a major extension of the image processing framework Scipion that provides inter-package integration in the model building area and full tracking of the complete workflow, from image processing to structure validation.

The evolution of SPHIRE-crYOLO particle picking and its application in automated cryo-EM processing workflows

Particle selection is a crucial step when processing electron cryo microscopy data. Several automated particle picking procedures were developed in the past but most struggle with non-ideal data sets. In our recent Communications Biology article, we presented crYOLO, a deep learning based particle picking program. It enables fast, automated particle picking at human levels of accuracy with low effort. A general model allows the use of crYOLO for selecting particles in previously unseen data sets without further training. Here we describe how crYOLO has evolved since its initial release. We have introduced filament picking, a new denoising technique, and a new graphical user interface. Moreover, we outline its usage in automated processing pipelines, which is an important advancement on the horizon of the field.

Wagner and Raunser recently presented a deep learning based particle picking program for Cryo-EM, crYOLO. Here they discuss recent improvements to the program, a graphical user interface and share their thoughts on desired future developments.