Alignment of electron tomographic series by correlation without the use of gold particles

Markerauto2: A fast and robust fully automatic fiducial marker-based tilt series alignment software for electron tomography

Cryoelectron tomography (cryo-ET) has become an indispensable technology for visualizing in situ biological ultrastructures, where the tilt series alignment is the key step to obtain a high-resolution three-dimensional reconstruction. Specifically, with the advent of high-throughput cryo-ET data collection, there is an increasing demand for high-accuracy and fully automatic tilt series alignment, to enable efficient data processing. Here, we propose Markerauto2, a fast and robust fully automatic software that enables accurate fiducial marker-based tilt series alignment. Markerauto2 implements the following novel pipelines: (1) an accelerated high-precision fiducial marker detection with wavelet multiscale template, (2) an ultra-fast and robust fiducial marker tracking supported by hashed geometric features, (3) a high-angle fiducial marker supplementation strategy to produce more complete tracks, and (4) a precise and robust calibration of projection parameters with group-weighted parameter optimization. Comprehensive experiments conducted on both simulated and real-world datasets demonstrate the robustness, efficiency, and effectiveness of the proposed software.

A joint alignment and reconstruction algorithm for electron tomography to visualize in-depth cell-to-cell interactions

Electron tomography allows one to obtain 3D reconstructions visualizing a tissue's ultrastructure from a series of 2D projection images. An inherent problem with this imaging technique is that its projection images contain unwanted shifts, which must be corrected for to achieve reliable reconstructions. Commonly, the projection images are aligned with each other by means of fiducial markers prior to the reconstruction procedure. In this work, we propose a joint alignment and reconstruction algorithm that iteratively solves for both the unknown reconstruction and the unintentional shift and does not require any fiducial markers. We evaluate the approach first on synthetic phantom data where the focus is not only on the reconstruction quality but more importantly on the shift correction. Subsequently, we apply the algorithm to healthy C57BL/6J mice and then compare it with non-obese diabetic (NOD) mice, with the aim of visualizing the attack of immune cells on pancreatic beta cells within type 1 diabetic mice at a more profound level through 3D analysis. We empirically demonstrate that the proposed algorithm is able to compute the shift with a remaining error at only the sub-pixel level and yields high-quality reconstructions for the limited-angle inverse problem. By decreasing labour and material costs, the algorithm facilitates further research directed towards investigating the immune system's attacks in pancreata of NOD mice for numerous samples at different stages of type 1 diabetes.

AreTomo: An integrated software package for automated marker-free, motion-corrected cryo-electron tomographic alignment and reconstruction

•

AreTomo, a GPU accelerated software package, fully automates motion-corrected marker-free tomographic alignment and reconstruction.

•

AreTomo can produce tomograms with sufficient accuracy to be directly used for subtomogram averaging.

•

AreTomo enables the on-the-fly reconstruction of tomograms in parallel with tilt series collection, thus providing users with real-time feedback of sample quality.

AreTomo, an abbreviation for Alignment and Reconstruction for Electron Tomography, is a GPU accelerated software package that fully automates motion-corrected marker-free tomographic alignment and reconstruction in a single package. By correcting in-plane rotation, translation, and importantly, the local motion resulting from beam-induced motion from tilt to tilt, AreTomo can produce tomograms with sufficient accuracy to be directly used for subtomogram averaging. Another major application is the on-the-fly reconstruction of tomograms in parallel with tilt series collection to provide users with real-time feedback of sample quality allowing users to make any necessary adjustments of collection parameters. Here, the multiple alignment algorithms implemented in AreTomo are described and the local motions measured on a typical tilt series are analyzed. The residual local motion after correction for global motion was found in the range of ± 80 Å, indicating that the accurate correction of local motion is critical for high-resolution cryo-electron tomography (cryoET).

Fast and noise-tolerant determination of the center of rotation in tomography

High-quality tomographic reconstruction is not possible without the accurate localization of the center of rotation. Poor localization leads to artifacts in the data and can even cause reconstructions to fail. There are many approaches to solving this problem, some of which involve the collection of full sinograms, or even provisional tomographic reconstructions, in order to determine the center of rotation. Here, a simple method based on the expected symmetry of the Fourier transform of summed projections approximately 180° apart is presented; unlike cross-correlation methods, it requires only a single Fourier transform to compute, and uses mainly low spatial frequency information which is less susceptible to noise. This approach is shown to be fast, and robust against poor signal-to-noise as well as to projection images acquired at angles that are not exactly 180° apart. This rapid method can be useful as a first step in the processing of tomographic data.

Endocytosed nanogold fiducials for improved in-situ cryo-electron tomography tilt-series alignment

Cryo-electron tomography (CET) on cryo-focused ion beam (FIB)-milled lamellae is becoming a powerful technique for determining the structure of macromolecular complexes in their native cellular environment. Prior to tomogram reconstruction, CET tilt-series recorded on FIB lamellae need to be aligned. Traditionally, CET tilt-series alignment is performed with 5-20 nm gold fiducials, but it has thus far proven difficult to apply this to FIB lamellae of eukaryotic cells. In here, we describe a simple method to allow uptake of bovine serum albumin (BSA)-gold fiducials into mammalian cells via endocytosis, which can subsequently be used as fiducials for tilt-series alignment of cryo-FIB lamellae. We compare the alignment of tilt-series with BSA-gold fiducials to fiducial-less patch-tracking, and find better alignment results with BSA-gold. This technique can contribute to understand cells at a structural and ultrastructural level with both cryo- and room-temperature electron tomography. Furthermore, fluorescently labeled BSA-gold has the potential to be used as fiducials for correlative light and electron microscopy studies.

Rapid alignment of nanotomography data using joint iterative reconstruction and reprojection

As x-ray and electron tomography is pushed further into the nanoscale, the limitations of rotation stages become more apparent, leading to challenges in the alignment of the acquired projection images. Here we present an approach for rapid post-acquisition alignment of these projections to obtain high quality three-dimensional images. Our approach is based on a joint estimation of alignment errors, and the object, using an iterative refinement procedure. With simulated data where we know the alignment error of each projection image, our approach shows a residual alignment error that is a factor of a thousand smaller, and it reaches the same error level in the reconstructed image in less than half the number of iterations. We then show its application to experimental data in x-ray and electron nanotomography.

Automated tilt series alignment and tomographic reconstruction in IMOD

Automated tomographic reconstruction is now possible in the IMOD software package, including the merging of tomograms taken around two orthogonal axes. Several developments enable the production of high-quality tomograms. When using fiducial markers for alignment, the markers to be tracked through the series are chosen automatically; if there is an excess of markers available, a well-distributed subset is selected that is most likely to track well. Marker positions are refined by applying an edge-enhancing Sobel filter, which results in a 20% improvement in alignment error for plastic-embedded samples and 10% for frozen-hydrated samples. Robust fitting, in which outlying points are given less or no weight in computing the fitting error, is used to obtain an alignment solution, so that aberrant points from the automated tracking can have little effect on the alignment. When merging two dual-axis tomograms, the alignment between them is refined from correlations between local patches; a measure of structure was developed so that patches with insufficient structure to give accurate correlations can now be excluded automatically. We have also developed a script for running all steps in the reconstruction process with a flexible mechanism for setting parameters, and we have added a user interface for batch processing of tilt series to the Etomo program in IMOD. Batch processing is fully compatible with interactive processing and can increase efficiency even when the automation is not fully successful, because users can focus their effort on the steps that require manual intervention.

Tomography by point source digital holographic microscopy

We propose a tomographic method for point source inline holographic microscopy. By recording a set of holograms at different illumination angles, shadowing effects are eliminated resulting in three-dimensional images with the same precision at the micrometer-scale in all directions. The advantage of our tomographic approach is that it works for both absorbing and phase objects, regardless of the change of refractive index at interfaces. We develop the method with computer simulations and demonstrate its strength by presenting experimental results for micrometer-sized polystyrene beads and a cotton fiber.

3D spatial resolution improvement by dual-axis electron tomography: application to tri-gate transistors

The performance of semiconductor devices can be linked to geometry and variations of the structure. For transistors in particular, the geometry of the gate stack is essential. In this work we investigate the gate stack of a tri-gate transistor using dual-axis electron tomography. This allows the reconstruction of all surfaces of the gate of the transistor with high resolution and measurement of the local thickness of the gate oxide. While previously, dual-axis electron tomography was employed for reducing missing wedge artifacts, our work demonstrates the potential of dual-axis tomography for improving the resolution of a tomographic reconstruction, even for structures not affected by missing wedge artifacts. By simulations and experiments we show the value of dual-axis tomography for characterization of nanoscale devices as an approach that requires no prior information and that can be easily extended even to more than two tilt axes.

Electron tomography of amplified nanogold immunolabelling: Improvement of quality based on alignment of projections with sinograms and use of post-reconstruction deconvolution

Electron tomography of immunolabelled proteins identified with amplified nanogold particles imaged by Scanning and Transmission Electron Microscopy within thick sections is a powerful method to investigate the three-dimensional organization of complex cellular machineries. In order to increase the overall quality of the reconstructed cube, we have developed two methods that improve the tomographic reconstruction process. We first performed a very precise alignment of the projections before reconstruction with a technique using sinograms. After reconstruction, we propose to compute image restoration by calculating the Point Spread Function of the projection/back-projection system and to use it to deblur the reconstructed cubes. Improvement in the quality of the reconstructed cubes is demonstrated on images of nucleolar proteins tagged with EGFP and immunolabelled with nanogold particles.

Accurate marker-free alignment with simultaneous geometry determination and reconstruction of tilt series in electron tomography

An image alignment method for electron tomography is presented which is based on cross-correlation techniques and which includes a simultaneous refinement of the tilt geometry. A coarsely aligned tilt series is iteratively refined with a procedure consisting of two steps for each cycle: area matching and subsequent geometry correction. The first step, area matching, brings into register equivalent specimen regions in all images of the tilt series. It determines four parameters of a linear two-dimensional transformation, not just translation and rotation as is done during the preceding coarse alignment with conventional methods. The refinement procedure also differs from earlier methods in that the alignment references are now computed from already aligned images by reprojection of a backprojected volume. The second step, geometry correction, refines the initially inaccurate estimates of the geometrical parameters, including the direction of the tilt axis, a tilt angle offset, and the inclination of the specimen with respect to the support film or specimen holder. The correction values serve as an indicator for the progress of the refinement. For each new iteration, the correction values are used to compute an updated set of geometry parameters by a least squares fit. Model calculations show that it is essential to refine the geometrical parameters as well as the accurate alignment of the images to obtain a faithful map of the original structure.

Three-dimensional transmission electron microscopy and its application to mitosis research

Transmission electron microscopy produces images that are projections of the original object, with the consequence that features from different depths of the specimen overlap and give a confusing image. This problem is overcome by reconstructing the object in 3D from a series of 2D views using either serial thin section reconstruction or electron tomography. In the serial section approach, the series of 2D views is generated from images of successive serial sections cut thin enough to be effectively 2D slices of the specimen. For electron tomography the series of 2D views is generated by tilting a single, usually thicker, section in the electron beam. Resolution in the depth dimension is limited to twice the section thickness for serial section reconstruction and is determined by the number of tilt views collected (i.e., by the fineness of the angular interval between successive tilt views) for electron tomography. Both methods produce distorted 3D reconstructions because of missing material and alignment difficulties in the case of serial sections and the limited angular tilt range in the case of electron tomography. However, techniques have evolved for minimizing and circumventing these distortions and, as long as the user is aware of the limitations, misinterpretations can be avoided. Since electron tomography provides better resolution (generally 5-20 nm), it is the method of choice for determining detailed structural interactions such as the depth of kinetochore MT penetration into the kinetochore outer plate. On the other hand, serial section reconstruction is more effective for projects that require tracking through a complete object in the specimen, such as counting the number of kinetochore MTs on each kinetochore. If the project requires finding a relatively small object in a large specimen (e.g., finding centrioles in an oocyte), then it is sometimes advantageous to cut thicker plastic sections and analyze them via stereo viewing. The mitotic spindle, however, is generally too complex to be analyzed via stereo viewing. Currently, collapse of plastic sections in the electron beam limits the utility of serial section electron tomography. Once a 3D reconstruction is completed it must be analyzed with the 2D medium of the screen on a computer monitor. The easiest approach is usually to walk through the 3D reconstruction volume slice by slice. However, in order to appreciate 3D interactions, and to communicate the results to others, it is generally necessary to segment key components from the rest of the volume and use modeling and rendering techniques. Rendered surface views can easily be color coded and provided with a number of depth cues to simulate the surface viewing encountered in everyday life. In some instances, it is useful to look through a smaller portion of the reconstruction volume with "X-ray vision." This can accomplished by using volume rendering to create a series of semitransparent views from different tilt angles.

The yeast spindle pole body is assembled around a central crystal of Spc42p

The spindle pole body (SPB) is the microtubule organizing center (MTOC) in the yeast Saccharomyces that plays a pivotal role in such diverse processes as mitosis, budding, and mating. We have used cryoelectron microscopy and image processing to study the structure of isolated diploid SPBs. We show that SPBs are present in two lateral-size classes, sharing a similar vertical architecture comprised of six major layers. Tomographic reconstructions of heparin-stripped SPBs reveal a central hexagonally packed layer. Overexpression of Spc42p results in the growth of a similar layer, forming a crystal that encircles the SPB. Hence, the SPB is an MTOC that utilizes crystallographic packing of subunits in its construction.