Big data in cryoEM: automated collection, processing and accessibility of EM data

The advent of preventive high-resolution structural histopathology by artificial-intelligence-powered cryogenic electron tomography

Advances in cryogenic electron microscopy (cryoEM) single particle analysis have revolutionized structural biology by facilitating the in vitro determination of atomic- and near-atomic-resolution structures for fully hydrated macromolecular complexes exhibiting compositional and conformational heterogeneity across a wide range of sizes. Cryogenic electron tomography (cryoET) and subtomogram averaging are rapidly progressing toward delivering similar insights for macromolecular complexes in situ, without requiring tags or harsh biochemical purification. Furthermore, cryoET enables the visualization of cellular and tissue phenotypes directly at molecular, nanometric resolution without chemical fixation or staining artifacts. This forward-looking review covers recent developments in cryoEM/ET and related technologies such as cryogenic focused ion beam milling scanning electron microscopy and correlative light microscopy, increasingly enhanced and supported by artificial intelligence algorithms. Their potential application to emerging concepts is discussed, primarily the prospect of complementing medical histopathology analysis. Machine learning solutions are poised to address current challenges posed by "big data" in cryoET of tissues, cells, and macromolecules, offering the promise of enabling novel, quantitative insights into disease processes, which may translate into the clinic and lead to improved diagnostics and targeted therapeutics.

Single particle cryo-electron microscopy with an enhanced 200 kV cryo-TEM configuration achieves near-atomic resolution

Single particle cryogenic electron microscopy (cryo-EM) as a structural biology methodology has become increasingly attractive and accessible to investigators in both academia and industry as this ever-advancing technology enables successful structural determination of a wide range of protein and nucleic acid targets. Although data for many high resolution cryo-EM structures are still obtained using a 300 kV cryogenic transmission electron microscope (cryo-TEM), a modern 200 kV cryo-TEM equipped with an advanced direct electron detector and energy filter is a cost-effective choice for most single particle applications, routinely achieving sub 3 angstrom (Å) resolution. Here, we systematically evaluate performance of one such high-end configuration - a 200 kV Glacios microscope coupled with a Falcon 4 direct electron detector and Selectris energy filter (Glacios-F4-S). First, we evaluated data quality on the standard benchmarking sample, rabbit muscle aldolase, using three of the most frequently used cryo-EM data collection software: SerialEM, Leginon and EPU, and found that - despite sample heterogeneity - all final reconstructions yield same overall resolutions of 2.6 Å and map quality when using either of the three software. Furthermore, comparison between Glacios-F4-S and a 300 kV cryo-TEM (Titan Krios with Falcon 4) revealed nominal resolution differences in overall reconstructions of a reconstituted human nucleosome core particle, achieving 2.8 and 2.5 Å, respectively. Finally, we performed comparative data analysis on the human RAD51 paralog complex, BCDX2, a four-protein complex of approximately 150 kilodaltons, and found that a small dataset (≤1,000 micrographs) was sufficient to generate a 3.3 Å reconstruction, with sufficient detail to resolve co-bound ligands, AMP-PNP and Mg +2 . In summary, this study provides evidence that the Glacios-F4-S operates equally well with all standard data collection software, and is sufficient to obtain high resolution structural information of novel macromolecular complexes, readily acquiring single particle data rivaling that of 300 kV cryo-TEMs.

Machine learning approaches to cryoEM density modification differentially affect biomacromolecule and ligand density quality

The application of machine learning to cryogenic electron microscopy (cryoEM) data analysis has added a valuable set of tools to the cryoEM data processing pipeline. As these tools become more accessible and widely available, the implications of their use should be assessed. We noticed that machine learning map modification tools can have differential effects on cryoEM densities. In this perspective, we evaluate these effects to show that machine learning tools generally improve densities for biomacromolecules while generating unpredictable results for ligands. This unpredictable behavior manifests both in quantitative metrics of map quality and in qualitative investigations of modified maps. The results presented here highlight the power and potential of machine learning tools in cryoEM, while also illustrating some of the risks of their unexamined use.

Correlative montage parallel array cryo-tomography for in situ structural cell biology

Imaging large fields of view while preserving high-resolution structural information remains a challenge in low-dose cryo-electron tomography. Here we present robust tools for montage parallel array cryo-tomography (MPACT) tailored for vitrified specimens. The combination of correlative cryo-fluorescence microscopy, focused-ion-beam milling, substrate micropatterning, and MPACT supports studies that contextually define the three-dimensional architecture of cells. To further extend the flexibility of MPACT, tilt series may be processed in their entirety or as individual tiles suitable for sub-tomogram averaging, enabling efficient data processing and analysis.

Big data in contemporary electron microscopy: challenges and opportunities in data transfer, compute and management

The second decade of the twenty-first century witnessed a new challenge in the handling of microscopy data. Big data, data deluge, large data, data compliance, data analytics, data integrity, data interoperability, data retention and data lifecycle are terms that have introduced themselves to the electron microscopy sciences. This is largely attributed to the booming development of new microscopy hardware tools. As a result, large digital image files with an average size of one terabyte within one single acquisition session is not uncommon nowadays, especially in the field of cryogenic electron microscopy. This brings along numerous challenges in data transfer, compute and management. In this review, we will discuss in detail the current state of international knowledge on big data in contemporary electron microscopy and how big data can be transferred, computed and managed efficiently and sustainably. Workflows, solutions, approaches and suggestions will be provided, with the example of the latest experiences in Australia. Finally, important principles such as data integrity, data lifetime and the FAIR and CARE principles will be considered.

Novel Artificial Intelligence-Based Approaches for Ab Initio Structure Determination and Atomic Model Building for Cryo-Electron Microscopy

Single particle cryo-electron microscopy (cryo-EM) has emerged as the prevailing method for near-atomic structure determination, shedding light on the important molecular mechanisms of biological macromolecules. However, the inherent dynamics and structural variability of biological complexes coupled with the large number of experimental images generated by a cryo-EM experiment make data processing nontrivial. In particular, ab initio reconstruction and atomic model building remain major bottlenecks that demand substantial computational resources and manual intervention. Approaches utilizing recent innovations in artificial intelligence (AI) technology, particularly deep learning, have the potential to overcome the limitations that cannot be adequately addressed by traditional image processing approaches. Here, we review newly proposed AI-based methods for ab initio volume generation, heterogeneous 3D reconstruction, and atomic model building. We highlight the advancements made by the implementation of AI methods, as well as discuss remaining limitations and areas for future development.

Cryo-EM structure of adeno-associated virus 4 at 2.2 Å resolution

Adeno-associated virus (AAV) is the vector of choice for several approved gene-therapy treatments and is the basis for many ongoing clinical trials. Various strains of AAV exist (referred to as serotypes), each with their own transfection characteristics. Here, a high-resolution cryo-electron microscopy structure (2.2 Å) of AAV serotype 4 (AAV4) is presented. The receptor responsible for transduction of the AAV4 clade of AAV viruses (including AAV11, AAV12 and AAVrh32.33) is unknown. Other AAVs interact with the same cell receptor, adeno-associated virus receptor (AAVR), in one of two different ways. AAV5-like viruses interact exclusively with the polycystic kidney disease-like 1 (PKD1) domain of AAVR, while most other AAVs interact primarily with the PKD2 domain. A comparison of the present AAV4 structure with prior corresponding structures of AAV5, AAV2 and AAV1 in complex with AAVR provides a foundation for understanding why the AAV4-like clade is unable to interact with either PKD1 or PKD2 of AAVR. The conformation of the AAV4 capsid in variable regions I, III, IV and V on the viral surface appears to be sufficiently different from AAV2 to ablate binding with PKD2. Differences between AAV4 and AAV5 in variable region VII appear to be sufficient to exclude binding with PKD1.

Exploring the Structural Variability of Dynamic Biological Complexes by Single-Particle Cryo-Electron Microscopy

Biological macromolecules and assemblies precisely rearrange their atomic 3D structures to execute cellular functions. Understanding the mechanisms by which these molecular machines operate requires insight into the ensemble of structural states they occupy during the functional cycle. Single-particle cryo-electron microscopy (cryo-EM) has become the preferred method to provide near-atomic resolution, structural information about dynamic biological macromolecules elusive to other structure determination methods. Recent advances in cryo-EM methodology have allowed structural biologists not only to probe the structural intermediates of biochemical reactions, but also to resolve different compositional and conformational states present within the same dataset. This article reviews newly developed sample preparation and single-particle analysis (SPA) techniques for high-resolution structure determination of intrinsically dynamic and heterogeneous samples, shedding light upon the intricate mechanisms employed by molecular machines and helping to guide drug discovery efforts.

CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images

Cryo-electron microscopy (cryo-EM) has become a tool of fundamental importance in structural biology, helping us understand the basic building blocks of life. The algorithmic challenge of cryo-EM is to jointly estimate the unknown 3D poses and the 3D electron scattering potential of a biomolecule from millions of extremely noisy 2D images. Existing reconstruction algorithms, however, cannot easily keep pace with the rapidly growing size of cryo-EM datasets due to their high computational and memory cost. We introduce cryoAI, an ab initio reconstruction algorithm for homogeneous conformations that uses direct gradient-based optimization of particle poses and the electron scattering potential from single-particle cryo-EM data. CryoAI combines a learned encoder that predicts the poses of each particle image with a physics-based decoder to aggregate each particle image into an implicit representation of the scattering potential volume. This volume is stored in the Fourier domain for computational efficiency and leverages a modern coordinate network architecture for memory efficiency. Combined with a symmetrized loss function, this framework achieves results of a quality on par with state-of-the-art cryo-EM solvers for both simulated and experimental data, one order of magnitude faster for large datasets and with significantly lower memory requirements than existing methods.

Cryo-electron Microscopy of Adeno-associated Virus

Adeno-associated virus (AAV) has a single-stranded DNA genome encapsidated in a small icosahedrally symmetric protein shell with 60 subunits. AAV is the leading delivery vector in emerging gene therapy treatments for inherited disorders, so its structure and molecular interactions with human hosts are of intense interest. A wide array of electron microscopic approaches have been used to visualize the virus and its complexes, depending on the scientific question, technology available, and amenability of the sample. Approaches range from subvolume tomographic analyses of complexes with large and flexible host proteins to detailed analysis of atomic interactions within the virus and with small ligands at resolutions as high as 1.6 Å. Analyses have led to the reclassification of glycan receptors as attachment factors, to structures with a new-found receptor protein, to identification of the epitopes of antibodies, and a new understanding of possible neutralization mechanisms. AAV is now well-enough characterized that it has also become a model system for EM methods development. Heralding a new era, cryo-EM is now also being deployed as an analytic tool in the process development and production quality control of high value pharmaceutical biologics, namely AAV vectors.

Evolving Experimental Techniques for Structure-Based Drug Design

Structure-based drug design (SBDD) is a prominent method in rational drug development and has traditionally benefitted from the atomic models of protein targets obtained using X-ray crystallography at cryogenic temperatures. In this perspective, we highlight recent advances in the development of structural techniques that are capable of probing dynamic information about protein targets. First, we discuss advances in the field of X-ray crystallography including serial room-temperature crystallography as a method for obtaining high-resolution conformational dynamics of protein-inhibitor complexes. Next, we look at cryogenic electron microscopy (cryoEM), another high-resolution technique that has recently been used to study proteins and protein complexes that are too difficult to crystallize. Finally, we present small-angle X-ray scattering (SAXS) as a potential high-throughput screening tool to identify inhibitors that target protein complexes and protein oligomerization.

Microscopic Visualization of Cell-Cell Adhesion Complexes at Micro and Nanoscale

Considerable progress has been made in our knowledge of the morphological and functional varieties of anchoring junctions. Cell-cell adhesion contacts consist of discrete junctional structures responsible for the mechanical coupling of cytoskeletons and allow the transmission of mechanical signals across the cell collective. The three main adhesion complexes are adherens junctions, tight junctions, and desmosomes. Microscopy has played a fundamental role in understanding these adhesion complexes on different levels in both physiological and pathological conditions. In this review, we discuss the main light and electron microscopy techniques used to unravel the structure and composition of the three cell-cell contacts in epithelial and endothelial cells. It functions as a guide to pick the appropriate imaging technique(s) for the adhesion complexes of interest. We also point out the latest techniques that have emerged. At the end, we discuss the problems investigators encounter during their cell-cell adhesion research using microscopic techniques.

Building Biological Relevance Into Integrative Modelling of Macromolecular Assemblies

Recent advances in structural biophysics and integrative modelling methods now allow us to decipher the structures of large macromolecular assemblies. Understanding the dynamics and mechanisms involved in their biological function requires rigorous integration of all available data. We have developed a complete modelling pipeline that includes analyses to extract biologically significant information by consistently combining automated and interactive human-guided steps. We illustrate this idea with two examples. First, we describe the ryanodine receptor, an ion channel that controls ion flux across the cell membrane through transitions between open and closed states. The conformational changes associated with the transitions are small compared to the considerable system size of the receptor; it is challenging to consistently track these states with the available cryo-EM structures. The second example involves homologous recombination, in which long filaments of a recombinase protein and DNA catalyse the exchange of homologous DNA strands to reliably repair DNA double-strand breaks. The nucleoprotein filament reaction intermediates in this process are short-lived and heterogeneous, making their structures particularly elusive. The pipeline we describe, which incorporates experimental and theoretical knowledge combined with state-of-the-art interactive and immersive modelling tools, can help overcome these challenges. In both examples, we point to new insights into biological processes that arise from such interdisciplinary approaches.

How advances in cryo-electron tomography have contributed to our current view of bacterial cell biology

Advancements in the field of cryo-electron tomography have greatly contributed to our current understanding of prokaryotic cell organization and revealed intracellular structures with remarkable architecture. In this review, we present some of the prominent advancements in cryo-electron tomography, illustrated by a subset of structural examples to demonstrate the power of the technique. More specifically, we focus on technical advances in automation of data collection and processing, sample thinning approaches, correlative cryo-light and electron microscopy, and sub-tomogram averaging methods. In turn, each of these advances enabled new insights into bacterial cell architecture, cell cycle progression, and the structure and function of molecular machines. Taken together, these significant advances within the cryo-electron tomography workflow have led to a greater understanding of prokaryotic biology. The advances made the technique available to a wider audience and more biological questions and provide the basis for continued advances in the near future.

Understanding the invisible hands of sample preparation for cryo-EM

Cryo-electron microscopy (cryo-EM) is rapidly becoming an attractive method in the field of structural biology. With the exploding popularity of cryo-EM, sample preparation must evolve to prevent congestion in the workflow. The dire need for improved microscopy samples has led to a diversification of methods. This Review aims to categorize and explain the principles behind various techniques in the preparation of vitrified samples for the electron microscope. Various aspects and challenges in the workflow are discussed, from sample optimization and carriers to deposition and vitrification. Reliable and versatile specimen preparation remains a challenge, and we hope to give guidelines and posit future directions for improvement.

[Cryo-electron microcopy for a new vision of the cell and its components]

Cryo-electron microscopy (cryo-EM) is a technique for imaging biological samples that plays a central role in structural biology, with high impact on research fields such as cell and developmental biology, bioinformatics, cell physics and applied mathematics. It allows the determination of structures of purified proteins within cells. This review describes the main recent advances in cryo-EM, illustrated by examples of proteins of biomedical interest, and the avenues for future development.

Three decades of listeriology through the prism of technological advances

Decades of breakthroughs resulting from cross feeding of microbiological research and technological innovation have promoted Listeria monocytogenes to the rank of model microorganism to study host-pathogen interactions. The extraordinary capacity of this bacterium to interfere with a vast array of host cellular processes uncovered new concepts in microbiology, cell biology and infection biology. Here, we review technological advances that revealed how bacteria and host interact in space and time at the molecular, cellular, tissue and whole body scales, ultimately revolutionising our understanding of Listeria pathogenesis. With the current bloom of multidisciplinary integrative approaches, Listeria entered a new microbiology era.

Towards data-driven next-generation transmission electron microscopy

Electron microscopy touches on nearly every aspect of modern life, underpinning materials development for quantum computing, energy and medicine. We discuss the open, highly integrated and data-driven microscopy architecture needed to realize transformative discoveries in the coming decade.

Real-space quantum-based refinement for cryo-EM: Q|R#3

Electron cryo-microscopy (cryo-EM) is rapidly becoming a major competitor to X-ray crystallography, especially for large structures that are difficult or impossible to crystallize. While recent spectacular technological improvements have led to significantly higher resolution three-dimensional reconstructions, the average quality of cryo-EM maps is still at the low-resolution end of the range compared with crystallography. A long-standing challenge for atomic model refinement has been the production of stereochemically meaningful models for this resolution regime. Here, it is demonstrated that including accurate model geometry restraints derived from ab initio quantum-chemical calculations (HF-D3/6-31G) can improve the refinement of an example structure (chain A of PDB entry 3j63). The robustness of the procedure is tested for additional structures with up to 7000 atoms (PDB entry 3a5x and chain C of PDB entry 5fn5) using the less expensive semi-empirical (GFN1-xTB) model. The necessary algorithms enabling real-space quantum refinement have been implemented in the latest version of qr.refine and are described here.

High-Throughput Cryo-EM Enabled by User-Free Preprocessing Routines

Single-particle cryoelectron microscopy (cryo-EM) continues to grow into a mainstream structural biology technique. Recent developments in data collection strategies alongside new sample preparation devices herald a future where users will collect multiple datasets per microscope session. To make cryo-EM data processing more automatic and user-friendly, we have developed an automatic pipeline for cryo-EM data preprocessing and assessment using a combination of deep-learning and image-analysis tools. We have verified the performance of this pipeline on a number of datasets and extended its scope to include sample screening by the user-free assessment of the qualities of a series of datasets under different conditions. We propose that our workflow provides a decision-free solution for cryo-EM, making data preprocessing more generalized and robust in the high-throughput era as well as more convenient for users from a range of backgrounds.

Advances in methods for atomic resolution macromolecular structure determination

Recent technical advances have dramatically increased the power and scope of structural biology. New developments in high-resolution cryo-electron microscopy, serial X-ray crystallography, and electron diffraction have been especially transformative. Here we highlight some of the latest advances and current challenges at the frontiers of atomic resolution methods for elucidating the structures and dynamical properties of macromolecules and their complexes.

Gum-Net: Unsupervised Geometric Matching for Fast and Accurate 3D Subtomogram Image Alignment and Averaging

We propose a Geometric unsupervised matching Network (Gum-Net) for finding the geometric correspondence between two images with application to 3D subtomogram alignment and averaging. Subtomogram alignment is the most important task in cryo-electron tomography (cryo-ET), a revolutionary 3D imaging technique for visualizing the molecular organization of unperturbed cellular landscapes in single cells. However, subtomogram alignment and averaging are very challenging due to severe imaging limits such as noise and missing wedge effects. We introduce an end-to-end trainable architecture with three novel modules specifically designed for preserving feature spatial information and propagating feature matching information. The training is performed in a fully unsupervised fashion to optimize a matching metric. No ground truth transformation information nor category-level or instance-level matching supervision information is needed. After systematic assessments on six real and nine simulated datasets, we demonstrate that Gum-Net reduced the alignment error by 40 to 50% and improved the averaging resolution by 10%. Gum-Net also achieved 70 to 110 times speedup in practice with GPU acceleration compared to state-of-the-art subtomogram alignment methods. Our work is the first 3D unsupervised geometric matching method for images of strong transformation variation and high noise level. The training code, trained model, and datasets are available in our open-source software AITom.

Data-driven challenges and opportunities in crystallography

Structural biology is in the midst of a revolution fueled by faster and more powerful instruments capable of delivering orders of magnitude more data than their predecessors. This increased pace in data gathering introduces new experimental and computational challenges, frustrating real-time processing and interpretation of data and requiring long-term solutions for data archival and retrieval. This combination of challenges and opportunities is driving the exploration of new areas of structural biology, including studies of macromolecular dynamics and the investigation of molecular ensembles in search of a better understanding of conformational landscapes. The next generation of instruments promises to yield even greater data rates, requiring a concerted effort by institutions, centers and individuals to extract meaning from every bit and make data accessible to the community at large, facilitating data mining efforts by individuals or groups as analysis tools improve.

Software for automated acquisition of electron tomography tilt series

For automated acquisition of tilt series for electron tomography, software needs to handle complications such as movements of the sample in x/y and z, increased projected thickness at high tilt, specimen drift, etc. In addition, many applications require special functionality such as low dose acquisition, automated sequential (batch) tomography, or montage tomography. After reviewing how these difficulties can be addressed and a closer look at what advanced acquisition strategies are employed in biosciences, this chapter introduces acquisition software both developed in academia as well as by hardware vendors. It covers the hardware requirements and compatibility, the functional principle and workflow implemented, as well as what advanced functions are supported by the individual programs.

A collection of yeast cellular electron cryotomography data

BACKGROUND

Cells are powered by a large set of macromolecular complexes, which work together in a crowded environment. The in situ mechanisms of these complexes are unclear because their 3D distribution, organization, and interactions are largely unknown. Electron cryotomography (cryo-ET) can address these knowledge gaps because it produces cryotomograms-3D images that reveal biological structure at ∼4-nm resolution. Cryo-ET uses no fixation, dehydration, staining, or plastic embedment, so cellular features are visualized in a life-like, frozen-hydrated state. To study chromatin and mitotic machinery in situ, we subjected yeast cells to genetic and chemical perturbations, cryosectioned them, and then imaged the cells by cryo-ET.

FINDINGS

Here we share >1,000 cryo-ET raw datasets of cryosectioned budding yeast Saccharomyces cerevisiaecollected as part of previously published studies. These data will be valuable to cell biologists who are interested in the nanoscale organization of yeasts and of eukaryotic cells in general. All the unpublished tilt series and a subset of corresponding cryotomograms have been deposited in the EMPIAR resource for the community to use freely. To improve tilt series discoverability, we have uploaded metadata and preliminary notes to publicly accessible Google Sheets, EMPIAR, and GigaDB.

CONCLUSIONS

Cellular cryo-ET data can be mined to obtain new cell-biological, structural, and 3D statistical insights in situ. These data contain structures not visible in traditional electron-microscopy data. Template matching and subtomogram averaging of known macromolecular complexes can reveal their 3D distributions and low-resolution structures. Furthermore, these data can serve as testbeds for high-throughput image-analysis pipelines, as training sets for feature-recognition software, for feasibility analysis when planning new structural-cell-biology projects, and as practice data for students.

Reducing cryoEM file storage using lossy image formats

Recent advances in instrumentation and software for cryoEM have increased the applicability and utility of this method. High levels of automation and faster data acquisition rates require hard decisions to be made regarding data retention. Here we investigate the efficacy of data compression applied to aligned summed movie files. Surprisingly, these images can be compressed using a standard lossy method that reduces file storage by 90-95% and yet can still be processed to provide sub-2 Å reconstructed maps. We do not advocate this as an archival method, but it may provide a useful means for retaining images as an historical record, especially at large facilities.

ETDB-Caltech: A blockchain-based distributed public database for electron tomography

Three-dimensional electron microscopy techniques like electron tomography provide valuable insights into cellular structures, and present significant challenges for data storage and dissemination. Here we explored a novel method to publicly release more than 11,000 such datasets, more than 30 TB in total, collected by our group. Our method, based on a peer-to-peer file sharing network built around a blockchain ledger, offers a distributed solution to data storage. In addition, we offer a user-friendly browser-based interface, https://etdb.caltech.edu, for anyone interested to explore and download our data. We discuss the relative advantages and disadvantages of this system and provide tools for other groups to mine our data and/or use the same approach to share their own imaging datasets.

APPLE picker: Automatic particle picking, a low-effort cryo-EM framework

Particle picking is a crucial first step in the computational pipeline of single-particle cryo-electron microscopy (cryo-EM). Selecting particles from the micrographs is difficult especially for small particles with low contrast. As high-resolution reconstruction typically requires hundreds of thousands of particles, manually picking that many particles is often too time-consuming. While template-based particle picking is currently a popular approach, it may suffer from introducing manual bias into the selection process. In addition, this approach is still somewhat time-consuming. This paper presents the APPLE (Automatic Particle Picking with Low user Effort) picker, a simple and novel approach for fast, accurate, and template-free particle picking. This approach is evaluated on publicly available datasets containing micrographs of β-galactosidase, T20S proteasome, 70S ribosome and keyhole limpet hemocyanin projections.

Structural biology meets data science: does anything change?

Data science has emerged from the proliferation of digital data, coupled with advances in algorithms, software and hardware (e.g., GPU computing). Innovations in structural biology have been driven by similar factors, spurring us to ask: can these two fields impact one another in deep and hitherto unforeseen ways? We posit that the answer is yes. New biological knowledge lies in the relationships between sequence, structure, function and disease, all of which play out on the stage of evolution, and data science enables us to elucidate these relationships at scale. Here, we consider the above question from the five key pillars of data science: acquisition, engineering, analytics, visualization and policy, with an emphasis on machine learning as the premier analytics approach.

Automated map sharpening by maximization of detail and connectivity

An algorithm for automatic map sharpening is presented that is based on optimization of the detail and connectivity of the sharpened map. The detail in the map is reflected in the surface area of an iso-contour surface that contains a fixed fraction of the volume of the map, where a map with high level of detail has a high surface area. The connectivity of the sharpened map is reflected in the number of connected regions defined by the same iso-contour surfaces, where a map with high connectivity has a small number of connected regions. By combining these two measures in a metric termed the `adjusted surface area', map quality can be evaluated in an automated fashion. This metric was used to choose optimal map-sharpening parameters without reference to a model or other interpretations of the map. Map sharpening by optimization of the adjusted surface area can be carried out for a map as a whole or it can be carried out locally, yielding a locally sharpened map. To evaluate the performance of various approaches, a simple metric based on map-model correlation that can reproduce visual choices of optimally sharpened maps was used. The map-model correlation is calculated using a model with B factors (atomic displacement factors; ADPs) set to zero. This model-based metric was used to evaluate map sharpening and to evaluate map-sharpening approaches, and it was found that optimization of the adjusted surface area can be an effective tool for map sharpening.