Knowledge Extraction from Atomically Resolved Images

Hierarchical Materials from High Information Content Macromolecular Building Blocks: Construction, Dynamic Interventions, and Prediction

Hierarchical materials that exhibit order over multiple length scales are ubiquitous in nature. Because hierarchy gives rise to unique properties and functions, many have sought inspiration from nature when designing and fabricating hierarchical matter. More and more, however, nature's own high-information content building blocks, proteins, peptides, and peptidomimetics, are being coopted to build hierarchy because the information that determines structure, function, and interfacial interactions can be readily encoded in these versatile macromolecules. Here, we take stock of recent progress in the rational design and characterization of hierarchical materials produced from high-information content blocks with a focus on stimuli-responsive and "smart" architectures. We also review advances in the use of computational simulations and data-driven predictions to shed light on how the side chain chemistry and conformational flexibility of macromolecular blocks drive the emergence of order and the acquisition of hierarchy and also on how ionic, solvent, and surface effects influence the outcomes of assembly. Continued progress in the above areas will ultimately usher in an era where an understanding of designed interactions, surface effects, and solution conditions can be harnessed to achieve predictive materials synthesis across scale and drive emergent phenomena in the self-assembly and reconfiguration of high-information content building blocks.

Hypothesis Learning in Automated Experiment: Application to Combinatorial Materials Libraries

Machine learning is rapidly becoming an integral part of experimental physical discovery via automated and high-throughput synthesis, and active experiments in scattering and electron/probe microscopy. This, in turn, necessitates the development of active learning methods capable of exploring relevant parameter spaces with the smallest number of steps. Here, an active learning approach based on conavigation of the hypothesis and experimental spaces is introduced. This is realized by combining the structured Gaussian processes containing probabilistic models of the possible system's behaviors (hypotheses) with reinforcement learning policy refinement (discovery). This approach closely resembles classical human-driven physical discovery, when several alternative hypotheses realized via models with adjustable parameters are tested during an experiment. This approach is demonstrated for exploring concentration-induced phase transitions in combinatorial libraries of Sm-doped BiFeO₃ using piezoresponse force microscopy, but it is straightforward to extend it to higher-dimensional parameter spaces and more complex physical problems once the experimental workflow and hypothesis generation are available.

Bayesian Learning of Adatom Interactions from Atomically Resolved Imaging Data

Atomic structures and adatom geometries of surfaces encode information about the thermodynamics and kinetics of the processes that lead to their formation, and which can be captured by a generative physical model. Here we develop a workflow based on a machine-learning-based analysis of scanning tunneling microscopy images to reconstruct the atomic and adatom positions, and a Bayesian optimization procedure to minimize statistical distance between the chosen physical models and experimental observations. We optimize the parameters of a 2- and 3-parameter Ising model describing surface ordering and use the derived generative model to make predictions across the parameter space. For concentration dependence, we compare the predicted morphologies at different adatom concentrations with the dissimilar regions on the sample surfaces that serendipitously had different adatom concentrations. The proposed workflow can be used to reconstruct the thermodynamic models and associated uncertainties from the experimental observations of materials microstructures. The code used in the manuscript is available at https://github.com/saimani5/Adatom_interactions.

ImageDataExtractor: A Tool To Extract and Quantify Data from Microscopy Images

The rise of data science is leading to new paradigms in data-driven materials discovery. This carries an essential notion that large data sources containing chemical structure and property information can be mined in a fashion that detects and exploits structure-property relationships, such that chemicals can be predicted to suit a given material application. The success of material predictions is predicated on these large data sources of chemical structure and property information being suited to a target application. Microscopy is commonly used to characterize chemical structure, especially in fields such as nanotechnology where material properties are highly dependent on the size and shape of nanoparticles. Large data sources of nanoparticle information stemming from microscopy images would thus be highly beneficial. Millions of microscopy images exist, but they lie fragmented across the literature, typically presented individually within a paper article and usually in a qualitative fashion therein, even though they harbor a wealth of numeric information. We present the ImageDataExtractor toolkit that autoidentifies and autoextracts microscopy images from scientific documents, whereupon it autonomously analyzes each image to produce quantitative particle size and shape information about its subject material. Each image is quantified by decoding its scale bar information using optical character recognition, with help from super-resolution convolutional neural networks where required. Individual particles are detected and profiled using various thresholding, segmentation, polygon fitting, and edge correction routines. The high-throughput operational capability of ImageDataExtractor means that it can be used to generate large-data sources of particle information for data-driven materials discovery. Evaluation metrics, precision and recall, are greater than 80% for the majority of the image processing steps, and precision is above 80% for all critical steps. The ImageDataExtractor tool is released under the MIT license and is available to download from http://www.imagedataextractor.org.

Toward Electrochemical Studies on the Nanometer and Atomic Scales: Progress, Challenges, and Opportunities

Electrochemical reactions and ionic transport underpin the operation of a broad range of devices and applications, from energy storage and conversion to information technologies, as well as biochemical processes, artificial muscles, and soft actuators. Understanding the mechanisms governing function of these applications requires probing local electrochemical phenomena on the relevant time and length scales. Here, we discuss the challenges and opportunities for extending electrochemical characterization probes to the nanometer and ultimately atomic scales, including challenges in down-scaling classical methods, the emergence of novel probes enabled by nanotechnology and based on emergent physics and chemistry of nanoscale systems, and the integration of local data into macroscopic models. Scanning probe microscopy (SPM) methods based on strain detection, potential detection, and hysteretic current measurements are discussed. We further compare SPM to electron beam probes and discuss the applicability of electron beam methods to probe local electrochemical behavior on the mesoscopic and atomic levels. Similar to a SPM tip, the electron beam can be used both for observing behavior and as an active electrode to induce reactions. We briefly discuss new challenges and opportunities for conducting fundamental scientific studies, matter patterning, and atomic manipulation arising in this context.

Learning from Imperfections: Predicting Structure and Thermodynamics from Atomic Imaging of Fluctuations

In materials characterization, traditionally a single experimental sample is used to derive information about a single point in the composition space, while the imperfections, impurities, and stochastic details of material structure are deemed irrelevant or complicating factors in the analysis. Here we demonstrate that atomic-scale studies of a single nominal composition can provide information about microstructures and thermodynamic response over a finite area of chemical space. Using the principles of statistical inference, we develop a framework for incorporating structural fluctuations into statistical mechanical models and use it to solve the inverse problem of deriving effective interatomic interactions responsible for elemental segregation in a La_5/8Ca_3/8MnO₃ thin film. The results are further analyzed by a variational autoencoder to detect anomalous behavior in the composition phase diagram. This study provides a framework for creating generative models from a combination of multiple experimental data and provides direct insight into the driving forces for cation segregation in manganites.

Materials Science in the AI age: high-throughput library generation, machine learning and a pathway from correlations to the underpinning physics

The use of advanced data analytics and applications of statistical and machine learning approaches ('AI') to materials science is experiencing explosive growth recently. In this prospective, we review recent work focusing on generation and application of libraries from both experiment and theoretical tools, across length scales. The available library data both enables classical correlative machine learning, and also opens the pathway for exploration of underlying causative physical behaviors. We highlight the key advances facilitated by this approach, and illustrate how modeling, macroscopic experiments and atomic-scale imaging can be combined to dramatically accelerate understanding and development of new material systems via a statistical physics framework. These developments point towards a data driven future wherein knowledge can be aggregated and used collectively, accelerating the advancement of materials science.