A transfer learning approach for improved classification of carbon nanomaterials from TEM images

Expanding the Horizons of Machine Learning in Nanomaterials to Chiral Nanostructures

Machine learning holds significant research potential in the field of nanotechnology, enabling nanomaterial structure and property predictions, facilitating materials design and discovery, and reducing the need for time-consuming and labor-intensive experiments and simulations. In contrast to their achiral counterparts, the application of machine learning for chiral nanomaterials is still in its infancy, with a limited number of publications to date. This is despite the great potential of machine learning to advance the development of new sustainable chiral materials with high values of optical activity, circularly polarized luminescence, and enantioselectivity, as well as for the analysis of structural chirality by electron microscopy. In this review, an analysis of machine learning methods used for studying achiral nanomaterials is provided, subsequently offering guidance on adapting and extending this work to chiral nanomaterials. An overview of chiral nanomaterials within the framework of synthesis-structure-property-application relationships is presented and insights on how to leverage machine learning for the study of these highly complex relationships are provided. Some key recent publications are reviewed and discussed on the application of machine learning for chiral nanomaterials. Finally, the review captures the key achievements, ongoing challenges, and the prospective outlook for this very important research field.

Using pretrained machine learning models to predict luminous and solar transmittance controllability of liquid crystal/polymer composites from microstructural images

Polarized optical microscopy (POM) images of polymer network liquid crystals (PNLCs) were first analyzed using a pretrained machine learning model for feature extraction and hierarchical clustering. The analyses worked well in predicting and improving the thermoresponsive changes individually in direct luminous and hemispheric solar transmittance, both of which are crucial properties of energy-saving smart windows. The features of a 1280 × 1920-pixel color POM image were extracted by the latest pretrained algorithm, EfficientNet-B7, as a 2560-dimensional vector and then reduced into a two-dimensional space for clustering and visualization using the uniform manifold approximation and projection (UMAP) algorithm while efficiently preserving the global structures of the distance relationship in a high-dimensional space. The feature vectors in the UMAP space were correlated with the thermoresponsive transmittance and classified using hierarchical clustering analysis. The extracted features belonging to some clusters were also correlated with the fabrication parameters. The PNLCs here were produced from various raw materials under different fabrication conditions. These analyses and predictability are extensively applied to different PNLCs for stimuli-responsive optical devices, such as solar- and privacy-control windows.

Converting Nanotoxicity Data to Information Using Artificial Intelligence and Simulation

Decades of nanotoxicology research have generated extensive and diverse data sets. However, data is not equal to information. The question is how to extract critical information buried in vast data streams. Here we show that artificial intelligence (AI) and molecular simulation play key roles in transforming nanotoxicity data into critical information, i.e., constructing the quantitative nanostructure (physicochemical properties)-toxicity relationships, and elucidating the toxicity-related molecular mechanisms. For AI and molecular simulation to realize their full impacts in this mission, several obstacles must be overcome. These include the paucity of high-quality nanomaterials (NMs) and standardized nanotoxicity data, the lack of model-friendly databases, the scarcity of specific and universal nanodescriptors, and the inability to simulate NMs at realistic spatial and temporal scales. This review provides a comprehensive and representative, but not exhaustive, summary of the current capability gaps and tools required to fill these formidable gaps. Specifically, we discuss the applications of AI and molecular simulation, which can address the large-scale data challenge for nanotoxicology research. The need for model-friendly nanotoxicity databases, powerful nanodescriptors, new modeling approaches, molecular mechanism analysis, and design of the next-generation NMs are also critically discussed. Finally, we provide a perspective on future trends and challenges.

Machine learning-augmented surface-enhanced spectroscopy toward next-generation molecular diagnostics

The world today is witnessing the significant role and huge demand for molecular detection and screening in healthcare and medical diagnosis, especially during the outbreak of COVID-19. Surface-enhanced spectroscopy techniques, including Surface-Enhanced Raman Scattering (SERS) and Infrared Absorption (SEIRA), provide lattice and molecular vibrational fingerprint information which is directly linked to the molecular constituents, chemical bonds, and configuration. These properties make them an unambiguous, nondestructive, and label-free toolkit for molecular diagnostics and screening. However, new issues in molecular diagnostics, such as increasing molecular species, faster spread of viruses, and higher requirements for detection accuracy and sensitivity, have brought great challenges to detection technology. Advancements in artificial intelligence and machine learning (ML) techniques show promising potential in empowering SERS and SEIRA with rapid analysis and automatic data processing to jointly tackle the challenge. This review introduces the combination of ML and SERS/SEIRA by investigating how ML algorithms can be beneficial to SERS/SEIRA, discussing the general process of combining ML and SEIRA/SERS, highlighting the molecular diagnostics and screening applications based on ML-combined SEIRA/SERS, and providing perspectives on the future development of ML-integrated SEIRA/SERS. In general, this review offers comprehensive knowledge about the recent advances and the future outlook regarding ML-integrated SEIRA/SERS for molecular diagnostics and screening.

Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook

In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.

Data-Driven Materials Innovation and Applications

Owing to the rapid developments to improve the accuracy and efficiency of both experimental and computational investigative methodologies, the massive amounts of data generated have led the field of materials science into the fourth paradigm of data-driven scientific research. This transition requires the development of authoritative and up-to-date frameworks for data-driven approaches for material innovation. A critical discussion on the current advances in the data-driven discovery of materials with a focus on frameworks, machine-learning algorithms, material-specific databases, descriptors, and targeted applications in the field of inorganic materials is presented. Frameworks for rationalizing data-driven material innovation are described, and a critical review of essential subdisciplines is presented, including: i) advanced data-intensive strategies and machine-learning algorithms; ii) material databases and related tools and platforms for data generation and management; iii) commonly used molecular descriptors used in data-driven processes. Furthermore, an in-depth discussion on the broad applications of material innovation, such as energy conversion and storage, environmental decontamination, flexible electronics, optoelectronics, superconductors, metallic glasses, and magnetic materials, is provided. Finally, how these subdisciplines (with insights into the synergy of materials science, computational tools, and mathematics) support data-driven paradigms is outlined, and the opportunities and challenges in data-driven material innovation are highlighted.

Deep learning approach for chemistry and processing history prediction from materials microstructure

Finding the chemical composition and processing history from a microstructure morphology for heterogeneous materials is desired in many applications. While the simulation methods based on physical concepts such as the phase-field method can predict the spatio-temporal evolution of the materials’ microstructure, they are not efficient techniques for predicting processing and chemistry if a specific morphology is desired. In this study, we propose a framework based on a deep learning approach that enables us to predict the chemistry and processing history just by reading the morphological distribution of one element. As a case study, we used a dataset from spinodal decomposition simulation of Fe–Cr–Co alloy created by the phase-field method. The mixed dataset, which includes both images, i.e., the morphology of Fe distribution, and continuous data, i.e., the Fe minimum and maximum concentration in the microstructures, are used as input data, and the spinodal temperature and initial chemical composition are utilized as the output data to train the proposed deep neural network. The proposed convolutional layers were compared with pretrained EfficientNet convolutional layers as transfer learning in microstructure feature extraction. The results show that the trained shallow network is effective for chemistry prediction. However, accurate prediction of processing temperature requires more complex feature extraction from the morphology of the microstructure. We benchmarked the model predictive accuracy for real alloy systems with a Fe–Cr–Co transmission electron microscopy micrograph. The predicted chemistry and heat treatment temperature were in good agreement with the ground truth.

Applications of deep learning in electron microscopy

We review the growing use of machine learning in electron microscopy (EM) driven in part by the availability of fast detectors operating at kiloHertz frame rates leading to large data sets that cannot be processed using manually implemented algorithms. We summarize the various network architectures and error metrics that have been applied to a range of EM-related problems including denoising and inpainting. We then provide a review of the application of these in both physical and life sciences, highlighting how conventional networks and training data have been specifically modified for EM.

Automated identification and quantification of tire wear particles (TWP) in airborne dust: SEM/EDX single particle analysis coupled to a machine learning classifier

The share of non-exhaust particles, including tire wear particles (TWP), within the airborne dust and particularly within PM10 has increased in recent years due to a significant reduction of other particles including exhaust road traffic emissions. However, the quantification of TWP is a demanding task due to the non-specificity of tracers, and the fact that they are commonly contained in analytically challenging low concentrations (e.g. Zn, styrene, 1,3-butadiene, vinylcyclohexene). This difficulty is amplified by the chemical and morpho-textural heterogeneity of TWP resulting from the interaction between the tires and the road surface. In contrast to bulk techniques, automated single particle SEM/EDX analysis can benefit from the ubiquitous heterogeneity of environmental TWP as a diagnostic criterion for their identification and quantification. For this purpose, we follow a machine-learning (ML) approach that makes use of an extensive number (67) of morphological, textural (backscatter-signal based) and chemical descriptors to differentiate environmental particles into the following classes: TWP, metals, minerals and biogenic/organic. We present a ML-based model developed to classify airborne samples (trained by >100,000 environmental particles including 6841 TWP), and its application within a one-year monitoring campaign at two Swiss sites. In this study, the mass concentrations of TWP in the airborne fractions PM80-10, PM10-2.5 and PM2.5-1 were determined. Furthermore, the particle size distribution and shape characteristics of 5621 TWP were evaluated. A cut through a TWP by means of FIB-SEM evidences that the mineral and metal particles typically found in TWP are not only present on the particle surface but also throughout the complete TWP volume. At the urban background site, the annual average mass fraction of TWP and micro-rubber in PM10 was 1.8% (0.28 μg/m³) and 0.9%, respectively. At the urban kerbside site, the corresponding values were 6 times higher amounting to 10.5% (2.24 μg/m³) for TWP, and 5.0% for micro-rubber.

Occupational Exposures to Engineered Nanomaterials: a Review of Workplace Exposure Assessment Methods

PURPOSE OF REVIEW

The purpose of this review is to consolidate exposure assessment methods for occupational research on engineered nanomaterials (ENMs) published within the past 5 years (2015-2020).

RECENT FINDINGS

The three ENMs that generated the highest volume of new research include titanium dioxide, graphene, and aluminum oxide. A multi-metric approach, using both online and offline instruments and analyses, has been found to be a useful method to characterize ENM workplace exposures and was commonly used in the recently published literature. Particle number concentration was the most common online exposure metric used, followed by the metrics of mass and surface area. There are currently no consensus methods for offline analyses of most ENMs. Researchers generally used gravimetric or elemental analyses for carbonaceous nanomaterials, titanium dioxide, and other nanometals, but there was little overlap between other ENM materials reviewed. Using biological markers of exposure, such as urinary oxidative stress biomarkers, as an indication of chronic exposure may also be useful for some ENMs and should be further researched. Generally, similar online instrumentation and offline electron microscopy methods were used for all ENMs. However, this consistency was not observed for offline mass analysis methods within specific ENMs. Consolidation of the most recent methods and results of exposure assessments within this broad material category can guide researchers toward future areas of study. Establishing consensus methods of exposure assessment for each individual ENM is crucial to characterizing workplace exposures, pooling data to fully understand their associated risks, and developing useful occupational exposure limits.