Deep-Learning Pipeline for Statistical Quantification of Amorphous Two-Dimensional Materials

Quantitative Three-Dimensional Imaging Analysis of HfO2 Nanoparticles in Single Cells via Deep Learning Aided X-ray Nano-Computed Tomography

It is crucial for understanding mechanisms of drug action to quantify the three-dimensional (3D) drug distribution within a single cell at nanoscale resolution. Yet it remains a great challenge due to limited lateral resolution, detection sensitivities, and reconstruction problems. The preferable method is using X-ray nano-computed tomography (Nano-CT) to observe and analyze drug distribution within cells, but it is time-consuming, requiring specialized expertise, and often subjective, particularly with ultrasmall metal nanoparticles (NPs). Furthermore, the accuracy of batch data analysis through conventional processing methods remains uncertain. In this study, we used radioenhancer ultrasmall HfO2 nanoparticles as a model to develop a modular and automated deep learning aided Nano-CT method for the localization quantitative analysis of ultrasmall metal NPs uptake in cancer cells. We have established an ultrasmall objects segmentation method for 3D Nano-CT images in single cells, which can highly sensitively analyze minute NPs and even ultrasmall NPs in single cells. We also constructed a localization quantitative analysis method, which may accurately segment the intracellularly bioavailable particles from those of the extracellular space and intracellular components and NPs. The high bioavailability of HfO2 NPs in tumor cells from deeper penetration in tumor tissue and higher tumor intracellular uptake provide mechanistic insight into HfO2 NPs as advanced radioenhancers in the combination of quantitative subcellular image analysis with the therapeutic effects of NPs on 3D tumor spheroids and breast cancer. Our findings unveil the substantial uptake rate and subcellular quantification of HfO2 NPs by the human breast cancer cell line (MCF-7). This revelation explicates the notable efficacy and safety profile of HfO2 NPs in tumor treatment. These findings demonstrate that this 3D imaging technique promoted by the deep learning algorithm has the potential to provide localization quantitative information about the 3D distributions of specific molecules at the nanoscale level. This study provides an approach for exploring the subcellular quantitative analysis of NPs in single cells, offering a valuable quantitative imaging tool for minute amounts or ultrasmall NPs.

Holistic Prediction of AuNP Aggregation in Diverse Aqueous Suspensions Based on Machine Vision and Dark-Field Scattering Imaging

The localized surface-plasmon resonance of the AuNP in aqueous media is extremely sensitive to environmental changes. By measuring the signal of plasmon scattering light, the dark-field microscopic (DFM) imaging technique has been used to monitor the aggregation of AuNPs, which has attracted great attention because of its simplicity, low cost, high sensitivity, and universal applicability. However, it is still challenging to interpret DFM images of AuNP aggregation due to the heterogeneous characteristics of the isolated and discontinuous color distribution. Herein, we introduce machine vision algorithms for the training of DFM images of AuNPs in different saline aqueous media. A visual deep learning framework based on AlexNet is constructed for studying the aggregation patterns of AuNPs in aqueous suspensions, which allows for rapid and accurate identification of the aggregation extent of AuNPs, with a prediction accuracy higher than 0.96. With the aid of machine learning analysis, we further demonstrate the prediction ability of various aggregation phenomena induced by both cation species and the concentration of the external saline solution. Our results suggest the great potential of machine vision frameworks in the accurate recognition of subtle pattern changes in DFM images, which can help researchers build predictive analytics based on DFM imaging data.

Deep learning analysis on transmission electron microscope imaging of atomic defects in two-dimensional materials

Defects are prevalent in two-dimensional (2D) materials due to thermal equilibrium and processing kinetics. The presence of various defect types can affect material properties significantly. With the development of the advanced transmission electron microscopy (TEM), the property-related structures could be investigated in multiple dimensions. It produces TEM datasets containing a large amount of information. Traditional data analysis is influenced by the subjectivity of researchers, and manual analysis is inefficient and imprecise. Recent developments in deep learning provide robust methods for the quantitative identification of defects in 2D materials efficiently and precisely. Taking advantage of big data, it breaks the limitations of TEM as a local characterization tool, making TEM an intelligent macroscopic analysis method. In this review, the recent developments in the TEM data analysis of defects in 2D materials using deep learning technology are summarized. Initially, an in-depth examination of the distinctions between TEM and natural images is presented. Subsequently, a comprehensive exploration of TEM data analysis ensues, encompassing denoising, point defects, line defects, planar defects, quantitative analysis, and applications. Furthermore, an exhaustive assessment of the significant obstacles encountered in the accurate identification of distinct structures is also provided.