Predictability of Localized Plasmonic Responses in Nanoparticle Assemblies

Real-time tracking of structural evolution in 2D MXenes using theory-enhanced machine learning

In situ Electron Energy Loss Spectroscopy (EELS) combined with Transmission Electron Microscopy (TEM) has traditionally been pivotal for understanding how material processing choices affect local structure and composition. However, the ability to monitor and respond to ultrafast transient changes, now achievable with EELS and TEM, necessitates innovative analytical frameworks. Here, we introduce a machine learning (ML) framework tailored for the real-time assessment and characterization of in operando EELS Spectrum Images (EELS-SI). We focus on 2D MXenes as the sample material system, specifically targeting the understanding and control of their atomic-scale structural transformations that critically influence their electronic and optical properties. This approach requires fewer labeled training data points than typical deep learning classification methods. By integrating computationally generated structures of MXenes and experimental datasets into a unified latent space using Variational Autoencoders (VAE) in a unique training method, our framework accurately predicts structural evolutions at latencies pertinent to closed-loop processing within the TEM. This study presents a critical advancement in enabling automated, on-the-fly synthesis and characterization, significantly enhancing capabilities for materials discovery and the precision engineering of functional materials at the atomic scale.

Uniform Gold Nanostructure Formation via Weakly Adsorbed Gold Films and Thermal Annealing for Reliable Localized Surface Plasmon Resonance-Based Detection of DNase-I

Deoxyribonuclease-I (DNase-I), a representative endonuclease, is an important biomarker for the diagnosis of infectious diseases and cancer progression. However, enzymatic activity decreases rapidly ex vivo, which highlights the need for precise on-site detection of DNase-I. Here, a localized surface plasmon resonance (LSPR) biosensor that enables the simple and rapid detection of DNase-I is reported. Moreover, a novel technique named electrochemical deposition and mild thermal annealing (EDMIT) is applied to overcome signal variations. By taking advantage of the low adhesion of gold clusters on indium tin oxide substrates, both the uniformity and sphericity of gold nanoparticles are increased under mild thermal annealing conditions via coalescence and Ostwald ripening. This ultimately results in an approximately 15-fold decrease in LSPR signal variations. The linear range of the fabricated sensor is 20-1000 ng mL-1 with a limit of detection (LOD) of 127.25 pg mL-1 , as demonstrated by spectral absorbance analyses. The fabricated LSPR sensor stably measured DNase-I concentrations from samples collected from both an inflammatory bowel disease (IBD) mouse model, as well as human patients with severe COVID-19 symptoms. Therefore, the proposed LSPR sensor fabricated via the EDMIT method can be used for early diagnosis of other infectious diseases.

Learning and Predicting Photonic Responses of Plasmonic Nanoparticle Assemblies via Dual Variational Autoencoders

The application of machine learning is demonstrated for rapid and accurate extraction of plasmonic particles cluster geometries from hyperspectral image data via a dual variational autoencoder (dual-VAE). In this approach, the information is shared between the latent spaces of two VAEs acting on the particle shape data and spectral data, respectively, but enforcing a common encoding on the shape-spectra pairs. It is shown that this approach can establish the relationship between the geometric characteristics of nanoparticles and their far-field photonic responses, demonstrating that hyperspectral darkfield microscopy can be used to accurately predict the geometry (number of particles, arrangement) of a multiparticle assemblies below the diffraction limit in an automated fashion with high fidelity (for monomers (0.96), dimers (0.86), and trimers (0.58). This approach of building structure-property relationships via shared encoding is universal and should have applications to a broader range of materials science and physics problems in imaging of both molecular and nanomaterial systems.

Automated Experiments of Local Non-Linear Behavior in Ferroelectric Materials

An automated experiment in multimodal imaging to probe structural, chemical, and functional behaviors in complex materials and elucidate the dominant physical mechanisms that control device function is developed and implemented. Here, the emergence of non-linear electromechanical responses in piezoresponse force microscopy (PFM) is explored. Non-linear responses in PFM can originate from multiple mechanisms, including intrinsic material responses often controlled by domain structure, surface topography that affects the mechanical phenomena at the tip-surface junction, and the presence of surface contaminants. Using an automated experiment to probe the origins of non-linear behavior in ferroelectric lead titanate (PTO) and ferroelectric Al_0.93 B_0.07 N films, it is found that PTO shows asymmetric nonlinear behavior across a/c domain walls and a broadened high nonlinear response region around c/c domain walls. In contrast, for Al_0.93 B_0.07 N, well-poled regions show high linear piezoelectric responses, when paired with low non-linear responses regions that are multidomain show low linear responses and high nonlinear responses. It is shown that formulating dissimilar exploration strategies in deep kernel learning as alternative hypotheses allows for establishing the preponderant physical mechanisms behind the non-linear behaviors, suggesting that automated experiments can potentially discern between competing physical mechanisms. This technique can also be extended to electron, probe, and chemical imaging.

Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy

Physics-driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here, this work develops and experimentally implements a deep kernel learning (DKL) workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics-based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization (BO) methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure-property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk- and edge plasmon discovery in MnPS3 , a lesser-known beam-sensitive layered 2D material. This approach is universal, can be directly used as-is with any specimen, and is expected to be applicable to any probe-based microscopic techniques including other STEM modalities, scanning probe microscopies, chemical, and optical imaging.

Automated Experiment in 4D-STEM: Exploring Emergent Physics and Structural Behaviors

Automated experiments in 4D scanning transmission electron microscopy (STEM) are implemented for rapid discovery of local structures, symmetry-breaking distortions, and internal electric and magnetic fields in complex materials. Deep kernel learning enables active learning of the relationship between local structure and 4D-STEM-based descriptors. With this, efficient and "intelligent" probing of dissimilar structural elements to discover desired physical functionality is made possible. This approach allows effective navigation of the sample in an automated fashion guided by either a predetermined physical phenomenon, such as strongest electric field magnitude, or in an exploratory fashion. We verify the approach first on preacquired 4D-STEM data and further implement it experimentally on an operational STEM. The experimental discovery workflow is demonstrated using graphene and subsequently extended toward a lesser-known layered 2D van der Waals material, MnPS₃. This approach establishes a pathway for physics-driven automated 4D-STEM experiments that enable probing the physics of strongly correlated systems and quantum materials and devices, as well as exploration of beam-sensitive materials.

Instantaneous Property Prediction and Inverse Design of Plasmonic Nanostructures Using Machine Learning: Current Applications and Future Directions

Advances in plasmonic materials and devices have given rise to a variety of applications in photocatalysis, microscopy, nanophotonics, and metastructures. With the advent of computing power and artificial neural networks, the characterization and design process of plasmonic nanostructures can be significantly accelerated using machine learning as opposed to conventional FDTD simulations. The machine learning (ML) based methods can not only perform with high accuracy and return optical spectra and optimal design parameters, but also maintain a stable high computing efficiency without being affected by the structural complexity. This work reviews the prominent ML methods involved in forward simulation and inverse design of plasmonic nanomaterials, such as Convolutional Neural Networks, Generative Adversarial Networks, Genetic Algorithms and Encoder-Decoder Networks. Moreover, we acknowledge the current limitations of ML methods in the context of plasmonics and provide perspectives on future research directions.

Sculpting the Plasmonic Responses of Nanoparticles by Directed Electron Beam Irradiation

Spatial confinement of matter in functional nanostructures has propelled these systems to the forefront of nanoscience, both as a playground for exotic physics and quantum phenomena and in multiple applications including plasmonics, optoelectronics, and sensing. In parallel, the emergence of monochromated electron energy loss spectroscopy (EELS) has enabled exploration of local nanoplasmonic functionalities within single nanoparticles and the collective response of nanoparticle assemblies, providing deep insight into associated mechanisms. However, modern synthesis processes for plasmonic nanostructures are often limited in the types of accessible geometry, and materials and are limited to spatial precisions on the order of tens of nm, precluding the direct exploration of critical aspects of the structure-property relationships. Here, the atomic-sized probe of the scanning transmission electron microscope is used to perform precise sculpting and design nanoparticle configurations. Using low-loss EELS, dynamic analyses of the evolution of the plasmonic response are provided. It is shown that within self-assembled systems of nanoparticles, individual nanoparticles can be selectively removed, reshaped, or patterned with nanometer-level resolution, effectively modifying the plasmonic response in both space and energy. This process significantly increases the scope for design possibilities and presents opportunities for unique structure development, which are ultimately the key for nanophotonic design.

Autonomous Experiments in Scanning Probe Microscopy and Spectroscopy: Choosing Where to Explore Polarization Dynamics in Ferroelectrics

Polarization dynamics in ferroelectric materials are explored via automated experiment in piezoresponse force microscopy/spectroscopy (PFM/S). A Bayesian optimization (BO) framework for imaging is developed, and its performance for a variety of acquisition and pathfinding functions is explored using previously acquired data. The optimized algorithm is then deployed on an operational scanning probe microscope (SPM) for finding areas of large electromechanical response in a thin film of PbTiO₃, with results showing that, with just 20% of the area sampled, most high-response clusters were captured. This approach can allow performing more complex spectroscopies in SPM that were previously not possible due to time constraints and sample stability. Improvements to the framework to enable the incorporation of more prior information and improve efficiency further are modeled and discussed.