1
|
Pregowska A, Roszkiewicz A, Osial M, Giersig M. How scanning probe microscopy can be supported by artificial intelligence and quantum computing? Microsc Res Tech 2024. [PMID: 38864463 DOI: 10.1002/jemt.24629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 05/28/2024] [Accepted: 05/29/2024] [Indexed: 06/13/2024]
Abstract
The impact of Artificial Intelligence (AI) is rapidly expanding, revolutionizing both science and society. It is applied to practically all areas of life, science, and technology, including materials science, which continuously requires novel tools for effective materials characterization. One of the widely used techniques is scanning probe microscopy (SPM). SPM has fundamentally changed materials engineering, biology, and chemistry by providing tools for atomic-precision surface mapping. Despite its many advantages, it also has some drawbacks, such as long scanning times or the possibility of damaging soft-surface materials. In this paper, we focus on the potential for supporting SPM-based measurements, with an emphasis on the application of AI-based algorithms, especially Machine Learning-based algorithms, as well as quantum computing (QC). It has been found that AI can be helpful in automating experimental processes in routine operations, algorithmically searching for optimal sample regions, and elucidating structure-property relationships. Thus, it contributes to increasing the efficiency and accuracy of optical nanoscopy scanning probes. Moreover, the combination of AI-based algorithms and QC may have enormous potential to enhance the practical application of SPM. The limitations of the AI-QC-based approach were also discussed. Finally, we outline a research path for improving AI-QC-powered SPM. RESEARCH HIGHLIGHTS: Artificial intelligence and quantum computing as support for scanning probe microscopy. The analysis indicates a research gap in the field of scanning probe microscopy. The research aims to shed light into ai-qc-powered scanning probe microscopy.
Collapse
Affiliation(s)
- Agnieszka Pregowska
- Department of Information and Computational Science, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland
| | - Agata Roszkiewicz
- Department of Information and Computational Science, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland
| | - Magdalena Osial
- Department of Information and Computational Science, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland
| | - Michael Giersig
- Department of Information and Computational Science, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland
| |
Collapse
|
2
|
Shao L, Ma J, Prelesnik JL, Zhou Y, Nguyen M, Zhao M, Jenekhe SA, Kalinin SV, Ferguson AL, Pfaendtner J, Mundy CJ, De Yoreo JJ, Baneyx F, Chen CL. Hierarchical Materials from High Information Content Macromolecular Building Blocks: Construction, Dynamic Interventions, and Prediction. Chem Rev 2022; 122:17397-17478. [PMID: 36260695 DOI: 10.1021/acs.chemrev.2c00220] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
Hierarchical materials that exhibit order over multiple length scales are ubiquitous in nature. Because hierarchy gives rise to unique properties and functions, many have sought inspiration from nature when designing and fabricating hierarchical matter. More and more, however, nature's own high-information content building blocks, proteins, peptides, and peptidomimetics, are being coopted to build hierarchy because the information that determines structure, function, and interfacial interactions can be readily encoded in these versatile macromolecules. Here, we take stock of recent progress in the rational design and characterization of hierarchical materials produced from high-information content blocks with a focus on stimuli-responsive and "smart" architectures. We also review advances in the use of computational simulations and data-driven predictions to shed light on how the side chain chemistry and conformational flexibility of macromolecular blocks drive the emergence of order and the acquisition of hierarchy and also on how ionic, solvent, and surface effects influence the outcomes of assembly. Continued progress in the above areas will ultimately usher in an era where an understanding of designed interactions, surface effects, and solution conditions can be harnessed to achieve predictive materials synthesis across scale and drive emergent phenomena in the self-assembly and reconfiguration of high-information content building blocks.
Collapse
Affiliation(s)
- Li Shao
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States
| | - Jinrong Ma
- Molecular Engineering and Sciences Institute, University of Washington, Seattle, Washington 98195, United States
| | - Jesse L Prelesnik
- Department of Chemistry, University of Washington, Seattle, Washington 98195, United States
| | - Yicheng Zhou
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States
| | - Mary Nguyen
- Department of Chemical Engineering, University of Washington, Seattle, Washington 98195, United States.,Department of Chemistry, University of Washington, Seattle, Washington 98195, United States
| | - Mingfei Zhao
- Pritzker School of Molecular Engineering, University of Chicago, Chicago, Illinois 60637, United States
| | - Samson A Jenekhe
- Department of Chemical Engineering, University of Washington, Seattle, Washington 98195, United States.,Department of Chemistry, University of Washington, Seattle, Washington 98195, United States
| | - Sergei V Kalinin
- Department of Materials Science and Engineering, University of Tennessee, Knoxville, Tennessee 37996, United States
| | - Andrew L Ferguson
- Pritzker School of Molecular Engineering, University of Chicago, Chicago, Illinois 60637, United States
| | - Jim Pfaendtner
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States.,Materials Science and Engineering, University of Washington, Seattle, Washington 98195, United States
| | - Christopher J Mundy
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States.,Department of Chemical Engineering, University of Washington, Seattle, Washington 98195, United States
| | - James J De Yoreo
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States.,Materials Science and Engineering, University of Washington, Seattle, Washington 98195, United States
| | - François Baneyx
- Molecular Engineering and Sciences Institute, University of Washington, Seattle, Washington 98195, United States.,Department of Chemical Engineering, University of Washington, Seattle, Washington 98195, United States
| | - Chun-Long Chen
- Physical Sciences Division, Pacific Northwest National Laboratory, Richland, Washington 99354, United States.,Department of Chemical Engineering, University of Washington, Seattle, Washington 98195, United States
| |
Collapse
|
3
|
Ziatdinov M, Liu Y, Kelley K, Vasudevan R, Kalinin SV. Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning. ACS NANO 2022; 16:13492-13512. [PMID: 36066996 DOI: 10.1021/acsnano.2c05303] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. The discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.
Collapse
Affiliation(s)
| | | | | | | | - Sergei V Kalinin
- Department of Materials Sciences and Engineering, University of Tennessee, Knoxville, Tennessee 37996, United States
| |
Collapse
|
4
|
Checa M, Millan-Solsona R, Mares AG, Pujals S, Gomila G. Fast Label-Free Nanoscale Composition Mapping of Eukaryotic Cells Via Scanning Dielectric Force Volume Microscopy and Machine Learning. SMALL METHODS 2021; 5:e2100279. [PMID: 34928004 DOI: 10.1002/smtd.202100279] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Revised: 04/28/2021] [Indexed: 06/14/2023]
Abstract
Mapping the biochemical composition of eukaryotic cells without the use of exogenous labels is a long-sought objective in cell biology. Recently, it has been shown that composition maps on dry single bacterial cells with nanoscale spatial resolution can be inferred from quantitative nanoscale dielectric constant maps obtained with the scanning dielectric microscope. Here, it is shown that this approach can also be applied to the much more challenging case of fixed and dry eukaryotic cells, which are highly heterogeneous and show micrometric topographic variations. More importantly, it is demonstrated that the main bottleneck of the technique (the long computation times required to extract the nanoscale dielectric constant maps) can be shortcut by using supervised neural networks, decreasing them from weeks to seconds in a wokstation computer. This easy-to-use data-driven approach opens the door for in situ and on-the-fly label free nanoscale composition mapping of eukaryotic cells with scanning dielectric microscopy.
Collapse
Affiliation(s)
- Martí Checa
- Nanoscale Bioelectrical Characterization Group, Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology (BIST), Carrer Baldiri i Reixac 11-15, Barcelona, 08028, Spain
| | - Ruben Millan-Solsona
- Nanoscale Bioelectrical Characterization Group, Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology (BIST), Carrer Baldiri i Reixac 11-15, Barcelona, 08028, Spain
- Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, Carrer Martí i Franquès 1, Barcelona, 08028, Spain
| | - Adrianna Glinkowska Mares
- Nanoscopy for Nanomedicine Group, Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology (BIST), Carrer Baldiri i Reixac 11-15, Barcelona, 08028, Spain
| | - Silvia Pujals
- Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, Carrer Martí i Franquès 1, Barcelona, 08028, Spain
- Nanoscopy for Nanomedicine Group, Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology (BIST), Carrer Baldiri i Reixac 11-15, Barcelona, 08028, Spain
| | - Gabriel Gomila
- Nanoscale Bioelectrical Characterization Group, Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology (BIST), Carrer Baldiri i Reixac 11-15, Barcelona, 08028, Spain
- Departament d'Enginyeria Electrònica i Biomèdica, Universitat de Barcelona, Carrer Martí i Franquès 1, Barcelona, 08028, Spain
| |
Collapse
|
5
|
Yang G, Li X, Cheng Y, Wang M, Ma D, Sokolov AP, Kalinin SV, Veith GM, Nanda J. Distilling nanoscale heterogeneity of amorphous silicon using tip-enhanced Raman spectroscopy (TERS) via multiresolution manifold learning. Nat Commun 2021; 12:578. [PMID: 33495465 PMCID: PMC7835247 DOI: 10.1038/s41467-020-20691-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Accepted: 12/14/2020] [Indexed: 11/23/2022] Open
Abstract
Accurately identifying the local structural heterogeneity of complex, disordered amorphous materials such as amorphous silicon is crucial for accelerating technology development. However, short-range atomic ordering quantification and nanoscale spatial resolution over a large area on a-Si have remained major challenges and practically unexplored. We resolve phonon vibrational modes of a-Si at a lateral resolution of <60 nm by tip-enhanced Raman spectroscopy. To project the high dimensional TERS imaging to a two-dimensional manifold space and categorize amorphous silicon structure, we developed a multiresolution manifold learning algorithm. It allows for quantifying average Si-Si distortion angle and the strain free energy at nanoscale without a human-specified physical threshold. The multiresolution feature of the multiresolution manifold learning allows for distilling local defects of ultra-low abundance (< 0.3%), presenting a new Raman mode at finer resolution grids. This work promises a general paradigm of resolving nanoscale structural heterogeneity and updating domain knowledge for highly disordered materials.
Collapse
Affiliation(s)
- Guang Yang
- Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA.
| | - Xin Li
- Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA.
- State Key Laboratory of Green Chemical Engineering and Industrial Catalysis, Sinopec Shanghai Research Institute of Petrochemical Technology, 1658 Pudong Beilu, Shanghai, PR, 201208, China.
| | | | - Mingchao Wang
- Department of Materials Science and Engineering, Monash University, Clayton, VIC, 3800, Australia
| | - Dong Ma
- Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Alexei P Sokolov
- Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
- Department of Chemistry, University of Tennessee, Knoxville, TN, 37996, USA
| | | | | | - Jagjit Nanda
- Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA.
| |
Collapse
|
6
|
Jiang C, Li Q, Huang J, Bi S, Ji R, Guo Q. Single-Layer MoS 2 Mechanical Resonant Piezo-Sensors with High Mass Sensitivity. ACS APPLIED MATERIALS & INTERFACES 2020; 12:41991-41998. [PMID: 32812733 DOI: 10.1021/acsami.0c11913] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Thin-film resonators and scanning probe microscopies (SPM) are usually used on low-frequency mechanical systems at the nanoscale or larger. Generally, off-chip approaches are applied to detect mechanical vibrations in these systems, but these methods are not much appropriate for atomic-thin-layer devices with ultrahigh characteristic frequencies and ultrathin thickness. Primarily, those mechanical devices based on atomic-layers provide highly improved properties, which are inapproachable with conventional nanoelectromechanical systems (NEMS). In this report, the assembly and manipulation of single-atomic-layer piezo-resonators as mass sensors with eigen mechanical resonances up to gigahertz are described. The resonators utilize electronic vibration transducers based on piezo-electric polarization charges, allowing direct and optimal atomic-layer sensor exports. This direct detection affords practical applications with the previously inapproachable Q-factor and sensitivity rather than photoelectric conversion. Exploration of a 2406.26 MHz membrane vibration is indicated with a thermo-noise-limited mass resolution of ∼3.0 zg (10-21 g) in room temperature. The fabricated mass sensors are contactless and fast and can afford a method for precision measurements of the ultrasmall mass with two-dimentional materials.
Collapse
Affiliation(s)
- Chengming Jiang
- Key Laboratory for Precision and Non-traditional Machining Technology of the Ministry of Education, Dalian University of Technology, Dalian 116024, China
| | - Qikun Li
- Key Laboratory for Precision and Non-traditional Machining Technology of the Ministry of Education, Dalian University of Technology, Dalian 116024, China
| | - Jijie Huang
- School of Materials Engineering, Purdue University, West Lafayette, Indiana 47907, United States
| | - Sheng Bi
- Key Laboratory for Precision and Non-traditional Machining Technology of the Ministry of Education, Dalian University of Technology, Dalian 116024, China
| | - Ruonan Ji
- Department of Physics, Northwestern Polytechnical University, Xi'an 710072, China
| | - Qinglei Guo
- Department of Material Science and Engineering, Frederick Seitz Material Research Laboratory, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, United States
| |
Collapse
|
7
|
Neumayer SM, Jesse S, Velarde G, Kholkin AL, Kravchenko I, Martin LW, Balke N, Maksymovych P. To switch or not to switch - a machine learning approach for ferroelectricity. NANOSCALE ADVANCES 2020; 2:2063-2072. [PMID: 36132496 PMCID: PMC9419588 DOI: 10.1039/c9na00731h] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Accepted: 04/06/2020] [Indexed: 05/11/2023]
Abstract
With the advent of increasingly elaborate experimental techniques in physics, chemistry and materials sciences, measured data are becoming bigger and more complex. The observables are typically a function of several stimuli resulting in multidimensional data sets spanning a range of experimental parameters. As an example, a common approach to study ferroelectric switching is to observe effects of applied electric field, but switching can also be enacted by pressure and is influenced by strain fields, material composition, temperature, time, etc. Moreover, the parameters are usually interdependent, so that their decoupling toward univariate measurements or analysis may not be straightforward. On the other hand, both explicit and hidden parameters provide an opportunity to gain deeper insight into the measured properties, provided there exists a well-defined path to capture and analyze such data. Here, we introduce a new, two-dimensional approach to represent hysteretic response of a material system to applied electric field. Utilizing ferroelectric polarization as a model hysteretic property, we demonstrate how explicit consideration of electromechanical response to two rather than one control voltages enables significantly more transparent and robust interpretation of observed hysteresis, such as differentiating between charge trapping and ferroelectricity. Furthermore, we demonstrate how the new data representation readily fits into a variety of machine-learning methodologies, from unsupervised classification of the origins of hysteretic response via linear clustering algorithms to neural-network-based inference of the sample temperature based on the specific morphology of hysteresis.
Collapse
Affiliation(s)
- Sabine M Neumayer
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Stephen Jesse
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Gabriel Velarde
- Department of Materials Science and Engineering, University of California Berkeley CA 94720 USA
- Materials Sciences Division, Lawrence Berkeley National Laboratory Berkeley CA 94720 USA
| | - Andrei L Kholkin
- Department of Physics & CICECO - Aveiro Institute of Materials, University of Aveiro Aveiro Portugal
- School of Natural Sciences and Mathematics, Ural Federal University Ekaterinburg Russia
| | - Ivan Kravchenko
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Lane W Martin
- Department of Materials Science and Engineering, University of California Berkeley CA 94720 USA
- Materials Sciences Division, Lawrence Berkeley National Laboratory Berkeley CA 94720 USA
| | - Nina Balke
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| | - Peter Maksymovych
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory Oak Ridge TN 37831 USA
| |
Collapse
|
8
|
Fukuma T, Garcia R. Atomic- and Molecular-Resolution Mapping of Solid-Liquid Interfaces by 3D Atomic Force Microscopy. ACS NANO 2018; 12:11785-11797. [PMID: 30422619 DOI: 10.1021/acsnano.8b07216] [Citation(s) in RCA: 78] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Hydration layers are ubiquitous in life and technology. Hence, interfacial aqueous layers have a central role in a wide range of phenomena from materials science to molecular and cell biology. A complete understanding of those processes requires, among other things, the development of very-sensitive and high-resolution instruments. Three-dimensional atomic force microscopy (3D-AFM) represents the latest and most successful attempt to generate atomically resolved three-dimensional images of solid-liquid interfaces. This review provides an overview of the 3D-AFM operating principles and its underlying physics. We illustrate and explain the capability of the instrument to resolve atomic defects on crystalline surfaces immersed in liquid. We also illustrate some of its applications to imaging the hydration structures on DNA or proteins. In the last section, we discuss some perspectives on emerging applications in materials science and molecular biology.
Collapse
Affiliation(s)
- Takeshi Fukuma
- Nano Life Science Institute (WPI-NanoLSI) , Kanazawa University , Kanazawa 920-1192 , Japan
| | - Ricardo Garcia
- Materials Science Factory , Instituto de Ciencia de Materiales de Madrid (ICMM) , 28049 Madrid , Spain
| |
Collapse
|