1
|
Liu Y, Roccapriore K, Checa M, Valleti SM, Yang JC, Jesse S, Vasudevan RK. AEcroscopy: A Software-Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation. SMALL METHODS 2024:e2301740. [PMID: 38639016 DOI: 10.1002/smtd.202301740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 03/31/2024] [Indexed: 04/20/2024]
Abstract
Microscopy has been pivotal in improving the understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most characterization labs. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, a coupled software-hardware platform is developed that consists of a software package termed AEcroscopy (short for Automated Experiments in Microscopy), along with a field-programmable-gate-array device with LabView-built customized acquisition scripts, which overcome these limitations and provide the necessary abstractions toward full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine-learning libraries and simulations, to provide automated decision-making and active theory-experiment optimization to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.
Collapse
Affiliation(s)
- Yongtao Liu
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Kevin Roccapriore
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Marti Checa
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Sai Mani Valleti
- Bredesen Center for Interdisciplinary Research, University of Tennessee, Knoxville, TN, 37996, USA
| | - Jan-Chi Yang
- Department of Physics, National Cheng Kung University, Tainan, 70101, Taiwan
| | - Stephen Jesse
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| | - Rama K Vasudevan
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
| |
Collapse
|
2
|
Liu Y, Liu X, Su A, Gong C, Chen S, Xia L, Zhang C, Tao X, Li Y, Li Y, Sun T, Bu M, Shao W, Zhao J, Li X, Peng Y, Guo P, Han Y, Zhu Y. Revolutionizing the structural design and determination of covalent-organic frameworks: principles, methods, and techniques. Chem Soc Rev 2024; 53:502-544. [PMID: 38099340 DOI: 10.1039/d3cs00287j] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
Covalent organic frameworks (COFs) represent an important class of crystalline porous materials with designable structures and functions. The interconnected organic monomers, featuring pre-designed symmetries and connectivities, dictate the structures of COFs, endowing them with high thermal and chemical stability, large surface area, and tunable micropores. Furthermore, by utilizing pre-functionalization or post-synthetic functionalization strategies, COFs can acquire multifunctionalities, leading to their versatile applications in gas separation/storage, catalysis, and optoelectronic devices. Our review provides a comprehensive account of the latest advancements in the principles, methods, and techniques for structural design and determination of COFs. These cutting-edge approaches enable the rational design and precise elucidation of COF structures, addressing fundamental physicochemical challenges associated with host-guest interactions, topological transformations, network interpenetration, and defect-mediated catalysis.
Collapse
Affiliation(s)
- Yikuan Liu
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Xiaona Liu
- National Engineering Research Center of Lower-Carbon Catalysis Technology, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian 116023, China.
| | - An Su
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Chengtao Gong
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Shenwei Chen
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Liwei Xia
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Chengwei Zhang
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Xiaohuan Tao
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Yue Li
- Institute of Intelligent Computing, Zhejiang Lab, Hangzhou 311121, China
| | - Yonghe Li
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Tulai Sun
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Mengru Bu
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Wei Shao
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Jia Zhao
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Xiaonian Li
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Yongwu Peng
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| | - Peng Guo
- National Engineering Research Center of Lower-Carbon Catalysis Technology, Dalian Institute of Chemical Physics, Chinese Academy of Sciences, Dalian 116023, China.
- University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Yu Han
- School of Emergent Soft Matter, South China University of Technology, Guangzhou, China.
- King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Saudi Arabia.
| | - Yihan Zhu
- Center for Electron Microscopy, Institute for Frontier and Interdisciplinary Sciences, State Key Laboratory Breeding Base of Green Chemistry Synthesis Technology, College of Materials Science and Engineering and College of Chemical Engineering, Zhejiang University of Technology, Hangzhou 310014, Zhejiang, China.
| |
Collapse
|
3
|
Liu Y, Ziatdinov MA, Vasudevan RK, Kalinin SV. Explainability and human intervention in autonomous scanning probe microscopy. PATTERNS (NEW YORK, N.Y.) 2023; 4:100858. [PMID: 38035198 PMCID: PMC10682748 DOI: 10.1016/j.patter.2023.100858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2023] [Revised: 07/26/2023] [Accepted: 09/15/2023] [Indexed: 12/02/2023]
Abstract
The broad adoption of machine learning (ML)-based autonomous experiments (AEs) in material characterization and synthesis requires strategies development for understanding and intervention in the experimental workflow. Here, we introduce and realize a post-experimental analysis strategy for deep kernel learning-based autonomous scanning probe microscopy. This approach yields real-time and post-experimental indicators for the progression of an active learning process interacting with an experimental system. We further illustrate how this approach can be applied to human-in-the-loop AEs, where human operators make high-level decisions at high latencies setting the policies for AEs, and the ML algorithm performs low-level, fast decisions. The proposed approach is universal and can be extended to other techniques and applications such as combinatorial library analysis.
Collapse
Affiliation(s)
- Yongtao Liu
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN 37830, USA
| | - Maxim A. Ziatdinov
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN 37830, USA
- Computational Sciences and Engineering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37830, USA
| | - Rama K. Vasudevan
- Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN 37830, USA
| | - Sergei V. Kalinin
- Department of Materials Science and Engineering, University of Tennessee, Knoxville, TN 37996, USA
| |
Collapse
|