1
|
Cheng P, Li Y, Lin R, Hu Y, Gao X, Qian J, Sun W, Yuan Q. Adaptive under-sampling strategy for fast imaging in compressive sensing-based atomic force microscopy. Ultramicroscopy 2024; 261:113964. [PMID: 38579523 DOI: 10.1016/j.ultramic.2024.113964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 03/04/2024] [Accepted: 04/01/2024] [Indexed: 04/07/2024]
Abstract
Compressive sensing (CS) can reconstruct the rest information almost without distortion by advanced computational algorithm, which significantly simplifies the process of atomic force microscope (AFM) scanning with high imaging quality. In common CS-AFM, the partial measurements randomly come from the whole region to be measured, which easily leads to detail loss and poor image quality in regions of interest (ROIs). Consequently, important microscopic phenomena are missed probably. In this paper, we developed an adaptive under-sampling strategy for CS-AFM to optimize the process of sampling. Under a certain under-sampling ratio, the weight coefficient of ROIs and regions of base (ROBs) were set to control the distribution of under-sampling points and corresponding measurement matrix. A series of simulations were completed to demonstrate the relationship between the weight coefficient of ROIs and image quality. After that, we verified the effectiveness of the method on our homemade AFM. Through a lot of simulations and experiments, we demonstrated how the proposed method optimized the sampling process of CS-AFM, which speeded up the process of AFM imaging with high quality.
Collapse
Affiliation(s)
- Peng Cheng
- School of Physics, Beihang University, Beijing 100191, China
| | - Yingzi Li
- School of Physics, Beihang University, Beijing 100191, China; Fujian Engineering and Research Center of Green and Environment-Friendly Functional Footwear Materials, College of Chemical Engineering and Materials Science, Quanzhou Normal University, Quanzhou 362000, China.
| | - Rui Lin
- School of Physics, Beihang University, Beijing 100191, China
| | - Yifan Hu
- School of Physics, Beihang University, Beijing 100191, China
| | - Xiaodong Gao
- School of Physics, Beihang University, Beijing 100191, China
| | - Jianqiang Qian
- School of Physics, Beihang University, Beijing 100191, China
| | - Wendong Sun
- School of Physics, Beihang University, Beijing 100191, China
| | - Quan Yuan
- School of Physics, Beihang University, Beijing 100191, China
| |
Collapse
|
2
|
Wang J, Yang F, Wang B, Liu M, Wang X, Wang R, Song G, Wang Z. High-quality AFM image acquisition of living cells by modified residual encoder-decoder network. J Struct Biol 2024; 216:108107. [PMID: 38906499 DOI: 10.1016/j.jsb.2024.108107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Revised: 05/31/2024] [Accepted: 06/17/2024] [Indexed: 06/23/2024]
Abstract
Atomic force microscope enables ultra-precision imaging of living cells. However, atomic force microscope imaging is a complex and time-consuming process. The obtained images of living cells usually have low resolution and are easily influenced by noise leading to unsatisfactory imaging quality, obstructing the research and analysis based on cell images. Herein, an adaptive attention image reconstruction network based on residual encoder-decoder was proposed, through the combination of deep learning technology and atomic force microscope imaging supporting high-quality cell image acquisition. Compared with other learning-based methods, the proposed network showed higher peak signal-to-noise ratio, higher structural similarity and better image reconstruction performances. In addition, the cell images reconstructed by each method were used for cell recognition, and the cell images reconstructed by the proposed network had the highest cell recognition rate. The proposed network has brought insights into the atomic force microscope-based imaging of living cells and cell image reconstruction, which is of great significance in biological and medical research.
Collapse
Affiliation(s)
- Junxi Wang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China; College of Physics, Changchun University of Science and Technology, Changchun 130022, China
| | - Fan Yang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China; College of Physics, Changchun University of Science and Technology, Changchun 130022, China
| | - Bowei Wang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China; College of Physics, Changchun University of Science and Technology, Changchun 130022, China
| | - Mengnan Liu
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China
| | - Xia Wang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China; College of Physics, Changchun University of Science and Technology, Changchun 130022, China
| | - Rui Wang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China
| | - Guicai Song
- College of Physics, Changchun University of Science and Technology, Changchun 130022, China.
| | - Zuobin Wang
- International Research Centre for Nano Handling and Manufacturing of China, Changchun University of Science and Technology, Changchun 130022, China; Centre for Opto/Bio-Nano Measurement and Manufacturing, Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528437, China; Ministry of Education Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Changchun University of Science and Technology, Changchun 130022, China; College of Physics, Changchun University of Science and Technology, Changchun 130022, China; JR3CN & IRAC, University of Bedfordshire, Luton LU1 3JU, UK.
| |
Collapse
|
3
|
Ukraintsev E, Rezek B. Non-contact non-resonant atomic force microscopy method for measurements of highly mobile molecules and nanoparticles. Ultramicroscopy 2023; 253:113816. [PMID: 37531754 DOI: 10.1016/j.ultramic.2023.113816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 04/13/2023] [Accepted: 07/25/2023] [Indexed: 08/04/2023]
Abstract
Atomic force microscopy (AFM) is nowadays indispensable versatile scanning probe method widely employed for fundamental and applied research in physics, chemistry, biology as well as industrial metrology. Conventional AFM systems can operate in various environments such as ultra-high vacuum, electrolyte solutions, or controlled gas atmosphere. Measurements in ambient air are prevalent due to their technical simplicity; however, there are drawbacks such as formation of water meniscus that greatly increases attractive interaction (adhesion) between the tip and the sample, reduced spatial resolution, and too strong interactions leading to tip and/or sample modifications. Here we show how the attractive forces in AFM under ambient conditions can be used with advantage to probe surface properties in a very sensitive way even on highly mobile molecules and nanoparticles. We introduce a stable non-contact non-resonant (NCNR) AFM method which enables to reliably perform measurements in the attractive force regime even in air by controlling the tip position in the intimate surface vicinity without touching it. We demonstrate proof-of-concept results on helicene-based macrocycles, DNA on mica, and nanodiamonds on SiO2. We compare the results with other conventional AFM regimes, showing NCNR advantages such as higher spatial resolution, reduced tip contamination, and negligible sample modification. We analyze principle physical and chemical mechanisms influencing the measurements, discuss issues of stability and various possible method implementations. We explain how the NCNR method can be applied in any AFM system by a mere software modification. The method thus opens a new research field for measurements of highly sensitive and mobile nanoscale objects under air and other environments.
Collapse
Affiliation(s)
- Egor Ukraintsev
- Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Prague 6, 166 27, Czech Republic.
| | - Bohuslav Rezek
- Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Prague 6, 166 27, Czech Republic
| |
Collapse
|
4
|
Li P, Shao Y, Xu K, Liu X. High-speed multiparametric imaging through off-resonance tapping AFM with active probe. Ultramicroscopy 2023; 248:113712. [PMID: 36881947 DOI: 10.1016/j.ultramic.2023.113712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 12/18/2022] [Accepted: 03/02/2023] [Indexed: 03/06/2023]
Abstract
Off-resonance tapping (ORT) mode of atomic force microscopy (AFM), based on force-distance curve, is widely concerned due to its advantages of weak tip-sample interaction and concurrent quantitative property mapping. However, the ORT-AFM still has the disadvantage of slow scan speed caused by low modulation frequency. In this paper, we overcome this disadvantage by introducing active probe method. With active probe, the cantilever was directly actuated with the induced strain after applying voltage in the piezoceramic film. In this way, the modulation frequency could be increased to more than an order of magnitude faster than that of traditional ORT, thus improving the scan rate. We demonstrated high-speed multiparametric imaging with the active probe method in ORT-AFM.
Collapse
Affiliation(s)
- Peng Li
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, P.R. China.
| | - Yongjian Shao
- School of Electrical and Control Engineering, Shenyang Jianzhu University, Shenyang 110168, P.R. China
| | - Ke Xu
- School of Electrical and Control Engineering, Shenyang Jianzhu University, Shenyang 110168, P.R. China
| | - Xiucheng Liu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, P.R. China
| |
Collapse
|
5
|
Kim YJ, Lim J, Kim DN. Accelerating AFM Characterization via Deep-Learning-Based Image Super-Resolution. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2022; 18:e2103779. [PMID: 34837327 DOI: 10.1002/smll.202103779] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 10/15/2021] [Indexed: 06/13/2023]
Abstract
Atomic force microscopy (AFM) is one of the most popular imaging and characterizing methods applicable to a wide range of nanoscale material systems. However, high-resolution imaging using AFM generally suffers from a low scanning yield due to its method of raster scanning. Here, a systematic method of data acquisition and preparation combined with a deep-learning-based image super-resolution, enabling rapid AFM characterization with accuracy, is proposed. Its application to measuring the geometrical and mechanical properties of structured DNA assemblies reveals that around a tenfold reduction in AFM imaging time can be achieved without significant loss of accuracy. Through a transfer learning strategy, it can be efficiently customized for a specific target sample on demand.
Collapse
Affiliation(s)
- Young-Joo Kim
- Institute of Advanced Machines and Design, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea
| | - Jaekyung Lim
- Department of Mechanical Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea
| | - Do-Nyun Kim
- Institute of Advanced Machines and Design, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea
- Department of Mechanical Engineering, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea
- Institute of Engineering Research, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea
| |
Collapse
|
6
|
Han G, Chen Y, Wu T, Li H, Luo J. Adaptive AFM imaging based on object detection using compressive sensing. Micron 2021; 154:103197. [DOI: 10.1016/j.micron.2021.103197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Revised: 12/02/2021] [Accepted: 12/07/2021] [Indexed: 11/26/2022]
|
7
|
Dou Z, Qian J, Li Y, Lin R, Wang J, Cheng P, Xu Z. Reducing molecular simulation time for AFM images based on super-resolution methods. BEILSTEIN JOURNAL OF NANOTECHNOLOGY 2021; 12:775-785. [PMID: 34386314 PMCID: PMC8329368 DOI: 10.3762/bjnano.12.61] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Accepted: 07/12/2021] [Indexed: 06/13/2023]
Abstract
Atomic force microscopy (AFM) has been an important tool for nanoscale imaging and characterization with atomic and subatomic resolution. Theoretical investigations are getting highly important for the interpretation of AFM images. Researchers have used molecular simulation to examine the AFM imaging mechanism. With a recent flurry of researches applying machine learning to AFM, AFM images obtained from molecular simulation have also been used as training data. However, the simulation is incredibly time consuming. In this paper, we apply super-resolution methods, including compressed sensing and deep learning methods, to reconstruct simulated images and to reduce simulation time. Several molecular simulation energy maps under different conditions are presented to demonstrate the performance of reconstruction algorithms. Through the analysis of reconstructed results, we find that both presented algorithms could complete the reconstruction with good quality and greatly reduce simulation time. Moreover, the super-resolution methods can be used to speed up the generation of training data and vary simulation resolution for AFM machine learning.
Collapse
Affiliation(s)
- Zhipeng Dou
- School of Physics, Beihang University, Beijing 100083, China
| | - Jianqiang Qian
- School of Physics, Beihang University, Beijing 100083, China
| | - Yingzi Li
- School of Physics, Beihang University, Beijing 100083, China
| | - Rui Lin
- School of Physics, Beihang University, Beijing 100083, China
| | - Jianhai Wang
- School of Physics, Beihang University, Beijing 100083, China
| | - Peng Cheng
- School of Physics, Beihang University, Beijing 100083, China
| | - Zeyu Xu
- School of Physics, Beihang University, Beijing 100083, China
| |
Collapse
|