1
|
Guo R, Lu S, Zhang M, Li Z, Li D, Wang F, Hu X, Wu S. One step accurate phase demodulation from a closed fringe pattern with the convolutional neural network HRUnet. APPLIED OPTICS 2024; 63:B59-B69. [PMID: 38437256 DOI: 10.1364/ao.506877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 11/24/2023] [Indexed: 03/06/2024]
Abstract
Retrieving a phase map from a single closed fringe pattern is a challenging task in optical interferometry. In this paper, a convolutional neural network (CNN), HRUnet, is proposed to demodulate phase from a closed fringe pattern. The HRUnet, derived from the Unet model, adopts a high resolution network (HRnet) module to extract high resolution feature maps of the data and employs residual blocks to erase the gradient vanishing in the network. With the trained network, the unwrapped phase map can be directly obtained by feeding a scaled fringe pattern. The high accuracy of the phase map obtained from HRUnet is demonstrated by demodulation of both simulated data and actual fringe patterns. Compared results between HRUnet and two other CNNS are also provided, and the results proved that the performance of HRUnet in accuracy is superior to the two other counterparts.
Collapse
|
2
|
Sharma S, Kulkarni R. Fringe pattern demodulation using Zernike polynomials and a l1-norm regularized extended Kalman filter. APPLIED OPTICS 2022; 61:5517-5523. [PMID: 36256121 DOI: 10.1364/ao.459160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 06/07/2022] [Indexed: 06/16/2023]
Abstract
A novel algorithm for closed fringe demodulation for an absolute phase estimation, to the best of our knowledge, is proposed. The two-dimensional phase is represented as a weighted linear combination of a certain number of Zernike polynomials (ZPs). Essentially, the problem of phase estimation is converted into the estimation of ZP coefficients. The task of ZP coefficient estimation is performed based on a state space model. Due to the nonlinear dependence of the fringe intensity measurement model on the ZP coefficients, the extended Kalman filter (EKF) is used for the state estimation. A pseudo-measurement model is considered based on the state vector sparsity constraint to improve the convergence performance of the EKF. Simulation and experimental results are provided to demonstrate the noise robustness and the practical applicability of the proposed method.
Collapse
|
3
|
Briñez-de León JC, Rico-García M, Restrepo-Martínez A. PhotoelastNet: a deep convolutional neural network for evaluating the stress field by using a single color photoelasticity image. APPLIED OPTICS 2022; 61:D50-D62. [PMID: 35297828 DOI: 10.1364/ao.444563] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 01/12/2022] [Indexed: 06/14/2023]
Abstract
Quantifying the stress field induced into a piece when it is loaded is important for engineering areas since it allows the possibility to characterize mechanical behaviors and fails caused by stress. For this task, digital photoelasticity has been highlighted by its visual capability of representing the stress information through images with isochromatic fringe patterns. Unfortunately, demodulating such fringes remains a complicated process that, in some cases, depends on several acquisitions, e.g., pixel-by-pixel comparisons, dynamic conditions of load applications, inconsistence corrections, dependence of users, fringe unwrapping processes, etc. Under these drawbacks and taking advantage of the power results reported on deep learning, such as the fringe unwrapping process, this paper develops a deep convolutional neural network for recovering the stress field wrapped into color fringe patterns acquired through digital photoelasticity studies. Our model relies on an untrained convolutional neural network to accurately demodulate the stress maps by inputting only one single photoelasticity image. We demonstrate that the proposed method faithfully recovers the stress field of complex fringe distributions on simulated images with an averaged performance of 92.41% according to the SSIM metric. With this, experimental cases of a disk and ring under compression were evaluated, achieving an averaged performance of 85% in the SSIM metric. These results, on the one hand, are in concordance with new tendencies in the optic community to deal with complicated problems through machine-learning strategies; on the other hand, it creates a new perspective in digital photoelasticity toward demodulating the stress field for a wider quantity of fringe distributions by requiring one single acquisition.
Collapse
|
4
|
Zuo C, Qian J, Feng S, Yin W, Li Y, Fan P, Han J, Qian K, Chen Q. Deep learning in optical metrology: a review. LIGHT, SCIENCE & APPLICATIONS 2022; 11:39. [PMID: 35197457 PMCID: PMC8866517 DOI: 10.1038/s41377-022-00714-x] [Citation(s) in RCA: 71] [Impact Index Per Article: 35.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 01/03/2022] [Accepted: 01/11/2022] [Indexed: 05/20/2023]
Abstract
With the advances in scientific foundations and technological implementations, optical metrology has become versatile problem-solving backbones in manufacturing, fundamental research, and engineering applications, such as quality control, nondestructive testing, experimental mechanics, and biomedicine. In recent years, deep learning, a subfield of machine learning, is emerging as a powerful tool to address problems by learning from data, largely driven by the availability of massive datasets, enhanced computational power, fast data storage, and novel training algorithms for the deep neural network. It is currently promoting increased interests and gaining extensive attention for its utilization in the field of optical metrology. Unlike the traditional "physics-based" approach, deep-learning-enabled optical metrology is a kind of "data-driven" approach, which has already provided numerous alternative solutions to many challenging problems in this field with better performances. In this review, we present an overview of the current status and the latest progress of deep-learning technologies in the field of optical metrology. We first briefly introduce both traditional image-processing algorithms in optical metrology and the basic concepts of deep learning, followed by a comprehensive review of its applications in various optical metrology tasks, such as fringe denoising, phase retrieval, phase unwrapping, subset correlation, and error compensation. The open challenges faced by the current deep-learning approach in optical metrology are then discussed. Finally, the directions for future research are outlined.
Collapse
Grants
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- National Key R&D Program of China (2017YFF0106403) Leading Technology of Jiangsu Basic Research Plan (BK20192003) National Defense Science and Technology Foundation of China (2019-JCJQ-JJ-381) "333 Engineering" Research Project of Jiangsu Province (BRA2016407) Fundamental Research Funds for the Central Universities (30920032101, 30919011222) Open Research Fund of Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense (3091801410411)
Collapse
Affiliation(s)
- Chao Zuo
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
| | - Jiaming Qian
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Shijie Feng
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Wei Yin
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Yixuan Li
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Pengfei Fan
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- School of Engineering and Materials Science, Queen Mary University of London, London, E1 4NS, UK
| | - Jing Han
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Kemao Qian
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, 639798, Singapore.
| | - Qian Chen
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
| |
Collapse
|
5
|
Zhao Z, Li B, Lu J, Kang X, Liu T. One-shot phase retrieval method for interferometry using a hypercolumns convolutional neural network. OPTICS EXPRESS 2021; 29:16406-16421. [PMID: 34154204 DOI: 10.1364/oe.410723] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Accepted: 01/25/2021] [Indexed: 06/13/2023]
Abstract
In three dimensional profilometry, phase retrieval technique plays a key role in signal processing stage. Fringe images need to be transformed into phase information to obtain the measurement result. In this paper, a new phase retrieval method based on deep learning technique is proposed for interferometry. Different from conventional multi-step phase shift methods, phase information can be extracted from only a single frame of an interferogram by this method. Here, the phase retrieval task is regarded as a regression problem and a hypercolumns convolutional neural network is constructed to solve it. Firstly, functions and each component of the network model are introduced in details; Then, four different mathematical functions are adopted to generate the training dataset; training and validation strategies are also designed subsequently; Finally, optimization processing is performed to eliminate local data defects in initial results with the help of polynomial fitting. In addition, hardware platform based on point diffraction interferometer is fabricated to support this method. Concluded from the experiment section, the proposed method possesses a desirable performance in terms of phase retrieval, denoising and time efficiency.
Collapse
|
6
|
Yuan S, Hu Y, Hao Q, Zhang S. High-accuracy phase demodulation method compatible to closed fringes in a single-frame interferogram based on deep learning. OPTICS EXPRESS 2021; 29:2538-2554. [PMID: 33726447 DOI: 10.1364/oe.413385] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 01/02/2021] [Indexed: 06/12/2023]
Abstract
Interferogram demodulation is a fundamental problem in optical interferometry. It is still challenging to obtain high-accuracy phases from a single-frame interferogram that contains closed fringes. In this paper, we propose a neural network architecture for single-frame interferogram demodulation. Furthermore, instead of using real experimental data, an interferogram generation model is constructed to generate the dataset for the network's training. A four-stage training strategy adopting appropriate optimizers and loss functions is developed to guarantee the high-accuracy training of the network. The experimental results indicate that the proposed method can achieve a phase demodulation accuracy of 0.01 λ (root mean square error) for actual interferograms containing closed fringes.
Collapse
|
7
|
Li Z, Li X, Liang R. Random two-frame interferometry based on deep learning. OPTICS EXPRESS 2020; 28:24747-24760. [PMID: 32907008 PMCID: PMC7470676 DOI: 10.1364/oe.397904] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 07/29/2020] [Accepted: 07/29/2020] [Indexed: 05/29/2023]
Abstract
A two-frame phase-shifting interferometric wavefront reconstruction method based on deep learning is proposed. By learning from a large number of simulation data based on a physical model, the wrapped phase can be calculated accurately from two interferograms with an unknown phase step. The phase step can be any value excluding the integral multiples of π and the size of interferograms can be flexible. This method does not need a pre-filtering to subtract the direct-current term, but only needs a simple normalization. Comparing with other two-frame methods in both simulations and experiments, the proposed method can achieve better performance.
Collapse
Affiliation(s)
- Ziqiang Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- College of Optical Sciences, University of Arizona, Tucson, Arizona 85721, USA
| | - Xinyang Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
| | - Rongguang Liang
- College of Optical Sciences, University of Arizona, Tucson, Arizona 85721, USA
| |
Collapse
|