1
|
Kusano T, Yatabe K, Oikawa Y. Fringe pattern analysis based on the two-dimensional synchrosqueezing transform. OPTICS LETTERS 2024; 49:4022-4025. [PMID: 39008767 DOI: 10.1364/ol.530258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Accepted: 07/01/2024] [Indexed: 07/17/2024]
Abstract
Windowed Fourier transform (WFT) is used to analyze fringe patterns observed from optical measurements. The space-frequency resolution of the WFT is limited, which affects the analyzing performance. In this Letter, we propose to apply the two-dimensional synchrosqueezing transform (SST) for analyzing fringe patterns. The SST is a technique used to overcome the limitation of the space-frequency resolution of the WFT, which sharpens the WFT representation using the derivative of the WFT phase. Numerical experiments confirm the effectiveness of the SST in denoising the fringe pattern and estimating the local frequency from the observed fringe pattern.
Collapse
|
2
|
Mao H, Zhou W, Gao W, Cao Y, Le Z. High-efficiency static speckle-suppression method based on a combination of beam splitting cavity and liquid-core fiber. OPTICS EXPRESS 2023; 31:36376-36387. [PMID: 38017791 DOI: 10.1364/oe.503830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 10/02/2023] [Indexed: 11/30/2023]
Abstract
Current static speckle suppression methods have an extremely large system size and unsatisfactory performance. This study proposes a device called beam-splitting cavity (BSC) and establishes a model of speckle suppression based on the combination of BSC and a liquid-core fiber. Subsequently, a passive static speckle suppression system is constructed and the key factors affecting the speckle contrast are studied. Consequently, the speckle contrast was reduced from 30.2% to 3.1%, which is below the human-eye speckle-discrimination limit (<4%). The scheme consists entirely of passive optical elements, which are more applicable to projectors than the traditional static and dynamic speckle-suppression methods.
Collapse
|
3
|
Zuo C, Qian J, Feng S, Yin W, Li Y, Fan P, Han J, Qian K, Chen Q. Deep learning in optical metrology: a review. LIGHT, SCIENCE & APPLICATIONS 2022; 11:39. [PMID: 35197457 PMCID: PMC8866517 DOI: 10.1038/s41377-022-00714-x] [Citation(s) in RCA: 71] [Impact Index Per Article: 35.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 01/03/2022] [Accepted: 01/11/2022] [Indexed: 05/20/2023]
Abstract
With the advances in scientific foundations and technological implementations, optical metrology has become versatile problem-solving backbones in manufacturing, fundamental research, and engineering applications, such as quality control, nondestructive testing, experimental mechanics, and biomedicine. In recent years, deep learning, a subfield of machine learning, is emerging as a powerful tool to address problems by learning from data, largely driven by the availability of massive datasets, enhanced computational power, fast data storage, and novel training algorithms for the deep neural network. It is currently promoting increased interests and gaining extensive attention for its utilization in the field of optical metrology. Unlike the traditional "physics-based" approach, deep-learning-enabled optical metrology is a kind of "data-driven" approach, which has already provided numerous alternative solutions to many challenging problems in this field with better performances. In this review, we present an overview of the current status and the latest progress of deep-learning technologies in the field of optical metrology. We first briefly introduce both traditional image-processing algorithms in optical metrology and the basic concepts of deep learning, followed by a comprehensive review of its applications in various optical metrology tasks, such as fringe denoising, phase retrieval, phase unwrapping, subset correlation, and error compensation. The open challenges faced by the current deep-learning approach in optical metrology are then discussed. Finally, the directions for future research are outlined.
Collapse
Grants
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- 61722506, 61705105, 62075096 National Natural Science Foundation of China (National Science Foundation of China)
- National Key R&D Program of China (2017YFF0106403) Leading Technology of Jiangsu Basic Research Plan (BK20192003) National Defense Science and Technology Foundation of China (2019-JCJQ-JJ-381) "333 Engineering" Research Project of Jiangsu Province (BRA2016407) Fundamental Research Funds for the Central Universities (30920032101, 30919011222) Open Research Fund of Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense (3091801410411)
Collapse
Affiliation(s)
- Chao Zuo
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
| | - Jiaming Qian
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Shijie Feng
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Wei Yin
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Yixuan Li
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Pengfei Fan
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
- School of Engineering and Materials Science, Queen Mary University of London, London, E1 4NS, UK
| | - Jing Han
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China
| | - Kemao Qian
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, 639798, Singapore.
| | - Qian Chen
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu Province, China.
| |
Collapse
|
4
|
Wojnowski W, Kalinowska K. Machine Learning and Electronic Noses for Medical Diagnostics. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2023]
|
5
|
Machine Learning and Electronic Noses for Medical Diagnostics. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_329-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
6
|
Bianco V, Memmolo P, Leo M, Montresor S, Distante C, Paturzo M, Picart P, Javidi B, Ferraro P. Strategies for reducing speckle noise in digital holography. LIGHT, SCIENCE & APPLICATIONS 2018; 7:48. [PMID: 30839600 PMCID: PMC6106996 DOI: 10.1038/s41377-018-0050-9] [Citation(s) in RCA: 86] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2017] [Revised: 06/01/2018] [Accepted: 06/05/2018] [Indexed: 05/05/2023]
Abstract
Digital holography (DH) has emerged as one of the most effective coherent imaging technologies. The technological developments of digital sensors and optical elements have made DH the primary approach in several research fields, from quantitative phase imaging to optical metrology and 3D display technologies, to name a few. Like many other digital imaging techniques, DH must cope with the issue of speckle artifacts, due to the coherent nature of the required light sources. Despite the complexity of the recently proposed de-speckling methods, many have not yet attained the required level of effectiveness. That is, a universal denoising strategy for completely suppressing holographic noise has not yet been established. Thus the removal of speckle noise from holographic images represents a bottleneck for the entire optics and photonics scientific community. This review article provides a broad discussion about the noise issue in DH, with the aim of covering the best-performing noise reduction approaches that have been proposed so far. Quantitative comparisons among these approaches will be presented.
Collapse
Affiliation(s)
- Vittorio Bianco
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| | - Pasquale Memmolo
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| | - Marco Leo
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| | - Silvio Montresor
- Université du Maine, CNRS UMR 6613, LAUM, Avenue Olivier Messiaen, 72085 Le Mans Cedex 9, France
| | - Cosimo Distante
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| | - Melania Paturzo
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| | - Pascal Picart
- Université du Maine, CNRS UMR 6613, LAUM, Avenue Olivier Messiaen, 72085 Le Mans Cedex 9, France
| | - Bahram Javidi
- Electrical and Computer Engineering Department, University of Connecticut, U-4157, Storrs, CT 06269 USA
| | - Pietro Ferraro
- CNR-ISASI Istituto di Scienze Applicate e Sistemi Intelligenti “E. Caianiello”, via Campi Flegrei 34, 80078 Pozzuoli (NA), Italy
| |
Collapse
|
7
|
Yatabe K, Tanigawa R, Ishikawa K, Oikawa Y. Time-directional filtering of wrapped phase for observing transient phenomena with parallel phase-shifting interferometry. OPTICS EXPRESS 2018; 26:13705-13720. [PMID: 29877419 DOI: 10.1364/oe.26.013705] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 05/07/2018] [Indexed: 06/08/2023]
Abstract
Recent development of parallel phase-shifting interferometry (PPSI) enables accurate measurement of time-varying phase maps. By combining a high-speed camera with PPSI, it became possible to observe not only time-varying but also fast phenomena including fluid flow and sound in air. In such observation, one has to remove static phase (time-invariant or slowly-varying phase unrelated to the phenomena of interest) from the observed phase maps. Ordinarily, a signal processing method for eliminating the static phase is utilized after phase unwrapping to avoid the 2π discontinuity which can be a source of error. In this paper, it is shown that such phase unwrapping is not necessary for the high-speed observation, and a time-directional filtering method is proposed for removing the static phase directly from the wrapped phase without performing phase unwrapping. In addition, experimental results of simultaneously visualizing flow and sound with 42 000 fps are shown to illustrate how the time-directional filtering changes the appearance. A MATLAB code is included within the paper (also in https://goo.gl/N4wzdp) for aiding the understanding of the proposed method.
Collapse
|
8
|
Montrésor S, Picart P, Karray M. Reference-free metric for quantitative noise appraisal in holographic phase measurements. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2018; 35:A53-A60. [PMID: 29328085 DOI: 10.1364/josaa.35.000a53] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2017] [Accepted: 10/23/2017] [Indexed: 06/07/2023]
Abstract
This paper presents a reference-free metric for quantitative appraisal of de-noising algorithms for phase measurements in digital holography. In the literature, quality metrics are not self-contained because they require a noise-free reference phase fringe pattern in order to be computed. In practical situations, no exact phase is available to evaluate the quality of processing. In order to bypass such limitations, one needs a metric directly capable of providing information on how efficient the filtering is, without any help from any reference measurements and by only considering the measured available phase data. This paper presents a novel reference-free metric, called estimated phase error for quantitative appraisal of de-noising algorithms for noisy phase data processing. This metric is based on the computation of an estimator of the standard deviation of the phase error between data processed with an external algorithm and that from the evaluated algorithm. A benchmark, including 37 different de-noising algorithms, demonstrates that the proposed metric is capable of producing the same rankings as those obtained with classical metrics, requiring a reference phase. Application to phase data from mechanical testing demonstrates that the ranking obtained from experimental phase data is similar to that obtained during the benchmarking with simulated data.
Collapse
|
9
|
Yatabe K, Ishikawa K, Oikawa Y. Simple, flexible, and accurate phase retrieval method for generalized phase-shifting interferometry. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2017; 34:87-96. [PMID: 28059228 DOI: 10.1364/josaa.34.000087] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2016] [Accepted: 11/19/2016] [Indexed: 06/06/2023]
Abstract
This paper presents a non-iterative phase retrieval method from randomly phase-shifted fringe images. By combining the hyperaccurate least squares ellipse fitting method with the subspace method (usually called the principal component analysis), a fast and accurate phase retrieval algorithm is realized. The proposed method is simple, flexible, and accurate. It can be easily coded without iteration, initial guess, or tuning parameter. Its flexibility comes from the fact that totally random phase-shifting steps and any number of fringe images greater than two are acceptable without any specific treatment. Finally, it is accurate because the hyperaccurate least squares method and the modified subspace method enable phase retrieval with a small error as shown by the simulations. A MATLAB code, which is used in the experimental section, is provided within the paper to demonstrate its simplicity and easiness.
Collapse
|
10
|
Yatabe K, Ishikawa K, Oikawa Y. Improving principal component analysis based phase extraction method for phase-shifting interferometry by integrating spatial information. OPTICS EXPRESS 2016; 24:22881-22891. [PMID: 27828355 DOI: 10.1364/oe.24.022881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Phase extraction methods based on the principal component analysis (PCA) can extract objective phase from phase-shifted fringes without any prior knowledge about their shift steps. Although it is fast and easy to implement, many fringe images are needed for extracting the phase accurately from noisy fringes. In this paper, a simple extension of the PCA method for reducing extraction error is proposed. It can effectively reduce influence from random noise, while most of the advantages of the PCA method is inherited because it only modifies the construction process of the data matrix from fringes. Although it takes more time because size of the data matrix to be decomposed is larger, computational time of the proposed method is shown to be reasonably fast by using the iterative singular value decomposition algorithm. Numerical experiments confirmed that the proposed method can reduce extraction error even when the number of interferograms is small.
Collapse
|
11
|
Yatabe K, Ishikawa K, Oikawa Y. Compensation of fringe distortion for phase-shifting three-dimensional shape measurement by inverse map estimation. APPLIED OPTICS 2016; 55:6017-6024. [PMID: 27505383 DOI: 10.1364/ao.55.006017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
For three-dimensional shape measurement, phase-shifting techniques are widely used to recover the objective phase containing height information from images of projected fringes. Although such techniques can provide an accurate result in theory, there might be considerable error in practice. One main cause of such an error is distortion of fringes due to nonlinear responses of a measurement system. In this paper, a postprocessing method for compensating distortion is proposed. Compared to other compensation methods, the proposed method is flexible in two senses: (1) no specific model of nonlinearity (such as the gamma model) is needed, and (2) no special calibration data are needed (only the observed image of the fringe is required). Experiments using simulated and real data confirmed that the proposed method can compensate multiple types of nonlinearity without being concerned about the model.
Collapse
|