1
|
Buitrago-Duque C, Tobón-Maya H, Gómez-Ramírez A, Zapata-Valencia SI, Lopera MJ, Trujillo C, Garcia-Sucerquia J. Open-access database for digital lensless holographic microscopy and its application on the improvement of deep-learning-based autofocusing models. APPLIED OPTICS 2024; 63:B49-B58. [PMID: 38437255 DOI: 10.1364/ao.507412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 11/22/2023] [Indexed: 03/06/2024]
Abstract
Among modern optical microscopy techniques, digital lensless holographic microscopy (DLHM) is one of the simplest label-free coherent imaging approaches. However, the hardware simplicity provided by the lensless configuration is often offset by the demanding computational postprocessing required to match the retrieved sample information to the user's expectations. A promising avenue to simplify this stage is the integration of artificial intelligence and machine learning (ML) solutions into the DLHM workflow. The biggest challenge to do so is the preparation of an extensive and high-quality experimental dataset of curated DLHM recordings to train ML models. In this work, a diverse, open-access dataset of DLHM recordings is presented as support for future research, contributing to the data needs of the applied research community. The database comprises 11,760 experimental DLHM holograms of bio and non-bio samples with diversity on the main recording parameters of the DLHM architecture. The database is divided into two datasets of 10 independent imaged samples. The first group, named multi-wavelength dataset, includes 8160 holograms and was recorded using laser diodes emitting at 654 nm, 510 nm, and 405 nm; the second group, named single-wavelength dataset, is composed of 3600 recordings and was acquired using a 633 nm He-Ne laser. All the experimental parameters related to the dataset acquisition, preparation, and calibration are described in this paper. The advantages of this large dataset are validated by re-training an existing autofocusing model for DLHM and as the training set for a simpler architecture that achieves comparable performance, proving its feasibility for improving existing ML-based models and the development of new ones.
Collapse
|
2
|
Zhong Z, Song D, Liu L, Chen X, Shan M. Dual-wavelength off-axis digital holography in ImageJ: toward real-time phase retrieval using CUDA streams. APPLIED OPTICS 2023; 62:5868-5874. [PMID: 37706936 DOI: 10.1364/ao.493456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 07/05/2023] [Indexed: 09/15/2023]
Abstract
An ImageJ plug-in is developed to realize automatic real-time phase reconstruction for dual-wavelength digital holography (DH). This plug-in assembles the algorithms, including automatic phase reconstruction based on the division algorithm and post-processing. These algorithms are implemented and analyzed using a CPU and GPU, respectively. To hide the CPU-to-GPU data transfer latency, an optimization scheme using Compute Unified Device Architecture (CUDA) streams is proposed in ImageJ. Experimental results show that the proposed plug-in can perform faster reconstruction for dual-wavelength DH, resulting in frame rates up to 48 fps even for one-megapixel digital holograms on a normal PC. In other words, the proposed plug-in can realize real-time phase reconstruction for dual-wavelength digital holographic videos.
Collapse
|
3
|
Dubay MM, Acres J, Riekeles M, Nadeau JL. Recent advances in experimental design and data analysis to characterize prokaryotic motility. J Microbiol Methods 2023; 204:106658. [PMID: 36529156 DOI: 10.1016/j.mimet.2022.106658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 12/13/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022]
Abstract
Bacterial motility plays a key role in important cell processes such as chemotaxis and biofilm formation, but is challenging to quantify due to the small size of the individual microorganisms and the complex interplay of biological and physical factors that influence motility phenotypes. Swimming, the first type of motility described in bacteria, still remains largely unquantified. Light microscopy has enabled qualitative characterization of swimming patterns seen in different strains, such as run and tumble, run-reverse-flick, run and slow, stop and coil, and push and pull, which has allowed for elucidation of the underlying physics. However, quantifying these behaviors (e.g., identifying run distances and speeds, turn angles and behavior by surfaces or cell-cell interactions) remains a challenging task. A qualitative and quantitative understanding of bacterial motility is needed to bridge the gap between experimentation, omics analysis, and bacterial motility theory. In this review, we discuss the strengths and limitations of how phase contrast microscopy, fluorescence microscopy, and digital holographic microscopy have been used to quantify bacterial motility. Approaches to automated software analysis, including cell recognition, tracking, and track analysis, are also discussed with a view to providing a guide for experimenters to setting up the appropriate imaging and analysis system for their needs.
Collapse
Affiliation(s)
- Megan Marie Dubay
- Department of Physics, Portland State University, 1719 SW 10(th) Ave., Portland, OR 97201, United States of America
| | - Jacqueline Acres
- Department of Physics, Portland State University, 1719 SW 10(th) Ave., Portland, OR 97201, United States of America
| | - Max Riekeles
- Astrobiology Group, Center of Astronomy and Astrophysics, Technical University Berlin, Hardenbergstraße 36A, 10623 Berlin, Germany
| | - Jay L Nadeau
- Department of Physics, Portland State University, 1719 SW 10(th) Ave., Portland, OR 97201, United States of America.
| |
Collapse
|
4
|
Castañeda R, Trujillo C, Doblas A. pyDHM: A Python library for applications in digital holographic microscopy. PLoS One 2022; 17:e0275818. [PMID: 36215263 PMCID: PMC9551626 DOI: 10.1371/journal.pone.0275818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Accepted: 09/23/2022] [Indexed: 11/19/2022] Open
Abstract
pyDHM is an open-source Python library aimed at Digital Holographic Microscopy (DHM) applications. The pyDHM is a user-friendly library written in the robust programming language of Python that provides a set of numerical processing algorithms for reconstructing amplitude and phase images for a broad range of optical DHM configurations. The pyDHM implements phase-shifting approaches for in-line and slightly off-axis systems and enables phase compensation for telecentric and non-telecentric systems. In addition, pyDHM includes three propagation algorithms for numerical focusing complex amplitude distributions in DHM and digital holography (DH) setups. We have validated the library using numerical and experimental holograms.
Collapse
Affiliation(s)
- Raul Castañeda
- Optical Imaging Research Laboratory, Department of Electrical and Computer Engineering, The University of Memphis, Memphis, TN, United States of America
| | - Carlos Trujillo
- Applied Optics Group, School of Applied Sciences and Engineering, Universidad EAFIT, Medellin, Colombia
| | - Ana Doblas
- Optical Imaging Research Laboratory, Department of Electrical and Computer Engineering, The University of Memphis, Memphis, TN, United States of America
- * E-mail:
| |
Collapse
|
5
|
Munera N, Trujillo C, Garcia-Sucerquia J. High-speed measurement of mechanical micro-deformations with an extended phase range using dual-wavelength digital holographic interferometry. APPLIED OPTICS 2022; 61:B279-B286. [PMID: 35201150 DOI: 10.1364/ao.443857] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 12/12/2021] [Indexed: 06/14/2023]
Abstract
The implementation of a digital holographic interferometry setup for high-speed micro-deformation measurement is presented. This proposal uses a dual-wavelength recording strategy to reconstruct micro-deformations up to 4.85 µm with no phase wrapping. The numerical processing required to recover the phase maps containing the information of micro-deformations is carried out in a general-purpose computing on graphics processing unit environment to boost its performance. The method completely processes recorded holograms of 1024×1024pixels in 48 ms, i.e., 21 frames per second (FPS) for a single-wavelength acquisition and 96 ms or 11 FPS for dual-wavelength recordings. The method is experimentally evaluated measuring deformations ranging from 0.033 µm to 4.85 µm with no need for phase unwrapping algorithms for an 8 cm diameter aluminum plate in a 110cm2 field of view.
Collapse
|
6
|
Buitrago-Duque C, Garcia-Sucerquia J. Realistic simulation and real-time reconstruction of digital holographic microscopy experiments in ImageJ. APPLIED OPTICS 2022; 61:B56-B63. [PMID: 35201126 DOI: 10.1364/ao.443137] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 10/27/2021] [Indexed: 06/14/2023]
Abstract
The description, implementation, and validation of an ImageJ plugin that allows the realistic simulation and real-time reconstruction of digital holographic microscopy (DHM) experiments are presented. The simulation module implements a telecentric image-plane DHM recording scheme with fully configurable imaging system, interference, and scaling parameters, including the possibility of defining an estimate of the roughness distribution of the sample to produce realistic coherent-noise affectations. The reconstruction module allows the computation of amplitude, intensity, or phase, from digital holograms' input as either single images or video streams for real-time processing; this module also implements user-defined fine-tuning parameters, allowing subpixel linear phase compensations and digital refocusing of the complex-valued reconstructed fields. In this note, the functionality of the plugin is illustrated by simulating the noisy DHM recording of a phase-only resolution test target and the reconstruction of both the resulting synthetic hologram and an equivalent experimental recording; the results show good agreement between the simulation and the experimental recording, and accurate measurements on the reconstructed information, thus granting the use of either module with full confidence according to needs and possibilities.
Collapse
|
7
|
Trujillo C, Piedrahita-Quintero P, Garcia-Sucerquia J. Digital lensless holographic microscopy: numerical simulation and reconstruction with ImageJ. APPLIED OPTICS 2020; 59:5788-5795. [PMID: 32609706 DOI: 10.1364/ao.395672] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 05/28/2020] [Indexed: 06/11/2023]
Abstract
The description and validation of an ImageJ open-source plugin to numerically simulate and reconstruct digital lensless holographic microscopy (DLHM) holograms are presented. Two modules compose the presented plugin: the simulation module implements a discrete version of the Rayleigh-Somerfield diffraction formula, which allows the user to directly build a simulated hologram from a known phase and/or amplitude object by just introducing the geometry parameters of the simulated setup; the plugin's reconstruction module implements a discrete version of the Kirchhoff-Helmholtz diffraction integral, thus allowing the user to reconstruct DLHM holograms by introducing the parameters of the acquisition setup and the desired reconstruction distance. The plugin offers the two said modules within the robust environment provided by a complete set of built-in tools for image processing available in ImageJ. While the simulation module has been validated through the evaluation of the forecasted lateral resolution of a DLHM setup in terms of the numerical aperture, the reconstruction module is tested by means of reconstructing experimental DLHM holograms of biological samples.
Collapse
|
8
|
Puyo L, Huignard JP, Atlan M. Off-axis digital holography with multiplexed volume Bragg gratings. APPLIED OPTICS 2018; 57:3281-3287. [PMID: 29714317 DOI: 10.1364/ao.57.003281] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2018] [Accepted: 03/16/2018] [Indexed: 06/08/2023]
Abstract
We report on an optical imaging design based on common-path off-axis digital holography, using a multiplexed volume Bragg grating. In the reported method, a reference optical wave is made by deflection and spatial filtering through a volume Bragg grating. This design has several advantages, including simplicity, stability, and robustness against misalignment.
Collapse
|
9
|
Castañeda R, Garcia-Sucerquia J. Single-shot 3D topography of reflective samples with digital holographic microscopy. APPLIED OPTICS 2018; 57:A12-A18. [PMID: 29328124 DOI: 10.1364/ao.57.000a12] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2017] [Accepted: 09/24/2017] [Indexed: 06/07/2023]
Abstract
In this work, an off-axis digital holographic microscope operating in reflection mode and a telecentric regimen to produce 3D topography of a microscopy sample is shown. The main characteristics of the proposed method, which make it different from the previous works in the field, are the possibility of producing the 3D topography by a single shot over the complete field of view with sensitivity of λ/100, without phase perturbations introduced by the illuminating-imaging system, and with no further numerical processing beyond that required for recovering the phase map of the sample. A complete analysis of the illuminating-imaging system of the digital holographic microscope is presented. The proposed digital holographic microscope is tested on imaging a USAF resolution test target and some micro-electromechanical systems (MEMs).
Collapse
|
10
|
Bedrossian M, Barr C, Lindensmith CA, Nealson K, Nadeau JL. Quantifying Microorganisms at Low Concentrations Using Digital Holographic Microscopy (DHM). J Vis Exp 2017. [PMID: 29155763 DOI: 10.3791/56343] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022] Open
Abstract
Accurately detecting and counting sparse bacterial samples has many applications in the food, beverage, and pharmaceutical processing industries, in medical diagnostics, and for life detection by robotic missions to other planets and moons of the solar system. Currently, sparse bacterial samples are counted by culture plating or epifluorescence microscopy. Culture plates require long incubation times (days to weeks), and epifluorescence microscopy requires extensive staining and concentration of the sample. Here, we demonstrate how to use off-axis digital holographic microscopy (DHM) to enumerate bacteria in very dilute cultures (100-104 cells/mL). First, the construction of the custom DHM is discussed, along with detailed instructions on building a low-cost instrument. The principles of holography are discussed, and a statistical model is used to estimate how long videos should be to detect cells, based on the optical performance characteristics of the instrument and the concentration of the bacterial solution (Table 2). Video detection of cells at 105, 104, 103, and 100 cells/mL is demonstrated in real time using un-reconstructed holograms. Reconstruction of amplitude and phase images is demonstrated using an open-source software package.
Collapse
Affiliation(s)
- Manuel Bedrossian
- Department of Medical Engineering, California Institute of Technology
| | - Casey Barr
- Department of Earth Sciences, University of Southern California
| | | | - Kenneth Nealson
- Department of Earth Sciences, University of Southern California
| | - Jay L Nadeau
- Department of Medical Engineering, California Institute of Technology;
| |
Collapse
|
11
|
Pellizzari M, Simonutti M, Degardin J, Sahel JA, Fink M, Paques M, Atlan M. High speed optical holography of retinal blood flow. OPTICS LETTERS 2016; 41:3503-6. [PMID: 27472604 DOI: 10.1364/ol.41.003503] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
We performed noninvasive video imaging of retinal blood flow in a pigmented rat by holographic interferometry of near-infrared laser light backscattered by retinal tissue, beating against an off-axis reference beam sampled at a frame rate of 39 kHz with a high throughput camera. Local Doppler contrasts emerged from the envelopes of short-time Fourier transforms and the phase of autocorrelation functions of holograms rendered by Fresnel transformation. This approach permitted imaging of blood flow in large retinal vessels (∼30 microns diameter) over 400×400 pixels with a spatial resolution of ∼8 microns and a temporal resolution of ∼6.5 ms.
Collapse
|