1
|
Matthews SA, Coelho C, Rodriguez Salas EE, Brock EE, Hodge VJ, Walker JA, Wilson LG. Real-time 3D tracking of swimming microbes using digital holographic microscopy and deep learning. PLoS One 2024; 19:e0301182. [PMID: 38669245 PMCID: PMC11051601 DOI: 10.1371/journal.pone.0301182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 03/12/2024] [Indexed: 04/28/2024] Open
Abstract
The three-dimensional swimming tracks of motile microorganisms can be used to identify their species, which holds promise for the rapid identification of bacterial pathogens. The tracks also provide detailed information on the cells' responses to external stimuli such as chemical gradients and physical objects. Digital holographic microscopy (DHM) is a well-established, but computationally intensive method for obtaining three-dimensional cell tracks from video microscopy data. We demonstrate that a common neural network (NN) accelerates the analysis of holographic data by an order of magnitude, enabling its use on single-board computers and in real time. We establish a heuristic relationship between the distance of a cell from the focal plane and the size of the bounding box assigned to it by the NN, allowing us to rapidly localise cells in three dimensions as they swim. This technique opens the possibility of providing real-time feedback in experiments, for example by monitoring and adapting the supply of nutrients to a microbial bioreactor in response to changes in the swimming phenotype of microbes, or for rapid identification of bacterial pathogens in drinking water or clinical samples.
Collapse
Affiliation(s)
- Samuel A. Matthews
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Carlos Coelho
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Erick E. Rodriguez Salas
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | - Emma E. Brock
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| | | | - James A. Walker
- Department of Computer Science, Deramore Lane, York, United Kingdom
| | - Laurence G. Wilson
- School of Physics, Engineering and Technology, University of York, Heslington, York, United Kingdom
| |
Collapse
|
2
|
Marzi A, Eder KM, Barroso Á, Kemper B, Schnekenburger J. Quantitative Phase Imaging as Sensitive Screening Method for Nanoparticle-Induced Cytotoxicity Assessment. Cells 2024; 13:697. [PMID: 38667312 PMCID: PMC11049110 DOI: 10.3390/cells13080697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 04/10/2024] [Accepted: 04/16/2024] [Indexed: 04/28/2024] Open
Abstract
The assessment of nanoparticle cytotoxicity is challenging due to the lack of customized and standardized guidelines for nanoparticle testing. Nanoparticles, with their unique properties, can interfere with biochemical test methods, so multiple tests are required to fully assess their cellular effects. For a more reliable and comprehensive assessment, it is therefore imperative to include methods in nanoparticle testing routines that are not affected by particles and allow for the efficient integration of additional molecular techniques into the workflow. Digital holographic microscopy (DHM), an interferometric variant of quantitative phase imaging (QPI), has been demonstrated as a promising method for the label-free assessment of the cytotoxic potential of nanoparticles. Due to minimal interactions with the sample, DHM allows for further downstream analyses. In this study, we investigated the capabilities of DHM in a multimodal approach to assess cytotoxicity by directly comparing DHM-detected effects on the same cell population with two downstream biochemical assays. Therefore, the dry mass increase in RAW 264.7 macrophages and NIH-3T3 fibroblast populations measured by quantitative DHM phase contrast after incubation with poly(alkyl cyanoacrylate) nanoparticles for 24 h was compared to the cytotoxic control digitonin, and cell culture medium control. Viability was then determined using a metabolic activity assay (WST-8). Moreover, to determine cell death, supernatants were analyzed for the release of the enzyme lactate dehydrogenase (LDH assay). In a comparative analysis, in which the average half-maximal effective concentration (EC50) of the nanocarriers on the cells was determined, DHM was more sensitive to the effect of the nanoparticles on the used cell lines compared to the biochemical assays.
Collapse
Affiliation(s)
- Anne Marzi
- Biomedical Technology Center, University of Muenster, Mendelstraße 17, D-48149 Muenster, Germany; (K.M.E.); (Á.B.); (B.K.)
| | | | | | | | | |
Collapse
|
3
|
Chvalova V, Vomastek T, Grousl T. Comparison of holotomographic microscopy and coherence-controlled holographic microscopy. J Microsc 2024; 294:5-13. [PMID: 38196346 DOI: 10.1111/jmi.13260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 12/18/2023] [Accepted: 12/26/2023] [Indexed: 01/11/2024]
Abstract
Quantitative phase imaging (QPI) is a powerful tool for label-free visualisation of living cells. Here, we compare two QPI microscopes - the Telight Q-Phase microscope and the Nanolive 3D Cell Explorer-fluo microscope. Both systems provide unbiased information about cell morphology, such as individual cell dry mass, perimeter and area. The Q-Phase microscope uses artefact-free, coherence-controlled holographic imaging technology to visualise cells in real time with minimal phototoxicity. The 3D Cell Explorer-fluo employs laser-based holotomography to reconstruct 3D images of living cells, visualising their internal structures and dynamics. Here, we analysed the strengths and limitations of both microscopes when examining two morphologically distinct cell lines - the cuboidal epithelial MDCK cells which form multicellular clusters and solitary growing Rat2 fibroblasts. We focus mainly on the ability of the devices to generate images suitable for single-cell segmentation by the built-in software, and we discuss the segmentation results and quantitative data generated from the segmented images. We show that both microscopes offer slightly different advantages, and the choice between them depends on the specific requirements and goals of the user.
Collapse
Affiliation(s)
- Vera Chvalova
- Laboratory of Cell Signalling, Institute of Microbiology of the Czech Academy of Sciences, Prague, Czech Republic
- Faculty of Science, Department of Cell Biology, Charles University, Prague, Czech Republic
| | - Tomas Vomastek
- Laboratory of Cell Signalling, Institute of Microbiology of the Czech Academy of Sciences, Prague, Czech Republic
| | - Tomas Grousl
- Laboratory of Cell Signalling, Institute of Microbiology of the Czech Academy of Sciences, Prague, Czech Republic
| |
Collapse
|
4
|
Wang P, Wu S, Zhang X, Qin B, Feng G. Moving grating-based laser heterodyne digital holographic microscopy system for measuring dynamic phase of living cell attachment. J Biophotonics 2024; 17:e202300355. [PMID: 38010123 DOI: 10.1002/jbio.202300355] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 10/26/2023] [Accepted: 10/28/2023] [Indexed: 11/29/2023]
Abstract
We propose a laser heterodyne digital holography microscopy system based on a moving grating, which uses the Doppler principle between a moving grating and beam to achieve a low-frequency bias between the diffracted beams, abandoning traditional heterodyne digital holography that requires multiple acousto-optic modulators. The dynamic phase distribution obtained using the laser heterodyne digital holography phase-reconstruction algorithm was more realistic and analyzable than the results of the angular spectrum algorithm. The structure and algorithm were used to capture the shape characteristics of mouse fibroblasts after ~2 h of incubation (37°C, 5% CO2), and the dynamic phase distribution of the cells was monitored in real-time during the attachment process. The system proposed in this study, with its high spatial resolution and high-precision phase measurement capability, is suitable for both static and live cells.
Collapse
Affiliation(s)
- Peng Wang
- Institute of Laser & Micro/Nano Engineering, College of Electronics and Information Engineering, Sichuan University, Chengdu, China
| | - Shizhou Wu
- Department of Orthopedic Surgery and Orthopedic Research Institute, Laboratory of Stem Cell and Tissue Engineering, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, Chengdu, China
| | - Xia Zhang
- Institute of Laser & Micro/Nano Engineering, College of Electronics and Information Engineering, Sichuan University, Chengdu, China
| | - Boquan Qin
- Department of Orthopedic Surgery and Orthopedic Research Institute, Laboratory of Stem Cell and Tissue Engineering, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, Chengdu, China
| | - Guoying Feng
- Institute of Laser & Micro/Nano Engineering, College of Electronics and Information Engineering, Sichuan University, Chengdu, China
| |
Collapse
|
5
|
Motoyama Y. [Simulation and Navigation in the Neurosurgical Field Using Three-Dimensional Hholograms by Mixed Reality Devices]. No Shinkei Geka 2024; 52:248-253. [PMID: 38514113 DOI: 10.11477/mf.1436204908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 03/23/2024]
Abstract
Recently, three-dimensional(3D)holograms from mixed-reality(MR)devices have become available in the medical field. 3D holographic images can provide immersive and intuitive information that has been reported to be very useful for preoperative simulations. Compared with conventional 3D images on a two-dimensional(2D)monitor, 3D holograms offer a higher level of realism, allowing observation of the images anytime and anywhere if the MR device is operational. Even during surgery, surgeons can check realistic 3D holograms in front of them, above the surgical field, without having to turn their heads toward a 2D monitor on the wall. 3D holograms can also be used for neuronavigation if the hologram is tracked to the patient's real head. This method can be defined as 3D augmented reality(AR)navigation, which shows a hologram of a target, such as a tumor or aneurysm, inside the head and brain. In the future, interventions using these techniques with 3D holograms from MR devices are expected to evolve and develop new types of treatments for endoscopic surgery or fluoroscopy-guided endovascular surgery.
Collapse
|
6
|
Ciaparrone G, Pirone D, Fiore P, Xin L, Xiao W, Li X, Bardozzo F, Bianco V, Miccio L, Pan F, Memmolo P, Tagliaferri R, Ferraro P. Label-free cell classification in holographic flow cytometry through an unbiased learning strategy. Lab Chip 2024; 24:924-932. [PMID: 38264771 DOI: 10.1039/d3lc00385j] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2024]
Abstract
Nowadays, label-free imaging flow cytometry at the single-cell level is considered the stepforward lab-on-a-chip technology to address challenges in clinical diagnostics, biology, life sciences and healthcare. In this framework, digital holography in microscopy promises to be a powerful imaging modality thanks to its multi-refocusing and label-free quantitative phase imaging capabilities, along with the encoding of the highest information content within the imaged samples. Moreover, the recent achievements of new data analysis tools for cell classification based on deep/machine learning, combined with holographic imaging, are urging these systems toward the effective implementation of point of care devices. However, the generalization capabilities of learning-based models may be limited from biases caused by data obtained from other holographic imaging settings and/or different processing approaches. In this paper, we propose a combination of a Mask R-CNN to detect the cells, a convolutional auto-encoder, used to the image feature extraction and operating on unlabelled data, thus overcoming the bias due to data coming from different experimental settings, and a feedforward neural network for single cell classification, that operates on the above extracted features. We demonstrate the proposed approach in the challenging classification task related to the identification of drug-resistant endometrial cancer cells.
Collapse
Affiliation(s)
- Gioele Ciaparrone
- Neurone Lab, Department of Management and Innovation Systems (DISA-MIS), University of Salerno, Fisciano, Italy.
| | - Daniele Pirone
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Pierpaolo Fiore
- Neurone Lab, Department of Management and Innovation Systems (DISA-MIS), University of Salerno, Fisciano, Italy.
| | - Lu Xin
- Key Laboratory of Precision Opto-Mechatronics Technology of Ministry of Education, School of Instrumentation Science & Optoelectronics Engineering, Beihang University, 100191 Beijing, China.
| | - Wen Xiao
- Key Laboratory of Precision Opto-Mechatronics Technology of Ministry of Education, School of Instrumentation Science & Optoelectronics Engineering, Beihang University, 100191 Beijing, China.
| | - Xiaoping Li
- Department of Obstetrics and Gynecology, Peking University People's Hospital, Beijing 100044, China
| | - Francesco Bardozzo
- Neurone Lab, Department of Management and Innovation Systems (DISA-MIS), University of Salerno, Fisciano, Italy.
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Vittorio Bianco
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Lisa Miccio
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Feng Pan
- Key Laboratory of Precision Opto-Mechatronics Technology of Ministry of Education, School of Instrumentation Science & Optoelectronics Engineering, Beihang University, 100191 Beijing, China.
| | - Pasquale Memmolo
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Roberto Tagliaferri
- Neurone Lab, Department of Management and Innovation Systems (DISA-MIS), University of Salerno, Fisciano, Italy.
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| | - Pietro Ferraro
- CNR - Institute of Applied Sciences and Intelligent Systems "Eduardo Caianiello", Pozzuoli, Italy.
| |
Collapse
|
7
|
Hua Z, Li Z, Lim D, Ajrouch A, Karkash A, Jalal S, Childress M, Turek J, Nolte D. Comparative oncology chemosensitivity assay for personalized medicine using low-coherence digital holography of dynamic light scattering from cancer biopsies. Sci Rep 2024; 14:2760. [PMID: 38332203 PMCID: PMC10853550 DOI: 10.1038/s41598-024-52404-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Accepted: 01/18/2024] [Indexed: 02/10/2024] Open
Abstract
Nearly half of cancer patients who receive standard-of-care treatments fail to respond to their first-line chemotherapy, demonstrating the pressing need for improved methods to select personalized cancer therapies. Low-coherence digital holography has the potential to fill this need by performing dynamic contrast OCT on living cancer biopsies treated ex vivo with anti-cancer therapeutics. Fluctuation spectroscopy of dynamic light scattering under conditions of holographic phase stability captures ultra-low Doppler frequency shifts down to 10 mHz caused by light scattering from intracellular motions. In the comparative preclinical/clinical trials presented here, a two-species (human and canine) and two-cancer (esophageal carcinoma and B-cell lymphoma) analysis of spectral phenotypes identifies a set of drug response characteristics that span species and cancer type. Spatial heterogeneity across a centimeter-scale patient biopsy sample is assessed by measuring multiple millimeter-scale sub-samples. Improved predictive performance is achieved for chemoresistance profiling by identifying red-shifted sub-samples that may indicate impaired metabolism and removing them from the prediction analysis. These results show potential for using biodynamic imaging for personalized selection of cancer therapy.
Collapse
Affiliation(s)
- Zhen Hua
- Department of Physics, Purdue University, West Lafayette, USA
| | - Zhe Li
- Department of Physics, Purdue University, West Lafayette, USA
| | - Dawith Lim
- Department of Physics, Purdue University, West Lafayette, USA
| | - Ali Ajrouch
- Division of Hematology/Oncology, Indiana University School of Medicine, Indianapolis, USA
| | - Ahmad Karkash
- Division of Hematology/Oncology, Indiana University School of Medicine, Indianapolis, USA
| | - Shadia Jalal
- Division of Hematology/Oncology, Indiana University School of Medicine, Indianapolis, USA
| | - Michael Childress
- Department of Veterinary Clinical Sciences, Purdue University, West Lafayette, USA
| | - John Turek
- Department of Basic Medical Sciences, Purdue University, West Lafayette, USA
| | - David Nolte
- Department of Physics, Purdue University, West Lafayette, USA.
| |
Collapse
|
8
|
Kumar M, Murata T, Matoba O. Live Cell Imaging by Single-Shot Common-Path Wide Field-of-View Reflective Digital Holographic Microscope. Sensors (Basel) 2024; 24:720. [PMID: 38339437 PMCID: PMC10857047 DOI: 10.3390/s24030720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 01/17/2024] [Accepted: 01/19/2024] [Indexed: 02/12/2024]
Abstract
Quantitative phase imaging by digital holographic microscopy (DHM) is a nondestructive and label-free technique that has been playing an indispensable role in the fields of science, technology, and biomedical imaging. The technique is competent in imaging and analyzing label-free living cells and investigating reflective surfaces. Herein, we introduce a new configuration of a wide field-of-view single-shot common-path off-axis reflective DHM for the quantitative phase imaging of biological cells that leverages several advantages, including being less-vibration sensitive to external perturbations due to its common-path configuration, also being compact in size, simple in optical design, highly stable, and cost-effective. A detailed description of the proposed DHM system, including its optical design, working principle, and capability for phase imaging, is presented. The applications of the proposed system are demonstrated through quantitative phase imaging results obtained from the reflective surface (USAF resolution test target) as well as transparent samples (living plant cells). The proposed system could find its applications in the investigation of several biological specimens and the optical metrology of micro-surfaces.
Collapse
Affiliation(s)
- Manoj Kumar
- Department of Systems Science, Graduate School of System Informatics, Kobe University, Rokkodai 1-1, Nada, Kobe 657-8501, Japan
- Center of Optical Scattering Image Science, Kobe University, Rokkodai 1-1, Nada, Kobe 657-8501, Japan
| | - Takashi Murata
- Department of Applied Bioscience, Kanagawa Institute of Technology, Atsugi 243-0292, Japan
| | - Osamu Matoba
- Department of Systems Science, Graduate School of System Informatics, Kobe University, Rokkodai 1-1, Nada, Kobe 657-8501, Japan
- Center of Optical Scattering Image Science, Kobe University, Rokkodai 1-1, Nada, Kobe 657-8501, Japan
| |
Collapse
|
9
|
Sun WS, Sun CC, Porta L, Yang TK, Su SH, Liu SH, Chou TH, Chen SC, Ho J, Lee CC. Creating Augmented Reality Holograms for Polytrauma Patients Using 3D Slicer and Holomedicine Medical Image Platform. AMIA Annu Symp Proc 2024; 2023:663-668. [PMID: 38222401 PMCID: PMC10785888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/16/2024]
Abstract
In traumatology physicians heavily rely on computed tomography (CT) 2D axial scans to identify and assess the patient's injuries after an accident. However, in some cases it can be difficult to rigorously evaluate the real extent of the damage considering only the bidimensional slices produced by the CT, and some life-threatening lesions can be missed. With the development of 3D holographic rendering and extended reality (XR) technology, CT images can be projected in a 3D format through head-mounted holographic displays, allowing multi-view from different angles and interactive slice intersections, thus increasing anatomical intelligibility. In this article, we explain how to import CT scans into holographic displays for 3D visualization and further compare the methodolgy with traditional bidimensional reading.
Collapse
Affiliation(s)
- Wei-Shao Sun
- Health Data Science Research Group, National Taiwan University Hospital, Taipei, Taiwan
| | - Chun-Chuan Sun
- IoT Center of Excellence, Microsoft Taiwan, Taipei, Taiwan
| | - Lorenzo Porta
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
- School of Medicine and Surgery, Università degli studi di Milano Bicocca, Milano, Italy
- Department of Emergency Medicine, ASST Grande Ospedale Metropolitano Niguarda, Milano, Italy
| | - Ting-Kai Yang
- Health Data Science Research Group, National Taiwan University Hospital, Taipei, Taiwan
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Shih-Hao Su
- Health Data Science Research Group, National Taiwan University Hospital, Taipei, Taiwan
| | - Shih-Hung Liu
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Tsung-Hsin Chou
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
- Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Shyr-Chyr Chen
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Joshua Ho
- The Center for Intelligent Healthcare, National Taiwan University Hospital, Taipei, Taiwan
| | - Chien-Chang Lee
- Health Data Science Research Group, National Taiwan University Hospital, Taipei, Taiwan
- Department of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
- The Center for Intelligent Healthcare, National Taiwan University Hospital, Taipei, Taiwan
| |
Collapse
|
10
|
Abbasian V, Darafsheh A. A dataset of digital holograms of normal and thalassemic cells. Sci Data 2024; 11:3. [PMID: 38168104 PMCID: PMC10762191 DOI: 10.1038/s41597-023-02818-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 12/04/2023] [Indexed: 01/05/2024] Open
Abstract
Digital holographic microscopy (DHM) is an intriguing medical diagnostic tool due to its label-free and quantitative nature, providing high-contrast images of phase samples. By capturing both intensity and phase information, DHM enables the numerical reconstruction of quantitative phase images. However, the lateral resolution is limited by the diffraction limit, which prompted the recent suggestion of microsphere-assisted DHM to enhance the DHM resolution straightforwardly. The use of such a technique as a medical diagnostic tool requires testing and validation of the proposed assays to prove their feasibility and viability. This paper publishes 760 and 609 microsphere-assisted DHM images of normal and thalassemic red blood cells obtained from a normal and thalassemic male individual, respectively.
Collapse
Affiliation(s)
- Vahid Abbasian
- Department of Radiation Oncology, Washington University School of Medicine in St. Louis, St. Louis, MO, 63110, USA.
- Imaging Science Program, McKelvey School of Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA.
- Department of Physics, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan, 45137-66731, Iran.
| | - Arash Darafsheh
- Department of Radiation Oncology, Washington University School of Medicine in St. Louis, St. Louis, MO, 63110, USA
| |
Collapse
|
11
|
Brunstein M, Lubetzki J, Moutoussamy C, Li W, Barral J. Fast 2-photon stimulation using holographic patterns. Opt Express 2023; 31:39222-39238. [PMID: 38018006 DOI: 10.1364/oe.498644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 10/04/2023] [Indexed: 11/30/2023]
Abstract
Two decades after its introduction, optogenetics - a biological technique to control the activity of neurons or other cell types with light - remains a cutting edge and promising tool to study biological processes. Its increasing usage in research varies widely from causally exploring biological mechanisms and neural computations, to neurostimulation and sensory restauration. To stimulate neurons in the brain, a variety of approaches have been developed to generate precise spatiotemporal light patterns. Yet certain constrains still exists in the current optical techniques to activate a neuronal population with both cellular resolution and millisecond precision. Here, we describe an experimental setup allowing to stimulate a few tens of neurons in a plane at sub-millisecond rates using 2-photon activation. A liquid crystal on silicon spatial light modulator (LCoS-SLM) was used to generate spatial patterns in 2 dimensions. The image of the patterns was formed on the plane of a digital micromirror device (DMD) that was used as a fast temporal modulator of each region of interest. Using fluorescent microscopy and patch-clamp recording of neurons in culture expressing the light-gated ion channels, we characterized the temporal and spatial resolution of the microscope. We described the advantages of combining the LCoS-SLM with the DMD to maximize the temporal precision, modulate the illumination amplitude, and reduce background activation. Finally, we showed that this approach can be extended to patterns in 3 dimensions. We concluded that the methodology is well suited to address important questions about the role of temporal information in neuronal coding.
Collapse
|
12
|
Zhao J, Liu L, Wang T, Zhang J, Wang X, Du X, Hao R, Liu J, Liu Y, Liu Y. Quantitative phase imaging of living red blood cells combining digital holographic microscopy and deep learning. J Biophotonics 2023; 16:e202300090. [PMID: 37321984 DOI: 10.1002/jbio.202300090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 06/12/2023] [Accepted: 06/13/2023] [Indexed: 06/17/2023]
Abstract
Digital holographic microscopy as a non-contacting, non-invasive, and highly accurate measurement technology, is becoming a valuable method for quantitatively investigating cells and tissues. Reconstruction of phases from a digital hologram is a key step in quantitative phase imaging for biological and biomedical research. This study proposes a two-stage deep convolutional neural network named VY-Net, to realize the effective and robust phase reconstruction of living red blood cells. The VY-Net can obtain the phase information of an object directly from a single-shot off-axis digital hologram. We also propose two new indices to evaluate the reconstructed phases. In experiments, the mean of the structural similarity index of reconstructed phases can reach 0.9309, and the mean of the accuracy of reconstructions of reconstructed phases is as high as 91.54%. An unseen phase map of a living human white blood cell is successfully reconstructed by the trained VY-Net, demonstrating its strong generality.
Collapse
Affiliation(s)
- Jiaxi Zhao
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Lin Liu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Tianhe Wang
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Jing Zhang
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiangzhou Wang
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaohui Du
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Ruqian Hao
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Juanxiu Liu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Yi Liu
- School of Physics, University of Electronic Science and Technology of China, Chengdu, China
| | - Yong Liu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
13
|
Shymkiv Y, Yuste R. Aberration-free holographic microscope for simultaneous imaging and stimulation of neuronal populations. Opt Express 2023; 31:33461-33474. [PMID: 37859128 PMCID: PMC10544954 DOI: 10.1364/oe.498051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/26/2023] [Accepted: 09/07/2023] [Indexed: 10/21/2023]
Abstract
A technical challenge in neuroscience is to record and specifically manipulate the activity of neurons in living animals. This can be achieved in some preparations with two-photon calcium imaging and photostimulation. These methods can be extended to three dimensions by holographic light sculpting with spatial light modulators (SLMs). At the same time, performing simultaneous holographic imaging and photostimulation is still cumbersome, requiring two light paths with separate SLMs. Here we present an integrated optical design using a single SLM for simultaneous imaging and photostimulation. Furthermore, we applied axially dependent adaptive optics to make the system aberration-free, and developed software for calibrations and closed-loop neuroscience experiments. Finally, we demonstrate the performance of the system with simultaneous calcium imaging and optogenetics in mouse primary auditory cortex in vivo. Our integrated holographic system could facilitate the systematic investigation of neural circuit function in awake behaving animals.
Collapse
Affiliation(s)
- Yuriy Shymkiv
- Neurotechnology Center, Dept. Biological Sciences, Columbia University, New York, NY, USA
| | - Rafael Yuste
- Neurotechnology Center, Dept. Biological Sciences, Columbia University, New York, NY, USA
| |
Collapse
|
14
|
Sui X, Wu W, Pivnenko M, Chu D, Cao L. Polarimetric calibrated robust dual-SLM complex-amplitude computer-generated holography. Opt Lett 2023; 48:3625-3628. [PMID: 37390198 DOI: 10.1364/ol.493915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 06/05/2023] [Indexed: 07/02/2023]
Abstract
Liquid crystal on silicon (LCoS) is a widely used spatial light modulator (SLM) in computer-generated holography (CGH). However, the phase-modulating profile of LCoS is often not ideally uniform in application, bringing about undesired intensity fringes. In this study, we overcome this problem by proposing a highly robust dual-SLM complex-amplitude CGH technique, which incorporates a polarimetric mode and a diffractive mode. The polarimetric mode linearizes the general phase modulations of the two SLMs separately, while the diffractive mode uses camera-in-the-loop optimization to achieve improved holographic display. Experimental results show the effectiveness of our proposal in improving reconstructing accuracy by 21.12% in peak signal-to-noise ratio (PSNR) and 50.74% in structure similarity index measure (SSIM), using LCoS SLMs with originally non-uniform phase-modulating profiles.
Collapse
|
15
|
Faini G, Tanese D, Molinier C, Telliez C, Hamdani M, Blot F, Tourain C, de Sars V, Del Bene F, Forget BC, Ronzitti E, Emiliani V. Ultrafast light targeting for high-throughput precise control of neuronal networks. Nat Commun 2023; 14:1888. [PMID: 37019891 PMCID: PMC10074378 DOI: 10.1038/s41467-023-37416-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 03/16/2023] [Indexed: 04/07/2023] Open
Abstract
Two-photon, single-cell resolution optogenetics based on holographic light-targeting approaches enables the generation of precise spatiotemporal neuronal activity patterns and thus a broad range of experimental applications, such as high throughput connectivity mapping and probing neural codes for perception. Yet, current holographic approaches limit the resolution for tuning the relative spiking time of distinct cells to a few milliseconds, and the achievable number of targets to 100-200, depending on the working depth. To overcome these limitations and expand the capabilities of single-cell optogenetics, we introduce an ultra-fast sequential light targeting (FLiT) optical configuration based on the rapid switching of a temporally focused beam between holograms at kHz rates. We used FLiT to demonstrate two illumination protocols, termed hybrid- and cyclic-illumination, and achieve sub-millisecond control of sequential neuronal activation and high throughput multicell illumination in vitro (mouse organotypic and acute brain slices) and in vivo (zebrafish larvae and mice), while minimizing light-induced thermal rise. These approaches will be important for experiments that require rapid and precise cell stimulation with defined spatio-temporal activity patterns and optical control of large neuronal ensembles.
Collapse
Affiliation(s)
- Giulia Faini
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Dimitrii Tanese
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Clément Molinier
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Cécile Telliez
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Massilia Hamdani
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Francois Blot
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Christophe Tourain
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Vincent de Sars
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Filippo Del Bene
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Benoît C Forget
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France
| | - Emiliano Ronzitti
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France.
| | - Valentina Emiliani
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012, Paris, France.
| |
Collapse
|
16
|
Garcia-Manrique J, Furlong C, Gonzalez-Herrera A, Cheng JT. Numerical model characterization of the sound transmission mechanism in the tympanic membrane from a high-speed digital holographic experiment in transient regime. Acta Biomater 2023; 159:63-73. [PMID: 36708849 DOI: 10.1016/j.actbio.2023.01.048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 01/04/2023] [Accepted: 01/19/2023] [Indexed: 01/27/2023]
Abstract
A methodology for the development of a finite element numerical model of the tympanic membrane (TM) based on experiments carried out in the time domain on a cadaveric human temporal bone is presented. Using a high-speed digital holographic (HDH) system, acoustically-induced transient displacements of the TM surface are obtained. The procedure is capable to generate and validate the finite element model of the TM by numerical and experimental data correlation. Reverse engineering approach is used to identify key material parameters that define the mechanical response of the TM. Finally, modal numerical simulations of the specimen are performed. Results show the feasibility of the methodology to obtain an accurate model of a specific specimen and to help interpret its behaviour with additional numerical simulations. STATEMENT OF SIGNIFICANCE: Improving knowledge of the dynamic behavior of the tympanic membrane is key to understanding the sound transmission system in human hearing and advance in the treatment of its pathologies. Recently we acquired a new tool to carry out experiments in transient regime by means of digital laser holography, capable of providing a large amount of information in a controlled transient test. In this work, these data are used to develop a methodology that generates a numerical model of the tympanic membrane based on numerical-experimental correlations. It is important to be able to develop models that fit specific patients. In this work, additional modal simulations are also presented that, in addition to validating the results, provide more information on the specimen.
Collapse
Affiliation(s)
- J Garcia-Manrique
- Department of Civil Engineering, Materials and Manufacturing, School of Engineering, University of Malaga, Spain; Eaton-Peabody Laboratory, Massachusetts Eye and Ear, Boston, MA, USA; Department of Otolaryngology-Head and Neck Surgery, Harvard Medical School, Boston, MA, USA.
| | - Cosme Furlong
- Center for Holographic Studies and Laser micro-mechaTronics (CHSLT), Worcester, MA, USA; Mechanical Engineering Department, Worcester Polytechnic Institute, Worcester, MA, USA
| | - A Gonzalez-Herrera
- Department of Civil Engineering, Materials and Manufacturing, School of Engineering, University of Malaga, Spain
| | - Jeffrey T Cheng
- Eaton-Peabody Laboratory, Massachusetts Eye and Ear, Boston, MA, USA; Department of Otolaryngology-Head and Neck Surgery, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
17
|
Běhal J, Pirone D, Sirico D, Bianco V, Mugnano M, Del Giudice D, Cavina B, Kurelac I, Memmolo P, Miccio L, Ferraro P. On monocytes and lymphocytes biolens clustering by in flow holographic microscopy. Cytometry A 2023; 103:251-259. [PMID: 36028475 DOI: 10.1002/cyto.a.24685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 07/29/2022] [Accepted: 08/23/2022] [Indexed: 11/09/2022]
Abstract
Live cells act as biological lenses and can be employed as real-world optical components in bio-hybrid systems. Imaging at nanoscale, optical tweezers, lithography and also photonic waveguiding are some of the already proven functionalities, boosted by the advantage that cells are fully biocompatible for intra-body applications. So far, various cell types have been studied for this purpose, such as red blood cells, bacterial cells, stem cells and yeast cells. White Blood Cells (WBCs) play a very important role in the regulation of the human body activities and are usually monitored for assessing its health. WBCs can be considered bio-lenses but, to the best of our knowledge, characterization of their optical properties have not been investigated yet. Here, we report for the first time an accurate study of two model classes of WBCs (i.e., monocytes and lymphocytes) by means of a digital holographic microscope coupled with a microfluidic system, assuming WBCs bio-lens characteristics. Thus, quantitative phase maps for many WBCs have been retrieved in flow-cytometry (FC) by achieving a significant statistical analysis to prove the enhancement in differentiation among sphere-like bio-lenses according to their sizes (i.e., diameter d) exploiting intensity parameters of the modulated light in proximity of the cell optical axis. We show that the measure of the low intensity area (S: I z < I th z ) in a fixed plane, is a feasible parameter for cell clustering, while achieving robustness against experimental misalignments and allowing to adjust the measurement sensitivity in post-processing. 2D scatterplots of the identified parameters (d-S) show better differentiation respect to the 1D case. The results show that the optical focusing properties of WBCs allow the clustering of the two populations by means of a mere morphological analysis, thus leading to the new concept of cell-optical-fingerprint avoiding fluorescent dyes. This perspective can open new routes in biomedical sciences, such as the chance to find optical-biomarkers at single cell level for label-free diagnosis.
Collapse
Affiliation(s)
- Jaromír Běhal
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
- Department of Optics, Palacký University, Olomouc, Czech Republic
| | - Daniele Pirone
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
- DIETI, Department of Electrical Engineering and Information Technologies, University of Naples "Federico II", Naples, Italy
| | - Daniele Sirico
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
- Department of Chemical, Materials and Production Engineering of the University of Naples Federico II, Naples, Italy
| | - Vittorio Bianco
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
| | - Martina Mugnano
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
| | - Danila Del Giudice
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
- Department of Mathematics and Physics, University of Campania "L. Vanvitelli", Caserta, Italy
| | - Beatrice Cavina
- Department of Medical and Surgical Sciences (DIMEC), Centro di Studio e Ricerca sulle Neoplasie (CSR) Ginecologiche, Alma Mater Studiorum-University of Bologna, Bologna, Italy
- Centre for Applied Biomedical Research (CRBA), University of Bologna, Bologna, Italy
| | - Ivana Kurelac
- Department of Medical and Surgical Sciences (DIMEC), Centro di Studio e Ricerca sulle Neoplasie (CSR) Ginecologiche, Alma Mater Studiorum-University of Bologna, Bologna, Italy
- Centre for Applied Biomedical Research (CRBA), University of Bologna, Bologna, Italy
| | - Pasquale Memmolo
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
| | - Lisa Miccio
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
| | - Pietro Ferraro
- CNR-ISASI, Institute of Applied Sciences and Intelligent Systems "E. Caianiello", Naples, Italy
| |
Collapse
|
18
|
Li T, Tan S, Li M, Luo J, Zhang Y, Jiang Z, Deng Y, Han L, Ke H, Shen J, Tang Y, Liu F, Chen H, Yang T. Holographically Activatable Nanoprobe via Glutathione/Albumin-Mediated Exponential Signal Amplification for High-Contrast Tumor Imaging. Adv Mater 2023; 35:e2209603. [PMID: 36524741 DOI: 10.1002/adma.202209603] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/11/2022] [Indexed: 06/17/2023]
Abstract
Glutathione (GSH)-activatable probes hold great promise for in vivo cancer imaging, but are restricted by their dependence on non-selective intracellular GSH enrichment and uncontrollable background noise. Here, a holographically activatable nanoprobe caging manganese tetraoxide is shown for tumor-selective contrast enhancement in magnetic resonance imaging (MRI) through cooperative GSH/albumin-mediated cascade signal amplification in tumors and rapid elimination in normal tissues. Once targeting tumors, the endocytosed nanoprobe effectively senses the lysosomal microenvironment to undergo instantaneous decomposition into Mn2+ with threshold GSH concentration of ≈ 0.12 mm for brightening MRI signals, thus achieving high contrast tumor imaging and flexible monitoring of GSH-relevant cisplatin resistance during chemotherapy. Upon efficient up-regulation of extracellular GSH in tumor via exogenous injection, the relaxivity-silent interstitial nanoprobe remarkably evolves into Mn2+ that are further captured/retained and re-activated into ultrahigh-relaxivity-capable complex by stromal albumin in the tumor, and simultaneously allows the renal clearance of off-targeted nanoprobe in the form of Mn2+ via lymphatic vessels for suppressing background noise to distinguish tiny liver metastasis. These findings demonstrate the concept of holographic tumor activation via both tumor GSH/albumin-mediated cascade signal amplification and simultaneous background suppression for precise tumor malignancy detection, surveillance, and surgical guidance.
Collapse
Affiliation(s)
- Ting Li
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Shuangxiu Tan
- Department of Radiology, Second Affiliated Hospital of Soochow University, Suzhou, 215004, China
| | - Mengjuan Li
- Department of Radiology, Second Affiliated Hospital of Soochow University, Suzhou, 215004, China
| | - Jie Luo
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Yueyue Zhang
- Department of Radiology, Second Affiliated Hospital of Soochow University, Suzhou, 215004, China
| | - Zhen Jiang
- Department of Radiology, Second Affiliated Hospital of Soochow University, Suzhou, 215004, China
| | - Yibin Deng
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Liang Han
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Hengte Ke
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Junkang Shen
- Department of Radiology, Second Affiliated Hospital of Soochow University, Suzhou, 215004, China
| | - Yong'an Tang
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Fan Liu
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| | - Huabing Chen
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
- Department of Pharmacy, The First Affiliated Hospital of Soochow University, Suzhou, 215006, China
- Institute for Interdisciplinary Drug Research and Translational Sciences, Soochow University, Suzhou, 215006, China
- State Key Laboratory of Radiation Medicine and Protection, and School of Radiation Medicine and Protection, Soochow University, Suzhou, 215123, China
| | - Tao Yang
- Jiangsu Key Laboratory of Neuropsychiatric Diseases, and College of Pharmaceutical Sciences, Soochow University, Suzhou, 215123, China
| |
Collapse
|
19
|
Ang AKR, Umena Y, Sato-Tomita A, Shibayama N, Happo N, Marumi R, Yamamoto Y, Kimura K, Kawamura N, Takano Y, Matsushita T, Sasaki YC, Shen JR, Hayashi K. Development of serial X-ray fluorescence holography for radiation-sensitive protein crystals. J Synchrotron Radiat 2023; 30:368-378. [PMID: 36891850 PMCID: PMC10000799 DOI: 10.1107/s1600577522011833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Accepted: 12/12/2022] [Indexed: 06/18/2023]
Abstract
X-ray fluorescence holography (XFH) is a powerful atomic resolution technique capable of directly imaging the local atomic structure around atoms of a target element within a material. Although it is theoretically possible to use XFH to study the local structures of metal clusters in large protein crystals, the experiment has proven difficult to perform, especially on radiation-sensitive proteins. Here, the development of serial X-ray fluorescence holography to allow the direct recording of hologram patterns before the onset of radiation damage is reported. By combining a 2D hybrid detector and the serial data collection used in serial protein crystallography, the X-ray fluorescence hologram can be directly recorded in a fraction of the measurement time needed for conventional XFH measurements. This approach was demonstrated by obtaining the Mn Kα hologram pattern from the protein crystal Photosystem II without any X-ray-induced reduction of the Mn clusters. Furthermore, a method to interpret the fluorescence patterns as real-space projections of the atoms surrounding the Mn emitters has been developed, where the surrounding atoms produce large dark dips along the emitter-scatterer bond directions. This new technique paves the way for future experiments on protein crystals that aim to clarify the local atomic structures of their functional metal clusters, and for other related XFH experiments such as valence-selective XFH or time-resolved XFH.
Collapse
Affiliation(s)
- Artoni Kevin R. Ang
- Department of Physical Science and Engineering, Nagoya Institute of Technology, Gokiso, Showa, Nagoya 466-8555, Japan
| | - Yasufumi Umena
- Synchrotron Radiation Research Center, Nagoya University, Furo, Chikusa, Nagoya 466-8603, Japan
| | - Ayana Sato-Tomita
- Division of Biophysics, Department of Physiology, Jichi Medical University, Yakushiji, Shimotsuke, Tochigi 329-0498, Japan
| | - Naoya Shibayama
- Division of Biophysics, Department of Physiology, Jichi Medical University, Yakushiji, Shimotsuke, Tochigi 329-0498, Japan
| | - Naohisa Happo
- Department of Computer and Network Engineering, Graduate School of Information Sciences, Hiroshima City University, Asa-Minami-ku, Hiroshima 731-3194, Japan
| | - Riho Marumi
- Department of Physical Science and Engineering, Nagoya Institute of Technology, Gokiso, Showa, Nagoya 466-8555, Japan
| | - Yuta Yamamoto
- Department of Physical Science and Engineering, Nagoya Institute of Technology, Gokiso, Showa, Nagoya 466-8555, Japan
| | - Koji Kimura
- Department of Physical Science and Engineering, Nagoya Institute of Technology, Gokiso, Showa, Nagoya 466-8555, Japan
| | - Naomi Kawamura
- Japan Synchrotron Radiation Research Institute (JASRI), Sayo, Hyôgo 679-5198, Japan
| | - Yu Takano
- Graduate School of Information Sciences, Hiroshima City University, Asa-Minami-ku, Hiroshima 731-3194, Japan
| | - Tomohiro Matsushita
- Graduate School of Science and Technology, Nara Institute of Science and Technology, Ikoma 630-0192, Japan
| | - Yuji C. Sasaki
- Graduate School of Frontier Sciences, University of Tokyo, Kashiwa, Chiba 277-8561, Japan
| | - Jian-Ren Shen
- Research Institute for Interdisciplinary Science and Graduate School of Natural Science and Technology, Okayama University, Tsushima Naka, Okayama 700-8530, Japan
| | - Kouichi Hayashi
- Department of Physical Science and Engineering, Nagoya Institute of Technology, Gokiso, Showa, Nagoya 466-8555, Japan
- Japan Synchrotron Radiation Research Institute (JASRI), Sayo, Hyôgo 679-5198, Japan
| |
Collapse
|
20
|
Alonso D, Garcia J, Micó V. Fluholoscopy-Compact and Simple Platform Combining Fluorescence and Holographic Microscopy. Biosensors (Basel) 2023; 13:253. [PMID: 36832019 PMCID: PMC9954010 DOI: 10.3390/bios13020253] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 02/01/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
The combination of different imaging modalities into single imaging platforms has a strong potential in biomedical sciences as it permits the analysis of complementary properties of the target sample. Here, we report on an extremely simple, cost-effective, and compact microscope platform for achieving simultaneous fluorescence and quantitative phase imaging modes with the capability of working in a single snapshot. It is based on the use of a single illumination wavelength to both excite the sample's fluorescence and provide coherent illumination for phase imaging. After passing the microscope layout, the two imaging paths are separated using a bandpass filter, and the two imaging modes are simultaneously obtained using two digital cameras. We first present calibration and analysis of both fluorescence and phase imaging modalities working independently and, later on, experimental validation for the proposed common-path dual-mode imaging platform considering static (resolution test targets, fluorescent micro-beads, and water-suspended lab-made cultures) as well as dynamic (flowing fluorescent beads, human sperm cells, and live specimens from lab-made cultures) samples.
Collapse
|
21
|
Zheng W, Wang J, Zhou Y, Zeng Q, Zhang C, Liu L, Yu H, Yang Y. Lensless holographic microscope with a time and memory-saving algorithm for large-volume imaging of organoids. Opt Lett 2023; 48:771-774. [PMID: 36723585 DOI: 10.1364/ol.481627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 12/30/2022] [Indexed: 06/18/2023]
Abstract
Organoids, the 3D culture systems derived from stem cells, are promising models for human organs. However, organoid study requires large-volume imaging with single cell resolution, which is beyond the spatial bandwidth limit of conventional optical microscopy. Herein, we propose a lensless holographic microscope empowered with a time and memory-saving algorithm. It solves the trade-off between the imaging field of view, resolution, and processing speed, and provides a practical tool for the study of organoids. We first build a compact microscopy system using a multi-angle LED illumination scheme and an on-chip structure. Then we develop a fast angular spectrum formula for fast reconstruction of oblique-illuminated coaxial holography under the under-sampling condition. Additionally, we derive a multi-angle illuminated filtered backpropagation algorithm to achieve high-precision and slice-wise recovery of 3D structures of objects. The reconstruction process demands only 1/50 of the memory required by a traditional optical diffraction tomography algorithm. Experimental results indicate that the proposed method can achieve 6.28 mm × 4.71 mm × 0.37 mm volume imaging within 104 s. Through the standardized polystyrene beads test, we demonstrate that the proposed microscope has micrometer-scale resolution in both lateral and axial directions. In addition, the 3D imaging results of salivary gland organoids show great application prospects of the proposed method in the field of living biological sampling imaging.
Collapse
|
22
|
Picazo-Bueno JÁ, Sanz M, Granero L, García J, Micó V. Multi-Illumination Single-Holographic-Exposure Lensless Fresnel (MISHELF) Microscopy: Principles and Biomedical Applications. Sensors (Basel) 2023; 23:1472. [PMID: 36772511 PMCID: PMC9918952 DOI: 10.3390/s23031472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Revised: 01/13/2023] [Accepted: 01/19/2023] [Indexed: 06/18/2023]
Abstract
Lensless holographic microscopy (LHM) comes out as a promising label-free technique since it supplies high-quality imaging and adaptive magnification in a lens-free, compact and cost-effective way. Compact sizes and reduced prices of LHMs make them a perfect instrument for point-of-care diagnosis and increase their usability in limited-resource laboratories, remote areas, and poor countries. LHM can provide excellent intensity and phase imaging when the twin image is removed. In that sense, multi-illumination single-holographic-exposure lensless Fresnel (MISHELF) microscopy appears as a single-shot and phase-retrieved imaging technique employing multiple illumination/detection channels and a fast-iterative phase-retrieval algorithm. In this contribution, we review MISHELF microscopy through the description of the principles, the analysis of the performance, the presentation of the microscope prototypes and the inclusion of the main biomedical applications reported so far.
Collapse
Affiliation(s)
- José Ángel Picazo-Bueno
- Department of Optics, Optometry and Vision Science, University of Valencia, 46100 Burjassot, Spain
- Biomedical Technology Center of the Medical Faculty, University of Muenster, Mendelstr. 17, D-48149 Muenster, Germany
| | - Martín Sanz
- Department of Optics, Optometry and Vision Science, University of Valencia, 46100 Burjassot, Spain
| | - Luis Granero
- Department of Optics, Optometry and Vision Science, University of Valencia, 46100 Burjassot, Spain
| | - Javier García
- Department of Optics, Optometry and Vision Science, University of Valencia, 46100 Burjassot, Spain
| | - Vicente Micó
- Department of Optics, Optometry and Vision Science, University of Valencia, 46100 Burjassot, Spain
| |
Collapse
|
23
|
Accanto N, Blot FGC, Lorca-Cámara A, Zampini V, Bui F, Tourain C, Badt N, Katz O, Emiliani V. A flexible two-photon fiberscope for fast activity imaging and precise optogenetic photostimulation of neurons in freely moving mice. Neuron 2023; 111:176-189.e6. [PMID: 36395773 DOI: 10.1016/j.neuron.2022.10.030] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 07/28/2022] [Accepted: 10/19/2022] [Indexed: 11/17/2022]
Abstract
We developed a flexible two-photon microendoscope (2P-FENDO) capable of all-optical brain investigation at near cellular resolution in freely moving mice. The system performs fast two-photon (2P) functional imaging and 2P holographic photostimulation of single and multiple cells using axially confined extended spots. Proof-of-principle experiments were performed in freely moving mice co-expressing jGCaMP7s and the opsin ChRmine in the visual or barrel cortex. On a field of view of 250 μm in diameter, we demonstrated functional imaging at a frame rate of up to 50 Hz and precise photostimulation of selected groups of cells. With the capability to simultaneously image and control defined neuronal networks in freely moving animals, 2P-FENDO will enable a precise investigation of neuronal functions in the brain during naturalistic behaviors.
Collapse
Affiliation(s)
- Nicolò Accanto
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France.
| | - François G C Blot
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France
| | | | - Valeria Zampini
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France
| | - Florence Bui
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France
| | - Christophe Tourain
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France
| | - Noam Badt
- Department of Applied Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Ori Katz
- Department of Applied Physics, Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Valentina Emiliani
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, F-75012 Paris, France.
| |
Collapse
|
24
|
Tai CW, Ahmadzadegan A, Ardekani A, Narsimhan V. A forward reconstruction, holographic method to overcome the lens effect during 3D detection of semi-transparent, non-spherical particles. Soft Matter 2022; 19:115-127. [PMID: 36472306 DOI: 10.1039/d2sm00738j] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Suspensions of semi-transparent particles such as polystyrene microparticles are commonly used as model systems in the study of micro-rheology, biology, and microfluidics. Holography is a valuable tool that allows one to obtain 3-D information for particle position and orientation, but forward reconstruction techniques often struggle to infer this information accurately for semi-transparent spheroids with an O(1) aspect ratio, since the lens effect from the particle introduces complex patterns. We propose a reconstruction method that uses image moment information to generate a mask over the sharp patterns from the lens effect and gives reasonable estimation of the 3-D position and orientation of the particle. The method proposed in this work uses the average particle geometry information to determine the process parameters and identify the appropriate detection zone. The average detection error for zc is less than 25% of the average particle thickness, and the average errors in the in-plane and out-of-plane orientations ϕ and θ are 2° and 4°, respectively. Our method provides comparable accuracy in the detection of the particle center of mass (xc, yc, zc) and in-plane orientation ϕ as a recent forward reconstruction method for semi-transparent particles proposed by Byeon et al. (H. Byeon, T. Go and S. J. Lee, Appl. Opt., 2016, 54, 2106-2112; H. Byeon, T. Go and S. J. Lee, Opt. Express, 2016, 24, 598-610). This method provides a clearly defined framework for identifying the particle's out-of-plane tilt angle θ. We finally demonstrate the applicability of the method to opaque, slender (aspect ratio AR ≫ 1) particles by analyzing the 3-D motion of E. coli cells from holographic video footage.
Collapse
Affiliation(s)
- Cheng-Wei Tai
- Davidson School of Chemical Engineering, Purdue University, 480 W Stadium Ave, West Lafayette, IN, 47907, USA.
| | - Adib Ahmadzadegan
- School of Mechanical Engineering, Purdue University, 585 Purdue Mall, West Lafayette, IN, 47907, USA.
| | - Arezoo Ardekani
- School of Mechanical Engineering, Purdue University, 585 Purdue Mall, West Lafayette, IN, 47907, USA.
| | - Vivek Narsimhan
- Davidson School of Chemical Engineering, Purdue University, 480 W Stadium Ave, West Lafayette, IN, 47907, USA.
| |
Collapse
|
25
|
Han W, Han J, Ju YG, Jang J, Park JH. Super multi-view near-eye display with a lightguide combiner. Opt Express 2022; 30:46383-46403. [PMID: 36558594 DOI: 10.1364/oe.477517] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 11/25/2022] [Indexed: 06/17/2023]
Abstract
We propose a lightguide-type super multi-view near-eye display that uses a digital micromirror device and a LED array. The proposed method presents three-dimensional images with a natural monocular depth cue using a compact combiner optics which consists of a thin lightguide and holographic optical elements (HOEs). Feasibility of the proposed method is verified by optical experiments which demonstrate monocular three-dimensional image presentation over a wide depth range. We also analyze the degradation of the image quality stemming from the spectral spread of the HOEs and show its reduction by a pre-compensation exploiting an adaptive moment estimation (Adam) optimizer.
Collapse
|
26
|
Jin L, Yu Z, Au A, Yip CM. Practical approach for optimizing off-axis telecentric digital holographic microscope design. Appl Opt 2022; 61:10490-10498. [PMID: 36607111 DOI: 10.1364/ao.476308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 11/09/2022] [Indexed: 06/17/2023]
Abstract
Digital holographic microscopy (DHM) has become an attractive imaging tool for the analysis of living cells and histological tissues. Telecentric DHM (TDHM) is a configuration of DHM that reduces the computational demands through a priori aberration corrections. However, TDHM requires a well-aligned optical pipeline to optimize its resolution and image quality (IQ), which has traditionally complicated the alignment process. Derived from optical interference functions, we offer here a set of methodologies to simplify TDHM design and alignment by determining the optimal +1-order position, which depends on the object-reference beam angle and the interference plane rotation angle. The methods are then experimentally tested and verified on a TDHM system by imaging living HeLa cells in suspension.
Collapse
|
27
|
Lee MH, Lew HM, Youn S, Kim T, Hwang JY. Deep Learning-Based Framework for Fast and Accurate Acoustic Hologram Generation. IEEE Trans Ultrason Ferroelectr Freq Control 2022; 69:3353-3366. [PMID: 36331635 DOI: 10.1109/tuffc.2022.3219401] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Acoustic holography has been gaining attention for various applications, such as noncontact particle manipulation, noninvasive neuromodulation, and medical imaging. However, only a few studies on how to generate acoustic holograms have been conducted, and even conventional acoustic hologram algorithms show limited performance in the fast and accurate generation of acoustic holograms, thus hindering the development of novel applications. We here propose a deep learning-based framework to achieve fast and accurate acoustic hologram generation. The framework has an autoencoder-like architecture; thus, the unsupervised training is realized without any ground truth. For the framework, we demonstrate a newly developed hologram generator network, the holographic ultrasound generation network (HU-Net), which is suitable for unsupervised learning of hologram generation, and a novel loss function that is devised for energy-efficient holograms. Furthermore, for considering various hologram devices (i.e., ultrasound transducers), we propose a physical constraint (PC) layer. Simulation and experimental studies were carried out for two different hologram devices, such as a 3-D printed lens, attached to a single element transducer, and a 2-D ultrasound array. The proposed framework was compared with the iterative angular spectrum approach (IASA) and the state-of-the-art (SOTA) iterative optimization method, Diff-PAT. In the simulation study, our framework showed a few hundred times faster generation speed, along with comparable or even better reconstruction quality, than those of IASA and Diff-PAT. In the experimental study, the framework was validated with 3-D printed lenses fabricated based on different methods, and the physical effect of the lenses on the reconstruction quality was discussed. The outcomes of the proposed framework in various cases (i.e., hologram generator networks, loss functions, and hologram devices) suggest that our framework may become a very useful alternative tool for other existing acoustic hologram applications, and it can expand novel medical applications.
Collapse
|
28
|
Ochner H, Szilagyi S, Edte M, Malavolti L, Rauschenbach S, Kern K. Phase Reconstruction of Low-Energy Electron Holograms of Individual Proteins. ACS Nano 2022; 16:18568-18578. [PMID: 36367752 PMCID: PMC9706659 DOI: 10.1021/acsnano.2c06897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 10/27/2022] [Indexed: 06/16/2023]
Abstract
Low-energy electron holography (LEEH) is one of the few techniques capable of imaging large and complex three-dimensional molecules, such as proteins, on the single-molecule level at subnanometer resolution. During the imaging process, the structural information about the object is recorded both in the amplitude and in the phase of the hologram. In low-energy electron holography imaging of proteins, the object's amplitude distribution, which directly reveals molecular size and shape on the single-molecule level, can be retrieved via a one-step reconstruction process. However, such a one-step reconstruction routine cannot directly recover the phase information encoded in the hologram. In order to extract the full information about the imaged molecules, we thus implemented an iterative phase retrieval algorithm and applied it to experimentally acquired low-energy electron holograms, reconstructing the phase shift induced by the protein along with the amplitude data. We show that phase imaging can map the projected atomic density of the molecule given by the number of atoms in the electron path. This directly implies a correlation between reconstructed phase shift and projected mean inner potential of the molecule, and thus a sensitivity to local changes in potential, an interpretation that is further substantiated by the strong phase signatures induced by localized charges.
Collapse
Affiliation(s)
- Hannah Ochner
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
| | - Sven Szilagyi
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
| | - Moritz Edte
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
| | - Luigi Malavolti
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
| | - Stephan Rauschenbach
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
- Department
of Chemistry, University of Oxford, 12 Mansfield Road, Oxford OX1 3TA, U.K.
| | - Klaus Kern
- Max
Planck Institute for Solid State Research, Heisenbergstrasse 1, DE-70569 Stuttgart, Germany
- Institut
de Physique, École Polytechnique
Fédérale de Lausanne, 1015 Lausanne, Switzerland
| |
Collapse
|
29
|
Arcab P, Mirecki B, Stefaniuk M, Pawłowska M, Trusiak M. Experimental optimization of lensless digital holographic microscopy with rotating diffuser-based coherent noise reduction. Opt Express 2022; 30:42810-42828. [PMID: 36522993 DOI: 10.1364/oe.470860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 09/23/2022] [Indexed: 06/17/2023]
Abstract
Laser-based lensless digital holographic microscopy (LDHM) is often spoiled by considerable coherent noise factor. We propose a novel LDHM method with significantly limited coherent artifacts, e.g., speckle noise and parasitic interference fringes. It is achieved by incorporating a rotating diffuser, which introduces partial spatial coherence and preserves high temporal coherence of laser light, crucial for credible in-line hologram reconstruction. We present the first implementation of the classical rotating diffuser concept in LDHM, significantly increasing the signal-to-noise ratio while preserving the straightforwardness and compactness of the LDHM imaging device. Prior to the introduction of the rotating diffusor, we performed LDHM experimental hardware optimization employing 4 light sources, 4 cameras, and 3 different optical magnifications (camera-sample distances). It was guided by the quantitative assessment of numerical amplitude/phase reconstruction of test targets, conducted upon standard deviation calculation (noise factor quantification), and resolution evaluation (information throughput quantification). Optimized rotating diffuser LDHM (RD-LDHM) method was successfully corroborated in technical test target imaging and examination of challenging biomedical sample (60 µm thick mouse brain tissue slice). Physical minimization of coherent noise (up to 50%) was positively verified, while preserving optimal spatial resolution of phase and amplitude imaging. Coherent noise removal, ensured by proposed RD-LDHM method, is especially important in biomedical inference, as speckles can falsely imitate valid biological features. Combining this favorable outcome with large field-of-view imaging can promote the use of reported RD-LDHM technique in high-throughput stain-free biomedical screening.
Collapse
|
30
|
Siemonsma S, Bell T. HoloKinect: Holographic 3D Video Conferencing. Sensors (Basel) 2022; 22:8118. [PMID: 36365816 PMCID: PMC9659293 DOI: 10.3390/s22218118] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/18/2022] [Accepted: 10/19/2022] [Indexed: 06/16/2023]
Abstract
Recent world events have caused a dramatic rise in the use of video conferencing solutions such as Zoom and FaceTime. Although 3D capture and display technologies are becoming common in consumer products (e.g., Apple iPhone TrueDepth sensors, Microsoft Kinect devices, and Meta Quest VR headsets), 3D telecommunication has not yet seen any appreciable adoption. Researchers have made great progress in developing advanced 3D telepresence systems, but often with burdensome hardware and network requirements. In this work, we present HoloKinect, an open-source, user-friendly, and GPU-accelerated platform for enabling live, two-way 3D video conferencing on commodity hardware and a standard broadband internet connection. A Microsoft Azure Kinect serves as the capture device and a Looking Glass Portrait multiscopically displays the final reconstructed 3D mesh for a hologram-like effect. HoloKinect packs color and depth information into a single video stream, leveraging multiwavelength depth (MWD) encoding to store depth maps in standard RGB video frames. The video stream is compressed with highly optimized and hardware-accelerated video codecs such as H.264. A search of the depth and video encoding parameter space was performed to analyze the quantitative and qualitative losses resulting from HoloKinect's lossy compression scheme. Visual results were acceptable at all tested bitrates (3-30 Mbps), while the best results were achieved with higher video bitrates and full 4:4:4 chroma sampling. RMSE values of the recovered depth measurements were low across all settings permutations.
Collapse
|
31
|
Abdelazeem RM, Ghareab Abdelsalam Ibrahim D. Discrimination between normal and cancer white blood cells using holographic projection technique. PLoS One 2022; 17:e0276239. [PMID: 36264929 PMCID: PMC9584458 DOI: 10.1371/journal.pone.0276239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2021] [Accepted: 10/03/2022] [Indexed: 11/15/2022] Open
Abstract
White blood cells (WBCs) play a vital role in the diagnosis of many blood diseases. Such diagnosis is based on the morphological analysis of blood microscopic images which is performed manually by skilled hematologist. However, this method has many drawbacks, such as the dependence on the hematologist's skill, slow performance, and varying accuracy. Therefore, in the current study, a new optical method for discrimination between normal and cancer WBCs of peripheral blood film (PBF) images is presented. This method is based on holographic projection technique which is able to provide an accurate and fast optical reconstruction method of WBCs floating in the air. Besides, it can provide a 3D visualization map of one WBC with its characterization parameters from only a single 2D hologram. To achieve that, at first, WBCs are accurately segmented from the microscopic PBF images using a developed in-house MATLAB code. Then, their associated phase computer-generated holograms (CGHs) are calculated using the well-known iterative Fourier transform algorithm (IFTA). Within the utilized algorithm, a speckle noise reduction technique, based on temporal multiplexing of spatial frequencies, is applied to minimize the speckle noise across the reconstruction plane. Additionally, a special hologram modulation is added to the calculated holograms to provide a 3D visualization map of one WBC, and discriminate normal and cancer WBCs. Finally, the calculated phase-holograms are uploaded on a phase-only spatial light modulator (SLM) for optical reconstruction. The optical reconstruction of such phase-holograms yields precise representation of normal and cancer WBCs. Moreover, a 3D visualization map of one WBC with its characterization parameters is provided. Therefore, the proposed technique can be used as a valuable tool for interpretation and analysis of WBCs, this in turn could provide an improvement in diagnosis and prognosis of blood diseases.
Collapse
Affiliation(s)
- Rania M. Abdelazeem
- Engineering Applications of Laser Department, National Institute of Laser Enhanced Sciences “NILES”, Cairo University, Giza, Egypt
- * E-mail:
| | | |
Collapse
|
32
|
Castañeda R, Trujillo C, Doblas A. pyDHM: A Python library for applications in digital holographic microscopy. PLoS One 2022; 17:e0275818. [PMID: 36215263 PMCID: PMC9551626 DOI: 10.1371/journal.pone.0275818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2022] [Accepted: 09/23/2022] [Indexed: 11/19/2022] Open
Abstract
pyDHM is an open-source Python library aimed at Digital Holographic Microscopy (DHM) applications. The pyDHM is a user-friendly library written in the robust programming language of Python that provides a set of numerical processing algorithms for reconstructing amplitude and phase images for a broad range of optical DHM configurations. The pyDHM implements phase-shifting approaches for in-line and slightly off-axis systems and enables phase compensation for telecentric and non-telecentric systems. In addition, pyDHM includes three propagation algorithms for numerical focusing complex amplitude distributions in DHM and digital holography (DH) setups. We have validated the library using numerical and experimental holograms.
Collapse
Affiliation(s)
- Raul Castañeda
- Optical Imaging Research Laboratory, Department of Electrical and Computer Engineering, The University of Memphis, Memphis, TN, United States of America
| | - Carlos Trujillo
- Applied Optics Group, School of Applied Sciences and Engineering, Universidad EAFIT, Medellin, Colombia
| | - Ana Doblas
- Optical Imaging Research Laboratory, Department of Electrical and Computer Engineering, The University of Memphis, Memphis, TN, United States of America
- * E-mail:
| |
Collapse
|
33
|
Lu W, Shi Y, Ou P, Zheng M, Tai H, Wang Y, Duan R, Wang M, Wu J. High quality of an absolute phase reconstruction for coherent digital holography with an enhanced anti-speckle deep neural unwrapping network. Opt Express 2022; 30:37457-37469. [PMID: 36258334 DOI: 10.1364/oe.470534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 08/31/2022] [Indexed: 06/16/2023]
Abstract
It is always a challenge how to overcome speckle noise interference in the phase reconstruction for coherent digital holography (CDH) and its application, as this issue has not been solved well so far. In this paper, we are proposing an enhanced anti-speckle deep neural unwrapping network (E-ASDNUN) approach to achieve high quality of absolute phase reconstruction for CDH. The method designs a special network-based noise filter and embeds it into a deep neural unwrapping network to enhance anti-noise capacity in the image feature recognition and extraction process. The numerical simulation and experimental test on the phase unwrapping reconstruction and the image quality evaluation under the noise circumstances show that the E-ASDNUN approach is very effective against the speckle noise in realizing the high quality of absolute phase reconstruction. Meanwhile, it also demonstrates much better robustness than the typical U-net neural network and the traditional phase unwrapping algorithms in reconstructing high wrapping densities and high noise levels of phase images. The E-ASDNUN approach is also examined and confirmed by measuring the same phase object using a commercial white light interferometry as a reference. The result is perfectly consistent with that obtained by the E-ASDNUN approach.
Collapse
|
34
|
Zicha D, Chmelik R. Testing anti-cancer drugs with holographic incoherent-light-source quantitative phase imaging. Methods Enzymol 2022; 679:255-274. [PMID: 36682864 DOI: 10.1016/bs.mie.2022.08.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
Quantitative Phase Imaging is becoming an important tool in the objective evaluation of cellular responses to experimental treatment. The technique is based on interferometric measurements of the optical thickness of cells in tissue culture reporting on the distribution of dry mass inside the cells. As the measurement of the optical thickness is interferometric, it is not subjected to the Abbe resolution limit, and the use of an incoherent-light source further increases the accuracy practically achieving 0.93nm in optical path difference corresponding to 4.6 femtograms/μm2. Holographic mode reduces the exposure in comparison to phase-shifting or phase-stepping interference microscopy and allows observation of faster dynamics. An attractive application is in the development of novel anti-cancer drugs and there is an important potential for pretesting chemotherapeutic drugs with biopsy material for personalized cancer treatment. The procedure involves the preparation of live cells in tissue culture, seeding them into suitable observation chambers, and time-lapse recording with an adjusted microscope. Subsequent image processing and statistical analysis are essential last steps producing the results, which include rapid measurements of cell growth in terms of dry-mass increase in individual cells, speed of cell motility and other dynamic morphometric parameters.
Collapse
Affiliation(s)
- Daniel Zicha
- CEITEC-Central European Institute of Technology, Brno University of Technology, Brno, Czech Republic; Institute of Physical Engineering, Faculty of Mechanical Engineering, Brno University of Technology, Brno, Czech Republic.
| | - Radim Chmelik
- CEITEC-Central European Institute of Technology, Brno University of Technology, Brno, Czech Republic; Institute of Physical Engineering, Faculty of Mechanical Engineering, Brno University of Technology, Brno, Czech Republic
| |
Collapse
|
35
|
Yeom J, Jeong J, Hong J, Choi KS. Analysis on image quality of a holographic lens with a non-converging signal wave for compact near-eye displays. Opt Express 2022; 30:36632-36643. [PMID: 36258587 DOI: 10.1364/oe.473125] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 09/13/2022] [Indexed: 06/16/2023]
Abstract
We analyze an image quality of a holographic lens (HL) in order to implement compact near-eye displays using a flat-panel-type micro-display panel. The proposed method utilizes a non-converging signal wave in a fabrication process of the HL, so that it provides affordable eye-box size with minimizing the aberration due to rays in the off-Bragg condition. For analyzing and optimizing the HL based on the non-converging signal wave, we introduce a comprehensive analysis model for an assessment of the image quality in the HL. The analysis model, inspired from the conventional lens design strategy for near-eye displays, evaluates the focal spot quality for incident rays forming each pixel with considering the on- and off-Bragg diffraction. The theoretical analysis is validated by simulation results using a volume hologram model in Zemax OpticStudio. As experimental verifications, we realize a prototype system using photopolymer-based HLs in a green color with the high transmittance of 89.3%. The image quality of the HLs is analyzed, which coincides well with the proposed analysis and assessment metric. By building a compact experimental setup employing the HL and a micro-organic light emitting diode display, we present see-through images with 8.0 mm of eye-box with reduced aberrations.
Collapse
|
36
|
Abstract
Metal oxide nanoparticles exhibit outstanding catalytic properties, believed to be related to the presence of oxygen vacancies at the particle's surface. However, little quantitative information is known about concentrations of point defects inside and at surfaces of these nanoparticles, due to the challenges in achieving an atomically resolved experimental access. By employing off-axis electron holography, we demonstrate, using MgO nanoparticles as an example, a methodology that discriminates between mobile charge induced by electron beam irradiation and immobile charge associated with deep traps induced by point defects as well as distinguishes between bulk and surface point defects. Counting the immobile charge provides a quantification of the concentration of F2+ centers induced by oxygen vacancies at the MgO nanocube surfaces.
Collapse
Affiliation(s)
- Yan Lu
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
- Beijing Key Lab and Institute of Microstructure and Properties of Advanced Materials, Beijing University of Technology, Beijing 100124, China
| | - Fengshan Zheng
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Qianqian Lan
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Michael Schnedler
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Philipp Ebert
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Rafal E Dunin-Borkowski
- Ernst Ruska-Centre for Microscopy and Spectroscopy with Electrons (ER-C 1) and Peter Grünberg Institute (PGI 5), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| |
Collapse
|
37
|
Tian Z, Ming Z, Qi A, Li F, Yu X, Song Y. Lensless computational imaging with a hybrid framework of holographic propagation and deep learning. Opt Lett 2022; 47:4283-4286. [PMID: 36048634 DOI: 10.1364/ol.464764] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 07/27/2022] [Indexed: 06/15/2023]
Abstract
Lensless imaging has attracted attention as it avoids the bulky optical lens. Lensless holographic imaging is a type of a lensless imaging technique. Recently, deep learning has also shown tremendous potential in lensless holographic imaging. A labeled complex field including real and imaginary components of the samples is usually used as a training dataset. However, obtaining such a holographic dataset is challenging. In this Letter, we propose a lensless computational imaging technique with a hybrid framework of holographic propagation and deep learning. The proposed framework takes recorded holograms as input instead of complex fields, and compares the input and regenerated holograms. Compared to previous supervised learning schemes with a labeled complex field, our method does not require this supervision. Furthermore, we use the generative adversarial network to constrain the proposed framework and tackle the trivial solution. We demonstrate high-quality reconstruction with the proposed framework compared to previous deep learning methods.
Collapse
|
38
|
Liu C, Zheng Y, Li NN, Hou YH, Jiang Z, Wang QH. Real scene acquisition and holographic near-eye display system based on a zoom industrial endoscope. Opt Express 2022; 30:33170-33181. [PMID: 36242363 DOI: 10.1364/oe.468267] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 08/17/2022] [Indexed: 06/16/2023]
Abstract
In this paper, we propose a real scene acquisition and holographic near-eye display system based on a zoom industrial endoscope. By controlling the driving current of the liquid lens, the working distance and focal length of the zoom industrial endoscope can be tuned accordingly. Thus, the object at different depths can be captured. Then, the sub-sampling algorithm is used to generate the hologram. By adjusting the hologram sampling rate of the objects with different depths, the holographic near-eye 3D display can be realized. Experimental results demonstrate that the working distance of the zoom industrial endoscope can be tuned from 20 mm to 200 mm with the driving current changing from 80 mA to 190 mA. With the proposed system, the human eye can intuitively see the depth relationships among the real objects. The proposed system is expected to be applied to 3D display and industrial inspection fields.
Collapse
|
39
|
Shu T, Hu G, Wu R, Li H, Zhang Z, Liu X. Compact full-color augmented reality near-eye display using freeform optics and a holographic optical combiner. Opt Express 2022; 30:31714-31727. [PMID: 36242248 DOI: 10.1364/oe.465842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 07/29/2022] [Indexed: 06/16/2023]
Abstract
We develop a compact full-color augmented reality near-eye display system with a multicolor holographic optical combiner and a freeform relay system. The digital image is produced by a full-color micro organic light-emitting diode (Micro-OLED) display module. The freeform relay system includes four freeform optics and a holographic optical mirror, which are employed to correct both the monochromatic and chromatic aberrations caused by the holographic optical combiner. The two multicolor holographic mirrors have a three-layer laminated structure and are delicately fabricated to yield an improved diffractive efficiency and a reduced efficiency difference for red, green, and blue colors. The high degrees of freedom of freeform optics, and the thin and light nature of the holographic optical combiner yield a compact form factor near-eye display system with a diagonal field of view (FOV) of 20° and the eye-box of 5 mm × 5 mm. Two prototypes are built to demonstrate the feasibility of the proposed display system.
Collapse
|
40
|
Spampinato GLB, Ronzitti E, Zampini V, Ferrari U, Trapani F, Khabou H, Agraval A, Dalkara D, Picaud S, Papagiakoumou E, Marre O, Emiliani V. All-optical inter-layers functional connectivity investigation in the mouse retina. Cell Rep Methods 2022; 2:100268. [PMID: 36046629 PMCID: PMC9421538 DOI: 10.1016/j.crmeth.2022.100268] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 06/03/2022] [Accepted: 07/19/2022] [Indexed: 06/01/2023]
Abstract
We developed a multi-unit microscope for all-optical inter-layers circuits interrogation. The system performs two-photon (2P) functional imaging and 2P multiplexed holographic optogenetics at axially distinct planes. We demonstrated the capability of the system to map, in the mouse retina, the functional connectivity between rod bipolar cells (RBCs) and ganglion cells (GCs) by activating single or defined groups of RBCs while recording the evoked response in the GC layer with cell-type specificity and single-cell resolution. We then used a logistic model to probe the functional connectivity between cell types by deriving the "cellular receptive field" describing how RBCs impact each GC type. With the capability to simultaneously image and control neuronal activity at axially distinct planes, the system enables a precise interrogation of multi-layered circuits. Understanding this information transfer is a promising avenue to dissect complex neural circuits and understand the neural basis of computations.
Collapse
Affiliation(s)
| | - Emiliano Ronzitti
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Valeria Zampini
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Ulisse Ferrari
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Francesco Trapani
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Hanen Khabou
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | | | - Deniz Dalkara
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Serge Picaud
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | | | - Olivier Marre
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| | - Valentina Emiliani
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, 75012 Paris, France
| |
Collapse
|
41
|
Běhal J, Borrelli F, Mugnano M, Bianco V, Capozzoli A, Curcio C, Liseno A, Miccio L, Memmolo P, Ferraro P. Developing a Reliable Holographic Flow Cyto-Tomography Apparatus by Optimizing the Experimental Layout and Computational Processing. Cells 2022; 11:cells11162591. [PMID: 36010667 PMCID: PMC9406712 DOI: 10.3390/cells11162591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 08/17/2022] [Accepted: 08/18/2022] [Indexed: 11/16/2022] Open
Abstract
Digital Holographic Tomography (DHT) has recently been established as a means of retrieving the 3D refractive index mapping of single cells. To make DHT a viable system, it is necessary to develop a reliable and robust holographic apparatus in order that such technology can be utilized outside of specialized optics laboratories and operated in the in-flow modality. In this paper, we propose a quasi-common-path lateral-shearing holographic optical set-up to be used, for the first time, for DHT in a flow-cytometer modality. The proposed solution is able to withstand environmental vibrations that can severely affect the interference process. Furthermore, we have scaled down the system while ensuring that a full 360° rotation of the cells occurs in the field-of-view, in order to retrieve 3D phase-contrast tomograms of single cells flowing along a microfluidic channel. This was achieved by setting the camera sensor at 45° with respect to the microfluidic direction. Additional optimizations were made to the computational elements to ensure the reliable retrieval of 3D refractive index distributions by demonstrating an effective method of tomographic reconstruction, based on high-order total variation. The results were first demonstrated using realistic 3D numerical phantom cells to assess the performance of the proposed high-order total variation method in comparison with the gold-standard algorithm for tomographic reconstructions: namely, filtered back projection. Then, the proposed DHT system and the processing pipeline were experimentally validated for monocytes and mouse embryonic fibroblast NIH-3T3 cells lines. Moreover, the repeatability of these tomographic measurements was also investigated by recording the same cell multiple times and quantifying the ability to provide reliable and comparable tomographic reconstructions, as confirmed by a correlation coefficient greater than 95%. The reported results represent various steps forward in several key aspects of in-flow DHT, thus paving the way for its use in real-world applications.
Collapse
Affiliation(s)
- Jaromír Běhal
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Francesca Borrelli
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Martina Mugnano
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Vittorio Bianco
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Amedeo Capozzoli
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Claudio Curcio
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Angelo Liseno
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell’Informazione, Università di Napoli Federico II, 80125 Napoli, Italy
| | - Lisa Miccio
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| | - Pasquale Memmolo
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
- Correspondence:
| | - Pietro Ferraro
- Institute of Applied Sciences and Intelligent Systems, Italian National Research Council (CNR-ISASI), 80078 Pozzuoli, Italy
| |
Collapse
|
42
|
Guo Z, Yang CT, Chien CC, Selth LA, Bagnaninchi PO, Thierry B. Optical Cellular Micromotion: A New Paradigm to Measure Tumor Cells Invasion within Gels Mimicking the 3D Tumor Environments. Small Methods 2022; 6:e2200471. [PMID: 35764869 DOI: 10.1002/smtd.202200471] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/22/2022] [Indexed: 06/15/2023]
Abstract
Measuring tumor cell invasiveness through 3D tissues, particularly at the single-cell level, can provide important mechanistic understanding and assist in identifying therapeutic targets of tumor invasion. However, current experimental approaches, including standard in vitro invasion assays, have limited physiological relevance and offer insufficient insight into the vast heterogeneity in tumor cell migration through tissues. To address these issues, here the concept of optical cellular micromotion is reported on, where digital holographic microscopy is used to map the optical nano- to submicrometer thickness fluctuations within single-cells. These fluctuations are driven by the dynamic movement of subcellular structures including the cytoskeleton and inherently associated with the biological processes involved in cell invasion within tissues. It is experimentally demonstrated that the optical cellular micromotion correlates with tumor cells motility and invasiveness both at the population and single-cell levels. In addition, the optical cellular micromotion significantly reduced upon treatment with migrastatic drugs that inhibit tumor cell invasion. These results demonstrate that micromotion measurements can rapidly and non-invasively determine the invasive behavior of single tumor cells within tissues, yielding a new and powerful tool to assess the efficacy of approaches targeting tumor cell invasiveness.
Collapse
Affiliation(s)
- Zhaobin Guo
- Future Industries Institute and ARC Centre of Excellence in Convergent Bio-Nano Science and Technology, University of South Australia, Mawson Lakes, SA, 5095, Australia
| | - Chih-Tsung Yang
- Future Industries Institute and ARC Centre of Excellence in Convergent Bio-Nano Science and Technology, University of South Australia, Mawson Lakes, SA, 5095, Australia
| | - Chia-Chi Chien
- Future Industries Institute and ARC Centre of Excellence in Convergent Bio-Nano Science and Technology, University of South Australia, Mawson Lakes, SA, 5095, Australia
| | - Luke A Selth
- Flinders Health and Medical Research Institute and Freemasons Centre for Male Health and Wellbeing, Flinders University, Bedford Park, SA, 5042, Australia
- Dame Roma Mitchell Cancer Research Laboratories and Freemasons Foundation Centre for Male Health and Wellbeing, Adelaide Medical School, The University of Adelaide, Adelaide, SA, 5000, Australia
| | - Pierre O Bagnaninchi
- Centre for Regenerative Medicine, University of Edinburgh, Edinburgh, EH16 4UU, UK
| | - Benjamin Thierry
- Future Industries Institute and ARC Centre of Excellence in Convergent Bio-Nano Science and Technology, University of South Australia, Mawson Lakes, SA, 5095, Australia
| |
Collapse
|
43
|
Joglekar M, Trivedi V, Chhaniwal V, Claus D, Javidi B, Anand A. LED based large field of view off-axis quantitative phase contrast microscopy by hologram multiplexing. Opt Express 2022; 30:29234-29245. [PMID: 36299102 DOI: 10.1364/oe.444616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 06/09/2022] [Indexed: 06/16/2023]
Abstract
In this manuscript, we describe the development of a single shot, self-referencing wavefront division, multiplexing digital holographic microscope employing LED sources for large field of view quantitative phase imaging of biological samples. To address the difficulties arising while performing interferometry with low temporally coherent sources, an optical arrangement utilizing multiple Fresnel Biprisms is used for hologram multiplexing, enhancing the field of view and increasing the signal to noise ratio. Biprisms offers the ease of obtaining interference patterns by automatically matching the path length between the two off-axis beams. The use of low temporally coherent sources reduces the speckle noise and the cost, and the form factor of the setup. The developed technique was implemented using both visible and UV LEDs and tested on polystyrene microspheres and human erythrocytes.
Collapse
|
44
|
Wang Z, Tu K, Pang Y, Zhang X, Lv G, Feng Q, Wang A, Ming H. Simultaneous multi-channel near-eye display: a holographic retinal projection display with large information content. Opt Lett 2022; 47:3876-3879. [PMID: 35913345 DOI: 10.1364/ol.461918] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 06/06/2022] [Indexed: 06/15/2023]
Abstract
Augmented reality (AR) near-eye displays (NEDs) are emerging as the next-generation display platform. The existing AR NED only present one single video channel at a time, same as traditional media such as TVs and smartphones. In this Letter, to the best of our knowledge, we propose for the first time a multi-channel holographic retinal projection display (RPD), which can provide multi-channel image sources simultaneously, thus greatly increasing the information content. Due to the superposition capacity of a hologram, multiple images are projected to different viewpoints simultaneously through multiple spherical wave encoding, so that the viewer can switch among playing channels very fast through eye rotation. A full-color dynamic multi-channel holographic near-eye display is demonstrated in the optical experiment. The proposed method provides a good prospect that the future AR glasses can play dozens of video channels in parallel, and the user can switch among channels freely and efficiently just through a simple eye rotation.
Collapse
|
45
|
Liu H, Wu X, Liu G, Ren H, R V V, Chen Z, Pu J. Label-free single-shot imaging with on-axis phase-shifting holographic reflectance quantitative phase microscopy. J Biophotonics 2022; 15:e202100400. [PMID: 35285152 DOI: 10.1002/jbio.202100400] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2021] [Revised: 03/04/2022] [Accepted: 03/07/2022] [Indexed: 06/14/2023]
Abstract
Quantitative phase microscopy (QPM) has been emerged as an indispensable diagnostic and characterization tool in biomedical imaging with its characteristic nature of label-free, noninvasive, and real time imaging modality. The integration of holography to the conventional microscopy opens new advancements in QPM featuring high-resolution and quantitative three-dimensional image reconstruction. However, the holography schemes suffer in space-bandwidth and time-bandwidth issues in the off-axis and phase-shifting configuration, respectively. Here, we introduce an on-axis phase-shifting holography based QPM system with single-shot imaging capability. The technique utilizes the Fizeau interferometry scheme in combination with polarization phase-shifting and space-division multiplexing to achieve the single-shot recording of the multiple phase-shifted holograms. Moreover, the high-speed imaging capability with instantaneous recording of spatially phase shifted holograms offers the flexible utilization of the approach in dynamic quantitative phase imaging with robust phase stability. We experimentally demonstrated the validity of the approach by quantitative phase imaging and depth-resolved imaging of paramecium cells. Furthermore, the technique is applied to the phase imaging and quantitative parameter estimation of red blood cells. This integration of a Fizeau-based phase-shifting scheme to the optical microscopy enables a simple and robust tool for the investigations of engineered and biological specimen with real-time quantitative analysis.
Collapse
Affiliation(s)
- Hanzi Liu
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, Fujian, China
| | - Xiaoyan Wu
- Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang, China
- Key Laboratory of Science and Technology on High Energy Laser, China Academy of Engineering Physics, Mianyang, China
| | - Guodong Liu
- Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang, China
- Key Laboratory of Science and Technology on High Energy Laser, China Academy of Engineering Physics, Mianyang, China
| | - Hongliang Ren
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, Fujian, China
| | - Vinu R V
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, Fujian, China
| | - Ziyang Chen
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, Fujian, China
| | - Jixiong Pu
- College of Information Science and Engineering, Fujian Key Laboratory of Light Propagation and Transformation, Huaqiao University, Xiamen, Fujian, China
| |
Collapse
|
46
|
Hwang L, Hur G, Kim J, Gentet P, Kwon S, Lee S. Uniformity improvement of a reconstructed-holographic image in a near-eye display system using off-axis HOE. Opt Express 2022; 30:21439-21454. [PMID: 36224863 DOI: 10.1364/oe.460680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 05/14/2022] [Indexed: 06/16/2023]
Abstract
When a near-eye display (NED) device reproduces an image at a location close to the eye, the virtual image is implemented at a large angle. The uniformity of the image is unbalanced due to the change in diffraction efficiency by the hologram recording angle and angular selectivity. This study proposes a method for implementing an optimal uniform image by analyzing the diffraction efficiency and the reconstructed image was analyzed using angular selectivity generated while reproducing the source point of the diffused image as an intermediate element by holographic optical element (HOE). This research provides practical results for displaying high diffraction efficiency and immersive holographic images in the NED system with HOE as uniformed intermediate elements.
Collapse
|
47
|
Lopera MJ, Trujillo C. Holographic point source for digital lensless holographic microscopy. Opt Lett 2022; 47:2862-2865. [PMID: 35648949 DOI: 10.1364/ol.459146] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 05/05/2022] [Indexed: 06/15/2023]
Abstract
A holographic point source (HPS) developed for digital lensless holographic microscopy (HPS-DLHM) is presented. The HPS is an off-axis phase transmission hologram of an experimental micrometer pinhole recorded on a photopolymer holographic film. An amplitude division interferometer, adjusted to operate at maximum diffraction efficiency, has been employed to record the hologram. The results of HPS-DLHM have been contrasted with the results obtained via conventional DLHM, and the two techniques were found to give similar measurements. Compared with conventional pinhole-based DLHM illumination, our cost-effective proposal provides increased mechanical stability, the possibility of wider spherical illumination cones, and shorter reconstruction distances. These superior features pave the way to applying this quantitative phase imaging (QPI) technique in biomedical and telemedicine applications. The imaging capabilities of our HPS-DLHM proposal have been tested by using an intricate sample of a honeybee leg, a low-absorption sample of epithelial cheek cells, a 1951 USAF test target, and smeared human erythrocytes.
Collapse
|
48
|
Nobukawa T, Maezawa M, Katano Y, Goto M, Muroi T, Hagiwara K, Ishii N. Transformation of coherence-dependent bokeh for incoherent digital holography. Opt Lett 2022; 47:2774-2777. [PMID: 35648927 DOI: 10.1364/ol.460108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
Incoherent digital holography (IDH) enables the recording of holograms with incoherent light. However, there is unnatural bokeh with ringing on reconstructed 2D images, owing to the diffraction calculation based on the coherent nature of the light. Thus, we propose a transformation method that converts it into incoherent bokeh. This proposed method can generate 2D images without ringing from recorded holograms through a virtual incoherent imaging system, while focusing on the non-linearity problem of reconstruction distances in IDH. Flexible depth-of-field control is also made possible by the judicious selection of parameters in this method. A proof-of-principle demonstration verifies its feasibility.
Collapse
|
49
|
Zhang X, Pang Y, Chen T, Tu K, Feng Q, Lv G, Wang Z. Holographic super multi-view Maxwellian near-eye display with eyebox expansion. Opt Lett 2022; 47:2530-2533. [PMID: 35561392 DOI: 10.1364/ol.456124] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 04/23/2022] [Indexed: 06/15/2023]
Abstract
A holographic super multi-view (SMV) Maxwellian display based on flexible wavefront modulation is proposed for the first time, to the best of our knowledge. It solves the issue that the previous holographic Maxwellian displays could not provide depth cues for monocular vision. Different from the previous methods, two or more parallax images are multiplied by quadric phase distributions and converged to the viewpoints existing in the pupil to provide 3-D vision. A time division method is proposed to eliminate the cross talk caused by the coherence of different spherical waves. Experiments demonstrate that the proposed method can accurately reconstruct images at different depth without cross talk. The proposed method inherits the previous holographic Maxwellian display's advantages of flexible viewpoint position adjustment and large depth of field (DOF). Superior to geometric optics based SMV displays, the proposed system is compact without lens aberration since only a single spatial light modulator (SLM) is needed without any additional optical elements.
Collapse
|
50
|
Dai S, Mi J, Dou J, Yu T, Zhang M, Di J, Zhang J, Zhao J. Dual-wavelength surface plasmon resonance holographic microscopy for simultaneous measurements of cell-substrate distance and cytoplasm refractive index. Opt Lett 2022; 47:2306-2309. [PMID: 35486786 DOI: 10.1364/ol.449400] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Accepted: 03/30/2022] [Indexed: 06/14/2023]
Abstract
Studying the basic characteristics of living cells is of great significance in biological research. Bio-physical parameters, including cell-substrate distance and cytoplasm refractive index (RI), can be used to reveal cellular properties. In this Letter, we propose a dual-wavelength surface plasmon resonance holographic microscopy (SPRHM) to simultaneously measure the cell-substrate distance and cytoplasm RI of live cells in a wide-field and non-intrusive manner. Phase-contrast surface plasmon resonance (SPR) images of individual cells at wavelengths of 632.8 nm and 690 nm are obtained using an optical system. The two-dimensional distributions of cell-substrate distance and cytoplasm RI are then demodulated from the phase-contrast SPR images of the cells. MDA-MB-231 cells and IDG-SW3 cells are experimentally measured to verify the feasibility of this approach. Our method provides a useful tool in biological fields for dual-parameter detection and characterization of live cells.
Collapse
|