1
|
Ou Z, Duh YS, Rommelfanger NJ, Keck CHC, Jiang S, Brinson K, Zhao S, Schmidt EL, Wu X, Yang F, Cai B, Cui H, Qi W, Wu S, Tantry A, Roth R, Ding J, Chen X, Kaltschmidt JA, Brongersma ML, Hong G. Achieving optical transparency in live animals with absorbing molecules. Science 2024; 385:eadm6869. [PMID: 39236186 DOI: 10.1126/science.adm6869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 07/12/2024] [Indexed: 09/07/2024]
Abstract
Optical imaging plays a central role in biology and medicine but is hindered by light scattering in live tissue. We report the counterintuitive observation that strongly absorbing molecules can achieve optical transparency in live animals. We explored the physics behind this observation and found that when strongly absorbing molecules dissolve in water, they can modify the refractive index of the aqueous medium through the Kramers-Kronig relations to match that of high-index tissue components such as lipids. We have demonstrated that our straightforward approach can reversibly render a live mouse body transparent to allow visualization of a wide range of deep-seated structures and activities. This work suggests that the search for high-performance optical clearing agents should focus on strongly absorbing molecules.
Collapse
Affiliation(s)
- Zihao Ou
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Yi-Shiou Duh
- Department of Physics, Stanford University, Stanford, CA, USA
- Geballe Laboratory for Advanced Materials, Stanford University, Stanford, CA, USA
| | - Nicholas J Rommelfanger
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Applied Physics, Stanford University, Stanford, CA, USA
| | - Carl H C Keck
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Shan Jiang
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Kenneth Brinson
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Su Zhao
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Elizabeth L Schmidt
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Xiang Wu
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Fan Yang
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Betty Cai
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
| | - Han Cui
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Wei Qi
- Department of Biology, Stanford University, Stanford, CA, USA
| | - Shifu Wu
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| | - Adarsh Tantry
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Neurosciences IDP Graduate program, Stanford University, Stanford, CA
| | - Richard Roth
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, USA
| | - Jun Ding
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, USA
- Department of Neurology and Neurological Sciences, Stanford University, Stanford, CA, USA
| | - Xiaoke Chen
- Department of Biology, Stanford University, Stanford, CA, USA
| | - Julia A Kaltschmidt
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA, USA
| | - Mark L Brongersma
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Geballe Laboratory for Advanced Materials, Stanford University, Stanford, CA, USA
- Department of Applied Physics, Stanford University, Stanford, CA, USA
| | - Guosong Hong
- Department of Materials Science and Engineering, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
| |
Collapse
|
2
|
Xia F, Rimoli CV, Akemann W, Ventalon C, Bourdieu L, Gigan S, de Aguiar HB. Neurophotonics beyond the surface: unmasking the brain's complexity exploiting optical scattering. NEUROPHOTONICS 2024; 11:S11510. [PMID: 38617592 PMCID: PMC11014413 DOI: 10.1117/1.nph.11.s1.s11510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 03/07/2024] [Accepted: 03/14/2024] [Indexed: 04/16/2024]
Abstract
The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.
Collapse
Affiliation(s)
- Fei Xia
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| | - Caio Vaz Rimoli
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Walther Akemann
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Cathie Ventalon
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Laurent Bourdieu
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Sylvain Gigan
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| | - Hilton B. de Aguiar
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| |
Collapse
|
3
|
Shimojo Y, Nishimura T, Tsuruta D, Ozawa T. Ultralow radiant exposure of a short-pulsed laser to disrupt melanosomes with localized thermal damage through a turbid medium. Sci Rep 2024; 14:20112. [PMID: 39209990 PMCID: PMC11362287 DOI: 10.1038/s41598-024-70807-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 08/21/2024] [Indexed: 09/04/2024] Open
Abstract
Short-pulsed lasers can treat dermal pigmented lesions through selective photothermolysis. The irradiated light experiences multiple scattering by the skin and is absorbed by abnormal melanosomes as well as by normal blood vessels above the target. Because the fluence is extremely high, the absorbed light can cause thermal damage to the adjacent tissue components, leading to complications. To minimize radiant exposure and reduce the risk of burns, a model of the melanosome-disruption threshold fluence (MDTF) has been developed that accounts for the light-propagation efficiency in the skin. However, the light-propagation efficiency is attenuated because of multiple scattering, which limits the extent to which the radiant exposure required for treatment can be reduced. Here, this study demonstrates the principle of melanosome disruption with localized thermal damage through a turbid medium by ultralow radiant exposure of a short-pulsed laser. The MDTF model was combined with a wavefront-shaping technique to design an irradiation condition that can increase the light-propagation efficiency to the target. Under this irradiation condition, melanosomes were disrupted at a radiant exposure 25 times lower than the minimal value used in conventional laser treatments. Furthermore, almost no thermal damage to the skin was confirmed through a numerical simulation. These experimental and numerical results show the potential for noninvasive melanosome disruption and may lead to the improvement of the safety of short-pulsed laser treatment.
Collapse
Affiliation(s)
- Yu Shimojo
- Derpartment of Dermatology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahimachi, Abeno, Osaka, 545-8585, Japan.
- Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka, 565-0871, Japan.
- Research Fellow of Japan Society for the Promotion of Science, 5-3-1 Kojimachi, Chiyoda, Tokyo, 102-0083, Japan.
| | - Takahiro Nishimura
- Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Daisuke Tsuruta
- Derpartment of Dermatology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahimachi, Abeno, Osaka, 545-8585, Japan
| | - Toshiyuki Ozawa
- Derpartment of Dermatology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahimachi, Abeno, Osaka, 545-8585, Japan
| |
Collapse
|
4
|
Yu LY, You S. High-fidelity and high-speed wavefront shaping by leveraging complex media. SCIENCE ADVANCES 2024; 10:eadn2846. [PMID: 38959310 PMCID: PMC11221521 DOI: 10.1126/sciadv.adn2846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 05/29/2024] [Indexed: 07/05/2024]
Abstract
High-precision light manipulation is crucial for delivering information through complex media. However, existing spatial light modulation devices face a fundamental speed-fidelity tradeoff. Digital micromirror devices have emerged as a promising candidate for high-speed wavefront shaping but at the cost of compromised fidelity due to the limited control degrees of freedom. Here, we leverage the sparse-to-random transformation through complex media to overcome the dimensionality limitation of spatial light modulation devices. We demonstrate that pattern compression by sparsity-constrained wavefront optimization allows sparse and robust wavefront representations in complex media, improving the projection fidelity without sacrificing frame rate, hardware complexity, or optimization time. Our method is generalizable to different pattern types and complex media, supporting consistent performance with up to 89% and 126% improvements in projection accuracy and speckle suppression, respectively. The proposed optimization framework could enable high-fidelity high-speed wavefront shaping through different scattering media and platforms without changes to the existing holographic setups, facilitating a wide range of physics and real-world applications.
Collapse
Affiliation(s)
- Li-Yu Yu
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | | |
Collapse
|
5
|
Aizik D, Levin A. Non-invasive and noise-robust light focusing using confocal wavefront shaping. Nat Commun 2024; 15:5575. [PMID: 38956030 PMCID: PMC11219997 DOI: 10.1038/s41467-024-49697-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 06/11/2024] [Indexed: 07/04/2024] Open
Abstract
Wavefront-shaping is a promising approach for imaging fluorescent targets deep inside scattering tissue despite strong aberrations. It enables focusing an incoming illumination into a single spot inside tissue, as well as correcting the outgoing light scattered from the tissue. Previously, wavefront shaping modulations have been successively estimated using feedback from strong fluorescent beads, which have been manually added to a sample. However, such algorithms do not generalize to neurons whose emission is orders of magnitude weaker. We suggest a wavefront shaping approach that works with a confocal modulation of both the illumination and imaging arms. Since the aberrations are corrected in the optics before the detector, the low photon budget is directed into a single sensor spot and detected with high signal-noise ratio. We derive a score function for modulation evaluation from mathematical principles, and successfully use it to image fluorescence neurons, despite scattering through thick tissue.
Collapse
Affiliation(s)
- Dror Aizik
- Department of Electrical and Computer Engineering, Technion, Haifa, Israel.
| | - Anat Levin
- Department of Electrical and Computer Engineering, Technion, Haifa, Israel
| |
Collapse
|
6
|
Zhao Z, Zhu R, Yang Y, Wang H, Wang J, Han G. Optical Analysis Method for Turbid Media Based on Wedge-Shaped Cells at Different Angles. ACS OMEGA 2024; 9:18119-18126. [PMID: 38680373 PMCID: PMC11044227 DOI: 10.1021/acsomega.3c09525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 02/09/2024] [Accepted: 02/20/2024] [Indexed: 05/01/2024]
Abstract
The wedge-shaped sample cell, by offering a comprehensive representation of scattering information in turbid media, significantly enhances the informational content conveyed by spectral images compared to flat sample cells. To further refine the accuracy of turbid medium component detection utilizing wedge-shaped sample cells, this work undertakes modeling and analysis of the influence of different wedge angles on detection precision. In this study, employing a 5° gradient in the incident angle of light, we investigate the impact of incident angles ranging from 10 to 45° on the turbid medium component analysis. Validation experiments are performed by utilizing solutions of Indian ink and fat emulsion at varying ratios. Experimental findings demonstrate that under identical experimental conditions, the wedge-shaped sample cell model at an incident angle of 35° yields optimal analysis results. Utilizing partial least-squares regression (PLSR) for the corresponding optical parameters, the highest value of Rp reached 0.980, with an RMSEP of 0.002. When compared to the model with a 30° incident angle, Rp increased by 0.033, and RMSEP decreased by 0.008. In comparison to the flat sample cell model, Rp increased by 0.041, and RMSEP decreased by 0.004. This study, through continuous variation of wedge angles and PLSR modeling and prediction, further enhances the accuracy of turbid medium component detection, laying an experimental foundation for subsequent analysis of turbid medium components based on wedge-shaped sample cells.
Collapse
Affiliation(s)
- Zhe Zhao
- School
of Electronics and Information Engineering, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| | - Ruina Zhu
- School
of Life Sciences, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| | - Yuyan Yang
- School
of Electronics and Information Engineering, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| | - Huiquan Wang
- School
of Life Sciences, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| | - Jinhai Wang
- School
of Life Sciences, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| | - Guang Han
- School
of Life Sciences, Tiangong University, Tianjin 300387, China
- Tianjin
Key Laboratory of Quality Control and Evaluation Technology for Medical
Devices, Tianjin 300387,China
| |
Collapse
|
7
|
Xia F, Rimoli CV, Akemann W, Ventalon C, Bourdieu L, Gigan S, de Aguiar HB. Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering. ARXIV 2024:arXiv:2403.14809v1. [PMID: 38562443 PMCID: PMC10984001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.
Collapse
Affiliation(s)
- Fei Xia
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, 24 rue Lhomond, 75005 Paris, France
| | - Caio Vaz Rimoli
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, 24 rue Lhomond, 75005 Paris, France
- Institut de Biologie de l'ENS (IBENS), École Normale Supérieure, CNRS, INSERM, Université PSL, Paris, France
| | - Walther Akemann
- Institut de Biologie de l'ENS (IBENS), École Normale Supérieure, CNRS, INSERM, Université PSL, Paris, France
| | - Cathie Ventalon
- Institut de Biologie de l'ENS (IBENS), École Normale Supérieure, CNRS, INSERM, Université PSL, Paris, France
| | - Laurent Bourdieu
- Institut de Biologie de l'ENS (IBENS), École Normale Supérieure, CNRS, INSERM, Université PSL, Paris, France
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, 24 rue Lhomond, 75005 Paris, France
| | - Hilton B de Aguiar
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, 24 rue Lhomond, 75005 Paris, France
| |
Collapse
|
8
|
Lin Q, Li Z, Wang B, Zhou M, Xie Y, Wang D, Hou C, Wang R, Liu X, Sun X, Shan H, Chen Z, Wu H, Yang Y, Fei C, Chen Z. Acoustic hologram-induced virtual in vivo enhanced waveguide (AH-VIEW). SCIENCE ADVANCES 2024; 10:eadl2232. [PMID: 38354252 DOI: 10.1126/sciadv.adl2232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Accepted: 01/12/2024] [Indexed: 02/16/2024]
Abstract
Optical imaging and phototherapy in deep tissues face notable challenges due to light scattering. We use encoded acoustic holograms to generate three-dimensional acoustic fields within the target medium, enabling instantaneous and robust modulation of the volumetric refractive index, thereby noninvasively controlling the trajectory of light. Through this approach, we achieved a remarkable 24.3% increase in tissue heating rate in vitro photothermal effect tests on porcine skin. In vivo photoacoustic imaging of mouse brain vasculature exhibits an improved signal-to-noise ratio through the intact scalp and skull. These findings demonstrate that our strategy can effectively suppress light scattering in complex biological tissues by inducing low-angle scattering, achieving an effective depth reaching the millimeter scale. The versatility of this strategy extends its potential applications to neuroscience, lithography, and additive manufacturing.
Collapse
Affiliation(s)
- Qibo Lin
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Zhaoxi Li
- School of Microelectronics, Xidian University, Xi'an 710071, China
| | - Bo Wang
- Department of Biomedical Engineering, School of Basic Medical Science, Central South University, Changsha 410083, China
| | - Mengqing Zhou
- School of Microelectronics, Xidian University, Xi'an 710071, China
| | - Yang Xie
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Danfeng Wang
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Chenxue Hou
- School of Microelectronics, Xidian University, Xi'an 710071, China
| | - Runyu Wang
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Xiangdong Liu
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Xin Sun
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Han Shan
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Ziyan Chen
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Huayi Wu
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
| | - Yintang Yang
- School of Microelectronics, Xidian University, Xi'an 710071, China
| | - Chunlong Fei
- School of Microelectronics, Xidian University, Xi'an 710071, China
| | - Zeyu Chen
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, College of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China
- Furong Laboratory (Precision Medicine), Changsha 410008, China
- National Engineering Research Center of Personalized Diagnostic and Therapeutic Technology, Xiangya Hospital, Central South University, Changsha 410008, China
- Hunan Engineering Research Center of Skin Health and Disease, Xiangya Hospital, Central South University, Changsha 410008, China
| |
Collapse
|
9
|
Zhang Y, Hao H, Song L, Wang H, Li D, Bongiovanni D, Zhan J, Xiu Z, Song D, Tang L, Morandotti R, Chen Z. Nonlinear optical response of heme solutions. OPTICS EXPRESS 2024; 32:5760-5769. [PMID: 38439294 DOI: 10.1364/oe.510714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/23/2024] [Indexed: 03/06/2024]
Abstract
Heme is the prosthetic group for cytochrome that exists in nearly all living organisms and serves as a vital component of human red blood cells (RBCs). Tunable optical nonlinearity in suspensions of RBCs has been demonstrated previously, however, the nonlinear optical response of a pure heme (without membrane structure) solution has not been studied to our knowledge. In this work, we show optical nonlinearity in two common kinds of heme (i.e., hemin and hematin) solutions by a series of experiments and numerical simulations. We find that the mechanism of nonlinearity in heme solutions is distinct from that observed in the RBC suspensions where the nonlinearity can be easily tuned through optical power, concentration, and the solution properties. In particular, we observe an unusual phenomenon wherein the heme solution exhibits negative optical nonlinearity and render self-collimation of a focused beam at specific optical powers, enabling shape-preserving propagation of light to long distances. Our results may have potential applications in optical imaging and medical diagnosis through blood.
Collapse
|
10
|
Zeng J, Zhao W, Zhai A, Ji W, Wang D. Tight focusing through scattering media via a Bessel-basis transmission matrix. OPTICS LETTERS 2024; 49:698-701. [PMID: 38300093 DOI: 10.1364/ol.514256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 12/27/2023] [Indexed: 02/02/2024]
Abstract
The transmission matrix (TM) is a powerful tool for focusing light through scattering media. Here, we demonstrate a Bessel-basis TM that enables tight focusing through the scattering media and reduces the full width at half maximum of the focus by 23% on average, as compared to the normally used Hadamard-basis TM. To measure the Bessel-basis TM, we establish a common-path inter-mode interferometer (IMI), which can fully utilize the pixels of the spatial light modulator, leading to an enhancement in the peak-to-background intensity ratio (PBR) of the focus. Experimental results suggest that the Bessel-basis TM can achieve a tighter focus behind the scattering media, and the PBR of the focus obtained by the IMI is around 14.3% higher than that achieved using the normal peripheral reference interferometry.
Collapse
|
11
|
Wu T, Zhang Y, Blochet B, Arjmand P, Berto P, Guillon M. Single-shot digital optical fluorescence phase conjugation through forward multiple-scattering samples. SCIENCE ADVANCES 2024; 10:eadi1120. [PMID: 38241370 PMCID: PMC10798569 DOI: 10.1126/sciadv.adi1120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 12/21/2023] [Indexed: 01/21/2024]
Abstract
Aberrations and multiple scattering in biological tissues critically distort light beams into highly complex speckle patterns. In this regard, digital optical phase conjugation (DOPC) is a promising technique enabling in-depth focusing. However, DOPC becomes challenging when using fluorescent guide stars for four main reasons: the low photon budget available, the large spectral bandwidth of the fluorescent signal, the Stokes shift between the emission and the excitation wavelength, and the absence of reference beam preventing holographic measurement. Here, we demonstrate the possibility to focus a laser beam through multiple-scattering samples by measuring speckle fields in a single acquisition step with a reference-free, high-resolution wavefront sensor. By taking advantage of the large spectral bandwidth of forward multiply scattering samples, digital fluorescence phase conjugation is achieved to focus a laser beam at the excitation wavelength while measuring the broadband speckle field arising from a micrometer-sized fluorescent bead.
Collapse
Affiliation(s)
- Tengfei Wu
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
| | - Yixuan Zhang
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
| | - Baptiste Blochet
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
| | - Payvand Arjmand
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
| | - Pascal Berto
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
- Sorbonne Université, CNRS, INSERM, Institut de la Vision, 17 Rue Moreau, Paris 75012, France
- Institut Universitaire de France (IUF), Paris 75007, France
| | - Marc Guillon
- Saints-Pères Paris Institute for the Neurosciences, CNRS UMR 8003, Université Paris Cité, 45 rue des Saints-Pères, Paris 75006, France
- Institut Universitaire de France (IUF), Paris 75007, France
| |
Collapse
|
12
|
Zhao S, Rauer B, Valzania L, Dong J, Liu R, Li F, Gigan S, de Aguiar HB. Single-pixel transmission matrix recovery via two-photon fluorescence. SCIENCE ADVANCES 2024; 10:eadi3442. [PMID: 38232161 DOI: 10.1126/sciadv.adi3442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 12/19/2023] [Indexed: 01/19/2024]
Abstract
Imaging at depth in opaque materials has long been a challenge. Recently, wavefront shaping has enabled notable advance for deep imaging. Nevertheless, most noninvasive wavefront-shaping methods require cameras, lack the sensitivity for deep imaging under weak optical signals, or can only focus on a single "guidestar." Here, we retrieve the transmission matrix (TM) noninvasively using two-photon fluorescence exploiting a single-pixel detection combined with a computational framework, allowing to achieve single-target focus on multiple guidestars spread beyond the memory effect range. In addition, if we assume that memory effect correlations exist in the TM, we are able to substantially reduce the number of measurements needed.
Collapse
Affiliation(s)
- Shupeng Zhao
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Bernhard Rauer
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Lorenzo Valzania
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Jonathan Dong
- Biomedical Imaging Group, Ecole polytechnique fédérale de Lausanne (EPFL), Lausanne 1015, Switzerland
| | - Ruifeng Liu
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Fuli Li
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Hilton B de Aguiar
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| |
Collapse
|
13
|
Lin B, Fan X, Peng P, Guo Z. Dynamic polarization fusion network (DPFN) for imaging in different scattering systems. OPTICS EXPRESS 2024; 32:511-525. [PMID: 38175079 DOI: 10.1364/oe.507711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 12/12/2023] [Indexed: 01/05/2024]
Abstract
Deep learning has broad applications in imaging through scattering media. Polarization, as a distinctive characteristic of light, exhibits superior stability compared to light intensity within scattering media. Consequently, the de-scattering network trained using polarization is expected to achieve enhanced performance and generalization. For getting optimal outcomes in diverse scattering conditions, it makes sense to train expert networks tailored for each corresponding condition. Nonetheless, it is often unfeasible to acquire the corresponding data for every possible condition. And, due to the uniqueness of polarization, different polarization information representation methods have different sensitivity to different environments. As another of the most direct approaches, a generalist network can be trained with a range of polarization data from various scattering situations, however, it requires a larger network to capture the diversity of the data and a larger training set to prevent overfitting. Here, in order to achieve flexible adaptation to diverse environmental conditions and facilitate the selection of optimal polarization characteristics, we introduce a dynamic learning framework. This framework dynamically adjusts the weights assigned to different polarization components, thus effectively accommodating a wide range of scattering conditions. The proposed architecture incorporates a Gating Network (GTN) that efficiently integrates multiple polarization features and dynamically determines the suitable polarization information for various scenarios. Experimental result demonstrates that the network exhibits robust generalization capabilities across continuous scattering conditions.
Collapse
|
14
|
Liu X, Wu S, Wu H, Zhang T, Qin H, Lin Y, Li B, Jiang X, Zheng X. Fully Active Delivery of Nanodrugs In Vivo via Remote Optical Manipulation. SMALL METHODS 2024; 8:e2301112. [PMID: 37880897 DOI: 10.1002/smtd.202301112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Revised: 09/29/2023] [Indexed: 10/27/2023]
Abstract
The active delivery of nanodrugs has been a bottleneck problem in nanomedicine. While modification of nanodrugs with targeting agents can enhance their retention at the lesion location, the transportation of nanodrugs in the circulation system is still a passive process. The navigation of nanodrugs with external forces such as magnetic field has been shown to be effective for active delivery, but the existing techniques are limited to specific materials like magnetic nanoparticles. In this study, an alternative actuation method is proposed based on optical manipulation for remote navigation of nanodrugs in vivo, which is compatible with most of the common drug carriers and exhibits significantly higher manipulation precision. By the programmable scanning of the laser beam, the motion trajectory and velocity of the nanodrugs can be precisely controlled in real time, making it possible for intelligent drug delivery, such as inverse-flow transportation, selective entry into specific vascular branch, and dynamic circumvention across obstacles. In addition, the controlled mass delivery of nanodrugs can be realized through indirect actuation by the microflow field. The developed optical manipulation method provides a new solution for the active delivery of nanodrugs, with promising potential for the treatment of blood diseases such as leukemia and thrombosis.
Collapse
Affiliation(s)
- Xiaoshuai Liu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Shuai Wu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Huaying Wu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Tiange Zhang
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Haifeng Qin
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Yufeng Lin
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Baojun Li
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| | - Xiqun Jiang
- College of Chemistry and Chemical Engineering, Nanjing University, Nanjing, 210023, China
| | - Xianchuang Zheng
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of Nanophotonics, Jinan University, Guangzhou, 511443, China
| |
Collapse
|
15
|
Ding C, Shao R, He Q, Li LS, Yang J. Wavefront shaping improves the transparency of the scattering media: a review. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11507. [PMID: 38089445 PMCID: PMC10711682 DOI: 10.1117/1.jbo.29.s1.s11507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 11/21/2023] [Accepted: 11/22/2023] [Indexed: 12/18/2023]
Abstract
Significance Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research. Aim To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress. Approach The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed. Results Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future. Conclusion The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.
Collapse
Affiliation(s)
- Chunxu Ding
- Shanghai Jiao Tong University, School of Electronic Information and Electrical Engineering, Shanghai, China
| | - Rongjun Shao
- Shanghai Jiao Tong University, School of Electronic Information and Electrical Engineering, Shanghai, China
| | - Qiaozhi He
- Shanghai Jiao Tong University, Institute of Marine Equipment, Shanghai, China
| | - Lei S. Li
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Jiamiao Yang
- Shanghai Jiao Tong University, School of Electronic Information and Electrical Engineering, Shanghai, China
- Shanghai Jiao Tong University, Institute of Marine Equipment, Shanghai, China
| |
Collapse
|
16
|
Blochet B, Akemann W, Gigan S, Bourdieu L. Fast wavefront shaping for two-photon brain imaging with multipatch correction. Proc Natl Acad Sci U S A 2023; 120:e2305593120. [PMID: 38100413 PMCID: PMC10743372 DOI: 10.1073/pnas.2305593120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 10/19/2023] [Indexed: 12/17/2023] Open
Abstract
Nonlinear fluorescence microscopy promotes in-vivo optical imaging of cellular structure at diffraction-limited resolution deep inside scattering biological tissues. Active compensation of tissue-induced aberrations and light scattering through adaptive wavefront correction further extends the accessible depth by restoring high resolution at large depth. However, those corrections are only valid over a very limited field of view within the angular memory effect. To overcome this limitation, we introduce an acousto-optic light modulation technique for fluorescence imaging with simultaneous wavefront correction at pixel scan speed. Biaxial wavefront corrections are first learned by adaptive optimization at multiple locations in the image field. During image acquisition, the learned corrections are then switched on the fly according to the position of the excitation focus during the raster scan. The proposed microscope is applied to in vivo transcranial neuron imaging and demonstrates multi-patch correction of thinned skull-induced aberrations and scattering at 40-kHz data acquisition speed.
Collapse
Affiliation(s)
- Baptiste Blochet
- Institut de Biologie de l’École Normale Supérieure, École Normale Supérieure, CNRS, INSERM, Université Paris Sciences et Lettres, Paris75005, France
- Laboratoire Kastler Brossel, École Normale Supérieure-Université Paris Sciences et Lettres, CNRS, Sorbonne Université, Collège de France, Paris75005, France
| | - Walther Akemann
- Institut de Biologie de l’École Normale Supérieure, École Normale Supérieure, CNRS, INSERM, Université Paris Sciences et Lettres, Paris75005, France
- Laboratoire Kastler Brossel, École Normale Supérieure-Université Paris Sciences et Lettres, CNRS, Sorbonne Université, Collège de France, Paris75005, France
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, École Normale Supérieure-Université Paris Sciences et Lettres, CNRS, Sorbonne Université, Collège de France, Paris75005, France
| | - Laurent Bourdieu
- Institut de Biologie de l’École Normale Supérieure, École Normale Supérieure, CNRS, INSERM, Université Paris Sciences et Lettres, Paris75005, France
| |
Collapse
|
17
|
Rates A, Lagendijk A, Adam AJL, IJzerman WL, Vos WL. Wavefront shaping through a free-form scattering object. OPTICS EXPRESS 2023; 31:43351-43361. [PMID: 38178430 DOI: 10.1364/oe.505974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 11/23/2023] [Indexed: 01/06/2024]
Abstract
Wavefront shaping is a technique to study and control light transport inside scattering media. Wavefront shaping is considered to be applicable to any complex material, yet in most previous studies, the only sample geometries that are studied are slabs or wave-guides. In this paper, we study how macroscopic changes in the sample shape affect light scattering using the wavefront shaping technique. Using a flexible scattering material, we optimize the intensity of light in a focusing spot using wavefront shaping and record the optimized pattern, comparing the enhancement for different curvatures and beam radii. We validate our hypothesis that wavefront shaping has a similar enhancement regardless of the free-form shape of the sample and thus offers relevant potential for industrial applications. We propose a new figure of merit to evaluate the performance of wavefront shaping for different shapes. Surprisingly, based on this figure of merit, we observe that for this particular sample, wavefront shaping has a slightly better performance for a free-form shape than for a slab shape.
Collapse
|
18
|
Shi Y, Sheng W, Fu Y, Liu Y. Overlapping speckle correlation algorithm for high-resolution imaging and tracking of objects in unknown scattering media. Nat Commun 2023; 14:7742. [PMID: 38007546 PMCID: PMC10676403 DOI: 10.1038/s41467-023-43674-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 11/16/2023] [Indexed: 11/27/2023] Open
Abstract
Optical imaging in scattering media is important to many fields but remains challenging. Recent methods have focused on imaging through thin scattering layers or thicker scattering media with prior knowledge of the sample, but this still limits practical applications. Here, we report an imaging method named 'speckle kinetography' that enables high-resolution imaging in unknown scattering media with thicknesses up to about 6 transport mean free paths. Speckle kinetography non-invasively records a series of incoherent speckle images accompanied by object motion and the inherently retained object information is extracted through an overlapping speckle correlation algorithm to construct the object's autocorrelation for imaging. Under single-colour light-emitting diode, white light, and fluorescence illumination, we experimentally demonstrate 1 μm resolution imaging and tracking of objects moving in scattering samples, while reducing the requirements for prior knowledge. We anticipate this method will enable imaging in currently inaccessible scenarios.
Collapse
Affiliation(s)
- Yaoyao Shi
- College of Physics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
- College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
- Key Laboratory of Radar Imaging and Microwave Photonics, Ministry of Education, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
| | - Wei Sheng
- College of Physics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China
| | - Yangyang Fu
- College of Physics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
| | - Youwen Liu
- College of Physics, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China.
| |
Collapse
|
19
|
Liu Y, Cui G, Shi S, Xiang Q, Zhao J, Hou C. Super-resolution imaging through scattering media based on improved triple correlation recursion and deterministic iterative estimation. APPLIED OPTICS 2023; 62:8642-8653. [PMID: 38037981 DOI: 10.1364/ao.500821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 10/21/2023] [Indexed: 12/02/2023]
Abstract
Iterative phase retrieval algorithms are commonly used in computational techniques and optimization methods to obtain the reconstruction of objects hidden behind opaque scattering media. However, these methods are susceptible to converging to incorrect local minima, and the calculation results tend to be unstable. In this paper, a triple-correlation-based super-resolution imaging (TCSI) framework is proposed to achieve single-shot imaging of unknown objects hidden behind the scattering medium. The amplitude spectrum of the object is obtained by a speckle correlation (SC) method. Iterative relaxation recursion (IRR) sufficiently extracts object information from the triple correlation (TC) of the speckle patterns, serving as the prior initial guess for the iterative estimation algorithm (IE) to obtain a deterministic phase spectrum. Blur correction (BC) is then applied to the diffraction-limited image to achieve super-resolution imaging. Experimental results demonstrate that the flexible framework could effectively overcome the influence of speckle resolution and outperform traditional methods in terms of performance. Our approach provides a basis for non-invasively visualizing various samples behind scattering media.
Collapse
|
20
|
Liu X, Wu H, Wu S, Qin H, Zhang T, Lin Y, Zheng X, Li B. Optically Programmable Living Microrouter in Vivo. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2304103. [PMID: 37749869 PMCID: PMC10646234 DOI: 10.1002/advs.202304103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 08/13/2023] [Indexed: 09/27/2023]
Abstract
With high reconfigurability and swarming intelligence, programmable medical micromachines (PMMs) represent a revolution in microrobots for executing complex coordinated tasks, especially for dynamic routing of various targets along their respective routes. However, it is difficult to achieve a biocompatible implantation into the body due to their exogenous building blocks. Herein, a living microrouter based on an organic integration of endogenous red blood cells (RBCs), programmable scanning optical tweezers and flexible optofluidic strategy is reported. By harvesting energy from a designed optical force landscape, five RBCs are optically rotated in a controlled velocity and direction, under which, a specific actuation flow is achieved to exert the well-defined hydrodynamic forces on various biological targets, thus enabling a selective routing by integrating three successive functions, i.e., dynamic input, inner processing, and controlled output. Benefited from the optofluidic manipulation, various blood cells, such as the platelets and white blood cells, are transported toward the damaged vessel and cell debris for the dynamic hemostasis and targeted clearance, respectively. Moreover, the microrouter enables a precise transport of nanodrugs for active and targeted delivery in a large quantity. The proposed RBC microrouter might provide a biocompatible medical platform for cell separation, drug delivery, and immunotherapy.
Collapse
Affiliation(s)
- Xiaoshuai Liu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Huaying Wu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Shuai Wu
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Haifeng Qin
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Tiange Zhang
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Yufeng Lin
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Xianchuang Zheng
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| | - Baojun Li
- Guangdong Provincial Key Laboratory of Nanophotonic Manipulation, Institute of NanophotonicsJinan UniversityGuangzhou511443China
| |
Collapse
|
21
|
Mashiko R, Tanida J, Naruse M, Horisaki R. Extrapolated speckle-correlation imaging with an untrained deep neural network. APPLIED OPTICS 2023; 62:8327-8333. [PMID: 38037936 DOI: 10.1364/ao.496924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 10/09/2023] [Indexed: 12/02/2023]
Abstract
We present a method for speckle-correlation imaging with an extended field of view to observe spatially non-sparse objects. In speckle-correlation imaging, an object is recovered from a non-invasively captured image through a scattering medium by assuming shift-invariance of the optical process called the memory effect. The field of view of speckle-correlation imaging is limited by the size of the memory effect, and it can be extended by extrapolating the speckle correlation in the reconstruction process. However, spatially sparse objects are assumed in the inversion process because of its severe ill-posedness. To address this issue, we introduce a deep image prior, which regularizes the image statistics by using the structure of an untrained convolutional neural network, to speckle-correlation imaging. We experimentally demonstrated the proposed method and showed the possibility of extending the method to imaging through scattering media.
Collapse
|
22
|
Pandya R, Valzania L, Dorchies F, Xia F, Mc Hugh J, Mathieson A, Tan HJ, Parton TG, Godeffroy L, Mazloomian K, Miller TS, Kanoufi F, De Volder M, Tarascon JM, Gigan S, de Aguiar HB, Grimaud A. Three-dimensional operando optical imaging of particle and electrolyte heterogeneities inside Li-ion batteries. NATURE NANOTECHNOLOGY 2023; 18:1185-1194. [PMID: 37591934 DOI: 10.1038/s41565-023-01466-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 06/20/2023] [Indexed: 08/19/2023]
Abstract
Understanding (de)lithiation heterogeneities in battery materials is key to ensure optimal electrochemical performance. However, this remains challenging due to the three-dimensional morphology of electrode particles, the involvement of both solid- and liquid-phase reactants and a range of relevant timescales (seconds to hours). Here we overcome this problem and demonstrate the use of confocal microscopy for the simultaneous three-dimensional operando measurement of lithium-ion dynamics in individual agglomerate particles, and the electrolyte in batteries. We examine two technologically important cathode materials: LixCoO2 and LixNi0.8Mn0.1Co0.1O2. The surface-to-core transport velocity of Li-phase fronts and volume changes are captured as a function of cycling rate. Additionally, we visualize heterogeneities in the bulk and at agglomerate surfaces during cycling, and image microscopic liquid electrolyte concentration gradients. We discover that surface-limited reactions and intra-agglomerate competing rates control (de)lithiation and structural heterogeneities in agglomerate-based electrodes. Importantly, the conditions under which optical imaging can be performed inside the complex environments of battery electrodes are outlined.
Collapse
Affiliation(s)
- Raj Pandya
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, Paris, France.
- Department of Physics, Cavendish Laboratory, University of Cambridge, Cambridge, UK.
| | - Lorenzo Valzania
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, Paris, France
| | - Florian Dorchies
- Chimie du Solide et de l'Energie, UMR 8260, Collège de France, Paris, France
- Réseau sur le stockage Electrochimique de l'Energie (RS2E), Amiens, France
| | - Fei Xia
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, Paris, France
| | - Jeffrey Mc Hugh
- Neuroglial Interactions in Cerebral Physiology and Pathologies, Center for Interdisciplinary Research in Biology, Collège de France, CNRS, INSERM, Labex Memolife, Université PSL, Paris, France
| | - Angus Mathieson
- Department of Physics, Cavendish Laboratory, University of Cambridge, Cambridge, UK
- Department of Engineering, University of Cambridge, Cambridge, UK
| | - Hwee Jien Tan
- Department of Engineering, University of Cambridge, Cambridge, UK
| | - Thomas G Parton
- Yusuf Hamied Department of Chemistry, University of Cambridge, Cambridge, UK
| | | | - Katrina Mazloomian
- Electrochemical Innovation Lab Department of Chemical Engineering, UCL, London, UK
| | - Thomas S Miller
- Electrochemical Innovation Lab Department of Chemical Engineering, UCL, London, UK
| | | | | | - Jean-Marie Tarascon
- Chimie du Solide et de l'Energie, UMR 8260, Collège de France, Paris, France
- Réseau sur le stockage Electrochimique de l'Energie (RS2E), Amiens, France
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, Paris, France.
| | - Hilton B de Aguiar
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France, Paris, France.
| | - Alexis Grimaud
- Chimie du Solide et de l'Energie, UMR 8260, Collège de France, Paris, France.
- Réseau sur le stockage Electrochimique de l'Energie (RS2E), Amiens, France.
- Department of Chemistry, Merkert Chemistry Center, Boston College, Chestnut Hill, MA, USA.
| |
Collapse
|
23
|
Pierangeli D, Perini G, Palmieri V, Grecco I, Friggeri G, De Spirito M, Papi M, DelRe E, Conti C. Extreme transport of light in spheroids of tumor cells. Nat Commun 2023; 14:4662. [PMID: 37537177 PMCID: PMC10400595 DOI: 10.1038/s41467-023-40379-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 07/14/2023] [Indexed: 08/05/2023] Open
Abstract
Extreme waves are intense and unexpected wavepackets ubiquitous in complex systems. In optics, these rogue waves are promising as robust and noise-resistant beams for probing and manipulating the underlying material. Localizing large optical power is crucial especially in biomedical systems, where, however, extremely intense beams have not yet been observed. We here discover that tumor-cell spheroids manifest optical rogue waves when illuminated by randomly modulated laser beams. The intensity of light transmitted through bio-printed three-dimensional tumor models follows a signature Weibull statistical distribution, where extreme events correspond to spatially-localized optical modes propagating within the cell network. Experiments varying the input beam power and size indicate that the rogue waves have a nonlinear origin. We show that these nonlinear optical filaments form high-transmission channels with enhanced transmission. They deliver large optical power through the tumor spheroid, and can be exploited to achieve a local temperature increase controlled by the input wave shape. Our findings shed light on optical propagation in biological aggregates and demonstrate how nonlinear extreme event formation allows light concentration in deep tissues, paving the way to using rogue waves in biomedical applications, such as light-activated therapies.
Collapse
Affiliation(s)
- Davide Pierangeli
- Institute for Complex Systems, National Research Council, Rome, 00185, Italy.
- Physics Department, Sapienza University of Rome, Rome, 00185, Italy.
| | - Giordano Perini
- Neuroscience Department, University Cattolica del Sacro Cuore, Rome, 00168, Italy
- IRCSS, Fondazione Policlinico Universitario Agostino Gemelli, Rome, 00168, Italy
| | - Valentina Palmieri
- Institute for Complex Systems, National Research Council, Rome, 00185, Italy
- Neuroscience Department, University Cattolica del Sacro Cuore, Rome, 00168, Italy
| | - Ivana Grecco
- Physics Department, Sapienza University of Rome, Rome, 00185, Italy
| | - Ginevra Friggeri
- Neuroscience Department, University Cattolica del Sacro Cuore, Rome, 00168, Italy
- IRCSS, Fondazione Policlinico Universitario Agostino Gemelli, Rome, 00168, Italy
| | - Marco De Spirito
- Neuroscience Department, University Cattolica del Sacro Cuore, Rome, 00168, Italy
- IRCSS, Fondazione Policlinico Universitario Agostino Gemelli, Rome, 00168, Italy
| | - Massimiliano Papi
- Neuroscience Department, University Cattolica del Sacro Cuore, Rome, 00168, Italy.
- IRCSS, Fondazione Policlinico Universitario Agostino Gemelli, Rome, 00168, Italy.
| | - Eugenio DelRe
- Physics Department, Sapienza University of Rome, Rome, 00185, Italy
| | - Claudio Conti
- Physics Department, Sapienza University of Rome, Rome, 00185, Italy
| |
Collapse
|
24
|
Mestre-Torà B, Duocastella M. Enhanced light focusing inside scattering media with shaped ultrasound. Sci Rep 2023; 13:11511. [PMID: 37460784 DOI: 10.1038/s41598-023-38598-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 07/11/2023] [Indexed: 07/20/2023] Open
Abstract
Light focusing is the primary enabler of various scientific and industrial processes including laser materials processing and microscopy. However, the scattering of light limits the depth at which current methods can operate inside heterogeneous media such as biological tissue, liquid emulsions, and composite materials. Several approaches have been developed to address this issue, but they typically come at the cost of losing spatial or temporal resolution, or increased invasiveness. Here, we show that ultrasound waves featuring a Bessel-like profile can locally modulate the optical properties of a turbid medium to facilitate light guiding. Supported by wave optics and Monte Carlo simulations, we demonstrate how ultrasound enhances light focusing a factor of 7 compared to conventional methods based on placing optical elements outside the complex medium. Combined with point-by-point scanning, images of samples immersed in turbid media with an optical density up to 15, similar to that of weakly scattering biological tissue, can be reconstructed. The quasi-instantaneous generation of the shaped-ultrasound waves, together with the possibility to use transmission and reflection architectures, can pave the way for the real-time control of light inside living tissue.
Collapse
Affiliation(s)
- Blanca Mestre-Torà
- Department of Applied Physics, Universitat de Barcelona, C/Martí i Franquès 1, 08028, Barcelona, Spain
| | - Martí Duocastella
- Department of Applied Physics, Universitat de Barcelona, C/Martí i Franquès 1, 08028, Barcelona, Spain.
- Institut de Nanociència i Nanotecnologia (In2UB), Universitat de Barcelona, 08028, Barcelona, Spain.
| |
Collapse
|
25
|
Ren Y, Jian J, Tan W, Wang J, Chen T, Zhang H, Xia W. Single-shot decoherence polarization gated imaging through turbid media. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2023; 94:073706. [PMID: 37486200 DOI: 10.1063/5.0152654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 07/09/2023] [Indexed: 07/25/2023]
Abstract
We propose a method for imaging through a turbid medium by using a single-shot decoherence polarization gate (DPG). The DPG is made up of a polarizer, an analyzer, and a weakly scattering medium. Contrary to intuition, we discover that the preferential utilization of sparsely scattered photons by introducing weakly scattering mediums can lead to better image quality. The experimental results show that the visibilities of the images acquired from the DPG imaging method are obviously improved. The contrast of the bar can be increased by 50% by the DPG imaging technique. Furthermore, we study the effect of the volume concentration of the weakly scattering medium on the speckle suppression and the enhancement of the visibilities of the images. The variances of the contrasts of the image show that there exists an optimum optical depth (∼0.8) of the weakly scattering medium for DPG imaging through a specific turbid medium.
Collapse
Affiliation(s)
- Yuhu Ren
- School of Physics and Technology, University of Jinan, Shandong, Jinan 250022, China
| | - Jimo Jian
- Qilu Hospital of Shandong University, Shandong, Jinan 250012, China
| | - Wenjiang Tan
- Key Laboratory for Physical Electronics and Devices of the Ministry of Education & Shaanxi Key Lab of Information Photonic Technique, School of Electronics and Information Engineering, Xi'an Jiaotong University, Xianning-xilu 28, Xi'an 710049, China
| | - Jing Wang
- School of Physics and Technology, University of Jinan, Shandong, Jinan 250022, China
| | - Tao Chen
- School of Physics and Technology, University of Jinan, Shandong, Jinan 250022, China
| | - Haikun Zhang
- School of Physics and Technology, University of Jinan, Shandong, Jinan 250022, China
| | - Wei Xia
- School of Physics and Technology, University of Jinan, Shandong, Jinan 250022, China
| |
Collapse
|
26
|
Feng BY, Guo H, Xie M, Boominathan V, Sharma MK, Veeraraghavan A, Metzler CA. NeuWS: Neural wavefront shaping for guidestar-free imaging through static and dynamic scattering media. SCIENCE ADVANCES 2023; 9:eadg4671. [PMID: 37379386 DOI: 10.1126/sciadv.adg4671] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 05/23/2023] [Indexed: 06/30/2023]
Abstract
Diffraction-limited optical imaging through scattering media has the potential to transform many applications such as airborne and space-based imaging (through the atmosphere), bioimaging (through skin and human tissue), and fiber-based imaging (through fiber bundles). Existing wavefront shaping methods can image through scattering media and other obscurants by optically correcting wavefront aberrations using high-resolution spatial light modulators-but these methods generally require (i) guidestars, (ii) controlled illumination, (iii) point scanning, and/or (iv) statics scenes and aberrations. We propose neural wavefront shaping (NeuWS), a scanning-free wavefront shaping technique that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors. We experimentally demonstrate guidestar-free, wide field-of-view, high-resolution, diffraction-limited imaging of extended, nonsparse, and static/dynamic scenes captured through static/dynamic aberrations.
Collapse
Affiliation(s)
- Brandon Y Feng
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| | - Haiyun Guo
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Mingyang Xie
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| | - Vivek Boominathan
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Manoj K Sharma
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Ashok Veeraraghavan
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Christopher A Metzler
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| |
Collapse
|
27
|
Soldevila F, Moretti C, Nöbauer T, Sarafraz H, Vaziri A, Gigan S. Functional imaging through scattering medium via fluorescence speckle demixing and localization. OPTICS EXPRESS 2023; 31:21107-21117. [PMID: 37381218 PMCID: PMC10316750 DOI: 10.1364/oe.487768] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 05/04/2023] [Accepted: 05/28/2023] [Indexed: 06/30/2023]
Abstract
Recently, fluorescence-based optical techniques have emerged as a powerful tool to probe information in the mammalian brain. However, tissue heterogeneities prevent clear imaging of deep neuron bodies due to light scattering. While several up-to-date approaches based on ballistic light allow to retrieve information at shallow depths inside the brain, non-invasive localization and functional imaging at depth still remains a challenge. It was recently shown that functional signals from time-varying fluorescent emitters located behind scattering samples could be retrieved by using a matrix factorization algorithm. Here we show that the seemingly information-less, low-contrast fluorescent speckle patterns recovered by the algorithm can be used to locate each individual emitter, even in the presence of background fluorescence. We test our approach by imaging the temporal activity of large groups of fluorescent sources behind different scattering phantoms mimicking biological tissues, and through a brain slice with a thickness of ∼200 µm.
Collapse
Affiliation(s)
- F. Soldevila
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| | - C. Moretti
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| | - T. Nöbauer
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
| | - H. Sarafraz
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
| | - A. Vaziri
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY, USA
| | - S. Gigan
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| |
Collapse
|
28
|
Liang H, Li TJ, Luo J, Zhao J, Wang J, Wu D, Luo ZC, Shen Y. Optical focusing inside scattering media with iterative time-reversed ultrasonically encoded near-infrared light. OPTICS EXPRESS 2023; 31:18365-18378. [PMID: 37381549 DOI: 10.1364/oe.491462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 05/03/2023] [Indexed: 06/30/2023]
Abstract
Focusing light inside scattering media is a long-sought goal in optics. Time-reversed ultrasonically encoded (TRUE) focusing, which combines the advantages of biological transparency of the ultrasound and the high efficiency of digital optical phase conjugation (DOPC) based wavefront shaping, has been proposed to tackle this problem. By invoking repeated acousto-optic interactions, iterative TRUE (iTRUE) focusing can further break the resolution barrier imposed by the acoustic diffraction limit, showing great potential for deep-tissue biomedical applications. However, stringent requirements on system alignment prohibit the practical use of iTRUE focusing, especially for biomedical applications at the near-infrared spectral window. In this work, we fill this blank by developing an alignment protocol that is suitable for iTRUE focusing with a near-infrared light source. This protocol mainly contains three steps, including rough alignment with manual adjustment, fine-tuning with a high-precision motorized stage, and digital compensation through Zernike polynomials. Using this protocol, an optical focus with a peak-to-background ratio (PBR) of up to 70% of the theoretical value can be achieved. By using a 5-MHz ultrasonic transducer, we demonstrated the first iTRUE focusing using near-infrared light at 1053 nm, enabling the formation of an optical focus inside a scattering medium composed of stacked scattering films and a mirror. Quantitatively, the size of the focus decreased from roughly 1 mm to 160 µm within a few consecutive iterations and a PBR up to 70 was finally achieved. We anticipate that the capability of focusing near-infrared light inside scattering media, along with the reported alignment protocol, can be beneficial to a variety of applications in biomedical optics.
Collapse
|
29
|
Wu G, Sun Y, Yin L, Song Z, Yu W. High-definition image transmission through dynamically perturbed multimode fiber by a self-attention based neural network. OPTICS LETTERS 2023; 48:2764-2767. [PMID: 37186760 DOI: 10.1364/ol.489828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
We implement faithful multimode fiber (MMF) image transmission by a self-attention-based neural network. Compared with a real-valued artificial neural network (ANN) based on a convolutional neural network (CNN), our method utilizes a self-attention mechanism to achieve a higher image quality. The enhancement measure (EME) and structural similarity (SSIM) of the dataset collected in the experiment improved by 0.79 and 0.04; the total number of parameters can be reduced by up to 25%. To enhance the robustness of the neural network to MMF bending in image transmission, we use a simulation dataset to prove that the hybrid training method is helpful in MMF transmission of a high-definition image. Our findings may pave the way for simpler and more robust single-MMF image transmission schemes with hybrid training; SSIM on datasets under different disturbances improve by 0.18. This system has the potential to be applied to various high-demand image transmission tasks, such as endoscopy.
Collapse
|
30
|
Gao J, Wang P, Li W, Zhang X, Song C, Liu Z, Han S, Liu H. Imaging and positioning through scattering media with double-helix point spread function engineering. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:046008. [PMID: 37114201 PMCID: PMC10127513 DOI: 10.1117/1.jbo.28.4.046008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 03/17/2023] [Accepted: 04/12/2023] [Indexed: 05/18/2023]
Abstract
Significance Double-helix point spread function (DH-PSF) microscopy has been developed for three-dimensional (3D) localization and imaging at super-resolution but usually in environments with no or weak scattering. To date, super-resolution imaging through turbid media has not been reported. Aim We aim to explore the potential of DH-PSF microscopy in the imaging and localization of targets in scattering environments for improved 3D localization accuracy and imaging quality. Approach The conventional DH-PSF method was modified to accommodate the scanning strategy combined with a deconvolution algorithm. The localization of a fluorescent microsphere is determined by the center of the corresponding double spot, and the image is reconstructed from the scanned data by deconvoluting the DH-PSF. Results The resolution, i.e., the localization accuracy, was calibrated to 13 nm in the transverse plane and 51 nm in the axial direction. Penetration thickness could reach an optical thickness (OT) of 5. Proof-of-concept imaging and the 3D localization of fluorescent microspheres through an eggshell membrane and an inner epidermal membrane of an onion are presented to demonstrate the super-resolution and optical sectioning capabilities. Conclusions Modified DH-PSF microscopy can image and localize targets buried in scattering media using super-resolution. Combining fluorescent dyes, nanoparticles, and quantum dots, among other fluorescent probes, the proposed method may provide a simple solution for visualizing deeper and clearer in/through scattering media, making in situ super-resolution microscopy possible for various demanding applications.
Collapse
Affiliation(s)
- Jingjing Gao
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
- University of Chinese Academy of Sciences, Center of Materials Science and Optoelectronics Engineering, Beijing, China
| | - Pengwei Wang
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
| | - Wenwen Li
- University of Science and Technology of China, Hefei National Laboratory, Hefei, China
| | - Xuyu Zhang
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
| | - Chunyuan Song
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
- University of Chinese Academy of Sciences, Center of Materials Science and Optoelectronics Engineering, Beijing, China
| | - Zhentao Liu
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
- University of Chinese Academy of Sciences, Center of Materials Science and Optoelectronics Engineering, Beijing, China
| | - Shensheng Han
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
- University of Chinese Academy of Sciences, Center of Materials Science and Optoelectronics Engineering, Beijing, China
- University of Chinese Academy of Sciences, Hangzhou Institute for Advanced Study, Hangzhou, China
| | - Honglin Liu
- Chinese Academy of Sciences, Shanghai Institute of Optics and Fine Mechanics, Key Laboratory of Quantum Optics, Shanghai, China
- University of Chinese Academy of Sciences, Center of Materials Science and Optoelectronics Engineering, Beijing, China
- Address all correspondence to Honglin Liu,
| |
Collapse
|
31
|
Zhang Q, Hu Q, Berlage C, Kner P, Judkewitz B, Booth M, Ji N. Adaptive optics for optical microscopy [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:1732-1756. [PMID: 37078027 PMCID: PMC10110298 DOI: 10.1364/boe.479886] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 05/03/2023]
Abstract
Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.
Collapse
Affiliation(s)
- Qinrong Zhang
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| | - Qi Hu
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Caroline Berlage
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
- Humboldt-Universität zu Berlin, Institute for Biology, 10099 Berlin, Germany
| | - Peter Kner
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602, USA
| | - Benjamin Judkewitz
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
| | - Martin Booth
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Na Ji
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| |
Collapse
|
32
|
Aarav S, Fleischer JW. Using speckle correlations for single-shot 3D imaging. APPLIED OPTICS 2023; 62:D181-D186. [PMID: 37132784 DOI: 10.1364/ao.478432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Recovery of a 3D object behind a scattering medium is an important problem in many fields, including biomedical and defense applications. Speckle correlation imaging can recover objects in a single shot but contains no depth information. To date, its extension to 3D recovery has relied on multiple measurements, multi-spectral light, or pre-calibration of the speckle with a reference object. Here, we show that the presence of a point source behind the scatterer enables single-shot reconstruction of multiple objects at multiple depths. The method relies on speckle scaling from the axial memory effect, in addition to the transverse one, and recovers objects directly, without the need for phase retrieval. We provide simulation and experimental results to show object reconstructions at different depths with a single-shot measurement. We also provide theoretical principles describing the region where speckle scales with axial distance and its effects on the depth of field. Our technique will be useful where a natural point source exists, such as fluorescence imaging or car headlights in fog.
Collapse
|
33
|
Cheng Z, Li C, Khadria A, Zhang Y, Wang LV. High-gain and high-speed wavefront shaping through scattering media. NATURE PHOTONICS 2023; 17:299-305. [PMID: 37333511 PMCID: PMC10275582 DOI: 10.1038/s41566-022-01142-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 12/12/2022] [Indexed: 06/20/2023]
Abstract
Wavefront shaping (WFS) is emerging as a promising tool for controlling and focusing light in complex scattering media. The shaping system's speed, the energy gain of the corrected wavefronts, and the control degrees of freedom (DOF) are the most important metrics for WFS, especially for highly scattering and dynamic samples. Despite recent advances, current methods suffer from trade-offs that limit satisfactory performance to only one or two of these metrics. Here, we report a WFS technique that simultaneously achieves high speed, high energy gain, and high control DOF. By combining photorefractive crystal-based analog optical phase conjugation (AOPC) and stimulated emission light amplification, our technique achieves an energy gain approaching unity, more than three orders of magnitude larger than conventional AOPC. The response time of ~10 μs with about 106 control modes corresponds to an average mode time of about 0.01 ns/mode, which is more than 50 times lower than some of the fastest WFS systems to date. We anticipate that this technique will be instrumental in overcoming the optical diffusion limit in photonics and translate WFS techniques to real-world applications.
Collapse
Affiliation(s)
- Zhongtao Cheng
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Chengmingyue Li
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Anjul Khadria
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Yide Zhang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| | - Lihong V. Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, California 91125, USA
| |
Collapse
|
34
|
Bai B, Li Y, Luo Y, Li X, Çetintaş E, Jarrahi M, Ozcan A. All-optical image classification through unknown random diffusers using a single-pixel diffractive network. LIGHT, SCIENCE & APPLICATIONS 2023; 12:69. [PMID: 36894546 PMCID: PMC9998891 DOI: 10.1038/s41377-023-01116-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 02/22/2023] [Accepted: 02/22/2023] [Indexed: 06/01/2023]
Abstract
Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 87.74 ± 1.12%. We also experimentally validated our single-pixel broadband diffractive network by classifying handwritten digits "0" and "1" through a random diffuser using terahertz waves and a 3D-printed diffractive network. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.
Collapse
Affiliation(s)
- Bijie Bai
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- Bioengineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Yuhang Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- Bioengineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Yi Luo
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- Bioengineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Xurong Li
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Ege Çetintaş
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- Bioengineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Mona Jarrahi
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, California, 90095, USA.
- Bioengineering Department, University of California, Los Angeles, California, 90095, USA.
- California Nano Systems Institute (CNSI), University of California, Los Angeles, California, 90095, USA.
| |
Collapse
|
35
|
Hüpfl J, Bachelard N, Kaczvinszki M, Horodynski M, Kühmayer M, Rotter S. Optimal Cooling of Multiple Levitated Particles through Far-Field Wavefront Shaping. PHYSICAL REVIEW LETTERS 2023; 130:083203. [PMID: 36898121 DOI: 10.1103/physrevlett.130.083203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 06/07/2022] [Accepted: 01/17/2023] [Indexed: 06/18/2023]
Abstract
Light forces can be harnessed to levitate mesoscopic objects and cool them down toward their motional quantum ground state. Roadblocks on the way to scale up levitation from a single to multiple particles in close proximity are the requirements to constantly monitor the particles' positions as well as to engineer light fields that react fast and appropriately to their movements. Here, we present an approach that solves both problems at once. By exploiting the information stored in a time-dependent scattering matrix, we introduce a formalism enabling the identification of spatially modulated wavefronts, which simultaneously cool down multiple objects of arbitrary shapes. An experimental implementation is suggested based on stroboscopic scattering-matrix measurements and time-adaptive injections of modulated light fields.
Collapse
Affiliation(s)
- Jakob Hüpfl
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
| | - Nicolas Bachelard
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
- Université de Bordeaux, CNRS, LOMA, UMR 5798, F-33405 Talence, France
| | - Markus Kaczvinszki
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
| | - Michael Horodynski
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
| | - Matthias Kühmayer
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
| | - Stefan Rotter
- Institute for Theoretical Physics, Vienna University of Technology (TU Wien), A-1040 Vienna, Austria
| |
Collapse
|
36
|
Soldevila F, Moretti C, Nöbauer T, Sarafraz H, Vaziri A, Gigan S. Functional imaging through scattering medium via fluorescence speckle demixing and localization. ARXIV 2023:arXiv:2302.06519v1. [PMID: 36824429 PMCID: PMC9949161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Abstract
Recently, fluorescence-based optical techniques have emerged as a powerful tool to probe information in the mammalian brain. However, tissue heterogeneities prevent clear imaging of deep neuron bodies due to light scattering. While several up-to-date approaches based on ballistic light allow to retrieve information at shallow depths inside the brain, non-invasive localization and functional imaging at depth still remains a challenge. It was recently shown that functional signals from time-varying fluorescent emitters located behind scattering samples could be retrieved by using a matrix factorization algorithm. Here we show that the seemingly information-less, low-contrast fluorescent speckle patterns recovered by the algorithm can be used to locate each individual emitter, even in the presence of background fluorescence. We test our approach by imaging the temporal activity of large groups of fluorescent sources behind different scattering phantoms mimicking biological tissues, and through a brain slice with a thickness of ~200 micron.
Collapse
Affiliation(s)
- F. Soldevila
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| | - C. Moretti
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| | - T. Nöbauer
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
| | - H. Sarafraz
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
| | - A. Vaziri
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY, USA
| | - S. Gigan
- Laboratoire Kastler Brossel, ENS–Université PSL, CNRS, Sorbonne Université, College de France, 24 Rue Lhomond, F-75005 Paris, France
| |
Collapse
|
37
|
Lu D, Feng Y, Peng X, He W. Speckle autocorrelation separation for multi-target scattering imaging. OPTICS EXPRESS 2023; 31:6529-6539. [PMID: 36823906 DOI: 10.1364/oe.479943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 01/16/2023] [Indexed: 06/18/2023]
Abstract
Imaging through scattering media remains a big challenge in optics while the single-shot non-invasive speckle autocorrelation technique (SAT) is well-known as a promising way to handle it. However, it usually cannot recover a large-scale target or multiple isolated small ones due to the limited effective range of the optical memory effect (OME). In this paper, we propose a multi-target scattering imaging scheme by combining the traditional SA algorithm with a Deep Learning (DL) strategy. The basic idea is to extract each autocorrelation component of every target from the autocorrelation result of a mixed speckle using a suitable DL method. Once we get all the expected autocorrelation components, a typical phase retrieval algorithm (PRA) could be applied to reveal the shapes of all those corresponding small targets. In our experimental demonstration, up to five isolated targets are successfully recovered.
Collapse
|
38
|
Fotiadi A, Rafailov E, Korobko D, Mégret P, Bykov A, Meglinski I. Brillouin Interaction between Two Optical Modes Selectively Excited in Weakly Guiding Multimode Optical Fibers. SENSORS (BASEL, SWITZERLAND) 2023; 23:1715. [PMID: 36772756 PMCID: PMC9919090 DOI: 10.3390/s23031715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 01/29/2023] [Accepted: 01/31/2023] [Indexed: 06/18/2023]
Abstract
A multimode optical fiber supports excitation and propagation of a pure single optical mode, i.e., the field pattern that satisfies the boundary conditions and does not change along the fiber. When two counterpropagating pure optical modes are excited, they could interact through the stimulated Brillouin scattering (SBS) process. Here, we present a simple theoretical formalism describing SBS interaction between two individual optical modes selectively excited in an acoustically isotropic multimode optical fiber. Employing a weakly guiding step-index fiber approach, we have built an analytical expression for the spatial distribution of the sound field amplitude in the fiber core and explored the features of SBS gain spectra, describing the interaction between modes of different orders. In this way, we give a clear insight into the sound propagation effects accompanying SBS in multimode optical fibers, and demonstrate their specific contributions to the SBS gain spectrum.
Collapse
Affiliation(s)
- Andrei Fotiadi
- Optoelectronics and Measurement Techniques Unit, University of Oulu, 90570 Oulu, Finland
- Electromagnetism and Telecommunication Department, University of Mons, B-7000 Mons, Belgium
| | - Edik Rafailov
- Optoelectronics and Biomedical Photonics Group, School of Engineering and Applied Science, Aston University, Birmingham B4 7ET, UK
| | - Dmitry Korobko
- S.P. Kapitsa Scientific Technological Research Institute, Ulyanovsk State University, 42 Leo Tolstoy Str., 432970 Ulyanovsk, Russia
| | - Patrice Mégret
- Electromagnetism and Telecommunication Department, University of Mons, B-7000 Mons, Belgium
| | - Alexander Bykov
- Optoelectronics and Measurement Techniques Unit, University of Oulu, 90570 Oulu, Finland
| | - Igor Meglinski
- Optoelectronics and Measurement Techniques Unit, University of Oulu, 90570 Oulu, Finland
- Optoelectronics and Biomedical Photonics Group, School of Engineering and Applied Science, Aston University, Birmingham B4 7ET, UK
| |
Collapse
|
39
|
Lee SY, Parot VJ, Bouma BE, Villiger M. Efficient dispersion modeling in optical multimode fiber. LIGHT, SCIENCE & APPLICATIONS 2023; 12:31. [PMID: 36720851 PMCID: PMC9889807 DOI: 10.1038/s41377-022-01061-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 12/09/2022] [Accepted: 12/12/2022] [Indexed: 06/18/2023]
Abstract
Dispersion remains an enduring challenge for the characterization of wavelength-dependent transmission through optical multimode fiber (MMF). Beyond a small spectral correlation width, a change in wavelength elicits a seemingly independent distribution of the transmitted field. Here we report on a parametric dispersion model that describes mode mixing in MMF as an exponential map and extends the concept of principal modes to describe the fiber's spectrally resolved transmission matrix (TM). We present computational methods to fit the model to measurements at only a few, judiciously selected, discrete wavelengths. We validate the model in various MMF and demonstrate an accurate estimation of the full TM across a broad spectral bandwidth, approaching the bandwidth of the best-performing principal modes, and exceeding the original spectral correlation width by more than two orders of magnitude. The model allows us to conveniently study the spectral behavior of principal modes, and obviates the need for dense spectral measurements, enabling highly efficient reconstruction of the multispectral TM of MMF.
Collapse
Affiliation(s)
- Szu-Yu Lee
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, MA, 02114, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02140, USA
| | - Vicente J Parot
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, MA, 02114, USA
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago, 7820244, Chile
| | - Brett E Bouma
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, MA, 02114, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02140, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, 02140, USA
| | - Martin Villiger
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, MA, 02114, USA.
| |
Collapse
|
40
|
Lin B, Fan X, Guo Z. Self-attention module in a multi-scale improved U-net (SAM-MIU-net) motivating high-performance polarization scattering imaging. OPTICS EXPRESS 2023; 31:3046-3058. [PMID: 36785304 DOI: 10.1364/oe.479636] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Accepted: 12/16/2022] [Indexed: 06/18/2023]
Abstract
Polarization imaging has outstanding advantages in the field of scattering imaging, which still encounters great challenges in heavy scattering media systems even though there are helps from deep learning technology. In this paper, we propose a self-attention module (SAM) in multi-scale improved U-net (SAM-MIU-net) for the polarization scattering imaging, which can extract a new combination of multidimensional information from targets effectively. The proposed SAM-MIU-net can focus on the stable feature carried by polarization characteristics of the target, so as to enhance the expression of the available features, and make it easier to extract polarization features which help to recover the detail of targets for the polarization scattering imaging. Meanwhile, the SAM's effectiveness has been verified in a series of experiments. Based on proposed SAM-MIU-net, we have investigated the generalization abilities for the targets' structures and materials, and the imaging distances between the targets and the ground glass. Experimental results demonstrate that our proposed SAM-MIU-net can achieve high-precision reconstruction of target information under incoherent light conditions for the polarization scattering imaging.
Collapse
|
41
|
Fan M, Zhu J, Wang S, Pu Y, Li H, Zhou S, Wang S. Light scattering control with the two-step focusing method based on neural networks and multi-pixel coding. OPTICS EXPRESS 2022; 30:46888-46899. [PMID: 36558629 DOI: 10.1364/oe.476255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
Focusing light through scattering media is essential for high-resolution optical imaging and deep penetration. Here, a two-step focusing method based on neural networks (NNs) and multi-pixel coding is proposed to achieve high-quality focusing with theoretical maximum enhancement. In the first step, a single-layer neural network (SLNN) is used to obtain the initial mask, which can be used to focus with a moderate enhancement. In the second step, we use multi-pixel coding to encode the initial mask. The coded masks and their corresponding speckle patterns are used to train another SLNN to get the final mask and achieve high-quality focusing. In this experiment, for a mask of 16 × 16 modulation units, in the case of using 8 pixels in a modulation unit, focus with the enhancement of 40.3 (only 0.44 less than the theoretical value) has been achieved with 3000 pictures (1000 pictures in the first step and 2000 pictures in the second step). Compared with the case of employing only the initial mask and the direct multi-pixel encoded mask, the enhancement is increased by 220% and 24%. The proposed method provides a new idea for improving the focusing effect through the scattering media using NNs.
Collapse
|
42
|
Luo J, Liu Y, Wu D, Xu X, Shao L, Feng Y, Pan J, Zhao J, Shen Y, Li Z. High-speed single-exposure time-reversed ultrasonically encoded optical focusing against dynamic scattering. SCIENCE ADVANCES 2022; 8:eadd9158. [PMID: 36525498 DOI: 10.1126/sciadv.add9158] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Focusing light deep inside live scattering tissue promises to revolutionize biophotonics by enabling deep tissue noninvasive optical imaging, manipulation, and therapy. By combining with guide stars, wavefront shaping is emerging as a powerful tool to make scattering media optically transparent. However, for in vivo biomedical applications, the speeds of existing techniques are still too slow to accommodate the fast speckle decorrelation of live tissue. To address this key bottleneck, we develop a quaternary phase encoding scheme to enable single-exposure time-reversed ultrasonically encode optical focusing with full-phase modulations. Specifically, we focus light inside dynamic scattering media with an average mode time down to 29 ns, which indicates that more than 104 effective spatial modes can be controlled within 1 millisecond. With this technique, we demonstrate in vivo light focusing in between a highly opaque adult zebrafish of 5.1 millimeters in thickness and a ground glass diffuser. Our work presents an important step toward in vivo deep tissue applications of wavefront shaping.
Collapse
Affiliation(s)
- Jiawei Luo
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
| | - Yan Liu
- School of Optometry, Indiana University, Bloomington, IN, USA
| | - Daixuan Wu
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
| | - Xiao Xu
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA
- Department of Biomedical Engineering, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Lijie Shao
- Department of Geriatrics, The First Affiliated Hospital of University of Science and Technology of China, Hefei, China
| | - Yuanhua Feng
- Department of Electronic Engineering, College of Information Science and Technology, Jinan University, Guangzhou, China
| | - Jingshun Pan
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
| | - Jiayu Zhao
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
| | - Yuecheng Shen
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
- State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, China
| | - Zhaohui Li
- School of Electronics and Information Technology, Guangdong Provincial Key Laboratory of Optoelectronic Information Processing Chips and Systems, Sun Yat-sen University, Guangzhou, China
- State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, China
- Southern Marine Science and Engineering Guangdong Laboratory, Zhuhai, China
| |
Collapse
|
43
|
Lan B, Wang H, Wang Y. One-to-all lightweight Fourier channel attention convolutional neural network for speckle reconstructions. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:2238-2245. [PMID: 36520741 DOI: 10.1364/josaa.470991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Accepted: 10/20/2022] [Indexed: 06/17/2023]
Abstract
Speckle reconstruction is a classical inverse problem in computational imaging. Inspired by the memory effect of the scattering medium, deep learning methods reveal excellent performance in extracting the correlation of speckle patterns. Nowadays, advanced models generally include more than 10M parameters and mostly pay more attention to the spatial feature information. However, the frequency domain of images also contains precise hierarchical representations. Here we propose a one-to-all lightweight Fourier channel attention convolutional neural network (FCACNN) with Fourier channel attention and the res-connected bottleneck structure. Compared with the state-of-the-art model, i.e., self-attention armed convolutional neural network (SACNN), our architecture has better feature extraction and reconstruction ability. The Pearson correlation coefficient and Jaccard index scores of FCACNN increased by at least 5.2% and 13.6% compared with task-related models. And the parameter number of the lightweight FCACNN is only 1.15M. Furthermore, the validation results show that the one-to-all model, FCACNN, has excellent generalization capability on unseen speckle patterns such as handwritten letters and Quickdraws.
Collapse
|
44
|
Rauer B, de Aguiar HB, Bourdieu L, Gigan S. Scattering correcting wavefront shaping for three-photon microscopy. OPTICS LETTERS 2022; 47:6233-6236. [PMID: 37219215 DOI: 10.1364/ol.468834] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Accepted: 11/01/2022] [Indexed: 05/24/2023]
Abstract
Three-photon (3P) microscopy is getting traction due to its superior performance in deep tissues. Yet, aberrations and light scattering still pose one of the main limitations in the attainable depth ranges for high-resolution imaging. Here, we show scattering correcting wavefront shaping with a simple continuous optimization algorithm, guided by the integrated 3P fluorescence signal. We demonstrate focusing and imaging behind scattering layers and investigate convergence trajectories for different sample geometries and feedback non-linearities. Furthermore, we show imaging through a mouse skull and demonstrate a novel, to the best of our knowledge, fast phase estimation scheme that substantially increases the speed at which the optimal correction can be found.
Collapse
|
45
|
Edmunds JL, Sonmezoglu S, Maharbiz MM. Piezoelectric-based optical modulator for miniaturized wireless medical implants. OPTICS EXPRESS 2022; 30:43664-43677. [PMID: 36523060 DOI: 10.1364/oe.474832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 10/24/2022] [Indexed: 06/17/2023]
Abstract
Optical links for medical implants have recently been explored as an attractive option primarily because it provides a route to ultrasmall wireless implant systems. Existing devices for optical communication either are not CMOS compatible, require large bias voltages to operate, or consume substantial amounts of power. Here, we present a high-Q CMOS-compatible electro-optic modulator that enables establishing an optical data uplink to implants. The modulator acts as a pF-scale capacitor, requires no bias voltage, and operates at CMOS voltages of down to 0.5V. We believe this technology would provide a path towards the realization of millimeter (mm)- and sub-mm scale wireless implants for use in bio-sensing applications.
Collapse
|
46
|
Yang Z, Huangfu H, Zhao Y, Duan M, Wang D, Zuo H. Simple method to modulate the scattered light field under strong disturbance. OPTICS LETTERS 2022; 47:5929-5932. [PMID: 37219139 DOI: 10.1364/ol.472545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Accepted: 10/19/2022] [Indexed: 05/24/2023]
Abstract
In this Letter, we propose a simple and robust method that we have named an optimal accumulation algorithm (OAA) to modulate a scattered light field. Compared with the simulated annealing algorithm (SAA) and genetic algorithm (GA), the OAA is very robust, that is to say it has a strong anti-disturbance capability. In experiments, the scattered light field through ground glass and a polystyrene suspension was modulated, where the polystyrene suspension supported a dynamic random disturbance. It was found that, even if the suspension is too thick to see the ballistic light, the OAA can still modulate the scattered field effectively, while the SAA and GA completely failed. In addition, the OAA is so simple that only addition and comparison are needed, and it can achieve multi-target modulation.
Collapse
|
47
|
Xu W, Wang H. Using beam-offset optical coherence tomography to reconstruct backscattered photon profiles in scattering media. BIOMEDICAL OPTICS EXPRESS 2022; 13:6124-6135. [PMID: 36733762 PMCID: PMC9872868 DOI: 10.1364/boe.469082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 09/10/2022] [Accepted: 10/09/2022] [Indexed: 06/18/2023]
Abstract
Raster scanning imaging technologies capture least scattered photons (LSPs) and reject multiple scattered photons (MSPs) in backscattered photons to image the underlying structures of a scattering medium. However, MSPs can still squeeze into the images, resulting in limited imaging depth, degraded contrast, and significantly reduced lateral resolution. Great efforts have been made to understand how MSPs affect imaging performance through modeling, but the techniques for visualizing the backscattered photon profile (BSPP) in scattering media during imaging are unavailable. Here, a method of reconstructing BSPP is demonstrated using beam-offset optical coherence tomography (OCT), in which OCT images are acquired at offset positions from the illumination beam. The separation of LSPs and MSPs based on the BSPP enables quantification of imaging depth, contrast, and lateral resolution, as well as access to the depth-resolved modulated transfer function (MTF). This approach presents great opportunities for better retrieving tissue optical properties, correctly interpreting images, or directly using MTF as the feedback for adaptive optical imaging.
Collapse
Affiliation(s)
- Weiming Xu
- The Department of Chemical, Paper, and Biomedical Engineering, Miami University, Oxford, 45056 OH, USA
- The Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Hui Wang
- The Department of Chemical, Paper, and Biomedical Engineering, Miami University, Oxford, 45056 OH, USA
| |
Collapse
|
48
|
Bender N, Goetschy A, Hsu CW, Yilmaz H, Palacios PJ, Yamilov A, Cao H. Coherent enhancement of optical remission in diffusive media. Proc Natl Acad Sci U S A 2022; 119:e2207089119. [PMID: 36191199 PMCID: PMC9564826 DOI: 10.1073/pnas.2207089119] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Accepted: 09/07/2022] [Indexed: 11/18/2022] Open
Abstract
Remitted waves are used for sensing and imaging in diverse diffusive media from the Earth's crust to the human brain. Separating the source and detector increases the penetration depth of light, but the signal strength decreases rapidly, leading to a poor signal-to-noise ratio. Here, we show, experimentally and numerically, that wavefront shaping a laser beam incident on a diffusive sample enables an enhancement of remission by an order of magnitude at depths of up to 10 transport mean free paths. We develop a theoretical model which predicts the maximal remission enhancement. Our analysis reveals a significant improvement in the sensitivity of remitted waves to local changes of absorption deep inside diffusive media. This work illustrates the potential of coherent wavefront control for noninvasive diffuse wave imaging applications, such as diffuse optical tomography and functional near-infrared spectroscopy.
Collapse
Affiliation(s)
- Nicholas Bender
- Department of Applied Physics, Yale University, New Haven, CT 06520
| | - Arthur Goetschy
- École Supérieure de Physique et de Chimie Industrielles de la ville de Paris, Paris Sciences et Lettres Research University, CNRS, Institut Langevin, F-75005 Paris, France
| | - Chia Wei Hsu
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA 90089
| | - Hasan Yilmaz
- Institute of Materials Science and Nanotechnology, National Nanotechnology Research Center, Bilkent University, 06800 Ankara, Turkey
| | - Pablo Jara Palacios
- Physics Department, Missouri University of Science & Technology, Rolla, MO 65409
| | - Alexey Yamilov
- Physics Department, Missouri University of Science & Technology, Rolla, MO 65409
| | - Hui Cao
- Department of Applied Physics, Yale University, New Haven, CT 06520
| |
Collapse
|
49
|
Nano-electromechanical spatial light modulator enabled by asymmetric resonant dielectric metasurfaces. Nat Commun 2022; 13:5811. [PMID: 36192401 PMCID: PMC9530114 DOI: 10.1038/s41467-022-33449-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 09/20/2022] [Indexed: 11/17/2022] Open
Abstract
Spatial light modulators (SLMs) play essential roles in various free-space optical technologies, offering spatio-temporal control of amplitude, phase, or polarization of light. Beyond conventional SLMs based on liquid crystals or microelectromechanical systems, active metasurfaces are considered as promising SLM platforms because they could simultaneously provide high-speed and small pixel size. However, the active metasurfaces reported so far have achieved either limited phase modulation or low efficiency. Here, we propose nano-electromechanically tunable asymmetric dielectric metasurfaces as a platform for reflective SLMs. Exploiting the strong asymmetric radiation of perturbed high-order Mie resonances, the metasurfaces experimentally achieve a phase-shift close to 290∘, over 50% reflectivity, and a wavelength-scale pixel size. Electrical control of diffraction patterns is also achieved by displacing the Mie resonators using nano-electro-mechanical forces. This work paves the ways for future exploration of the asymmetric metasurfaces and for their application to the next-generation SLMs. This work experimentally demonstrates nano-electromechanically tunable asymmetric dielectric metasurfaces. The metasurfaces enable large phase tuning, high reflection, a wavelength-scale pixel size, and electrical control of diffraction patterns.
Collapse
|
50
|
Hsieh CM, Ren X, Liu Q. Feedback-based wavefront shaping for weak light with lock-in beat frequency detection. OPTICS LETTERS 2022; 47:5192-5195. [PMID: 36181219 DOI: 10.1364/ol.467435] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 09/13/2022] [Indexed: 06/16/2023]
Abstract
Feedback-based wavefront shaping is a promising and versatile technique for enhancing the contrast of a target signal through highly scattering media. However, this technique can fail for low optical signals such as fluorescence and Raman signals or in a reflection setup because the trend in weak feedback signals can be easily overwhelmed by noise. To address this challenge, we develop a technique based on a single acousto-optic deflector (AOD) to create a signal with a selected beat frequency from optical signals that can serve as feedback, in which the phase distribution of various radio frequency components of the driving signal for the AOD is optimized for wavefront shaping. By shifting incident light frequency with the AOD, the feedback signal at a selected beat frequency can be measured with a high signal-to-noise ratio (SNR) by a lock-in amplifier, thus enabling the enhancement of weak target signals through highly scattering media. It is found that the method of lock-in beat frequency detection can significantly improve fluorescence imaging and Raman spectral measurements in a reflection setup, and thus could be potentially used for in vivo measurements.
Collapse
|