1
|
Amitonova LV. Multimode fiber endoscopes for computational brain imaging. NEUROPHOTONICS 2024; 11:S11509. [PMID: 38450327 PMCID: PMC10917391 DOI: 10.1117/1.nph.11.s1.s11509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 01/08/2024] [Accepted: 01/31/2024] [Indexed: 03/08/2024]
Abstract
Advances in imaging tools have always been a pivotal driver for new discoveries in neuroscience. An ability to visualize neurons and subcellular structures deep within the brain of a freely behaving animal is integral to our understanding of the relationship between neural activity and higher cognitive functions. However, fast high-resolution imaging is limited to sub-surface brain regions and generally requires head fixation of the animal under the microscope. Developing new approaches to address these challenges is critical. The last decades have seen rapid progress in minimally invasive endo-microscopy techniques based on bare optical fibers. A single multimode fiber can be used to penetrate deep into the brain without causing significant damage to the overlying structures and provide high-resolution imaging. Here, we discuss how the full potential of high-speed super-resolution fiber endoscopy can be realized by a holistic approach that combines fiber optics, light shaping, and advanced computational algorithms. The recent progress opens up new avenues for minimally invasive deep brain studies in freely behaving mice.
Collapse
Affiliation(s)
- Lyubov V. Amitonova
- Vrije Universiteit Amsterdam, Department of Physics and Astronomy, Amsterdam, The Netherlands
- Advanced Research Center for Nanolithography, Amsterdam, The Netherlands
| |
Collapse
|
2
|
Hou L, Yang L, Yang Z, Liu Y, Huang Z, Zhang L. Compact and efficient photonic lanterns through multi-stage tapering. OPTICS LETTERS 2024; 49:4779-4782. [PMID: 39207962 DOI: 10.1364/ol.524265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 07/25/2024] [Indexed: 09/04/2024]
Abstract
Photonic lanterns (PLs) have been recently used in mode-division multiplexed systems with a low insertion loss, a low mode-dependent loss (MDL), and a wide bandwidth. However, the cross talk (XT) performance of the PLs requires further enhancement within a short taper length. In this Letter, a multi-stage cascaded scheme for short PLs is proposed to further improve the performance on losses and XT. The XT of the optimized 6-mode 3-stage PL is below -23.4 dB, while the total length is only 6 cm. To the best of our knowledge, this is the first quantitative optimization of a 3-stage tapered PL, resulting in a compact structure and excellent performance. Furthermore, we experimentally validate the feasibility of the 3-stage tapering process.
Collapse
|
3
|
Liang J, Ye J, Ma X, Lu Y, Li J, Xu J, Chen Z, Leng J, Jiang Z, Zhou P. Mode division multiplexing reconstructive spectrometer with an all-fiber photonics lantern. FRONTIERS OF OPTOELECTRONICS 2024; 17:23. [PMID: 39014042 PMCID: PMC11252098 DOI: 10.1007/s12200-024-00130-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 07/04/2024] [Indexed: 07/18/2024]
Abstract
This study presents a high-accuracy, all-fiber mode division multiplexing (MDM) reconstructive spectrometer (RS). The MDM was achieved by utilizing a custom-designed 3 × 1 mode-selective photonics lantern to launch distinct spatial modes into the multimode fiber (MMF). This facilitated the information transmission by increasing light scattering processes, thereby encoding the optical spectra more comprehensively into speckle patterns. Spectral resolution of 2 pm and the recovery of 2000 spectral channels were accomplished. Compared to methods employing single-mode excitation and two-mode excitation, the three-mode excitation method reduced the recovered error by 88% and 50% respectively. A resolution enhancement approach based on alternating mode modulation was proposed, reaching the MMF limit for the 3 dB bandwidth of the spectral correlation function. The proof-of-concept study can be further extended to encompass diverse programmable mode excitations. It is not only succinct and highly efficient but also well-suited for a variety of high-accuracy, high-resolution spectral measurement scenarios.
Collapse
Affiliation(s)
- Junrui Liang
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
| | - Jun Ye
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha, 410073, China
- Hunan Provincial Key Laboratory of High Energy Laser Technology, National University of Defense Technology, Changsha, 410073, China
| | - Xiaoya Ma
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
| | - Yao Lu
- Space Engineering University, Beijing, 101416, China
| | - Jun Li
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
| | - Jiangming Xu
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China.
| | - Zilun Chen
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha, 410073, China
- Hunan Provincial Key Laboratory of High Energy Laser Technology, National University of Defense Technology, Changsha, 410073, China
| | - Jinyong Leng
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha, 410073, China
- Hunan Provincial Key Laboratory of High Energy Laser Technology, National University of Defense Technology, Changsha, 410073, China
| | - Zongfu Jiang
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha, 410073, China
- Hunan Provincial Key Laboratory of High Energy Laser Technology, National University of Defense Technology, Changsha, 410073, China
| | - Pu Zhou
- College of Advanced Disciplinary Studies, National University of Defense Technology, Changsha, 410073, China.
| |
Collapse
|
4
|
Santos Garcia C, Larchevêque M, O’Sullivan S, Van Waerebeke M, Thomson RR, Repetti A, Pesquet JC. A primal-dual data-driven method for computational optical imaging with a photonic lantern. PNAS NEXUS 2024; 3:pgae164. [PMID: 38689704 PMCID: PMC11058747 DOI: 10.1093/pnasnexus/pgae164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 03/26/2024] [Indexed: 05/02/2024]
Abstract
Optical fibers aim to image in vivo biological processes. In this context, high spatial resolution and stability to fiber movements are key to enable decision-making processes (e.g. for microendoscopy). Recently, a single-pixel imaging technique based on a multicore fiber photonic lantern has been designed, named computational optical imaging using a lantern (COIL). A proximal algorithm based on a sparsity prior, dubbed SARA-COIL, has been further proposed to solve the associated inverse problem, to enable image reconstructions for high resolution COIL microendoscopy. In this work, we develop a data-driven approach for COIL. We replace the sparsity prior in the proximal algorithm by a learned denoiser, leading to a plug-and-play (PnP) algorithm. The resulting PnP method, based on a proximal primal-dual algorithm, enables to solve the Morozov formulation of the inverse problem. We use recent results in learning theory to train a network with desirable Lipschitz properties, and we show that the resulting primal-dual PnP algorithm converges to a solution to a monotone inclusion problem. Our simulations highlight that the proposed data-driven approach improves the reconstruction quality over variational SARA-COIL method on both simulated and real data.
Collapse
Affiliation(s)
| | | | - Solal O’Sullivan
- CVN, CentraleSupélec, Unversité Paris-Saclay, Gif sur Yvette 91190, France
| | | | - Robert R Thomson
- Institute of Photonics and Quantum Science, Heriot-Watt University, Edinburgh EH14 4AS, UK
| | - Audrey Repetti
- School of Engineering and Physical Sciences and School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh EH14 4AS, UK
| | | |
Collapse
|
5
|
Lochocki B, Ivanina A, Bandhoe A, de Boer JF, Amitonova LV. Swept-source multimode fiber imaging. Sci Rep 2023; 13:8071. [PMID: 37202418 DOI: 10.1038/s41598-023-34062-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Accepted: 04/24/2023] [Indexed: 05/20/2023] Open
Abstract
High-resolution compressive imaging via a flexible multimode fiber is demonstrated using a swept-laser source and wavelength dependent speckle illumination. An in-house built swept-source allowing for independent control of bandwidth and scanning range is used to explore and demonstrate a mechanically scan-free approach for high-resolution imaging through an ultrathin and flexible fiber probe. The computational image reconstruction is shown by utilizing a narrow sweeping bandwidth of [Formula: see text] nm while acquisition time is decreased by 95% compared to conventional raster scanning endoscopy. Demonstrated narrow-band illumination in the visible spectrum is vital for the detection of fluorescence biomarkers in neuroimaging applications. The proposed approach yields device simplicity and flexibility for minimally invasive endoscopy.
Collapse
Affiliation(s)
- Benjamin Lochocki
- Nanoscale Imaging and Metrology, Advanced Research Center for Nanolithography (ARCNL), Science Park 106, 1098 XG, Amsterdam, The Netherlands.
| | - Aleksandra Ivanina
- Nanoscale Imaging and Metrology, Advanced Research Center for Nanolithography (ARCNL), Science Park 106, 1098 XG, Amsterdam, The Netherlands
| | - Akje Bandhoe
- Nanoscale Imaging and Metrology, Advanced Research Center for Nanolithography (ARCNL), Science Park 106, 1098 XG, Amsterdam, The Netherlands
| | - Johannes F de Boer
- Department of Physics and Astronomy, LaserLaB, Vrije Universiteit Amsterdam, de Boelelaan 1081, 1081 HV, Amsterdam, The Netherlands
| | - Lyubov V Amitonova
- Nanoscale Imaging and Metrology, Advanced Research Center for Nanolithography (ARCNL), Science Park 106, 1098 XG, Amsterdam, The Netherlands
- Department of Physics and Astronomy, LaserLaB, Vrije Universiteit Amsterdam, de Boelelaan 1081, 1081 HV, Amsterdam, The Netherlands
| |
Collapse
|
6
|
Lyu Z, Abrashitova K, de Boer JF, Andresen ER, Rigneault H, Amitonova LV. Sub-diffraction computational imaging via a flexible multicore-multimode fiber. OPTICS EXPRESS 2023; 31:11249-11260. [PMID: 37155765 DOI: 10.1364/oe.481052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
An ultra-thin multimode fiber is an ideal platform for minimally invasive microscopy with the advantages of a high density of modes, high spatial resolution, and a compact size. In practical applications, the probe needs to be long and flexible, which unfortunately destroys the imaging capabilities of a multimode fiber. In this work, we propose and experimentally demonstrate sub-diffraction imaging through a flexible probe based on a unique multicore-multimode fiber. A multicore part consists of 120 Fermat's spiral distributed single-mode cores. Each of the cores offers stable light delivery to the multimode part, which provides optimal structured light illumination for sub-diffraction imaging. As a result, perturbation-resilient fast sub-diffraction fiber imaging by computational compressive sensing is demonstrated.
Collapse
|
7
|
Dong Z, Wen Z, Pang C, Wang L, Wu L, Liu X, Yang Q. A modulated sparse random matrix for high-resolution and high-speed 3D compressive imaging through a multimode fiber. Sci Bull (Beijing) 2022; 67:1224-1228. [PMID: 36546150 DOI: 10.1016/j.scib.2022.03.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 02/07/2022] [Accepted: 03/14/2022] [Indexed: 01/07/2023]
Affiliation(s)
- Zhenyu Dong
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China
| | - Zhong Wen
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China
| | - Chenlei Pang
- Research Center for Intelligent Sensing, Zhejiang Lab, Hangzhou 311100, China
| | - Liqiang Wang
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China; Research Center for Intelligent Sensing, Zhejiang Lab, Hangzhou 311100, China
| | - Lan Wu
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China
| | - Xu Liu
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China; Research Center for Intelligent Sensing, Zhejiang Lab, Hangzhou 311100, China
| | - Qing Yang
- Research Center for Intelligent Sensing, Zhejiang Lab, Hangzhou 311100, China; State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, China; Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan 030006, China.
| |
Collapse
|
8
|
Lee SY, Parot VJ, Bouma BE, Villiger M. Confocal 3D reflectance imaging through multimode fiber without wavefront shaping. OPTICA 2022; 9:112-120. [PMID: 35419464 PMCID: PMC9005109 DOI: 10.1364/optica.446178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 12/08/2021] [Indexed: 06/14/2023]
Abstract
Imaging through optical multimode fiber (MMF) has the potential to enable hair-thin endoscopes that reduce the invasiveness of imaging deep inside tissues and organs. Active wavefront shaping and fluorescent labeling have recently been exploited to overcome modal scrambling and enable MMF imaging. Here, we present a computational approach that circumvents the need for active wavefront control and exogenous fluorophores. We demonstrate the reconstruction of depth-gated confocal images through MMF using a raster-scanned, focused input illumination at the fiber proximal end. We show the compatibility of this approach with quantitative phase, dark-field, and polarimetric imaging. Computational imaging through MMF opens a new pathway for minimally invasive imaging in medical diagnosis and biological investigations.
Collapse
Affiliation(s)
- Szu-Yu Lee
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, Massachusetts 02114, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Vicente J. Parot
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, Massachusetts 02114, USA
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago 7820244, Chile
| | - Brett E. Bouma
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, Massachusetts 02114, USA
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Martin Villiger
- Harvard Medical School and Massachusetts General Hospital, Wellman Center for Photomedicine, Boston, Massachusetts 02114, USA
| |
Collapse
|
9
|
Ochoa M, Algorri JF, Roldán-Varona P, Rodríguez-Cobo L, López-Higuera JM. Recent Advances in Biomedical Photonic Sensors: A Focus on Optical-Fibre-Based Sensing. SENSORS (BASEL, SWITZERLAND) 2021; 21:6469. [PMID: 34640788 PMCID: PMC8513032 DOI: 10.3390/s21196469] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Revised: 09/21/2021] [Accepted: 09/23/2021] [Indexed: 01/22/2023]
Abstract
In this invited review, we provide an overview of the recent advances in biomedical photonic sensors within the last five years. This review is focused on works using optical-fibre technology, employing diverse optical fibres, sensing techniques, and configurations applied in several medical fields. We identified technical innovations and advancements with increased implementations of optical-fibre sensors, multiparameter sensors, and control systems in real applications. Examples of outstanding optical-fibre sensor performances for physical and biochemical parameters are covered, including diverse sensing strategies and fibre-optical probes for integration into medical instruments such as catheters, needles, or endoscopes.
Collapse
Affiliation(s)
- Mario Ochoa
- Photonics Engineering Group, University of Cantabria, 39005 Santander, Spain; (J.F.A.); (P.R.-V.)
- Instituto de Investigación Sanitaria Valdecilla (IDIVAL), 39011 Santander, Spain
| | - José Francisco Algorri
- Photonics Engineering Group, University of Cantabria, 39005 Santander, Spain; (J.F.A.); (P.R.-V.)
- Instituto de Investigación Sanitaria Valdecilla (IDIVAL), 39011 Santander, Spain
| | - Pablo Roldán-Varona
- Photonics Engineering Group, University of Cantabria, 39005 Santander, Spain; (J.F.A.); (P.R.-V.)
- Instituto de Investigación Sanitaria Valdecilla (IDIVAL), 39011 Santander, Spain
- CIBER-bbn, Institute of Health Carlos III, 28029 Madrid, Spain;
| | | | - José Miguel López-Higuera
- Photonics Engineering Group, University of Cantabria, 39005 Santander, Spain; (J.F.A.); (P.R.-V.)
- Instituto de Investigación Sanitaria Valdecilla (IDIVAL), 39011 Santander, Spain
- CIBER-bbn, Institute of Health Carlos III, 28029 Madrid, Spain;
| |
Collapse
|
10
|
Cruz-Delgado D, Alvarado-Zacarias JC, Cooper MA, Wittek S, Dobias C, Martinez-Mercado J, Antonio-Lopez JE, Fontaine NK, Amezcua-Correa R. Photonic lantern tip/tilt detector for adaptive optics systems. OPTICS LETTERS 2021; 46:3292-3295. [PMID: 34197439 DOI: 10.1364/ol.430761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Accepted: 06/11/2021] [Indexed: 06/13/2023]
Abstract
In this work, we demonstrate a four-core multicore fiber photonic lantern tip/tilt wavefront sensor. To diagnose the low-order Zernike aberrations, we exploit the ability of the photonic lantern to encode the characteristics of a complex incoming beam at the multimode facet of the sensor to intensity distributions at the multicore fiber output. Here, we provide a comprehensive numerical analysis capable of predicting the performance of fabricated devices and experimentally demonstrate the concept. Two receiver architectures are implemented to discern tip/tilt information by (i) imaging the four-core fiber facet on a 2D detector and (ii) direct power measurement of the single mode outputs using a multicore fiber multiplexer and photodetectors. For both receiver schemes, an angular detection window of ∼0.4∘ at 1064 nm can be achieved. Our results are expected to further facilitate the development of intensity-based fiber wavefront sensors for adaptive optics systems.
Collapse
|
11
|
Memory effect assisted imaging through multimode optical fibres. Nat Commun 2021; 12:3751. [PMID: 34145228 PMCID: PMC8213736 DOI: 10.1038/s41467-021-23729-1] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 04/29/2021] [Indexed: 02/05/2023] Open
Abstract
When light propagates through opaque material, the spatial information it holds becomes scrambled, but not necessarily lost. Two classes of techniques have emerged to recover this information: methods relying on optical memory effects, and transmission matrix (TM) approaches. Here we develop a general framework describing the nature of memory effects in structures of arbitrary geometry. We show how this framework, when combined with wavefront shaping driven by feedback from a guide-star, enables estimation of the TM of any such system. This highlights that guide-star assisted imaging is possible regardless of the type of memory effect a scatterer exhibits. We apply this concept to multimode fibres (MMFs) and identify a 'quasi-radial' memory effect. This allows the TM of an MMF to be approximated from only one end - an important step for micro-endoscopy. Our work broadens the applications of memory effects to a range of novel imaging and optical communication scenarios.
Collapse
|