1
|
Xia F, Rimoli CV, Akemann W, Ventalon C, Bourdieu L, Gigan S, de Aguiar HB. Neurophotonics beyond the surface: unmasking the brain's complexity exploiting optical scattering. NEUROPHOTONICS 2024; 11:S11510. [PMID: 38617592 PMCID: PMC11014413 DOI: 10.1117/1.nph.11.s1.s11510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 03/07/2024] [Accepted: 03/14/2024] [Indexed: 04/16/2024]
Abstract
The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.
Collapse
Affiliation(s)
- Fei Xia
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| | - Caio Vaz Rimoli
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Walther Akemann
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Cathie Ventalon
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Laurent Bourdieu
- Université PSL, Institut de Biologie de l’ENS, École Normale Supérieure, CNRS, INSERM, Paris, France
| | - Sylvain Gigan
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| | - Hilton B. de Aguiar
- Sorbonne Université, Collège de France, Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Paris, France
| |
Collapse
|
2
|
Zhao S, Rauer B, Valzania L, Dong J, Liu R, Li F, Gigan S, de Aguiar HB. Single-pixel transmission matrix recovery via two-photon fluorescence. SCIENCE ADVANCES 2024; 10:eadi3442. [PMID: 38232161 DOI: 10.1126/sciadv.adi3442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 12/19/2023] [Indexed: 01/19/2024]
Abstract
Imaging at depth in opaque materials has long been a challenge. Recently, wavefront shaping has enabled notable advance for deep imaging. Nevertheless, most noninvasive wavefront-shaping methods require cameras, lack the sensitivity for deep imaging under weak optical signals, or can only focus on a single "guidestar." Here, we retrieve the transmission matrix (TM) noninvasively using two-photon fluorescence exploiting a single-pixel detection combined with a computational framework, allowing to achieve single-target focus on multiple guidestars spread beyond the memory effect range. In addition, if we assume that memory effect correlations exist in the TM, we are able to substantially reduce the number of measurements needed.
Collapse
Affiliation(s)
- Shupeng Zhao
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Bernhard Rauer
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Lorenzo Valzania
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Jonathan Dong
- Biomedical Imaging Group, Ecole polytechnique fédérale de Lausanne (EPFL), Lausanne 1015, Switzerland
| | - Ruifeng Liu
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Fuli Li
- Shaanxi Province Key Laboratory for Quantum Information and Quantum Optoelectronic Devices, School of Physics, Xi'an Jiaotong University, Xi'an 710049, China
| | - Sylvain Gigan
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| | - Hilton B de Aguiar
- Laboratoire Kastler Brossel, ENS-Université PSL, CNRS, Sorbonne Université, Collège de France. 24 rue Lhomond, 75005 Paris, France
| |
Collapse
|
3
|
Goel S, Conti C, Leedumrongwatthanakun S, Malik M. Referenceless characterization of complex media using physics-informed neural networks. OPTICS EXPRESS 2023; 31:32824-32839. [PMID: 37859076 DOI: 10.1364/oe.500529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 09/01/2023] [Indexed: 10/21/2023]
Abstract
In this work, we present a method to characterize the transmission matrices of complex scattering media using a physics-informed, multi-plane neural network (MPNN) without the requirement of a known optical reference field. We use this method to accurately measure the transmission matrix of a commercial multi-mode fiber without the problems of output-phase ambiguity and dark spots, leading to up to 58% improvement in focusing efficiency compared with phase-stepping holography. We demonstrate how our method is significantly more noise-robust than phase-stepping holography and show how it can be generalized to characterize a cascade of transmission matrices, allowing one to control the propagation of light between independent scattering media. This work presents an essential tool for accurate light control through complex media, with applications ranging from classical optical networks, biomedical imaging, to quantum information processing.
Collapse
|
4
|
Fan M, Zhu J, Wang S, Pu Y, Li H, Zhou S, Wang S. Light scattering control with the two-step focusing method based on neural networks and multi-pixel coding. OPTICS EXPRESS 2022; 30:46888-46899. [PMID: 36558629 DOI: 10.1364/oe.476255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
Focusing light through scattering media is essential for high-resolution optical imaging and deep penetration. Here, a two-step focusing method based on neural networks (NNs) and multi-pixel coding is proposed to achieve high-quality focusing with theoretical maximum enhancement. In the first step, a single-layer neural network (SLNN) is used to obtain the initial mask, which can be used to focus with a moderate enhancement. In the second step, we use multi-pixel coding to encode the initial mask. The coded masks and their corresponding speckle patterns are used to train another SLNN to get the final mask and achieve high-quality focusing. In this experiment, for a mask of 16 × 16 modulation units, in the case of using 8 pixels in a modulation unit, focus with the enhancement of 40.3 (only 0.44 less than the theoretical value) has been achieved with 3000 pictures (1000 pictures in the first step and 2000 pictures in the second step). Compared with the case of employing only the initial mask and the direct multi-pixel encoded mask, the enhancement is increased by 220% and 24%. The proposed method provides a new idea for improving the focusing effect through the scattering media using NNs.
Collapse
|