"There's plenty of room at the bottom": deep brain imaging with holographic endo-microscopy

Significance

Over more than 300 years, microscopic imaging keeps providing fundamental insights into the mechanisms of living organisms. Seeing microscopic structures beyond the reach of free-space light-based microscopy, however, requires dissection of the tissue-an intervention seriously disturbing its physiological functions. The hunt for low-invasiveness tools has led a growing community of physicists and engineers into the realm of complex media photonics. One of its activities represents exploiting multimode optical fibers (MMFs) as ultra-thin endoscopic probes. Employing wavefront shaping, these tools only recently facilitated the first peeks at cells and their sub-cellular compartments at the bottom of the mouse brain with the impact of micro-scale tissue damage.

Aim

Here, we aim to highlight advances in MMF-based holographic endo-microscopy facilitating microscopic imaging throughout the whole depth of the mouse brain.

Approach

We summarize the important technical and methodological prerequisites for stabile high-resolution imaging in vivo.

Results

We showcase images of the microscopic building blocks of brain tissue, including neurons, neuronal processes, vessels, intracellular calcium signaling, and red blood cell velocity in individual vessels.

Conclusions

This perspective article helps to understand the complexity behind the technology of holographic endo-microscopy, summarizes its recent advances and challenges, and stimulates the mind of the reader for further exploitation of this tool in the neuroscience research.

Neurophotonics beyond the surface: unmasking the brain's complexity exploiting optical scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

An Ultrathin, Fast-Response, Large-Scale Liquid-Crystal-Facilitated Multi-Functional Reconfigurable Metasurface for Comprehensive Wavefront Modulation

The rapid advancement of prevailing communication/sensing technologies necessitates cost-effective millimeter-wave arrays equipped with a massive number of phase-shifting cells to perform complicated beamforming tasks. Conventional approaches employing semiconductor switch/varactor components or tunable materials encounter obstacles such as quantization loss, high cost, high complexity, and limited adaptability for realizing large-scale arrays. Here, a low-cost, ultrathin, fast-response, and large-scale solution relying on metasurface concepts combined together with liquid crystal (LC) materials requiring a layer thickness of only 5 µm is reported. Rather than immersing resonant structures in LCs, a joint material-circuit-based strategy is devised, via integrating deep-subwavelength-thick LCs into slow-wave structures, to achieve constitutive metacells with continuous phase shifting and stable reflectivity. An LC-facilitated reconfigurable metasurface sub-system containing more than 2300 metacells is realized with its unprecedented comprehensive wavefront manipulation capacity validated through various beamforming functions, including beam focusing/steering, reconfigurable vortex beams, and tunable holograms, demonstrating a milli-second-level function-switching speed. The proposed methodology offers a paradigm shift for modulating electromagnetic waves in a non-resonating broadband fashion with fast-response and low-cost properties by exploiting functionalized LC-enabled metasurfaces. Moreover, this extremely agile metasurface-enabled antenna technology will facilitate a transformative impact on communication/sensing systems and empower new possibilities for wavefront engineering and diffractive wave calculation/inference.

Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Terahertz Spatiotemporal Wave Synthesis in Random Systems

Complex media have emerged as a powerful and robust framework to control light-matter interactions designed for task-specific optical functionalities. Studies on wavefront shaping through disordered systems have demonstrated optical wave manipulation capabilities beyond conventional optics, including aberration-free and subwavelength focusing. However, achieving arbitrary and simultaneous control over the spatial and temporal features of light remains challenging. In particular, no practical solution exists for field-level arbitrary spatiotemporal control of wave packets. A new paradigm shift has emerged in the terahertz frequency domain, offering methods for absolute time-domain measurements of the scattered electric field, enabling direct field-based wave synthesis. In this work, we report the experimental demonstration of field-level control of single-cycle terahertz pulses on arbitrary spatial points through complex disordered media.

Polariton Microfluidics for Nonreciprocal Dragging and Reconfigurable Shaping of Polaritons

Dielectric environment engineering is an efficient and general approach to manipulating polaritons. Liquids serving as the surrounding media of polaritons have been used to shift polariton dispersions and tailor polariton wavefronts. However, those liquid-based methods have so far been limited to their static states, not fully unleashing the promise offered by the mobility of liquids. Here, we propose a microfluidic strategy for polariton manipulation by merging polaritonics with microfluidics. The diffusion of fluids causes gradient refractive indices over microchannels, which breaks the symmetry of polariton dispersions and realizes the microfluidic analogue to nonreciprocal polariton dragging. Based on polariton microfluidics, we also designed a set of on-chip polaritonic elements to actively shape polaritons, including planar lenses, off-axis lenses, Janus lenses, bends, and splitters. Our strategy expands the toolkit for the manipulation of polaritons at the subwavelength scale and possesses potential in the fields of polariton biochemistry and molecular sensing.

Performance enhancement in wavefront shaping of multiply scattered light: a review

Significance

In nonballistic regime, optical scattering impedes high-resolution imaging through/inside complex media, such as milky liquid, fog, multimode fiber, and biological tissues, where confocal and multiphoton modalities fail. The significant tissue inhomogeneity-induced distortions need to be overcome and a technique referred as optical wavefront shaping (WFS), first proposed in 2007, has been becoming a promising solution, allowing for flexible and powerful light control. Understanding the principle and development of WFS may inspire exciting innovations for effective optical manipulation, imaging, stimulation, and therapy at depths in tissue or tissue-like complex media.

Aim

We aim to provide insights about what limits the WFS towards biomedical applications, and how recent efforts advance the performance of WFS among different trade-offs.

Approach

By differentiating the two implementation directions in the field, i.e., precompensation WFS and optical phase conjugation (OPC), improvement strategies are summarized and discussed.

Results

For biomedical applications, improving the speed of WFS is most essential in both directions, and a system-compatible wavefront modulator driven by fast apparatus is desired. In addition to that, algorithm efficiency and adaptability to perturbations/noise is of concern in precompensation WFS, while for OPC significant improvements rely heavily on integrating physical mechanisms and delicate system design for faster response and higher energy gain.

Conclusions

Substantial improvements in WFS implementations, from the aspects of physics, engineering, and computing, have inspired many novel and exciting optical applications that used to be optically inaccessible. It is envisioned that continuous efforts in the field can further advance WFS towards biomedical applications and guide our vision into deep biological tissues.

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

Fast wavefront shaping for two-photon brain imaging with multipatch correction

Nonlinear fluorescence microscopy promotes in-vivo optical imaging of cellular structure at diffraction-limited resolution deep inside scattering biological tissues. Active compensation of tissue-induced aberrations and light scattering through adaptive wavefront correction further extends the accessible depth by restoring high resolution at large depth. However, those corrections are only valid over a very limited field of view within the angular memory effect. To overcome this limitation, we introduce an acousto-optic light modulation technique for fluorescence imaging with simultaneous wavefront correction at pixel scan speed. Biaxial wavefront corrections are first learned by adaptive optimization at multiple locations in the image field. During image acquisition, the learned corrections are then switched on the fly according to the position of the excitation focus during the raster scan. The proposed microscope is applied to in vivo transcranial neuron imaging and demonstrates multi-patch correction of thinned skull-induced aberrations and scattering at 40-kHz data acquisition speed.

Generating Angular-Varying Time Delays of THz Pulses via Direct Space-to-Time Mapping of Metasurface Structures

We experimentally demonstrate the generation of double terahertz (THz) pulses with tailored angular-dependent time delays from a nonlinear metasurface excited by a near-infrared femtosecond pulse. The tailored temporal properties of the generated pulses emerge from a direct mapping of the nonlinear spatial response of the metasurface to the emitted THz temporal profile. We utilize the Pancharatnam-Berry phase to implement symmetric and antisymmetric metasurface configurations and show that the emitted patterns present spatiotemporal "X-shaped" profiles after collimation by a parabolic mirror, with angular-dependent pulse delays corresponding to the intended design. In addition, we show that the addition of polarization multiplexing presents the opportunity to achieve a full range of elliptical THz polarizations. Double pulse generation and spatiotemporal shaping of THz waves in general show potential for THz spectroscopy and molecular dynamics applications, particularly in pump-probe experiments.

Focusing Coherent Light through Volume Scattering Phantoms via Wavefront Shaping

Manipulating the wavefront of coherent light incident on scattering media to enhance the imaging depth, sensitivity, and resolution is a common technique in biomedical applications. Local phase variations cause changes in the interference and can be used to create a focus inside or behind a scattering medium. We use wavefront shaping (WFS) to force constructive interference at an arbitrary location. The amount of light transmitted into a given region strongly depends on the scattering and absorption characteristics. These are described by their respective coefficients μs and μa and the scattering phase function. Controlling the scattering and absorption coefficients, we study the behavior of wavefront shaping and the achievable intensity enhancement behind volume scattering media with well-defined optical properties. The phantoms designed in this publication are made of epoxy resin. Into these epoxy matrices, specific amounts of scattering and absorbing particles, such as titanium dioxide pigments and molecular dyes, are mixed. The mixture obtained is filled into 3D-printed frames of various thicknesses. After a precise fabrication procedure, an integrating sphere-based setup characterizes the phantoms experimentally. It detects the total hemispherical transmission and reflection. Further theoretical characterization is performed with a newly developed hybrid PN method. This method senses the flux of light into a particular angular range at the lower boundary of a slab. The calculations are performed without suffering from ringing and fulfill the exact boundary conditions there. A decoupled two-path detection system allows for fast optimization as well as sensitive detection. The measurements yield results that agree well with the theoretically expected behavior.

Multimode Optical Interconnects on Silicon Interposer Enable Confidential Hardware-to-Hardware Communication

Following Moore's law, the density of integrated circuits is increasing in all dimensions, for instance, in 3D stacked chip networks. Amongst other electro-optic solutions, multimode optical interconnects on a silicon interposer promise to enable high throughput for modern hardware platforms in a restricted space. Such integrated architectures require confidential communication between multiple chips as a key factor for high-performance infrastructures in the 5G era and beyond. Physical layer security is an approach providing information theoretic security among network participants, exploiting the uniqueness of the data channel. We experimentally project orthogonal and non-orthogonal symbols through 380 μm long multimode on-chip interconnects by wavefront shaping. These interconnects are investigated for their uniqueness by repeating these experiments across multiple channels and samples. We show that the detected speckle patterns resulting from modal crosstalk can be recognized by training a deep neural network, which is used to transform these patterns into a corresponding readable output. The results showcase the feasibility of applying physical layer security to multimode interconnects on silicon interposers for confidential optical 3D chip networks.

Scoring-Based Genetic Algorithm for Wavefront Shaping to Optimize Multiple Objectives

We present a scoring-based genetic algorithm (SBGA) for wavefront shaping to optimize multiple objectives at a time. The algorithm is able to find one feasible solution despite having to optimize multiple objectives. We employ the algorithm to generate multiple focus points simultaneously and allocate their intensities as desired. We then introduce a third objective to confine light focusing only to desired targets and prevent irradiation in neighboring regions. Through simulations and experiments, we demonstrate the algorithm's ease of implementation and flexibility to control the search direction. This algorithm can potentially be applied to improve biomedical imaging, optogenetics, and optical trapping.

A Single-Celled Metasurface for Multipolarization Generation and Wavefront Manipulation

Due to their unprecedented ability to flexibly manipulate the parameters of light, metasurfaces offer a new approach to integrating multiple functions in a single optical element. In this paper, based on a single-celled metasurface composed of chiral umbrella-shaped metal-insulator-metal (MIM) unit cells, a strategy for simultaneous multiple polarization generation and wavefront shaping is proposed. The unit cells can function as broadband and high-performance polarization-preserving mirrors. In addition, by introducing a chiral-assisted Aharonov-Anandan (AA) geometric phase, the phase profile and phase retardation of two spin-flipped orthogonal circular polarized components can be realized simultaneously and independently with a single-celled metasurface via two irrelevant parameters. Benefiting from this flexible phase manipulation ability, a vectorial hologram generator and metalens array with spatially varying polarizations were demonstrated. This work provides an effective approach to avoid the pixel and efficiency losses caused by the intrinsic symmetry of the PB geometric phase, and it may play an important role in the miniaturization and integration of multipolarization-involved displays, real-time imaging, and spectroscopy systems.

Coherent enhancement of optical remission in diffusive media

Remitted waves are used for sensing and imaging in diverse diffusive media from the Earth's crust to the human brain. Separating the source and detector increases the penetration depth of light, but the signal strength decreases rapidly, leading to a poor signal-to-noise ratio. Here, we show, experimentally and numerically, that wavefront shaping a laser beam incident on a diffusive sample enables an enhancement of remission by an order of magnitude at depths of up to 10 transport mean free paths. We develop a theoretical model which predicts the maximal remission enhancement. Our analysis reveals a significant improvement in the sensitivity of remitted waves to local changes of absorption deep inside diffusive media. This work illustrates the potential of coherent wavefront control for noninvasive diffuse wave imaging applications, such as diffuse optical tomography and functional near-infrared spectroscopy.

Cylindrical Metalens for Generation and Focusing of Free-Electron Radiation

Metasurfaces constitute a powerful approach to generate and control light by engineering optical material properties at the subwavelength scale. Recently, this concept was applied to manipulate free-electron radiation phenomena, rendering versatile light sources with unique functionalities. In this Letter, we experimentally demonstrate spectral and angular control over coherent light emission by metasurfaces that interact with free-electrons under grazing incidence. Specifically, we study metalenses based on chirped metagratings that simultaneously emit and shape Smith-Purcell radiation in the visible and near-infrared spectral regime. In good agreement with theory, we observe the far-field signatures of strongly convergent and divergent cylindrical radiation wavefronts using in situ hyperspectral angle-resolved light detection in a scanning electron microscope. Furthermore, we theoretically explore simultaneous control over the polarization and wavefront of Smith-Purcell radiation via a split-ring-resonator metasurface, enabling tunable operation by spatially selective mode excitation at nanometer resolution. Our work highlights the potential of merging metasurfaces with free-electron excitations for versatile and highly tunable radiation sources in wide-ranging spectral regimes.

Holographic optogenetic stimulation with calcium imaging as an all optical tool for cardiac electrophysiology

All optical approaches to control and read out the electrical activity in a cardiac syncytium can improve our understanding of cardiac electrophysiology. Here, we demonstrate optogenetic stimulation of cardiomyocytes with high spatial precision using light foci generated with a ferroelectric spatial light modulator. Computer generated holograms binarized by bidirectional error diffusion create multiple foci with more even intensity distribution compared with thresholding approach. We evoke the electrical activity of cardiac HL1 cells expressing the channelrhodopsin-2 variant, ChR2(H134R) using single and multiple light foci and at the same time visualize the action potential using a calcium sensitive indicator called Cal-630. We show that localized regions in the cardiac monolayer can be stimulated enabling us to initiate signal propagation from a precise location. Furthermore, we demonstrate that probing the cardiac cells with multiple light foci enhances the excitability of the cardiac network. This approach opens new applications in manipulating and visualizing the electrical activity in a cardiac syncytium.

Clinical Outcomes and Quality of Vision Associated with Bilateral Implantation of a Wavefront Shaping Presbyopia Correcting Intraocular Lens

Purpose

To provide normative visual acuity and quality of vision data related to bilateral implantation of a wavefront shaping presbyopia correcting intraocular lens (IOL).

Patients and Methods

This was a non-interventional research study of the refraction, visual acuity (VA) and quality of vision achieved after bilateral implantation of a wavefront shaping presbyopia correcting intraocular lens between 3 months and 12 months post-surgery. The manifest refraction, and uncorrected and distance corrected VA at near, intermediate and distance (40 cm, 50 cm, 66cm, 4 m) were tested. Binocular mesopic VA at 4m and uncorrected photopic low contrast (25%) VA at 4 m were also tested, the latter with and without a glare source. A patient reported outcome questionnaire was administered. Defocus curve testing with and without simulated myopia in the non-dominant eye was also tested (reported elsewhere).

Results

Forty subjects completed the study. There was no statistically significant difference between the uncorrected and distance corrected VA at any distance. Mean logMAR binocular VAs were (−0.07 ± 0.07) at 4 m, (0.00 ± 0.07) at 66 cm and (0.07 ± 0.11) at 40 cm. Uncorrected photopic low contrast VA was statistically significantly better without glare (0.09 ± 0.10) compared to with glare (0.44 ± 0.21, p < 0.01). Reported glare, halos and starbursts were “not at all” Or “a little” bothersome for more than 95% of subjects. Hazy vision and blurred vision were reported most often.

Conclusion

The Vivity IOL provided patients with good distance and intermediate vision, and functional near vision with low reported bother from glare, halos, or starbursts.

Point your SmartPhone at the code above. If you have a QR code reader the video abstract will appear. Or use:

https://youtu.be/fCukWtZz0pk

Long-GRIN-Lens Microendoscopy Enabled by Wavefront Shaping for a Biomedical Microdevice: An Analytical Investigation

We analytically investigate the feasibility of long graded-index (GRIN)-lens-based microendoscopes through wavefront shaping. Following the very well-defined ray trajectories in a GRIN lens, mode-dependent phase delay is first determined. Then, the phase compensation needed for obtaining diffraction limited resolution is derived. Finally, the diffraction pattern of the lens output is computed using the Rayleigh–Sommerfeld diffraction theory. We show that diffraction-limited resolution is obtained for a 0.5 mm diameter lens with a length over 1 m. It is also demonstrated that different imaging working distances (WDs) can be realized by modifying the phase compensation. When a short design WD is used, a large imaging numerical aperture (NA) higher than 0.4 is achievable even when a low NA lens (NA = 0.1) is used. The long- and thin-GRIN-lens-based microendoscope investigated here, which is attractive for biomedical applications, is being prioritized for use in a clinical stage microdevice that measures three-dimensional drug responses inside the body. The advance described in this work may enable superior imaging capabilities in clinical applications in which long and flexible imaging probes are favored.

Tunable mode control through myriad-mode fibers

Multimode fibers are attractive for imaging, communication, computation, and energy delivery. Unfortunately, intermodal and polarization coupling precludes direct control of the delivered mode composition. We present a technique to tailor the mode composition at the output of a multimode fiber with thousands of modes, which we refer to as myriad-mode fiber, using its experimentally measured transmission matrix. While precise mode control has been demonstrated in typical multimode fibers with up to 210 modes, the method proposed here is particularly useful for high mode number fibers, such as when the number of modes is comparable to the number of modes of the wavefront shaping spatial light modulator. To illustrate the technique, we select different subsets of modes to create focal spots at the output of a fiber with 7140 modes. Importantly, we define efficiency and fidelity metrics to evaluate the mode control and demonstrate the relationship between efficiency, fidelity, and the spatial location of the spots across the distal fiber cross-section.

Analog Spatial Light Modulators Based on Micromirror Arrays

The Fraunhofer Institute for Photonic Microsystems (IPMS) has been developing and manufacturing micromirror arrays for more than 20 years. While originally focusing on applications related to microlithography and therefore mainly for light in the deep ultraviolet range, the range of applications has been expanded since, including applications in the visible and near-infrared range. This paper gives an overview of the devices and their designs, fabrication, and characterization.

In situ measurement of the isoplanatic patch for imaging through intact bone

Wavefront-shaping (WS) enables imaging through scattering tissues like bone, which is important for neuroscience and bone-regeneration research. WS corrects for the optical aberrations at a given depth and field-of-view (FOV) within the sample; the extent of the validity of which is limited to a region known as the isoplanatic patch (IP). Knowing this parameter helps to estimate the number of corrections needed for WS imaging over a given FOV. In this paper, we first present direct transmissive measurement of murine skull IP using digital optical phase conjugation based focusing. Second, we extend our previously reported phase accumulation ray tracing (PART) method to provide in-situ in-silico estimation of IP, called correlative PART (cPART). Our results show an IP range of 1 to 3 μm for mice within an age range of 8 to 14 days old and 1.00 ± 0.25 μm in a 12-week old adult skull. Consistency between the two measurement approaches indicates that cPART can be used to approximate the IP before a WS experiment, which can be used to calculate the number of corrections required within a given field of view.

Wavefront Shaping Concepts for Application in Optical Coherence Tomography-A Review

Optical coherence tomography (OCT) enables three-dimensional imaging with resolution on the micrometer scale. The technique relies on the time-of-flight gated detection of light scattered from a sample and has received enormous interest in applications as versatile as non-destructive testing, metrology and non-invasive medical diagnostics. However, in strongly scattering media such as biological tissue, the penetration depth and imaging resolution are limited. Combining OCT imaging with wavefront shaping approaches significantly leverages the capabilities of the technique by controlling the scattered light field through manipulation of the field incident on the sample. This article reviews the main concepts developed so far in the field and discusses the latest results achieved with a focus on signal enhancement and imaging.

Disordered Optics: Exploiting Multiple Light Scattering and Wavefront Shaping for Nonconventional Optical Elements

Advances in diverse areas such as inspection, imaging, manufacturing, telecommunications, and information processing have been stimulated by novel optical devices. Conventional material ingredients for these devices are typically made of homogeneous refractive or diffractive materials and require sophisticated design and fabrication, which results in practical limitations related to their form and functional figures of merit. To overcome such limitations, recent developments in the application of disordered materials as novel optical elements have indicated great potential in enabling functionalities that go beyond their conventional counterparts, while the materials exhibit potential advantages with respect to reduced form factors. Combined with wavefront shaping, disordered materials enable dynamic transitions between multiple functionalities in a single active optical device. Recent progress in this field is summarized to gain insight into the physical principles behind disordered optics with regard to their advantages in various applications as well as their limitations compared to conventional optics.

Learned Integrated Sensing Pipeline: Reconfigurable Metasurface Transceivers as Trainable Physical Layer in an Artificial Neural Network

The rapid proliferation of intelligent systems (e.g., fully autonomous vehicles) in today's society relies on sensors with low latency and computational effort. Yet current sensing systems ignore most available a priori knowledge, notably in the design of the hardware level, such that they fail to extract as much task-relevant information per measurement as possible. Here, a "learned integrated sensing pipeline" (LISP), including in an end-to-end fashion both physical and processing layers, is shown to enable joint learning of optimal measurement strategies and a matching processing algorithm, making use of a priori knowledge on task, scene, and measurement constraints. Numerical results demonstrate accuracy improvements around 15% for object recognition tasks with limited numbers of measurements, using dynamic metasurface apertures capable of transceiving programmable microwave patterns. Moreover, it is concluded that the optimal learned microwave patterns are nonintuitive, underlining the importance of the LISP paradigm in current sensorization trends.

A Single Noninterleaved Metasurface for High-Capacity and Flexible Mode Multiplexing of Higher-Order Poincaré Sphere Beams

Cylindrical vector vortex beams, a particular class of higher-order Poincaré sphere beams, are generalized forms of waves carrying orbital angular momentum with inhomogeneous states-of-polarization on their wavefronts. Conventional methods as well as the more recently proposed segmented/interleaved shared-aperture metasurfaces for vortex beam generation are either severely limited by bulky optical setups or by restricted channel capacity with low efficiency and mode number. Here, a noninterleaved vortex multiplexing approach is proposed, which utilizes superimposed scattered waves with opposite spin states emanating from all meta-atoms in a coherent manner, counter-intuitively enabling ultrahigh-capacity, high-efficiency, and flexible generation of massive vortex beams with structured state-of-polarization. A series of exemplary prototypes, implemented by sub-wavelength-thick metasurfaces, are demonstrated experimentally, achieving kaleidoscopic vector vortex beams. This methodology holds great promise for structured wavefront shaping, vortex generation, and high information-capacity planar photonics, which may have a profound impact on transformative technological advances in fields including spin-Hall photonics, optical holography, compressive imaging, electromagnetic communication, and so on.

Reliability of wavefront shaping based on coherent optical adaptive technique in deep tissue focusing

Wavefront shaping can compensate the wavefront distortions in deep tissue focusing, leading to an improved penetration depth. However, when using the backscattered signals as the feedback, unexpected compensation bias may be introduced, resulting in focusing position deviations or even no focus in the illumination focal plane. Here we investigated the reliability of wavefront shaping based on coherent optical adaptive technique in deep tissue focusing by measuring the position deviations between the foci in the illumination focal plane and the epi-detection plane. The experimental results show that when the penetration depth reaches 150 μm in mouse brain tissue (with scattering coefficient ~22.42 mm^-1 ) using a 488 nm laser and an objective lens with 0.75 numerical aperture, the center of the real focus will deviate out of one radius range of the Airy disk while the optimized focus in the epi-detection plane maintained basically at the center. With the penetration depth increases, the peak to background ratio of the focus in the illumination focal plane decreases faster than that in the epi-detection plane. The results indicate that when the penetration depth reaches 150 μm, feedback based on backscattered signals will make wavefront shaping lose its reliability, which may provide a guidance for applications of non-invasive precise optogenetics or deep tissue optical stimulation using wavefront shaping methods. A, Intensity distribution in the epi-detection plane and the illumination focal plane before and after correction, corresponding to brain sections with 250 and 300 μm thickness, respectively. Scale bar is 2 μm. B, Averaged focusing deviations in the epi-detection plane (optimized) and the illumination focal plane (monitored) after compensation. The unit of the ordinate is one Airy disk diameter. Black dashed line represents one Airy disk radius. Bars represent the SE of each measurement set.

Shaping the branched flow of light through disordered media

Electronic matter waves traveling through the weak and smoothly varying disorder potential of a semiconductor show a characteristic branching behavior instead of a smooth spreading of flow. By transferring this phenomenon to optics, we demonstrate numerically how the branched flow of light can be controlled to propagate along a single branch rather than along many of them at the same time. Our method is based on shaping the incoming wavefront and only requires partial knowledge of the system's transmission matrix. We show that the light flowing along a single branch has a broadband frequency stability such that one can even steer pulses along selected branches-a prospect with many interesting possibilities for wave control in disordered environments.

Retinal imaging with optical coherence tomography and low-loss adaptive optics using a 2.8-mm beam size

As data acquisition for retinal imaging with optical coherence tomography (OCT) becomes faster, efficient collection of photons becomes more important to maintain image quality. One approach is to use a larger aperture at the eye's pupil to collect more photons that have been reflected from the retina. A 2.8-mm beam diameter system with only seven reflecting surfaces was developed for low-loss retinal imaging. The larger beam size requires defocus and astigmatism correction, which was done in a closed loop adaptive optics method using a Shack-Hartmann wavefront sensor and a deformable mirror (DM) with 140 actuators and a ±2.75 μm stroke. This DM facilitates defocus correction ranging from approximately -3 D to +3 D. Comparing the new system with a standard 1.2-mm system on a model eye, a signal-to-noise gain of 4.5 dB and a 2.3 times smaller speckle size were measured. Measurements on the retinas of five subjects showed even better results, with increases in dynamic range up to 13 dB. Note that the new sample arm only occupies 30 cm × 60 cm, which makes it highly suitable for imaging in a clinical environment. Figure: B-scan images obtained over a width of 8 deg from the right eye of a 31-year-old Caucasian male. While the left side was imaged with a standard 1.2-mm OCT system, the right side was imaged with the 2.8-mm system. Both images were collected with the same integration time and incident power, after correction of aberrations. Using the dynamic range within the images, which is determined by comparing the highest pixel value to the noise floor, a difference in dynamic range of 10.8 dB was measured between the two systems.

Two-Color Volumetric Imaging of Neuronal Activity of Cortical Columns

To capture the emergent properties of neural circuits, high-speed volumetric imaging of neural activity at cellular resolution is needed. Here, we introduce wavelength multiplexing to perform fast volumetric two-photon imaging of cortical columns (>2,000 neurons in 10 planes at 10 vol/s), using two different calcium indicators, an electrically tunable lens and a spatial light modulator. We image the activity of neuronal populations from layers 2/3 to 5 of primary visual cortex from awake mice, finding a lack of columnar structures in orientation responses and revealing correlations between layers which differ from trial to trial. We also simultaneously image functional correlations between presynaptic layer 1 axons and postsynaptic layer 2/3 neurons. Wavelength multiplexing enhances high-speed volumetric microscopy and can be combined with other optical multiplexing methods to easily boost imaging throughput.

Recent Progress on Graphene-Functionalized Metasurfaces for Tunable Phase and Polarization Control

The combination of graphene and a metasurface holds great promise for dynamic manipulation of the electromagnetic wave from low terahertz to mid-infrared. The optical response of graphene is significantly enhanced by the highly-localized fields in the meta-atoms, and the characteristics of meta-atoms can in turn be modulated in a large dynamic range through electrical doping of graphene. Graphene metasurfaces are initially focused on intensity modulation as modulators and tunable absorbers. In this paper, we review the recent progress of graphene metasurfaces for active control of the phase and the polarization. The related applications involve, but are not limited to lenses with tunable intensity or focal length, dynamic beam scanning, wave plates with tunable frequency, switchable polarizers, and real-time generation of an arbitrary polarization state, all by tuning the gate voltage of graphene. The review is concluded with a discussion of the existing challenges and the personal perspective of future directions.

High-speed alignment optimization of digital optical phase conjugation systems based on autocovariance analysis in conjunction with orthonormal rectangular polynomials

Digital optical phase conjugation (DOPC) enables many optical applications by permitting focusing of light through scattering media. However, DOPC systems require precise alignment of all optical components, particularly of the spatial light modulator (SLM) and camera, in order to accurately record the wavefront and perform playback through the use of time-reversal symmetry. We present a digital compensation technique to optimize the alignment of the SLM in five degrees of freedom, permitting focusing through thick scattering media with a thickness of 5 mm and transport scattering coefficient of 2.5  mm  -  1 while simultaneously improving focal quality, as quantified by the peak-to-background ratio, by several orders of magnitude over an unoptimized alignment.

Shaping reverberating sound fields with an actively tunable metasurface

Wavefront shaping with spatial light modulators has recently motivated many studies in the field of light manipulation in diffusive media. Here, we extend this concept to acoustic waves by designing and building a binary phase-modulating spatial sound modulator (SSM). The SSM is an acoustic metasurface consisting of unit cells with two states, switchable through programmed electronics. We demonstrate in audible frequencies, and in a reverberating environment, the capability of controlling and reshaping any complex sound field. Our work will not only open avenues to study wave propagation in complex and chaotic media but also inspire applications in acoustic engineering.

A reverberating environment is a common complex medium for airborne sound, with familiar examples such as music halls and lecture theaters. The complexity of reverberating sound fields has hindered their meaningful control. Here, by combining acoustic metasurface and adaptive wavefield shaping, we demonstrate the versatile control of reverberating sound fields in a room. This is achieved through the design and the realization of a binary phase-modulating spatial sound modulator that is based on an actively reconfigurable acoustic metasurface. We demonstrate useful functionalities including the creation of quiet zones and hotspots in a typical reverberating environment.

Time-reversed ultrasonically encoded optical focusing through highly scattering ex vivo human cataractous lenses

Normal development of the visual system in infants relies on clear images being projected onto the retina, which can be disrupted by lens opacity caused by congenital cataract. This disruption, if uncorrected in early life, results in amblyopia (permanently decreased vision even after removal of the cataract). Doctors are able to prevent amblyopia by removing the cataract during the first several weeks of life, but this surgery risks a host of complications, which can be equally visually disabling. Here, we investigated the feasibility of focusing light noninvasively through highly scattering cataractous lenses to stimulate the retina, thereby preventing amblyopia. This approach would allow the cataractous lens removal surgery to be delayed and hence greatly reduce the risk of complications from early surgery. Employing a wavefront shaping technique named time-reversed ultrasonically encoded optical focusing in reflection mode, we focused 532-nm light through a highly scattering ex vivo adult human cataractous lens. This work demonstrates a potential clinical application of wavefront shaping techniques.

Engineering and Optimization of Quasi-Nondiffracting Helicon-Like Beams With an Evolutionary Algorithm

Nondiffracting beams maintain their intensity profiles over a large propagation distance without substantial diffraction and exhibit unique propagation trajectories, leading to scientific impacts in various fields. However, the nonlocalized intensity distribution of non-diffracting beams is restrictive for many practical applications. Thus, strategies to optimize the beam profiles remain much in demand. In this report, we demonstrate an evolutionary algorithmic framework for optical beam engineering and optimization and experimentally validate it by realizing quasi-nondiffracting radially self-accelerating (or self-rotating) beams in a high-resolution imaging system. The work reports a tightly confined side-lobe-suppressed helicon-like beam that largely maintains its properties of radial self-acceleration and non-diffraction in the 3-D space. The optimization method represents a new methodological avenue that can be extended to a broad range of beam engineering problems.

Hybridized wavefront shaping for high-speed, high-efficiency focusing through dynamic diffusive media

One of the prime limiting factors of optical imaging in biological applications is the diffusion of light by tissue, which prevents focusing at depths greater than the optical diffusion limit (typically ?1??mm). To overcome this challenge, wavefront shaping techniques that use a spatial light modulator (SLM) to correct the phase of the incident wavefront have recently been developed. These techniques are able to focus light through scattering media beyond the optical diffusion limit. However, the low speeds of typically used liquid crystal SLMs limit the focusing speed. Here, we present a method using a digital micromirror device (DMD) and an electro-optic modulator (EOM) to measure the scattering-induced aberrations, and using a liquid crystal SLM to apply the correction to the illuminating wavefront. By combining phase modulation from an EOM with the DMD’s ability to provide selective illumination, we exploit the DMD’s higher refresh rate for phase measurement. We achieved focusing through scattering media in less than 8 ms, which is sufficiently short for certain in vivo applications, as it is comparable to the speckle correlation time of living tissue.

Focusing light through biological tissue and tissue-mimicking phantoms up to 9.6 cm in thickness with digital optical phase conjugation

Optical phase conjugation (OPC)-based wavefront shaping techniques focus light through or within scattering media, which is critically important for deep-tissue optical imaging, manipulation, and therapy. However, to date, the sample thickness in OPC experiments has been limited to only a few millimeters. Here, by using a laser with a long coherence length and an optimized digital OPC system that can safely deliver more light power, we focused 532-nm light through tissue-mimicking phantoms up to 9.6 cm thick, as well as through ex vivo chicken breast tissue up to 2.5 cm thick. Our results demonstrate that OPC can be achieved even when photons have experienced on average 1000 scattering events. The demonstrated penetration of nearly 10 cm (∼100 transport mean free paths) has never been achieved before by any optical focusing technique, and it shows the promise of OPC for deep-tissue noninvasive optical imaging, manipulation, and therapy.

Scattering Optical Elements: Stand-Alone Optical Elements Exploiting Multiple Light Scattering

Optical design and fabrication techniques are crucial for making optical elements. From conventional lenses to diffractive optical elements and to recent metasurfaces, various types of optical elements have been proposed to manipulate light where optical materials are fabricated into desired structures. Here, we propose a scattering optical element (SOE) that exploits multiple light scattering and wavefront shaping. Instead of fabricating optical materials, the SOE consists of a disordered medium and a photopolymer-based wavefront recorder, with shapes impinging on light on demand. With the proposed stand-alone SOEs, we experimentally demonstrate control of various properties of light, including intensity, polarization, spectral frequency, and near field. Due to the tremendous freedom brought about by disordered media, the proposed approach will provide unexplored routes to manipulate arbitrary optical fields in stand-alone optical elements.

All-Optical Interrogation of Neural Circuits

There have been two recent revolutionary advances in neuroscience: First, genetically encoded activity sensors have brought the goal of optical detection of single action potentials in vivo within reach. Second, optogenetic actuators now allow the activity of neurons to be controlled with millisecond precision. These revolutions have now been combined, together with advanced microscopies, to allow "all-optical" readout and manipulation of activity in neural circuits with single-spike and single-neuron precision. This is a transformational advance that will open new frontiers in neuroscience research. Harnessing the power of light in the all-optical approach requires coexpression of genetically encoded activity sensors and optogenetic probes in the same neurons, as well as the ability to simultaneously target and record the light from the selected neurons. It has recently become possible to combine sensors and optical strategies that are sufficiently sensitive and cross talk free to enable single-action-potential sensitivity and precision for both readout and manipulation in the intact brain. The combination of simultaneous readout and manipulation from the same genetically defined cells will enable a wide range of new experiments as well as inspire new technologies for interacting with the brain. The advances described in this review herald a future where the traditional tools used for generations by physiologists to study and interact with the brain-stimulation and recording electrodes-can largely be replaced by light. We outline potential future developments in this field and discuss how the all-optical strategy can be applied to solve fundamental problems in neuroscience.

SIGNIFICANCE STATEMENT

This review describes the nexus of dramatic recent developments in optogenetic probes, genetically encoded activity sensors, and novel microscopies, which together allow the activity of neural circuits to be recorded and manipulated entirely using light. The optical and protein engineering strategies that form the basis of this "all-optical" approach are now sufficiently advanced to enable single-neuron and single-action potential precision for simultaneous readout and manipulation from the same functionally defined neurons in the intact brain. These advances promise to illuminate many fundamental challenges in neuroscience, including transforming our search for the neural code and the links between neural circuit activity and behavior.

Two-photon quantum walk in a multimode fiber

Multiphoton propagation in connected structures-a quantum walk-offers the potential of simulating complex physical systems and provides a route to universal quantum computation. Increasing the complexity of quantum photonic networks where the walk occurs is essential for many applications. We implement a quantum walk of indistinguishable photon pairs in a multimode fiber supporting 380 modes. Using wavefront shaping, we control the propagation of the two-photon state through the fiber in which all modes are coupled. Excitation of arbitrary output modes of the system is realized by controlling classical and quantum interferences. This report demonstrates a highly multimode platform for multiphoton interference experiments and provides a powerful method to program a general high-dimensional multiport optical circuit. This work paves the way for the next generation of photonic devices for quantum simulation, computing, and communication.

Graded metascreens to enable a new degree of nanoscale light management

Optical metasurfaces, typically referred to as two-dimensional metamaterials, are arrays of engineered subwavelength inclusions suitably designed to tailor the light properties, including amplitude, phase and polarization state, over deeply subwavelength scales. By exploiting anomalous localized interactions of surface elements with optical waves, metasurfaces can go beyond the functionalities offered by conventional diffractive optical gratings. The innate simplicity of implementation and the distinct underlying physics of their wave-matter interaction distinguish metasurfaces from three-dimensional metamaterials and provide a valuable means of moulding optical waves in the desired manner. Here, we introduce a general approach based on the electromagnetic equivalence principle to develop and synthesize graded, non-periodic metasurfaces to generate arbitrarily prescribed distributions of electromagnetic waves. Graded metasurfaces are realized with a single layer of spatially modulated, electrically polarizable nanoparticles, tailoring the scattering response of the surface with nanoscale resolutions. We discuss promising applications based on the proposed local wave management technique, including the design of ultrathin optical carpet cloaks, alignment-free polarization beam splitters and a novel approach to enable broadband light absorption enhancement in thin-film solar cells. This concept opens up a practical route towards efficient planarized optical structures with potential impact on the integrated nanophotonic technology.

Optimization of focusing through scattering media using the continuous sequential algorithm

The ability to control the propagation of light through scattering media is essential for atmospheric optics, astronomy, biomedical imaging and remote sensing. The optimization of focusing light through a scattering medium is of particular interest for the case of highly scattering materials. Optical wavefront beam-shaping plays a critical role in optimizing such a propagation; however, an enormous field of adjustable parameters makes the overall task complicated. Here, we propose and experimentally evaluate several variations on the standard continuous sequential algorithm that hold a promise of revealing new, faster and more efficient optimization algorithms for selecting an optical wavefront to focus light through a scattering medium. We demonstrate that the order in which pixels are chosen in the continuous sequential algorithm can lead to a 2-fold decrease in the number of iterations required to reach a given enhancement.

High-resolution in vivo imaging of mouse brain through the intact skull

Multiphoton microscopy is the current method of choice for in vivo deep-tissue imaging. The long laser wavelength suffers less scattering, and the 3D-confined excitation permits the use of scattered signal light. However, the imaging depth is still limited because of the complex refractive index distribution of biological tissue, which scrambles the incident light and destroys the optical focus needed for high resolution imaging. Here, we demonstrate a wavefront-shaping scheme that allows clear imaging through extremely turbid biological tissue, such as the skull, over an extended corrected field of view (FOV). The complex wavefront correction is obtained and directly conjugated to the turbid layer in a noninvasive manner. Using this technique, we demonstrate in vivo submicron-resolution imaging of neural dendrites and microglia dynamics through the intact skulls of adult mice. This is the first observation, to our knowledge, of dynamic morphological changes of microglia through the intact skull, allowing truly noninvasive studies of microglial immune activities free from external perturbations.