Focusing light inside dynamic scattering media with millisecond digital optical phase conjugation

Ultralow radiant exposure of a short-pulsed laser to disrupt melanosomes with localized thermal damage through a turbid medium

Short-pulsed lasers can treat dermal pigmented lesions through selective photothermolysis. The irradiated light experiences multiple scattering by the skin and is absorbed by abnormal melanosomes as well as by normal blood vessels above the target. Because the fluence is extremely high, the absorbed light can cause thermal damage to the adjacent tissue components, leading to complications. To minimize radiant exposure and reduce the risk of burns, a model of the melanosome-disruption threshold fluence (MDTF) has been developed that accounts for the light-propagation efficiency in the skin. However, the light-propagation efficiency is attenuated because of multiple scattering, which limits the extent to which the radiant exposure required for treatment can be reduced. Here, this study demonstrates the principle of melanosome disruption with localized thermal damage through a turbid medium by ultralow radiant exposure of a short-pulsed laser. The MDTF model was combined with a wavefront-shaping technique to design an irradiation condition that can increase the light-propagation efficiency to the target. Under this irradiation condition, melanosomes were disrupted at a radiant exposure 25 times lower than the minimal value used in conventional laser treatments. Furthermore, almost no thermal damage to the skin was confirmed through a numerical simulation. These experimental and numerical results show the potential for noninvasive melanosome disruption and may lead to the improvement of the safety of short-pulsed laser treatment.

All-optical phase conjugation using diffractive wavefront processing

Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with applications ranging from imaging to beam focusing. Here, we present a diffractive wavefront processor to approximate all-optical phase conjugation. Leveraging deep learning, a set of diffractive layers was optimized to all-optically process an arbitrary phase-aberrated input field, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated this wavefront processor by 3D-fabricating diffractive layers and performing OPC on phase distortions never seen during training. Employing terahertz radiation, our diffractive processor successfully performed OPC through a shallow volume that axially spans tens of wavelengths. We also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and multi-wavelength nature, this diffractive wavefront processor can be used for various applications, e.g., turbidity suppression and aberration correction across different spectral bands.

Speed-enhanced scattering compensation method with sub-Nyquist sampling

A rapid feedback-based scattering compensation method is particularly important for guiding light precisely within turbid tissues, especially the dynamic tissues. However, the huge number of measurements that come from the underutilization of the signal frequency channel greatly limits the modulation speed. This paper introduces a rapid compensation method with the sub-Nyquist sampling which improves the channel utilization and the speed of wavefront shaping. The number of measurements is reduced to ∼1500 with 32 × 32 freedom, and the PBR of the focus reaches ∼200. The system performances are demonstrated by focusing the light through brain slices of different thicknesses.

Single-shot digital optical fluorescence phase conjugation through forward multiple-scattering samples

Aberrations and multiple scattering in biological tissues critically distort light beams into highly complex speckle patterns. In this regard, digital optical phase conjugation (DOPC) is a promising technique enabling in-depth focusing. However, DOPC becomes challenging when using fluorescent guide stars for four main reasons: the low photon budget available, the large spectral bandwidth of the fluorescent signal, the Stokes shift between the emission and the excitation wavelength, and the absence of reference beam preventing holographic measurement. Here, we demonstrate the possibility to focus a laser beam through multiple-scattering samples by measuring speckle fields in a single acquisition step with a reference-free, high-resolution wavefront sensor. By taking advantage of the large spectral bandwidth of forward multiply scattering samples, digital fluorescence phase conjugation is achieved to focus a laser beam at the excitation wavelength while measuring the broadband speckle field arising from a micrometer-sized fluorescent bead.

Performance enhancement in wavefront shaping of multiply scattered light: a review

Significance

In nonballistic regime, optical scattering impedes high-resolution imaging through/inside complex media, such as milky liquid, fog, multimode fiber, and biological tissues, where confocal and multiphoton modalities fail. The significant tissue inhomogeneity-induced distortions need to be overcome and a technique referred as optical wavefront shaping (WFS), first proposed in 2007, has been becoming a promising solution, allowing for flexible and powerful light control. Understanding the principle and development of WFS may inspire exciting innovations for effective optical manipulation, imaging, stimulation, and therapy at depths in tissue or tissue-like complex media.

Aim

We aim to provide insights about what limits the WFS towards biomedical applications, and how recent efforts advance the performance of WFS among different trade-offs.

Approach

By differentiating the two implementation directions in the field, i.e., precompensation WFS and optical phase conjugation (OPC), improvement strategies are summarized and discussed.

Results

For biomedical applications, improving the speed of WFS is most essential in both directions, and a system-compatible wavefront modulator driven by fast apparatus is desired. In addition to that, algorithm efficiency and adaptability to perturbations/noise is of concern in precompensation WFS, while for OPC significant improvements rely heavily on integrating physical mechanisms and delicate system design for faster response and higher energy gain.

Conclusions

Substantial improvements in WFS implementations, from the aspects of physics, engineering, and computing, have inspired many novel and exciting optical applications that used to be optically inaccessible. It is envisioned that continuous efforts in the field can further advance WFS towards biomedical applications and guide our vision into deep biological tissues.

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

Fast wavefront shaping for two-photon brain imaging with multipatch correction

Nonlinear fluorescence microscopy promotes in-vivo optical imaging of cellular structure at diffraction-limited resolution deep inside scattering biological tissues. Active compensation of tissue-induced aberrations and light scattering through adaptive wavefront correction further extends the accessible depth by restoring high resolution at large depth. However, those corrections are only valid over a very limited field of view within the angular memory effect. To overcome this limitation, we introduce an acousto-optic light modulation technique for fluorescence imaging with simultaneous wavefront correction at pixel scan speed. Biaxial wavefront corrections are first learned by adaptive optimization at multiple locations in the image field. During image acquisition, the learned corrections are then switched on the fly according to the position of the excitation focus during the raster scan. The proposed microscope is applied to in vivo transcranial neuron imaging and demonstrates multi-patch correction of thinned skull-induced aberrations and scattering at 40-kHz data acquisition speed.

Projecting colorful images through scattering media via deep learning

The existence of scatterers in the optical path has been the major obstacle that prohibits one from projecting images through solid walls, turbid water, clouds, and fog. Recent developments in wavefront shaping and neural networks demonstrate effective compensation for scattering effects, showing the promise to project clear images against strong scattering. However, previous studies were mainly restricted to projecting greyscale images using monochromatic light, mainly due to the increased complexity of simultaneously controlling multiple wavelengths. In this work, we fill this blank by developing a projector network, which enables the projection of colorful images through scattering media with three primary colors. To validate the performance of the projector network, we experimentally demonstrated projecting colorful images obtained from the MINST dataset through two stacked diffusers. Quantitatively, the averaged intensity Pearson's correlation coefficient for 1,000 test colorful images reaches about 90.6%, indicating the superiority of the developed network. We anticipate that the projector network can be beneficial to a variety of display applications in scattering environments.

An ultrahigh-fidelity 3D holographic display using scattering to homogenize the angular spectrum

A three-dimensional (3D) holographic display (3DHD) can preserve all the volumetric information about an object. However, the poor fidelity of 3DHD constrains its applications. Here, we present an ultrahigh-fidelity 3D holographic display that uses scattering for homogenization of angular spectrum. A scattering medium randomizes the incident photons and homogenizes the angular spectrum distribution. The redistributed field is recorded by a photopolymer film with numerous modulation modes and a half-wavelength scale pixel size. We have experimentally improved the contrast of a focal spot to 6 × 106 and tightened its spatial resolution to 0.5 micrometers, respectively ~300 and 4.4 times better than digital approaches. By exploiting the spatial multiplexing ability of the photopolymer and the transmission channel selection capability of the scattering medium, we have realized a dynamic holographic display of 3D spirals consisting of 20 foci across 1 millimeter × 1 millimeter × 26 millimeters with uniform intensity.

Formation of multiple complex light structures simultaneously in 3D volume using a single binary phase mask

Complex structure formation inside or through turbid media is a challenging task due to refractive index inhomogeneity, random light scattering, and speckle noise formation. In this article, we have coupled the data regression model in the R-squared metric and used its advantages as a fitness function in the genetic algorithm to advance the resolution and structural uniformity. As a compatible system with the binary genetic algorithm, we have presented a cost-effective iterative wavefront shaping system-design with binary phase modulation using an affordable ferroelectric liquid crystal (FLC) based binary-phase spatial light modulator (SLM). R-squared metric in the genetic algorithm is analyzed to optimize the binary phase mask, and the prototype system based on iterative binary phase modulation has been validated with a 120-grit ground glass diffuser and fresh chicken tissues of thickness 307 [Formula: see text] and 812 [Formula: see text]. The detailed results show that the proposed cost-effective wavefront shaping system with data regression model assisted R-squared fitness function can construct high-resolution multiple complex hetero-structures simultaneously in 3D volume using an optimized single phase-mask.

Low-cost wavefront shaping via the third-order correlation of light fields

In this Letter, inspired by the ghost imaging technique, we propose a wavefront shaping technique based on the third-order correlation of light fields (TCLF). Theoretically, we prove that if the light field fluctuation can be modeled by a complex Gaussian random process with a non-zero mean, the conjugate complex amplitude of the object and a focusing phase factor can be obtained by TCLF when using a single-point detector, which can support wavefront shaping. Experiments demonstrate that TCLF can achieve high-resolution wavefront shaping for scattered fields and scattering-assisted holography without additional operations such as optimization and phase shifting.

Optical focusing inside scattering media with iterative time-reversed ultrasonically encoded near-infrared light

Focusing light inside scattering media is a long-sought goal in optics. Time-reversed ultrasonically encoded (TRUE) focusing, which combines the advantages of biological transparency of the ultrasound and the high efficiency of digital optical phase conjugation (DOPC) based wavefront shaping, has been proposed to tackle this problem. By invoking repeated acousto-optic interactions, iterative TRUE (iTRUE) focusing can further break the resolution barrier imposed by the acoustic diffraction limit, showing great potential for deep-tissue biomedical applications. However, stringent requirements on system alignment prohibit the practical use of iTRUE focusing, especially for biomedical applications at the near-infrared spectral window. In this work, we fill this blank by developing an alignment protocol that is suitable for iTRUE focusing with a near-infrared light source. This protocol mainly contains three steps, including rough alignment with manual adjustment, fine-tuning with a high-precision motorized stage, and digital compensation through Zernike polynomials. Using this protocol, an optical focus with a peak-to-background ratio (PBR) of up to 70% of the theoretical value can be achieved. By using a 5-MHz ultrasonic transducer, we demonstrated the first iTRUE focusing using near-infrared light at 1053 nm, enabling the formation of an optical focus inside a scattering medium composed of stacked scattering films and a mirror. Quantitatively, the size of the focus decreased from roughly 1 mm to 160 µm within a few consecutive iterations and a PBR up to 70 was finally achieved. We anticipate that the capability of focusing near-infrared light inside scattering media, along with the reported alignment protocol, can be beneficial to a variety of applications in biomedical optics.

Focusing through scattering media by a single polarization transmission matrix with binary polarization modulation

Wavefront distortion induced by scattering media seriously affects optical focusing. Wavefront shaping based on a transmission matrix (TM) is useful in controlling light propagation in highly scattering media. Traditional TM generally studies amplitude and phase, but the stochastic nature of the light propagation in the scattering medium also affects its polarization. Based on the binary polarization modulation, we propose a single polarization transmission matrix (SPTM) and achieve single-spot focusing through scattering media. We anticipate that the SPTM will be widely used in wavefront shaping.

High-gain and high-speed wavefront shaping through scattering media

Wavefront shaping (WFS) is emerging as a promising tool for controlling and focusing light in complex scattering media. The shaping system's speed, the energy gain of the corrected wavefronts, and the control degrees of freedom (DOF) are the most important metrics for WFS, especially for highly scattering and dynamic samples. Despite recent advances, current methods suffer from trade-offs that limit satisfactory performance to only one or two of these metrics. Here, we report a WFS technique that simultaneously achieves high speed, high energy gain, and high control DOF. By combining photorefractive crystal-based analog optical phase conjugation (AOPC) and stimulated emission light amplification, our technique achieves an energy gain approaching unity, more than three orders of magnitude larger than conventional AOPC. The response time of ~10 μs with about 106 control modes corresponds to an average mode time of about 0.01 ns/mode, which is more than 50 times lower than some of the fastest WFS systems to date. We anticipate that this technique will be instrumental in overcoming the optical diffusion limit in photonics and translate WFS techniques to real-world applications.

Optical trapping with holographically structured light for single-cell studies

A groundbreaking work in 1970 by Arthur Ashkin paved the way for developing various optical trapping techniques. Optical tweezers have become an established method for the manipulation of biological objects, due to their noninvasiveness and precise controllability. Recent innovations are accelerating and now enable single-cell manipulation through holographic light structuring. In this review, we provide an overview of recent advances in optical tweezer techniques for studies at the individual cell level. Our review focuses on holographic optical tweezers that utilize active spatial light modulators to noninvasively manipulate live cells. The versatility of the technology has led to valuable integrations with microscopy, microfluidics, and biotechnological techniques for various single-cell studies. We aim to recapitulate the basic principles of holographic optical tweezers, highlight trends in their biophysical applications, and discuss challenges and future prospects.

Scoring-Based Genetic Algorithm for Wavefront Shaping to Optimize Multiple Objectives

We present a scoring-based genetic algorithm (SBGA) for wavefront shaping to optimize multiple objectives at a time. The algorithm is able to find one feasible solution despite having to optimize multiple objectives. We employ the algorithm to generate multiple focus points simultaneously and allocate their intensities as desired. We then introduce a third objective to confine light focusing only to desired targets and prevent irradiation in neighboring regions. Through simulations and experiments, we demonstrate the algorithm's ease of implementation and flexibility to control the search direction. This algorithm can potentially be applied to improve biomedical imaging, optogenetics, and optical trapping.

Robust and adjustable dynamic scattering compensation for high-precision deep tissue optogenetics

The development of high-precision optogenetics in deep tissue is limited due to the strong optical scattering induced by biological tissue. Although various wavefront shaping techniques have been developed to compensate the scattering, it is still a challenge to non-invasively characterize the dynamic scattered optical wavefront inside the living tissue. Here, we present a non-invasive scattering compensation system with fast multidither coherent optical adaptive technique (fCOAT), which allows the rapid wavefront correction and stable focusing in dynamic scattering medium. We achieve subcellular-resolution focusing through 500-μm-thickness brain slices, or even three pieces overlapped mouse skulls after just one iteration with a 589 nm CW laser. Further, focusing through dynamic scattering medium such as live rat ear is also successfully achieved. The formed focus can maintain longer than 60 s, which satisfies the requirements of stable optogenetics manipulation. Moreover, the focus size is adjustable from subcellular level to tens of microns to freely match the various manipulation targets. With the specially designed fCOAT system, we successfully achieve single-cellular optogenetic manipulation through the brain tissue, with a stimulation efficiency enhancement up to 300% compared with that of the speckle.

Fabrication, control, and modeling of robots inspired by flagella and cilia

Flagella and cilia are slender structures that serve important functionalities in the microscopic world through their locomotion induced by fluid and structure interaction. With recent developments in microscopy, fabrication, biology, and modeling capability, robots inspired by the locomotion of these organelles in low Reynolds number flow have been manufactured and tested on the micro-and macro-scale, ranging from medicalin vivomicrobots, microfluidics to macro prototypes. We present a collection of modeling theories, control principles, and fabrication methods for flagellated and ciliary robots.

High-speed single-exposure time-reversed ultrasonically encoded optical focusing against dynamic scattering

Focusing light deep inside live scattering tissue promises to revolutionize biophotonics by enabling deep tissue noninvasive optical imaging, manipulation, and therapy. By combining with guide stars, wavefront shaping is emerging as a powerful tool to make scattering media optically transparent. However, for in vivo biomedical applications, the speeds of existing techniques are still too slow to accommodate the fast speckle decorrelation of live tissue. To address this key bottleneck, we develop a quaternary phase encoding scheme to enable single-exposure time-reversed ultrasonically encode optical focusing with full-phase modulations. Specifically, we focus light inside dynamic scattering media with an average mode time down to 29 ns, which indicates that more than 10⁴ effective spatial modes can be controlled within 1 millisecond. With this technique, we demonstrate in vivo light focusing in between a highly opaque adult zebrafish of 5.1 millimeters in thickness and a ground glass diffuser. Our work presents an important step toward in vivo deep tissue applications of wavefront shaping.

Wavefront shaping for forward scattering

Aberrations and scattering limit the ability of optical microscopy to penetrate deep tissues. Adaptive optics (AO) is a very effective technique to correct for smooth aberrations. Wavefront shaping (WFS) techniques, on the other hand, compensate both scattering and aberrations and have guaranteed convergence even for finding high-dimensional corrections. However, if it is known in advance that the required corrections should be smooth, WFS is suboptimal because it does not use this a priori information. Here, we combine the best of AO and WFS by introducing a WFS method that takes into account the smoothness of the required correction. Our method is numerically stable and robust against noise, and it can find the corrections for multiple targets simultaneously. We experimentally confirmed that this method outperforms existing WFS techniques, especially in forward scattering samples.

Speedy light focusing through scattering media by a cooperatively FPGA-parameterized genetic algorithm

We developed an accelerated Genetic Algorithm (GA) system based on the cooperation of a field-programmable gate array (FPGA) and the optimized parameters that enables fast light focusing through scattering media. Starting at the searching space, which influences the convergence of the optimization algorithms, we manipulated the mutation rate that defines the number of mutated pixels on the spatial light modulator to accelerate the GA process. We found that the enhanced decay ratio of the mutation rate leads to a much faster convergence of the GA. A convergence-efficiency function was defined to gauge the tradeoff between the processing time and the enhancement of the focal spot. This function allowed us to adopt the shorter iteration number of the GA that still achieves applicable light focusing. Furthermore, the accelerated GA configuration was programmed in FPGA to boost processing speed at the hardware level. It shows the ability to focus light through scattering media within a few seconds, 150 times faster than the PC-based GA. The processing cycle could be further promoted to a millisecond-level with the advanced FPGA processor chips. This study makes the evolution-based optimization approach adaptable in dynamic scattering media, showing the capability to tackle wavefront shaping in biological material.

Anti-scattering light focusing with full-polarization digital optical phase conjugation based on digital micromirror devices

The high resolution of optical imaging and optogenetic stimulation in the deep tissue requires focusing light against strong scattering with high contrast. Digital optical phase conjugation (DOPC) has emerged recently as a promising solution for this requirement, because of its short latency. A digital micromirror device (DMD) in the implementation of DOPC enables a large number of modulation modes and a high speed of modulation both of which are important when dealing with a highly dynamic scattering medium. Here, we propose full-polarization DOPC (fpDOPC) in which two DMDs simultaneously modulate the two orthogonally polarized components of the optical field, respectively, to mitigate the effect of depolarization caused by strong scattering. We designed a simple system to overcome the difficulty of alignment encountered when modulating two polarized components independently. Our simulation and experiment showed that fpDOPC could generate a high-contrast focal spot, even though the polarization of light had been highly randomized by scattering. In comparison with the conventional method of modulating the polarization along a particular direction, fpDOPC can improve the peak to background ratio of the focal spot by a factor of two. This new technique has good potential in applications such as high-contrast light focusing in vivo.

Wavefront shaping: A versatile tool to conquer multiple scattering in multidisciplinary fields

Optical techniques offer a wide variety of applications as light-matter interactions provide extremely sensitive mechanisms to probe or treat target media. Most of these implementations rely on the usage of ballistic or quasi-ballistic photons to achieve high spatial resolution. However, the inherent scattering nature of light in biological tissues or tissue-like scattering media constitutes a critical obstacle that has restricted the penetration depth of non-scattered photons and hence limited the implementation of most optical techniques for wider applications. In addition, the components of an optical system are usually designed and manufactured for a fixed function or performance. Recent advances in wavefront shaping have demonstrated that scattering- or component-induced phase distortions can be compensated by optimizing the wavefront of the input light pattern through iteration or by conjugating the transmission matrix of the scattering medium. This offers unprecedented opportunities in many applications to achieve controllable optical delivery or detection at depths or dynamically configurable functionalities by using scattering media to substitute conventional optical components. In this article, the recent progress of wavefront shaping in multidisciplinary fields is reviewed, from optical focusing and imaging with scattering media, functionalized devices, modulation of mode coupling, and nonlinearity in multimode fiber to multimode fiber-based applications. Apart from insights into the underlying principles and recent advances in wavefront shaping implementations, practical limitations and roadmap for future development are discussed in depth. Looking back and looking forward, it is believed that wavefront shaping holds a bright future that will open new avenues for noninvasive or minimally invasive optical interactions and arbitrary control inside deep tissues. The high degree of freedom with multiple scattering will also provide unprecedented opportunities to develop novel optical devices based on a single scattering medium (generic or customized) that can outperform traditional optical components.

Holographic optogenetic stimulation with calcium imaging as an all optical tool for cardiac electrophysiology

All optical approaches to control and read out the electrical activity in a cardiac syncytium can improve our understanding of cardiac electrophysiology. Here, we demonstrate optogenetic stimulation of cardiomyocytes with high spatial precision using light foci generated with a ferroelectric spatial light modulator. Computer generated holograms binarized by bidirectional error diffusion create multiple foci with more even intensity distribution compared with thresholding approach. We evoke the electrical activity of cardiac HL1 cells expressing the channelrhodopsin-2 variant, ChR2(H134R) using single and multiple light foci and at the same time visualize the action potential using a calcium sensitive indicator called Cal-630. We show that localized regions in the cardiac monolayer can be stimulated enabling us to initiate signal propagation from a precise location. Furthermore, we demonstrate that probing the cardiac cells with multiple light foci enhances the excitability of the cardiac network. This approach opens new applications in manipulating and visualizing the electrical activity in a cardiac syncytium.

Snapshot time-reversed ultrasonically encoded optical focusing guided by time-reversed photoacoustic wave

Deep-tissue optical imaging is a longstanding challenge limited by scattering. Both optical imaging and treatment can benefit from focusing light in deep tissue beyond one transport mean free path. Wavefront shaping based on time-reversed ultrasonically encoded (TRUE) optical focusing utilizes ultrasound focus, which is much less scattered than light in biological tissues as the 'guide star'. However, the traditional TRUE is limited by the ultrasound focusing area and pressure tagging efficiency, especially in acoustically heterogeneous medium. Even the improved version of iterative TRUE comes at a large time consumption, which limits the application of TRUE. To address this problem, we proposed a method called time-reversed photoacoustic wave guided time-reversed ultrasonically encoded (TRPA-TRUE) optical focusing by integrating accurate ultrasonic focusing through acoustically heterogeneous medium guided by time-reversing PA signals, and the ultrasound modulation of diffused coherent light with optical phase conjugation (OPC), achieving dynamic focusing of light into scattering medium. Simulation results show that the focusing accuracy of the proposed method has been significantly improved compared with conventional TRUE, which is more suitable for practical applications that suffers severe acoustic distortion, e.g. transcranial optical focusing.

Deep learning image transmission through a multimode fiber based on a small training dataset

An improved deep neural network incorporating attention mechanism and DSSIM loss function (AM_U_Net) is used to recover input images with speckles transmitted through a multimode fiber (MMF). The network is trained on a relatively small dataset and demonstrates an optimal reconstruction ability and generalization ability. Furthermore, a bimodal fusion method is developed based on S polarization and P polarization speckles, greatly improving the recognition accuracy. These findings prove that AM_U_Net has remarkable capabilities for information recovery and transfer learning and good tolerance and robustness under different MMF transmission conditions, indicating its significant application potential in medical imaging and secure communication.

Simultaneous scattering compensation at multiple points in multi-photon microscopy

The two-photon fluorescence imaging depth has been significantly improved in recent years by compensating for tissue scattering with wavefront correction. However, in most approaches the wavefront corrections are valid only over a small sample region on the order of 1 to 10 µm. In samples where most scattering structures are confined to a single plane, sample conjugate correction geometries can increase the observable field to a few tens of µm. Here, we apply a recently introduced fast converging scheme for sensor-less scattering correction termed "Dynamic Adaptive Scattering compensation Holography" (DASH) in a sample conjugate configuration with a high pixel count nematic liquid crystal spatial light modulator (LC-SLM). Using a large SLM allows us to simultaneously correct for scattering at multiple field points, which can be distributed over the entire field of view provided by the objective lens. Despite the comparably slow refresh time of LC-SLMs, we achieve correction times on the order of 10 s per field point, which we show is sufficiently fast to counteract scattering at multiple sites in living mouse hippocampal tissue slices.

Modeling of iterative time-reversed ultrasonically encoded optical focusing in a reflection mode

Time-reversed ultrasonically-encoded (TRUE) optical focusing is a promising technique to realize deep-tissue optical focusing by employing ultrasonic guide stars. However, the sizes of the ultrasound-induced optical focus are determined by the wavelengths of the ultrasound, which are typically tens of microns. To satisfy the need for high-resolution imaging and manipulation, iterative TRUE (iTRUE) was proposed to break this limit by triggering repeated interactions between light and ultrasound and compressing the optical focus. However, even for the best result reported to date, the resolutions along the ultrasound axial and lateral direction were merely improved by only 2-fold to 3-fold. This observation leads to doubt whether iTRUE can be effective in reducing the size of the optical focus. In this work, we address this issue by developing a physical model to investigate iTRUE in a reflection mode numerically. Our numerical results show that, under the influence of shot noises, iTRUE can reduce the optical focus to a single speckle within a finite number of iterations. This model also allows numerical investigations of iTRUE in detail. Quantitatively, based on the parameters set, we show that the optical focus can be reduced to a size of 1.6 µm and a peak-to-background ratio over 10⁴ can be realized. It is also shown that iTRUE cannot significantly advance the focusing depth. We anticipate that this work can serve as useful guidance for optimizing iTRUE system for future biomedical applications, including deep-tissue optical imaging, laser surgery, and optogenetics.

De-noising imaging through diffusers with autocorrelation

Recovering targets through diffusers is an important topic as well as a general problem in optical imaging. The difficulty of recovering is increased due to the noise interference caused by an imperfect imaging environment. Existing approaches generally require a high-signal-to-noise-ratio (SNR) speckle pattern to recover the target, but still have limitations in de-noising or generalizability. Here, featuring information of high-SNR autocorrelation as a physical constraint, we propose a two-stage (de-noising and reconstructing) method to improve robustness based on data driving. Specifically, a two-stage convolutional neural network (CNN) called autocorrelation reconstruction (ACR) CNN is designed to de-noise and reconstruct targets from low-SNR speckle patterns. We experimentally demonstrate the robustness through various diffusers with different levels of noise, from simulative Gaussian noise to the detector and photon noise captured by the actual optical system. The de-noising stage improves the peak SNR from 20 to 38 dB in the system data, and the reconstructing stage, compared with the unconstrained method, successfully recovers targets hidden in unknown diffusers with the detector and photon noise. With the help of the physical constraint to optimize the learning process, our two-stage method is realized to improve generalizability and has potential in various fields such as imaging in low illumination.

Focusing light into scattering media with ultrasound-induced field perturbation

Focusing light into scattering media, although challenging, is highly desirable in many realms. With the invention of time-reversed ultrasonically encoded (TRUE) optical focusing, acousto-optic modulation was demonstrated as a promising guidestar mechanism for achieving noninvasive and addressable optical focusing into scattering media. Here, we report a new ultrasound-assisted technique, ultrasound-induced field perturbation optical focusing, abbreviated as UFP. Unlike in conventional TRUE optical focusing, where only the weak frequency-shifted first-order diffracted photons due to acousto-optic modulation are useful, here UFP leverages the brighter zeroth-order photons diffracted by an ultrasonic guidestar as information carriers to guide optical focusing. We find that the zeroth-order diffracted photons, although not frequency-shifted, do have a field perturbation caused by the existence of the ultrasonic guidestar. By detecting and time-reversing the differential field of the frequency-unshifted photons when the ultrasound is alternately ON and OFF, we can focus light to the position where the field perturbation occurs inside the scattering medium. We demonstrate here that UFP optical focusing has superior performance to conventional TRUE optical focusing, which benefits from the more intense zeroth-order photons. We further show that UFP optical focusing can be easily and flexibly developed into double-shot realization or even single-shot realization, which is desirable for high-speed wavefront shaping. This new method upsets conventional thinking on the utility of an ultrasonic guidestar and broadens the horizon of light control in scattering media. We hope that it provides a more efficient and flexible mechanism for implementing ultrasound-guided wavefront shaping.

Anti-scattering light focusing by fast wavefront shaping based on multi-pixel encoded digital-micromirror device

Speed and enhancement are the two most important metrics for anti-scattering light focusing by wavefront shaping (WS), which requires a spatial light modulator with a large number of modulation modes and a fast speed of response. Among the commercial modulators, the digital-micromirror device (DMD) is the sole solution providing millions of modulation modes and a pattern rate higher than 20 kHz. Thus, it has the potential to accelerate the process of anti-scattering light focusing with a high enhancement. Nevertheless, modulating light in a binary mode by the DMD restricts both the speed and enhancement seriously. Here, we propose a multi-pixel encoded DMD-based WS method by combining multiple micromirrors into a single modulation unit to overcome the drawbacks of binary modulation. In addition, to efficiently optimize the wavefront, we adopted separable natural evolution strategies (SNES), which could carry out a global search against a noisy environment. Compared with the state-of-the-art DMD-based WS method, the proposed method increased the speed of optimization and enhancement of focus by a factor of 179 and 16, respectively. In our demonstration, we achieved 10 foci with homogeneous brightness at a high speed and formed W- and S-shape patterns against the scattering medium. The experimental results suggest that the proposed method will pave a new avenue for WS in the applications of biomedical imaging, photon therapy, optogenetics, dynamic holographic display, etc.

Fast holographic scattering compensation for deep tissue biological imaging

Scattering in biological tissues is a major barrier for in vivo optical imaging of all but the most superficial structures. Progress toward overcoming the distortions caused by scattering in turbid media has been made by shaping the excitation wavefront to redirect power into a single point in the imaging plane. However, fast, non-invasive determination of the required wavefront compensation remains challenging. Here, we introduce a quickly converging algorithm for non-invasive scattering compensation, termed DASH, in which holographic phase stepping interferometry enables new phase information to be updated after each measurement. This leads to rapid improvement of the wavefront correction, forming a focus after just one measurement iteration and achieving an order of magnitude higher signal enhancement at this stage than the previous state-of-the-art. Using DASH, we demonstrate two-photon fluorescence imaging of microglia cells in highly turbid mouse hippocampal tissue down to a depth of 530 μm.

Genetic-algorithm-assisted coherent enhancement absorption in scattering media by exploiting transmission and reflection matrices

The investigations on coherent enhancement absorption (CEA) inside scattering media are critically important in biophotonics. CEA can deliver light to the targeted position, thus enabling deep-tissue optical imaging by improving signal strength and imaging resolution. In this work, we develop a numerical framework that employs the method of finite-difference time-domain. Both the transmission and reflection matrices of scattering media with open boundaries are constructed, allowing the studies on the eigenvalues and eigenchannels. To realize CEA for scattering media with local absorption, we develop a genetic-algorithm-assisted numerical model. By minimizing the total transmittance and reflectance simultaneously, different realizations of CEA are observed and, without setting internal monitors, can be differentiated with cases of light leaked from sides. By modulating the incident wavefront at only one side of the scattering medium, it is shown that for a 5-μm-diameter absorber buried inside a scattering medium of 15 μm × 12 μm, more than half of the incident light can be delivered and absorbed at the target position. The enhancement in absorption is more than four times higher than that with random input. This value can be even higher for smaller absorption regions. We also quantify the effectiveness of the method and show that it is inversely proportional to the openness of the scattering medium. This result is potentially useful for targeted light delivery inside scattering media with local absorption.

Optical information transmission through complex scattering media with optical-channel-based intensity streaming

For the past decade, optical wavefront shaping has been the standard technique to control light through scattering media. Implicit in this dominance is the assumption that manipulating optical interference is a necessity for optical control through scattering media. In this paper, we challenge this assumption by reporting on an alternate approach for light control through a disordered scattering medium - optical-channel-based intensity streaming (OCIS). Instead of actively tuning the interference between the optical paths via wavefront shaping, OCIS controls light and transmits information through scattering media through linear intensity operations. We demonstrate a set of OCIS experiments that connect to some wavefront shaping implementations, i.e. iterative wavefront optimization, digital optical phase conjugation, image transmission through transmission matrix, and direct imaging through scattering media. We experimentally created focus patterns through scattering media on a sub-millisecond timescale. We also demonstrate that OCIS enables a scattering medium mediated secure optical communication application.

Low-coherence optical diffraction tomography using a ferroelectric liquid crystal spatial light modulator

Optical diffraction tomography (ODT) is a three-dimensional (3D) label-free imaging technique. The 3D refractive index distribution of a sample can be reconstructed from multiple two-dimensional optical field images via ODT. Herein, we introduce a temporally low-coherence ODT technique using a ferroelectric liquid crystal spatial light modulator (FLC SLM). The fast binary-phase modulation provided by the FLC SLM ensures the high spatiotemporal resolution. To reduce coherent noise, a superluminescent light-emitting diode is used as an economic low-coherence light source. We demonstrate the performance of the proposed system using various samples, including colloidal microspheres and live epithelial cells.

High-fidelity off-axis digital optical phase conjugation with transmission matrix assisted calibration

The spatial information carried by light is scrambled when it propagates through a scattering medium, such as frosted glass, biological tissue, turbulent air, or multimode optical fibres. Digital optical phase conjugation (DOPC) is a technique that 'pre-aberrates' an illuminating wavefront to compensate for scatterer induced distortion. DOPC systems act as phase-conjugate mirrors: they require a camera to holographically record a distorted wavefront emanating from the scatterer and a spatial light modulator (SLM) to synthesize a phase conjugate of the measured wavefront, which is sent back through the scatterer thus creating a time-reversed copy of the original optical field. High-fidelity DOPC can be technically challenging to achieve as it typically requires pixel-perfect alignment between the camera and SLM. Here we describe a DOPC system in which the normally stringent alignment criteria are relaxed. In our system the SLM and camera are placed in-line in the same optical path from the sample, and the SLM is used in an off-axis configuration. This means high-precision alignment can be achieved by measurement of the transmission matrix (TM) mapping optical fields from the SLM to the camera and vice-versa, irrespective of their relative position. The TM also absorbs and removes other aberrations in the optical system, such as the curvature of the SLM and camera chips. Using our system we demonstrate high-fidelity focussing of light through two ground glass diffusers with a peak-intensity to mean-background ratio of ∼700. We provide a step-by-step guide detailing how to align this system and discuss the trade-offs with alternative configurations. We also describe how our setup can be used as a 'single-pixel camera' based DOPC system, offering potential for DOPC at wavelengths in which cameras are not available or are prohibitively expensive.

Single-shot time-reversed optical focusing into and through scattering media

Optical time reversal can focus light through or into scattering media, which raises a new possibility for conquering optical diffusion. Because optical time reversal must be completed within the correlation time of speckles, enhancing the speed of time-reversed optical focusing is important for practical applications. Although employing faster digital devices for time-reversal helps, more efficient methodologies are also desired. Here, we report a single-shot time-reversed optical focusing method to minimize the wavefront measurement time. In our approach, all information requisite for optical time reversal is extracted from a single-shot hologram, and hence no other preconditions or measurements are required. In particular, we demonstrate the first realization of single-shot time-reversed ultrasonically encoded (TRUE) optical focusing into scattering media. By using the minimum amount of measurement, this work breaks the fundamental speed limit of digitally based time reversal for focusing into and through scattering media, and constitutes an important step toward high-speed wavefront shaping applications.

Seeing through multimode fibers with real-valued intensity transmission matrices

Image transmission through multimode optical fibers has been an area of immense interests driven by the demand for miniature endoscopes in biomedicine and higher speed and capacity in telecommunications. Conventionally, a complex-valued transmission matrix is obtained experimentally to link the input and output light fields of a multimode fiber for image retrieval, which complicates the experimental setup and increases the computational complexity. Here, we report a simple and high-speed method for image retrieval based on our demonstration of a pseudo-linearity between the input and output light intensity distributions of multimode fibers. We studied the impact of several key parameters to image retrieval, including image pixel count, fiber core diameter and numerical aperture. We further demonstrated with experiments and numerical simulations that a wide variety of input binary and gray scale images could be faithfully retrieved from the corresponding output speckle patterns. Thus, it promises to be useful for highly miniaturized endoscopy in biomedicine and spatial-mode-division multiplexing in telecommunications.

Retrieving the optical transmission matrix of a multimode fiber using the extended Kalman filter

Characterizing the transmission matrix (TM) of a multimode fiber (MMF) benefits many fiber-based applications and allows in-depth studies on the physical properties. For example, by modulating the incident field, the knowledge of the TM allows one to synthesize any optical field at the distill end of the MMF. However, the extraction of optical fields usually requires holographic measurements with interferometry, which complicates the system design and introduces additional noise. In this work, we developed an efficient method to retrieve the TM of the MMF in a referenceless optical system. With pure intensity measurements, this method uses the extended Kalman filter (EKF) to recursively search for the optimum solution. To facilitate the computational process, a modified speckle-correlation scatter matrix (MSSM) is constructed as a low-fidelity initial estimation. This method, termed EKF-MSSM, only requires 4N intensity measurements to precisely solve for N unknown complex variables in the TM. Experimentally, we successfully retrieved the TM of the MMF with high precision, which allows optical focusing with the enhancement (>70%) close to the theoretical value. We anticipate that this method will serve as a useful tool for studying physical properties of the MMFs and potentially open new possibilities in a variety of applications in fiber optics.

Fighting against fast speckle decorrelation for light focusing inside live tissue by photon frequency shifting

Focusing light inside live tissue by digital optical phase conjugation (DOPC) has been intensively investigated due to its potential biomedical applications in deep-tissue imaging, optogenetics, microsurgery, and phototherapy. However, fast physiological motions in a live animal, such as blood flow and respiratory motions, produce undesired photon perturbation and thus inevitably deteriorate the performance of light focusing. Here, we develop a photon-frequency-shifting DOPC method to fight against fast physiological motions by switching the states of a guide star at a distinctive frequency. Therefore, the photons tagged by the guide star are well detected at the specific frequency, separating them from the photons perturbed by fast motions. Light focusing was demonstrated in both phantoms in vitro and mice in vivo with substantially improved focusing contrast. This work puts a new perspective on light focusing inside live tissue and promises wide biomedical applications.

Real-time frequency-encoded spatiotemporal focusing through scattering media using a programmable 2D ultrafine optical frequency comb

Optical wavefront shaping is a powerful tool for controlling photons in strongly scattering media. Its speed, however, has been the bottleneck for in vivo applications. Moreover, unlike spatial focusing, temporal focusing from a continuous-wave source has rarely been exploited yet is highly desired for nonlinear photonics. Here, we present a novel real-time frequency-encoded spatiotemporal (FEST) focusing technology. FEST focusing uses a novel programmable two-dimensional optical frequency comb with an ultrafine linewidth to perform single-shot wavefront measurements, with a fast single-pixel detector. This technique enables simultaneous spatial and temporal focusing at microsecond scales through thick dynamic scattering media. This technology also enabled us to discover the large-scale temporal shift, a new phenomenon that, with the conventional spatial memory effect, establishes a space-time duality. FEST focusing opens a new avenue for high-speed wavefront shaping in the field of photonics.

Implementation of an Off-Axis Digital Optical Phase Conjugation System for Turbidity Suppression on Scattering Medium

Due to the light scattering effect, it is difficult to directly achieve optical focusing and imaging in turbid media, such as milk and biological tissue. The turbidity suppression of a scattering medium and control of light through the scattering medium are important for imaging on biological tissue or biophotonics. Optical phase conjugation is a novel technology on turbidity suppression by directly creating phase conjugation light waves to form time-reversed light. In this work, we report a digital optical phase conjugation system based on off-axis holography. Compared with traditional digital optical phase conjugation methods, the off-axis holography acquires the conjugation phase using only one interference image, obviously saving photo acquisition time. Furthermore, we tested the optical phase conjugate reduction performance of this system and also achieved optical focusing through the diffuser. We also proved that the reversing of random scattering in turbid media is achievable by phase conjugation.

Structured light beams created through a multimode fiber via virtual Fourier filtering based on digital optical phase conjugation

Digital optical phase conjugation (DOPC) is a newly developed technique in wavefront shaping to control light propagation through complex media. Currently, DOPC has been demonstrated for the reconstruction of two- and three-dimensional targets and enabled important applications in many areas. Nevertheless, the reconstruction results are only phase conjugated to the original input targets. Herein, we demonstrate that DOPC could be further developed for creating structured light beams through a multimode fiber (MMF). By applying annular filtering in the virtual Fourier domain of the acquired speckle field, we realize the creation of the quasi-Bessel and donut beams through the MMF. In principle, arbitrary amplitude and/or phase circular symmetry filtering could be performed in the Fourier domain, thus generating the corresponding point spread functions. We expect that the reported technique can be useful for super-resolution endoscopic imaging and optical manipulation through MMFs.

Intelligently optimized digital optical phase conjugation with particle swarm optimization

Wavefront shaping (WFS) based on digital optical phase conjugation (DOPC) has gained major interest in focusing light through or inside scattering media. However, the quality of DOPC is greatly limited by imperfections of the system in a complicated and coupled way. In this Letter, we incorporate the concept of global optimization to solve this problem comprehensively for the first time, to the best of our knowledge. An automatic and intelligent optimization framework for DOPC techniques is proposed, leveraging the global optimization ability of particle swarm optimization (PSO). We demonstrate the general and powerful ability of the proposed approach in a series of DOPC-related experiments for focusing through and inside scattering media. This novel work can improve the OPC quality greatly and simplify the development of a high-performance DOPC system, which may open up a new avenue for the general scientific community to benefit from DOPC-based WFS in their potential applications.

Fast 3D movement of a laser focusing spot behind scattering media by utilizing optical memory effect and optical conjugate planes

Controlling light propagation intentionally through turbid media such as ground glass or biological tissue has been demonstrated for many useful applications. Due to random scattering effect, one of the important goals is to draw a desired shape behind turbid media with a swift and precise method. Feedback wavefront shaping method which is known as a very effective approach to focus the light, is restricted by slow optimization process for obtaining multiple spots. Here we propose a technique to implement feedback wavefront shaping with optical memory effect and optical 4f system to speedy move focus spot and form shapes in 3D space behind scattering media. Starting with only one optimization process to achieve a focusing spot, the advantages of the optical configuration and full digital control allow us to move the focus spot with high quality at the speed of SLM frame rate. Multiple focusing spots can be achieved simultaneously by combining multiple phase patterns on a single SLM. By inheriting the phase patterns in the initial focusing process, we can enhance the intensity of the focusing spot at the edge of memory effect in with 50% reduction in optimization time. With a new focusing spot, we have two partially overlapped memory effect regions, expanding our 3D scanning range. With fast wavefront shaping devices, our proposed technique could potentially find appealing applications with biological tissues.

The Unlimited Potential of Microbial Rhodopsins as Optical Tools

Microbial rhodopsins, a photoactive membrane protein family, serve as fundamental tools for optogenetics, an innovative technology for controlling biological activities with light. Microbial rhodopsins are widely distributed in nature and have a wide variety of biological functions. Regardless of the many different known types of microbial rhodopsins, only a few of them have been used in optogenetics to control neural activity to understand neural networks. The efforts of our group have been aimed at identifying and characterizing novel rhodopsins from nature and also at engineering novel variant rhodopsins by rational design. On the basis of the molecular and functional characteristics of those novel rhodopsins, we have proposed new rhodopsin-based optogenetics tools to control not only neural activities but also "non-neural" activities. In this Perspective, we introduce the achievements and summarize future challenges in creating optogenetics tools using rhodopsins. The implementation of optogenetics deep inside an in vivo brain is the well-known challenge for existing rhodopsins. As a perspective to address this challenge, we introduce innovative optical illumination techniques using wavefront shaping that can reinforce the low light sensitivity of the rhodopsins and realize deep-brain optogenetics. The applications of our optogenetics tools could be extended to manipulate non-neural biological activities such as gene expression, apoptosis, energy production, and muscle contraction. We also discuss the potentially unlimited biotechnological applications of microbial rhodopsins in the future such as in photovoltaic devices and in drug delivery systems. We believe that advances in the field will greatly expand the potential uses of microbial rhodopsins as optical tools.

Multi-objective optimization genetic algorithm for multi-point light focusing in wavefront shaping

We introduce a new multi-objective genetic algorithm for wavefront shaping and realize controllable multi-point light focusing through scattering medium. Different from previous single-objective optimization genetic algorithms, our algorithm named Non-dominated Sorting Genetic Algorithm II based on hybrid optimization scheme (NSGA2-H) can make all focus points have uniform intensity while ensuring that their enhancement is as high as possible. We demonstrate the characteristics of NSGA2-H through simulations and experiments in amplitude optimization, analyze its optimization mechanisms and show its powerful optical control capability in uniform intensity focusing and even in customizable intensity focusing. This research will be expected to further promote future practical applications based on multi-point focusing of wavefront shaping, especially in optical trapping and optogenetics.

Algorithm for in vivo detection of tissue type from multiple scattering light phase images

In vivo physiological assessments are typically done by either imaging techniques or by sensing changes in the attenuation coefficient. Using visible or near-infrared (NIR), imaging is mainly possible for thin tissues. On the other hand, clinical information can also be detected by examining changes in tissue optical properties. The most challenging aspect in sensing techniques is the spectral dependent scattering, which varies with the physiological state and tissue type. We have previously published our novel noninvasive nanophotonics technique for detecting tissue scattering based on reflectance measurements: the iterative multi-plane optical property extraction (IMOPE). The IMOPE reconstructs the reemitted light phase using an iterative algorithm and extracts the scattering properties based on a theoretical model. This paper presents the in vivo application of distinguishing between different mouse tissue areas. The reconstructed phase images reveal different areas in the inner thigh of a mouse, which are related to the muscle, bone, and skin. The IMOPE uses the reconstructed phases for sensing and detecting unseen components beneath the skin surface. This technique could be further applied to the diagnosis of various physiological states.

Large-Scale Photonic Ising Machine by Spatial Light Modulation

Quantum and classical physics can be used for mathematical computations that are hard to tackle by conventional electronics. Very recently, optical Ising machines have been demonstrated for computing the minima of spin Hamiltonians, paving the way to new ultrafast hardware for machine learning. However, the proposed systems are either tricky to scale or involve a limited number of spins. We design and experimentally demonstrate a large-scale optical Ising machine based on a simple setup with a spatial light modulator. By encoding the spin variables in a binary phase modulation of the field, we show that light propagation can be tailored to minimize an Ising Hamiltonian with spin couplings set by input amplitude modulation and a feedback scheme. We realize configurations with thousands of spins that settle in the ground state in a low-temperature ferromagneticlike phase with all-to-all and tunable pairwise interactions. Our results open the route to classical and quantum photonic Ising machines that exploit light spatial degrees of freedom for parallel processing of a vast number of spins with programmable couplings.

Fast compensation for arbitrary focusing through scattering media

We introduce a fast compensation scheme to realize arbitrary focusing after propagation through a scattering sample. Theoretical analysis of the effect of cross terms on multi-point focusing is conducted based on the transmission matrix theory. The results show that the cross-term influence is very significant, which needs to be considered. The Multi-Population Genetic Algorithm is adopted to retrieve the input mode for the suppression of the cross-term effect. In order to realize fast compensation and reduce measurement noise, the off-axis holographic method is used to measure the large transmission matrix, which reduces the number of measurements compared with the traditional method. In the experiment, after retrieving the input phase, we obtain a high-quality focal output, and the signal-to-noise ratio is increased by 13.6 dB.