Focusing on moving targets through scattering samples

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

Optical focusing inside scattering media with iterative time-reversed ultrasonically encoded near-infrared light

Focusing light inside scattering media is a long-sought goal in optics. Time-reversed ultrasonically encoded (TRUE) focusing, which combines the advantages of biological transparency of the ultrasound and the high efficiency of digital optical phase conjugation (DOPC) based wavefront shaping, has been proposed to tackle this problem. By invoking repeated acousto-optic interactions, iterative TRUE (iTRUE) focusing can further break the resolution barrier imposed by the acoustic diffraction limit, showing great potential for deep-tissue biomedical applications. However, stringent requirements on system alignment prohibit the practical use of iTRUE focusing, especially for biomedical applications at the near-infrared spectral window. In this work, we fill this blank by developing an alignment protocol that is suitable for iTRUE focusing with a near-infrared light source. This protocol mainly contains three steps, including rough alignment with manual adjustment, fine-tuning with a high-precision motorized stage, and digital compensation through Zernike polynomials. Using this protocol, an optical focus with a peak-to-background ratio (PBR) of up to 70% of the theoretical value can be achieved. By using a 5-MHz ultrasonic transducer, we demonstrated the first iTRUE focusing using near-infrared light at 1053 nm, enabling the formation of an optical focus inside a scattering medium composed of stacked scattering films and a mirror. Quantitatively, the size of the focus decreased from roughly 1 mm to 160 µm within a few consecutive iterations and a PBR up to 70 was finally achieved. We anticipate that the capability of focusing near-infrared light inside scattering media, along with the reported alignment protocol, can be beneficial to a variety of applications in biomedical optics.

Wavefront shaping: A versatile tool to conquer multiple scattering in multidisciplinary fields

Optical techniques offer a wide variety of applications as light-matter interactions provide extremely sensitive mechanisms to probe or treat target media. Most of these implementations rely on the usage of ballistic or quasi-ballistic photons to achieve high spatial resolution. However, the inherent scattering nature of light in biological tissues or tissue-like scattering media constitutes a critical obstacle that has restricted the penetration depth of non-scattered photons and hence limited the implementation of most optical techniques for wider applications. In addition, the components of an optical system are usually designed and manufactured for a fixed function or performance. Recent advances in wavefront shaping have demonstrated that scattering- or component-induced phase distortions can be compensated by optimizing the wavefront of the input light pattern through iteration or by conjugating the transmission matrix of the scattering medium. This offers unprecedented opportunities in many applications to achieve controllable optical delivery or detection at depths or dynamically configurable functionalities by using scattering media to substitute conventional optical components. In this article, the recent progress of wavefront shaping in multidisciplinary fields is reviewed, from optical focusing and imaging with scattering media, functionalized devices, modulation of mode coupling, and nonlinearity in multimode fiber to multimode fiber-based applications. Apart from insights into the underlying principles and recent advances in wavefront shaping implementations, practical limitations and roadmap for future development are discussed in depth. Looking back and looking forward, it is believed that wavefront shaping holds a bright future that will open new avenues for noninvasive or minimally invasive optical interactions and arbitrary control inside deep tissues. The high degree of freedom with multiple scattering will also provide unprecedented opportunities to develop novel optical devices based on a single scattering medium (generic or customized) that can outperform traditional optical components.

Focusing of a Laser Beam Passed through a Moderately Scattering Medium Using Phase-Only Spatial Light Modulator

The rarely considered case of laser beam propagation and focusaing through the moderately scattering medium was researched. A phase-only spatial light modulator (SLM) with 1920×1080 pixel resolution was used to increase the efficiency of focusing of laser radiation propagated through the 5 mm layer of the scattering suspension of 1 µm polystyrene microbeads in distilled water with the concentration values ranging from 105 to 106 mm−3. A CCD camera with micro-objective was used to estimate the intensity distribution of the far-field focal spot. A Shack-Hartmann sensor was used to measure wavefront distortions. The conducted experimental research demonstrated the 8% increase in integral intensity and 16% decrease in diameter of the far-field focal spot due to the use of the SLM for laser beam focusing.

Enhance the delivery of light energy ultra-deep into turbid medium by controlling multiple scattering photons to travel in open channels

Multiple light scattering is considered as the major limitation for deep imaging and focusing in turbid media. In this paper, we present an innovative method to overcome this limitation and enhance the delivery of light energy ultra-deep into turbid media with significant improvement in focusing. Our method is based on a wide-field reflection matrix optical coherence tomography (RM-OCT). The time-reversal decomposition of the RM is calibrated with the Tikhonov regularization parameter in order to get more accurate reversal results deep inside the scattering sample. We propose a concept named model energy matrix, which provides a direct mapping of light energy distribution inside the scattering sample. To the best of our knowledge, it is the first time that a method to measure and quantify the distribution of beam intensity inside a scattering sample is demonstrated. By employing the inversion of RM to find the matched wavefront and shaping with a phase-only spatial light modulator, we succeeded in both focusing a beam deep (~9.6 times of scattering mean free path, SMFP) inside the sample and increasing the delivery of light energy by an order of magnitude at an ultra-deep (~14.4 SMFP) position. This technique provides a powerful tool to understand the propagation of photon in a scattering medium and opens a new way to focus light inside biological tissues.

Optical reciprocity induced wavefront shaping for axial and lateral shifting of focus through a scattering medium

Light propagating along a reversed path experiences the same transmission coefficient as in the forward direction, independent of the path complexity. This is called the optical reciprocity of light, which is valid for not too intense scattering media as well. Hence, by utilizing the reciprocity principle, the proposed novel technique can achieve axially and laterally tunable focus, non-invasively, through a scattering media without a priori knowledge or modeling of its scattering properties. Moreover, the uniqueness of the proposed technique lies in the fact that the illumination and detection are on the same side of the scattering media.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Optimal Control of Coherent Light Scattering for Binary Decision Problems

Because of quantum noise fluctuations, the rate of error achievable in decision problems involving several possible configurations of a scattering system is subject to a fundamental limit known as the Helstrom bound. Here, we present a general framework to calculate and minimize this bound using coherent probe fields with tailored spatial distributions. As an example, we experimentally study a target located in between two disordered scattering media. We first show that the optimal field distribution can be directly identified using a general approach based on scattering matrix measurements. We then demonstrate that this optimal light field successfully probes the presence of the target with a number of photons that is reduced by more than 2 orders of magnitude as compared to unoptimized fields.

Delay-time distribution in the scattering of short Gaussian pulses in microwave networks

We investigate delay-time distributions in the scattering of short Gaussian pulses in microwave networks which simulate quantum graphs. We show that in the limit of short delay times the delay-time distribution is very sensitive to the internal structure of the networks. Therefore, it can be used to reveal their local structure including the boundary conditions at the vertices of the networks. In the frequency domain the pulses comprise many resonance frequencies of the networks. Furthermore, we show that the time-delay distribution averaged over different internal configurations of a finite network decays exponentially. Our experimental results for four-vertex and isoscattering microwave networks are in very good agreement with the theoretical ones obtained from the modified theory of U. Smilansky and H. Schanz [J. Phys. A 51, 075302 (2018)1751-811310.1088/1751-8121/aaa0df]. We modified the theory to account for internal absorption of microwave networks.

Modeling of iterative time-reversed ultrasonically encoded optical focusing in a reflection mode

Time-reversed ultrasonically-encoded (TRUE) optical focusing is a promising technique to realize deep-tissue optical focusing by employing ultrasonic guide stars. However, the sizes of the ultrasound-induced optical focus are determined by the wavelengths of the ultrasound, which are typically tens of microns. To satisfy the need for high-resolution imaging and manipulation, iterative TRUE (iTRUE) was proposed to break this limit by triggering repeated interactions between light and ultrasound and compressing the optical focus. However, even for the best result reported to date, the resolutions along the ultrasound axial and lateral direction were merely improved by only 2-fold to 3-fold. This observation leads to doubt whether iTRUE can be effective in reducing the size of the optical focus. In this work, we address this issue by developing a physical model to investigate iTRUE in a reflection mode numerically. Our numerical results show that, under the influence of shot noises, iTRUE can reduce the optical focus to a single speckle within a finite number of iterations. This model also allows numerical investigations of iTRUE in detail. Quantitatively, based on the parameters set, we show that the optical focus can be reduced to a size of 1.6 µm and a peak-to-background ratio over 10⁴ can be realized. It is also shown that iTRUE cannot significantly advance the focusing depth. We anticipate that this work can serve as useful guidance for optimizing iTRUE system for future biomedical applications, including deep-tissue optical imaging, laser surgery, and optogenetics.

Focusing light into scattering media with ultrasound-induced field perturbation

Focusing light into scattering media, although challenging, is highly desirable in many realms. With the invention of time-reversed ultrasonically encoded (TRUE) optical focusing, acousto-optic modulation was demonstrated as a promising guidestar mechanism for achieving noninvasive and addressable optical focusing into scattering media. Here, we report a new ultrasound-assisted technique, ultrasound-induced field perturbation optical focusing, abbreviated as UFP. Unlike in conventional TRUE optical focusing, where only the weak frequency-shifted first-order diffracted photons due to acousto-optic modulation are useful, here UFP leverages the brighter zeroth-order photons diffracted by an ultrasonic guidestar as information carriers to guide optical focusing. We find that the zeroth-order diffracted photons, although not frequency-shifted, do have a field perturbation caused by the existence of the ultrasonic guidestar. By detecting and time-reversing the differential field of the frequency-unshifted photons when the ultrasound is alternately ON and OFF, we can focus light to the position where the field perturbation occurs inside the scattering medium. We demonstrate here that UFP optical focusing has superior performance to conventional TRUE optical focusing, which benefits from the more intense zeroth-order photons. We further show that UFP optical focusing can be easily and flexibly developed into double-shot realization or even single-shot realization, which is desirable for high-speed wavefront shaping. This new method upsets conventional thinking on the utility of an ultrasonic guidestar and broadens the horizon of light control in scattering media. We hope that it provides a more efficient and flexible mechanism for implementing ultrasound-guided wavefront shaping.

Memory effect assisted imaging through multimode optical fibres

When light propagates through opaque material, the spatial information it holds becomes scrambled, but not necessarily lost. Two classes of techniques have emerged to recover this information: methods relying on optical memory effects, and transmission matrix (TM) approaches. Here we develop a general framework describing the nature of memory effects in structures of arbitrary geometry. We show how this framework, when combined with wavefront shaping driven by feedback from a guide-star, enables estimation of the TM of any such system. This highlights that guide-star assisted imaging is possible regardless of the type of memory effect a scatterer exhibits. We apply this concept to multimode fibres (MMFs) and identify a 'quasi-radial' memory effect. This allows the TM of an MMF to be approximated from only one end - an important step for micro-endoscopy. Our work broadens the applications of memory effects to a range of novel imaging and optical communication scenarios.

Imaging in turbid water based on a Hadamard single-pixel imaging system

Underwater imaging is a challenging task because of the large amounts of noise and the scattering nature of water. Conventional optical methods cannot realize clear imaging in underwater conditions owing to the limitations of low sensitivity, geometrical aberrations, and the narrow spectrum of photoelectric detectors. By contrast, single-pixel imaging (SPI) is a promising tool for imaging in poor-visibility environments. Nevertheless, this challenge is faced even when using traditional SPI methods in highly turbid underwater environments. In this work, we propose a Hadamard single-pixel imaging (HSI) system that outperforms other imaging modes in turbid water imaging. The effects of laser power, projection rate, and water turbidity on the final image quality are systematically investigated. Results reveal that compared with the state-of-the-art SPI techniques, the proposed HSI system is more promising for underwater imaging because of its high resolution and anti-scattering capabilities.

Wavefront Shaping Concepts for Application in Optical Coherence Tomography-A Review

Optical coherence tomography (OCT) enables three-dimensional imaging with resolution on the micrometer scale. The technique relies on the time-of-flight gated detection of light scattered from a sample and has received enormous interest in applications as versatile as non-destructive testing, metrology and non-invasive medical diagnostics. However, in strongly scattering media such as biological tissue, the penetration depth and imaging resolution are limited. Combining OCT imaging with wavefront shaping approaches significantly leverages the capabilities of the technique by controlling the scattered light field through manipulation of the field incident on the sample. This article reviews the main concepts developed so far in the field and discusses the latest results achieved with a focus on signal enhancement and imaging.

Laser beam focusing through a moderately scattering medium using a bimorph mirror

The rarely considered case when the optical radiation passes through the weakly scattering medium, e.g. mid-density atmospheric fog with the number of scattering events up to 10 was investigated in this paper. We demonstrated an improvement of focusing of a laser beam (λ=0.65 µm) passed through the 5 mm-thick layer of scattering suspension of 1 µm polystyrene microbeads diluted in a distilled water. For the first time the low-order aberration corrector - wide aperture bimorph deformable mirror with 48 electrodes configured in 6 rings was used to optimize a far-field focal spot. We compared efficiencies of the algorithm that optimized the positions of the focal spots on Shack-Hartmann type sensor and the algorithm that optimized the peak brightness and the diameter of the far-field focal spot registered with a CCD. We experimentally demonstrated the increase of the peak brightness of the far-field focal spot by up to 60% due to the use of the bimorph deformable mirror for beam focusing through the scattering medium with concentration values of scatterers ranged from 10⁵ to 10⁶ mm^-3.

Quantitative analysis of hidden particles diffusing behind a scattering layer using speckle correlation

Speckle-correlation imaging is a family of methods that makes use of the "memory effect" to image objects hidden behind visually opaque layers. Here, we show that a correlation analysis can be applied to quantitative imaging of an ensemble of dynamic fluorescent beads diffusing on a 2D surface. We use an epi-fluorescence microscope where both the illumination and detection light patterns are speckled, due to light scattering by a thin disordered layer. The spatio-temporal cross-correlation of the detection speckle pattern is calculated as a function of lag time and spatial shift and is used to determine the diffusion constant and number of fluorescent particles in the sample without requiring any phase retrieval procedure. It is worth to note that the "memory effect" range is not required to extend beyond a distance of few speckle grains, thus making our method potentially useful for nearly arbitrary values of the thickness of the scattering layer.

Model-based wavefront shaping microscopy

Wavefront shaping is increasingly being used in modern microscopy to obtain high-resolution images deep inside inhomogeneous media. Wavefront shaping methods typically rely on the presence of a "guide star" to find the optimal wavefront to mitigate the scattering of light. However, the use of guide stars poses severe limitations. Notably, only objects in the close vicinity of the guide star can be imaged. Here, we introduce a guide-star-free wavefront shaping method in which the optimal wavefront is computed using a digital model of the sample. The refractive index model of the sample, that serves as the input for the computation, is constructed in situ by the microscope itself. In a proof of principle imaging experiment, we demonstrate a large improvement in the two-photon fluorescence signal through a diffuse medium, outperforming state-of-the-art wavefront shaping by a factor of two in imaging depth.

Retrieving the optical transmission matrix of a multimode fiber using the extended Kalman filter

Characterizing the transmission matrix (TM) of a multimode fiber (MMF) benefits many fiber-based applications and allows in-depth studies on the physical properties. For example, by modulating the incident field, the knowledge of the TM allows one to synthesize any optical field at the distill end of the MMF. However, the extraction of optical fields usually requires holographic measurements with interferometry, which complicates the system design and introduces additional noise. In this work, we developed an efficient method to retrieve the TM of the MMF in a referenceless optical system. With pure intensity measurements, this method uses the extended Kalman filter (EKF) to recursively search for the optimum solution. To facilitate the computational process, a modified speckle-correlation scatter matrix (MSSM) is constructed as a low-fidelity initial estimation. This method, termed EKF-MSSM, only requires 4N intensity measurements to precisely solve for N unknown complex variables in the TM. Experimentally, we successfully retrieved the TM of the MMF with high precision, which allows optical focusing with the enhancement (>70%) close to the theoretical value. We anticipate that this method will serve as a useful tool for studying physical properties of the MMFs and potentially open new possibilities in a variety of applications in fiber optics.

Sub-acoustic resolution optical focusing through scattering using photoacoustic fluctuation guided wavefront shaping

Focusing light through turbid media using wavefront shaping generally requires a noninvasive guide star to provide feedback on the focusing process. Here we report a photoacoustic guide star mechanism suitable for wavefront shaping through a scattering wall that is based on the fluctuations in the photoacoustic signals generated in a micro-vessel filled with flowing absorbers. The standard deviation of photoacoustic signals generated from random distributions of particles is dependent on the illumination volume and increases nonlinearly as the illumination volume is decreased. We harness this effect to guide wavefront shaping using the standard deviation of the photoacoustic response as the feedback signal. We further demonstrate sub-acoustic resolution optical focusing through a diffuser with a genetic algorithm optimization routine.

Fighting against fast speckle decorrelation for light focusing inside live tissue by photon frequency shifting

Focusing light inside live tissue by digital optical phase conjugation (DOPC) has been intensively investigated due to its potential biomedical applications in deep-tissue imaging, optogenetics, microsurgery, and phototherapy. However, fast physiological motions in a live animal, such as blood flow and respiratory motions, produce undesired photon perturbation and thus inevitably deteriorate the performance of light focusing. Here, we develop a photon-frequency-shifting DOPC method to fight against fast physiological motions by switching the states of a guide star at a distinctive frequency. Therefore, the photons tagged by the guide star are well detected at the specific frequency, separating them from the photons perturbed by fast motions. Light focusing was demonstrated in both phantoms in vitro and mice in vivo with substantially improved focusing contrast. This work puts a new perspective on light focusing inside live tissue and promises wide biomedical applications.

Focusing light inside live tissue using reversibly switchable bacterial phytochrome as a genetically encoded photochromic guide star

Focusing light deep by engineering wavefronts toward guide stars inside scattering media has potential biomedical applications in imaging, manipulation, stimulation, and therapy. However, the lack of endogenous guide stars in biological tissue hinders its translations to in vivo applications. Here, we use a reversibly switchable bacterial phytochrome protein as a genetically encoded photochromic guide star (GePGS) in living tissue to tag photons at targeted locations, achieving light focusing inside the tissue by wavefront shaping. As bacterial phytochrome-based GePGS absorbs light differently upon far-red and near-infrared illumination, a large dynamic absorption contrast can be created to tag photons inside tissue. By modulating the GePGS at a distinctive frequency, we suppressed the competition between GePGS and tissue motions and formed tight foci inside mouse tumors in vivo and acute mouse brain tissue, thus improving light delivery efficiency and specificity. Spectral multiplexing of GePGS proteins with different colors is an attractive possibility.

Non-Invasive Imaging Through Scattering Medium by Using a Reverse Response Wavefront Shaping Technique

Fundamental challenge of imaging through a scattering media has been resolved by various approaches in the past two decades. Optical wavefront shaping technique is one such method in which one shapes the wavefront of light entering a scattering media using a wavefront shaper such that it cancels the scattering effect. It has been the most effective technique in focusing light inside a scattering media. Unfortunately, most of these techniques require direct access to the scattering medium or need to know the scattering properties of the medium beforehand. Through the novel scheme presented on this paper, both the illumination module and the detection are on the same side of the inspected object and the imaging process is a real time fast converging operation. We model the scattering medium being a biological tissue as a matrix having mathematical properties matched to the physical and biological aspects of the sample. In our adaptive optics scheme, we aim to estimate the scattering function and thus to encode the intensity of the illuminating laser light source using DMD (Digital Micromirror Device) with an inverse scattering function of the scattering medium, such that after passing its scattering function a focused beam is obtained. We optimize the pattern to be displayed on the DMD using Particle Swarm Algorithm (PSO) which eventually help in retrieving a 1D object hidden behind the media.

Speckle rotation decorrelation based single-shot video through scattering media

Optical imaging and tracking moving objects through scattering media is a challenge with important applications. However, previous works suffer from time-consuming recovery process, object complexity limit, or object information lost. Here we present a method based on the speckle rotation decorrelation property. The rotational speckles detected at short intervals are uncorrelated and multiplexed in a single-shot camera image. Object frames of the video are recovered by cross-correlation deconvolution of the camera image with a computationally rotated point spread function. The near real-time recovery provides sharp object image frames with accurate object relative positions, exact movement velocity, and continuous motion trails. This multiplexing technique has important implications for a wide range of real-world imaging scenarios.

Rapid wide-field imaging through scattering media by digital holographic wavefront correction

Imaging through scattering media has been a long standing challenge in many disciplines. One of the promising solutions to address the challenge is the wavefront shaping technique, in which the phase distortion due to a scattering medium is corrected by a phase modulation device such as a spatial light modulator (SLM). However, the wide-field imaging speed is limited either by the feedback-based optimization to search the correction phase or by the update rate of SLMs. In this report, we introduce a new method called digital holographic wavefront correction, in which the correction phase is determined by a single-shot off-axis holography. The correction phase establishes the so-called "scattering lens", which allows any objects to be imaged through scattering media; in our case, the "scattering lens" is a digital one established through computational methods. As no SLM is involved in the imaging process, the imaging speed is significantly improved. We have demonstrated that moving objects behind scattering media can be recorded at the speed of 2.8 fps with each frame corrected by the updated correction phase while the image contrast is maintained as high as 0.9. The image speed can potentially reach the video rate if the computing power is sufficiently high. We have also demonstrated that the digital wavefront correction method also works when the light intensity is low, which implicates its potential usefulness in imaging dynamic processes in biological tissues.

Real-time optical manipulation of particles through turbid media

Complex diffusive scattering media pose significant challenges for light focusing as well as optical imaging to be implemented in practice. Recently, it has been demonstrated that the wavefront shaping technique can be applied to realize focusing and imaging through scattering medium. Here we report dynamic optical manipulation of particles through turbid media by employing the interleaved segment wavefront correction method, which is an improved genetic algorithm providing faster convergence speed and higher peak to background ratio. Manipulating micro-beads behind a scattering medium along both one and two dimensional predesigned trajectories in real time has been successfully demonstrated.

Controlling 1550-nm light through a multimode fiber using a Hadamard encoding algorithm

To meet the demand for higher capacity fiber-optic communication, multimode fibers have gradually attracted attention, but they introduce spatial distortions. To overcome this limitation, wavefront shaping technology promises to control scattered light after it is transmitted through multimode fibers. In this work, we introduce a Hadamard encoding algorithm (HEA) to control 1550-nm light that has passed through a multimode fiber. A series of Hadamard bases is iteratively added to the current optimum phase map, and the coefficient of each order is determined through a simple four-step phase-shifting mechanism. Using a laser source at 1550-nm wavelength, we experimentally achieved an optical focus through a 2-meter-long multimode fiber. With 1024 orders, the experimental enhancement reached 690, which is 86% of the theoretical value. As far as we know, this is the best result ever reported in focusing 1550-nm light through a multimode fiber. Moreover, we note that the HEA can also be used to reduce the intensity of the targeted light, suggesting broad applications in glare suppression. These results demonstrate superior performance in controlling targeted light transport through a multimode fiber at a telecommunication wavelength. We anticipate that this work will open new possibilities in a variety of applications in fiber optics.

Implementation of digital optical phase conjugation with embedded calibration and phase rectification

Focused and controllable optical delivery beyond the optical diffusion limit in biological tissue has been desired for long yet considered challenging. Digital optical phase conjugation (DOPC) has been proven promising to tackle this challenge. Its broad applications, however, have been hindered by the system’s complexity and rigorous requirements, such as the optical beam quality, the pixel match between the wavefront sensor and wavefront modulator, as well as the flatness of the modulator’s active region. In this paper, we present a plain yet reliable DOPC setup with an embedded four-phase, non-iterative approach that can rapidly compensate for the wavefront modulator’s surface curvature, together with a non-phase-shifting in-line holography method for optical phase conjugation in the absence of an electro-optic modulator (EOM). In experiment, with the proposed setup the peak-to-background ratio (PBR) of optical focusing through a standard ground glass in experiment can be improved from 460 up to 23,000, while the full width at half maximum (FWHM) of the focal spot can be reduced from 50 down to 10 μm. The focusing efficiency, as measured by the value of PBR, reaches nearly 56.5% of the theoretical value. Such a plain yet efficient implementation, if further engineered, may potentially boost DOPC suitable for broader applications.

High-speed alignment optimization of digital optical phase conjugation systems based on autocovariance analysis in conjunction with orthonormal rectangular polynomials

Digital optical phase conjugation (DOPC) enables many optical applications by permitting focusing of light through scattering media. However, DOPC systems require precise alignment of all optical components, particularly of the spatial light modulator (SLM) and camera, in order to accurately record the wavefront and perform playback through the use of time-reversal symmetry. We present a digital compensation technique to optimize the alignment of the SLM in five degrees of freedom, permitting focusing through thick scattering media with a thickness of 5 mm and transport scattering coefficient of 2.5  mm  -  1 while simultaneously improving focal quality, as quantified by the peak-to-background ratio, by several orders of magnitude over an unoptimized alignment.

Effects of digital phase-conjugate light intensity on time-reversal imaging through animal tissue

For transillumination imaging of animal tissues, we have attempted to suppress the scattering effect in a turbid medium using the time-reversal principle of phase-conjugate light. We constructed a digital phase-conjugate system to enable intensity modulation and phase modulation. Using this system, we clarified the effectiveness of the intensity information for restoration of the original light distribution through a turbid medium. By varying the scattering coefficient of the medium, we clarified the limit of time-reversal ability with intensity information of the phase-conjugate light. Experiment results demonstrated the applicability of the proposed technique to animal tissue.

Dynamic light sheet generation and fluorescence imaging behind turbid media

BACKGROUND

Light sheet microscopy became a popular tool allowing fast imaging with reduced out of focus light. However, when light penetrates turbid media such as biological tissues, multiple scattering scrambles the illumination into a speckle pattern and severely challenges conventional fluorescence imaging with focused light or with a light sheet. In this article, we present generation of light sheet type illumination patterns despite scattering.

METHODS

We optimize the wave-front of the incoming light to transform the speckle pattern behind the scattering layer into a light sheet within the region of interest. We utilize a fast spatial light modulator for phase modulation and a genetic optimization algorithm. The light pattern behind the scattering layer is detected via a clear detection path and acts as a feedback signal for the algorithm.

RESULTS

We enabled homogenous light sheet illumination behind turbid media and enhanced the signal of fluorescent beads selectively at the desired focal plane up to eight times on average. The technique is capable to compensate the dynamic changes of the speckle pattern as well, as shown on samples consisting of living drosophila pupae.

CONCLUSION

Our technique shows that not only single foci, but also a homogenous light sheet illumination can directly be created and maintained behind static and dynamic scattering media. To make the technique suitable for common biological settings, where the detection path is turbid as well, a fluorescent probe can be used to provide the feedback signal.

Time-reversed magnetically controlled perturbation (TRMCP) optical focusing inside scattering media

Manipulating and focusing light deep inside biological tissue and tissue-like complex media has been desired for long yet considered challenging. One feasible strategy is through optical wavefront engineering, where the optical scattering-induced phase distortions are time reversed or pre-compensated so that photons travel along different optical paths interfere constructively at the targeted position within a scattering medium. To define the targeted position, an internal guidestar is needed to guide or provide a feedback for wavefront engineering. It could be injected or embedded probes such as fluorescence or nonlinear microspheres, ultrasonic modulation, as well as absorption perturbation. Here we propose to use a magnetically controlled optical absorbing microsphere as the internal guidestar. Using a digital optical phase conjugation system, we obtained sharp optical focusing within scattering media through time-reversing the scattered light perturbed by the magnetic microsphere. Since the object is magnetically controlled, dynamic optical focusing is allowed with a relatively large field-of-view by scanning the magnetic field externally. Moreover, the magnetic microsphere can be packaged with an organic membrane, using biological or chemical means to serve as a carrier. Therefore, the technique may find particular applications for enhanced targeted drug delivery, and imaging and photoablation of angiogenic vessels in tumours.

Time-reversed ultrasonically encoded optical focusing through highly scattering ex vivo human cataractous lenses

Normal development of the visual system in infants relies on clear images being projected onto the retina, which can be disrupted by lens opacity caused by congenital cataract. This disruption, if uncorrected in early life, results in amblyopia (permanently decreased vision even after removal of the cataract). Doctors are able to prevent amblyopia by removing the cataract during the first several weeks of life, but this surgery risks a host of complications, which can be equally visually disabling. Here, we investigated the feasibility of focusing light noninvasively through highly scattering cataractous lenses to stimulate the retina, thereby preventing amblyopia. This approach would allow the cataractous lens removal surgery to be delayed and hence greatly reduce the risk of complications from early surgery. Employing a wavefront shaping technique named time-reversed ultrasonically encoded optical focusing in reflection mode, we focused 532-nm light through a highly scattering ex vivo adult human cataractous lens. This work demonstrates a potential clinical application of wavefront shaping techniques.

Wavefront Shaping and Its Application to Enhance Photoacoustic Imaging

Since its introduction to the field in mid-1990s, photoacoustic imaging has become a fast-developing biomedical imaging modality with many promising potentials. By converting absorbed diffused light energy into not-so-diffused ultrasonic waves, the reconstruction of the ultrasonic waves from the targeted area in photoacoustic imaging leads to a high-contrast sensing of optical absorption with ultrasonic resolution in deep tissue, overcoming the optical diffusion limit from the signal detection perspective. The generation of photoacoustic signals, however, is still throttled by the attenuation of photon flux due to the strong diffusion effect of light in tissue. Recently, optical wavefront shaping has demonstrated that multiply scattered light could be manipulated so as to refocus inside a complex medium, opening up new hope to tackle the fundamental limitation. In this paper, the principle and recent development of photoacoustic imaging and optical wavefront shaping are briefly introduced. Then we describe how photoacoustic signals can be used as a guide star for in-tissue optical focusing, and how such focusing can be exploited for further enhancing photoacoustic imaging in terms of sensitivity and penetration depth. Finally, the existing challenges and further directions towards in vivo applications are discussed.

Deep tissue optical focusing and optogenetic modulation with time-reversed ultrasonically encoded light

Noninvasive light focusing deep inside living biological tissue has long been a goal in biomedical optics. However, the optical scattering of biological tissue prevents conventional optical systems from tightly focusing visible light beyond several hundred micrometers. The recently developed wavefront shaping technique time-reversed ultrasonically encoded (TRUE) focusing enables noninvasive light delivery to targeted locations beyond the optical diffusion limit. However, until now, TRUE focusing has only been demonstrated inside nonliving tissue samples. We present the first example of TRUE focusing in 2-mm-thick living brain tissue and demonstrate its application for optogenetic modulation of neural activity in 800-μm-thick acute mouse brain slices at a wavelength of 532 nm. We found that TRUE focusing enabled precise control of neuron firing and increased the spatial resolution of neuronal excitation fourfold when compared to conventional lens focusing. This work is an important step in the application of TRUE focusing for practical biomedical uses.

High-speed single-shot optical focusing through dynamic scattering media with full-phase wavefront shaping

In biological applications, optical focusing is limited by the diffusion of light, which prevents focusing at depths greater than ∼1 mm in soft tissue. Wavefront shaping extends the depth by compensating for phase distortions induced by scattering and thus allows for focusing light through biological tissue beyond the optical diffusion limit by using constructive interference. However, due to physiological motion, light scattering in tissue is deterministic only within a brief speckle correlation time. In in vivo tissue, this speckle correlation time is on the order of milliseconds, and so the wavefront must be optimized within this brief period. The speed of digital wavefront shaping has typically been limited by the relatively long time required to measure and display the optimal phase pattern. This limitation stems from the low speeds of cameras, data transfer and processing, and spatial light modulators. While binary-phase modulation requiring only two images for the phase measurement has recently been reported, most techniques require at least three frames for the full-phase measurement. Here, we present a full-phase digital optical phase conjugation method based on off-axis holography for single-shot optical focusing through scattering media. By using off-axis holography in conjunction with graphics processing unit based processing, we take advantage of the single-shot full-phase measurement while using parallel computation to quickly reconstruct the phase map. With this system, we can focus light through scattering media with a system latency of approximately 9 ms, on the order of the in vivo speckle correlation time.

High-speed single-shot optical focusing through dynamic scattering media with full-phase wavefront shaping

In biological applications, optical focusing is limited by the diffusion of light, which prevents focusing at depths greater than ∼1 mm in soft tissue. Wavefront shaping extends the depth by compensating for phase distortions induced by scattering and thus allows for focusing light through biological tissue beyond the optical diffusion limit by using constructive interference. However, due to physiological motion, light scattering in tissue is deterministic only within a brief speckle correlation time. In in vivo tissue, this speckle correlation time is on the order of milliseconds, and so the wavefront must be optimized within this brief period. The speed of digital wavefront shaping has typically been limited by the relatively long time required to measure and display the optimal phase pattern. This limitation stems from the low speeds of cameras, data transfer and processing, and spatial light modulators. While binary-phase modulation requiring only two images for the phase measurement has recently been reported, most techniques require at least three frames for the full-phase measurement. Here, we present a full-phase digital optical phase conjugation method based on off-axis holography for single-shot optical focusing through scattering media. By using off-axis holography in conjunction with graphics processing unit based processing, we take advantage of the single-shot full-phase measurement while using parallel computation to quickly reconstruct the phase map. With this system, we can focus light through scattering media with a system latency of approximately 9 ms, on the order of the in vivo speckle correlation time.

Focusing light inside scattering media with magnetic-particle-guided wavefront shaping

Optical scattering has traditionally limited the ability to focus light inside scattering media such as biological tissue. Recently developed wavefront shaping techniques promise to overcome this limit by tailoring an optical wavefront to constructively interfere at a target location deep inside scattering media. To find such a wavefront solution, a "guide-star" mechanism is required to identify the target location. However, developing guidestars of practical usefulness is challenging, especially in biological tissue, which hinders the translation of wavefront shaping techniques. Here, we demonstrate a guidestar mechanism that relies on magnetic modulation of small particles. This guidestar method features an optical modulation efficiency of 29% and enables micrometer-scale focusing inside biological tissue with a peak intensity-to-background ratio (PBR) of 140; both numbers are one order of magnitude higher than those achieved with the ultrasound guidestar, a popular guidestar method. We also demonstrate that light can be focused on cells labeled with magnetic particles, and to different target locations by magnetically controlling the position of a particle. Since magnetic fields have a large penetration depth even through bone structures like the skull, this optical focusing method holds great promise for deep-tissue applications such as optogenetic modulation of neurons, targeted light-based therapy, and imaging.

Focusing light through scattering media by transmission matrix inversion

Focusing light through scattering media has broad applications in optical imaging, manipulation and therapy. The contrast of the focus can be quantified by peak-to-background intensity ratio (PBR). Here, we theoretically and numerically show that by using a transmission matrix inversion method to achieve focusing, within a limited field of view and under a low noise condition in transmission matrix measurements, the PBR of the focus can be higher than that achieved by conventional methods such as optical phase conjugation or feedback-based wavefront shaping. Experimentally, using a phase-modulation spatial light modulator, we increase the PBR by 66% over that achieved by conventional methods based on phase conjugation. In addition, we demonstrate that, within a limited field of view and under a low noise condition in transmission matrix measurements, our matrix inversion method enables light focusing to multiple foci with greater fidelity than those of conventional methods.

Interleaved segment correction achieves higher improvement factors in using genetic algorithm to optimize light focusing through scattering media

Focusing and imaging through scattering media has been proved possible with high resolution wavefront shaping. A completely scrambled scattering field can be corrected by applying a correction phase mask on a phase only spatial light modulator (SLM) and thereby the focusing quality can be improved. The correction phase is often found by global searching algorithms, among which Genetic Algorithm (GA) stands out for its parallel optimization process and high performance in noisy environment. However, the convergence of GA slows down gradually with the progression of optimization, causing the improvement factor of optimization to reach a plateau eventually. In this report, we propose an interleaved segment correction (ISC) method that can significantly boost the improvement factor with the same number of iterations comparing with the conventional all segment correction (ASC) method. In the ISC method, all the phase segments are divided into a number of interleaved groups; GA optimization procedures are performed individually and sequentially among each group of segments. The final correction phase mask is formed by applying correction phases of all interleaved groups together on the SLM. The ISC method has been proved significantly useful in practice because of its ability to achieve better improvement factors when noise is present in the system. We have also demonstrated that the imaging quality is improved as better correction phases are found and applied on the SLM. Additionally, the ISC method lowers the demand of dynamic ranges of detection devices. The proposed method holds potential in applications, such as high-resolution imaging in deep tissue.

Holographic imaging through a scattering layer using speckle interferometry

Optical imaging through complex scattering media is one of the major technical challenges with important applications in many research fields, ranging from biomedical imaging to astronomical telescopy to spatially multiplexed optical communications. Various approaches for imaging through a turbid layer have been recently proposed that exploit the advantage of object information encoded in correlations of the random optical fields. Here we propose and experimentally demonstrate an alternative approach for single-shot imaging of objects hidden behind an opaque scattering layer. The proposed technique relies on retrieving the interference fringes projected behind the scattering medium, which leads to complex field reconstruction, from far-field laser speckle interferometry with two-point intensity correlation measurement. We demonstrate that under suitable conditions, it is possible to perform imaging to reconstruct the complex amplitude of objects situated at different depths.

Focusing inside Disordered Media with the Generalized Wigner-Smith Operator

We introduce a wave front shaping protocol for focusing inside disordered media based on a generalization of the established Wigner-Smith time-delay operator. The key ingredient for our approach is the scattering (or transmission) matrix of the medium and its derivative with respect to the position of the target one aims to focus on. A specific experimental realization in the microwave regime is presented showing that the eigenstates of a corresponding operator are sorted by their focusing strength-ranging from strongly focusing on the designated target to completely bypassing it. Our protocol works without optimization or phase conjugation and we expect it to be particularly attractive for optical imaging in disordered media.

Lensless complex amplitude image retrieval through a visually opaque scattering medium

We propose and experimentally demonstrate lensless complex amplitude image retrieval through a visually opaque scattering medium from spatially fluctuating fields using intensity measurement and a phase-retrieval algorithm. The complex amplitude information of the hidden object is encoded in the form of a real and nonnegative amplitude function represented as an interference pattern. A single charge coupled device (CCD) image of the scattered light collected through a visually opaque optical diffuser contains enough information to digitally regenerate the interference pattern. Furthermore, a lensless configuration is implemented which eliminates any possible aberration effects associated with optical components, and this further has promising applications where the use of imaging optics is not feasible. Experimental results for the recovery of complex fields corresponding to optical vortices of two different topological charges are presented.

Three-dimensional focusing through scattering media using conjugate adaptive optics with remote focusing (CAORF)

The small correction volume for conventional wavefront shaping methods limits their application in biological imaging through scattering media. We demonstrate large volume wavefront shaping through a scattering layer with a single correction by conjugate adaptive optics and remote focusing (CAORF). The remote focusing module can maintain the conjugation between the adaptive optical (AO) element and the scattering layer during three-dimensional scanning. This new configuration provides a wider correction volume by better utilization of the memory effect in a fast three-dimensional laser scanning microscope. Our results show that the proposed system can provide 10 times wider axial field of view compared with a conventional conjugate AO system when 16,384 segments are used on a spatial light modulator. We also demonstrate three-dimensional fluorescence imaging, multi-spot patterning through a scattering layer and two-photon imaging through mouse skull tissue.

Optical Phase Conjugation with Less Than a Photon per Degree of Freedom

We demonstrate experimentally that optical phase conjugation can be used to focus light through strongly scattering media even when far less than a photon per optical degree of freedom is detected. We found that the best achievable intensity contrast is equal to the total number of detected photons, as long as the resolution of the system is high enough. Our results demonstrate that phase conjugation can be used even when the photon budget is extremely low, such as in high-speed focusing through dynamic media or imaging deep inside tissue.

Imaging moving targets through scattering media

Optical microscopy in complex, inhomogeneous media is challenging due to the presence of multiply scattered light that limits the depths at which diffraction-limited resolution can be achieved. One way to circumvent the degradation in resolution is to use speckle- correlation-based imaging (SCI) techniques, which permit imaging of objects inside scattering media at diffraction-limited resolution. However, SCI methods are currently limited to imaging sparsely tagged objects in a dark-field scenario. In this work, we demonstrate the ability to image hidden, moving objects in a bright-field scenario. By using a deterministic phase modulator to generate a spatially incoherent light source, the background contribution can be kept constant between acquisitions and subtracted out. In this way, the signal arising from the object can be isolated, and the object can be reconstructed with high fidelity. With the ability to effectively isolate the object signal, our work is not limited to imaging bright objects in the dark-field case, but also works in bright-field scenarios, with non-emitting objects.

Exploiting scattering media for exploring 3D objects

Scattering media, such as diffused glass and biological tissue, are usually treated as obstacles in imaging. To cope with the random phase introduced by a turbid medium, most existing imaging techniques recourse to either phase compensation by optical means or phase recovery using iterative algorithms, and their applications are often limited to two-dimensional imaging. In contrast, we utilize the scattering medium as an unconventional imaging lens and exploit its lens-like properties for lensless three-dimensional (3D) imaging with diffraction-limited resolution. Our spatially incoherent lensless imaging technique is simple and capable of variable focusing with adjustable depths of focus that enables depth sensing of 3D objects that are concealed by the diffusing medium. Wide-field imaging with diffraction-limited resolution is verified experimentally by a single-shot recording of the 1951 USAF resolution test chart, and 3D imaging and depth sensing are demonstrated by shifting focus over axially separated objects.

Focusing light inside dynamic scattering media with millisecond digital optical phase conjugation

Wavefront shaping based on digital optical phase conjugation (DOPC) focuses light through or inside scattering media, but the low speed of DOPC prevents it from being applied to thick, living biological tissue. Although a fast DOPC approach was recently developed, the reported single-shot wavefront measurement method does not work when the goal is to focus light inside, instead of through, highly scattering media. Here, using a ferroelectric liquid crystal based spatial light modulator, we develop a simpler but faster DOPC system that focuses light not only through, but also inside scattering media. By controlling 2.6 × 105 optical degrees of freedom, our system focused light through 3 mm thick moving chicken tissue, with a system latency of 3.0 ms. Using ultrasound-guided DOPC, along with a binary wavefront measurement method, our system focused light inside a scattering medium comprising moving tissue with a latency of 6.0 ms, which is one to two orders of magnitude shorter than those of previous digital wavefront shaping systems. Since the demonstrated speed approaches tissue decorrelation rates, this work is an important step toward in vivo deep-tissue non-invasive optical imaging, manipulation, and therapy.

Sub-Nyquist sampling boosts targeted light transport through opaque scattering media

Optical time-reversal techniques are being actively developed to focus light through or inside opaque scattering media. When applied to biological tissue, these techniques promise to revolutionize biophotonics by enabling deep-tissue non-invasive optical imaging, optogenetics, optical tweezing, and phototherapy. In all previous optical time-reversal experiments, the scattered light field was well-sampled during wavefront measurement and wavefront reconstruction, following the Nyquist sampling criterion. Here, we overturn this conventional practice by demonstrating that even when the scattered field is under-sampled, light can still be focused through or inside scattering media. Even more surprisingly, we show both theoretically and experimentally that the focus achieved by under-sampling can be one order of magnitude brighter than that achieved under the well-sampling conditions used in previous works, where 3×3 to 5×5 pixels were used to sample one speckle grain on average. Moreover, sub-Nyquist sampling improves the signal-to-noise ratio and the collection efficiency of the scattered light. We anticipate that this newly explored under-sampling scheme will transform the understanding of optical time reversal and boost the performance of optical imaging, manipulation, and communication through opaque scattering media.

Hybridized wavefront shaping for high-speed, high-efficiency focusing through dynamic diffusive media

One of the prime limiting factors of optical imaging in biological applications is the diffusion of light by tissue, which prevents focusing at depths greater than the optical diffusion limit (typically ?1??mm). To overcome this challenge, wavefront shaping techniques that use a spatial light modulator (SLM) to correct the phase of the incident wavefront have recently been developed. These techniques are able to focus light through scattering media beyond the optical diffusion limit. However, the low speeds of typically used liquid crystal SLMs limit the focusing speed. Here, we present a method using a digital micromirror device (DMD) and an electro-optic modulator (EOM) to measure the scattering-induced aberrations, and using a liquid crystal SLM to apply the correction to the illuminating wavefront. By combining phase modulation from an EOM with the DMD’s ability to provide selective illumination, we exploit the DMD’s higher refresh rate for phase measurement. We achieved focusing through scattering media in less than 8 ms, which is sufficiently short for certain in vivo applications, as it is comparable to the speckle correlation time of living tissue.

Glare suppression by coherence gated negation

Imaging of a weak target hidden behind a scattering medium can be significantly confounded by glare. We report a method, termed coherence gated negation (CGN), that uses destructive optical interference to suppress glare and allow improved imaging of a weak target. As a demonstration, we show that by permuting through a set range of amplitude and phase values for a reference beam interfering with the optical field from the glare and target reflection, we can suppress glare by an order of magnitude, even when the optical wavefront is highly disordered. This strategy significantly departs from conventional coherence gating methods in that CGN actively "gates out" the unwanted optical contributions while conventional methods "gate in" the target optical signal. We further show that the CGN method can outperform conventional coherence gating image quality in certain scenarios by more effectively rejecting unwanted optical contributions.