Wavefront shaping: A versatile tool to conquer multiple scattering in multidisciplinary fields

A mini-review on gene delivery technique using nanoparticles-mediated photoporation induced by nanosecond pulsed laser

Nanosecond pulsed laser induced photoporation has gained increasing attention from scholars as an effective method for delivering the membrane-impermeable extracellular materials into living cells. Compared with femtosecond laser, nanosecond laser has the advantage of high throughput and low costs. It also has a higher delivery efficiency than continuous wave laser. Here, we provide an extensive overview of current status of nanosecond pulsed laser induced photoporation, covering the photoporation mechanism as well as various factors that impact the delivery efficiency of photoporation. Additionally, we discuss various techniques for achieving photoporation, such as direct photoporation, nanoparticles-mediated photoporation and plasmonic substrates mediated photoporation. Among these techniques, nanoparticles-mediated photoporation is the most promising approach for potential clinical application. Studies have already been reported to safely destruct the vitreous opacities in vivo by nanosecond laser induced vapor nanobubble. Finally, we discuss the potential of nanosecond laser induced phototoporation for future clinical applications, particularly in the areas of skin and ophthalmic pathologies. We hope this review can inspire scientists to further improve nanosecond laser induced photoporation and facilitate its eventual clinical application.

Neural network enabled fringe projection through scattering media

The projection of fringes plays an essential role in many applications, such as fringe projection profilometry and structured illumination microscopy. However, these capabilities are significantly constrained in environments affected by optical scattering. Although recent developments in wavefront shaping have effectively generated high-fidelity focal points and relatively simple structured images amidst scattering, the ability to project fringes that cover half of the projection area has not yet been achieved. To address this limitation, this study presents a fringe projector enabled by a neural network, capable of projecting fringes with variable periodicities and orientation angles through scattering media. We tested this projector on two types of scattering media: ground glass diffusers and multimode fibers. For these scattering media, the average Pearson's correlation coefficients between the projected fringes and their designed configurations are 86.9% and 79.7%, respectively. These results demonstrate the effectiveness of the proposed neural network enabled fringe projector. This advancement is expected to broaden the scope of fringe-based imaging techniques, making it feasible to employ them in conditions previously hindered by scattering effects.

Time-gated imaging through dense fog via physics-driven Swin transformer

Imaging through the fog is valuable for many areas, such as autonomous driving and cosmic exploration. However, due to the influence of strong backscattering and diffuse reflection generated by the dense fog on the temporal-spatial correlations of photons returning from the target object, the reconstruction quality of most existing methods is significantly reduced under dense fog conditions. In this study, we describe the optical scatter imaging process and propose a physics-driven Swin Transformer method utilizing Time-of-Flight (ToF) and Deep Learning principles to mitigate scattering effects and reconstruct targets in conditions of heterogeneous dense fog. The results suggest that, despite the exponential decrease in the number of ballistic photons as the optical thickness of fog increases, the Physics-Driven Swin Transformer method demonstrates satisfactory performance in imaging targets obscured by dense fog. Importantly, this article highlights that even in dense fog imaging experiments with optical thickness reaching up to 3.0, which exceeds previous studies, commonly utilized quantitative evaluation metrics like PSNR and SSIM indicate that our method is cutting-edge in imaging through dense fog.

Optical versus radiographic imaging and tomography: introduction to the ROADS feature issue

Optical imaging is an ancient branch of imaging dating back to thousands of years. Radiographic imaging and tomography (RadIT), including the first use of X-rays by Wilhelm Röntgen, and then, γ-rays, energetic charged particles, neutrons, etc. are about 130 years young. The synergies between optical and radiographic imaging can be cast in the framework of these building blocks: Physics, Sources, Detectors, Methods, and Data Science, as described in Appl. Opt.61, RDS1 (2022)APOPAI0003-693510.1364/AO.455628. Optical imaging has expanded to include three-dimensional (3D) tomography (including holography), due in to part the invention of optical (including infrared) lasers. RadIT are intrinsically 3D because of the penetrating power of ionizing radiation. Both optical imaging and tomography (OIT) and RadIT are evolving into even higher dimensional regimes, such as time-resolved tomography (4D) and temporarily and spectroscopically resolved tomography (4D +). Further advances in OIT and RadIT will continue to be driven by desires for higher information yield, higher resolutions, and higher probability models with reduced uncertainties. Synergies in quantum physics, laser-driven sources, low-cost detectors, data-driven methods, automated processing of data, and artificially intelligent data acquisition protocols will be beneficial to both branches of imaging in many applications. These topics, along with an overview of the Radiography, Applied Optics, and Data Science virtual feature issue, are discussed here.

Widefield functional speckle-correlation optical scattering mesoscopy toward hemodynamic imaging

Speckle-correlation optical scattering imaging (SCOSI) has shown the potential for non-invasive biomedical diagnostic applications, which directly utilizes the scattering patterns to reconstruct the deep and non-line-of-sight objects. However, the course of the translation of this technique to preclinical biomedical imaging applications has been postponed by the following two facts: 1) the field of view of SCOSI was significantly limited by the optical memory effect, and 2) the molecular-tagged functional imaging of the biological tissues remains largely unexplored. In this work, a proof-of-concept design of the first-generation widefield functional SCOSI (WF-SCOSI) system was presented for simultaneously achieving mesoscopic mapping of fluid morphology and flow rate, which was realized by implementing the concepts of scanning synthesis and fluorescence scattering flowmetry. The ex vivo imaging results of the fluorescence-labeled large-scale blood vessel network phantom underneath the strong scatters demonstrated the effectiveness of WF-SCOSI toward non-invasive hemodynamic imaging applications.

Vectorial holography over a multimode fiber

Vectorial holography through a strongly scattering medium can facilitate various applications in optics and photonics. However, the realization of vectorial holography with arbitrary distribution of optical intensity is still limited because of experimental noise during the calibration of vectorial transmission matrix (TM) and reconstruction noise during the retrieval of input wavefront for a given holographic target. Herein, we propose and experimentally demonstrate the vectorial holography with arbitrary distribution of optical intensity over a multimode fiber (MMF) using the Tikhonov regularization. By optimizing the noise factor, the performance of vectorial holography over an MMF is improved compared with the conjugate transpose and inverse TM methods. Our results might shed new light on the optical communication and detection mediated by MMFs.

High-security learning-based optical encryption assisted by disordered metasurface

Artificial intelligence has gained significant attention for exploiting optical scattering for optical encryption. Conventional scattering media are inevitably influenced by instability or perturbations, and hence unsuitable for long-term scenarios. Additionally, the plaintext can be easily compromised due to the single channel within the medium and one-to-one mapping between input and output. To mitigate these issues, a stable spin-multiplexing disordered metasurface (DM) with numerous polarized transmission channels serves as the scattering medium, and a double-secure procedure with superposition of plaintext and security key achieves two-to-one mapping between input and output. In attack analysis, when the ciphertext, security key, and incident polarization are all correct, the plaintext can be decrypted. This system demonstrates excellent decryption efficiency over extended periods in noisy environments. The DM, functioning as an ultra-stable and active speckle generator, coupled with the double-secure approach, creates a highly secure speckle-based cryptosystem with immense potentials for practical applications.

Observation of the nonanalytic behavior of optical phonons in monolayer hexagonal boron nitride

Phonon splitting of the longitudinal and transverse optical modes (LO-TO splitting), a ubiquitous phenomenon in three-dimensional polar materials, will break down in two-dimensional (2D) polar systems. Theoretical predictions propose that the LO phonon in 2D polar monolayers becomes degenerate with the TO phonon, displaying a distinctive "V-shaped" nonanalytic behavior near the center of the Brillouin zone. However, the full experimental verification of these nonanalytic behaviors has been lacking. Here, using monolayer hexagonal boron nitride (h-BN) as a prototypical example, we report the comprehensive and direct experimental verification of the nonanalytic behavior of LO phonons by inelastic electron scattering spectroscopy. Interestingly, the slope of the LO phonon in our measurements is lower than the theoretically predicted value for a freestanding monolayer due to the screening of the Cu foil substrate. This enables the phonon polaritons in monolayer h-BN/Cu foil to exhibit ultra-slow group velocity (~5 × 10-6 c, c is the speed of light) and ultra-high confinement (~ 4000 times smaller wavelength than that of light). These exotic behaviors of the optical phonons in h-BN presents promising prospects for future optoelectronic applications.

Reference-free in situ rapid regional calibration of phase-only spatial light modulators

Spatial light modulators (SLMs) have become an indispensable element in modern optics for their versatile performance in many applications. Among various types of SLMs, such as digital micromirror devices (DMD), liquid crystal-based phase-only spatial light modulators (LC-SLMs), and deformable mirrors (DM), LC-SLMs are often the method of choice due to their high efficiency, precise phase modulation, and abundant number of effective pixels. In general, for research grade applications, an additional SLM calibration step is required due to fabrication imperfection resulting in non-flat liquid crystal panels and varying phase responses over the SLM area. Here, we demonstrate a straightforward approach for reference-free orthogonal calibration of an arbitrary number of SLM subregions which only requires the same measurement time as global calibration. The proposed method requires minimal optical elements and can be applied to any optical setup as is. As a benchmark performance test, we achieved a 2.2-fold enhancement in correction efficiency for wavefront shaping through scattering media utilizing the calibrated 2160 subregions of the SLM, in comparison with a single global look-up table (LUT).

Performance enhancement in wavefront shaping of multiply scattered light: a review

Significance

In nonballistic regime, optical scattering impedes high-resolution imaging through/inside complex media, such as milky liquid, fog, multimode fiber, and biological tissues, where confocal and multiphoton modalities fail. The significant tissue inhomogeneity-induced distortions need to be overcome and a technique referred as optical wavefront shaping (WFS), first proposed in 2007, has been becoming a promising solution, allowing for flexible and powerful light control. Understanding the principle and development of WFS may inspire exciting innovations for effective optical manipulation, imaging, stimulation, and therapy at depths in tissue or tissue-like complex media.

Aim

We aim to provide insights about what limits the WFS towards biomedical applications, and how recent efforts advance the performance of WFS among different trade-offs.

Approach

By differentiating the two implementation directions in the field, i.e., precompensation WFS and optical phase conjugation (OPC), improvement strategies are summarized and discussed.

Results

For biomedical applications, improving the speed of WFS is most essential in both directions, and a system-compatible wavefront modulator driven by fast apparatus is desired. In addition to that, algorithm efficiency and adaptability to perturbations/noise is of concern in precompensation WFS, while for OPC significant improvements rely heavily on integrating physical mechanisms and delicate system design for faster response and higher energy gain.

Conclusions

Substantial improvements in WFS implementations, from the aspects of physics, engineering, and computing, have inspired many novel and exciting optical applications that used to be optically inaccessible. It is envisioned that continuous efforts in the field can further advance WFS towards biomedical applications and guide our vision into deep biological tissues.

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

Projecting colorful images through scattering media via deep learning

The existence of scatterers in the optical path has been the major obstacle that prohibits one from projecting images through solid walls, turbid water, clouds, and fog. Recent developments in wavefront shaping and neural networks demonstrate effective compensation for scattering effects, showing the promise to project clear images against strong scattering. However, previous studies were mainly restricted to projecting greyscale images using monochromatic light, mainly due to the increased complexity of simultaneously controlling multiple wavelengths. In this work, we fill this blank by developing a projector network, which enables the projection of colorful images through scattering media with three primary colors. To validate the performance of the projector network, we experimentally demonstrated projecting colorful images obtained from the MINST dataset through two stacked diffusers. Quantitatively, the averaged intensity Pearson's correlation coefficient for 1,000 test colorful images reaches about 90.6%, indicating the superiority of the developed network. We anticipate that the projector network can be beneficial to a variety of display applications in scattering environments.

Efficiently scanning a focus behind scattering media beyond memory effect by wavefront tilting and re-optimization

One of the main challenges in the wavefront shaping technique is to enable controllable light propagation through scattering media. However, the scanning of the focus generated by wavefront shaping is limited to a small range determined by the optical memory effect (ME). Here, we propose and demonstrate efficiently scanning a focus behind scattering media beyond the ME region using the wavefront tilting and re-optimization (WFT&RO) method. After scanning an initial focus to a desired position by wavefront tilting, our approach utilizes the scanned focus at a new position as the "guide star" to do wavefront re-optimization, which can not only enhance the intensity of the focus to the value before scanning but also accelerate the optimization speed. Repeat such a process, we can theoretically fast scan the focus to any position beyond the ME region while maintaining a relatively uniform intensity. We experimentally demonstrate the power of the method by scanning a focus with uniform intensity values through an optical diffuser within a range that is at least 5 folds larger than the ME region. Additionally, for the case of two cascaded optical diffusers, the scanning range achieved is at least 7 folds larger than the ME region. Our method holds promising implications for applications such as imaging through media, where the ability to control light through scattering media is crucial.

A review of materials used in tomographic volumetric additive manufacturing

Volumetric additive manufacturing is a novel fabrication method allowing rapid, freeform, layer-less 3D printing. Analogous to computer tomography (CT), the method projects dynamic light patterns into a rotating vat of photosensitive resin. These light patterns build up a three-dimensional energy dose within the photosensitive resin, solidifying the volume of the desired object within seconds. Departing from established sequential fabrication methods like stereolithography or digital light printing, volumetric additive manufacturing offers new opportunities for the materials that can be used for printing. These include viscous acrylates and elastomers, epoxies (and orthogonal epoxy-acrylate formulations with spatially controlled stiffness) formulations, tunable stiffness thiol-enes and shape memory foams, polymer derived ceramics, silica-nanocomposite based glass, and gelatin-based hydrogels for cell-laden biofabrication. Here we review these materials, highlight the challenges to adapt them to volumetric additive manufacturing, and discuss the perspectives they present.

Graphical abstract

Supplementary Information

The online version contains supplementary material available at10.1557/s43579-023-00447-x.

Imaging through scattering media under strong ambient light interference via the lock-in process

Scattered light imaging techniques leveraging memory effects have been extensively investigated, yet most approaches are limited to operating in predominantly dark environments. The introduction of additional optical noise disrupts the fine structure of the original speckle pattern, undermining spatial correlation and resulting in imaging failure. In this study, we present a high-performance imaging method that integrates a lock-in process to overcome this limitation. Our experimental results demonstrate that the proposed technique enables successful imaging of targets in low signal-to-background ratio (SBR) environments, even at SBR levels as low as -28.0 dB. Furthermore, the method allows for the directional separation of targets with distinct modulation frequencies. This innovative approach has the potential to significantly expand the applicability of scattering imaging techniques by eliminating the constraints of dark field environments, thereby enhancing the convenience of in vivo microscopy and daytime astronomical observations.

Rapid, artifact-reduced, image reconstruction for super-resolution structured illumination microscopy

Super-resolution structured illumination microscopy (SR-SIM) is finding increasing application in biomedical research due to its superior ability to visualize subcellular dynamics in living cells. However, during image reconstruction artifacts can be introduced and when coupled with time-consuming postprocessing procedures, limits this technique from becoming a routine imaging tool for biologists. To address these issues, an accelerated, artifact-reduced reconstruction algorithm termed joint space frequency reconstruction-based artifact reduction algorithm (JSFR-AR-SIM) was developed by integrating a high-speed reconstruction framework with a high-fidelity optimization approach designed to suppress the sidelobe artifact. Consequently, JSFR-AR-SIM produces high-quality, super-resolution images with minimal artifacts, and the reconstruction speed is increased. We anticipate this algorithm to facilitate SR-SIM becoming a routine tool in biomedical laboratories.

Light-sheets and smart microscopy, an exciting future is dawning

Light-sheet fluorescence microscopy has transformed our ability to visualize and quantitatively measure biological processes rapidly and over long time periods. In this review, we discuss current and future developments in light-sheet fluorescence microscopy that we expect to further expand its capabilities. This includes smart and adaptive imaging schemes to overcome traditional imaging trade-offs, i.e., spatiotemporal resolution, field of view and sample health. In smart microscopy, a microscope will autonomously decide where, when, what and how to image. We further assess how image restoration techniques provide avenues to overcome these tradeoffs and how "open top" light-sheet microscopes may enable multi-modal imaging with high throughput. As such, we predict that light-sheet microscopy will fulfill an important role in biomedical and clinical imaging in the future.

Bio-inspired adhesive hydrogel for biomedicine-principles and design strategies

The adhesiveness of hydrogels is urgently required in various biomedical applications such as medical patches, tissue sealants, and flexible electronic devices. However, biological tissues are often wet, soft, movable, and easily damaged. These features pose difficulties for the construction of adhesive hydrogels for medical use. In nature, organisms adhere to unique strategies, such as reversible sucker adhesion in octopuses and nontoxic and firm catechol chemistry in mussels, which provide many inspirations for medical hydrogels to overcome the above challenges. In this review, we systematically classify bioadhesion strategies into structure-related and molecular-related ones, which cover almost all known bioadhesion paradigms. We outline the principles of these strategies and summarize the corresponding designs of medical adhesive hydrogels inspired by them. Finally, conclusions and perspectives concerning the development of this field are provided. For the booming bio-inspired adhesive hydrogels, this review aims to summarize and analyze the various existing theories and provide systematic guidance for future research from an innovative perspective.

Small Animal In Situ Drug Delivery Effects via Transdermal Microneedles Array versus Intravenous Injection: A Pilot Observation Based on Photoacoustic Tomography

Intravenous injection is a rapid, low-cost, and direct method that is commonly used to deliver multifarious biotherapeutics and vaccines. However, intravenous injection often causes trauma or tissue injury that requires professional operation. Transdermal drug delivery overcomes the aforementioned defects, and the microneedles (MNs) array is one of the most promising transdermal drug delivery platforms. Timely, precise, and non-invasive monitoring and evaluation of the effects of MNs in transdermal administration is significant to the research of drug efficiency response to specific diseases. In this sense, photoacoustic computed tomography (PACT), which provides wavelength-selective and deep-penetrating optical contrast, could be a promising imaging tool for in situ evaluation of the treatment effects. In this work, we propose the use of PACT to non-invasively assess the effects of real-time drug delivery in glioma tumors through transdermal administration with degradable indocyanine green-loaded hyaluronic acid MNs (ICG-HA-MNs). The outcome is systematically and quantitatively compared with that via intravenous injection. It is found that the photoacoustic signals of ICG in the tumor site express a faster elevation and shorter duration time in the intravenous injection group; by contrast, the photoacoustic signals demonstrate a lower intensity but prolonged duration time in the MNs group. The observed phenomenon indicates faster response but shorter drug duration for intravenous injection, which is in contrast with the lower loading but prolonged performance for transdermal drug delivery with MNs. These results exhibit good consistency with the earlier, common-sense findings reported from other aspects, confirming that PACT can serve as a potential imaging tool to precisely, non-invasively, and quickly evaluate in situ drug delivery effects and provide constructive guidance for the design and fabrication of microneedles.