Locating and classifying fluorescent tags behind turbid layers using time-resolved inversion

Non-invasive single photon imaging through strongly scattering media

Non-invasive optical imaging through opaque and multi-scattering media remains highly desirable across many application domains. The random scattering and diffusion of light in such media inflict exponential decay and aberration, prohibiting diffraction-limited imaging. By non-interferometric few picoseconds optical gating of backscattered photons, we demonstrate single photon sensitive non-invasive 3D imaging of targets occluded by strongly scattering media with optical thicknesses reaching 9.5l_s (19l_s round trip). It achieves diffraction-limited imaging of a target placed 130 cm away through the opaque media, with millimeter lateral and depth resolution while requiring only one photon detection out of 50,000 probe pulses. Our single photon sensitive imaging technique does not require wavefront shaping nor computationally-intensive image reconstruction algorithms, promising practical solutions for diffraction-limited imaging through highly opaque and diffusive media with low illumination power.

Single-shot real-time femtosecond imaging of temporal focusing

While the concept of focusing usually applies to the spatial domain, it is equally applicable to the time domain. Real-time imaging of temporal focusing of single ultrashort laser pulses is of great significance in exploring the physics of the space-time duality and finding diverse applications. The drastic changes in the width and intensity of an ultrashort laser pulse during temporal focusing impose a requirement for femtosecond-level exposure to capture the instantaneous light patterns generated in this exquisite phenomenon. Thus far, established ultrafast imaging techniques either struggle to reach the desired exposure time or require repeatable measurements. We have developed single-shot 10-trillion-frame-per-second compressed ultrafast photography (T-CUP), which passively captures dynamic events with 100-fs frame intervals in a single camera exposure. The synergy between compressed sensing and the Radon transformation empowers T-CUP to significantly reduce the number of projections needed for reconstructing a high-quality three-dimensional spatiotemporal datacube. As the only currently available real-time, passive imaging modality with a femtosecond exposure time, T-CUP was used to record the first-ever movie of non-repeatable temporal focusing of a single ultrashort laser pulse in a dynamic scattering medium. T-CUP's unprecedented ability to clearly reveal the complex evolution in the shape, intensity, and width of a temporally focused pulse in a single measurement paves the way for single-shot characterization of ultrashort pulses, experimental investigation of nonlinear light-matter interactions, and real-time wavefront engineering for deep-tissue light focusing.

Dynamic Metasurface Aperture as Smart Around-the-Corner Motion Detector

Detecting and analysing motion is a key feature of Smart Homes and the connected sensor vision they embrace. At present, most motion sensors operate in line-of-sight Doppler shift schemes. Here, we propose an alternative approach suitable for indoor environments, which effectively constitute disordered cavities for radio frequency (RF) waves; we exploit the fundamental sensitivity of modes of such cavities to perturbations, caused here by moving objects. We establish experimentally three key features of our proposed system: (i) ability to capture the temporal variations of motion and discern information such as periodicity (“smart”), (ii) non line-of-sight motion detection, and (iii) single-frequency operation. Moreover, we explain theoretically and demonstrate experimentally that the use of dynamic metasurface apertures can substantially enhance the performance of RF motion detection. Potential applications include accurately detecting human presence and monitoring inhabitants’ vital signs.

Multiplexed fluorescence lifetime imaging by concentration-dependent quenching

This study sought to use the undesirable concentration-dependent quenching to propose a simple multiplexed imaging analysis for histopathological identification of different stained tissues. To verify this point, the relationship between the fluorescence lifetime and eosin concentration was obtained. At low concentrations, the fluorescence lifetimes of eosin were independent of the concentration (<0.25 μg ml^-1). At moderate concentrations (0.25-1 μg ml^-1), eosin was quenched and its fluorescence lifetime was shortened gradually. Interestingly, the fluorescence of eosin was still quenched when the concentration exceeded 1 μg ml^-1, but its corresponding fluorescence lifetimes increase with increased concentration (>100 μg ml^-1). To further verify that multiplexed imaging of different tissues could be achieved only by eosin, we used fluorescence lifetime imaging microscopy (FLIM) to measure fluorescence lifetimes from hematoxylin and eosin (H&E) stained sections. Working directly on an average fluorescence lifetime (τ_m) histogram for lifetime-based separation easily achieved multiplexed imaging in situ. H&E stained erythrocytes, smooth muscles, collagen and artificial structures on a prepared microscopic slide could be identified without the need of alternating laser excitation, using hyperspectral systems and special staining or multi-labeled immunofluorescence. Using only eosin, different types of tissues could be distinguished by eosin concentration-dependent quenching. Hence, eosin fluorescence lifetimes potentially simplify multiplexed imaging and may have potential applications for pathological diagnosis.

Object classification through scattering media with deep learning on time resolved measurement

We demonstrate an imaging technique that allows identification and classification of objects hidden behind scattering media and is invariant to changes in calibration parameters within a training range. Traditional techniques to image through scattering solve an inverse problem and are limited by the need to tune a forward model with multiple calibration parameters (like camera field of view, illumination position etc.). Instead of tuning a forward model and directly inverting the optical scattering, we use a data driven approach and leverage convolutional neural networks (CNN) to learn a model that is invariant to calibration parameters variations within the training range and nearly invariant beyond that. This effectively allows robust imaging through scattering conditions that is not sensitive to calibration. The CNN is trained with a large synthetic dataset generated with a Monte Carlo (MC) model that contains random realizations of major calibration parameters. The method is evaluated with a time-resolved camera and multiple experimental results are provided including pose estimation of a mannequin hidden behind a paper sheet with 23 correct classifications out of 30 tests in three poses (76.6% accuracy on real-world measurements). This approach paves the way towards real-time practical non line of sight (NLOS) imaging applications.

Exceedingly small iron oxide nanoparticles as positive MRI contrast agents

Medical imaging is routine in the diagnosis and staging of a wide range of medical conditions. In particular, magnetic resonance imaging (MRI) is critical for visualizing soft tissue and organs, with over 60 million MRI procedures performed each year worldwide. About one-third of these procedures are contrast-enhanced MRI, and gadolinium-based contrast agents (GBCAs) are the mainstream MRI contrast agents used in the clinic. GBCAs have shown efficacy and are safe to use with most patients; however, some GBCAs have a small risk of adverse effects, including nephrogenic systemic fibrosis (NSF), the untreatable condition recently linked to gadolinium (Gd) exposure during MRI with contrast. In addition, Gd deposition in the human brain has been reported following contrast, and this is now under investigation by the US Food and Drug Administration (FDA). To address a perceived need for a Gd-free contrast agent with pharmacokinetic and imaging properties comparable to GBCAs, we have designed and developed zwitterion-coated exceedingly small superparamagnetic iron oxide nanoparticles (ZES-SPIONs) consisting of ∼3-nm inorganic cores and ∼1-nm ultrathin hydrophilic shell. These ZES-SPIONs are free of Gd and show a high T₁ contrast power. We demonstrate the potential of ZES-SPIONs in preclinical MRI and magnetic resonance angiography.

Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse

Ultrafast video recording of spatiotemporal light distribution in a scattering medium has a significant impact in biomedicine. Although many simulation tools have been implemented to model light propagation in scattering media, existing experimental instruments still lack sufficient imaging speed to record transient light-scattering events in real time. We report single-shot ultrafast video recording of a light-induced photonic Mach cone propagating in an engineered scattering plate assembly. This dynamic light-scattering event was captured in a single camera exposure by lossless-encoding compressed ultrafast photography at 100 billion frames per second. Our experimental results are in excellent agreement with theoretical predictions by time-resolved Monte Carlo simulation. This technology holds great promise for next-generation biomedical imaging instrumentation.

All Photons Imaging Through Volumetric Scattering

Imaging through thick highly scattering media (sample thickness ≫ mean free path) can realize broad applications in biomedical and industrial imaging as well as remote sensing. Here we propose a computational “All Photons Imaging” (API) framework that utilizes time-resolved measurement for imaging through thick volumetric scattering by using both early arrived (non-scattered) and diffused photons. As opposed to other methods which aim to lock on specific photons (coherent, ballistic, acoustically modulated, etc.), this framework aims to use all of the optical signal. Compared to conventional early photon measurements for imaging through a 15 mm tissue phantom, our method shows a two fold improvement in spatial resolution (4db increase in Peak SNR). This all optical, calibration-free framework enables widefield imaging through thick turbid media, and opens new avenues in non-invasive testing, analysis, and diagnosis.

Terahertz time-gated spectral imaging for content extraction through layered structures

Spatial resolution, spectral contrast and occlusion are three major bottlenecks for non-invasive inspection of complex samples with current imaging technologies. We exploit the sub-picosecond time resolution along with spectral resolution provided by terahertz time-domain spectroscopy to computationally extract occluding content from layers whose thicknesses are wavelength comparable. The method uses the statistics of the reflected terahertz electric field at subwavelength gaps to lock into each layer position and then uses a time-gated spectral kurtosis to tune to highest spectral contrast of the content on that specific layer. To demonstrate, occluding textual content was successfully extracted from a packed stack of paper pages down to nine pages without human supervision. The method provides over an order of magnitude enhancement in the signal contrast and can impact inspection of structural defects in wooden objects, plastic components, composites, drugs and especially cultural artefacts with subwavelength or wavelength comparable layers.

High speed color imaging through scattering media with a large field of view

Optical imaging through complex media has many important applications. Although research progresses have been made to recover optical image through various turbid media, the widespread application of the technology is hampered by the recovery speed, requirement on specific illumination, poor image quality and limited field of view. Here we demonstrate that above-mentioned drawbacks can be essentially overcome. The realization of high speed color imaging through turbid media is successfully carried out by taking into account the media memory effect, the point spread function, the exit pupil of the optical system, and the optimized signal to noise ratio. By retrieving selected speckles with enlarged field of view, high quality image is recovered with a responding speed only determined by the frame rates of the image capturing devices. The immediate application of the technique is expected to register static and dynamic imaging under human skin to recover information with a wearable device.

Relativistic effects in imaging of light in flight with arbitrary paths

Direct observation of light in flight is enabled by recent avalanche photodiode arrays, which have the capability for time-correlated single photon counting. In contrast to classical imaging, imaging of light in flight depends on the relative sensor position, which is studied in detail by measurement and analysis of light pulses propagating at different angles. The time differences of arrival are analyzed to determine the propagation angle and distance of arbitrary light paths. Further analysis of the apparent velocity shows that light pulses can appear to travel at superluminal or subluminal apparent velocities.

Optical brush: Imaging through permuted probes

The combination of computational techniques and ultrafast imaging have enabled sensing through unconventional settings such as around corners, and through diffusive media. We exploit time of flight (ToF) measurements to enable a flexible interface for imaging through permuted set of fibers. The fibers are randomly distributed in the scene and are packed on the camera end, thus making a brush-like structure. The scene is illuminated by two off-axis optical pulses. Temporal signatures of fiber tips in the scene are used to localize each fiber. Finally, by combining the position and measured intensity of each fiber, the original input is reconstructed. Unlike conventional fiber bundles with packed set of fibers that are limited by a narrow field of view (FOV), lack of flexibility, and extended coaxial precalibration, the proposed optical brush is flexible and uses off-axis calibration method based on ToF. The enabled brush form can couple to other types of ToF imaging systems. This can impact probe-based applications such as, endoscopy, tomography, and industrial imaging and sensing.

Sequentially timed all-optical mapping photography (STAMP) utilizing spectral filtering

We propose and experimentally demonstrate a new method called SF-STAMP for sequentially timed all-optical mapping photography (STAMP) that utilizes spectral filtering. SF-STAMP is composed of a diffractive optical element (DOE), a band-pass filter, and two Fourier transform lenses. Using a linearly frequency-chirped pulse and converting the wavelength to the time axis, we realize single-shot ultrafast burst imaging. As an experimental demonstration of SF-STAMP, we monitor the dynamics of a laser ablation using a linearly frequency-chirped broadband pulse (>100 nm) that is temporally stretched up to ~40 ps. This imaging method is expected to be effective for investigating ultrafast dynamics in a diverse range of fields, such as photochemistry, plasma physics, and fluidics.

Encrypted Three-dimensional Dynamic Imaging using Snapshot Time-of-flight Compressed Ultrafast Photography

Compressed ultrafast photography (CUP), a computational imaging technique, is synchronized with short-pulsed laser illumination to enable dynamic three-dimensional (3D) imaging. By leveraging the time-of-flight (ToF) information of pulsed light backscattered by the object, ToF-CUP can reconstruct a volumetric image from a single camera snapshot. In addition, the approach unites the encryption of depth data with the compressed acquisition of 3D data in a single snapshot measurement, thereby allowing efficient and secure data storage and transmission. We demonstrated high-speed 3D videography of moving objects at up to 75 volumes per second. The ToF-CUP camera was applied to track the 3D position of a live comet goldfish. We have also imaged a moving object obscured by a scattering medium.

Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths

Time-of-flight sensing with single-photon sensitivity enables new approaches for the localization of objects outside a sensor's field of view by analyzing backscattered photons. In this Letter, the authors have studied the application of Geiger-mode avalanche photodiode arrays and eye-safe infrared lasers, and provide experimental data of the direct visualization of backscattering light in flight, and direct vision and indirect vision of targets in line-of-sight and non-line-of-sight configurations at shortwave infrared wavelengths.