Single-shot real-time sub-nanosecond electron imaging aided by compressed sensing: Analytical modeling and simulation

Spatial-temporal characterization of photoemission in a streak-mode dynamic transmission electron microscope

A long-standing motivation driving high-speed electron microscopy development is to capture phase transformations and material dynamics in real time with high spatial and temporal resolution. Current dynamic transmission electron microscopes (DTEMs) are limited to nanosecond temporal resolution and the ability to capture only a few frames of a transient event. With the motivation to overcome these limitations, we present our progress in developing a streak-mode DTEM (SM-DTEM) and demonstrate the recovery of picosecond images with high frame sequence depth. We first demonstrate that a zero-dimensional (0D) SM-DTEM can provide temporal information on any local region of interest with a 0.37 μm diameter, a 20-GHz sampling rate, and 1200 data points in the recorded trace. We use this method to characterize the temporal profile of the photoemitted electron pulse, finding that it deviates from the incident ultraviolet laser pulse and contains an unexpected peak near its onset. Then, we demonstrate a two-dimensional (2D) SM-DTEM, which uses compressed-sensing-based tomographic imaging to recover a full spatiotemporal photoemission profile over a 1.85-μm-diameter field of view with nanoscale spatial resolution, 370-ps inter-frame interval, and 140-frame sequence depth in a 50-ns time window. Finally, a perspective is given on the instrumental modifications necessary to further develop this promising technique with the goal of decreasing the time to capture a 2D SM-DTEM dataset.

Time-resolved transmission electron microscopy for nanoscale chemical dynamics

The ability of transmission electron microscopy (TEM) to image a structure ranging from millimetres to Ångströms has made it an indispensable component of the toolkit of modern chemists. TEM has enabled unprecedented understanding of the atomic structures of materials and how structure relates to properties and functions. Recent developments in TEM have advanced the technique beyond static material characterization to probing structural evolution on the nanoscale in real time. Accompanying advances in data collection have pushed the temporal resolution into the microsecond regime with the use of direct-electron detectors and down to the femtosecond regime with pump-probe microscopy. Consequently, studies have deftly applied TEM for understanding nanoscale dynamics, often in operando. In this Review, time-resolved in situ TEM techniques and their applications for probing chemical and physical processes are discussed, along with emerging directions in the TEM field.

Fast wide-field upconversion luminescence lifetime thermometry enabled by single-shot compressed ultrahigh-speed imaging

Photoluminescence lifetime imaging of upconverting nanoparticles is increasingly featured in recent progress in optical thermometry. Despite remarkable advances in photoluminescent temperature indicators, existing optical instruments lack the ability of wide-field photoluminescence lifetime imaging in real time, thus falling short in dynamic temperature mapping. Here, we report video-rate upconversion temperature sensing in wide field using single-shot photoluminescence lifetime imaging thermometry (SPLIT). Developed from a compressed-sensing ultrahigh-speed imaging paradigm, SPLIT first records wide-field luminescence intensity decay compressively in two views in a single exposure. Then, an algorithm, built upon the plug-and-play alternating direction method of multipliers, is used to reconstruct the video, from which the extracted lifetime distribution is converted to a temperature map. Using the core/shell NaGdF4:Er3+,Yb3+/NaGdF4 upconverting nanoparticles as the lifetime-based temperature indicators, we apply SPLIT in longitudinal wide-field temperature monitoring beneath a thin scattering medium. SPLIT also enables video-rate temperature mapping of a moving biological sample at single-cell resolution.

Punching holes in light: recent progress in single-shot coded-aperture optical imaging

Single-shot coded-aperture optical imaging physically captures a code-aperture-modulated optical signal in one exposure and then recovers the scene via computational image reconstruction. Recent years have witnessed dazzling advances in various modalities in this hybrid imaging scheme in concomitant technical improvement and widespread applications in physical, chemical and biological sciences. This review comprehensively surveys state-of-the-art single-shot coded-aperture optical imaging. Based on the detected photon tags, this field is divided into six categories: planar imaging, depth imaging, light-field imaging, temporal imaging, spectral imaging, and polarization imaging. In each category, we start with a general description of the available techniques and design principles, then provide two representative examples of active-encoding and passive-encoding approaches, with a particular emphasis on their methodology and applications as well as their advantages and challenges. Finally, we envision prospects for further technical advancement in this field.

An automated vertical drift correction algorithm for AFM images based on morphology prediction

The atomic force microscope (AFM) has become a powerful tool in many fields. However, environmental noise and other disturbances are very likely to cause the AFM probe to vibrate, which lead to vertical drift in AFM imaging and limit its further application. Therefore, to correct image distortion caused by vertical drift, a morphology prediction based image correction algorithm is proposed in this paper. Specifically, a Gaussian-Hann filter is first designed for distorted AFM images, based on which, an adaptive image binarization algorithm is developed to achieve accurate object detection and background extraction. Furthermore, an advanced morphology prediction algorithm, consisting of morphological approximation prediction and morphological detail prediction, is proposed to correct image distortion by using the extracted substrate of a sample image. Approximate morphology is generated by an improved weighted fusion autoregressive model, and morphological detail is obtained by energy analysis based on discrete wavelet transform. Experimental and application results are presented to illustrate that the proposed algorithm is able to effectively eliminate vertical drift of AFM images.

Extension of time window into nanoseconds in single-shot ultrafast burst imaging by spectrally sweeping pulses

We achieved single-shot 2D-burst imaging with a ∼22ps temporal resolution in a nanosecond time window using sequentially timed all-optical mapping photography with a spectral filtering (SF-STAMP) scheme, where a single snapshot of spectral images measured with a linear frequency chirped laser pulse forms time-resolved snapshots. We combined a pulse-stretching scheme of a free-space angular-chirp-enhanced delay (FACED) composed of a pair of tilted mirrors and a 4f-system. With a 4f-FACED system, we generated collinearly propagating burst laser pulses with a different center wavelength and a tunable time interval and demonstrated single-shot burst imaging with a 303 ps interval in a 1.5 ns time window by an SF-STAMP with spectrally sweeping probe pulses.

Single-shot ultrafast imaging attaining 70 trillion frames per second

Real-time imaging of countless femtosecond dynamics requires extreme speeds orders of magnitude beyond the limits of electronic sensors. Existing femtosecond imaging modalities either require event repetition or provide single-shot acquisition with no more than 10¹³ frames per second (fps) and 3 × 10² frames. Here, we report compressed ultrafast spectral photography (CUSP), which attains several new records in single-shot multi-dimensional imaging speeds. In active mode, CUSP achieves both 7 × 10¹³ fps and 10³ frames simultaneously by synergizing spectral encoding, pulse splitting, temporal shearing, and compressed sensing-enabling unprecedented quantitative imaging of rapid nonlinear light-matter interaction. In passive mode, CUSP provides four-dimensional (4D) spectral imaging at 0.5 × 10¹² fps, allowing the first single-shot spectrally resolved fluorescence lifetime imaging microscopy (SR-FLIM). As a real-time multi-dimensional imaging technology with the highest speeds and most frames, CUSP is envisioned to play instrumental roles in numerous pivotal scientific studies without the need for event repetition.

Laser-free GHz stroboscopic transmission electron microscope: Components, system integration, and practical considerations for pump-probe measurements

A 300 keV transmission electron microscope was modified to produce broadband pulsed beams that can be, in principle, between 40 MHz and 12 GHz, corresponding to temporal resolution in the nanosecond to picosecond range without an excitation laser. The key enabling technology is a pair of phase-matched modulating and de-modulating traveling wave metallic comb striplines (pulsers). An initial temporal resolution of 30 ps was achieved with a strobe frequency of 6.0 GHz. The placement of the pulsers, mounted immediately below the gun, allows for preservation of all optical configurations, otherwise available to the unmodified instrument, and therefore makes such a post-modified instrument for dual-use, i.e., both pulsed-beam mode (i.e., stroboscopic time-resolved) and conventional continuous waveform mode. In this article, we describe the elements inserted into the beam path, challenges encountered during integration with an in-service microscope, and early results from an electric-field-driven pump-probe experiment. We conclude with ideas for making this class of instruments broadly applicable for examining cyclical and repeatable phenomena.

Picosecond-resolution phase-sensitive imaging of transparent objects in a single shot

With the growing interest in the optical imaging of ultrafast phenomena in transparent objects, from shock wave to neuronal action potentials, high contrast imaging at high frame rates has become desirable. While phase sensitivity provides the contrast, the frame rates and sequence depths are highly limited by the detectors. Here, we present phase-sensitive compressed ultrafast photography (pCUP) for single-shot real-time ultrafast imaging of transparent objects by combining the contrast of dark-field imaging with the speed and the sequence depth of CUP. By imaging the optical Kerr effect and shock wave propagation, we demonstrate that pCUP can image light-speed phase signals in a single shot with up to 350 frames captured at up to 1 trillion frames per second. We expect pCUP to be broadly used for a vast range of fundamental and applied sciences.