Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning

In diverse realms of research, such as holographic optical tweezer mechanical measurements, colloidal particle motion state examinations, cell tracking, and drug delivery, the localization and analysis of particle motion command paramount significance. Algorithms ranging from conventional numerical methods to advanced deep-learning networks mark substantial strides in the sphere of particle orientation analysis. However, the need for datasets has hindered the application of deep learning in particle tracking. In this work, we elucidated an efficacious methodology pivoted toward generating synthetic datasets conducive to this domain that resonates with robustness and precision when applied to real-world data of tracking 3D particles. We developed a 3D real-time particle positioning network based on the CenterNet network. After conducting experiments, our network has achieved a horizontal positioning error of 0.0478 μm and a z-axis positioning error of 0.1990 μm. It shows the capability to handle real-time tracking of particles, diverse in dimensions, near the focal plane with high precision. In addition, we have rendered all datasets cultivated during this investigation accessible.

Wide-field Stokes polarimetric microscopy for second harmonic generation imaging

We employ wide-field second harmonic generation (SHG) microscopy together with nonlinear Stokes polarimetry for quick ultrastructural investigation of large sample areas (700 μm × 700 μm) in thin histology sections. The Stokes vector components for SHG are obtained from the polarimetric measurements with incident and outgoing linear and circular polarization states. The Stokes components are used to construct the images of polarimetric parameters and deduce the maps of ultrastructural parameters of achiral and chiral nonlinear susceptibility tensor components ratios and cylindrical axis orientation in fibrillar materials. The large area imaging was employed for lung tumor margin investigations. The imaging shows reduced SHG intensity, increased achiral susceptibility ratio values, and preferential orientation of collagen strands along the boarder of tumor margin. The wide-field Stokes polarimetric SHG microscopy opens a possibility of quick large area imaging of ultrastructural parameters of tissue collagen, which can be used for nonlinear histopathology investigations.

Recent progress of second near-infrared (NIR-II) fluorescence microscopy in bioimaging

Visualizing biological tissues in vivo at a cellular or subcellular resolution to explore molecular signaling and cell behaviors is a crucial direction for research into biological processes. In vivo imaging can provide quantitative and dynamic visualization/mapping in biology and immunology. New microscopy techniques combined with near-infrared region fluorophores provide additional avenues for further progress in vivo bioimaging. Based on the development of chemical materials and physical optoelectronics, new NIR-II microscopy techniques are emerging, such as confocal and multiphoton microscopy, light-sheet fluorescence microscopy (LSFM), and wide-field microscopy. In this review, we introduce the characteristics of in vivo imaging using NIR-II fluorescence microscopy. We also cover the recent advances in NIR-II fluorescence microscopy techniques in bioimaging and the potential for overcoming current challenges.

Direct Modular Printing of Plasmonic Chemosensors

Here, we present and implement a new approach for producing modular inkjet-printable surface-enhanced Raman scattering (SERS) chemosensors. These sensors, combined with a rapid large field-of-view imaging system allow for fast imaging of the chemical characteristics of a sample. The performance of these materials is illustrated by printing a pH sensor on paper and interrogating aqueous solutions at different pH values. Results show single-shot images exceeding 9 mm² which are readily read out via SERS imaging.

Comparing Super-Resolution Microscopy Techniques to Analyze Chromosomes

The importance of fluorescence light microscopy for understanding cellular and sub-cellular structures and functions is undeniable. However, the resolution is limited by light diffraction (~200–250 nm laterally, ~500–700 nm axially). Meanwhile, super-resolution microscopy, such as structured illumination microscopy (SIM), is being applied more and more to overcome this restriction. Instead, super-resolution by stimulated emission depletion (STED) microscopy achieving a resolution of ~50 nm laterally and ~130 nm axially has not yet frequently been applied in plant cell research due to the required specific sample preparation and stable dye staining. Single-molecule localization microscopy (SMLM) including photoactivated localization microscopy (PALM) has not yet been widely used, although this nanoscopic technique allows even the detection of single molecules. In this study, we compared protein imaging within metaphase chromosomes of barley via conventional wide-field and confocal microscopy, and the sub-diffraction methods SIM, STED, and SMLM. The chromosomes were labeled by DAPI (4′,6-diamidino-2-phenylindol), a DNA-specific dye, and with antibodies against topoisomerase IIα (Topo II), a protein important for correct chromatin condensation. Compared to the diffraction-limited methods, the combination of the three different super-resolution imaging techniques delivered tremendous additional insights into the plant chromosome architecture through the achieved increased resolution.

Analysis and Model of Cortical Slow Waves Acquired with Optical Techniques

Slow waves (SWs) are spatio-temporal patterns of cortical activity that occur both during natural sleep and anesthesia and are preserved across species. Even though electrophysiological recordings have been largely used to characterize brain states, they are limited in the spatial resolution and cannot target specific neuronal population. Recently, large-scale optical imaging techniques coupled with functional indicators overcame these restrictions, and new pipelines of analysis and novel approaches of SWs modelling are needed to extract relevant features of the spatio-temporal dynamics of SWs from these highly spatially resolved data-sets. Here we combined wide-field fluorescence microscopy and a transgenic mouse model expressing a calcium indicator (GCaMP6f) in excitatory neurons to study SW propagation over the meso-scale under ketamine anesthesia. We developed a versatile analysis pipeline to identify and quantify the spatio-temporal propagation of the SWs. Moreover, we designed a computational simulator based on a simple theoretical model, which takes into account the statistics of neuronal activity, the response of fluorescence proteins and the slow waves dynamics. The simulator was capable of synthesizing artificial signals that could reliably reproduce several features of the SWs observed in vivo, thus enabling a calibration tool for the analysis pipeline. Comparison of experimental and simulated data shows the robustness of the analysis tools and its potential to uncover mechanistic insights of the Slow Wave Activity (SWA).

Large Scale Double-Path Illumination System with Split Field of View for the All-Optical Study of Inter-and Intra-Hemispheric Functional Connectivity on Mice

Recent improvements in optical tools that can perturb brain activity and simultaneously reveal the elicited alterations in the associated regions offer an exceptional means to understand and map the connectivity of the brain. In this work, we exploit a combination of recently developed optical tools to monitor neural population at the meso-scale level and to mould the cortical patterns of targeted neuronal population. Our goal was to investigate the propagation of neuronal activity over the mouse cortex that is triggered by optogenetic stimulation in the contralateral hemisphere. Towards this aim, we developed a wide-field fluorescence microscope that is characterized by a double illumination path allowing for the optogenetic stimulation of the transfected area in the left hemisphere and the simultaneous recording of cortical activity in the right hemisphere. The microscope was further implemented with a custom shutter in order to split the LED illumination path, resulting in a half-obscured field of view. By avoiding the spectral crosstalk between GCaMP6f and channelrhodopsin 2 (ChR2), this system offered the possibility of simultaneous “pumping and probing” of inter-hemispheric functional connectivity on Thy1-GCaMP6f mice.

Visualization of Neuronal Structures in Wide-Field Microscopy Brain Images

Wide-field microscopes are commonly used in neurobiology for experimental studies of brain samples. Available visualization tools are limited to electron, two-photon, and confocal microscopy datasets, and current volume rendering techniques do not yield effective results when used with wide-field data. We present a workflow for the visualization of neuronal structures in wide-field microscopy images of brain samples. We introduce a novel gradient-based distance transform that overcomes the out-of-focus blur caused by the inherent design of wide-field microscopes. This is followed by the extraction of the 3D structure of neurites using a multi-scale curvilinear filter and cell-bodies using a Hessian-based enhancement filter. The response from these filters is then applied as an opacity map to the raw data. Based on the visualization challenges faced by domain experts, our workflow provides multiple rendering modes to enable qualitative analysis of neuronal structures, which includes separation of cell-bodies from neurites and an intensity-based classification of the structures. Additionally, we evaluate our visualization results against both a standard image processing deconvolution technique and a confocal microscopy image of the same specimen. We show that our method is significantly faster and requires less computational resources, while producing high quality visualizations. We deploy our workflow in an immersive gigapixel facility as a paradigm for the processing and visualization of large, high-resolution, wide-field microscopy brain datasets.

High-resolution cytometry for high-content cell cycle analysis

One of the major limitations of flow cytometry (FCM) is the absence of an intracellular view. Automated microscopy and image analysis, together with technological developments, led to new approaches in cytometry that bypass the above limitation, introducing high resolution, high content, and large statistical sampling. However, few attempts have been made, until now, to translate the wide repertoire of FCM assays into high-content image screening. This unit describes the implementation of an acquisition and analysis protocol for evaluation of the cell cycle by automated microscopy. The approach grants the possibility to perform simultaneous analysis of a high number of different parameters. A large part of this unit is devoted to the description of hardware features that can optimize the recorded information together with the acquisition and analysis procedures employed to produce good-quality data.

Tunable vapor-condensed nanolenses

Nanostructured optical components, such as nanolenses, direct light at subwavelength scales to enable, among others, high-resolution lithography, miniaturization of photonic circuits, and nanoscopic imaging of biostructures. A major challenge in fabricating nanolenses is the appropriate positioning of the lens with respect to the sample while simultaneously ensuring it adopts the optimal size and shape for the intended use. One application of particular interest is the enhancement of contrast and signal-to-noise ratio in the imaging of nanoscale objects, especially over wide fields-of-view (FOVs), which typically come with limited resolution and sensitivity for imaging nano-objects. Here we present a self-assembly method for fabricating time- and temperature-tunable nanolenses based on the condensation of a polymeric liquid around a nanoparticle, which we apply to the high-throughput on-chip detection of spheroids smaller than 40 nm, rod-shaped particles with diameter smaller than 20 nm, and biofunctionalized nanoparticles, all across an ultralarge FOV of >20 mm(2). Previous nanoparticle imaging efforts across similar FOVs have detected spheroids no smaller than 100 nm, and therefore our results demonstrate the detection of particles >15-fold smaller in volume, which in free space have >240 times weaker Rayleigh scattering compared to the particle sizes detected in earlier wide-field imaging work. This entire platform, with its tunable nanolens condensation and wide-field imaging functions, is also miniaturized into a cost-effective and portable device, which might be especially important for field use, mobile sensing, and diagnostics applications, including, for example, the measurement of viral load in bodily fluids.