Superresolution structured illumination microscopy reconstruction algorithms: a review

Nanoscale insights into hematology: super-resolved imaging on blood cell structure, function, and pathology

Fluorescence nanoscopy, also known as super-resolution microscopy, has transcended the conventional resolution barriers and enabled visualization of biological samples at nanometric resolutions. A series of super-resolution techniques have been developed and applied to investigate the molecular distribution, organization, and interactions in blood cells, as well as the underlying mechanisms of blood-cell-associated diseases. In this review, we provide an overview of various fluorescence nanoscopy technologies, outlining their current development stage and the challenges they are facing in terms of functionality and practicality. We specifically explore how these innovations have propelled forward the analysis of thrombocytes (platelets), erythrocytes (red blood cells) and leukocytes (white blood cells), shedding light on the nanoscale arrangement of subcellular components and molecular interactions. We spotlight novel biomarkers uncovered by fluorescence nanoscopy for disease diagnosis, such as thrombocytopathies, malignancies, and infectious diseases. Furthermore, we discuss the technological hurdles and chart out prospective avenues for future research directions. This review aims to underscore the significant contributions of fluorescence nanoscopy to the field of blood cell analysis and disease diagnosis, poised to revolutionize our approach to exploring, understanding, and managing disease at the molecular level.

Fluorescent chemosensors facilitate the visualization of plant health and their living environment in sustainable agriculture

Globally, 91% of plant production encounters diverse environmental stresses that adversely affect their growth, leading to severe yield losses of 50-60%. In this case, monitoring the connection between the environment and plant health can balance population demands with environmental protection and resource distribution. Fluorescent chemosensors have shown great progress in monitoring the health and environment of plants due to their high sensitivity and biocompatibility. However, to date, no comprehensive analysis and systematic summary of fluorescent chemosensors used in monitoring the correlation between plant health and their environment have been reported. Thus, herein, we summarize the current fluorescent chemosensors ranging from their design strategies to applications in monitoring plant-environment interaction processes. First, we highlight the types of fluorescent chemosensors with design strategies to resolve the bottlenecks encountered in monitoring the health and living environment of plants. In addition, the applications of fluorescent small-molecule, nano and supramolecular chemosensors in the visualization of the health and living environment of plants are discussed. Finally, the major challenges and perspectives in this field are presented. This work will provide guidance for the design of efficient fluorescent chemosensors to monitor plant health, and then promote sustainable agricultural development.

hydroSIM: super-resolution speckle illumination microscopy with a hydrogel diffuser

Super-resolution microscopy has emerged as an indispensable methodology for probing the intricacies of cellular biology. Structured illumination microscopy (SIM), in particular, offers an advantageous balance of spatial and temporal resolution, allowing for visualizing cellular processes with minimal disruption to biological specimens. However, the broader adoption of SIM remains hampered by the complexity of instrumentation and alignment. Here, we introduce speckle-illumination super-resolution microscopy using hydrogel diffusers (hydroSIM). The study utilizes the high scattering and optical transmissive properties of hydrogel materials and realizes a remarkably simplified approach to plug-in super-resolution imaging via a common epi-fluorescence platform. We demonstrate the hydroSIM system using various phantom and biological samples, and the results exhibited effective 3D resolution doubling, optical sectioning, and high contrast. We foresee hydroSIM, a cost-effective, biocompatible, and user-accessible super-resolution methodology, to significantly advance a wide range of biomedical imaging and applications.

Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM)

Structured illumination microscopy (SIM) has emerged as a promising super-resolution fluorescence imaging technique, offering diverse configurations and computational strategies to mitigate phototoxicity during real-time imaging of biological specimens. Traditional efforts to enhance system frame rates have concentrated on processing algorithms, like rolling reconstruction or reduced frame reconstruction, or on investments in costly sCMOS cameras with accelerated row readout rates. In this article, we introduce an approach to elevate SIM frame rates and region of interest (ROI) coverage at the hardware level, without necessitating an upsurge in camera expenses or intricate algorithms. Here, parallel acquisition-readout SIM (PAR-SIM) achieves the highest imaging speed for fluorescence imaging at currently available detector sensitivity. By using the full frame-width of the detector through synchronizing the pattern generation and image exposure-readout process, we have achieved a fundamentally stupendous information spatial-temporal flux of 132.9 MPixels · s-1, 9.6-fold that of the latest techniques, with the lowest SNR of -2.11 dB and 100 nm resolution. PAR-SIM demonstrates its proficiency in successfully reconstructing diverse cellular organelles in dual excitations, even under conditions of low signal due to ultra-short exposure times. Notably, mitochondrial dynamic tubulation and ongoing membrane fusion processes have been captured in live COS-7 cell, recorded with PAR-SIM at an impressive 408 Hz. We posit that this novel parallel exposure-readout mode not only augments SIM pattern modulation for superior frame rates but also holds the potential to benefit other complex imaging systems with a strategic controlling approach.

Visualization of cristae and mtDNA interactions via STED nanoscopy using a low saturation power probe

Mitochondria are crucial organelles closely associated with cellular metabolism and function. Mitochondrial DNA (mtDNA) encodes a variety of transcripts and proteins essential for cellular function. However, the interaction between the inner membrane (IM) and mtDNA remains elusive due to the limitations in spatiotemporal resolution offered by conventional microscopy and the absence of suitable in vivo probes specifically targeting the IM. Here, we have developed a novel fluorescence probe called HBmito Crimson, characterized by exceptional photostability, fluorogenicity within lipid membranes, and low saturation power. We successfully achieved over 500 frames of low-power stimulated emission depletion microscopy (STED) imaging to visualize the IM dynamics, with a spatial resolution of 40 nm. By utilizing dual-color imaging of the IM and mtDNA, it has been uncovered that mtDNA tends to habitat at mitochondrial tips or branch points, exhibiting an overall spatially uniform distribution. Notably, the dynamics of mitochondria are intricately associated with the positioning of mtDNA, and fusion consistently occurs in close proximity to mtDNA to minimize pressure during cristae remodeling. In healthy cells, >66% of the mitochondria are Class III (i.e., mitochondria >5 μm or with >12 cristae), while it dropped to <18% in ferroptosis. Mitochondrial dynamics, orchestrated by cristae remodeling, foster the even distribution of mtDNA. Conversely, in conditions of apoptosis and ferroptosis where the cristae structure is compromised, mtDNA distribution becomes irregular. These findings, achieved with unprecedented spatiotemporal resolution, reveal the intricate interplay between cristae and mtDNA and provide insights into the driving forces behind mtDNA distribution.

Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy

Computational super-resolution methods, including conventional analytical algorithms and deep learning models, have substantially improved optical microscopy. Among them, supervised deep neural networks have demonstrated outstanding performance, however, demanding abundant high-quality training data, which are laborious and even impractical to acquire due to the high dynamics of living cells. Here, we develop zero-shot deconvolution networks (ZS-DeconvNet) that instantly enhance the resolution of microscope images by more than 1.5-fold over the diffraction limit with 10-fold lower fluorescence than ordinary super-resolution imaging conditions, in an unsupervised manner without the need for either ground truths or additional data acquisition. We demonstrate the versatile applicability of ZS-DeconvNet on multiple imaging modalities, including total internal reflection fluorescence microscopy, three-dimensional wide-field microscopy, confocal microscopy, two-photon microscopy, lattice light-sheet microscopy, and multimodal structured illumination microscopy, which enables multi-color, long-term, super-resolution 2D/3D imaging of subcellular bioprocesses from mitotic single cells to multicellular embryos of mouse and C. elegans.

Advanced 3D imaging and organoid bioprinting for biomedical research and therapeutic applications

Organoid cultures offer a valuable platform for studying organ-level biology, allowing for a closer mimicry of human physiology compared to traditional two-dimensional cell culture systems or non-primate animal models. While many organoid cultures use cell aggregates or decellularized extracellular matrices as scaffolds, they often lack precise biochemical and biophysical microenvironments. In contrast, three-dimensional (3D) bioprinting allows precise placement of organoids or spheroids, providing enhanced spatial control and facilitating the direct fusion for the formation of large-scale functional tissues in vitro. In addition, 3D bioprinting enables fine tuning of biochemical and biophysical cues to support organoid development and maturation. With advances in the organoid technology and its potential applications across diverse research fields such as cell biology, developmental biology, disease pathology, precision medicine, drug toxicology, and tissue engineering, organoid imaging has become a crucial aspect of physiological and pathological studies. This review highlights the recent advancements in imaging technologies that have significantly contributed to organoid research. Additionally, we discuss various bioprinting techniques, emphasizing their applications in organoid bioprinting. Integrating 3D imaging tools into a bioprinting platform allows real-time visualization while facilitating quality control, optimization, and comprehensive bioprinting assessment. Similarly, combining imaging technologies with organoid bioprinting can provide valuable insights into tissue formation, maturation, functions, and therapeutic responses. This approach not only improves the reproducibility of physiologically relevant tissues but also enhances understanding of complex biological processes. Thus, careful selection of bioprinting modalities, coupled with appropriate imaging techniques, holds the potential to create a versatile platform capable of addressing existing challenges and harnessing opportunities in these rapidly evolving fields.

Ultrabright Xanthene Fluorescence Probe for Mitochondrial Super-Resolution Imaging

Mitochondria are important organelles that provide energy for cellular physiological activities. Changes in their structures may indicate the occurrence of diseases, and the super-resolution imaging of mitochondria is of great significance. However, developing fluorescent probes for mitochondrial super-resolution visualization still remains challenging due to insufficient fluorescence brightness and poor stability. Herein, we rationally synthesized an ultrabright xanthene fluorescence probe Me-hNR for mitochondria-specific super-resolution imaging using structured illumination microscopy (SIM). The rigid structure of Me-hNR provided its ultrahigh fluorescence quantum yield of up to 0.92 and ultrahigh brightness of up to 16,000. Occupying the para-position of the O atom in the xanthene skeleton by utilizing the smallest methyl group ensured its excellent stability. The study of the photophysical process indicated that Me-hNR mainly emitted fluorescence via radiative decay, and nonradiative decay and inter-system crossing were rare due to the slow nonradiative decay rate and large energy gap (ΔEst = 0.55 eV). Owing to these excellent merits, Me-hNR can specifically light up mitochondria at ultralow concentrations down to 5 nM. The unprecedented spatial resolution for mitochondria with an fwhm of 174 nm was also achieved. Therefore, this ultrabright xanthene fluorescence probe has great potential in visualizing the structural changes of mitochondria and revealing the pathogenesis of related diseases using SIM.

Bridging Smart Nanosystems with Clinically Relevant Models and Advanced Imaging for Precision Drug Delivery

Intracellular delivery of nano-drug-carriers (NDC) to specific cells, diseased regions, or solid tumors has entered the era of precision medicine that requires systematic knowledge of nano-biological interactions from multidisciplinary perspectives. To this end, this review first provides an overview of membrane-disruption methods such as electroporation, sonoporation, photoporation, microfluidic delivery, and microinjection with the merits of high-throughput and enhanced efficiency for in vitro NDC delivery. The impact of NDC characteristics including particle size, shape, charge, hydrophobicity, and elasticity on cellular uptake are elaborated and several types of NDC systems aiming for hierarchical targeting and delivery in vivo are reviewed. Emerging in vitro or ex vivo human/animal-derived pathophysiological models are further explored and highly recommended for use in NDC studies since they might mimic in vivo delivery features and fill the translational gaps from animals to humans. The exploration of modern microscopy techniques for precise nanoparticle (NP) tracking at the cellular, organ, and organismal levels informs the tailored development of NDCs for in vivo application and clinical translation. Overall, the review integrates the latest insights into smart nanosystem engineering, physiological models, imaging-based validation tools, all directed towards enhancing the precise and efficient intracellular delivery of NDCs.

FLEX: genetically encodable enzymatic fluorescence signal amplification using engineered peroxidase

Fluorescent tagging of biomolecules enables their sensitive detection during separation and determining their subcellular location. In this context, peroxidase-based reactions are actively utilized for signal amplification. To harness this potential, we developed a genetically encodable enzymatic fluorescence signal amplification method using APEX (FLEX). We synthesized a fluorescent probe, Jenfluor triazole (JFT1), which effectively amplifies and restricts fluorescence signals under fixed conditions, enabling fluorescence-based detection of subcellularly localized electron-rich metabolites. Moreover, JFT1 exhibited stable fluorescence signals even under osmium-treated and polymer-embedded conditions, which supported findings from correlative light and electron microscopy (CLEM) using APEX. Using various APEX-conjugated proteins of interest (POIs) targeted to different organelles, we successfully visualized their localization through FLEX imaging while effectively preserving organelle ultrastructures. FLEX provides insights into dynamic lysosome-mitochondria interactions upon exposure to chemical stressors. Overall, FLEX holds significant promise as a sensitive and versatile system for fluorescently detecting APEX2-POIs in multiscale biological samples.

A Structured Illumination Microscopy Framework with Spatial-Domain Noise Propagation

Biological images captured by a microscope are characterized by heterogeneous signal-to-noise ratios (SNRs) across the field of view due to spatially varying photon emission and camera noise. State-of-the-art unsupervised structured illumination microscopy (SIM) reconstruction algorithms, commonly implemented in the Fourier domain, do not accurately model this noise and suffer from high-frequency artifacts, user-dependent choices of smoothness constraints making assumptions on biological features, and unphysical negative values in the recovered fluorescence intensity map. On the other hand, supervised methods rely on large datasets for training, and often require retraining for new sample structures. Consequently, achieving high contrast near the maximum theoretical resolution in an unsupervised, physically principled manner remains a challenging task. Here, we propose Bayesian-SIM (B-SIM), an unsupervised Bayesian framework to quantitatively reconstruct SIM data, rectifying these shortcomings by accurately incorporating all noise sources in the spatial domain. To accelerate the reconstruction process for computational feasibility, we devise a parallelized Monte Carlo sampling strategy for inference. We benchmark our framework on both simulated and experimental images, and demonstrate improved contrast permitting feature recovery at up to 25% shorter length scales over state-of-the-art methods at both high- and low-SNR. B-SIM enables unsupervised, quantitative, physically accurate reconstruction without the need for labeled training data, democratizing high-quality SIM reconstruction and expands the capabilities of live-cell SIM to lower SNR, potentially revealing biological features in previously inaccessible regimes.

Open-source microscope add-on for structured illumination microscopy

Super-resolution techniques expand the abilities of researchers who have the knowledge and resources to either build or purchase a system. This excludes the part of the research community without these capabilities. Here we introduce the openSIM add-on to upgrade existing optical microscopes to Structured Illumination super-resolution Microscopes (SIM). The openSIM is an open-hardware system, designed and documented to be easily duplicated by other laboratories, making super-resolution modality accessible to facilitate innovative research. The add-on approach gives a performance improvement for pre-existing lab equipment without the need to build a completely new system.

How to identify biofouling species in marine and freshwater

The identification and management of biofouling remain pressing challenges in marine and freshwater ecosystems, with significant implications for environmental sustainability and industrial operations. This comprehensive review synthesizes the current state-of-the-art in biofouling identification technologies, examining eight prominent methodologies: Microscopy Examination, Molecular Biology, Remote Sensing, Community Involvement, Ecological Methods, Artificial Intelligence, Chemical Analysis, and Macro Photography. Each method is evaluated for its respective advantages and disadvantages, considering factors such as precision, scalability, cost, and data quality. Furthermore, the review identifies current obstacles that inhibit the optimal utilization of these technologies, ranging from technical limitations and high operational costs to issues of data inconsistency and subjectivity. Finally, the review posits a future outlook, advocating for the development of integrated, standardized systems that amalgamate the strengths of individual approaches. Such advancement will pave the way for more effective and sustainable strategies for biofouling identification and management.

Fast, multicolour optical sectioning over extended fields of view with patterned illumination and machine learning

Structured illumination can reject out-of-focus signal from a sample, enabling high-speed and high-contrast imaging over large areas with widefield detection optics. However, this optical sectioning technique is currently limited by image reconstruction artefacts and poor performance at low signal-to-noise ratios. We combine multicolour interferometric pattern generation with machine learning to achieve high-contrast, real-time reconstruction of image data that is robust to background noise and sample motion. We validate the method in silico and demonstrate imaging of diverse specimens, from fixed and live biological samples to synthetic biosystems, reconstructing data live at 11 Hz across a 44 × 44μm2 field of view, and demonstrate image acquisition speeds exceeding 154 Hz.

Pixel-reassigned line-scanning microscopy for fast volumetric super-resolution imaging

Super-resolution microscopy has revolutionized the field of biophotonics by revealing detailed 3D biological structures. Nonetheless, the technique is still largely limited by the low throughput and hampered by increased background signals for dense or thick biological specimens. In this paper, we present a pixel-reassigned continuous line-scanning microscope for large-scale high-speed 3D super-resolution imaging, which achieves an imaging resolution of 0.41 µm in the lateral direction, i.e., a 2× resolution enhancement from the raw images. Specifically, the recorded line images are first reassigned to the line-excitation center at each scanning position to enhance the resolution. Next, a modified HiLo algorithm is applied to reduce the background signals. Parametric models have been developed to simulate the imaging results of randomly distributed fluorescent beads. Imaging experiments were designed and performed to verify the predicted performance on various biological samples, which demonstrated an imaging speed of 3400 pixels/ms on millimeter-scale specimens. These results confirm the pixel-reassigned line-scanning microscopy is a facile and powerful method to realize large-area super-resolution imaging on thick or dense biological samples.

Easily scalable multi-color DMD-based structured illumination microscopy

Structured illumination microscopy (SIM) achieves super-resolution imaging using a series of phase-shifted sinusoidal illumination patterns to down-modulate high spatial-frequency information of samples. Digital micromirror devices (DMDs) have been increasingly used to generate SIM illumination patterns due to their high speed and moderate cost. However, a DMD micromirror array's blazed grating structure causes strong angular dispersion for different wavelengths of light, thus severely hampering its application in multicolor imaging. We developed a multi-color DMD-SIM setup that employs a diffraction grating to compensate the DMD's dispersion and demonstrate super-resolution SIM imaging of both fluorescent beads and live cells samples with four color channels. This simple but effective approach can be readily scaled to more color channels, thereby greatly expanding the application of SIM in the study of complex multi-component structures and dynamics in soft matter systems.

Super-Resolution Imaging of Neuronal Structures with Structured Illumination Microscopy

Super-resolution structured illumination microscopy (SR-SIM) is an optical fluorescence microscopy method which is suitable for imaging a wide variety of cells and tissues in biological and biomedical research. Typically, SIM methods use high spatial frequency illumination patterns generated by laser interference. This approach provides high resolution but is limited to thin samples such as cultured cells. Using a different strategy for processing raw data and coarser illumination patterns, we imaged through a 150-micrometer-thick coronal section of a mouse brain expressing GFP in a subset of neurons. The resolution reached 144 nm, an improvement of 1.7-fold beyond conventional widefield imaging.