Rapid species identification of pathogenic bacteria from a minute quantity exploiting three-dimensional quantitative phase imaging and artificial neural network

Application of Mono and Trinuclear Cyclometalated Iridium (III) Complexes in Differential Bacterial Imaging and Antimicrobial Photodynamic Therapy

The application of transition metal complexes for antimicrobial photodynamic therapy (PDT) has emerged as an attractive alternative in mitigating a broad range of bacterial pathogens, including multidrug-resistant pathogens. In view of their photostability, long excited-state lifetimes, and tunable emission properties, transition metal complexes also contribute as bioimaging agents. In the present work, we designed mono and trinuclear cyclometalated iridium (III) complexes to explore their imaging application and antibacterial potential. For this, we used Methicillin-resistant S. aureus (MRSA), the most prevalent of community-associated (CA) multidrug-resistant (MDR) bacteria (CA MDR) and Lactococcus lactis (L. lactis) as Gram-positive while Campylobacter jejuni (C. jejuni) and E. coli as Gram-negative bacteria. In addition to differential bioimaging of these bacteria, we assessed the antibacterial effects of both mono and trinuclear Ir(III) complexes under exposure to 427 nm LED light. The data presented herein strongly suggest better efficacy of trinuclear Ir(III) complex over the mononuclear complex in imparting photoinduced cell death of MRSA. Based on the safety profile of these complexes, we propose that trinuclear cyclometalated iridium(III) complex holds great promise for selective recognition and targeting MDR bacteria with minimal off-target effect.

Single-shot quantitative phase-fluorescence imaging using cross-grating wavefront microscopy

The article introduces an optical microscopy technique capable of simultaneously acquiring quantitative fluorescence and phase (or equivalently wavefront) images with a single camera sensor, avoiding any delay between both images, or registration of images acquired separately. The method is based on the use of a 2-dimensional diffraction grating (aka cross-grating) positioned at a millimeter distance from a 2-color camera. Fluorescence and wavefront images are extracted from the two color channels of the camera, and retrieved by image demodulation. The applicability of the method is illustrated on various samples, namely fluorescent micro-beads, bacteria and mammalian cells.

On the use of deep learning for phase recovery

Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.

Enhanced functionalities of immune cells separated by a microfluidic lattice: assessment based on holotomography

The isolation of white blood cells (WBCs) from whole blood constitutes a pivotal process for immunological studies, diagnosis of hematologic disorders, and the facilitation of immunotherapy. Despite the ubiquity of density gradient centrifugation in WBC isolation, its influence on WBC functionality remains inadequately understood. This research employs holotomography to explore the effects of two distinct WBC separation techniques, namely conventional centrifugation and microfluidic separation, on the functionality of the isolated cells. We utilize three-dimensional refractive index distribution and time-lapse dynamics to analyze individual WBCs in-depth, focusing on their morphology, motility, and phagocytic capabilities. Our observations highlight that centrifugal processes negatively impact WBC motility and phagocytic capacity, whereas microfluidic separation yields a more favorable outcome in preserving WBC functionality. These findings emphasize the potential of microfluidic separation techniques as a viable alternative to traditional centrifugation for WBC isolation, potentially enabling more precise analyses in immunology research and improving the accuracy of hematologic disorder diagnoses.

Three-dimensional label-free morphology of CD8 + T cells as a sepsis biomarker

Sepsis is a dysregulated immune response to infection that leads to organ dysfunction and is associated with a high incidence and mortality rate. The lack of reliable biomarkers for diagnosing and prognosis of sepsis is a major challenge in its management. We aimed to investigate the potential of three-dimensional label-free CD8 + T cell morphology as a biomarker for sepsis. This study included three-time points in the sepsis recovery cohort (N = 8) and healthy controls (N = 20). Morphological features and spatial distribution within cells were compared among the patients' statuses. We developed a deep learning model to predict the diagnosis and prognosis of sepsis using the internal cell morphology. Correlation between the morphological features and clinical indices were analysed. Cell morphological features and spatial distribution differed significantly between patients with sepsis and healthy controls and between the survival and non-survival groups. The model for predicting the diagnosis and prognosis of sepsis showed an area under the receiver operating characteristic curve of nearly 100% with only a few cells, and a strong correlation between the morphological features and clinical indices was observed. Our study highlights the potential of three-dimensional label-free CD8 + T cell morphology as a promising biomarker for sepsis. This approach is rapid, requires a minimum amount of blood samples, and has the potential to provide valuable information for the early diagnosis and prognosis of sepsis.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Quantitative phase imaging for characterization of single cell growth dynamics

Quantitative phase imaging (QPI) has emerged as an indispensable tool in the field of biomedicine, offering the ability to obtain quantitative maps of phase changes due to optical path length delays without the need for contrast agents. These maps provide valuable information about cellular morphology and dynamics, unperturbed by the introduction of exogenous substances. In this review, a summary of recent studies that have focused on elucidating the growth dynamics of individual cells using QPI is presented. Specifically, investigations into cellular changes occurring during mitosis, the differentiation of cellular organelles, the assessment of distinct cell death processes (i.e., apoptosis, necrosis, and oncosis) and the precise measurement of live cell temperature are explored. Furthermore, the captivating applications of QPI in theragnostics, where its potential for transformative impact is prominently showcased, are highlighted. Finally, the challenges that need to be overcome for its wider adoption and successful integration into biomedical research are outlined.

Dry mass photometry of single bacteria using quantitative wavefront microscopy

Quantitative phase microscopy (QPM) represents a noninvasive alternative to fluorescence microscopy for cell observation with high contrast and for the quantitative measurement of dry mass (DM) and growth rate at the single-cell level. While DM measurements using QPM have been widely conducted on mammalian cells, bacteria have been less investigated, presumably due to the high resolution and high sensitivity required by their smaller size. This article demonstrates the use of cross-grating wavefront microscopy, a high-resolution and high-sensitivity QPM, for accurate DM measurement and monitoring of single microorganisms (bacteria and archaea). The article covers strategies for overcoming light diffraction and sample focusing, and introduces the concepts of normalized optical volume and optical polarizability (OP) to gain additional information beyond DM. The algorithms for DM, optical volume, and OP measurements are illustrated through two case studies: monitoring DM evolution in a microscale colony-forming unit as a function of temperature, and using OP as a potential species-specific signature.

Deep learning-based label-free hematology analysis framework using optical diffraction tomography

Hematology analysis, a common clinical test for screening various diseases, has conventionally required a chemical staining process that is time-consuming and labor-intensive. To reduce the costs of chemical staining, label-free imaging can be utilized in hematology analysis. In this work, we exploit optical diffraction tomography and the fully convolutional one-stage object detector or FCOS, a deep learning architecture for object detection, to develop a label-free hematology analysis framework. Detected cells are classified into four groups: red blood cell, abnormal red blood cell, platelet, and white blood cell. In the results, the trained object detection model showed superior detection performance for blood cells in refractive index tomograms (0.977 mAP) and also showed high accuracy in the four-class classification of blood cells (0.9708 weighted F1 score, 0.9712 total accuracy). For further verification, mean corpuscular volume (MCV) and mean corpuscular hemoglobin (MCH) were compared with values obtained from reference hematology equipment, with our results showing reasonable correlation in both MCV (0.905) and MCH (0.889). This study provides a successful demonstration of the proposed framework in detecting and classifying blood cells using optical diffraction tomography for label-free hematology analysis.

Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning

A plaque assay-the gold-standard method for measuring the concentration of replication-competent lytic virions-requires staining and usually more than 48 h of runtime. Here we show that lens-free holographic imaging and deep learning can be combined to expedite and automate the assay. The compact imaging device captures phase information label-free at a rate of approximately 0.32 gigapixels per hour per well, covers an area of about 30 × 30 mm2 and a 10-fold larger dynamic range of virus concentration than standard assays, and quantifies the infected area and the number of plaque-forming units. For the vesicular stomatitis virus, the automated plaque assay detected the first cell-lysing events caused by viral replication as early as 5 h after incubation, and in less than 20 h it detected plaque-forming units at rates higher than 90% at 100% specificity. Furthermore, it reduced the incubation time of the herpes simplex virus type 1 by about 48 h and that of the encephalomyocarditis virus by about 20 h. The stain-free assay should be amenable for use in virology research, vaccine development and clinical diagnosis.

Machine-learning-based diagnosis of thyroid fine-needle aspiration biopsy synergistically by Papanicolaou staining and refractive index distribution

We developed a machine learning algorithm (MLA) that can classify human thyroid cell clusters by exploiting both Papanicolaou staining and intrinsic refractive index (RI) as correlative imaging contrasts and evaluated the effects of this combination on diagnostic performance. Thyroid fine-needle aspiration biopsy (FNAB) specimens were analyzed using correlative optical diffraction tomography, which can simultaneously measure both, the color brightfield of Papanicolaou staining and three-dimensional RI distribution. The MLA was designed to classify benign and malignant cell clusters using color images, RI images, or both. We included 1535 thyroid cell clusters (benign: malignancy = 1128:407) from 124 patients. Accuracies of MLA classifiers using color images, RI images, and both were 98.0%, 98.0%, and 100%, respectively. As information for classification, the nucleus size was mainly used in the color image; however, detailed morphological information of the nucleus was also used in the RI image. We demonstrate that the present MLA and correlative FNAB imaging approach has the potential for diagnosing thyroid cancer, and complementary information from color and RI images can improve the performance of the MLA.

Highly sensitive quantitative phase microscopy and deep learning aided with whole genome sequencing for rapid detection of infection and antimicrobial resistance

Current state-of-the-art infection and antimicrobial resistance (AMR) diagnostics are based on culture-based methods with a detection time of 48-96 h. Therefore, it is essential to develop novel methods that can do real-time diagnoses. Here, we demonstrate that the complimentary use of label-free optical assay with whole-genome sequencing (WGS) can enable rapid diagnosis of infection and AMR. Our assay is based on microscopy methods exploiting label-free, highly sensitive quantitative phase microscopy (QPM) followed by deep convolutional neural networks-based classification. The workflow was benchmarked on 21 clinical isolates from four WHO priority pathogens that were antibiotic susceptibility tested, and their AMR profile was determined by WGS. The proposed optical assay was in good agreement with the WGS characterization. Accurate classification based on the gram staining (100% recall for gram-negative and 83.4% for gram-positive), species (98.6%), and resistant/susceptible type (96.4%), as well as at the individual strain level (100% sensitivity in predicting 19 out of the 21 strains, with an overall accuracy of 95.45%). The results from this initial proof-of-concept study demonstrate the potential of the QPM assay as a rapid and first-stage tool for species, strain-level classification, and the presence or absence of AMR, which WGS can follow up for confirmation. Overall, a combined workflow with QPM and WGS complemented with deep learning data analyses could, in the future, be transformative for detecting and identifying pathogens and characterization of the AMR profile and antibiotic susceptibility.

Pixel-level multimodal fusion deep networks for predicting subcellular organelle localization from label-free live-cell imaging

Complex intracellular organizations are commonly represented by dividing the metabolic process of cells into different organelles. Therefore, identifying sub-cellular organelle architecture is significant for understanding intracellular structural properties, specific functions, and biological processes in cells. However, the discrimination of these structures in the natural organizational environment and their functional consequences are not clear. In this article, we propose a new pixel-level multimodal fusion (PLMF) deep network which can be used to predict the location of cellular organelle using label-free cell optical microscopy images followed by deep-learning-based automated image denoising. It provides valuable insights that can be of tremendous help in improving the specificity of label-free cell optical microscopy by using the Transformer-Unet network to predict the ground truth imaging which corresponds to different sub-cellular organelle architectures. The new prediction method proposed in this article combines the advantages of a transformer's global prediction and CNN's local detail analytic ability of background features for label-free cell optical microscopy images, so as to improve the prediction accuracy. Our experimental results showed that the PLMF network can achieve over 0.91 Pearson's correlation coefficient (PCC) correlation between estimated and true fractions on lung cancer cell-imaging datasets. In addition, we applied the PLMF network method on the cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new way for the time-resolved study of subcellular components in different cells, especially for cancer cells.

Recent Progress in Spectroscopic Methods for the Detection of Foodborne Pathogenic Bacteria

Detection of foodborne pathogens at an early stage is very important to control food quality and improve medical response. Rapid detection of foodborne pathogens with high sensitivity and specificity is becoming an urgent requirement in health safety, medical diagnostics, environmental safety, and controlling food quality. Despite the existing bacterial detection methods being reliable and widely used, these methods are time-consuming, expensive, and cumbersome. Therefore, researchers are trying to find new methods by integrating spectroscopy techniques with artificial intelligence and advanced materials. Within this progress report, advances in the detection of foodborne pathogens using spectroscopy techniques are discussed. This paper presents an overview of the progress and application of spectroscopy techniques for the detection of foodborne pathogens, particularly new trends in the past few years, including surface-enhanced Raman spectroscopy, surface plasmon resonance, fluorescence spectroscopy, multiangle laser light scattering, and imaging analysis. In addition, the applications of artificial intelligence, microfluidics, smartphone-based techniques, and advanced materials related to spectroscopy for the detection of bacterial pathogens are discussed. Finally, we conclude and discuss possible research prospects in aspects of spectroscopy techniques for the identification and classification of pathogens.