Virtual Staining, Segmentation, and Classification of Blood Smears for Label-Free Hematology Analysis

Deep learning-assisted smartphone-based quantitative microscopy for label-free peripheral blood smear analysis

Hematologists evaluate alterations in blood cell enumeration and morphology to confirm peripheral blood smear findings through manual microscopic examination. However, routine peripheral blood smear analysis is both time-consuming and labor-intensive. Here, we propose using smartphone-based autofluorescence microscopy (Smart-AM) for imaging label-free blood smears at subcellular resolution with automatic hematological analysis. Smart-AM enables rapid and label-free visualization of morphological features of normal and abnormal blood cells (including leukocytes, erythrocytes, and thrombocytes). Moreover, assisted with deep-learning algorithms, this technique can automatically detect and classify different leukocytes with high accuracy, and transform the autofluorescence images into virtual Giemsa-stained images which show clear cellular features. The proposed technique is portable, cost-effective, and user-friendly, making it significant for broad point-of-care applications.

Virtual histological staining of unlabeled autopsy tissue

Traditional histochemical staining of post-mortem samples often confronts inferior staining quality due to autolysis caused by delayed fixation of cadaver tissue, and such chemical staining procedures covering large tissue areas demand substantial labor, cost and time. Here, we demonstrate virtual staining of autopsy tissue using a trained neural network to rapidly transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images, matching hematoxylin and eosin (H&E) stained versions of the same samples. The trained model can effectively accentuate nuclear, cytoplasmic and extracellular features in new autopsy tissue samples that experienced severe autolysis, such as COVID-19 samples never seen before, where the traditional histochemical staining fails to provide consistent staining quality. This virtual autopsy staining technique provides a rapid and resource-efficient solution to generate artifact-free H&E stains despite severe autolysis and cell death, also reducing labor, cost and infrastructure requirements associated with the standard histochemical staining.

WBC YOLO-ViT: 2 Way - 2 stage white blood cell detection and classification with a combination of YOLOv5 and vision transformer

Accurate detection and classification of white blood cells, otherwise known as leukocytes, play a critical role in diagnosing and monitoring various illnesses. However, conventional methods, such as manual classification by trained professionals, must be revised in terms of accuracy, efficiency, and potential bias. Moreover, applying deep learning techniques to detect and classify white blood cells using microscopic images is challenging owing to limited data, resolution noise, irregular shapes, and varying colors from different sources. This study presents a novel approach integrating object detection and classification for numerous type-white blood cell. We designed a 2-way approach to use two types of images: WBC and nucleus. YOLO (fast object detection) and ViT (powerful image representation capabilities) are effectively integrated into 16 classes. The proposed model demonstrates an exceptional 96.449% accuracy rate in classification.

Digital staining facilitates biomedical microscopy

Traditional staining of biological specimens for microscopic imaging entails time-consuming, laborious, and costly procedures, in addition to producing inconsistent labeling and causing irreversible sample damage. In recent years, computational "virtual" staining using deep learning techniques has evolved into a robust and comprehensive application for streamlining the staining process without typical histochemical staining-related drawbacks. Such virtual staining techniques can also be combined with neural networks designed to correct various microscopy aberrations, such as out-of-focus or motion blur artifacts, and improve upon diffracted-limited resolution. Here, we highlight how such methods lead to a host of new opportunities that can significantly improve both sample preparation and imaging in biomedical microscopy.

Deep learning-enabled virtual histological staining of biological samples

Histological staining is the gold standard for tissue examination in clinical pathology and life-science research, which visualizes the tissue and cellular structures using chromatic dyes or fluorescence labels to aid the microscopic assessment of tissue. However, the current histological staining workflow requires tedious sample preparation steps, specialized laboratory infrastructure, and trained histotechnologists, making it expensive, time-consuming, and not accessible in resource-limited settings. Deep learning techniques created new opportunities to revolutionize staining methods by digitally generating histological stains using trained neural networks, providing rapid, cost-effective, and accurate alternatives to standard chemical staining methods. These techniques, broadly referred to as virtual staining, were extensively explored by multiple research groups and demonstrated to be successful in generating various types of histological stains from label-free microscopic images of unstained samples; similar approaches were also used for transforming images of an already stained tissue sample into another type of stain, performing virtual stain-to-stain transformations. In this Review, we provide a comprehensive overview of the recent research advances in deep learning-enabled virtual histological staining techniques. The basic concepts and the typical workflow of virtual staining are introduced, followed by a discussion of representative works and their technical innovations. We also share our perspectives on the future of this emerging field, aiming to inspire readers from diverse scientific fields to further expand the scope of deep learning-enabled virtual histological staining techniques and their applications.

Compact and low-cost deep-ultraviolet microscope system for label-free molecular imaging and point-of-care hematological analysis

Deep-ultraviolet (UV) microscopy enables label-free, high-resolution, quantitative molecular imaging and enables unique applications in biomedicine, including the potential for fast hematological analysis at the point-of-care. UV microscopy has been shown to quantify hemoglobin content and white blood cells (five-part differential), providing a simple alternative to the current gold standard, the hematological analyzer. Previously, however, the UV system comprised a bulky broadband laser-driven plasma light source along with a large and expensive camera and 3D translation stage. Here, we present a modified deep-UV microscope system with a compact footprint and low-cost components. We detail the novel design with simple, inexpensive optics and hardware to enable fast and accurate automated imaging. We characterize the system, including a modified low-cost web-camera and custom automated 3D translation stage, and demonstrate its ability to scan and capture large area images. We further demonstrate the capability of the system by imaging and analyzing blood smears, using previously trained networks for automatic segmentation, classification (including 5-part white blood cell differential), and colorization. The developed system is approximately 10 times less expensive than previous configurations and can serve as a point-of-care hematology analyzer, as well as be applied broadly in biomedicine as a simple compact, low-cost, quantitative molecular imaging system.

Label-free deep-UV microscopy detection and grading of neutropenia using a passive microfluidic device

Neutropenia is a condition comprising an abnormally low number of neutrophils, a type of white blood cell, which puts patients at an increased risk of severe infections. Neutropenia is especially common among cancer patients and can disrupt their treatment or even be life-threatening in severe cases. Therefore, routine monitoring of neutrophil counts is crucial. However, the current standard of care to assess neutropenia, the complete blood count (CBC), is resource-intensive, time-consuming, and expensive, thereby limiting easy or timely access to critical hematological information such as neutrophil counts. Here, we present a simple technique for fast, label-free neutropenia detection and grading via deep-ultraviolet (deep-UV) microscopy of blood cells in polydimethylsiloxane (PDMS)-based passive microfluidic devices. The devices can potentially be manufactured in large quantities at a low cost, requiring only 1 μL of whole blood for operation. We show that the absolute neutrophil counts (ANC) obtained from our proposed microfluidic device-enabled deep-UV microscopy system are highly correlated with those from CBCs using commercial hematology analyzers in patients with moderate and severe neutropenia, as well as healthy donors. This work lays the foundation for the development of a compact, easy-to-use UV microscope system to track neutrophil counts that is suitable for low-resource, at-home, or point-of-care settings.