De Novo Identification and Visualization of Important Cell Populations for Classic Hodgkin Lymphoma Using Flow Cytometry and Machine Learning

Recommendations for using artificial intelligence in clinical flow cytometry

Flow cytometry is a key clinical tool in the diagnosis of many hematologic malignancies and traditionally requires close inspection of digital data by hematopathologists with expert domain knowledge. Advances in artificial intelligence (AI) are transferable to flow cytometry and have the potential to improve efficiency and prioritization of cases, reduce errors, and highlight fundamental, previously unrecognized associations with underlying biological processes. As a multidisciplinary group of stakeholders, we review a range of critical considerations for appropriately applying AI to clinical flow cytometry, including use case identification, low and high risk use cases, validation, revalidation, computational considerations, and the present regulatory frameworks surrounding AI in clinical medicine. In particular, we provide practical guidance for the development, implementation, and suggestions for potential regulation of AI-based methods in the clinical flow cytometry laboratory. We expect these recommendations to be a helpful initial framework of reference, which will also require additional updates as the field matures.

Comparison of three machine learning algorithms for classification of B-cell neoplasms using clinical flow cytometry data

Multiparameter flow cytometry data is visually inspected by expert personnel as part of standard clinical disease diagnosis practice. This is a demanding and costly process, and recent research has demonstrated that it is possible to utilize artificial intelligence (AI) algorithms to assist in the interpretive process. Here we report our examination of three previously published machine learning methods for classification of flow cytometry data and apply these to a B-cell neoplasm dataset to obtain predicted disease subtypes. Each of the examined methods classifies samples according to specific disease categories using ungated flow cytometry data. We compare and contrast the three algorithms with respect to their architectures, and we report the multiclass classification accuracies and relative required computation times. Despite different architectures, two of the methods, flowCat and EnsembleCNN, had similarly good accuracies with relatively fast computational times. We note a speed advantage for EnsembleCNN, particularly in the case of addition of training data and retraining of the classifier.

Morphology and multiparameter flow cytometry combined for integrated lymphoma diagnosis on small volume samples: possibilities and limitations

The diagnosis of lymphoma relies mainly on clinical examination and laboratory explorations. Among the latter, morphological and immunohistochemical analysis of a tissue biopsy are the cornerstones for proper identification and classification of the disease. In lymphoma with blood and/or bone marrow involvement, multiparameter flow cytometry is useful. This technique can also be applied to fresh cells released from a biopsy sample. For full comprehension of lymphomas, surgical biopsies are best and indeed recommended by the hematopathological community. Currently, however, there is a global trend towards less invasive procedures, resulting in smaller samples such as core needle biopsies or fine needle aspirations which can make the diagnosis quite challenging. In this review, the possibilities and limitations to make an accurate lymphoma diagnosis on such small volume material are presented. After recalling the major steps of lymphoma diagnosis, the respective value of histology, cytology, and flow cytometry is discussed, including handling of small specimens. The benefits of an integrated approach are then evoked, followed by discussion about which attitude to adopt in different contexts. Perhaps contrary to the prevailing view among many pathologists, a full diagnosis on small volume material, combined with relevant ancillary techniques, is often possible and indeed supported by recent literature. A glimpse at future evolutions, notably the merit of artificial intelligence tools, is finally provided. All in all, this document aims at providing pathologists with an overview of diagnostic possibilities in lymphoma patients when confronted with small volume material such as core needle biopsies or fine needle aspirations.

Machine learning-based clinical decision support using laboratory data

Artificial intelligence (AI) and machine learning (ML) are becoming vital in laboratory medicine and the broader context of healthcare. In this review article, we summarized the development of ML models and how they contribute to clinical laboratory workflow and improve patient outcomes. The process of ML model development involves data collection, data cleansing, feature engineering, model development, and optimization. These models, once finalized, are subjected to thorough performance assessments and validations. Recently, due to the complexity inherent in model development, automated ML tools were also introduced to streamline the process, enabling non-experts to create models. Clinical Decision Support Systems (CDSS) use ML techniques on large datasets to aid healthcare professionals in test result interpretation. They are revolutionizing laboratory medicine, enabling labs to work more efficiently with less human supervision across pre-analytical, analytical, and post-analytical phases. Despite contributions of the ML tools at all analytical phases, their integration presents challenges like potential model uncertainties, black-box algorithms, and deskilling of professionals. Additionally, acquiring diverse datasets is hard, and models' complexity can limit clinical use. In conclusion, ML-based CDSS in healthcare can greatly enhance clinical decision-making. However, successful adoption demands collaboration among professionals and stakeholders, utilizing hybrid intelligence, external validation, and performance assessments.

Validation of Artificial Intelligence (AI)-Assisted Flow Cytometry Analysis for Immunological Disorders

Flow cytometry is a vital diagnostic tool for hematologic and immunologic disorders, but manual analysis is prone to variation and time-consuming. Over the last decade, artificial intelligence (AI) has advanced significantly. In this study, we developed and validated an AI-assisted flow cytometry workflow using 379 clinical cases from 2021, employing a 3-tube, 10-color flow panel with 21 antibodies for primary immunodeficiency diseases and related immunological disorders. The AI software (DeepFlow™, version 2.1.1) is fully automated, reducing analysis time to under 5 min per case. It interacts with hematopatholoists for manual gating adjustments when necessary. Using proprietary multidimensional density-phenotype coupling algorithm, the AI model accurately classifies and enumerates T, B, and NK cells, along with important immune cell subsets, including CD4+ helper T cells, CD8+ cytotoxic T cells, CD3+/CD4-/CD8- double-negative T cells, and class-switched or non-switched B cells. Compared to manual analysis with hematopathologist-determined lymphocyte subset percentages as the gold standard, the AI model exhibited a strong correlation (r > 0.9) across lymphocyte subsets. This study highlights the accuracy and efficiency of AI-assisted flow cytometry in diagnosing immunological disorders in a clinical setting, providing a transformative approach within a concise timeframe.

Automated Deep Learning-Based Diagnosis and Molecular Characterization of Acute Myeloid Leukemia Using Flow Cytometry

The current flow cytometric analysis of blood and bone marrow samples for diagnosis of acute myeloid leukemia (AML) relies heavily on manual intervention in the processing and analysis steps, introducing significant subjectivity into resulting diagnoses and necessitating highly trained personnel. Furthermore, concurrent molecular characterization via cytogenetics and targeted sequencing can take multiple days, delaying patient diagnosis and treatment. Attention-based multi-instance learning models (ABMILMs) are deep learning models that make accurate predictions and generate interpretable insights regarding the classification of a sample from individual events/cells; nonetheless, these models have yet to be applied to flow cytometry data. In this study, we developed a computational pipeline using ABMILMs for the automated diagnosis of AML cases based exclusively on flow cytometric data. Analysis of 1820 flow cytometry samples shows that this pipeline provides accurate diagnoses of acute leukemia (area under the receiver operating characteristic curve [AUROC] 0.961) and accurately differentiates AML vs B- and T-lymphoblastic leukemia (AUROC 0.965). Models for prediction of 9 cytogenetic aberrancies and 32 pathogenic variants in AML provide accurate predictions, particularly for t(15;17)(PML::RARA) [AUROC 0.929], t(8;21)(RUNX1::RUNX1T1) (AUROC 0.814), and NPM1 variants (AUROC 0.807). Finally, we demonstrate how these models generate interpretable insights into which individual flow cytometric events and markers deliver optimal diagnostic utility, providing hematopathologists with a data visualization tool for improved data interpretation, as well as novel biological associations between flow cytometric marker expression and cytogenetic/molecular variants in AML. Our study is the first to illustrate the feasibility of using deep learning-based analysis of flow cytometric data for automated AML diagnosis and molecular characterization.

Automated Deep Learning-Based Diagnosis and Molecular Characterization of Acute Myeloid Leukemia using Flow Cytometry

Current flow cytometric analysis of blood and bone marrow samples for diagnosis of acute myeloid leukemia (AML) relies heavily on manual intervention in both the processing and analysis steps, introducing significant subjectivity into resulting diagnoses and necessitating highly trained personnel. Furthermore, concurrent molecular characterization via cytogenetics and targeted sequencing can take multiple days, delaying patient diagnosis and treatment. Attention-based multi-instance learning models (ABMILMs) are deep learning models which make accurate predictions and generate interpretable insights regarding the classification of a sample from individual events/cells; nonetheless, these models have yet to be applied to flow cytometry data. In this study, we developed a computational pipeline using ABMILMs for the automated diagnosis of AML cases based exclusively on flow cytometric data. Analysis of 1,820 flow cytometry samples shows that this pipeline provides accurate diagnoses of acute leukemia [AUROC 0.961] and accurately differentiates AML versus B- and T-lymphoblastic leukemia [AUROC 0.965]. Models for prediction of 9 cytogenetic aberrancies and 32 pathogenic variants in AML provide accurate predictions, particularly for t(15;17)(PML::RARA) [AUROC 0.929], t(8;21)(RUNX1::RUNX1T1) [AUROC 0.814], and NPM1 variants [AUROC 0.807]. Finally, we demonstrate how these models generate interpretable insights into which individual flow cytometric events and markers deliver optimal diagnostic utility, providing hematopathologists with a data visualization tool for improved data interpretation, as well as novel biological associations between flow cytometric marker expression and cytogenetic/molecular variants in AML. Our study is the first to illustrate the feasibility of using deep learning-based analysis of flow cytometric data for automated AML diagnosis and molecular characterization.

Artificial Intelligence for Clinical Flow Cytometry

In this review, the authors discuss the fundamental principles of machine learning. They explore recent studies and approaches in implementing machine learning into flow cytometry workflows. These applications are promising but not without their shortcomings. Explainability may be the biggest barrier to adoption, as they contain "black boxes" in which a complex network of mathematical processes learns features of data that are not translatable into real language. The authors discuss the current limitations of machine learning models and the possibility that, without a multiinstitutional development process, these applications could have poor generalizability. They also discuss widespread deployment of augmented decision-making.

Artificial intelligence in clinical multiparameter flow cytometry and mass cytometry-key tools and progress

There are many research studies and emerging tools using artificial intelligence (AI) and machine learning to augment flow and mass cytometry workflows. Emerging AI tools can quickly identify common cell populations with continuous improvement of accuracy, uncover patterns in high-dimensional cytometric data that are undetectable by human analysis, facilitate the discovery of cell subpopulations, perform semi-automated immune cell profiling, and demonstrate potential to automate aspects of clinical multiparameter flow cytometric (MFC) diagnostic workflow. Utilizing AI in the analysis of cytometry samples can reduce subjective variability and assist in breakthroughs in understanding diseases. Here we review the diverse types of AI that are being applied to clinical cytometry data and how AI is driving advances in data analysis to improve diagnostic sensitivity and accuracy. We review supervised and unsupervised clustering algorithms for cell population identification, various dimensionality reduction techniques, and their utilities in visualization and machine learning pipelines, and supervised learning approaches for classifying entire cytometry samples.Understanding the AI landscape will enable pathologists to better utilize open source and commercially available tools, plan exploratory research projects to characterize diseases, and work with machine learning and data scientists to implement clinical data analysis pipelines.

Developing and validating a highly sensitive platelet clump detection model for the Sysmex haematology analyser

BACKGROUND

Mainstream haematology analysers (HAs) are reported to have low detection sensitivity for platelet clumps. In this study, a deep learning (DL) algorithm, convolutional neural network (CNN), was implemented to detect platelet clumps.

METHODS

Adenosine diphosphate (ADP) was used to induce platelet aggregation to mimic platelet clumps detected (PCD) samples. Six types of leukocyte scattergrams were collected from the Sysmex XN-10. Then, multiple CNNs were trained and validated by scattergrams in a fivefold cross-validation (CV) method. Finally, the CNN model with the best CV accuracy was tested with practical routine work samples.

RESULTS

A total of 386 samples (190 PCD and 196 negative samples) and 4253 samples (150 PCD and 4103 negative samples) were eligible for CNN training and practical test, respectively. The CNN with the highest CV accuracy was trained by using scattergrams of side scatter (SSC) vs. forward scatter (FSC) from the white count and nucleated red blood cells (WNR) channel, whose mean area under the curve (AUC), accuracy, specificity and sensitivity were 0.968, 0.940, 0.937 and 0.942, respectively, in the CV. In the practical test, the AUC, accuracy, specificity and sensitivity of the CNN were 0.916, 0.961, 0.860 and 0.965, respectively. The dispersed spots presenting around the leucocytes in the WNR channel may be a sign of platelet clumping.

CONCLUSIONS

This study demonstrates that the CNN algorithms can identify platelet clumps based on optical information from dedicated leukocyte channels and has a higher ability to detect platelet clumps than the XN-10 device's internal algorithm under practical circumstances.