Artificial Intelligence and Digital Microscopy Applications in Diagnostic Hematopathology

Prediction of inhibitor development in previously untreated and minimally treated children with severe and moderately severe hemophilia A using a machine-learning network

BACKGROUND

Prediction of inhibitor development in patients with hemophilia A (HA) remains a challenge.

OBJECTIVES

To construct a predictive model for inhibitor development in HA using a network of clinical variables and biomarkers based on the individual similarity network.

METHODS

Previously untreated and minimally treated children with severe/moderately severe HA, participants of the HEMFIL Cohort Study, were followed up until reaching 75 exposure days (EDs) without inhibitor (INH-) or upon inhibitor development (INH+). Clinical data and biological samples were collected before the start of factor (F)VIII replacement (T0). A predictive model (HemfilNET) was built to compare the networks and potential global topological differences between INH- and INH+ at T0, considering the network robustness. For validation, the "leave-one-out" cross-validation technique was employed. Accuracy, precision, recall, and F1-score were used as evaluation metrics for the machine-learning model.

RESULTS

We included 95 children with HA (CHA), of whom 31 (33%) developed inhibitors. The algorithm, featuring 37 variables, identified distinct patterns of networks at T0 for INH+ and INH-. The accuracy of the model was 74.2% for CHA INH+ and 98.4% for INH-. By focusing the analysis on CHA with high-risk F8 mutations for inhibitor development, the accuracy in identifying CHA INH+ increased to 82.1%.

CONCLUSION

Our machine-learning algorithm demonstrated an overall accuracy of 90.5% for predicting inhibitor development in CHA, which further improved when restricting the analysis to CHA with a high-risk F8 genotype. However, our model requires validation in other cohorts. Yet, missing data for some variables hindered more precise predictions.

Prediction of immunochemotherapy response for diffuse large B-cell lymphoma using artificial intelligence digital pathology

Diffuse large B-cell lymphoma (DLBCL) is a heterogeneous and prevalent subtype of aggressive non-Hodgkin lymphoma that poses diagnostic and prognostic challenges, particularly in predicting drug responsiveness. In this study, we used digital pathology and deep learning to predict responses to immunochemotherapy in patients with DLBCL. We retrospectively collected 251 slide images from 216 DLBCL patients treated with rituximab, cyclophosphamide, doxorubicin, vincristine, and prednisone (R-CHOP), with their immunochemotherapy response labels. The digital pathology images were processed using contrastive learning for feature extraction. A multi-modal prediction model was developed by integrating clinical data and pathology image features. Knowledge distillation was employed to mitigate overfitting on gigapixel histopathology images to create a model that predicts responses based solely on pathology images. Based on the importance derived from the attention mechanism of the model, we extracted histological features that were considered key textures associated with drug responsiveness. The multi-modal prediction model achieved an impressive area under the ROC curve of 0.856, demonstrating significant associations with clinical variables such as Ann Arbor stage, International Prognostic Index, and bulky disease. Survival analyses indicated their effectiveness in predicting relapse-free survival. External validation using TCGA datasets supported the model's ability to predict survival differences. Additionally, pathology-based predictions show promise as independent prognostic indicators. Histopathological analysis identified centroblastic and immunoblastic features to be associated with treatment response, aligning with previous morphological classifications and highlighting the objectivity and reproducibility of artificial intelligence-based diagnosis. This study introduces a novel approach that combines digital pathology and clinical data to predict the response to immunochemotherapy in patients with DLBCL. This model shows great promise as a diagnostic and prognostic tool for clinical management of DLBCL. Further research and genomic data integration hold the potential to enhance its impact on clinical practice, ultimately improving patient outcomes.

Advancements in technology for characterizing the tumor immune microenvironment

Immunotherapy plays a key role in cancer treatment, however, responses are limited to a small number of patients. The biological basis for the success of immunotherapy is the complex interaction between tumor cells and tumor immune microenvironment (TIME). Historically, research on tumor immune constitution was limited to the analysis of one or two markers, more novel technologies are needed to interpret the complex interactions between tumor cells and TIME. In recent years, major advances have already been made in depicting TIME at a considerably elevated degree of throughput, dimensionality and resolution, allowing dozens of markers to be labeled simultaneously, and analyzing the heterogeneity of tumour-immune infiltrates in detail at the single cell level, depicting the spatial landscape of the entire microenvironment, as well as applying artificial intelligence (AI) to interpret a large amount of complex data from TIME. In this review, we summarized emerging technologies that have made contributions to the field of TIME, and provided prospects for future research.

From microscope to micropixels: A rapid review of artificial intelligence for the peripheral blood film

Artificial intelligence (AI) and its application in classification of blood cells in the peripheral blood film is an evolving field in haematology. We performed a rapid review of the literature on AI and peripheral blood films, evaluating the condition studied, image datasets, machine learning models, training set size, testing set size and accuracy. A total of 283 studies were identified, encompassing 6 broad domains: malaria (n = 95), leukemia (n = 81), leukocytes (n = 72), mixed (n = 25), erythrocytes (n = 15) or Myelodysplastic syndrome (MDS) (n = 1). These publications have demonstrated high self-reported mean accuracy rates across various studies (95.5% for malaria, 96.0% for leukemia, 94.4% for leukocytes, 95.2% for mixed studies and 91.2% for erythrocytes), with an overall mean accuracy of 95.1%. Despite the high accuracy, the challenges toward real world translational usage of these AI trained models include the need for well-validated multicentre data, data standardisation, and studies on less common cell types and non-malarial blood-borne parasites.

Performance of the digital cell morphology analyzer MC-100i in a multicenter study in tertiary hospitals in China

BACKGROUND

This study investigated the performance of the MC-100i, a pre-commercial digital morphology analyzer utilizing a convolutional neural network algorithm, in a multicentric setting involving up to 11 tertiary hospitals in China.

METHODS

Blood smears were analyzed by MC-100i, verified by morphologists, and manually differentiated. The classification performance on WBCs and RBCs was evaluated by comparing the classification results using different methods. The PLT and PLT clump counting performance was also assessed. The total assay time including hands-on time was evaluated.

RESULTS

The agreements between pre- and post-classification were high for normal WBCs (κ > 0.96) and lower for overall abnormal WBCs (κ = 0.90). The post-classification results correlated well with manual differentials for both normal and abnormal WBCs (r > 0.93), except for basophils (r = 0.8480) and atypical lymphocytes (r = 0.8211). The clinical sensitivity and specificity of each RBC abnormality after verification were above 90 % using microscopy reviews as the reference. The PLTs counted by the MC-100i before and after verification correlated well with those measured by the PLT-O mode (r = 0.98). Moreover, PLT clumps were successfully classified by the analyzer in EDTA-dependent pseudothrombocytopenia blood samples.

CONCLUSIONS

The MC-100i is an accurate and reliable digital cell morphology analyzer, offering another intelligent option for hematology laboratories.

An AI based smart-phone system for asbestos identification

Asbestos identification is a complex environmental and economic challenge. Typical commercial identification of asbestos involves sending samples to a laboratory where someone learned in the field uses light microscopy and specialized mounting to identify the morphologically distinct signatures of Asbestos. In this work we investigate the use of a portable (30x) microscope which works with a smart phone camera to develop an image recognition system. 7328 images from over 1000 distinct samples of cement sheet from Melbourne, Australia were used to train a phone-based image recognition system for Asbestos identification. Three common CNN's were tested ResNet101, InceptionV3 and VGG_16 with ResNet101 achieving the best result. The distinctiveness of Asbestos was found to be identified correctly 90% of the time using a phone-based system and no specialized mounting. The image recognition system was trained with ResNet101 a convolutional neural network deep learning model which weights layers with a residual function. Resulting in an accuracy of 98.46% and loss of 3.8% ResNet101 was found to produce a more accurate model for this use-case than other deep learning neural networks.

Application of machine learning in the management of lymphoma: Current practice and future prospects

In the past decade, digitization of medical records and multiomics data analysis in lymphoma has led to the accessibility of high-dimensional records. The digitization of medical records, the visualization of extensive volume data extracted from medical images, and the integration of multiomics methods into clinical decision-making have produced many datasets. As a promising auxiliary tool, machine learning (ML) intends to extract homologous features in large-scale data sets and encode them into various patterns to complete complicated tasks. At present, artificial intelligence and digital mining have shown promising prospects in the field of lymphoma pathological image analysis. The paradigm shift from qualitative analysis to quantitative analysis makes the pathological diagnosis more intelligent and the results more accurate and objective. ML can promote accurate lymphoma diagnosis and provide patients with prognostic information and more individualized treatment options. Based on the above, this comprehensive review of the general workflow of ML highlights recent advances in ML techniques in the diagnosis, treatment, and prognosis of lymphoma, and clarifies the boundedness and future orientation of the ML technique in the clinical practice of lymphoma.

Machine Learning Model with Texture Analysis for Automatic Classification of Histopathological Images of Ocular Adnexal Mucosa-associated Lymphoid Tissue Lymphoma of Two Different Origins

PURPOSE

The purpose of this study was to develop artificial intelligence algorithms that can distinguish between orbital and conjunctival mucosa-associated lymphoid tissue (MALT) lymphomas in pathological images.

METHODS

Tissue blocks with residual MALT lymphoma and data from histological and flow cytometric studies and molecular genetic analyses such as gene rearrangement were procured for 129 patients treated between April 2008 and April 2020. We collected pathological hematoxylin and eosin-stained (HE) images of lymphoma from these patients and cropped 10 different image patches at a resolution of 2048 × 2048 from pathological images from each patient. A total of 990 images from 99 patients were used to create and evaluate machine-learning models. Each image patch of three different magnification rates at ×4, ×20, and ×40 underwent texture analysis to extract features, and then seven different machine-learning algorithms were applied to the results to create models. Cross-validation on a patient-by-patient basis was used to create and evaluate models, and then 300 images from the remaining 30 cases were used to evaluate the average accuracy rate.

RESULTS

Ten-fold cross-validation using the support vector machine with linear kernel algorithm was identified as the best algorithm for discriminating between conjunctival mucosa-associated lymphoid tissue and orbital MALT lymphomas, with an average accuracy rate under cross-validation of 85%. There were ×20 magnification HE images that were more accurate in distinguishing orbital and conjunctival MALT lymphomas among ×4, ×20, and ×40.

CONCLUSION

Artificial intelligence algorithms can successfully distinguish HE images between orbital and conjunctival MALT lymphomas.

Recent advancements in artificial intelligence for breast cancer: Image augmentation, segmentation, diagnosis, and prognosis approaches

Breast cancer is a significant global health burden, with increasing morbidity and mortality worldwide. Early screening and accurate diagnosis are crucial for improving prognosis. Radiographic imaging modalities such as digital mammography (DM), digital breast tomosynthesis (DBT), magnetic resonance imaging (MRI), ultrasound (US), and nuclear medicine techniques, are commonly used for breast cancer assessment. And histopathology (HP) serves as the gold standard for confirming malignancy. Artificial intelligence (AI) technologies show great potential for quantitative representation of medical images to effectively assist in segmentation, diagnosis, and prognosis of breast cancer. In this review, we overview the recent advancements of AI technologies for breast cancer, including 1) improving image quality by data augmentation, 2) fast detection and segmentation of breast lesions and diagnosis of malignancy, 3) biological characterization of the cancer such as staging and subtyping by AI-based classification technologies, 4) prediction of clinical outcomes such as metastasis, treatment response, and survival by integrating multi-omics data. Then, we then summarize large-scale databases available to help train robust, generalizable, and reproducible deep learning models. Furthermore, we conclude the challenges faced by AI in real-world applications, including data curating, model interpretability, and practice regulations. Besides, we expect that clinical implementation of AI will provide important guidance for the patient-tailored management.

Artificial intelligence feasibility in veterinary medicine: A systematic review

Background and Aim

In recent years, artificial intelligence (AI) has become increasingly necessary in the life sciences, particularly medicine and healthcare. This study aimed to systematically review the literature and critically analyze multiple databases on the use of AI in veterinary medicine to assess its challenges. We aim to foster an understanding of the effects that can be approached and applied for professional awareness.

Materials and Methods

This study used multiple electronic databases with information on applied AI in veterinary medicine based on the current guidelines outlined in PRISMA and Cochrane for systematic review. The electronic databases PubMed, Embase, Google Scholar, Cochrane Library, and Elsevier were thoroughly screened through March 22, 2023. The study design was carefully chosen to emphasize evidence quality and population heterogeneity.

Results

A total of 385 of the 883 citations initially obtained were thoroughly reviewed. There were four main areas that AI addressed; the first was diagnostic issues, the second was education, animal production, and epidemiology, the third was animal health and welfare, pathology, and microbiology, and the last was all other categories. The quality assessment of the included studies found that they varied in their relative quality and risk of bias. However, AI aftereffect-linked algorithms have raised criticism of their generated conclusions.

Conclusion

Quality assessment noted areas of AI outperformance, but there was criticism of its performance as well. It is recommended that the extent of AI in veterinary medicine should be increased, but it should not take over the profession. The concept of ambient clinical intelligence is adaptive, sensitive, and responsive to the digital environment and may be attractive to veterinary professionals as a means of lowering the fear of automating veterinary medicine. Future studies should focus on an AI model with flexible data input, which can be expanded by clinicians/users to maximize their interaction with good algorithms and reduce any errors generated by the process.

Investigating the Joint Amplitude and Phase Imaging of Stained Samples in Automatic Diagnosis

The diagnosis of many diseases relies, at least on first intention, on an analysis of blood smears acquired with a microscope. However, image quality is often insufficient for the automation of such processing. A promising improvement concerns the acquisition of enriched information on samples. In particular, Quantitative Phase Imaging (QPI) techniques, which allow the digitization of the phase in complement to the intensity, are attracting growing interest. Such imaging allows the exploration of transparent objects not visible in the intensity image using the phase image only. Another direction proposes using stained images to reveal some characteristics of the cells in the intensity image; in this case, the phase information is not exploited. In this paper, we question the interest of using the bi-modal information brought by intensity and phase in a QPI acquisition when the samples are stained. We consider the problem of detecting parasitized red blood cells for diagnosing malaria from stained blood smears using a Deep Neural Network (DNN). Fourier Ptychographic Microscopy (FPM) is used as the computational microscopy framework to produce QPI images. We show that the bi-modal information enhances the detection performance by 4% compared to the intensity image only when the convolution in the DNN is implemented through a complex-based formalism. This proves that the DNN can benefit from the bi-modal enhanced information. We conjecture that these results should extend to other applications processed through QPI acquisition.

Artificial intelligence and digital pathology: clinical promise and deployment considerations

Artificial intelligence (AI) presents an opportunity in anatomic pathology to provide quantitative objective support to a traditionally subjective discipline, thereby enhancing clinical workflows and enriching diagnostic capabilities. AI requires access to digitized pathology materials, which, at present, are most commonly generated from the glass slide using whole-slide imaging. Models are developed collaboratively or sourced externally, and best practices suggest validation with internal datasets most closely resembling the data expected in practice. Although an array of AI models that provide operational support for pathology practices or improve diagnostic quality and capabilities has been described, most of them can be categorized into one or more discrete types. However, their function in the pathology workflow can vary, as a single algorithm may be appropriate for screening and triage, diagnostic assistance, virtual second opinion, or other uses depending on how it is implemented and validated. Despite the clinical promise of AI, the barriers to adoption have been numerous, to which inclusion of new stakeholders and expansion of reimbursement opportunities may be among the most impactful solutions.

Artificial intelligence in digital pathology of cutaneous lymphomas: a review of the current state and future perspectives

Primary cutaneous lymphomas (CLs) represent a heterogeneous group of T-cell lymphomas and B-cell lymphomas that present in the skin without evidence of extracutaneous involvement at time of diagnosis. CLs are largely distinct from their systemic counterparts in clinical presentation, histopathology, and biological behavior and, therefore, require different therapeutic management. Additional diagnostic burden is added by the fact that several benign inflammatory dermatoses mimic CL subtypes, requiring clinicopathological correlation for definitive diagnosis. Due to the heterogeneity and rarity of CL, adjunct diagnostic tools are welcomed, especially by pathologists without expertise in this field or with limited access to a centralized specialist panel. The transition into digital pathology workflows enables artificial intelligence (AI)-based analysis of patients' whole-slide pathology images (WSIs). AI can be used to automate manual processes in histopathology but, more importantly, can be applied to complex diagnostic tasks, especially suitable for rare disease like CL. To date, AI-based applications for CL have been minimally explored in literature. However, in other skin cancers and systemic lymphomas, disciplines that are recognized here as the building blocks for CLs, several studies demonstrated promising results using AI for disease diagnosis and subclassification, cancer detection, specimen triaging, and outcome prediction. Additionally, AI allows discovery of novel biomarkers or may help to quantify established biomarkers. This review summarizes and blends applications of AI in pathology of skin cancer and lymphoma and proposes how these findings can be applied to diagnostics of CL.

Application of Artificial Intelligence in the Diagnosis, Treatment, and Prognostic Evaluation of Mediastinal Malignant Tumors

Artificial intelligence (AI), also known as machine intelligence, is widely utilized in the medical field, promoting medical advances. Malignant tumors are the critical focus of medical research and improvement of clinical diagnosis and treatment. Mediastinal malignancy is an important tumor that attracts increasing attention today due to the difficulties in treatment. Combined with artificial intelligence, challenges from drug discovery to survival improvement are constantly being overcome. This article reviews the progress of the use of AI in the diagnosis, treatment, and prognostic prospects of mediastinal malignant tumors based on current literature findings.

Artificial Intelligence in Bone Marrow Histological Diagnostics: Potential Applications and Challenges

The expanding digitalization of routine diagnostic histological slides holds a potential to apply artificial intelligence (AI) to pathology, including bone marrow (BM) histology. In this perspective, we describe potential tasks in diagnostics that can be supported, investigations that can be guided, and questions that can be answered by the future application of AI on whole-slide images of BM biopsies. These range from characterization of cell lineages and quantification of cells and stromal structures to disease prediction. First glimpses show an exciting potential to detect subtle phenotypic changes with AI that are due to specific genotypes. The discussion is illustrated by examples of current AI research using BM biopsy slides. In addition, we briefly discuss current challenges for implementation of AI-supported diagnostics.

An Automated Pipeline for Differential Cell Counts on Whole-Slide Bone Marrow Aspirate Smears

The pathologic diagnosis of bone marrow disorders relies in part on the microscopic analysis of bone marrow aspirate (BMA) smears and the manual counting of marrow nucleated cells to obtain a differential cell count (DCC). This manual process has significant limitations, including the analysis of only a small subset of optimal slide areas and nucleated cells, as well as interobserver variability due to differences in cell selection and classification. To address these shortcomings, we developed an automated machine learning-based pipeline for obtaining 11-component DCCs on whole-slide BMAs. This pipeline uses a sequential process of identifying optimal BMA regions with high proportions of marrow nucleated cells, detecting individual cells within these optimal areas, and classifying these cells into 1 of 11 DCC components. Convolutional neural network models were trained on 396,048 BMA region, 28,914 cell boundary, and 1,510,976 cell class images from manual annotations. The resulting automated pipeline produced 11-component DCCs that demonstrated a high statistical and diagnostic concordance with manual DCCs among a heterogeneous group of testing BMA slides with varying pathologies and cellularities. Additionally, we demonstrated that an automated analysis can reduce the intraslide variance in DCCs by analyzing the whole slide and marrow nucleated cells within all optimal regions. Finally, the pipeline outputs of region classification, cell detection, and cell classification can be visualized using whole-slide image analysis software. This study demonstrates the feasibility of a fully automated pipeline for generating DCCs on scanned whole-slide BMA images, with the potential for improving the current standard of practice for utilizing BMA smears in the laboratory analysis of hematologic disorders.

Automatic generation of artificial images of leukocytes and leukemic cells using generative adversarial networks (syntheticcellgan)

BACKGROUND AND OBJECTIVES

Visual analysis of cell morphology has an important role in the diagnosis of hematological diseases. Morphological cell recognition is a challenge that requires experience and in-depth review by clinical pathologists. Within the new trend of introducing computer-aided diagnostic tools in laboratory medicine, models based on deep learning are being developed for the automatic identification of different types of cells in peripheral blood. In general, well-annotated large image sets are needed to train the models to reach a desired classification performance. This is especially relevant when it comes to discerning between cell images in which morphological differences are subtle and when it comes to low prevalent diseases with the consequent difficulty in collecting cell images. The objective of this work is to develop, train and validate SyntheticCellGAN (SCG), a new system for the automatic generation of artificial images of white blood cells, maintaining morphological characteristics very close to real cells found in practice in clinical laboratories.

METHODS

SCG is designed with two sequential generative adversarial networks. First, a Wasserstein structure is used to transform random noise vectors into low resolution images of basic mononuclear cells. Second, the concept of image-to-image translation is used to build specific models that transform the basic images into high-resolution final images with the realistic morphology of each cell type target: 1) the five groups of normal leukocytes (lymphocytes, monocytes, eosinophils, neutrophils and basophils); 2) atypical promyelocytes and hairy cells, which are two relevant cell types of complex morphology with low abundance in blood smears.

RESULTS

The images of the SCG system are evaluated with four experimental tests. In the first test we evaluated the generated images with quantitative metrics for GANs. In the second test, morphological verification of the artificial images is performed by expert clinical pathologists with 100% accuracy. In the third test, two classifiers based on convolutional neural networks (CNN) previously trained with images of real cells are used. Two sets of artificial images of the SCG system are classified with an accuracy of 95.36% and 94%, respectively. In the fourth test, three CNN classifiers are trained with artificial images of the SCG system. Real cells are identified with an accuracy ranging from 87.7% to 100%.

CONCLUSIONS

The SCG system has proven effective in creating images of all normal leukocytes and two low-prevalence cell classes associated with diseases such as acute promyelocyte leukemia and hairy cell leukemia. Once trained, the system requires low computational cost and can help augment high-quality image datasets to improve automatic recognition model training for clinical laboratory practice.

Phenotyping senescent mesenchymal stromal cells using AI image translation

Mesenchymal stromal cells (MSCs) offer promising potential in biomedical research, clinical therapeutics, and immunomodulatory therapies due to their ease of isolation and multipotent, immunoprivileged, and immunosuppersive properties. Extensive efforts have focused on optimizing the cell isolation and culture methods to generate scalable, therapeutically-relevant MSCs for clinical applications. However, MSC-based therapies are often hindered by cell heterogeneity and inconsistency of therapeutic function caused, in part, by MSC senescence. As such, noninvasive and molecular-based MSC characterizations play an essential role in assuring the consistency of MSC functions. Here, we demonstrated that AI image translation algorithms can effectively predict immunofluorescence images of MSC senescence markers from phase contrast images. We showed that the expression level of senescence markers including senescence-associated beta-galactosidase (SABG), p16, p21, and p38 are accurately predicted by deep-learning models for Doxorubicin-induced MSC senescence, irradiation-induced MSC senescence, and replicative MSC senescence. Our AI model distinguished the non-senescent and senescent MSC populations and simultaneously captured the cell-to-cell variability within a population. Our microscopy-based phenotyping platform can be integrated with cell culture routines making it an easily accessible tool for MSC engineering and manufacturing.

Identification of prognostic factors in classic Hodgkin lymphoma by integrating whole slide imaging and next generation sequencing

Digital pathology and genomics are increasingly used to improve our understanding of lymphoid neoplasms. Algorithms for quantifying cell populations in the lymph node and genetics can be integrated to identify new biomarkers with prognostic impact in classic Hodgkin lymphoma (cHL). In 16 cHL patients, we have performed whole slide imaging (WSI) analysis and quantification of CD30+, CD20+, CD3+ and MUM1+ cells in whole tissue slides, and Next Generation Sequencing (NGS) in formalin fixed paraffin-embedded (FFPE) tissue, using a widely used NSG panel (Oncomine® Focus Assay) to define genetic variants underlying tumor development. The different cell populations could be successfully identified in scanned slides of cHL, supporting the inclusion of WSI in the histopathological evaluation of cHL as an adequate method for the quantification of different cell populations. We also performed genetic profiling in FFPE samples of cHL leading to the identification of copy number variations in the Neurofibromin 1 gene (17q11.2) and the Androgen Receptor gene (Xq12) accompanied by chromosomal gains and losses in CDK4, KRAS and FGFR2 genes. Progression-free survival (PFS) was statistically significantly higher in cHL patients with amplification in the NF1 gene combined with CD3+ cells above 28.6% (p = 0.006) and MUM1+ cells above 21.8% (p < 0.001). Moreover, patients with MUM1+ cells above 21.8% showed a statistically significantly higher PFS when combined with amplification of the AR gene (p < 0.001) and wild-type KRAS (p < 0.001). The integration of WSI analysis and DNA sequencing could be useful to improve our understanding of the biology of cHL and define risk subgroups.

Artificial Intelligence in Breast Cancer Screening and Diagnosis

Cancer is a disease that continues to plague our modern society. Among all types of cancer, breast cancer is now the most common type of cancer occurring in women worldwide. Various factors, including genetics, lifestyle, and the environment, have contributed to the rise in the prevalence of breast cancer among women of all socioeconomic strata. Therefore, proper screening for early diagnosis and treatment becomes a major factor when fighting the disease. Artificial intelligence (AI) continues to revolutionize various spheres of our lives with its numerous applications. Using AI in the existing screening process makes obtaining results even easier and more convenient. Faster, more accurate results are some of the benefits of AI methods in breast cancer screening. Nonetheless, there are many challenges in the process of the integration of AI that needs to be addressed systematically. The following is a review of the application of AI in breast cancer screening.

Accurate classification of white blood cells by coupling pre-trained ResNet and DenseNet with SCAM mechanism

BACKGROUND

Via counting the different kinds of white blood cells (WBCs), a good quantitative description of a person's health status is obtained, thus forming the critical aspects for the early treatment of several diseases. Thereby, correct classification of WBCs is crucial. Unfortunately, the manual microscopic evaluation is complicated, time-consuming, and subjective, so its statistical reliability becomes limited. Hence, the automatic and accurate identification of WBCs is of great benefit. However, the similarity between WBC samples and the imbalance and insufficiency of samples in the field of medical computer vision bring challenges to intelligent and accurate classification of WBCs. To tackle these challenges, this study proposes a deep learning framework by coupling the pre-trained ResNet and DenseNet with SCAM (spatial and channel attention module) for accurately classifying WBCs.

RESULTS

In the proposed network, ResNet and DenseNet enables information reusage and new information exploration, respectively, which are both important and compatible for learning good representations. Meanwhile, the SCAM module sequentially infers attention maps from two separate dimensions of space and channel to emphasize important information or suppress unnecessary information, further enhancing the representation power of our model for WBCs to overcome the limitation of sample similarity. Moreover, the data augmentation and transfer learning techniques are used to handle the data of imbalance and insufficiency. In addition, the mixup approach is adopted for modeling the vicinity relation across training samples of different categories to increase the generalizability of the model. By comparing with five representative networks on our developed LDWBC dataset and the publicly available LISC, BCCD, and Raabin WBC datasets, our model achieves the best overall performance. We also implement the occlusion testing by the gradient-weighted class activation mapping (Grad-CAM) algorithm to improve the interpretability of our model.

CONCLUSION

The proposed method has great potential for application in intelligent and accurate classification of WBCs.

A Review of Artificial Intelligence Applications in Hematology Management: Current Practices and Future Prospects

Background

Machine learning (ML) and deep learning (DL) methods have recently garnered a great deal of attention in the field of cancer research by making a noticeable contribution to the growth of predictive medicine and modern oncological practices. Considerable focus has been particularly directed toward hematologic malignancies because of the complexity in detecting early symptoms. Many patients with blood cancer do not get properly diagnosed until their cancer has reached an advanced stage with limited treatment prospects. Hence, the state-of-the-art revolves around the latest artificial intelligence (AI) applications in hematology management.

Objective

This comprehensive review provides an in-depth analysis of the current AI practices in the field of hematology. Our objective is to explore the ML and DL applications in blood cancer research, with a special focus on the type of hematologic malignancies and the patient’s cancer stage to determine future research directions in blood cancer.

Methods

We searched a set of recognized databases (Scopus, Springer, and Web of Science) using a selected number of keywords. We included studies written in English and published between 2015 and 2021. For each study, we identified the ML and DL techniques used and highlighted the performance of each model.

Results

Using the aforementioned inclusion criteria, the search resulted in 567 papers, of which 144 were selected for review.

Conclusions

The current literature suggests that the application of AI in the field of hematology has generated impressive results in the screening, diagnosis, and treatment stages. Nevertheless, optimizing the patient’s pathway to treatment requires a prior prediction of the malignancy based on the patient’s symptoms or blood records, which is an area that has still not been properly investigated.

A Deep Learning Approach for the Morphological Recognition of Reactive Lymphocytes in Patients with COVID-19 Infection

Laboratory medicine plays a fundamental role in the detection, diagnosis and management of COVID-19 infection. Recent observations of the morphology of cells circulating in blood found the presence of particular reactive lymphocytes (COVID-19 RL) in some of the infected patients and demonstrated that it was an indicator of a better prognosis of the disease. Visual morphological analysis is time consuming, requires smear review by expert clinical pathologists, and is prone to subjectivity. This paper presents a convolutional neural network system designed for automatic recognition of COVID-19 RL. It is based on the Xception71 structure and is trained using images of blood cells from real infected patients. An experimental study is carried out with a group of 92 individuals. The input for the system is a set of images selected by the clinical pathologist from the blood smear of a patient. The output is the prediction whether the patient belongs to the group associated with better prognosis of the disease. A threshold is obtained for the classification system to predict that the smear belongs to this group. With this threshold, the experimental test shows excellent performance metrics: 98.3% sensitivity and precision, 97.1% specificity, and 97.8% accuracy. The system does not require costly calculations and can potentially be integrated into clinical practice to assist clinical pathologists in a more objective smear review for early prognosis.

Chronic Lymphocytic Leukemia Progression Diagnosis with Intrinsic Cellular Patterns via Unsupervised Clustering

Simple Summary

Distinguishing between chronic lymphocytic leukemia (CLL), accelerated CLL (aCLL), and full-blown transformation to diffuse large B-cell lymphoma (Richter transformation; RT) has significant clinical implications. Identifying cellular phenotypes via unsupervised clustering provides the most robust analytic performance in analyzing digitized pathology slides. This study serves as a proof of concept that using an unsupervised machine learning scheme can enhance diagnostic accuracy.

Abstract

Identifying the progression of chronic lymphocytic leukemia (CLL) to accelerated CLL (aCLL) or transformation to diffuse large B-cell lymphoma (Richter transformation; RT) has significant clinical implications as it prompts a major change in patient management. However, the differentiation between these disease phases may be challenging in routine practice. Unsupervised learning has gained increased attention because of its substantial potential in data intrinsic pattern discovery. Here, we demonstrate that cellular feature engineering, identifying cellular phenotypes via unsupervised clustering, provides the most robust analytic performance in analyzing digitized pathology slides (accuracy = 0.925, AUC = 0.978) when compared to alternative approaches, such as mixed features, supervised features, unsupervised/mixed/supervised feature fusion and selection, as well as patch-based convolutional neural network (CNN) feature extraction. We further validate the reproducibility and robustness of unsupervised feature extraction via stability and repeated splitting analysis, supporting its utility as a diagnostic aid in identifying CLL patients with histologic evidence of disease progression. The outcome of this study serves as proof of principle using an unsupervised machine learning scheme to enhance the diagnostic accuracy of the heterogeneous histology patterns that pathologists might not easily see.

Gain of Chromosome 6p Correlates with Severe Anaplasia, Cellular Hyperchromasia, and Extraocular Spread of Retinoblastoma

PURPOSE

Gain of chromosome 6p has been associated with poor ocular survival in retinoblastoma and histopathologic grading of anaplasia with increased risk of metastatic spread and death. This study examined the correlation between these factors and other chromosomal abnormalities as well as results of whole genome sequencing, digital morphometry, and progression-free survival.

DESIGN

Retrospective cohort study from 2 United States tertiary referral centers.

PARTICIPANTS

Forty-two children who had undergone enucleation for retinoblastoma from January 2000 through December 2017.

METHODS

Status of chromosomes 6p, 1q, 9q, and 16q was evaluated with fluorescence in situ hybridization, the degree of anaplasia and presence of histologic high-risk features were assessed by ocular pathologists, digital morphometry was performed on scanned tumor slides, and whole genome sequencing was performed on a subset of tumors. Progression-free survival was defined as absence of distant or local metastases or tumor growth beyond the cut end of the optic nerve.

MAIN OUTCOME MEASURES

Correlation between each of chromosomal abnormalities, anaplasia, morphometry and sequencing results, and survival.

RESULTS

Forty-one of 42 included patients underwent primary enucleation and 1 was treated first with intra-arterial chemotherapy. Seven tumors showed mild anaplasia, 19 showed moderate anaplasia, and 16 showed severe anaplasia. All tumors had gain of 1q, 18 tumors had gain of 6p, 6 tumors had gain of 9q, and 36 tumors had loss of 16q. Tumors with severe anaplasia were significantly more likely to harbor 6p gains than tumors with nonsevere anaplasia (P < 0.001). Further, the hematoxylin staining intensity was significantly greater and that of eosin staining significantly lower in tumors with severe anaplasia (P < 0.05). Neither severe anaplasia (P = 0.10) nor gain of 6p (P = 0.21) correlated with histologic high-risk features, and severe anaplasia did not correlate to RB1, CREBBP, NSD1, or BCOR mutations in a subset of 14 tumors (P > 0.5). Patients with gain of 6p showed significantly shorter progression-free survival (P = 0.03, Wilcoxon test).

CONCLUSIONS

Gain of chromosome 6p emerges as a strong prognostic biomarker in retinoblastoma because it correlates with severe anaplasia, quantifiable changes in tumor cell staining characteristics, and extraocular spread.

Atypical lymphoid cells circulating in blood in COVID-19 infection: morphology, immunophenotype and prognosis value

AIMS

Atypical lymphocytes circulating in blood have been reported in COVID-19 patients. This study aims to (1) analyse if patients with reactive lymphocytes (COVID-19 RL) show clinical or biological characteristics related to outcome; (2) develop an automatic system to recognise them in an objective way and (3) study their immunophenotype.

METHODS

Clinical and laboratory findings in 36 COVID-19 patients were compared between those showing COVID-19 RL in blood (18) and those without (18). Blood samples were analysed in Advia2120i and stained with May Grünwald-Giemsa. Digital images were acquired in CellaVisionDM96. Convolutional neural networks (CNNs) were used to accurately recognise COVID-19 RL. Immunophenotypic study was performed throughflow cytometry.

RESULTS

Neutrophils, D-dimer, procalcitonin, glomerular filtration rate and total protein values were higher in patients without COVID-19 RL (p<0.05) and four of these patients died. Haemoglobin and lymphocyte counts were higher (p<0.02) and no patients died in the group showing COVID-19 RL. COVID-19 RL showed a distinct deep blue cytoplasm with nucleus mostly in eccentric position. Through two sequential CNNs, they were automatically distinguished from normal lymphocytes and classical RL with sensitivity, specificity and overall accuracy values of 90.5%, 99.4% and 98.7%, respectively. Immunophenotypic analysis revealed COVID-19 RL are mostly activated effector memory CD4 and CD8 T cells.

CONCLUSION

We found that COVID-19 RL are related to a better evolution and prognosis. They can be detected by morphology in the smear review, being the computerised approach proposed useful to enhance a more objective recognition. Their presence suggests an abundant production of virus-specific T cells, thus explaining the better outcome of patients showing these cells circulating in blood.

Deep learning in cancer diagnosis, prognosis and treatment selection

Deep learning is a subdiscipline of artificial intelligence that uses a machine learning technique called artificial neural networks to extract patterns and make predictions from large data sets. The increasing adoption of deep learning across healthcare domains together with the availability of highly characterised cancer datasets has accelerated research into the utility of deep learning in the analysis of the complex biology of cancer. While early results are promising, this is a rapidly evolving field with new knowledge emerging in both cancer biology and deep learning. In this review, we provide an overview of emerging deep learning techniques and how they are being applied to oncology. We focus on the deep learning applications for omics data types, including genomic, methylation and transcriptomic data, as well as histopathology-based genomic inference, and provide perspectives on how the different data types can be integrated to develop decision support tools. We provide specific examples of how deep learning may be applied in cancer diagnosis, prognosis and treatment management. We also assess the current limitations and challenges for the application of deep learning in precision oncology, including the lack of phenotypically rich data and the need for more explainable deep learning models. Finally, we conclude with a discussion of how current obstacles can be overcome to enable future clinical utilisation of deep learning.

Artificial intelligence strategy integrating morphologic and architectural biomarkers provides robust diagnostic accuracy for disease progression in chronic lymphocytic leukemia

Artificial intelligence-based tools designed to assist in the diagnosis of lymphoid neoplasms remain limited. The development of such tools can add value as a diagnostic aid in the evaluation of tissue samples involved by lymphoma. A common diagnostic question is the determination of chronic lymphocytic leukemia (CLL) progression to accelerated CLL (aCLL) or transformation to diffuse large B-cell lymphoma (Richter transformation; RT) in patients who develop progressive disease. The morphologic assessment of CLL, aCLL, and RT can be diagnostically challenging. Using established diagnostic criteria of CLL progression/transformation, we designed four artificial intelligence-constructed biomarkers based on cytologic (nuclear size and nuclear intensity) and architectural (cellular density and cell to nearest-neighbor distance) features. We analyzed the predictive value of implementing these biomarkers individually and then in an iterative sequential manner to distinguish tissue samples with CLL, aCLL, and RT. Our model, based on these four morphologic biomarker attributes, achieved a robust analytic accuracy. This study suggests that biomarkers identified using artificial intelligence-based tools can be used to assist in the diagnostic evaluation of tissue samples from patients with CLL who develop aggressive disease features. © 2021 The Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

How artificial intelligence might disrupt diagnostics in hematology in the near future

Artificial intelligence (AI) is about to make itself indispensable in the health care sector. Examples of successful applications or promising approaches range from the application of pattern recognition software to pre-process and analyze digital medical images, to deep learning algorithms for subtype or disease classification, and digital twin technology and in silico clinical trials. Moreover, machine-learning techniques are used to identify patterns and anomalies in electronic health records and to perform ad-hoc evaluations of gathered data from wearable health tracking devices for deep longitudinal phenotyping. In the last years, substantial progress has been made in automated image classification, reaching even superhuman level in some instances. Despite the increasing awareness of the importance of the genetic context, the diagnosis in hematology is still mainly based on the evaluation of the phenotype. Either by the analysis of microscopic images of cells in cytomorphology or by the analysis of cell populations in bidimensional plots obtained by flow cytometry. Here, AI algorithms not only spot details that might escape the human eye, but might also identify entirely new ways of interpreting these images. With the introduction of high-throughput next-generation sequencing in molecular genetics, the amount of available information is increasing exponentially, priming the field for the application of machine learning approaches. The goal of all the approaches is to allow personalized and informed interventions, to enhance treatment success, to improve the timeliness and accuracy of diagnoses, and to minimize technically induced misclassifications. The potential of AI-based applications is virtually endless but where do we stand in hematology and how far can we go?

Translational Applications of Artificial Intelligence and Machine Learning for Diagnostic Pathology in Lymphoid Neoplasms: A Comprehensive and Evolutive Analysis

Genomic analysis and digitalization of medical records have led to a big data scenario within hematopathology. Artificial intelligence and machine learning tools are increasingly used to integrate clinical, histopathological, and genomic data in lymphoid neoplasms. In this study, we identified global trends, cognitive, and social framework of this field from 1990 to 2020. Metadata were obtained from the Clarivate Analytics Web of Science database in January 2021. A total of 525 documents were assessed by document type, research areas, source titles, organizations, and countries. SciMAT and VOSviewer package were used to perform scientific mapping analysis. Geographical distribution showed the USA and People's Republic of China as the most productive countries, reporting up to 190 (36.19%) of all documents. A third-degree polynomic equation predicts that future global production in this area will be three-fold the current number, near 2031. Thematically, current research is focused on the integration of digital image analysis and genomic sequencing in Non-Hodgkin lymphomas, prediction of chemotherapy response and validation of new prognostic models. These findings can serve pathology departments to depict future clinical and research avenues, but also, public institutions and administrations to promote synergies and optimize funding allocation.

A benchmark bone marrow aspirate smear dataset and a multi-scale cell detection model for the diagnosis of hematological disorders

Research on pathological diagnosis of hematopoietic disorders based on bone marrow aspirate smear images has attracted more and more attention with the development of deep learning methods. However, high quality bone marrow aspirate smear image datasets are not readily available because of the time, the efforts, and the medical knowledge required in the acquisition and manual annotation images. In order to facilitate the research of automated diagnosis of hematological disorders, we constructed a high quality Bone Marrow Aspirate Smear Image Dataset (BMASID), which contains 230 bone marrow aspirate smear images, all with the corresponding labeled images. We used additional clinical images as testing data, which are more challenging because of image noise, cell overlap, cell adhesion, blurred borders of cells and ambiguous types of cells. We also proposed a Cell Recognition Network (CRNet) that was trained on this benchmark dataset. CRNet is comprised of a cell detector to locate and recognize cells in the bone marrow aspirate images, and a cell classifier to classify the types of cells. New anchors and novel evaluation metrics are proposed and applied in CRNet. Benchmark evaluations of the proposed CRNet demonstrated the satisfactory performance of our state-of-the-art methods. Experimental results show that the detection precision by detector is more than 83%, and it is better when compared with other detection methods. After the cell type confirmation by the cell classifier, the precision is more than 95%. Compared with the most popular evaluation metrics Intersection over Union (IoU) and the newly proposed Generalized Intersection over Union (GIoU) used in the object detection benchmarks, our evaluation metrics are more suitable for the cell detection task with ambiguous cell boundaries. The proposed bone marrow aspirate smear image dataset and the proposed evaluation metrics can be used in the training and the evaluation of cell detection models, which contributes to future research in the pathological analysis and auxiliary diagnostic methods of hematological disorders. The codes are available at: https://github.com/SuJie-Med/hematolgical-disorders.

Application of Single-Cell Approaches to Study Myeloproliferative Neoplasm Biology

Philadelphia-negative myeloproliferative neoplasms (MPNs) are an excellent tractable disease model of a number of aspects of human cancer biology, including genetic evolution, tissue-associated fibrosis, and cancer stem cells. In this review, we discuss recent insights into MPN biology gained from the application of a number of new single-cell technologies to study human disease, with a specific focus on single-cell genomics, single-cell transcriptomics, and digital pathology.

A deep learning model (ALNet) for the diagnosis of acute leukaemia lineage using peripheral blood cell images

BACKGROUND AND OBJECTIVES

Morphological differentiation among blasts circulating in blood in acute leukaemia is challenging. Artificial intelligence decision support systems hold substantial promise as part of clinical practise in detecting haematological malignancy. This study aims to develop a deep learning-based system to predict the diagnosis of acute leukaemia using blood cell images.

METHODS

A set of 731 blood smears containing 16,450 single-cell images was analysed from 100 healthy controls, 191 patients with viral infections and 148 with acute leukaemia. Training and testing sets were arranged with 85% and 15% of these smears, respectively. To find the best architecture for acute leukaemia classification VGG16, ResNet101, DenseNet121 and SENet154 were evaluated. Fine-tuning was implemented to these pre-trained CNNs to adapt their layers to our data. Once the best architecture was chosen, a system with two modules working sequentially was configured (ALNet). The first module recognised abnormal promyelocytes among other mononuclear blood cell images, such as lymphocytes, monocytes, reactive lymphocytes and blasts. The second distinguished if blasts were myeloid or lymphoid lineage. The final strategy was to predict patients' initial diagnosis of acute leukaemia lineage using the blood smear review. ALNet was assessed with smears of the testing set.

RESULTS

ALNet provided the correct diagnostic prediction of all patients with promyelocytic and myeloid leukaemia. Sensitivity, specificity and precision values of 100%, 92.3% and 93.7%, respectively, were obtained for myeloid leukaemia. Regarding lymphoid leukaemia, a sensitivity of 89% and specificity and precision values of 100% were obtained.

CONCLUSIONS

ALNet is a predictive model designed with two serially connected convolutional networks. It is proposed to assist clinical pathologists in the diagnosis of acute leukaemia during the blood smear review. It has been proved to distinguish neoplastic (leukaemia) and non-neoplastic (infections) diseases, as well as recognise the leukaemia lineage.

Developing and Preliminary Validating an Automatic Cell Classification System for Bone Marrow Smears: a Pilot Study

Bone marrow smear examination is an indispensable diagnostic tool in the evaluation of hematological diseases, but the process of manual differential count is labor extensive. In this study, we developed an automatic system with integrated scanning hardware and machine learning-based software to perform differential cell count on bone marrow smears to assist diagnosis. The initial development of the artificial neural network was based on 3000 marrow smear samples retrospectively archived from Sir Run Run Shaw Hospital affiliated to Zhejiang University School of Medicine between June 2016 and December 2018. The preliminary field validating test of the system was based on 124 marrow smears newly collected from the Second Affiliated Hospital of Harbin Medical University between April 2019 and November 2019. The study was performed in parallel of machine automatic recognition with conventional manual differential count by pathologists using the microscope. We selected representative 600,000 marrow cell images as training set of the algorithm, followed by random captured 30,867 cell images for validation. In validation, the overall accuracy of automatic cell classification was 90.1% (95% CI, 89.8-90.5%). In a preliminary field validating test, the reliability coefficient (ICC) of cell series proportion between the two analysis methods were high (ICC ≥ 0.883, P < 0.0001) and the results by the two analysis methods were consistent for granulocytes and erythrocytes. The system was effective in cell classification and differential cell count on marrow smears. It provides a useful digital tool in the screening and evaluation of various hematological disorders.

A bird's-eye view of deep learning in bioimage analysis

Deep learning of artificial neural networks has become the de facto standard approach to solving data analysis problems in virtually all fields of science and engineering. Also in biology and medicine, deep learning technologies are fundamentally transforming how we acquire, process, analyze, and interpret data, with potentially far-reaching consequences for healthcare. In this mini-review, we take a bird's-eye view at the past, present, and future developments of deep learning, starting from science at large, to biomedical imaging, and bioimage analysis in particular.