A Hematologist-Level Deep Learning Algorithm (BMSNet) for Assessing the Morphologies of Single Nuclear Balls in Bone Marrow Smears: Algorithm Development

Artificial intelligence interpretation of touch print smear cytology of testicular specimen from patients with azoospermia

PURPOSE

Identification of mature sperm at microdissection testicular sperm extraction (mTESE) is a crucial step of sperm retrieval to help patients with non-obstructive azoospermia (NOA) proceed to intracytoplasmic sperm injection. Touch print smear (TPS) cytology allows immediate interpretation and prompt sperm identification intraoperatively. In this study, we leverage machine learning (ML) to facilitate TPS reading and conquer the learning curve for new operators.

MATERIALS AND METHODS

One hundred seventy-six microscopic TPS images from the testicular specimen of patients with azoospermia at Taipei Veterans General Hospital were retrospectively collected, including categories of Sertoli cell, primary spermatocytes, round spermatids, elongated spermatids, immature sperm, and mature sperm. Among them, 118 images were assigned as the training set and 29 images as the validation set. RetinaNet (Lin et al. in IEEE Trans Pattern Anal Mach Intell. 42:318-327, 2020), a one-stage detection framework, was adopted for cell detection. The performance was evaluated at the cell level with average precision (AP) and recall, and the precision-recall (PR) curve was displayed among an independent testing set that contains 29 images that aim to assess the model.

RESULTS

The training set consisted of 4772 annotated cells, including 1782 Sertoli cells, 314 primary spermatocytes, 443 round spermatids, 279 elongated spermatids, 504 immature sperm, and 1450 mature sperm. This study demonstrated the performance of each category and the overall AP and recall on the validation set, which were 80.47% and 96.69%. The overall AP and recall were 79.48% and 93.63% on the testing set, while increased to 85.29% and 93.80% once the post-meiotic cells were merged into one category.

CONCLUSIONS

This study proposed an innovative approach that leveraged ML methods to facilitate the diagnosis of spermatogenesis at mTESE for patients with NOA. With the assistance of ML techniques, surgeons could determine the stages of spermatogenesis and provide timely histopathological diagnosis for infertile males.

Recent advancements in machine learning for bone marrow cell morphology analysis

As machine learning progresses, techniques such as neural networks, decision trees, and support vector machines are being increasingly applied in the medical domain, especially for tasks involving large datasets, such as cell detection, recognition, classification, and visualization. Within the domain of bone marrow cell morphology analysis, deep learning offers substantial benefits due to its robustness, ability for automatic feature learning, and strong image characterization capabilities. Deep neural networks are a machine learning paradigm specifically tailored for image processing applications. Artificial intelligence serves as a potent tool in supporting the diagnostic process of clinical bone marrow cell morphology. Despite the potential of artificial intelligence to augment clinical diagnostics in this domain, manual analysis of bone marrow cell morphology remains the gold standard and an indispensable tool for identifying, diagnosing, and assessing the efficacy of hematologic disorders. However, the traditional manual approach is not without limitations and shortcomings, necessitating, the exploration of automated solutions for examining and analyzing bone marrow cytomorphology. This review provides a multidimensional account of six bone marrow cell morphology processes: automated bone marrow cell morphology detection, automated bone marrow cell morphology segmentation, automated bone marrow cell morphology identification, automated bone marrow cell morphology classification, automated bone marrow cell morphology enumeration, and automated bone marrow cell morphology diagnosis. Highlighting the attractiveness and potential of machine learning systems based on bone marrow cell morphology, the review synthesizes current research and recent advances in the application of machine learning in this field. The objective of this review is to offer recommendations to hematologists for selecting the most suitable machine learning algorithms to automate bone marrow cell morphology examinations, enabling swift and precise analysis of bone marrow cytopathic trends for early disease identification and diagnosis. Furthermore, the review endeavors to delineate potential future research avenues for machine learning-based applications in bone marrow cell morphology analysis.

Integrating AI and ML in Myelodysplastic Syndrome Diagnosis: State-of-the-Art and Future Prospects

Myelodysplastic syndrome (MDS) is composed of diverse hematological malignancies caused by dysfunctional stem cells, leading to abnormal hematopoiesis and cytopenia. Approximately 30% of MDS cases progress to acute myeloid leukemia (AML), a more aggressive disease. Early detection is crucial to intervene before MDS progresses to AML. The current diagnostic process for MDS involves analyzing peripheral blood smear (PBS), bone marrow sample (BMS), and flow cytometry (FC) data, along with clinical patient information, which is labor-intensive and time-consuming. Recent advancements in machine learning offer an opportunity for faster, automated, and accurate diagnosis of MDS. In this review, we aim to provide an overview of the current applications of AI in the diagnosis of MDS and highlight their advantages, disadvantages, and performance metrics.

Improved YOLOv7 Algorithm for Detecting Bone Marrow Cells

The detection and classification of bone marrow (BM) cells is a critical cornerstone for hematology diagnosis. However, the low accuracy caused by few BM-cell data samples, subtle difference between classes, and small target size, pathologists still need to perform thousands of manual identifications daily. To address the above issues, we propose an improved BM-cell-detection algorithm in this paper, called YOLOv7-CTA. Firstly, to enhance the model's sensitivity to fine-grained features, we design a new module called CoTLAN in the backbone network to enable the model to perform long-term modeling between target feature information. Then, in order to cooperate with the CoTLAN module to pay more attention to the features in the area to be detected, we integrate the coordinate attention (CoordAtt) module between the CoTLAN modules to improve the model's attention to small target features. Finally, we cluster the target boxes of the BM cell dataset based on K-means++ to generate more suitable anchor boxes, which accelerates the convergence of the improved model. In addition, in order to solve the imbalance between positive and negative samples in BM-cell pictures, we use the Focal loss function to replace the multi-class cross entropy. Experimental results demonstrate that the best mean average precision (mAP) of the proposed model reaches 88.6%, which is an improvement of 12.9%, 8.3%, and 6.7% compared with that of the Faster R-CNN model, YOLOv5l model, and YOLOv7 model, respectively. This verifies the effectiveness and superiority of the YOLOv7-CTA model in BM-cell-detection tasks.

Cell projection plots: A novel visualization of bone marrow aspirate cytology

Deep models for cell detection have demonstrated utility in bone marrow cytology, showing impressive results in terms of accuracy and computational efficiency. However, these models have yet to be implemented in the clinical diagnostic workflow. Additionally, the metrics used to evaluate cell detection models are not necessarily aligned with clinical goals and targets. In order to address these issues, we introduce novel, automatically generated visual summaries of bone marrow aspirate specimens called cell projection plots (CPPs). Encompassing relevant biological patterns such as neutrophil maturation, CPPs provide a compact summary of bone marrow aspirate cytology. To gauge clinical relevance, CPPs were inspected by 3 hematopathologists, who decided whether corresponding diagnostic synopses matched with generated CPPs. Pathologists were able to match CPPs to the correct synopsis with a matching degree of 85%. Our finding suggests CPPs can represent clinically relevant information from bone marrow aspirate specimens and may be used to efficiently summarize bone marrow cytology to pathologists. CPPs could be a step toward human-centered implementation of artificial intelligence (AI) in hematopathology, and a basis for a diagnostic-support tool for digital pathology workflows.

High-accuracy morphological identification of bone marrow cells using deep learning-based Morphogo system

Accurate identification and classification of bone marrow (BM) nucleated cell morphology are crucial for the diagnosis of hematological diseases. However, the subjective and time-consuming nature of manual identification by pathologists hinders prompt diagnosis and patient treatment. To address this issue, we developed Morphogo, a convolutional neural network-based system for morphological examination. Morphogo was trained using a vast dataset of over 2.8 million BM nucleated cell images. Its performance was evaluated using 508 BM cases that were categorized into five groups based on the degree of morphological abnormalities, comprising a total of 385,207 BM nucleated cells. The results demonstrated Morphogo's ability to identify over 25 different types of BM nucleated cells, achieving a sensitivity of 80.95%, specificity of 99.48%, positive predictive value of 76.49%, negative predictive value of 99.44%, and an overall accuracy of 99.01%. In most groups, Morphogo cell analysis and Pathologists' proofreading showed high intragroup correlation coefficients for granulocytes, erythrocytes, lymphocytes, monocytes, and plasma cells. These findings further validate the practical applicability of the Morphogo system in clinical practice and emphasize its value in assisting pathologists in diagnosing blood disorders.

Digital assessment of peripheral blood and bone marrow aspirate smears

The diagnosis of benign and neoplastic hematologic disorders relies on analysis of peripheral blood and bone marrow aspirate smears. As demonstrated by the widespread laboratory adoption of hematology analyzers for automated assessment of peripheral blood, digital analysis of these samples provides many significant benefits compared to relying solely on manual review. Nonetheless, analogous instruments for digital bone marrow aspirate smear assessment have yet to be clinically implemented. In this review, we first provide a historical overview detailing the implementation of hematology analyzers for digital peripheral blood assessment in the clinical laboratory, including the improvements in accuracy, scope, and throughput of current instruments over prior generations. We also describe recent research in digital peripheral blood assessment, particularly in the development of advanced machine learning models that may soon be incorporated into commercial instruments. Next, we provide an overview of recent research in digital assessment of bone marrow aspirate smears and how these approaches could soon lead to development and clinical adoption of instrumentation for automated bone marrow aspirate smear analysis. Finally, we describe the relative advantages and provide our vision for the future of digital assessment of peripheral blood and bone marrow aspirate smears, including what improvements we can soon expect in the hematology laboratory.

Challenging gold standard hematology diagnostics through the introduction of whole genome sequencing and artificial intelligence

The diagnosis of hematological malignancies is rather complex and requires the application of a plethora of different assays, techniques and methodologies. Some of the methods, like cytomorphology, have been in use for decades, while other methods, such as next-generation sequencing or even whole genome sequencing (WGS), are relatively new. The application of the methods and the evaluation of the results require distinct skills and knowledge and place different demands on the practitioner. However, even with experienced hematologists, diagnostic ambiguity remains a regular occurrence and the comprehensive analysis of high-dimensional WGS data soon exceeds any human's capacity. Hence, in order to reduce inter-observer variability and to improve the timeliness and accuracy of diagnoses, machine learning based approaches have been developed to assist in the decision making process. Moreover, to achieve the goal of precision oncology, comprehensive genomic profiling is increasingly being incorporated into routine standard of care.

Applications of Artificial Intelligence in Philadelphia-Negative Myeloproliferative Neoplasms

Philadelphia-negative (Ph-) myeloproliferative neoplasms (MPNs) are a group of hematopoietic malignancies identified by clonal proliferation of blood cell lineages and encompasses polycythemia vera (PV), essential thrombocythemia (ET), and primary myelofibrosis (PMF). The clinical and laboratory features of Philadelphia-negative MPNs are similar, making them difficult to diagnose, especially in the preliminary stages. Because treatment goals and progression risk differ amongst MPNs, accurate classification and prognostication are critical for optimal management. Artificial intelligence (AI) and machine learning (ML) algorithms provide a plethora of possible tools to clinicians in general, and particularly in the field of malignant hematology, to better improve diagnosis, prognosis, therapy planning, and fundamental knowledge. In this review, we summarize the literature discussing the application of AI and ML algorithms in patients with diagnosed or suspected Philadelphia-negative MPNs. A literature search was conducted on PubMed/MEDLINE, Embase, Scopus, and Web of Science databases and yielded 125 studies, out of which 17 studies were included after screening. The included studies demonstrated the potential for the practical use of ML and AI in the diagnosis, prognosis, and genomic landscaping of patients with Philadelphia-negative MPNs.

Artificial intelligence in hematological diagnostics: Game changer or gadget?

The future of clinical diagnosis and treatment of hematologic diseases will inevitably involve the integration of artificial intelligence (AI)-based systems into routine practice to support the hematologists' decision making. Several studies have shown that AI-based models can already be used to automatically differentiate cells, reliably detect malignant cell populations, support chromosome banding analysis, and interpret clinical variants, contributing to early disease detection and prognosis. However, even the best tool can become useless if it is misapplied or the results are misinterpreted. Therefore, in order to comprehensively judge and correctly apply newly developed AI-based systems, the hematologist must have a basic understanding of the general concepts of machine learning. In this review, we provide the hematologist with a comprehensive overview of various machine learning techniques, their current implementations and approaches in different diagnostic subfields (e.g., cytogenetics, molecular genetics), and the limitations and unresolved challenges of the systems.

The Application of Morphogo in the Detection of Megakaryocytes from Bone Marrow Digital Images with Convolutional Neural Networks

The evaluation of megakaryocytes is an important part of the work up on bone marrow smear examination. It has significance in the differential diagnosis, therapeutic efficacy assessment, and predication of prognosis of many hematologic diseases. The process of manual identification of megakaryocytes are tedious and lack of reproducibility; therefore, a reliable method of automated megakaryocytic identification is urgently needed. Three hundred and thirty-three bone marrow aspirate smears were digitized by Morphogo system. Pathologists annotated megakaryocytes on the digital images of marrow smears are applied to construct a large dataset for testing the system's predictive performance. Subsequently, we obtained megakaryocyte count and classification for each sample by different methods (system-automated analysis, system-assisted analysis, and microscopic examination) to study the correlation between different counting and classification methods. Morphogo system localized cells likely to be megakaryocytes on digital smears, which were later annotated by pathologists and the system, respectively. The system showed outstanding performance in identifying megakaryocytes in bone marrow smears with high sensitivity (96.57%) and specificity (89.71%). The overall correlation between the different methods was confirmed the high consistency (r ≥ 0.7218, R² ≥ 0.5211) with microscopic examination in classifying megakaryocytes. Morphogo system was proved as a reliable screen tool for analyzing megakaryocytes. The application of Morphogo system shows promises to advance the automation and standardization of bone marrow smear examination.

An AI-Aided Diagnostic Framework for Hematologic Neoplasms Based on Morphologic Features and Medical Expertise

A morphologic examination is essential for the diagnosis of hematological diseases. However, its conventional manual operation is time-consuming and laborious. Herein, we attempt to establish an artificial intelligence (AI)-aided diagnostic framework integrating medical expertise. This framework acts as a virtual hematological morphologist (VHM) for diagnosing hematological neoplasms. Two datasets were established as follows: An image dataset was used to train the Faster Region-based Convolutional Neural Network to develop an image-based morphologic feature extraction model. A case dataset containing retrospective morphologic diagnostic data was used to train a support vector machine algorithm to develop a feature-based case identification model based on diagnostic criteria. Integrating these 2 models established a whole-process AI-aided diagnostic framework, namely, VHM, and a 2-stage strategy was applied to practice case diagnosis. The recall and precision of VHM in bone marrow cell classification were 94.65% and 93.95%, respectively. The balanced accuracy, sensitivity, and specificity of VHM were 97.16%, 99.09%, and 92%, respectively, in the differential diagnosis of normal and abnormal cases, and 99.23%, 97.96%, and 100%, respectively, in the precise diagnosis of chronic myelogenous leukemia in chronic phase. This work represents the first attempt, to our knowledge, to extract multimodal morphologic features and to integrate a feature-based case diagnosis model for designing a comprehensive AI-aided morphologic diagnostic framework. The performance of our knowledge-based framework was superior to that of the widely used end-to-end AI-based diagnostic framework in terms of testing accuracy (96.88% vs 68.75%) or generalization ability (97.11% vs 68.75%) in differentiating normal and abnormal cases. The remarkable advantage of VHM is that it follows the logic of clinical diagnostic procedures, making it a reliable and interpretable hematological diagnostic tool.

Leukemia can be Effectively Early Predicted in Routine Physical Examination with the Assistance of Machine Learning Models

Objectives. The diagnosis of leukemia relies very much on the results of bone marrow examinations, which is never generally performed in routine physical examination. In many rural areas even community hospitals and primary care clinics, the lack of hematological specialist and facility does not allow a definite diagnosis of leukemia. Thus, there will be a significant benefit if machine learning (ML) models could help early predict leukemia using preliminary blood test data in a routine physical examination in community hospitals to save time before a definite diagnosis. Methods. We collected the routine physical examination data of 1230 newly diagnosed leukemia patients and 1300 healthy people. We trained and tested 3 machine learning (ML) models including linear support vector machine (LSVM), random forest (RF), and XGboost models. We not only examined the accordance between model results and statistical analysis of the input data but also examined the consistency of model accuracy scores and relative importance order of model factors with regard to different input data sets and different model arguments to check the applicability of both the models and the input data. Results. Generally, the RF and XGboost models give more identical, consistent, and robust relative importance order of factors that is also accordant with the statistical analysis, while the LSVM gives much different and nonsense orders for different inputs. Results of the RF and XGboost models show that (1) generally, the models achieve accuracy scores above 0.9, indicating effective identification of leukemia, and (2) the top three factors that contribute most to the identification of leukemia include red blood cell (RBC), hematocrit (HCT), and white blood cell (WBC), while the other factors contribute relatively less. Conclusions. This study shows a feasible case example for early identification of leukemia using routine physical examination data with the assistance of ML models, which can be conveniently, cheaply, and widely applied in community hospitals or primary care clinics to save time before definite diagnosis; however, more studies are still needed to validate the applicability of more ML models to a larger variety of input data sets.

Deep learning application of the discrimination of bone marrow aspiration cells in patients with myelodysplastic syndromes

Myelodysplastic syndromes (MDS) are a group of hematologic neoplasms accompanied by dysplasia of the bone marrow hematopoietic cells with cytopenia. Detecting dysplasia is important in the diagnosis of MDS, but it takes considerable time and effort. Also, since the assessment of dysplasia is subjective and difficult to quantify, a more efficient tool is needed for quality control and standardization of bone marrow aspiration smear interpretation. In this study, we developed and evaluated an algorithm to automatically discriminate hematopoietic cell lineages and detect dysplastic cells in bone marrow aspiration smears using deep learning technology. Bone marrow aspiration images were acquired from 34 patients diagnosed with MDS and from 24 normal bone marrow slides. In total, 8065 cells were classified into eight categories: normal erythrocytes, normal granulocytes, normal megakaryocytes, dysplastic erythrocytes, dysplastic granulocytes, dysplastic megakaryocytes, blasts, and others. The algorithm demonstrated acceptable performance in classifying dysplastic cells, with an AUC of 0.945-0.996 and accuracy of 0.912-0.993. The algorithm developed in this study could be used as an auxiliary tool for diagnosing patients with MDS and is expected to contribute to shortening the time required for MDS bone marrow aspiration diagnosis and standardizing visual reading.

Efficient and Highly Accurate Diagnosis of Malignant Hematological Diseases Based on Whole-Slide Images Using Deep Learning

Hematopoietic disorders are serious diseases that threaten human health, and the diagnosis of these diseases is essential for treatment. However, traditional diagnosis methods rely on manual operation, which is time consuming and laborious, and examining entire slide is challenging. In this study, we developed a weakly supervised deep learning method for diagnosing malignant hematological diseases requiring only slide-level labels. The method improves efficiency by converting whole-slide image (WSI) patches into low-dimensional feature representations. Then the patch-level features of each WSI are aggregated into slide-level representations by an attention-based network. The model provides final diagnostic predictions based on these slide-level representations. By applying the proposed model to our collection of bone marrow WSIs at different magnifications, we found that an area under the receiver operating characteristic curve of 0.966 on an independent test set can be obtained at 10× magnification. Moreover, the performance on microscopy images can achieve an average accuracy of 94.2% on two publicly available datasets. In conclusion, we have developed a novel method that can achieve fast and accurate diagnosis in different scenarios of hematological disorders.

Automated bone marrow cytology using deep learning to generate a histogram of cell types

Background

Bone marrow cytology is required to make a hematological diagnosis, influencing critical clinical decision points in hematology. However, bone marrow cytology is tedious, limited to experienced reference centers and associated with inter-observer variability. This may lead to a delayed or incorrect diagnosis, leaving an unmet need for innovative supporting technologies.

Methods

We develop an end-to-end deep learning-based system for automated bone marrow cytology. Starting with a bone marrow aspirate digital whole slide image, our system rapidly and automatically detects suitable regions for cytology, and subsequently identifies and classifies all bone marrow cells in each region. This collective cytomorphological information is captured in a representation called Histogram of Cell Types (HCT) quantifying bone marrow cell class probability distribution and acting as a cytological patient fingerprint.

Results

Our system achieves high accuracy in region detection (0.97 accuracy and 0.99 ROC AUC), and cell detection and cell classification (0.75 mean average precision, 0.78 average F1-score, Log-average miss rate of 0.31).

Conclusions

HCT has potential to eventually support more efficient and accurate diagnosis in hematology, supporting AI-enabled computational pathology.

A method to classify bone marrow cells with rejected option

Bone marrow cell morphology has always been an important tool for the diagnosis of blood diseases. Still, it requires years of experience from a suitable person. Furthermore, the outcomes of their recognition are subjective and there is no objective quantitative standard. As a result, developing a deep learning automatic classification system for bone marrow cells is extremely important. However, typical classification machine learning systems only produce classification answers, and will not refuse to generate predictions when the prediction reliability is low. It will pose a big problem in some high-risk systems such as bone marrow cell recognition. This paper proposes a bone marrow cell classification method with rejected option (CMWRO) to classify 11 bone marrow cells. CMWRO is based on convolutional neural networks, ICP and SoftMax (CNN-ICP-SoftMax), containing a classifier with rejected option. When the rejected rate (RR) of tested samples is 0.3143, it can ensure that the precision, sensitivity, accuracy of the accepted samples reach 0.9921, 0.9917 and 0.9944 respectively. And the rejected samples will be handled by other ways, such as identified by doctors. Besides, the method has a good filtering effect on cell types that the classifier is not trained, such as abnormal cells and cells with less sample distribution. It can reach more than 82% in filtering efficiency. CMWRO improves the doctors' trust in the results of accepted samples to a certain extent. They only need to carefully identify the samples that CMWRO refuses to recognize, and finally combines the two results. It can greatly improve the efficiency and accuracy of bone marrow cell recognition.

Personalized Risk Schemes and Machine Learning to Empower Genomic Prognostication Models in Myelodysplastic Syndromes

Myelodysplastic syndromes (MDS) are characterized by variable clinical manifestations and outcomes. Several prognostic systems relying on clinical factors and cytogenetic abnormalities have been developed to help stratify MDS patients into different risk categories of distinct prognoses and therapeutic implications. The current abundance of molecular information poses the challenges of precisely defining patients' molecular profiles and their incorporation in clinically established diagnostic and prognostic schemes. Perhaps the prognostic power of the current systems can be boosted by incorporating molecular features. Machine learning (ML) algorithms can be helpful in developing more precise prognostication models that integrate complex genomic interactions at a higher dimensional level. These techniques can potentially generate automated diagnostic and prognostic models and assist in advancing personalized therapies. This review highlights the current prognostication models used in MDS while shedding light on the latest achievements in ML-based research.

How artificial intelligence might disrupt diagnostics in hematology in the near future

Artificial intelligence (AI) is about to make itself indispensable in the health care sector. Examples of successful applications or promising approaches range from the application of pattern recognition software to pre-process and analyze digital medical images, to deep learning algorithms for subtype or disease classification, and digital twin technology and in silico clinical trials. Moreover, machine-learning techniques are used to identify patterns and anomalies in electronic health records and to perform ad-hoc evaluations of gathered data from wearable health tracking devices for deep longitudinal phenotyping. In the last years, substantial progress has been made in automated image classification, reaching even superhuman level in some instances. Despite the increasing awareness of the importance of the genetic context, the diagnosis in hematology is still mainly based on the evaluation of the phenotype. Either by the analysis of microscopic images of cells in cytomorphology or by the analysis of cell populations in bidimensional plots obtained by flow cytometry. Here, AI algorithms not only spot details that might escape the human eye, but might also identify entirely new ways of interpreting these images. With the introduction of high-throughput next-generation sequencing in molecular genetics, the amount of available information is increasing exponentially, priming the field for the application of machine learning approaches. The goal of all the approaches is to allow personalized and informed interventions, to enhance treatment success, to improve the timeliness and accuracy of diagnoses, and to minimize technically induced misclassifications. The potential of AI-based applications is virtually endless but where do we stand in hematology and how far can we go?

Artificial intelligence-based morphological fingerprinting of megakaryocytes: a new tool for assessing disease in MPN patients

Accurate diagnosis and classification of myeloproliferative neoplasms (MPNs) requires integration of clinical, morphological, and genetic findings. Despite major advances in our understanding of the molecular and genetic basis of MPNs, the morphological assessment of bone marrow trephines (BMT) is critical in differentiating MPN subtypes and their reactive mimics. However, morphological assessment is heavily constrained by a reliance on subjective, qualitative, and poorly reproducible criteria. To improve the morphological assessment of MPNs, we have developed a machine learning approach for the automated identification, quantitative analysis, and abstract representation of megakaryocyte features using reactive/nonneoplastic BMT samples (n = 43) and those from patients with established diagnoses of essential thrombocythemia (n = 45), polycythemia vera (n = 18), or myelofibrosis (n = 25). We describe the application of an automated workflow for the identification and delineation of relevant histological features from routinely prepared BMTs. Subsequent analysis enabled the tissue diagnosis of MPN with a high predictive accuracy (area under the curve = 0.95) and revealed clear evidence of the potential to discriminate between important MPN subtypes. Our method of visually representing abstracted megakaryocyte features in the context of analyzed patient cohorts facilitates the interpretation and monitoring of samples in a manner that is beyond conventional approaches. The automated BMT phenotyping approach described here has significant potential as an adjunct to standard genetic and molecular testing in established or suspected MPN patients, either as part of the routine diagnostic pathway or in the assessment of disease progression/response to treatment.

Screening For Bone Marrow Cellularity Changes in Cynomolgus Macaques in Toxicology Safety Studies Using Artificial Intelligence Models

Many compounds affect the cellularity of hematolymphoid organs including bone marrow. Toxicologic pathologists are tasked with their evaluation as part of safety studies. An artificial intelligence (AI) tool could provide diagnostic support for the pathologist. We looked at the ability of a deep-learning AI model to evaluate whole slide images of macaque sternebrae to identify and enumerate bone marrow hematopoietic cells. The AI model was trained and able to differentiate the hematopoietic cells from the other sternebrae tissues. We compared the model to severity scores in a study with decreased hematopoietic cellularity. The mean cells/mm² from the model was lower for each increase in severity score. The AI model was trained by 1 pathologist, providing proof of concept that AI model generation can be fast and agile, without the need of a cross disciplinary team and significant effort. We see great potential for the role of AI-based bone marrow screening.

Assessment of dysplasia in bone marrow smear with convolutional neural network

In this study, we developed the world's first artificial intelligence (AI) system that assesses the dysplasia of blood cells on bone marrow smears and presents the result of AI prediction for one of the most representative dysplasia—decreased granules (DG). We photographed field images from the bone marrow smears from patients with myelodysplastic syndrome (MDS) or non-MDS diseases and cropped each cell using an originally developed cell detector. Two morphologists labelled each cell. The degree of dysplasia was evaluated on a four-point scale: 0–3 (e.g., neutrophil with severely decreased granules were labelled DG3). We then constructed the classifier from the dataset of labelled images. The detector and classifier were based on a deep neural network pre-trained with natural images. We obtained 1797 labelled images, and the morphologists determined 134 DGs (DG1: 46, DG2: 77, DG3: 11). Subsequently, we performed a five-fold cross-validation to evaluate the performance of the classifier. For DG1–3 labelled by morphologists, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were 91.0%, 97.7%, 76.3%, 99.3%, and 97.2%, respectively. When DG1 was excluded in the process, the sensitivity, specificity, PPV, NPV, and accuracy were 85.2%, 98.9%, 80.6%, and 99.2% and 98.2%, respectively.

Automatic Detection of Coronary Metallic Stent Struts Based on YOLOv3 and R-FCN

An artificial stent implantation is one of the most effective ways to treat coronary artery diseases. It is vital in vascular medical imaging, such as intravascular optical coherence tomography (IVOCT), to be able to track the position of stents in blood vessels effectively. We trained two models, the “You Only Look Once” version 3 (YOLOv3) and the Region-based Fully Convolutional Network (R-FCN), to detect metal support struts in IVOCT, respectively. After rotating the original images in the training set for data augmentation, and modifying the scale of the conventional anchor box in both two algorithms to fit the size of the target strut, YOLOv3 and R-FCN achieved precision, recall, and AP all above 95% in 0.4 IoU threshold. And R-FCN performs better than YOLOv3 in all relevant indicators.