A review of metaphase chromosome image selection techniques for automatic karyotype generation

Cancer cytogenetics in the era of artificial intelligence: shaping the future of chromosome analysis

Artificial intelligence (AI) has rapidly advanced in the past years, particularly in medicine for improved diagnostics. In clinical cytogenetics, AI is becoming crucial for analyzing chromosomal abnormalities and improving precision. However, existing software lack learning capabilities from experienced users. AI integration extends to genomic data analysis, personalized medicine and research, but ethical concerns arise. In this article, we discuss the challenges of the full automation in cytogenetic test interpretation and focus on its importance and benefits.

An automatic progressive chromosome segmentation approach using deep learning with traditional image processing

The fully automatic chromosome analysis system plays an important role in the detection of genetic diseases, which in turn can reduce the diagnosis burden for cytogenetic experts. Chromosome segmentation is a critical step for such a system. However, due to the non-rigid structure of chromosomes, chromosomes may curve in any direction, and two or more chromosomes may touch or overlap to form unpredictable chromosome clusters in metaphase chromosome images, leading to automatic chromosome segmentation as a challenge. In this paper, we propose an automatic progressive segmentation approach to perform the entire metaphase chromosome image segmentation using deep learning with traditional image processing. It follows three stages. In the first stage, thresholding-based and geometric-based methods are employed to divide all chromosomes as single ones and chromosome clusters. To tackle the segmentation for unpredictable chromosome clusters, we first present a new chromosome cluster identification network named CCI-Net to classify all chromosome clusters into different types in the second stage, and then in the third stage, we combine traditional image processing with deep CNNs to accomplish chromosome instance segmentation from different types of clusters. Evaluation results on a clinical dataset of 1148 metaphase chromosome images show that the proposed automatic progressive segmentation method achieves 94.60% chromosome cluster identification accuracy and 99.15% instance segmentation accuracy. The experimental results exhibit that our proposed approach can effectively identify chromosome clusters and successfully perform fully automatic chromosome segmentation.

Chromosome classification via deep learning and its application to patients with structural abnormalities of chromosomes

BACKGROUND AND OBJECTIVE

Karyotyping is an important technique in cytogenetic practice for the early diagnosis of genetic diseases. Clinical karyotyping is tedious, time-consuming, and error-prone. The objective of our study was to develop a single-stage deep convolutional neural networks (DCNN)-based model to automatically classify normal and abnormal chromosomes in an end-to-end manner.

METHODS

We analyzed 2,424 normal chromosomes and 544 abnormal chromosomes. A preliminary support vector machine (SVM) model was developed to evaluate the basic recognition performance on the dataset. A DCNN-based model was then proposed to process the same dataset.

RESULTS

By utilizing the SVM model, the classification accuracy of 24 normal chromosomes was 86.01 %. The 32 types of normal and abnormal chromosomes got an accuracy of 85.37 %. The accuracy of the DCNN-based model performing the 24 normal chromosomal classification was 91.75 %. The accuracy of the 32 type classification was 87.76 %. To differentiate eight common structural abnormalities, we obtained accuracies that ranged from 90.84 % to 100 %, and the values of the AUC ranged from 91.81 % to 100 %.

CONCLUSIONS

Our proposed DCNN-based model effectively performed the karyotype classification in an end-to-end manner. It had the competence to be used as a prediction tool for abnormal karyotype detection and screening in genetic diagnosis without initial feature extraction. We believe our work is meaningful for genetic triage management to lower the cost in clinical practice.

RC-Net: Regression Correction for End-To-End Chromosome Instance Segmentation

Precise segmentation of chromosome in the real image achieved by a microscope is significant for karyotype analysis. The segmentation of image is usually achieved by a pixel-level classification task, which considers different instances as different classes. Many instance segmentation methods predict the Intersection over Union (IoU) through the head branch to correct the classification confidence. Their effectiveness is based on the correlation between branch tasks. However, none of these methods consider the correlation between input and output in branch tasks. Herein, we propose a chromosome instance segmentation network based on regression correction. First, we adopt two head branches to predict two confidences that are more related to localization accuracy and segmentation accuracy to correct the classification confidence, which reduce the omission of predicted boxes in NMS. Furthermore, a NMS algorithm is further designed to screen the target segmentation mask with the IoU of the overlapping instance, which reduces the omission of predicted masks in NMS. Moreover, given the fact that the original IoU loss function is not sensitive to the wrong segmentation, K-IoU loss function is defined to strengthen the penalty of the wrong segmentation, which rationalizes the loss of mis-segmentation and effectively prevents wrong segmentation. Finally, an ablation experiment is designed to evaluate the effectiveness of the chromosome instance segmentation network based on regression correction, which shows that our proposed method can effectively enhance the performance in automatic chromosome segmentation tasks and provide a guarantee for end-to-end karyotype analysis.

CIR-Net: Automatic Classification of Human Chromosome Based on Inception-ResNet Architecture

BACKGROUND

In medicine, karyotyping chromosomes is important for medical diagnostics, drug development, and biomedical research. Unfortunately, chromosome karyotyping is usually done by skilled cytologists manually, which requires experience, domain expertise, and considerable manual efforts. Therefore, automating the karyotyping process is a significant and meaningful task.

METHOD

This paper focuses on chromosome classification because it is critical for chromosome karyotyping. In recent years, deep learning-based methods are the most promising methods for solving the tasks of chromosome classification. Although the deep learning-based Inception architecture has yielded state-of-the-art performance in the 2015 ILSVRC challenge, it has not been used in chromosome classification tasks so far. Therefore, we develop an automatic chromosome classification approach named CIR-Net based on Inception-ResNet which is an optimized version of Inception. However, the classification performance of origin Inception-ResNet on the insufficient chromosome dataset still has a lot of capacity for improvement. Further, we propose a simple but effective augmentation method called CDA for improving the performance of CIR-Net.

RESULTS

The experimental results show that our proposed method achieves 95.98 percent classification accuracy on the clinical G-band chromosome dataset whose training dataset is insufficient. Moreover, the proposed augmentation method CDA improves more than 8.5 percent (from 87.46 to 95.98 percent) classification accuracy comparing to other methods. In this paper, the experimental results demonstrate that our proposed method is recent the most effective solution for solving clinical chromosome classification problems in chromosome auto-karyotyping on the condition of the insufficient training dataset. Code and Dataset are available at https://github.com/CloudDataLab/CIR-Net.

Classification of analyzable metaphase images using transfer learning and fine tuning

Chromosomes are bodies that contain human genetic information. Chromosomal disorders can cause structural and functional disorders in individuals. Detecting the metaphase stages of the cells accurately is a crucial step to detect possible defects in chromosomes. Thus, it is vital at this stage to identify the identical chromosome of each chromosome, to perform the pairing process, and to identify problems arising from this process. In this study, it was investigated whether the analyzable metaphase images can be analyzed by using the transfer learning and fine tuning approaches of deep learning models. The weights of VGG16 and InceptionV3 models trained with ImageNet data set were transferred to this problem and the classification process was carried out. True positive ratio values are 99%(± 0.9) and 99%(± 0.9) for VGG and Inception networks, respectively. The classification performances obtained depending on the changing training set ratios are presented comparatively in figures. F-measure, precision, and recall values obtained for the VGG and Inception networks were observed as 99%(± 1.0) and 99%(± 1.0), respectively. F-measure, precision, and recall values of VGG and Inceptionv3 networks are also presented with respect to the ratio of training size. The obtained results have compared with the state-of-the-art methods in the literature and supported with the tables and graphics. The training phase was also accelerated by using transfer learning and fine tuning methods. Transfer learning and fine tuning processes have almost similar performance as the models used in the literature and trained from scratch in metaphase Graphical Abstract The Flowchart of the proposed system for classifying metaphase candidates detection.

Machine Learning Classifiers Evaluation for Automatic Karyogram Generation from G-Banded Metaphase Images

This work proposes the evaluation of a set of algorithms of machine learning and the selection of the most appropriate one for the classification of segmented chromosomes images acquired using the Giemsa staining technique (G-banding). The evaluation and selection of the best classification algorithms was carried out over a dataset of 119 Q-banding chromosomes images, and the obtained results were then applied to a dataset of 24 G-band chromosomes images, manually classified by an expert of the Laboratory of Cytogenetic of the Children’s Hospital of Tamaulipas. The results of evaluation of 51 classifiers yielded that the best classification accuracy for the selected features was obtained by a backpropagation neural network. One of the main contributions of this study is the proposal of a two-stage classification scheme based on the best classifier found by the initial evaluation. In stage 1, chromosome images are classified into three major groups. In stage 2, the output of phase 1 is used as the input of a multiclass classifier. Using this scheme, 82% of the IGB bank samples and 88% of the samples of a bank of images obtained with a Q-band available in the literature consisting of 119 chromosome studies were successfully classified. The proposed work is a part of an desktop application that allows cytogeneticist to automatically generate cytogenetic reports.

Optimization and validation of automated dicentric chromosome analysis for radiological/nuclear triage applications

Dicentric Chromosome Assay (DCA) is the most preferred cytogenetic technique for absorbed radiation dose assessment in exposed humans. However, DCA is somewhat impractical for triage application owing to its labor intensive and time consuming nature. Although lymphocyte culture for 48 h in vitro is inevitable for DCA, manual scoring of dicentric chromosomes (DCs) requires an additional time of 24-48 h, making the overall turnaround time of 72-96 h for dose estimation. To accelerate the speed of DC analysis for dose estimation, an automated tool was optimized and validated for triage mode of scoring. Several image training files were created to improve the specificity of automated DC analysis algorithm. Accuracy and efficiency of the automated (unsupervised) DC scoring was compared with the semi-automated scoring that involved human verification and correction of DCs (elimination of false positives and inclusion of true positives). DC scoring was performed by both automated and semi-automated modes for different doses of X-rays and γ-rays (0 Gy-5 Gy). Biodoses estimated from the frequencies of DCs detected by both automated (unsupervised) and semi-automated (supervised) scoring modes were grossly similar to the actual delivered doses in the range of 0.5 to 3 Gy of low LET radiation. We suggest that the automated DC tool can be effectively used for large scale radiological/nuclear incidents where a rapid segregation is essential for prioritizing moderately or severely exposed humans to receive appropriate medical countermeasures.

Correlation-based feature selection and classification via regression of segmented chromosomes using geometric features

The genetic defects in the humans are uncovered by studying the chromosomes, as they are the genetic information carriers. They are non-rigid objects and they appear in different orientations when they are imaged. To find out the genetic defects, the chromosomes are pre-processed so that they are not touching, overlapping, and bent, and the noise is also discarded. The presence of bends, overlaps, or touches makes it difficult to uncover the genetic abnormalities. So there is a need for development of an efficient technique to classify the segmented chromosomes into different types and then pre-process them in order to correct their orientation. In this work, a hybrid classification technique based upon correlation-based feature selection and classification via regression approach, which will classify the segmented chromosomes into five categories viz; straight, overlapping, bent, touching, or noise is presented. The performance evaluation has been done using 1592 segmented chromosomes from Advance Digital Imaging Research data set. The over-all accuracy of 94.78 % has been obtained for the five class problem. The performance of the proposed classifier has been compared with Bayes Net, Naïve Bayes, Radial Bias Feed Forward Network, and k-nearest-neighbour classifiers. Based upon this categorization, different pre-processing techniques will be applied to correct the orientation of the chromosomes.