Computer-aided detection of bone metastasis in bone scintigraphy images using parallelepiped classification method

Artificial Intelligence in Detection, Management, and Prognosis of Bone Metastasis: A Systematic Review

BACKGROUND

Metastasis commonly occur in the bone tissue. Artificial intelligence (AI) has become increasingly prevalent in the medical sector as support in decision-making, diagnosis, and treatment processes. The objective of this systematic review was to assess the reliability of AI systems in clinical, radiological, and pathological aspects of bone metastases.

METHODS

We included studies that evaluated the use of AI applications in patients affected by bone metastases. Two reviewers performed a digital search on 31 December 2023 on PubMed, Scopus, and Cochrane library and extracted authors, AI method, interest area, main modalities used, and main objectives from the included studies.

RESULTS

We included 59 studies that analyzed the contribution of computational intelligence in diagnosing or forecasting outcomes in patients with bone metastasis. Six studies were specific for spine metastasis. The study involved nuclear medicine (44.1%), clinical research (28.8%), radiology (20.4%), or molecular biology (6.8%). When a primary tumor was reported, prostate cancer was the most common, followed by lung, breast, and kidney.

CONCLUSIONS

Appropriately trained AI models may be very useful in merging information to achieve an overall improved diagnostic accuracy and treatment for metastasis in the bone. Nevertheless, there are still concerns with the use of AI systems in medical settings. Ethical considerations and legal issues must be addressed to facilitate the safe and regulated adoption of AI technologies. The limitations of the study comprise a stronger emphasis on early detection rather than tumor management and prognosis as well as a high heterogeneity for type of tumor, AI technology and radiological techniques, pathology, or laboratory samples involved.

Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

The use of deep learning methods for the automatic detection and quantification of bone metastases in bone scan images holds significant clinical value. A fast and accurate automated system for segmenting bone metastatic lesions can assist clinical physicians in diagnosis. In this study, a small internal dataset comprising 100 breast cancer patients (90 cases of bone metastasis and 10 cases of non-metastasis) and 100 prostate cancer patients (50 cases of bone metastasis and 50 cases of non-metastasis) was used for model training. Initially, all image labels were binary. We used the Otsu thresholding method or negative mining to generate a non-metastasis mask, thereby transforming the image labels into three classes. We adopted the Double U-Net as the baseline model and made modifications to its output activation function. We changed the activation function to SoftMax to accommodate multi-class segmentation. Several methods were used to enhance model performance, including background pre-processing to remove background information, adding negative samples to improve model precision, and using transfer learning to leverage shared features between two datasets, which enhances the model's performance. The performance was investigated via 10-fold cross-validation and computed on a pixel-level scale. The best model we achieved had a precision of 69.96%, a sensitivity of 63.55%, and an F1-score of 66.60%. Compared to the baseline model, this represents an 8.40% improvement in precision, a 0.56% improvement in sensitivity, and a 4.33% improvement in the F1-score. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.

Bone metastasis detection method based on improving golden jackal optimization using whale optimization algorithm

This paper presents a machine learning-based technique for interpreting bone scintigraphy images, focusing on feature extraction and introducing a new feature selection method called GJOW. GJOW enhances the effectiveness of the golden jackal optimization (GJO) algorithm by integrating operators from the whale optimization algorithm (WOA). The technique's performance is evaluated through extensive experiments using 18 benchmark datasets and 581 bone scan images obtained from a gamma camera, including 362 abnormal and 219 normal cases. The results highlight the superior predictive effectiveness of the GJOW algorithm in bone metastasis detection, achieving an accuracy of 71.79% and specificity of 91.14%. The contributions of this study include the introduction of a new machine learning-based approach for detecting bone metastasis using gamma camera scans, leading to improved accuracy in identifying bone metastases. The findings have practical implications for early detection and intervention, potentially improving patient outcomes.

Systematic Review of Tumor Segmentation Strategies for Bone Metastases

Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.

Semi-supervised segmentation of metastasis lesions in bone scan images

To develop a deep image segmentation model that automatically identifies and delineates lesions of skeletal metastasis in bone scan images, facilitating clinical diagnosis of lung cancer–caused bone metastasis by nuclear medicine physicians. A semi-supervised segmentation model is proposed, comprising the feature extraction subtask and pixel classification subtask. During the feature extraction stage, cascaded layers which include the dilated residual convolution, inception connection, and feature aggregation learn the hierarchal representations of low-resolution bone scan images. During the pixel classification stage, each pixel is first classified into categories in a semi-supervised manner, and the boundary of pixels belonging to an individual lesion is then delineated using a closed curve. Experimental evaluation conducted on 2,280 augmented samples (112 original images) demonstrates that the proposed model performs well for automated segmentation of metastasis lesions, with a score of 0.692 for DSC if the model is trained using 37% of the labeled samples. The self-defined semi-supervised segmentation model can be utilized as an automated clinical tool to detect and delineate metastasis lesions in bone scan images, using only a few manually labeled image samples. Nuclear medicine physicians need only attend to those segmented lesions while ignoring the background when they diagnose bone metastasis using low-resolution images. More images of patients from multiple centers are typically needed to further improve the scalability and performance of the model via mitigating the impacts of variability in size, shape, and intensity of bone metastasis lesions.

Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges

Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.

Research on Lightweight Disaster Classification Based on High-Resolution Remote Sensing Images

With the increasing frequency of natural disasters becoming, it is very important to classify and identify disasters. We propose a lightweight disaster classification model, which has lower computation and parameter quantities and a higher accuracy than other classification models. For this purpose, this paper specially proposes the SDS-Network algorithm, which is optimized on ResNet, to deal with the above problems of remote sensing images. First, it implements the spatial attention mechanism to improve the accuracy of the algorithm; then, the depth separable convolution is introduced to reduce the number of model calculations and parameters while ensuring the accuracy of the algorithm; finally, the effect of the model is increased by adjusting some hyperparameters. The experimental results show that, compared with the classic AlexNet, ResNet18, VGG16, VGG19, and Densenet121 classification models, the SDS-Network algorithm in this paper has a higher accuracy, and when compared with the lightweight models mobilenet series, shufflenet series, squeezenet series, and mnasnet series, it has lower model complexity and a higher accuracy rate. According to a comprehensive performance comparison of the charts made in this article, it is found that the SDS-Network algorithm is still better than the regnet series algorithm. Furthermore, after verification with a public data set, the SDS-Network algorithm in this paper is found to have a good generalization ability. Thus, we can conclude that the SDS-Network classification model of the algorithm in this paper has a good classification effect, and it is suitable for disaster classification tasks. Finally, it is verified on public data sets that the proposed SDS-Network has good generalization ability and portability.

Application of SPECT and PET / CT with computer-aided diagnosis in bone metastasis of prostate cancer: a review

Bone metastasis has a significant influence on the prognosis of prostate cancer(PCa) patients. In this review, we discussed the current application of PCa bone metastasis diagnosis with single-photon emission computed tomography (SPECT) and positron emission tomography/computed tomography (PET/CT) computer-aided diagnosis(CAD) systems. A literature search identified articles concentrated on PCa bone metastasis and PET/CT or SPECT CAD systems using the PubMed database. We summarized the previous studies focused on CAD systems and manual quantitative markers calculation, and the coincidence rate was acceptable. We also analyzed the quantification methods, advantages, and disadvantages of CAD systems. CAD systems can detect abnormal lesions of PCa patients’ 99mTc-MDP-SPECT, 18F-FDG-PET/CT, 18F-NaF-PET/CT, and 68 Ga-PSMA PET/CT images automated or semi-automated. CAD systems can also calculate the quantitative markers, which can quantify PCa patients’ whole-body bone metastasis tumor burden accurately and quickly and give a standardized and objective result. SPECT and PET/CT CAD systems are potential tools to monitor and quantify bone metastasis lesions of PCa patients simply and accurately, the future clinical application of CAD systems in diagnosing PCa bone metastasis lesions is necessary and feasible.

Automated detection of lung cancer-caused metastasis by classifying scintigraphic images using convolutional neural network with residual connection and hybrid attention mechanism

Background

Whole-body bone scan is the widely used tool for surveying bone metastases caused by various primary solid tumors including lung cancer. Scintigraphic images are characterized by low specificity, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. Convolutional neural network can be used to develop automated classification of images by automatically extracting hierarchal features and classifying high-level features into classes.

Results

Using convolutional neural network, a multi-class classification model has been developed to detect skeletal metastasis caused by lung cancer using clinical whole-body scintigraphic images. The proposed method consisted of image aggregation, hierarchal feature extraction, and high-level feature classification. Experimental evaluations on a set of clinical scintigraphic images have shown that the proposed multi-class classification network is workable for automated detection of lung cancer-caused metastasis, with achieving average scores of 0.7782, 0.7799, 0.7823, 0.7764, and 0.8364 for accuracy, precision, recall, F-1 score, and AUC value, respectively.

Conclusions

The proposed multi-class classification model can not only predict whether an image contains lung cancer-caused metastasis, but also differentiate between subclasses of lung cancer (i.e., adenocarcinoma and non-adenocarcinoma). On the context of two-class (i.e., the metastatic and non-metastatic) classification, the proposed model obtained a higher score of 0.8310 for accuracy metric.

Automated detection of skeletal metastasis of lung cancer with bone scans using convolutional nuclear network

Bone scan is widely used for surveying bone metastases caused by various solid tumors. Scintigraphic images are characterized by inferior spatial resolution, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. We present in this work a new framework for automatically classifying scintigraphic images collected from patients clinically diagnosed with lung cancer. The framework consists of data preparation and image classification. In the data preparation stage, data augmentation is used to enlarge the dataset, followed by image fusion and thoracic region extraction. In the image classification stage, we use a self-defined convolutional neural network consisting of feature extraction, feature aggregation, and feature classification sub-networks. The developed multi-class classification network can not only predict whether a bone scan image contains bone metastasis but also tell which subcategory of lung cancer that a bone metastasis metastasized from is present in the image. Experimental evaluations on a set of clinical bone scan images have shown that the proposed multi-class classification network is workable for automated classification of metastatic images, with achieving average scores of 0.7392, 0.7592, 0.7242, and 0.7292 for accuracy, precision, recall, and F-1 score, respectively.

dSPIC: a deep SPECT image classification network for automated multi-disease, multi-lesion diagnosis

BACKGROUND

Functional imaging especially the SPECT bone scintigraphy has been accepted as the effective clinical tool for diagnosis, treatment, evaluation, and prevention of various diseases including metastasis. However, SPECT imaging is brightly characterized by poor resolution, low signal-to-noise ratio, as well as the high sensitivity and low specificity because of the visually similar characteristics of lesions between diseases on imaging findings.

METHODS

Focusing on the automated diagnosis of diseases with whole-body SPECT scintigraphic images, in this work, a self-defined convolutional neural network is developed to survey the presence or absence of diseases of concern. The data preprocessing mainly including data augmentation is first conducted to cope with the problem of limited samples of SPECT images by applying the geometric transformation operations and generative adversarial network techniques on the original SPECT imaging data. An end-to-end deep SPECT image classification network named dSPIC is developed to extract the optimal features from images and then to classify these images into classes, including metastasis, arthritis, and normal, where there may be multiple diseases existing in a single image.

RESULTS

A group of real-world data of whole-body SPECT images is used to evaluate the self-defined network, obtaining a best (worst) value of 0.7747 (0.6910), 0.7883 (0.7407), 0.7863 (0.6956), 0.8820 (0.8273) and 0.7860 (0.7230) for accuracy, precision, sensitivity, specificity, and F-1 score, respectively, on the testing samples from the original and augmented datasets.

CONCLUSIONS

The prominent classification performance in contrast to other related deep classifiers including the classical AlexNet network demonstrates that the built deep network dSPIC is workable and promising for the multi-disease, multi-lesion classification task of whole-body SPECT bone scintigraphy images.

Object-oriented classification approach for bone metastasis mapping from whole-body bone scintigraphy

PURPOSE

Whole-body bone scintigraphy is the most widely used method for detecting bone metastases in advanced cancer. However, its interpretation depends on the experience of the radiologist. Some automatic interpretation systems have been developed in order to improve diagnostic accuracy. These systems are pixel-based and do not use spatial or textural information of groups of pixels, which could be very important for classifying images with better accuracy. This paper presents a fast method of object-oriented classification that facilitates easier interpretation of bone scintigraphy images.

METHODS

Nine whole-body images from patients suspected with bone metastases were analyzed in this preliminary study. First, an edge-based segmentation algorithm together with the full lambda-schedule algorithm were used to identify the object in the bone scintigraphy and the textural and spatial attributes of these objects were calculated. Then, a set of objects (224 objects, ~ 46% of the total objects) were selected as training data based on visual examination of the image, and were assigned to various levels of radionuclide accumulation before performing the data classification using both k-nearest-neighbor and support vector machine classifiers. The performance of the proposed method was evaluated using as metric the statistical parameters calculated from error matrix.

RESULTS

The results revealed that the proposed object-oriented classification approach using either k-nearest-neighbor or support vector machine as classification methods performed well in detecting bone metastasis in terms of overall accuracy (86.62 ± 2.163% and 86.81 ± 2.137% respectively) and kappa coefficient (0.6395 ± 0.0143 and 0.6481 ± 0.0218 respectively).

CONCLUSIONS

In conclusion, the described method provided encouraging results in mapping bone metastases in whole-body bone scintigraphy.

A Lightweight Convolutional Neural Network Architecture Applied for Bone Metastasis Classification in Nuclear Medicine: A Case Study on Prostate Cancer Patients

Bone metastasis is among the most frequent in diseases to patients suffering from metastatic cancer, such as breast or prostate cancer. A popular diagnostic method is bone scintigraphy where the whole body of the patient is scanned. However, hot spots that are presented in the scanned image can be misleading, making the accurate and reliable diagnosis of bone metastasis a challenge. Artificial intelligence can play a crucial role as a decision support tool to alleviate the burden of generating manual annotations on images and therefore prevent oversights by medical experts. So far, several state-of-the-art convolutional neural networks (CNN) have been employed to address bone metastasis diagnosis as a binary or multiclass classification problem achieving adequate accuracy (higher than 90%). However, due to their increased complexity (number of layers and free parameters), these networks are severely dependent on the number of available training images that are typically limited within the medical domain. Our study was dedicated to the use of a new deep learning architecture that overcomes the computational burden by using a convolutional neural network with a significantly lower number of floating-point operations (FLOPs) and free parameters. The proposed lightweight look-behind fully convolutional neural network was implemented and compared with several well-known powerful CNNs, such as ResNet50, VGG16, Inception V3, Xception, and MobileNet on an imaging dataset of moderate size (778 images from male subjects with prostate cancer). The results prove the superiority of the proposed methodology over the current state-of-the-art on identifying bone metastasis. The proposed methodology demonstrates a unique potential to revolutionize image-based diagnostics enabling new possibilities for enhanced cancer metastasis monitoring and treatment.

Development of Convolutional Neural Networks to identify bone metastasis for prostate cancer patients in bone scintigraphy

OBJECTIVE

The main aim of this work is to build a robust Convolutional Neural Network (CNN) algorithm that efficiently and quickly classifies bone scintigraphy images, by determining the presence or absence of prostate cancer metastasis.

METHODS

CNN, widely applied in medical image classification, was used for bone scintigraphy image classification. The retrospective study included 778 sequential male patients who underwent whole-body bone scans. A nuclear medicine physician classified all the cases into 3 categories: (1) normal, (2) malignant, and (3) degenerative, which were used as the gold standard.

RESULTS

An efficient CNN architecture was built, based on CNN exploration performance, achieving high prediction accuracy. The results showed that the method is sufficiently precise when it comes to differentiating a bone metastasis from other either degenerative changes or normal tissue (overall classification accuracy = 91.42% ± 1.64%). To strengthen the outcomes of this study the authors further compared the best performing CNN method to other popular CNN architectures for medical imaging, like ResNet50, VGG16 and GoogleNet, as reported in the literature.

CONCLUSIONS

The prediction results reveal the efficacy of the proposed CNN-based approach and its ability for an easier and more precise interpretation of whole-body images in bone metastasis diagnosis for prostate cancer patients in nuclear medicine. This leads to marked effects on the diagnostic accuracy and decision-making regarding the treatment to be applied.

Bone metastasis classification using whole body images from prostate cancer patients based on convolutional neural networks application

Bone metastasis is one of the most frequent diseases in prostate cancer; scintigraphy imaging is particularly important for the clinical diagnosis of bone metastasis. Up to date, minimal research has been conducted regarding the application of machine learning with emphasis on modern efficient convolutional neural networks (CNNs) algorithms, for the diagnosis of prostate cancer metastasis from bone scintigraphy images. The advantageous and outstanding capabilities of deep learning, machine learning's groundbreaking technological advancement, have not yet been fully investigated regarding their application in computer-aided diagnosis systems in the field of medical image analysis, such as the problem of bone metastasis classification in whole-body scans. In particular, CNNs are gaining great attention due to their ability to recognize complex visual patterns, in the same way as human perception operates. Considering all these new enhancements in the field of deep learning, a set of simpler, faster and more accurate CNN architectures, designed for classification of metastatic prostate cancer in bones, is explored. This research study has a two-fold goal: to create and also demonstrate a set of simple but robust CNN models for automatic classification of whole-body scans in two categories, malignant (bone metastasis) or healthy, using solely the scans at the input level. Through a meticulous exploration of CNN hyper-parameter selection and fine-tuning, the best architecture is selected with respect to classification accuracy. Thus a CNN model with improved classification capabilities for bone metastasis diagnosis is produced, using bone scans from prostate cancer patients. The achieved classification testing accuracy is 97.38%, whereas the average sensitivity is approximately 95.8%. Finally, the best-performing CNN method is compared to other popular and well-known CNN architectures used for medical imaging, like VGG16, ResNet50, GoogleNet and MobileNet. The classification results show that the proposed CNN-based approach outperforms the popular CNN methods in nuclear medicine for metastatic prostate cancer diagnosis in bones.

Analysis of Homogeneous and Heterogeneous Factors for Bone Metastasis in Esophageal Cancer

BACKGROUND Esophageal cancer is a common cancer worldwide. We performed the present study to assess the homogeneous and heterogeneous risk and prognostic factors of bone metastasis (BM) in esophageal cancer patients using data extracted from the Surveillance, Epidemiology, and End Results (SEER) database. MATERIAL AND METHODS Data from patients with esophageal cancer in the SEER database from 2010 to 2016 were extracted to reveal the risk factors for BM through univariable and multivariable logistic regression. Cox hazard regression analysis was used to evaluate the prognostic factors in esophageal cancer patients with BM from 2010 to 2015. RESULTS A total of 2075 (8.0%) patients with initial bone metastasis were diagnosed from among 25 955 patients with esophageal cancer from 2010 to 2016. Male sex, T4 stage, brain metastasis, and liver metastasis were common risk factors for the occurrence and prognosis of BM. Patients with age younger than 67 years, grade III, higher N stage (N1, N2, and N3), histological subtype of esophageal adenocarcinoma or others, and lung metastasis were also more likely to experience bone metastasis, while unmarried patients were associated with shorter survival. CONCLUSIONS The prevalence of initial bone metastasis was approximately 8.0% in esophageal cancer patients. More attention should be paid to patients with revealed risk and prognostic factors because these factors can guide individualize bone metastasis screening and treatment of esophageal cancer patients.