1
|
Papalia GF, Brigato P, Sisca L, Maltese G, Faiella E, Santucci D, Pantano F, Vincenzi B, Tonini G, Papalia R, Denaro V. Artificial Intelligence in Detection, Management, and Prognosis of Bone Metastasis: A Systematic Review. Cancers (Basel) 2024; 16:2700. [PMID: 39123427 PMCID: PMC11311270 DOI: 10.3390/cancers16152700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Revised: 07/20/2024] [Accepted: 07/26/2024] [Indexed: 08/12/2024] Open
Abstract
BACKGROUND Metastasis commonly occur in the bone tissue. Artificial intelligence (AI) has become increasingly prevalent in the medical sector as support in decision-making, diagnosis, and treatment processes. The objective of this systematic review was to assess the reliability of AI systems in clinical, radiological, and pathological aspects of bone metastases. METHODS We included studies that evaluated the use of AI applications in patients affected by bone metastases. Two reviewers performed a digital search on 31 December 2023 on PubMed, Scopus, and Cochrane library and extracted authors, AI method, interest area, main modalities used, and main objectives from the included studies. RESULTS We included 59 studies that analyzed the contribution of computational intelligence in diagnosing or forecasting outcomes in patients with bone metastasis. Six studies were specific for spine metastasis. The study involved nuclear medicine (44.1%), clinical research (28.8%), radiology (20.4%), or molecular biology (6.8%). When a primary tumor was reported, prostate cancer was the most common, followed by lung, breast, and kidney. CONCLUSIONS Appropriately trained AI models may be very useful in merging information to achieve an overall improved diagnostic accuracy and treatment for metastasis in the bone. Nevertheless, there are still concerns with the use of AI systems in medical settings. Ethical considerations and legal issues must be addressed to facilitate the safe and regulated adoption of AI technologies. The limitations of the study comprise a stronger emphasis on early detection rather than tumor management and prognosis as well as a high heterogeneity for type of tumor, AI technology and radiological techniques, pathology, or laboratory samples involved.
Collapse
Affiliation(s)
- Giuseppe Francesco Papalia
- Operative Research Unit of Orthopaedic and Trauma Surgery, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy; (G.F.P.)
- Research Unit of Orthopaedic and Trauma Surgery, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| | - Paolo Brigato
- Operative Research Unit of Orthopaedic and Trauma Surgery, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy; (G.F.P.)
- Research Unit of Orthopaedic and Trauma Surgery, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| | - Luisana Sisca
- Department of Medical Oncology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy
| | - Girolamo Maltese
- Operative Research Unit of Orthopaedic and Trauma Surgery, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy; (G.F.P.)
- Research Unit of Orthopaedic and Trauma Surgery, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| | - Eliodoro Faiella
- Department of Radiology and Interventional Radiology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 00128 Rome, Italy
- Research Unit of Radiology and Interventional Radiology, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| | - Domiziana Santucci
- Department of Radiology and Interventional Radiology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 00128 Rome, Italy
| | - Francesco Pantano
- Department of Medical Oncology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy
| | - Bruno Vincenzi
- Department of Medical Oncology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy
| | - Giuseppe Tonini
- Department of Medical Oncology, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy
| | - Rocco Papalia
- Operative Research Unit of Orthopaedic and Trauma Surgery, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy; (G.F.P.)
- Research Unit of Orthopaedic and Trauma Surgery, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| | - Vincenzo Denaro
- Operative Research Unit of Orthopaedic and Trauma Surgery, Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo, 200, 00128 Rome, Italy; (G.F.P.)
- Research Unit of Orthopaedic and Trauma Surgery, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo, 21, 00128 Rome, Italy
| |
Collapse
|
2
|
Chen YY, Yu PN, Lai YC, Hsieh TC, Cheng DC. Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training. Diagnostics (Basel) 2023; 13:3042. [PMID: 37835785 PMCID: PMC10572884 DOI: 10.3390/diagnostics13193042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 09/18/2023] [Accepted: 09/22/2023] [Indexed: 10/15/2023] Open
Abstract
The use of deep learning methods for the automatic detection and quantification of bone metastases in bone scan images holds significant clinical value. A fast and accurate automated system for segmenting bone metastatic lesions can assist clinical physicians in diagnosis. In this study, a small internal dataset comprising 100 breast cancer patients (90 cases of bone metastasis and 10 cases of non-metastasis) and 100 prostate cancer patients (50 cases of bone metastasis and 50 cases of non-metastasis) was used for model training. Initially, all image labels were binary. We used the Otsu thresholding method or negative mining to generate a non-metastasis mask, thereby transforming the image labels into three classes. We adopted the Double U-Net as the baseline model and made modifications to its output activation function. We changed the activation function to SoftMax to accommodate multi-class segmentation. Several methods were used to enhance model performance, including background pre-processing to remove background information, adding negative samples to improve model precision, and using transfer learning to leverage shared features between two datasets, which enhances the model's performance. The performance was investigated via 10-fold cross-validation and computed on a pixel-level scale. The best model we achieved had a precision of 69.96%, a sensitivity of 63.55%, and an F1-score of 66.60%. Compared to the baseline model, this represents an 8.40% improvement in precision, a 0.56% improvement in sensitivity, and a 4.33% improvement in the F1-score. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.
Collapse
Affiliation(s)
- Yi-You Chen
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan; (Y.-Y.C.); (P.-N.Y.)
| | - Po-Nien Yu
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan; (Y.-Y.C.); (P.-N.Y.)
| | - Yung-Chi Lai
- Department of Nuclear Medicine, Feng Yuan Hospital, Ministry of Health and Welfare, Taichung 420, Taiwan;
| | - Te-Chun Hsieh
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan; (Y.-Y.C.); (P.-N.Y.)
- Department of Nuclear Medicine and PET Center, China Medical University Hospital, Taichung 404, Taiwan
| | - Da-Chuan Cheng
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan; (Y.-Y.C.); (P.-N.Y.)
| |
Collapse
|
3
|
Magdy O, Abd Elaziz M, Elgarayhi A, Ewees AA, Sallah M. Bone metastasis detection method based on improving golden jackal optimization using whale optimization algorithm. Sci Rep 2023; 13:15019. [PMID: 37699992 PMCID: PMC10497577 DOI: 10.1038/s41598-023-41733-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Accepted: 08/30/2023] [Indexed: 09/14/2023] Open
Abstract
This paper presents a machine learning-based technique for interpreting bone scintigraphy images, focusing on feature extraction and introducing a new feature selection method called GJOW. GJOW enhances the effectiveness of the golden jackal optimization (GJO) algorithm by integrating operators from the whale optimization algorithm (WOA). The technique's performance is evaluated through extensive experiments using 18 benchmark datasets and 581 bone scan images obtained from a gamma camera, including 362 abnormal and 219 normal cases. The results highlight the superior predictive effectiveness of the GJOW algorithm in bone metastasis detection, achieving an accuracy of 71.79% and specificity of 91.14%. The contributions of this study include the introduction of a new machine learning-based approach for detecting bone metastasis using gamma camera scans, leading to improved accuracy in identifying bone metastases. The findings have practical implications for early detection and intervention, potentially improving patient outcomes.
Collapse
Affiliation(s)
- Omnia Magdy
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt
| | - Mohamed Abd Elaziz
- Department of Mathematics, Faculty of Science, Zagazig University, Zagazig, 44519, Egypt.
- Faculty of Computer Science and Engineering, Galala University, Suez, 435611, Egypt.
- Artificial Intelligence Research Center (AIRC), Ajman University, Ajman, UAE.
- Department of Electrical and Computer Engineering, Lebanese American University, Byblos, Lebanon.
- MEU Research Unit, Middle East University, Amman, Jordan.
| | - Ahmed Elgarayhi
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt
| | - Ahmed A Ewees
- Department of Computer, Damietta University, Damietta, 34517, Egypt.
| | - Mohammed Sallah
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt
- Department of Physics, College of Sciences, University of Bisha, P.O. Box 344, Bisha , 61922, Saudi Arabia
| |
Collapse
|
4
|
Systematic Review of Tumor Segmentation Strategies for Bone Metastases. Cancers (Basel) 2023; 15:cancers15061750. [PMID: 36980636 PMCID: PMC10046265 DOI: 10.3390/cancers15061750] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/09/2023] [Accepted: 03/10/2023] [Indexed: 03/18/2023] Open
Abstract
Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.
Collapse
|
5
|
Segmentation of lung cancer-caused metastatic lesions in bone scan images using self-defined model with deep supervision. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
6
|
Lin Q, Gao R, Luo M, Wang H, Cao Y, Man Z, Wang R. Semi-supervised segmentation of metastasis lesions in bone scan images. Front Mol Biosci 2022; 9:956720. [DOI: 10.3389/fmolb.2022.956720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 10/13/2022] [Indexed: 11/13/2022] Open
Abstract
To develop a deep image segmentation model that automatically identifies and delineates lesions of skeletal metastasis in bone scan images, facilitating clinical diagnosis of lung cancer–caused bone metastasis by nuclear medicine physicians. A semi-supervised segmentation model is proposed, comprising the feature extraction subtask and pixel classification subtask. During the feature extraction stage, cascaded layers which include the dilated residual convolution, inception connection, and feature aggregation learn the hierarchal representations of low-resolution bone scan images. During the pixel classification stage, each pixel is first classified into categories in a semi-supervised manner, and the boundary of pixels belonging to an individual lesion is then delineated using a closed curve. Experimental evaluation conducted on 2,280 augmented samples (112 original images) demonstrates that the proposed model performs well for automated segmentation of metastasis lesions, with a score of 0.692 for DSC if the model is trained using 37% of the labeled samples. The self-defined semi-supervised segmentation model can be utilized as an automated clinical tool to detect and delineate metastasis lesions in bone scan images, using only a few manually labeled image samples. Nuclear medicine physicians need only attend to those segmented lesions while ignoring the background when they diagnose bone metastasis using low-resolution images. More images of patients from multiple centers are typically needed to further improve the scalability and performance of the model via mitigating the impacts of variability in size, shape, and intensity of bone metastasis lesions.
Collapse
|
7
|
Zhou X, Wang H, Feng C, Xu R, He Y, Li L, Tu C. Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges. Front Oncol 2022; 12:908873. [PMID: 35928860 PMCID: PMC9345628 DOI: 10.3389/fonc.2022.908873] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 06/15/2022] [Indexed: 12/12/2022] Open
Abstract
Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.
Collapse
Affiliation(s)
- Xiaowen Zhou
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Xiangya School of Medicine, Central South University, Changsha, China
| | - Hua Wang
- Xiangya School of Medicine, Central South University, Changsha, China
| | - Chengyao Feng
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Ruilin Xu
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Yu He
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Lan Li
- Department of Pathology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Chao Tu
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Chao Tu,
| |
Collapse
|
8
|
Research on Lightweight Disaster Classification Based on High-Resolution Remote Sensing Images. REMOTE SENSING 2022. [DOI: 10.3390/rs14112577] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
With the increasing frequency of natural disasters becoming, it is very important to classify and identify disasters. We propose a lightweight disaster classification model, which has lower computation and parameter quantities and a higher accuracy than other classification models. For this purpose, this paper specially proposes the SDS-Network algorithm, which is optimized on ResNet, to deal with the above problems of remote sensing images. First, it implements the spatial attention mechanism to improve the accuracy of the algorithm; then, the depth separable convolution is introduced to reduce the number of model calculations and parameters while ensuring the accuracy of the algorithm; finally, the effect of the model is increased by adjusting some hyperparameters. The experimental results show that, compared with the classic AlexNet, ResNet18, VGG16, VGG19, and Densenet121 classification models, the SDS-Network algorithm in this paper has a higher accuracy, and when compared with the lightweight models mobilenet series, shufflenet series, squeezenet series, and mnasnet series, it has lower model complexity and a higher accuracy rate. According to a comprehensive performance comparison of the charts made in this article, it is found that the SDS-Network algorithm is still better than the regnet series algorithm. Furthermore, after verification with a public data set, the SDS-Network algorithm in this paper is found to have a good generalization ability. Thus, we can conclude that the SDS-Network classification model of the algorithm in this paper has a good classification effect, and it is suitable for disaster classification tasks. Finally, it is verified on public data sets that the proposed SDS-Network has good generalization ability and portability.
Collapse
|
9
|
Chen Z, Chen X, Wang R. Application of SPECT and PET / CT with computer-aided diagnosis in bone metastasis of prostate cancer: a review. Cancer Imaging 2022; 22:18. [PMID: 35428360 PMCID: PMC9013072 DOI: 10.1186/s40644-022-00456-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Accepted: 04/04/2022] [Indexed: 01/05/2023] Open
Abstract
AbstractBone metastasis has a significant influence on the prognosis of prostate cancer(PCa) patients. In this review, we discussed the current application of PCa bone metastasis diagnosis with single-photon emission computed tomography (SPECT) and positron emission tomography/computed tomography (PET/CT) computer-aided diagnosis(CAD) systems. A literature search identified articles concentrated on PCa bone metastasis and PET/CT or SPECT CAD systems using the PubMed database. We summarized the previous studies focused on CAD systems and manual quantitative markers calculation, and the coincidence rate was acceptable. We also analyzed the quantification methods, advantages, and disadvantages of CAD systems. CAD systems can detect abnormal lesions of PCa patients’ 99mTc-MDP-SPECT, 18F-FDG-PET/CT, 18F-NaF-PET/CT, and 68 Ga-PSMA PET/CT images automated or semi-automated. CAD systems can also calculate the quantitative markers, which can quantify PCa patients’ whole-body bone metastasis tumor burden accurately and quickly and give a standardized and objective result. SPECT and PET/CT CAD systems are potential tools to monitor and quantify bone metastasis lesions of PCa patients simply and accurately, the future clinical application of CAD systems in diagnosing PCa bone metastasis lesions is necessary and feasible.
Collapse
|
10
|
Guo Y, Lin Q, Zhao S, Li T, Cao Y, Man Z, Zeng X. Automated detection of lung cancer-caused metastasis by classifying scintigraphic images using convolutional neural network with residual connection and hybrid attention mechanism. Insights Imaging 2022; 13:24. [PMID: 35138479 PMCID: PMC8828823 DOI: 10.1186/s13244-022-01162-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 01/20/2022] [Indexed: 12/03/2022] Open
Abstract
Background Whole-body bone scan is the widely used tool for surveying bone metastases caused by various primary solid tumors including lung cancer. Scintigraphic images are characterized by low specificity, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. Convolutional neural network can be used to develop automated classification of images by automatically extracting hierarchal features and classifying high-level features into classes. Results Using convolutional neural network, a multi-class classification model has been developed to detect skeletal metastasis caused by lung cancer using clinical whole-body scintigraphic images. The proposed method consisted of image aggregation, hierarchal feature extraction, and high-level feature classification. Experimental evaluations on a set of clinical scintigraphic images have shown that the proposed multi-class classification network is workable for automated detection of lung cancer-caused metastasis, with achieving average scores of 0.7782, 0.7799, 0.7823, 0.7764, and 0.8364 for accuracy, precision, recall, F-1 score, and AUC value, respectively. Conclusions The proposed multi-class classification model can not only predict whether an image contains lung cancer-caused metastasis, but also differentiate between subclasses of lung cancer (i.e., adenocarcinoma and non-adenocarcinoma). On the context of two-class (i.e., the metastatic and non-metastatic) classification, the proposed model obtained a higher score of 0.8310 for accuracy metric.
Collapse
Affiliation(s)
- Yanru Guo
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Qiang Lin
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China. .,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China. .,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China.
| | - Shaofang Zhao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Tongtong Li
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China
| | - Yongchun Cao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China
| | - Zhengxing Man
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of Streaming Data Computing Technologies and Application, Northwest Minzu University, Lanzhou, Gansu, China.,Key Laboratory of China's Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, Gansu, China
| | - Xianwu Zeng
- Department of Nuclear Medicine, Gansu Provincial Tumor Hospital, Lanzhou, Gansu, China.
| |
Collapse
|
11
|
Li T, Lin Q, Guo Y, Zhao S, Zeng X, Man Z, Cao Y, Hu Y. Automated detection of skeletal metastasis of lung cancer with bone scans using convolutional nuclear network. Phys Med Biol 2021; 67. [PMID: 34933282 DOI: 10.1088/1361-6560/ac4565] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 12/21/2021] [Indexed: 11/12/2022]
Abstract
Bone scan is widely used for surveying bone metastases caused by various solid tumors. Scintigraphic images are characterized by inferior spatial resolution, bringing a significant challenge to manual analysis of images by nuclear medicine physicians. We present in this work a new framework for automatically classifying scintigraphic images collected from patients clinically diagnosed with lung cancer. The framework consists of data preparation and image classification. In the data preparation stage, data augmentation is used to enlarge the dataset, followed by image fusion and thoracic region extraction. In the image classification stage, we use a self-defined convolutional neural network consisting of feature extraction, feature aggregation, and feature classification sub-networks. The developed multi-class classification network can not only predict whether a bone scan image contains bone metastasis but also tell which subcategory of lung cancer that a bone metastasis metastasized from is present in the image. Experimental evaluations on a set of clinical bone scan images have shown that the proposed multi-class classification network is workable for automated classification of metastatic images, with achieving average scores of 0.7392, 0.7592, 0.7242, and 0.7292 for accuracy, precision, recall, and F-1 score, respectively.
Collapse
Affiliation(s)
- Tongtong Li
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Qiang Lin
- School of Mathematics and Computer Science, Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, 730030, CHINA
| | - Yanru Guo
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Shaofang Zhao
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Xianwu Zeng
- Gansu Provincial Cancer Hospital, No. 2, Dongjie Rd., Lanzhou, Gansu, 730050, CHINA
| | - Zhengxing Man
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Yongchun Cao
- Northwest Minzu University, No. 1, Xibei Xincun Rd., Lanzhou, Gansu, 730030, CHINA
| | - Yonghua Hu
- Gansu University of Chinese Medicine, No. 35, Dingxi Donglu Rd., Lanzhou, 730000, CHINA
| |
Collapse
|
12
|
Lin Q, Cao C, Li T, Man Z, Cao Y, Wang H. dSPIC: a deep SPECT image classification network for automated multi-disease, multi-lesion diagnosis. BMC Med Imaging 2021; 21:122. [PMID: 34380441 PMCID: PMC8359584 DOI: 10.1186/s12880-021-00653-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2020] [Accepted: 07/27/2021] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Functional imaging especially the SPECT bone scintigraphy has been accepted as the effective clinical tool for diagnosis, treatment, evaluation, and prevention of various diseases including metastasis. However, SPECT imaging is brightly characterized by poor resolution, low signal-to-noise ratio, as well as the high sensitivity and low specificity because of the visually similar characteristics of lesions between diseases on imaging findings. METHODS Focusing on the automated diagnosis of diseases with whole-body SPECT scintigraphic images, in this work, a self-defined convolutional neural network is developed to survey the presence or absence of diseases of concern. The data preprocessing mainly including data augmentation is first conducted to cope with the problem of limited samples of SPECT images by applying the geometric transformation operations and generative adversarial network techniques on the original SPECT imaging data. An end-to-end deep SPECT image classification network named dSPIC is developed to extract the optimal features from images and then to classify these images into classes, including metastasis, arthritis, and normal, where there may be multiple diseases existing in a single image. RESULTS A group of real-world data of whole-body SPECT images is used to evaluate the self-defined network, obtaining a best (worst) value of 0.7747 (0.6910), 0.7883 (0.7407), 0.7863 (0.6956), 0.8820 (0.8273) and 0.7860 (0.7230) for accuracy, precision, sensitivity, specificity, and F-1 score, respectively, on the testing samples from the original and augmented datasets. CONCLUSIONS The prominent classification performance in contrast to other related deep classifiers including the classical AlexNet network demonstrates that the built deep network dSPIC is workable and promising for the multi-disease, multi-lesion classification task of whole-body SPECT bone scintigraphy images.
Collapse
Affiliation(s)
- Qiang Lin
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, 730030, China. .,Key Lab of Streaming Data Computing and Applications, Northwest Minzu University, Lanzhou, 730030, China.
| | - Chuangui Cao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, 730030, China.,Key Lab of Streaming Data Computing and Applications, Northwest Minzu University, Lanzhou, 730030, China
| | - Tongtong Li
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, 730030, China.,Key Lab of Streaming Data Computing and Applications, Northwest Minzu University, Lanzhou, 730030, China
| | - Zhengxing Man
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, 730030, China.,Key Lab of Streaming Data Computing and Applications, Northwest Minzu University, Lanzhou, 730030, China
| | - Yongchun Cao
- School of Mathematics and Computer Science, Northwest Minzu University, Lanzhou, 730030, China.,Key Lab of Streaming Data Computing and Applications, Northwest Minzu University, Lanzhou, 730030, China
| | - Haijun Wang
- Department of Nuclear Medicine, Gansu Provincial Hospital, Lanzhou, 730000, China
| |
Collapse
|
13
|
Object-oriented classification approach for bone metastasis mapping from whole-body bone scintigraphy. Phys Med 2021; 84:141-148. [PMID: 33894584 DOI: 10.1016/j.ejmp.2021.03.040] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 03/12/2021] [Accepted: 03/30/2021] [Indexed: 01/10/2023] Open
Abstract
PURPOSE Whole-body bone scintigraphy is the most widely used method for detecting bone metastases in advanced cancer. However, its interpretation depends on the experience of the radiologist. Some automatic interpretation systems have been developed in order to improve diagnostic accuracy. These systems are pixel-based and do not use spatial or textural information of groups of pixels, which could be very important for classifying images with better accuracy. This paper presents a fast method of object-oriented classification that facilitates easier interpretation of bone scintigraphy images. METHODS Nine whole-body images from patients suspected with bone metastases were analyzed in this preliminary study. First, an edge-based segmentation algorithm together with the full lambda-schedule algorithm were used to identify the object in the bone scintigraphy and the textural and spatial attributes of these objects were calculated. Then, a set of objects (224 objects, ~ 46% of the total objects) were selected as training data based on visual examination of the image, and were assigned to various levels of radionuclide accumulation before performing the data classification using both k-nearest-neighbor and support vector machine classifiers. The performance of the proposed method was evaluated using as metric the statistical parameters calculated from error matrix. RESULTS The results revealed that the proposed object-oriented classification approach using either k-nearest-neighbor or support vector machine as classification methods performed well in detecting bone metastasis in terms of overall accuracy (86.62 ± 2.163% and 86.81 ± 2.137% respectively) and kappa coefficient (0.6395 ± 0.0143 and 0.6481 ± 0.0218 respectively). CONCLUSIONS In conclusion, the described method provided encouraging results in mapping bone metastases in whole-body bone scintigraphy.
Collapse
|
14
|
Ntakolia C, Diamantis DE, Papandrianos N, Moustakidis S, Papageorgiou EI. A Lightweight Convolutional Neural Network Architecture Applied for Bone Metastasis Classification in Nuclear Medicine: A Case Study on Prostate Cancer Patients. Healthcare (Basel) 2020; 8:E493. [PMID: 33217973 PMCID: PMC7711827 DOI: 10.3390/healthcare8040493] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2020] [Revised: 11/12/2020] [Accepted: 11/16/2020] [Indexed: 12/16/2022] Open
Abstract
Bone metastasis is among the most frequent in diseases to patients suffering from metastatic cancer, such as breast or prostate cancer. A popular diagnostic method is bone scintigraphy where the whole body of the patient is scanned. However, hot spots that are presented in the scanned image can be misleading, making the accurate and reliable diagnosis of bone metastasis a challenge. Artificial intelligence can play a crucial role as a decision support tool to alleviate the burden of generating manual annotations on images and therefore prevent oversights by medical experts. So far, several state-of-the-art convolutional neural networks (CNN) have been employed to address bone metastasis diagnosis as a binary or multiclass classification problem achieving adequate accuracy (higher than 90%). However, due to their increased complexity (number of layers and free parameters), these networks are severely dependent on the number of available training images that are typically limited within the medical domain. Our study was dedicated to the use of a new deep learning architecture that overcomes the computational burden by using a convolutional neural network with a significantly lower number of floating-point operations (FLOPs) and free parameters. The proposed lightweight look-behind fully convolutional neural network was implemented and compared with several well-known powerful CNNs, such as ResNet50, VGG16, Inception V3, Xception, and MobileNet on an imaging dataset of moderate size (778 images from male subjects with prostate cancer). The results prove the superiority of the proposed methodology over the current state-of-the-art on identifying bone metastasis. The proposed methodology demonstrates a unique potential to revolutionize image-based diagnostics enabling new possibilities for enhanced cancer metastasis monitoring and treatment.
Collapse
Affiliation(s)
- Charis Ntakolia
- Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, 35100 Lamia, Greece;
| | - Dimitrios E. Diamantis
- Department of Computer Science and Biomedical Informatics, School of Science, University of Thessaly, 35100 Lamia, Greece;
| | - Nikolaos Papandrianos
- Department of Energy Systems, Faculty of Technology, Geopolis Campus, University of Thessaly, Larissa-Trikala Ring Road, 41500 Larissa, Greece;
| | | | - Elpiniki I. Papageorgiou
- Department of Energy Systems, Faculty of Technology, Geopolis Campus, University of Thessaly, Larissa-Trikala Ring Road, 41500 Larissa, Greece;
| |
Collapse
|
15
|
Papandrianos N, Papageorgiou EI, Anagnostis A. Development of Convolutional Neural Networks to identify bone metastasis for prostate cancer patients in bone scintigraphy. Ann Nucl Med 2020; 34:824-832. [PMID: 32839920 DOI: 10.1007/s12149-020-01510-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Accepted: 08/04/2020] [Indexed: 12/21/2022]
Abstract
OBJECTIVE The main aim of this work is to build a robust Convolutional Neural Network (CNN) algorithm that efficiently and quickly classifies bone scintigraphy images, by determining the presence or absence of prostate cancer metastasis. METHODS CNN, widely applied in medical image classification, was used for bone scintigraphy image classification. The retrospective study included 778 sequential male patients who underwent whole-body bone scans. A nuclear medicine physician classified all the cases into 3 categories: (1) normal, (2) malignant, and (3) degenerative, which were used as the gold standard. RESULTS An efficient CNN architecture was built, based on CNN exploration performance, achieving high prediction accuracy. The results showed that the method is sufficiently precise when it comes to differentiating a bone metastasis from other either degenerative changes or normal tissue (overall classification accuracy = 91.42% ± 1.64%). To strengthen the outcomes of this study the authors further compared the best performing CNN method to other popular CNN architectures for medical imaging, like ResNet50, VGG16 and GoogleNet, as reported in the literature. CONCLUSIONS The prediction results reveal the efficacy of the proposed CNN-based approach and its ability for an easier and more precise interpretation of whole-body images in bone metastasis diagnosis for prostate cancer patients in nuclear medicine. This leads to marked effects on the diagnostic accuracy and decision-making regarding the treatment to be applied.
Collapse
Affiliation(s)
- Nikolaos Papandrianos
- Department of Energy Systems, Faculty of Technology, University of Thessaly, Geopolis Campus, Larissa - Trikala Ring Road, 41500, Larissa, Greece.
| | - Elpiniki I Papageorgiou
- Department of Energy Systems, Faculty of Technology, University of Thessaly, Geopolis Campus, Larissa - Trikala Ring Road, 41500, Larissa, Greece.,Institute for Bio-economy and Agri-technology, Center for Research and Technology Hellas, Thessaloníki, Greece
| | - Athanasios Anagnostis
- Computer Science & Telecommunications Department, University of Thessaly, 35131, Lamia, Greece.,Institute for Bio-economy and Agri-technology, Center for Research and Technology Hellas, Thessaloníki, Greece
| |
Collapse
|
16
|
Papandrianos N, Papageorgiou E, Anagnostis A, Papageorgiou K. Bone metastasis classification using whole body images from prostate cancer patients based on convolutional neural networks application. PLoS One 2020; 15:e0237213. [PMID: 32797099 PMCID: PMC7428190 DOI: 10.1371/journal.pone.0237213] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2019] [Accepted: 07/22/2020] [Indexed: 12/21/2022] Open
Abstract
Bone metastasis is one of the most frequent diseases in prostate cancer; scintigraphy imaging is particularly important for the clinical diagnosis of bone metastasis. Up to date, minimal research has been conducted regarding the application of machine learning with emphasis on modern efficient convolutional neural networks (CNNs) algorithms, for the diagnosis of prostate cancer metastasis from bone scintigraphy images. The advantageous and outstanding capabilities of deep learning, machine learning's groundbreaking technological advancement, have not yet been fully investigated regarding their application in computer-aided diagnosis systems in the field of medical image analysis, such as the problem of bone metastasis classification in whole-body scans. In particular, CNNs are gaining great attention due to their ability to recognize complex visual patterns, in the same way as human perception operates. Considering all these new enhancements in the field of deep learning, a set of simpler, faster and more accurate CNN architectures, designed for classification of metastatic prostate cancer in bones, is explored. This research study has a two-fold goal: to create and also demonstrate a set of simple but robust CNN models for automatic classification of whole-body scans in two categories, malignant (bone metastasis) or healthy, using solely the scans at the input level. Through a meticulous exploration of CNN hyper-parameter selection and fine-tuning, the best architecture is selected with respect to classification accuracy. Thus a CNN model with improved classification capabilities for bone metastasis diagnosis is produced, using bone scans from prostate cancer patients. The achieved classification testing accuracy is 97.38%, whereas the average sensitivity is approximately 95.8%. Finally, the best-performing CNN method is compared to other popular and well-known CNN architectures used for medical imaging, like VGG16, ResNet50, GoogleNet and MobileNet. The classification results show that the proposed CNN-based approach outperforms the popular CNN methods in nuclear medicine for metastatic prostate cancer diagnosis in bones.
Collapse
Affiliation(s)
| | - Elpiniki Papageorgiou
- Faculty of Technology, Dept. of Energy Systems, University of Thessaly, Geopolis Campus, Larisa, Greece
- Institute for Bio-economy and Agri-technology, Center for Research and Technology Hellas, Greece
| | - Athanasios Anagnostis
- Institute for Bio-economy and Agri-technology, Center for Research and Technology Hellas, Greece
- Department of Computer Science and Telecommunications, University of Thessaly, Lamia, Greece
| | | |
Collapse
|
17
|
Zhang J, Ma W, Wu H, Wang J, Lin Y, Wang X, Zhang C. Analysis of Homogeneous and Heterogeneous Factors for Bone Metastasis in Esophageal Cancer. Med Sci Monit 2019; 25:9416-9425. [PMID: 31821313 PMCID: PMC6924131 DOI: 10.12659/msm.920483] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Esophageal cancer is a common cancer worldwide. We performed the present study to assess the homogeneous and heterogeneous risk and prognostic factors of bone metastasis (BM) in esophageal cancer patients using data extracted from the Surveillance, Epidemiology, and End Results (SEER) database. MATERIAL AND METHODS Data from patients with esophageal cancer in the SEER database from 2010 to 2016 were extracted to reveal the risk factors for BM through univariable and multivariable logistic regression. Cox hazard regression analysis was used to evaluate the prognostic factors in esophageal cancer patients with BM from 2010 to 2015. RESULTS A total of 2075 (8.0%) patients with initial bone metastasis were diagnosed from among 25 955 patients with esophageal cancer from 2010 to 2016. Male sex, T4 stage, brain metastasis, and liver metastasis were common risk factors for the occurrence and prognosis of BM. Patients with age younger than 67 years, grade III, higher N stage (N1, N2, and N3), histological subtype of esophageal adenocarcinoma or others, and lung metastasis were also more likely to experience bone metastasis, while unmarried patients were associated with shorter survival. CONCLUSIONS The prevalence of initial bone metastasis was approximately 8.0% in esophageal cancer patients. More attention should be paid to patients with revealed risk and prognostic factors because these factors can guide individualize bone metastasis screening and treatment of esophageal cancer patients.
Collapse
Affiliation(s)
- Jin Zhang
- Department of Bone and Soft Tissue Tumors, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China (mainland)
| | - Wenjuan Ma
- Department of Breast Imaging, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China (mainland)
| | - Haixiao Wu
- Department of Bone and Soft Tissue Tumors, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China (mainland)
| | - Jun Wang
- Department of Oncology, Radiology and Nuclear Medicine, Medical Institute of Peoples' Friendship University of Russia, Moscow, Russian Federation
| | - Yile Lin
- Department of Bone and Soft Tissue Tumors, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China (mainland)
| | - Xin Wang
- Department of Epidemiology and Biostatistics, First Affiliated Hospital, Army Medical University, Chongqing, China (mainland)
| | - Chao Zhang
- Department of Bone and Soft Tissue Tumors, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Tianjin, China (mainland)
| |
Collapse
|