1
|
Tian J, Wang K, Wu P, Li J, Zhang X, Wang X. Development of a deep learning model for detecting lumbar vertebral fractures on CT images: An external validation. Eur J Radiol 2024; 180:111685. [PMID: 39197270 DOI: 10.1016/j.ejrad.2024.111685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 05/31/2024] [Accepted: 08/14/2024] [Indexed: 09/01/2024]
Abstract
OBJECTIVE To develop and externally validate a binary classification model for lumbar vertebral body fractures based on CT images using deep learning methods. METHODS This study involved data collection from two hospitals for AI model training and external validation. In Cohort A from Hospital 1, CT images from 248 patients, comprising 1508 vertebrae, revealed that 20.9% had fractures (315 vertebrae) and 79.1% were non-fractured (1193 vertebrae). In Cohort B from Hospital 2, CT images from 148 patients, comprising 887 vertebrae, indicated that 14.8% had fractures (131 vertebrae) and 85.2% were non-fractured (756 vertebrae). The AI model for lumbar spine fractures underwent two stages: vertebral body segmentation and fracture classification. The first stage utilized a 3D V-Net convolutional deep neural network, which produced a 3D segmentation map. From this map, region of each vertebra body were extracted and then input into the second stage of the algorithm. The second stage employed a 3D ResNet convolutional deep neural network to classify each proposed region as positive (fractured) or negative (not fractured). RESULTS The AI model's accuracy for detecting vertebral fractures in Cohort A's training set (n = 1199), validation set (n = 157), and test set (n = 152) was 100.0 %, 96.2 %, and 97.4 %, respectively. For Cohort B (n = 148), the accuracy was 96.3 %. The area under the receiver operating characteristic curve (AUC-ROC) values for the training, validation, and test sets of Cohort A, as well as Cohort B, and their 95 % confidence intervals (CIs) were as follows: 1.000 (1.000, 1.000), 0.978 (0.944, 1.000), 0.986 (0.969, 1.000), and 0.981 (0.970, 0.992). The area under the precision-recall curve (AUC-PR) values were 1.000 (0.996, 1.000), 0.964 (0.927, 0.985), 0.907 (0.924, 0.984), and 0.890 (0.846, 0.971), respectively. According to the DeLong test, there was no significant difference in the AUC-ROC values between the test set of Cohort A and Cohort B, both for the overall data and for each specific vertebral location (all P>0.05). CONCLUSION The developed model demonstrates promising diagnostic accuracy and applicability for detecting lumbar vertebral fractures.
Collapse
Affiliation(s)
- Jingyi Tian
- Department of Radiology, Peking University First Hospital, Beijing, China; Department of Radiology, Beijing Water Conservancy Hospital, Beijing, China
| | - Kexin Wang
- School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Pengsheng Wu
- Beijing Smart Tree Medical Technology Co. Ltd., Beijing, China
| | - Jialun Li
- Beijing Smart Tree Medical Technology Co. Ltd., Beijing, China
| | - Xiaodong Zhang
- Department of Radiology, Peking University First Hospital, Beijing, China
| | - Xiaoying Wang
- Department of Radiology, Peking University First Hospital, Beijing, China.
| |
Collapse
|
2
|
Choi E, Park D, Son G, Bak S, Eo T, Youn D, Hwang D. Weakly supervised deep learning for diagnosis of multiple vertebral compression fractures in CT. Eur Radiol 2024; 34:3750-3760. [PMID: 37973631 DOI: 10.1007/s00330-023-10394-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 08/08/2023] [Accepted: 09/11/2023] [Indexed: 11/19/2023]
Abstract
OBJECTIVE This study aims to develop a weakly supervised deep learning (DL) model for vertebral-level vertebral compression fracture (VCF) classification using image-level labelled data. METHODS The training set included 815 patients with normal (n = 507, 62%) or VCFs (n = 308, 38%). Our proposed model was trained on image-level labelled data for vertebral-level classification. Another supervised DL model was trained with vertebral-level labelled data to compare the performance of the proposed model. RESULTS The test set included 227 patients with normal (n = 117, 52%) or VCFs (n = 110, 48%). For a fair comparison of the two models, we compared sensitivities with the same specificities of the proposed model and the vertebral-level supervised model. The specificity for overall L1-L5 performance was 0.981. The proposed model may outperform the vertebral-level supervised model with sensitivities of 0.770 vs 0.705 (p = 0.080), respectively. For vertebral-level analysis, the specificities for each L1-L5 were 0.974, 0.973, 0.970, 0.991, and 0.995, respectively. The proposed model yielded the same or better sensitivity than the vertebral-level supervised model in L1 (0.750 vs 0.694, p = 0.480), L3 (0.793 vs 0.586, p < 0.05), L4 (0.833 vs 0.667, p = 0.480), and L5 (0.600 vs 0.600, p = 1.000), respectively. The proposed model showed lower sensitivity than the vertebral-level supervised model for L2, but there was no significant difference (0.775 vs 0.825, p = 0.617). CONCLUSIONS The proposed model may have a comparable or better performance than the supervised model in vertebral-level VCF classification. CLINICAL RELEVANCE STATEMENT Vertebral-level vertebral compression fracture classification aids in devising patient-specific treatment plans by identifying the precise vertebrae affected by compression fractures. KEY POINTS • Our proposed weakly supervised method may have comparable or better performance than the supervised method for vertebral-level vertebral compression fracture classification. • The weakly supervised model could have classified cases with multiple vertebral compression fractures at the vertebral-level, even if the model was trained with image-level labels. • Our proposed method could help reduce radiologists' labour because it enables vertebral-level classification from image-level labels.
Collapse
Affiliation(s)
- Euijoon Choi
- Department of Artificial Intelligence, Yonsei University, Seoul, Republic of Korea
| | - Doohyun Park
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Geonhui Son
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | | | - Taejoon Eo
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Daemyung Youn
- School of Management of Technology, Yonsei University, Seoul, Republic of Korea
| | - Dosik Hwang
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea.
- Center for Healthcare Robotics, Korea Institute of Science and Technology, 5, Hwarang-Ro 14-Gil, Seongbuk-Gu, Seoul, 02792, Republic of Korea.
- Department of Oral and Maxillofacial Radiology, Yonsei University College of Dentistry, Seoul, Republic of Korea.
- Department of Radiology and Center for Clinical Imaging Data Science (CCIDS), Yonsei University College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
3
|
Jung J, Dai J, Liu B, Wu Q. Artificial intelligence in fracture detection with different image modalities and data types: A systematic review and meta-analysis. PLOS DIGITAL HEALTH 2024; 3:e0000438. [PMID: 38289965 PMCID: PMC10826962 DOI: 10.1371/journal.pdig.0000438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 12/25/2023] [Indexed: 02/01/2024]
Abstract
Artificial Intelligence (AI), encompassing Machine Learning and Deep Learning, has increasingly been applied to fracture detection using diverse imaging modalities and data types. This systematic review and meta-analysis aimed to assess the efficacy of AI in detecting fractures through various imaging modalities and data types (image, tabular, or both) and to synthesize the existing evidence related to AI-based fracture detection. Peer-reviewed studies developing and validating AI for fracture detection were identified through searches in multiple electronic databases without time limitations. A hierarchical meta-analysis model was used to calculate pooled sensitivity and specificity. A diagnostic accuracy quality assessment was performed to evaluate bias and applicability. Of the 66 eligible studies, 54 identified fractures using imaging-related data, nine using tabular data, and three using both. Vertebral fractures were the most common outcome (n = 20), followed by hip fractures (n = 18). Hip fractures exhibited the highest pooled sensitivity (92%; 95% CI: 87-96, p< 0.01) and specificity (90%; 95% CI: 85-93, p< 0.01). Pooled sensitivity and specificity using image data (92%; 95% CI: 90-94, p< 0.01; and 91%; 95% CI: 88-93, p < 0.01) were higher than those using tabular data (81%; 95% CI: 77-85, p< 0.01; and 83%; 95% CI: 76-88, p < 0.01), respectively. Radiographs demonstrated the highest pooled sensitivity (94%; 95% CI: 90-96, p < 0.01) and specificity (92%; 95% CI: 89-94, p< 0.01). Patient selection and reference standards were major concerns in assessing diagnostic accuracy for bias and applicability. AI displays high diagnostic accuracy for various fracture outcomes, indicating potential utility in healthcare systems for fracture diagnosis. However, enhanced transparency in reporting and adherence to standardized guidelines are necessary to improve the clinical applicability of AI. Review Registration: PROSPERO (CRD42021240359).
Collapse
Affiliation(s)
- Jongyun Jung
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| | - Jingyuan Dai
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| | - Bowen Liu
- Department of Mathematics and Statistics, Division of Computing, Analytics, and Mathematics, School of Science and Engineering (Bowen Liu), University of Missouri-Kansas City, Kansas City, Missouri, United States of America
| | - Qing Wu
- Department of Biomedical Informatics (Dr. Qing Wu, Jongyun Jung, and Jingyuan Dai), College of Medicine, The Ohio State University, Columbus, Ohio, United States of America
| |
Collapse
|
4
|
Wang X, Zhou D, Kong Y, Cheng N, Gao M, Zhang G, Ma J, Chen Y, Ge S. Value of 18F-FDG-PET/CT radiomics combined with clinical variables in the differential diagnosis of malignant and benign vertebral compression fractures. EJNMMI Res 2023; 13:89. [PMID: 37819414 PMCID: PMC10567613 DOI: 10.1186/s13550-023-01038-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 09/20/2023] [Indexed: 10/13/2023] Open
Abstract
BACKGROUND Vertebral compression fractures (VCFs) are common clinical problems that arise from various reasons. The differential diagnosis of benign and malignant VCFs is challenging. This study was designed to develop and validate a radiomics model to predict benign and malignant VCFs with 18F-fluorodeoxyglucose-positron emission tomography/computed tomography (18F-FDG-PET/CT). RESULTS Twenty-six features (9 PET features and 17 CT features) and eight clinical variables (age, SUVmax, SUVpeak, SULmax, SULpeak, osteolytic destruction, fracture line, and appendices/posterior vertebrae involvement) were ultimately selected. The area under the curve (AUCs) of the radiomics and clinical-radiomics models were significantly different from that of the clinical model in both the training group (0.986, 0.987 vs. 0.884, p < 0.05) and test group (0.962, 0.948 vs. 0.858, p < 0.05), while there was no significant difference between the radiomics model and clinical-radiomics model (p > 0.05). The accuracies of the radiomics and clinical-radiomics models were 94.0% and 95.0% in the training group and 93.2% and 93.2% in the test group, respectively. The three models all showed good calibration (Hosmer-Lemeshow test, p > 0.05). According to the decision curve analysis (DCA), the radiomics model and clinical-radiomics model exhibited higher overall net benefit than the clinical model. CONCLUSIONS The PET/CT-based radiomics and clinical-radiomics models showed good performance in distinguishing between malignant and benign VCFs. The radiomics method may be valuable for treatment decision-making.
Collapse
Affiliation(s)
- Xun Wang
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Dandan Zhou
- Big Data and Artificial Intelligence, Jining Polytechnic, Jinyu Road, Jining, Shandong, China
| | - Yu Kong
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Nan Cheng
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Ming Gao
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Guqing Zhang
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Junli Ma
- Department of Radiation Oncology, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China
| | - Yueqin Chen
- Department of Medical Imaging, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China.
| | - Shuang Ge
- Department of Radiation Oncology, Affiliated Hospital of Jining Medical University, Guhuai Road, Jining, Shandong, China.
| |
Collapse
|
5
|
Xiao BH, Zhu MSY, Du EZ, Liu WH, Ma JB, Huang H, Gong JS, Diacinti D, Zhang K, Gao B, Liu H, Jiang RF, Ji ZY, Xiong XB, He LC, Wu L, Xu CJ, Du MM, Wang XR, Chen LM, Wu KY, Yang L, Xu MS, Diacinti D, Dou Q, Kwok TYC, Wáng YXJ. A software program for automated compressive vertebral fracture detection on elderly women's lateral chest radiograph: Ofeye 1.0. Quant Imaging Med Surg 2022; 12:4259-4271. [PMID: 35919046 PMCID: PMC9338385 DOI: 10.21037/qims-22-433] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 05/25/2022] [Indexed: 11/17/2022]
Abstract
Background Because osteoporotic vertebral fracture (OVF) on chest radiographs is commonly missed in radiological reports, we aimed to develop a software program which offers automated detection of compressive vertebral fracture (CVF) on lateral chest radiographs, and which emphasizes CVF detection specificity with a low false positivity rate. Methods For model training, we retrieved 3,991 spine radiograph cases and 1,979 chest radiograph cases from 16 sources, with among them in total 1,404 cases had OVF. For model testing, we retrieved 542 chest radiograph cases and 162 spine radiograph cases from four independent clinics, with among them 215 cases had OVF. All cases were female subjects, and except for 31 training data cases which were spine trauma cases, all the remaining cases were post-menopausal women. Image data included DICOM (Digital Imaging and Communications in Medicine) format, hard film scanned PNG (Portable Network Graphics) format, DICOM exported PNG format, and PACS (Picture Archiving and Communication System) downloaded resolution reduced DICOM format. OVF classification included: minimal and mild grades with <20% or ≥20-25% vertebral height loss respectively, moderate grade with ≥25-40% vertebral height loss, severe grade with ≥40%-2/3 vertebral height loss, and collapsed grade with ≥2/3 vertebral height loss. The CVF detection base model was mainly composed of convolution layers that include convolution kernels of different sizes, pooling layers, up-sampling layers, feature merging layers, and residual modules. When the model loss function could not be further decreased with additional training, the model was considered to be optimal and termed 'base-model 1.0'. A user-friendly interface was also developed, with the synthesized software termed 'Ofeye 1.0'. Results Counting cases and with minimal and mild OVFs included, base-model 1.0 demonstrated a specificity of 97.1%, a sensitivity of 86%, and an accuracy of 93.9% for the 704 testing cases. In total, 33 OVFs in 30 cases had a false negative reading, which constituted a false negative rate of 14.0% (30/215) by counting all OVF cases. Eighteen OVFs in 15 cases had OVFs of ≥ moderate grades missed, which constituted a false negative rate of 7.0% (15/215, i.e., sensitivity 93%) if only counting cases with ≥ moderate grade OVFs missed. False positive reading was recorded in 13 vertebrae in 13 cases (one vertebra in each case), which constituted a false positivity rate of 2.7% (13/489). These vertebrae with false positivity labeling could be readily differentiated from a true OVF by a human reader. The software Ofeye 1.0 allows 'batch processing', for example, 100 radiographs can be processed in a single operation. This software can be integrated into hospital PACS, or installed in a standalone personal computer. Conclusions A user-friendly software program was developed for CVF detection on elderly women's lateral chest radiographs. It has an overall low false positivity rate, and for moderate and severe CVFs an acceptably low false negativity rate. The integration of this software into radiological practice is expected to improve osteoporosis management for elderly women.
Collapse
Affiliation(s)
- Ben-Heng Xiao
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | | | - Er-Zhu Du
- Department of Radiology, Dongguan Traditional Chinese Medicine Hospital, Dongguan, China
| | - Wei-Hong Liu
- Department of Radiology, General Hospital of China Resources & Wuhan Iron and Steel Corporation, Wuhan, China
| | - Jian-Bing Ma
- Department of Radiology, the First Hospital of Jiaxing, The Affiliated Hospital of Jiaxing University, Jiaxing, China
| | - Hua Huang
- Department of Radiology, The Third People’s Hospital of Shenzhen, The Second Affiliated Hospital of Southern University of Science and Technology, National Clinical Research Center for Infectious Diseases, Shenzhen, China
| | - Jing-Shan Gong
- Department of Radiology, Shenzhen People’s Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Davide Diacinti
- Department of Radiological Sciences, Oncology and Pathology, Sapienza University of Rome, Sapienza University of Rome, Rome, Italy
- Department of Diagnostic and Molecular Imaging, Radiology and Radiotherapy, University Foundation Hospital Tor Vergata, Rome, Italy
| | - Kun Zhang
- Department of Radiology, First Affiliated Hospital of Hunan University of Chinese Medicine, Changsha, China
| | - Bo Gao
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Heng Liu
- Department of Radiology, the Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Ri-Feng Jiang
- Department of Radiology, Fujian Medical University Union Hospital, Fuzhou, China
| | - Zhong-You Ji
- PET-CT Center, Fujian Medical University Union Hospital, Fuzhou, China
| | - Xiao-Bao Xiong
- Department of Radiology, Zhejiang Provincial Tongde Hospital, Hangzhou, China
| | - Lai-Chang He
- Department of Radiology, the First Affiliated Hospital of Nanchang University, Nanchang, China
| | - Lei Wu
- Department of Radiology, the First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Chuan-Jun Xu
- Department of Radiology, The Second Hospital of Nanjing, Nanjing University of Chinese Medicine, Nanjing, China
| | - Mei-Mei Du
- Department of Radiology, The Second Affiliated Hospital and Yuying Children's Hospital, Wenzhou Medical University, Wenzhou, China
| | - Xiao-Rong Wang
- Department of Radiology, Ningbo First Hospital, Ningbo, China
| | - Li-Mei Chen
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Kong-Yang Wu
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
- College of Electrical and Information Engineering, Jinan University, Guangzhou, China
| | - Liu Yang
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Mao-Sheng Xu
- Department of Radiology, the First Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, China
| | - Daniele Diacinti
- Department of Radiological Sciences, Oncology and Pathology, Sapienza University of Rome, Sapienza University of Rome, Rome, Italy
| | - Qi Dou
- Department of Computer Science and Engineering, Faculty of Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Timothy Y. C. Kwok
- JC Centre for Osteoporosis Care and Control, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Yì Xiáng J. Wáng
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|