Artificial intelligence in musculoskeletal imaging: realistic clinical applications in the next decade

This article will provide a perspective review of the most extensively investigated deep learning (DL) applications for musculoskeletal disease detection that have the best potential to translate into routine clinical practice over the next decade. Deep learning methods for detecting fractures, estimating pediatric bone age, calculating bone measurements such as lower extremity alignment and Cobb angle, and grading osteoarthritis on radiographs have been shown to have high diagnostic performance with many of these applications now commercially available for use in clinical practice. Many studies have also documented the feasibility of using DL methods for detecting joint pathology and characterizing bone tumors on magnetic resonance imaging (MRI). However, musculoskeletal disease detection on MRI is difficult as it requires multi-task, multi-class detection of complex abnormalities on multiple image slices with different tissue contrasts. The generalizability of DL methods for musculoskeletal disease detection on MRI is also challenging due to fluctuations in image quality caused by the wide variety of scanners and pulse sequences used in routine MRI protocols. The diagnostic performance of current DL methods for musculoskeletal disease detection must be further evaluated in well-designed prospective studies using large image datasets acquired at different institutions with different imaging parameters and imaging hardware before they can be fully implemented in clinical practice. Future studies must also investigate the true clinical benefits of current DL methods and determine whether they could enhance quality, reduce error rates, improve workflow, and decrease radiologist fatigue and burnout with all of this weighed against the costs.

Simultaneous automated ascertainment of prevalent vertebral fracture and abdominal aortic calcification in clinical practice: role in fracture risk assessment

Whether simultaneous automated ascertainments of prevalent vertebral fracture (auto-PVFx) and abdominal aortic calcification (auto-AAC) on vertebral fracture assessment (VFA) lateral spine bone density (BMD) images jointly predict incident fractures in routine clinical practice is unclear. We estimated the independent associations of auto-PVFx and auto-AAC primarily with incident major osteoporotic and secondarily with incident hip and any clinical fractures in 11 013 individuals (mean [SD] age 75.8 [6.8] years, 93.3% female) who had a BMD test combined with VFA between March 2010 and December 2017. Auto-PVFx and auto-AAC were ascertained using convolutional neural networks (CNNs). Proportional hazards models were used to estimate the associations of auto-PVFx and auto-AAC with incident fractures over a mean (SD) follow-up of 3.7 (2.2) years, adjusted for each other and other risk factors. At baseline, 17% (n = 1881) had auto-PVFx and 27% (n = 2974) had a high level of auto-AAC (≥ 6 on scale of 0 to 24). Multivariable-adjusted hazard ratios (HR) for incident major osteoporotic fracture (95% CI) were 1.85 (1.59, 2.15) for those with compared with those without auto-PVFx, and 1.36 (1.14, 1.62) for those with high compared with low auto-AAC. The multivariable-adjusted HRs for incident hip fracture were 1.62 (95% CI, 1.26 to 2.07) for those with compared to those without auto-PVFx, and 1.55 (95% CI, 1.15 to 2.09) for those high auto-AAC compared with low auto-AAC. The 5-year cumulative incidence of major osteoporotic fracture was 7.1% in those with no auto-PVFx and low auto-AAC, 10.1% in those with no auto-PVFx and high auto-AAC, 13.4% in those with auto-PVFx and low auto-AAC, and 18.0% in those with auto-PVFx and high auto-AAC. While physician manual review of images in clinical practice will still be needed to confirm image quality and provide clinical context for interpretation, simultaneous automated ascertainment of auto-PVFx and auto-AAC can aid fracture risk assessment.

A Computed Tomography-Based Fracture Prediction Model With Images of Vertebral Bones and Muscles by Employing Deep Learning: Development and Validation Study

BACKGROUND

With the progressive increase in aging populations, the use of opportunistic computed tomography (CT) scanning is increasing, which could be a valuable method for acquiring information on both muscles and bones of aging populations.

OBJECTIVE

The aim of this study was to develop and externally validate opportunistic CT-based fracture prediction models by using images of vertebral bones and paravertebral muscles.

METHODS

The models were developed based on a retrospective longitudinal cohort study of 1214 patients with abdominal CT images between 2010 and 2019. The models were externally validated in 495 patients. The primary outcome of this study was defined as the predictive accuracy for identifying vertebral fracture events within a 5-year follow-up. The image models were developed using an attention convolutional neural network-recurrent neural network model from images of the vertebral bone and paravertebral muscles.

RESULTS

The mean ages of the patients in the development and validation sets were 73 years and 68 years, and 69.1% (839/1214) and 78.8% (390/495) of them were females, respectively. The areas under the receiver operator curve (AUROCs) for predicting vertebral fractures were superior in images of the vertebral bone and paravertebral muscles than those in the bone-only images in the external validation cohort (0.827, 95% CI 0.821-0.833 vs 0.815, 95% CI 0.806-0.824, respectively; P<.001). The AUROCs of these image models were higher than those of the fracture risk assessment models (0.810 for major osteoporotic risk, 0.780 for hip fracture risk). For the clinical model using age, sex, BMI, use of steroids, smoking, possible secondary osteoporosis, type 2 diabetes mellitus, HIV, hepatitis C, and renal failure, the AUROC value in the external validation cohort was 0.749 (95% CI 0.736-0.762), which was lower than that of the image model using vertebral bones and muscles (P<.001).

CONCLUSIONS

The model using the images of the vertebral bone and paravertebral muscle showed better performance than that using the images of the bone-only or clinical variables. Opportunistic CT screening may contribute to identifying patients with a high fracture risk in the future.

Deep learning in the radiologic diagnosis of osteoporosis: a literature review

OBJECTIVE

Osteoporosis is a systemic bone disease characterized by low bone mass, damaged bone microstructure, increased bone fragility, and susceptibility to fractures. With the rapid development of artificial intelligence, a series of studies have reported deep learning applications in the screening and diagnosis of osteoporosis. The aim of this review was to summary the application of deep learning methods in the radiologic diagnosis of osteoporosis.

METHODS

We conducted a two-step literature search using the PubMed and Web of Science databases. In this review, we focused on routine radiologic methods, such as X-ray, computed tomography, and magnetic resonance imaging, used to opportunistically screen for osteoporosis.

RESULTS

A total of 40 studies were included in this review. These studies were divided into three categories: osteoporosis screening (n = 20), bone mineral density prediction (n = 13), and osteoporotic fracture risk prediction and detection (n = 7).

CONCLUSIONS

Deep learning has demonstrated a remarkable capacity for osteoporosis screening. However, clinical commercialization of a diagnostic model for osteoporosis remains a challenge.

Harnessing ResNet50 and SENet for enhanced ankle fracture identification

BACKGROUND

Ankle fractures are prevalent injuries that necessitate precise diagnostic tools. Traditional diagnostic methods have limitations that can be addressed using machine learning techniques, with the potential to improve accuracy and expedite diagnoses.

METHODS

We trained various deep learning architectures, notably the Adapted ResNet50 with SENet capabilities, to identify ankle fractures using a curated dataset of radiographic images. Model performance was evaluated using common metrics like accuracy, precision, and recall. Additionally, Grad-CAM visualizations were employed to interpret model decisions.

RESULTS

The Adapted ResNet50 with SENet capabilities consistently outperformed other models, achieving an accuracy of 93%, AUC of 95%, and recall of 92%. Grad-CAM visualizations provided insights into areas of the radiographs that the model deemed significant in its decisions.

CONCLUSIONS

The Adapted ResNet50 model enhanced with SENet capabilities demonstrated superior performance in detecting ankle fractures, offering a promising tool to complement traditional diagnostic methods. However, continuous refinement and expert validation are essential to ensure optimal application in clinical settings.

Machine Learning and Deep Learning in Spinal Injury: A Narrative Review of Algorithms in Diagnosis and Prognosis

Spinal injuries, including cervical and thoracolumbar fractures, continue to be a major public health concern. Recent advancements in machine learning and deep learning technologies offer exciting prospects for improving both diagnostic and prognostic approaches in spinal injury care. This narrative review systematically explores the practical utility of these computational methods, with a focus on their application in imaging techniques such as computed tomography (CT) and magnetic resonance imaging (MRI), as well as in structured clinical data. Of the 39 studies included, 34 were focused on diagnostic applications, chiefly using deep learning to carry out tasks like vertebral fracture identification, differentiation between benign and malignant fractures, and AO fracture classification. The remaining five were prognostic, using machine learning to analyze parameters for predicting outcomes such as vertebral collapse and future fracture risk. This review highlights the potential benefit of machine learning and deep learning in spinal injury care, especially their roles in enhancing diagnostic capabilities, detailed fracture characterization, risk assessments, and individualized treatment planning.

Artificial intelligence in fracture detection with different image modalities and data types: A systematic review and meta-analysis

Artificial Intelligence (AI), encompassing Machine Learning and Deep Learning, has increasingly been applied to fracture detection using diverse imaging modalities and data types. This systematic review and meta-analysis aimed to assess the efficacy of AI in detecting fractures through various imaging modalities and data types (image, tabular, or both) and to synthesize the existing evidence related to AI-based fracture detection. Peer-reviewed studies developing and validating AI for fracture detection were identified through searches in multiple electronic databases without time limitations. A hierarchical meta-analysis model was used to calculate pooled sensitivity and specificity. A diagnostic accuracy quality assessment was performed to evaluate bias and applicability. Of the 66 eligible studies, 54 identified fractures using imaging-related data, nine using tabular data, and three using both. Vertebral fractures were the most common outcome (n = 20), followed by hip fractures (n = 18). Hip fractures exhibited the highest pooled sensitivity (92%; 95% CI: 87-96, p< 0.01) and specificity (90%; 95% CI: 85-93, p< 0.01). Pooled sensitivity and specificity using image data (92%; 95% CI: 90-94, p< 0.01; and 91%; 95% CI: 88-93, p < 0.01) were higher than those using tabular data (81%; 95% CI: 77-85, p< 0.01; and 83%; 95% CI: 76-88, p < 0.01), respectively. Radiographs demonstrated the highest pooled sensitivity (94%; 95% CI: 90-96, p < 0.01) and specificity (92%; 95% CI: 89-94, p< 0.01). Patient selection and reference standards were major concerns in assessing diagnostic accuracy for bias and applicability. AI displays high diagnostic accuracy for various fracture outcomes, indicating potential utility in healthcare systems for fracture diagnosis. However, enhanced transparency in reporting and adherence to standardized guidelines are necessary to improve the clinical applicability of AI. Review Registration: PROSPERO (CRD42021240359).

A CT-based Deep Learning Model for Predicting Subsequent Fracture Risk in Patients with Hip Fracture

Background Patients have the highest risk of subsequent fractures in the first few years after an initial fracture, yet models to predict short-term subsequent risk have not been developed. Purpose To develop and validate a deep learning prediction model for subsequent fracture risk using digitally reconstructed radiographs from hip CT in patients with recent hip fractures. Materials and Methods This retrospective study included adult patients who underwent three-dimensional hip CT due to a fracture from January 2004 to December 2020. Two-dimensional frontal, lateral, and axial digitally reconstructed radiographs were generated and assembled to construct an ensemble model. DenseNet modules were used to calculate risk probability based on extracted image features and fracture-free probability plots were output. Model performance was assessed using the C index and area under the receiver operating characteristic curve (AUC) and compared with other models using the paired t test. Results The training and validation set included 1012 patients (mean age, 74.5 years ± 13.3 [SD]; 706 female, 113 subsequent fracture) and the test set included 468 patients (mean age, 75.9 years ± 14.0; 335 female, 22 subsequent fractures). In the test set, the ensemble model had a higher C index (0.73) for predicting subsequent fractures than that of other image-based models (C index range, 0.59-0.70 for five of six models; P value range, < .001 to < .05). The ensemble model achieved AUCs of 0.74, 0.74, and 0.73 at the 2-, 3-, and 5-year follow-ups, respectively; higher than that of most other image-based models at 2 years (AUC range, 0.57-0.71 for five of six models; P value range, < .001 to < .05) and 3 years (AUC range, 0.55-0.72 for four of six models; P value range, < .001 to < .05). Moreover, the AUCs achieved by the ensemble model were higher than that of a clinical model that included known risk factors (2-, 3-, and 5-year AUCs of 0.58, 0.64, and 0.70, respectively; P < .001 for all). Conclusion In patients with recent hip fractures, the ensemble deep learning model using digital reconstructed radiographs from hip CT showed good performance for predicting subsequent fractures in the short term. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Li and Jaremko in this issue.

Skeletal Fracture Detection with Deep Learning: A Comprehensive Review

Deep learning models have shown great promise in diagnosing skeletal fractures from X-ray images. However, challenges remain that hinder progress in this field. Firstly, a lack of clear definitions for recognition, classification, detection, and localization tasks hampers the consistent development and comparison of methodologies. The existing reviews often lack technical depth or have limited scope. Additionally, the absence of explainable facilities undermines the clinical application and expert confidence in results. To address these issues, this comprehensive review analyzes and evaluates 40 out of 337 recent papers identified in prestigious databases, including WOS, Scopus, and EI. The objectives of this review are threefold. Firstly, precise definitions are established for the bone fracture recognition, classification, detection, and localization tasks within deep learning. Secondly, each study is summarized based on key aspects such as the bones involved, research objectives, dataset sizes, methods employed, results obtained, and concluding remarks. This process distills the diverse approaches into a generalized processing framework or workflow. Moreover, this review identifies the crucial areas for future research in deep learning models for bone fracture diagnosis. These include enhancing the network interpretability, integrating multimodal clinical information, providing therapeutic schedule recommendations, and developing advanced visualization methods for clinical application. By addressing these challenges, deep learning models can be made more intelligent and specialized in this domain. In conclusion, this review fills the gap in precise task definitions within deep learning for bone fracture diagnosis and provides a comprehensive analysis of the recent research. The findings serve as a foundation for future advancements, enabling improved interpretability, multimodal integration, clinical decision support, and advanced visualization techniques.

The use of deep learning in medical imaging to improve spine care: A scoping review of current literature and clinical applications

Background

Artificial intelligence is a revolutionary technology that promises to assist clinicians in improving patient care. In radiology, deep learning (DL) is widely used in clinical decision aids due to its ability to analyze complex patterns and images. It allows for rapid, enhanced data, and imaging analysis, from diagnosis to outcome prediction. The purpose of this study was to evaluate the current literature and clinical utilization of DL in spine imaging.

Methods

This study is a scoping review and utilized the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology to review the scientific literature from 2012 to 2021. A search in PubMed, Web of Science, Embased, and IEEE Xplore databases with syntax specific for DL and medical imaging in spine care applications was conducted to collect all original publications on the subject. Specific data was extracted from the available literature, including algorithm application, algorithms tested, database type and size, algorithm training method, and outcome of interest.

Results

A total of 365 studies (total sample of 232,394 patients) were included and grouped into 4 general applications: diagnostic tools, clinical decision support tools, automated clinical/instrumentation assessment, and clinical outcome prediction. Notable disparities exist in the selected algorithms and the training across multiple disparate databases. The most frequently used algorithms were U-Net and ResNet. A DL model was developed and validated in 92% of included studies, while a pre-existing DL model was investigated in 8%. Of all developed models, only 15% of them have been externally validated.

Conclusions

Based on this scoping review, DL in spine imaging is used in a broad range of clinical applications, particularly for diagnosing spinal conditions. There is a wide variety of DL algorithms, database characteristics, and training methods. Future studies should focus on external validation of existing models before bringing them into clinical use.

Development and clinical validation of deep learning for auto-diagnosis of supraspinatus tears

BACKGROUND

Accurately diagnosing supraspinatus tears based on magnetic resonance imaging (MRI) is challenging and time-combusting due to the experience level variability of the musculoskeletal radiologists and orthopedic surgeons. We developed a deep learning-based model for automatically diagnosing supraspinatus tears (STs) using shoulder MRI and validated its feasibility in clinical practice.

MATERIALS AND METHODS

A total of 701 shoulder MRI data (2804 images) were retrospectively collected for model training and internal test. An additional 69 shoulder MRIs (276 images) were collected from patients who underwent shoulder arthroplasty and constituted the surgery test set for clinical validation. Two advanced convolutional neural networks (CNN) based on Xception were trained and optimized to detect STs. The diagnostic performance of the CNN was evaluated according to its sensitivity, specificity, precision, accuracy, and F1 score. Subgroup analyses were performed to verify its robustness, and we also compared the CNN's performance with that of 4 radiologists and 4 orthopedic surgeons on the surgery and internal test sets.

RESULTS

Optimal diagnostic performance was achieved on the 2D model, from which F1-scores of 0.824 and 0.75, and areas under the ROC curves of 0.921 (95% confidence interval, 0.841-1.000) and 0.882 (0.817-0.947) were observed on the surgery and internal test sets. For the subgroup analysis, the 2D CNN model demonstrated a sensitivity of 0.33-1.000 and 0.625-1.000 for different degrees of tears on the surgery and internal test sets, and there was no significant performance difference between 1.5 and 3.0 T data. Compared with eight clinicians, the 2D CNN model exhibited better diagnostic performance than the junior clinicians and was equivalent to senior clinicians.

CONCLUSIONS

The proposed 2D CNN model realized the adequate and efficient automatic diagnoses of STs, which achieved a comparable performance of junior musculoskeletal radiologists and orthopedic surgeons. It might be conducive to assisting poor-experienced radiologists, especially in community scenarios lacking consulting experts.

Artificial intelligence CAD tools in trauma imaging: a scoping review from the American Society of Emergency Radiology (ASER) AI/ML Expert Panel

BACKGROUND

AI/ML CAD tools can potentially improve outcomes in the high-stakes, high-volume model of trauma radiology. No prior scoping review has been undertaken to comprehensively assess tools in this subspecialty.

PURPOSE

To map the evolution and current state of trauma radiology CAD tools along key dimensions of technology readiness.

METHODS

Following a search of databases, abstract screening, and full-text document review, CAD tool maturity was charted using elements of data curation, performance validation, outcomes research, explainability, user acceptance, and funding patterns. Descriptive statistics were used to illustrate key trends.

RESULTS

A total of 4052 records were screened, and 233 full-text articles were selected for content analysis. Twenty-one papers described FDA-approved commercial tools, and 212 reported algorithm prototypes. Works ranged from foundational research to multi-reader multi-case trials with heterogeneous external data. Scalable convolutional neural network-based implementations increased steeply after 2016 and were used in all commercial products; however, options for explainability were narrow. Of FDA-approved tools, 9/10 performed detection tasks. Dataset sizes ranged from < 100 to > 500,000 patients, and commercialization coincided with public dataset availability. Cross-sectional torso datasets were uniformly small. Data curation methods with ground truth labeling by independent readers were uncommon. No papers assessed user acceptance, and no method included human-computer interaction. The USA and China had the highest research output and frequency of research funding.

CONCLUSIONS

Trauma imaging CAD tools are likely to improve patient care but are currently in an early stage of maturity, with few FDA-approved products for a limited number of uses. The scarcity of high-quality annotated data remains a major barrier.

Differentiation of acute and chronic vertebral compression fractures using conventional CT based on deep transfer learning features and hand-crafted radiomics features

BACKGROUND

We evaluated the diagnostic efficacy of deep learning radiomics (DLR) and hand-crafted radiomics (HCR) features in differentiating acute and chronic vertebral compression fractures (VCFs).

METHODS

A total of 365 patients with VCFs were retrospectively analysed based on their computed tomography (CT) scan data. All patients completed MRI examination within 2 weeks. There were 315 acute VCFs and 205 chronic VCFs. Deep transfer learning (DTL) features and HCR features were extracted from CT images of patients with VCFs using DLR and traditional radiomics, respectively, and feature fusion was performed to establish the least absolute shrinkage and selection operator. The MRI display of vertebral bone marrow oedema was used as the gold standard for acute VCF, and the model performance was evaluated using the receiver operating characteristic (ROC).To separately evaluate the effectiveness of DLR, traditional radiomics and feature fusion in the differential diagnosis of acute and chronic VCFs, we constructed a nomogram based on the clinical baseline data to visualize the classification evaluation. The predictive power of each model was compared using the Delong test, and the clinical value of the nomogram was evaluated using decision curve analysis (DCA).

RESULTS

Fifty DTL features were obtained from DLR, 41 HCR features were obtained from traditional radiomics, and 77 features fusion were obtained after feature screening and fusion of the two. The area under the curve (AUC) of the DLR model in the training cohort and test cohort were 0.992 (95% confidence interval (CI), 0.983-0.999) and 0.871 (95% CI, 0.805-0.938), respectively. While the AUCs of the conventional radiomics model in the training cohort and test cohort were 0.973 (95% CI, 0.955-0.990) and 0.854 (95% CI, 0.773-0.934), respectively. The AUCs of the features fusion model in the training cohort and test cohort were 0.997 (95% CI, 0.994-0.999) and 0.915 (95% CI, 0.855-0.974), respectively. The AUCs of nomogram constructed by the features fusion in combination with clinical baseline data were 0.998 (95% CI, 0.996-0.999) and 0.946 (95% CI, 0.906-0.987) in the training cohort and test cohort, respectively. The Delong test showed that the differences between the features fusion model and the nomogram in the training cohort and the test cohort were not statistically significant (P values were 0.794 and 0.668, respectively), and the differences in the other prediction models in the training cohort and the test cohort were statistically significant (P < 0.05). DCA showed that the nomogram had high clinical value.

CONCLUSION

The features fusion model can be used for the differential diagnosis of acute and chronic VCFs, and its differential diagnosis ability is improved when compared with that when either radiomics is used alone. At the same time, the nomogram has a high predictive value for acute and chronic VCFs and can be a potential decision-making tool to assist clinicians, especially when a patient is unable to undergo spinal MRI examination.

Opportunistic Screening Techniques for Analysis of CT Scans

PURPOSE OF REVIEW

Opportunistic screening is a combination of techniques to identify subjects of high risk for osteoporotic fracture using routine clinical CT scans prescribed for diagnoses unrelated to osteoporosis. The two main components are automated detection of vertebral fractures and measurement of bone mineral density (BMD) in CT scans, in which a phantom for calibration of CT to BMD values is not used. This review describes the particular challenges of opportunistic screening and provides an overview and comparison of current techniques used for opportunistic screening. The review further outlines the performance of opportunistic screening.

RECENT FINDINGS

A wide range of technologies for the automatic detection of vertebral fractures have been developed and successfully validated. Most of them are based on artificial intelligence algorithms. The automated differentiation of osteoporotic from traumatic fractures and vertebral deformities unrelated to osteoporosis, the grading of vertebral fracture severity, and the detection of mild vertebral fractures is still problematic. The accuracy of automated fracture detection compared to classical radiological semi-quantitative Genant scoring is about 80%. Accuracy errors of alternative BMD calibration methods compared to simultaneous phantom-based calibration used in standard quantitative CT (QCT) range from below 5% to about 10%. The impact of contrast agents, frequently administered in clinical CT on the determination of BMD and on fracture risk determination is still controversial. Opportunistic screening, the identification of vertebral fracture and the measurement of BMD using clinical routine CT scans, is feasible but corresponding techniques still need to be integrated into the clinical workflow and further validated with respect to the prediction of fracture risk.

Another look at regression analysis using ranked set samples with application to an osteoporosis study

Statistical learning with ranked set samples has shown promising results in estimating various population parameters. Despite the vast literature on rank-based statistical learning methodologies, very little effort has been devoted to studying regression analysis with such samples. A pressing issue is how to incorporate the rank information of ranked set samples into the analysis. We propose two methodologies based on a weighted least squares approach and multilevel modeling to better incorporate the rank information of such samples into the estimation and prediction processes of regression-type models. Our approaches reveal significant improvements in both estimation and prediction problems over already existing methods in the literature and the corresponding ones with simple random samples. We study the robustness of our methods with respect to the misspecification of the distribution of the error terms. Also, we show that rank-based regression models can effectively predict simple random test data by assigning ranks to them a posteriori using judgment poststratification. Theoretical results are augmented with simulations and an osteoporosis study based on a real data set from the Bone Mineral Density (BMD) program of Manitoba to estimate the BMD level of patients using easy to obtain covariates.

Current Applications of Machine Learning in Spine: From Clinical View

STUDY DESIGN

Narrative review.

OBJECTIVES

This review aims to present current applications of machine learning (ML) in spine domain to clinicians.

METHODS

We conducted a comprehensive PubMed search of peer-reviewed articles that were published between 2006 and 2020 using terms (spine, spinal, lumbar, cervical, thoracic, machine learning) to examine ML in spine. Then exclude research of other domain, case report, review or meta-analysis, and which without available abstract or full text.

RESULTS

Total 1738 articles were retrieved from database, and 292 studies were finally included. Key findings of current applications were compiled and summarized in this review. Main clinical applications of those techniques including image processing, diagnosis, decision supporting, operative assistance, rehabilitation, surgery outcomes, complications, hospitalization and cost.

CONCLUSIONS

ML had achieved excellent performance and hold immense potential in spine. ML could help clinical staff to improve medical level, enhance work efficiency, and reduce adverse events. However more randomized controlled trials and improvement of interpretability are essential to clinicians accepting models' assistance in real work.

Osteoporosis diagnosis in knee X-rays by transfer learning based on convolution neural network

Osteoporosis degrades the quality of bones and is the primary cause of fractures in the elderly and women after menopause. The high diagnostic and treatment costs urge the researchers to find a cost-effective diagnostic system to diagnose osteoporosis in the early stages. X-ray imaging is the cheapest and most common imaging technique to detect bone pathologies butmanual interpretation of x-rays for osteoporosis is difficult and extraction of required features and selection of high-performance classifiers is a very challenging task. Deep learning systems have gained the popularity in image analysis field over the last few decades. This paper proposes a convolution neural network (CNN) based approach to detect osteoporosis from x-rays. In our study, we have used the transfer learning of deep learning-based CNNs namely AlexNet, VggNet-16, ResNet, and VggNet -19 to classify the x-ray images of knee joints into normal, osteopenia, and osteoporosis disease groups. The main objectives of the current study are: (i) to present a dataset of 381 knee x-rays medically validated by the T-scores obtained from the Quantitative Ultrasound System, and (ii) to propose a deep learning approach using transfer learning to classify different stages of the disease. The performance of these classifiers is compared and the best accuracy of 91.1% is achieved by pretrained Alexnet architecture on the presented dataset with an error rate of 0.09 and validation loss of 0.54 as compared to the accuracy of 79%, an error rate of 0.21, and validation loss of 0.544 when pretrained network was not used.. The results of the study suggest that a deep learning system with transfer learning can help clinicians to detect osteoporosis in its early stages hence reducing the risk of fractures.

Definition of normal vertebral morphometry using NHANES‐II radiographs

A robust definition of normal vertebral morphometry is required to confidently identify abnormalities such as fractures. The Second National Health and Nutrition Examination Survey (NHANES‐II) collected a nationwide probability sample to document the health status of the United States. Over 10,000 lateral cervical spine and 7,000 lateral lumbar spine X‐rays were collected. Demographic, anthropometric, health, and medical history data were also collected. The coordinates of the vertebral body corners were obtained for each lumbar and cervical vertebra using previously validated, automated technology consisting of a pipeline of neural networks and coded logic. These landmarks were used to calculate six vertebral body morphometry metrics. Descriptive statistics were generated and used to identify and trim outliers from the data. Descriptive statistics were tabulated using the trimmed data for use in quantifying deviation from average for each metric. The dependency of these metrics on sex, age, race, nation of origin, height, weight, and body mass index (BMI) was also assessed. There was low variation in vertebral morphometry after accounting for vertebrae (eg, L1, L2), and the R² was high for ANOVAs. Excluding outliers, age, sex, race, nation of origin, height, weight, and BMI were statistically significant for most of the variables, though the F‐statistic was very small compared to that for vertebral level. Excluding all variables except vertebra changed the ANOVA R² very little. Reference data were generated that could be used to produce standardized metrics in units of SD from mean. This allows for easy identification of abnormalities resulting from vertebral fractures, atypical vertebral body morphometries, and other congenital or degenerative conditions. Standardized metrics also remove the effect of vertebral level, facilitating easy interpretation and enabling data for all vertebrae to be pooled in research studies. © 2022 The Authors. JBMR Plus published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research.

Development of a Spine X-Ray-Based Fracture Prediction Model Using a Deep Learning Algorithm

BACKGRUOUND

Since image-based fracture prediction models using deep learning are lacking, we aimed to develop an X-ray-based fracture prediction model using deep learning with longitudinal data.

METHODS

This study included 1,595 participants aged 50 to 75 years with at least two lumbosacral radiographs without baseline fractures from 2010 to 2015 at Seoul National University Hospital. Positive and negative cases were defined according to whether vertebral fractures developed during follow-up. The cases were divided into training (n=1,416) and test (n=179) sets. A convolutional neural network (CNN)-based prediction algorithm, DeepSurv, was trained with images and baseline clinical information (age, sex, body mass index, glucocorticoid use, and secondary osteoporosis). The concordance index (C-index) was used to compare performance between DeepSurv and the Fracture Risk Assessment Tool (FRAX) and Cox proportional hazard (CoxPH) models.

RESULTS

Of the total participants, 1,188 (74.4%) were women, and the mean age was 60.5 years. During a mean follow-up period of 40.7 months, vertebral fractures occurred in 7.5% (120/1,595) of participants. In the test set, when DeepSurv learned with images and clinical features, it showed higher performance than FRAX and CoxPH in terms of C-index values (DeepSurv, 0.612; 95% confidence interval [CI], 0.571 to 0.653; FRAX, 0.547; CoxPH, 0.594; 95% CI, 0.552 to 0.555). Notably, the DeepSurv method without clinical features had a higher C-index (0.614; 95% CI, 0.572 to 0.656) than that of FRAX in women.

CONCLUSION

DeepSurv, a CNN-based prediction algorithm using baseline image and clinical information, outperformed the FRAX and CoxPH models in predicting osteoporotic fracture from spine radiographs in a longitudinal cohort.

Development of a manufacturer-independent convolutional neural network for the automated identification of vertebral compression fractures in vertebral fracture assessment images using active learning

BACKGROUND

Convolutional neural networks (CNNs) can identify vertebral compression fractures in GE vertebral fracture assessment (VFA) images with high balanced accuracy, but performance against Hologic VFAs is unknown. To obtain good classification performance, supervised machine learning requires balanced and labeled training data. Active learning is an iterative data annotation process with the ability to reduce the cost of labeling medical image data and reduce class imbalance.

PURPOSE

To train CNNs to identify vertebral fractures in Hologic VFAs using an active learning approach, and evaluate the ability of CNNs to generalize to both Hologic and GE VFA images.

METHODS

VFAs were obtained from the OsteoLaus Study (labeled Hologic Discovery A, n = 2726), the Manitoba Bone Mineral Density Program (labeled GE Prodigy and iDXA, n = 12,742), and the Canadian Longitudinal Study on Aging (CLSA, unlabeled Hologic Discovery A, n = 17,190). Unlabeled CLSA VFAs were split into five equal-sized partitions (n = 3438) and reviewed sequentially using active learning. Based on predicted fracture probability, 17.6% (n = 3032) of the unlabeled VFAs were selected for expert review using the modified algorithm-based qualitative (mABQ) method. CNNs were simultaneously trained on Hologic, GE dual-energy and GE single-energy VFAs. Two ensemble CNNs were constructed using the maximum and mean predicted probability from six separately trained CNNs that differed due to stochastic variation. CNNs were evaluated against the OsteoLaus validation set (n = 408) during the active learning process; ensemble performance was measured against the OsteoLaus test set (n = 819).

RESULTS

The baseline CNN, prior to active learning, achieved 55.0% sensitivity, 97.9% specificity, 57.9% positive predictive value (PPV), F1-score 56.4%. Through active learning, 2942 CLSA Hologic VFAs (492 fractures) were added to the training data-increasing the proportion of Hologic VFAs with fractures from 4.2% to 12.5%. With active learning, CNN performance improved to 80.0% sensitivity, 99.7% specificity, 94.1% PPV, F1-score 86.5%. The CNN maximum ensemble achieved 91.9% sensitivity (100% for grade 3 and 95.5% for grade 2 fractures), 99.0% specificity, 81.0% PPV, F1-score 86.1%.

CONCLUSION

Simultaneously training on a composite dataset consisting of both Hologic and GE VFAs allowed for the development of a single manufacturer-independent CNN that generalized to both scanner types with good classification performance. Active learning can reduce class imbalance and produce an effective medical image classifier while only labeling a subset of available unlabeled image data-thereby reducing the time and cost required to train a machine learning model.

A software program for automated compressive vertebral fracture detection on elderly women's lateral chest radiograph: Ofeye 1.0

Background

Because osteoporotic vertebral fracture (OVF) on chest radiographs is commonly missed in radiological reports, we aimed to develop a software program which offers automated detection of compressive vertebral fracture (CVF) on lateral chest radiographs, and which emphasizes CVF detection specificity with a low false positivity rate.

Methods

For model training, we retrieved 3,991 spine radiograph cases and 1,979 chest radiograph cases from 16 sources, with among them in total 1,404 cases had OVF. For model testing, we retrieved 542 chest radiograph cases and 162 spine radiograph cases from four independent clinics, with among them 215 cases had OVF. All cases were female subjects, and except for 31 training data cases which were spine trauma cases, all the remaining cases were post-menopausal women. Image data included DICOM (Digital Imaging and Communications in Medicine) format, hard film scanned PNG (Portable Network Graphics) format, DICOM exported PNG format, and PACS (Picture Archiving and Communication System) downloaded resolution reduced DICOM format. OVF classification included: minimal and mild grades with <20% or ≥20-25% vertebral height loss respectively, moderate grade with ≥25-40% vertebral height loss, severe grade with ≥40%-2/3 vertebral height loss, and collapsed grade with ≥2/3 vertebral height loss. The CVF detection base model was mainly composed of convolution layers that include convolution kernels of different sizes, pooling layers, up-sampling layers, feature merging layers, and residual modules. When the model loss function could not be further decreased with additional training, the model was considered to be optimal and termed 'base-model 1.0'. A user-friendly interface was also developed, with the synthesized software termed 'Ofeye 1.0'.

Results

Counting cases and with minimal and mild OVFs included, base-model 1.0 demonstrated a specificity of 97.1%, a sensitivity of 86%, and an accuracy of 93.9% for the 704 testing cases. In total, 33 OVFs in 30 cases had a false negative reading, which constituted a false negative rate of 14.0% (30/215) by counting all OVF cases. Eighteen OVFs in 15 cases had OVFs of ≥ moderate grades missed, which constituted a false negative rate of 7.0% (15/215, i.e., sensitivity 93%) if only counting cases with ≥ moderate grade OVFs missed. False positive reading was recorded in 13 vertebrae in 13 cases (one vertebra in each case), which constituted a false positivity rate of 2.7% (13/489). These vertebrae with false positivity labeling could be readily differentiated from a true OVF by a human reader. The software Ofeye 1.0 allows 'batch processing', for example, 100 radiographs can be processed in a single operation. This software can be integrated into hospital PACS, or installed in a standalone personal computer.

Conclusions

A user-friendly software program was developed for CVF detection on elderly women's lateral chest radiographs. It has an overall low false positivity rate, and for moderate and severe CVFs an acceptably low false negativity rate. The integration of this software into radiological practice is expected to improve osteoporosis management for elderly women.

Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges

Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.

Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis

OBJECTIVES

To systematically quantify the diagnostic accuracy and identify potential covariates affecting the performance of artificial intelligence (AI) in diagnosing orthopedic fractures.

METHODS

PubMed, Embase, Web of Science, and Cochrane Library were systematically searched for studies on AI applications in diagnosing orthopedic fractures from inception to September 29, 2021. Pooled sensitivity and specificity and the area under the receiver operating characteristic curves (AUC) were obtained. This study was registered in the PROSPERO database prior to initiation (CRD 42021254618).

RESULTS

Thirty-nine were eligible for quantitative analysis. The overall pooled AUC, sensitivity, and specificity were 0.96 (95% CI 0.94-0.98), 90% (95% CI 87-92%), and 92% (95% CI 90-94%), respectively. In subgroup analyses, multicenter designed studies yielded higher sensitivity (92% vs. 88%) and specificity (94% vs. 91%) than single-center studies. AI demonstrated higher sensitivity with transfer learning (with vs. without: 92% vs. 87%) or data augmentation (with vs. without: 92% vs. 87%), compared to those without. Utilizing plain X-rays as input images for AI achieved results comparable to CT (AUC 0.96 vs. 0.96). Moreover, AI achieved comparable results to humans (AUC 0.97 vs. 0.97) and better results than non-expert human readers (AUC 0.98 vs. 0.96; sensitivity 95% vs. 88%).

CONCLUSIONS

AI demonstrated high accuracy in diagnosing orthopedic fractures from medical images. Larger-scale studies with higher design quality are needed to validate our findings.

KEY POINTS

• Multicenter study design, application of transfer learning, and data augmentation are closely related to improving the performance of artificial intelligence models in diagnosing orthopedic fractures. • Utilizing plain X-rays as input images for AI to diagnose fractures achieved results comparable to CT (AUC 0.96 vs. 0.96). • AI achieved comparable results to humans (AUC 0.97 vs. 0.97) but was superior to non-expert human readers (AUC 0.98 vs. 0.96, sensitivity 95% vs. 88%) in diagnosing fractures.

Improved diagnostic performance of plain radiography for cervical ossification of the posterior longitudinal ligament using deep learning

Background

A high false-negative rate has been reported for the diagnosis of ossification of the posterior longitudinal ligament (OPLL) using plain radiography. We investigated whether deep learning (DL) can improve the diagnostic performance of radiologists for cervical OPLL using plain radiographs.

Materials and methods

The training set consisted of 915 radiographs from 207 patients diagnosed with OPLL. For the test set, we used 200 lateral cervical radiographs from 100 patients with cervical OPLL and 100 patients without OPLL. An observer performance study was conducted over two reading sessions. In the first session, we compared the diagnostic performance of the DL-model and the six observers. The diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC) at the vertebra and patient level. The sensitivity and specificity of the DL model and average observers were calculated in per-patient analysis. Subgroup analysis was performed according to the morphologic classification of OPLL. In the second session, observers evaluated the radiographs by referring to the results of the DL-model.

Results

In the vertebra-level analysis, the DL-model showed an AUC of 0.854, which was higher than the average AUC of observers (0.826), but the difference was not significant (p = 0.292). In the patient-level analysis, the performance of the DL-model had an AUC of 0.851, and the average AUC of observers was 0.841 (p = 0.739). The patient-level sensitivity and specificity were 91% and 69% in the DL model, and 83% and 68% for the average observers, respectively. Both the DL-model and observers showed decreases in overall performance in the segmental and circumscribed types. With knowledge of the results of the DL-model, the average AUC of observers increased to 0.893 (p = 0.001) at the vertebra level and 0.911 (p < 0.001) at the patient level. In the subgroup analysis, the improvement was largest in segmental-type (AUC difference 0.087; p = 0.002).

Conclusions

The DL-based OPLL detection model can significantly improve the diagnostic performance of radiologists on cervical radiographs.

Artificial Intelligence in Fracture Detection: A Systematic Review and Meta-Analysis

Background Patients with fractures are a common emergency presentation and may be misdiagnosed at radiologic imaging. An increasing number of studies apply artificial intelligence (AI) techniques to fracture detection as an adjunct to clinician diagnosis. Purpose To perform a systematic review and meta-analysis comparing the diagnostic performance in fracture detection between AI and clinicians in peer-reviewed publications and the gray literature (ie, articles published on preprint repositories). Materials and Methods A search of multiple electronic databases between January 2018 and July 2020 (updated June 2021) was performed that included any primary research studies that developed and/or validated AI for the purposes of fracture detection at any imaging modality and excluded studies that evaluated image segmentation algorithms. Meta-analysis with a hierarchical model to calculate pooled sensitivity and specificity was used. Risk of bias was assessed by using a modified Prediction Model Study Risk of Bias Assessment Tool, or PROBAST, checklist. Results Included for analysis were 42 studies, with 115 contingency tables extracted from 32 studies (55 061 images). Thirty-seven studies identified fractures on radiographs and five studies identified fractures on CT images. For internal validation test sets, the pooled sensitivity was 92% (95% CI: 88, 93) for AI and 91% (95% CI: 85, 95) for clinicians, and the pooled specificity was 91% (95% CI: 88, 93) for AI and 92% (95% CI: 89, 92) for clinicians. For external validation test sets, the pooled sensitivity was 91% (95% CI: 84, 95) for AI and 94% (95% CI: 90, 96) for clinicians, and the pooled specificity was 91% (95% CI: 81, 95) for AI and 94% (95% CI: 91, 95) for clinicians. There were no statistically significant differences between clinician and AI performance. There were 22 of 42 (52%) studies that were judged to have high risk of bias. Meta-regression identified multiple sources of heterogeneity in the data, including risk of bias and fracture type. Conclusion Artificial intelligence (AI) and clinicians had comparable reported diagnostic performance in fracture detection, suggesting that AI technology holds promise as a diagnostic adjunct in future clinical practice. Clinical trial registration no. CRD42020186641 © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Cohen and McInnes in this issue.

Deep learning for screening primary osteopenia and osteoporosis using spine radiographs and patient clinical covariates in a Chinese population

PURPOSE

Many high-risk osteopenia and osteoporosis patients remain undiagnosed. We proposed to construct a convolutional neural network model for screening primary osteopenia and osteoporosis based on the lumbar radiographs, and to compare the diagnostic performance of the CNN model adding the clinical covariates with the image model alone.

METHODS

A total of 6,908 participants were collected for analysis, including postmenopausal women and men aged 50-95 years, who performed conventional lumbar x-ray examinations and dual-energy x-ray absorptiometry (DXA) examinations within 3 months. All participants were divided into a training set, a validation set, test set 1, and test set 2 at a ratio of 8:1:1:1. The bone mineral density (BMD) values derived from DXA were applied as the reference standard. A three-class CNN model was developed to classify the patients into normal BMD, osteopenia, and osteoporosis. Moreover, we developed the models integrating the images with clinical covariates (age, gender, and BMI), and explored whether adding clinical data improves diagnostic performance over the image mode alone. The receiver operating characteristic curve analysis was performed for assessing the model performance.

RESULTS

As for classifying osteoporosis, the model based on the anteroposterior+lateral channel performed best, with the area under the curve (AUC) range from 0.909 to 0.937 in three test cohorts. The models with images alone achieved moderate sensitivity in classifying osteopenia, in which the highest AUC achieved 0.785. The performance of models integrating images with clinical data shows a slight improvement over models with anteroposterior or lateral images input alone for diagnosing osteoporosis, in which the AUC increased about 2%-4%. Regarding categorizing osteopenia and the normal BMD, the proposed models integrating images with clinical data also outperformed the models with images solely.

CONCLUSION

The deep learning-based approach could screen osteoporosis and osteopenia based on lumbar radiographs.

An increasing number of convolutional neural networks for fracture recognition and classification in orthopaedics : are these externally validated and ready for clinical application?

Aims

The number of convolutional neural networks (CNN) available for fracture detection and classification is rapidly increasing. External validation of a CNN on a temporally separate (separated by time) or geographically separate (separated by location) dataset is crucial to assess generalizability of the CNN before application to clinical practice in other institutions. We aimed to answer the following questions: are current CNNs for fracture recognition externally valid?; which methods are applied for external validation (EV)?; and, what are reported performances of the EV sets compared to the internal validation (IV) sets of these CNNs?

Methods

The PubMed and Embase databases were systematically searched from January 2010 to October 2020 according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. The type of EV, characteristics of the external dataset, and diagnostic performance characteristics on the IV and EV datasets were collected and compared. Quality assessment was conducted using a seven-item checklist based on a modified Methodologic Index for NOn-Randomized Studies instrument (MINORS).

Results

Out of 1,349 studies, 36 reported development of a CNN for fracture detection and/or classification. Of these, only four (11%) reported a form of EV. One study used temporal EV, one conducted both temporal and geographical EV, and two used geographical EV. When comparing the CNN’s performance on the IV set versus the EV set, the following were found: AUCs of 0.967 (IV) versus 0.975 (EV), 0.976 (IV) versus 0.985 to 0.992 (EV), 0.93 to 0.96 (IV) versus 0.80 to 0.89 (EV), and F1-scores of 0.856 to 0.863 (IV) versus 0.757 to 0.840 (EV).

Conclusion

The number of externally validated CNNs in orthopaedic trauma for fracture recognition is still scarce. This greatly limits the potential for transfer of these CNNs from the developing institute to another hospital to achieve similar diagnostic performance. We recommend the use of geographical EV and statements such as the Consolidated Standards of Reporting Trials–Artificial Intelligence (CONSORT-AI), the Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence (SPIRIT-AI) and the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis–Machine Learning (TRIPOD-ML) to critically appraise performance of CNNs and improve methodological rigor, quality of future models, and facilitate eventual implementation in clinical practice.

Cite this article: Bone Jt Open 2021;2(10):879–885.

Application of deep learning neural network in predicting bone mineral density from plain X-ray radiography

DeepDXA is a deep learning model designed to infer bone mineral density data from plain pelvis X-ray, and it can achieve good predicted value for clinical use.

PURPOSE

Osteoporosis is defined as a systemic disease of the bone characterized by a decrease in bone strength and deterioration of bone structure at the microscopic level, leading to bone fragility and increased risk of fracture. Bone mineral density (BMD) is the preferred method for the diagnosis of osteoporosis, and dual-energy x-ray absorptiometry (DXA) is the gold standard for diagnosing osteoporosis. Conventional radiography is more suited for the screening of osteoporosis rather than diagnosis, and osteoporosis can be detected on radiographs by experienced physicians only. This study explored the possibility of predicting BMD relative to DXA using patient radiographs.

METHODS

A deep learning algorithm of convolutional neural network (CNN) was used for the purpose. The method includes image segmentation, CNN learning, and a convolution-based regression model (DeepDXA) that links the isolated images of the femur bone to predict BMD value. Data were obtained in a single medical center from 2006 to 2018, with a total amount of 3472 pairs of pelvis X-ray and DXA examination within 1 year.

RESULTS

The proposed workflow successfully predicted BMD values of the femur bone with the correlation coefficient (R) of 0.85 (P < 0.001) and the accuracy of 0.88 for prediction osteoporosis, a finding that could be reliably ready for further clinical use.

CONCLUSION

When suspicious osteoporosis is seen on plain films using the deep learning method we developed, further referral to DXA for the definite diagnosis of osteoporosis is indicated.

Current uses, emerging applications, and clinical integration of artificial intelligence in neuroradiology

Artificial intelligence (AI) is a branch of computer science with a variety of subfields and techniques, exploited to serve as a deductive tool that performs tasks originally requiring human cognition. AI tools and its subdomains are being incorporated into healthcare delivery for the improvement of medical data interpretation encompassing clinical management, diagnostics, and prognostic outcomes. In the field of neuroradiology, AI manifested through deep machine learning and connected neural networks (CNNs) has demonstrated incredible accuracy in identifying pathology and aiding in diagnosis and prognostication in several areas of neurology and neurosurgery. In this literature review, we survey the available clinical data highlighting the utilization of AI in the field of neuroradiology across multiple neurological and neurosurgical subspecialties. In addition, we discuss the emerging role of AI in neuroradiology, its strengths and limitations, as well as future needs in strengthening its role in clinical practice. Our review evaluated data across several subspecialties of neurology and neurosurgery including vascular neurology, spinal pathology, traumatic brain injury (TBI), neuro-oncology, multiple sclerosis, Alzheimer's disease, and epilepsy. AI has established a strong presence within the realm of neuroradiology as a successful and largely supportive technology aiding in the interpretation, diagnosis, and even prognostication of various pathologies. More research is warranted to establish its full scientific validity and determine its maximum potential to aid in optimizing and providing the most accurate imaging interpretation.

Feasibility of a generalized convolutional neural network for automated identification of vertebral compression fractures: The Manitoba Bone Mineral Density Registry

BACKGROUND

Vertebral fracture assessment (VFA) images are acquired in dual-energy (DE) or single-energy (SE) scan modes. Automated identification of vertebral compression fractures, from VFA images acquired using GE Healthcare scanners in DE mode, has achieved high accuracy through the use of convolutional neural networks (CNNs). Due to differences between DE and SE images, it is uncertain whether CNNs trained on one scan mode will generalize to the other.

PURPOSE

To evaluate the ability of CNNs to generalize between GE DE and GE SE VFA scan modes.

METHODS

12,742 GE VFA images from the Manitoba Bone Mineral Density Program, obtained between 2010 and 2017, were exported in both DE and SE modes. VFAs were classified by imaging specialists as fracture present or absent using the modified algorithm-based qualitative (mABQ) method. VFA scans were randomly divided into independent training (60%), validation (10%), and test (30%) sets. Three CNN models were constructed by training separately on DE only, SE only, and a composite dataset comprised of both SE and DE VFAs. All three trained CNN models were separately evaluated against both SE and DE test datasets.

RESULTS

Good performance was seen for CNNs trained and evaluated on the same scan mode. DE scans used for both training and evaluation (DE/DE) achieved 87.9% sensitivity, 87.4% specificity, and an area under the receiver operating characteristic curve (AUC) of 0.94. SE scans used for both training and evaluation (SE/SE) achieved 78.6% sensitivity, 90.6% specificity, AUC = 0.92. Conversely, CNNs performed poorly when evaluated on scan modes that differed from their training sets (AUC = 0.58). However, a composite CNN trained simultaneously on both SE and DE VFAs gave performance comparable to DE/DE (82.4% sensitivity, 94.3% specificity, AUC = 0.95); and provided improved performance over SE/SE (82.2% sensitivity, 92.3% specificity, AUC = 0.94). Positive predictive value was higher with the composite CNN compared with models trained solely on DE (74.5% vs. 58.7%) or SE VFAs (68.6% vs. 62.9%).

CONCLUSION

CNNs for vertebral fracture identification are highly sensitive to scan mode. Training CNNs on a composite dataset, comprised of both GE DE and GE SE VFAs, allows CNNs to generalize to both scan modes and may facilitate the development of manufacturer-independent machine learning models for vertebral fracture detection.

Classification and Visualisation of Normal and Abnormal Radiographs; A Comparison between Eleven Convolutional Neural Network Architectures

This paper investigates the classification of radiographic images with eleven convolutional neural network (CNN) architectures (GoogleNet, VGG-19, AlexNet, SqueezeNet, ResNet-18, Inception-v3, ResNet-50, VGG-16, ResNet-101, DenseNet-201 and Inception-ResNet-v2). The CNNs were used to classify a series of wrist radiographs from the Stanford Musculoskeletal Radiographs (MURA) dataset into two classes-normal and abnormal. The architectures were compared for different hyper-parameters against accuracy and Cohen's kappa coefficient. The best two results were then explored with data augmentation. Without the use of augmentation, the best results were provided by Inception-ResNet-v2 (Mean accuracy = 0.723, Mean kappa = 0.506). These were significantly improved with augmentation to Inception-ResNet-v2 (Mean accuracy = 0.857, Mean kappa = 0.703). Finally, Class Activation Mapping was applied to interpret activation of the network against the location of an anomaly in the radiographs.

Machine learning for automated abdominal aortic calcification scoring of DXA vertebral fracture assessment images: A pilot study

BACKGROUND

Abdominal aortic calcification (AAC) identified on dual-energy x-ray absorptiometry (DXA) vertebral fracture assessment (VFA) lateral spine images is predictive of cardiovascular outcomes, but is time-consuming to perform manually. Whether this procedure can be automated using convolutional neural networks (CNNs), a class of machine learning algorithms used for image processing, has not been widely investigated.

METHODS

Using the Province of Manitoba Bone Density Program DXA database, we selected a random sample of 1100 VFA images from individuals qualifying for VFA as part of their osteoporosis assessment. For each scan, AAC was manually scored using the 24-point semi-quantitative scale and categorized as low (score < 2), moderate (score 2 to <6), or high (score ≥ 6). An ensemble consisting of two CNNs was developed, by training and evaluating separately on single-energy and dual-energy images. AAC prediction was performed using the mean AAC score of the two models.

RESULTS

Mean (SD) age of the cohort was 75.5 (6.7) years, 95.5% were female. Training (N = 770, 70%), validation (N = 110, 10%) and test sets (N = 220, 20%) were well-balanced with respect to baseline characteristics and AAC scores. For the test set, the Pearson correlation between the CNN-predicted and human-labelled scores was 0.93 with intraclass correlation coefficient for absolute agreement 0.91 (95% CI 0.89-0.93). Kappa for AAC category agreement (prevalence- and bias-adjusted, ordinal scale) was 0.71 (95% CI 0.65-0.78). There was complete separation of the low and high categories, without any low AAC score scans predicted to be high and vice versa.

CONCLUSIONS

CNNs are capable of detecting AAC in VFA images, with high correlation between the human and predicted scores. These preliminary results suggest CNNs are a promising method for automatically detecting and quantifying AAC.

Detecting pathological features and predicting fracture risk from dual-energy X-ray absorptiometry images using deep learning

Dual-energy X-ray absorptiometry (DXA) is the gold standard imaging method for diagnosing osteoporosis in clinical practice. The DXA images are commonly used to estimate a numerical value for bone mineral density (BMD), which decreases in osteoporosis. Low BMD is a known risk factor for osteoporotic fractures. In this study, we used deep learning to identify lumbar scoliosis and structural abnormalities that potentially affect BMD but are often neglected in lumbar spine DXA analysis. In addition, we tested the approach's ability to predict fractures using only DXA images. A dataset of 2949 images gathered by Kuopio Osteoporosis Risk Factor and Prevention Study was used to train a convolutional neural network (CNN) for classification. The model was able to classify scoliosis with an AUC of 0.96 and structural abnormalities causing unreliable BMD measurement with an AUC of 0.91. It predicted fractures occurring within 5 years from the lumbar spine DXA scan with an AUC of 0.63, meeting the predictive performance of combined BMD measurements from the lumbar spine and hip. In an independent test set of 574 clinical patients, AUC for lumbar scoliosis was 0.93 and AUC for unreliable BMD measurements was 0.94. In each classification task, neural network visualizations indicated the model's predictive strategy. We conclude that deep learning could complement the well established DXA method for osteoporosis diagnostics by analyzing incidental findings and image reliability, and improve its predictive ability in the future.

Joint Associations of Prevalent Radiographic Vertebral Fracture and Abdominal Aortic Calcification With Incident Hip, Major Osteoporotic, and Clinical Vertebral Fractures

Prevalent vertebral fractures (PVFx) and abdominal aortic calcification (AAC) are both associated with incident fractures and can be ascertained on the same lateral spine images, but their joint association with incident fractures is unclear. Our objective was to estimate the individual and joint associations of PVFx and AAC with incident major osteoporotic, hip, and clinical vertebral fractures in 5365 older men enrolled in the Osteoporotic Fractures in Men (MrOS) Study, using Cox proportional hazards and Fine and Gray subdistribution hazards models to account for competing mortality. PVFx (Genant SQ grade 2 or 3) and 24-point AAC score were ascertained on baseline lateral spine radiographs. Self-reports of incident fractures were solicited every 4 months and confirmed by review of clinical radiographic reports. Compared with men without PVFx and AAC-24 score 0 or 1, the subdistribution hazard ratio (SHR) for incident major osteoporotic fracture was 1.38 (95% confidence interval [CI] 1.13-1.69) among men with AAC-24 score ≥2 alone, 1.71 (95% CI 1.37-2.14) for men with PVFx alone, and 2.35 (95% CI 1.75-3.16) for men with both risk factors, after accounting for conventional risk factors and competing mortality. Wald statistics showed improved prediction model performance by including both risk factors compared with including only AAC (chi-square = 17.3, p < .001) or including only PVFx (chi-square = 8.5, p = .036). Older men with both PVFx and a high level of AAC are at higher risk of incident major osteoporotic fracture than men with either risk factor alone. Assessing prevalent radiographic vertebral fracture and AAC on the same lateral spine images may improve prediction of older men who will have an incident major osteoporotic fracture, even after accounting for traditional fracture risk factors and competing mortality. © 2021 American Society for Bone and Mineral Research (ASBMR).

Machine Learning Solutions for Osteoporosis-A Review

Osteoporosis and its clinical consequence, bone fracture, is a multifactorial disease that has been the object of extensive research. Recent advances in machine learning (ML) have enabled the field of artificial intelligence (AI) to make impressive breakthroughs in complex data environments where human capacity to identify high-dimensional relationships is limited. The field of osteoporosis is one such domain, notwithstanding technical and clinical concerns regarding the application of ML methods. This qualitative review is intended to outline some of these concerns and to inform stakeholders interested in applying AI for improved management of osteoporosis. A systemic search in PubMed and Web of Science resulted in 89 studies for inclusion in the review. These covered one or more of four main areas in osteoporosis management: bone properties assessment (n = 13), osteoporosis classification (n = 34), fracture detection (n = 32), and risk prediction (n = 14). Reporting and methodological quality was determined by means of a 12-point checklist. In general, the studies were of moderate quality with a wide range (mode score 6, range 2 to 11). Major limitations were identified in a significant number of studies. Incomplete reporting, especially over model selection, inadequate splitting of data, and the low proportion of studies with external validation were among the most frequent problems. However, the use of images for opportunistic osteoporosis diagnosis or fracture detection emerged as a promising approach and one of the main contributions that ML could bring to the osteoporosis field. Efforts to develop ML-based models for identifying novel fracture risk factors and improving fracture prediction are additional promising lines of research. Some studies also offered insights into the potential for model-based decision-making. Finally, to avoid some of the common pitfalls, the use of standardized checklists in developing and sharing the results of ML models should be encouraged. © 2021 American Society for Bone and Mineral Research (ASBMR).

CT Cervical Spine Fracture Detection Using a Convolutional Neural Network

BACKGROUND AND PURPOSE

Multidetector CT has emerged as the standard of care imaging technique to evaluate cervical spine trauma. Our aim was to evaluate the performance of a convolutional neural network in the detection of cervical spine fractures on CT.

MATERIALS AND METHODS

We evaluated C-spine, an FDA-approved convolutional neural network developed by Aidoc to detect cervical spine fractures on CT. A total of 665 examinations were included in our analysis. Ground truth was established by retrospective visualization of a fracture on CT by using all available CT, MR imaging, and convolutional neural network output information. The ĸ coefficients, sensitivity, specificity, and positive and negative predictive values were calculated with 95% CIs comparing diagnostic accuracy and agreement of the convolutional neural network and radiologist ratings, respectively, compared with ground truth.

RESULTS

Convolutional neural network accuracy in cervical spine fracture detection was 92% (95% CI, 90%-94%), with 76% (95% CI, 68%-83%) sensitivity and 97% (95% CI, 95%-98%) specificity. The radiologist accuracy was 95% (95% CI, 94%-97%), with 93% (95% CI, 88%-97%) sensitivity and 96% (95% CI, 94%-98%) specificity. Fractures missed by the convolutional neural network and by radiologists were similar by level and location and included fractured anterior osteophytes, transverse processes, and spinous processes, as well as lower cervical spine fractures that are often obscured by CT beam attenuation.

CONCLUSIONS

The convolutional neural network holds promise at both worklist prioritization and assisting radiologists in cervical spine fracture detection on CT. Understanding the strengths and weaknesses of the convolutional neural network is essential before its successful incorporation into clinical practice. Further refinements in sensitivity will improve convolutional neural network diagnostic utility.

Vertebral fracture: epidemiology, impact and use of DXA vertebral fracture assessment in fracture liaison services

Vertebral fractures are independent risk factors for vertebral and nonvertebral fractures. Since vertebral fractures are often missed, the relatively new introduction of vertebral fracture assessment (VFA) for imaging of the lateral spine during DXA-measurement of the spine and hips may contribute to detect vertebral fractures. We advocate performing a VFA in all patients with a recent fracture visiting a fracture liaison service (FLS). Fracture liaison services (FLS) are important service models for delivering secondary fracture prevention for older adults presenting with a fragility fracture. While commonly age, clinical risk factors (including fracture site and number of prior fracture) and BMD play a crucial role in determining fracture risk and indications for treatment with antiosteoporosis medications, prevalent vertebral fractures usually remain undetected. However, vertebral fractures are important independent risk factors for future vertebral and nonvertebral fractures. A development of the DXA technology, vertebral fracture assessment (VFA), allows for assessment of the lateral spine during the regular DXA bone mineral density measurement of the lumbar spine and hips. Recent approaches to the stratification of antiosteoporosis medication type according to baseline fracture risk, and differences by age in the indication for treatment by prior fracture mean that additional information from VFA may influence initiation and type of treatment. Furthermore, knowledge of baseline vertebral fractures allows reliable definition of incident vertebral fracture events during treatment, which may modify the approach to therapy. In this manuscript, we will discuss the epidemiology and clinical significance of vertebral fractures, the different methods of detecting vertebral fractures, and the rationale for, and implications of, use of VFA routinely in FLS. • Vertebral fracture assessment is a tool available on modern DXA instruments and has proven ability to detect vertebral fractures, the majority of which occur without a fall and without the signs and symptoms of an acute fracture. • Most osteoporosis guidelines internationally suggest that treatment with antiosteoporosis medications should be considered for older individuals (e.g., 65 years +) with a recent low trauma fracture without the need for DXA. • Younger individuals postfracture may be risk-assessed on the basis of FRAX® probability including DXA and associated treatment thresholds. • Future fracture risk is markedly influenced by both site, number, severity, and recency of prior fracture; awareness of baseline vertebral fractures facilitates definition of true incident vertebral fracture events occurring during antiosteoporosis treatment. • Detection of previously clinically silent vertebral fractures, defining site of prior fracture, might alter treatment decisions in younger or older FLS patients, consistent with recent IOF-ESCEO guidance on baseline-risk-stratified therapy, and provides a reliable baseline from which to define new, potentially therapy-altering, vertebral fracture events.

[Artificial intelligence for diagnosis of vertebral compression fractures using a morphometric analysis model, based on convolutional neural networks]

BACKGROUND

Pathological low-energy (LE) vertebral compression fractures (VFs) are common complications of osteoporosis and predictors of subsequent LE fractures. In 84% of cases, VFs are not reported on chest CT (CCT), which calls for the development of an artificial intelligence-based (AI) assistant that would help radiology specialists to improve the diagnosis of osteoporosis complications and prevent new LE fractures.

AIMS

To develop an AI model for automated diagnosis of compression fractures of the thoracic spine based on chest CT images.

MATERIALS AND METHODS

Between September 2019 and May 2020 the authors performed a retrospective sampling study of ССТ images. The 160 of results were selected and anonymized. The data was labeled by seven readers. Using the morphometric analysis, the investigators received the following metric data: ventral, medial and dorsal dimensions. This was followed by a semiquantitative assessment of VFs degree. The data was used to develop the Comprise-G AI mode based on CNN, which subsequently measured the size of the vertebral bodies and then calculates the compression degree. The model was evaluated with the ROC curve analysis and by calculating sensitivity and specificity values.

RESULTS

Formed data consist of 160 patients (a training group - 100 patients; a test group - 60 patients). The total of 2,066 vertebrae was annotated. When detecting Grade 2 and 3 maximum VFs in patients the Comprise-G model demonstrated sensitivity - 90,7%, specificity - 90,7%, AUC ROC - 0.974 on the 5-FOLD cross-validation data of the training dataset; on the test data - sensitivity - 83,2%, specificity - 90,0%, AUC ROC - 0.956; in vertebrae demonstrated sensitivity - 91,5%, specificity - 95,2%, AUC ROC - 0.981 on the cross-validation data; for the test data sensitivity - 79,3%, specificity - 98,7%, AUC ROC - 0.978.

CONCLUSIONS

The Comprise-G model demonstrated high diagnostic capabilities in detecting the VFs on CCT images and can be recommended for further validation.

Artificial Intelligence and Deep Learning in Neuroradiology: Exploring the New Frontier

There have been many recently published studies exploring machine learning (ML) and deep learning applications within neuroradiology. The improvement in performance of these techniques has resulted in an ever-increasing number of commercially available tools for the neuroradiologist. In this narrative review, recent publications exploring ML in neuroradiology are assessed with a focus on several key clinical domains. In particular, major advances are reviewed in the context of: (1) intracranial hemorrhage detection, (2) stroke imaging, (3) intracranial aneurysm screening, (4) multiple sclerosis imaging, (5) neuro-oncology, (6) head and tumor imaging, and (7) spine imaging.

Computer-aided diagnosis systems for osteoporosis detection: a comprehensive survey

Computer-aided diagnosis (CAD) has revolutionized the field of medical diagnosis. They assist in improving the treatment potentials and intensify the survival frequency by early diagnosing the diseases in an efficient, timely, and cost-effective way. The automatic segmentation has led the radiologist to successfully segment the region of interest to improve the diagnosis of diseases from medical images which is not so efficiently possible by manual segmentation. The aim of this paper is to survey the vision-based CAD systems especially focusing on the segmentation techniques for the pathological bone disease known as osteoporosis. Osteoporosis is the state of the bones where the mineral density of bones decreases and they become porous, making the bones easily susceptible to fractures by small injury or a fall. The article covers the image acquisition techniques for acquiring the medical images for osteoporosis diagnosis. The article also discusses the advanced machine learning paradigms employed in segmentation for osteoporosis disease. Other image processing steps in osteoporosis like feature extraction and classification are also briefly described. Finally, the paper gives the future directions to improve the osteoporosis diagnosis and presents the proposed architecture. Graphical abstract.

Prediction of bone mineral density from computed tomography: application of deep learning with a convolutional neural network

OBJECTIVES

To investigate whether a deep learning model can predict the bone mineral density (BMD) of lumbar vertebrae from unenhanced abdominal computed tomography (CT) images.

METHODS

In this Institutional Review Board-approved retrospective study, patients who received both unenhanced CT examinations and dual-energy X-ray absorptiometry (DXA) of the lumbar vertebrae, in two institutions (1 and 2), were included. Supervised deep learning was employed to obtain a convolutional neural network (CNN) model using axial CT images, including the lumbar vertebrae as input data and BMD values obtained with DXA as reference data. For this purpose, 1665 CT images from 183 patients in institution 1, which were augmented to 99,900 (= 1665 × 60) images (noise adding, parallel shift and rotation were performed), were used. Internal (by using data of 45 other patients in institution 1) and external validations (by using data of 50 patients in institution 2) were performed to evaluate the performance of the trained CNN model. Correlations and diagnostic performances were evaluated with Pearson's correlation coefficient (r) and area under the receiver operating characteristic curve (AUC), respectively.

RESULTS

The estimated BMD values, according to the CNN model (BMDCNN), were significantly correlated with the BMD values obtained with DXA (r = 0.852 (p < 0.001) and 0.840 (p < 0.001) for the internal and external validation datasets, respectively). Using BMDCNN, osteoporosis was diagnosed with AUCs of 0.965 and 0.970 for the internal and external validation datasets, respectively.

CONCLUSIONS

Using deep learning, the BMD of lumbar vertebrae could be predicted from unenhanced abdominal CT images.

KEY POINTS

• By applying a deep learning technique, the bone mineral density (BMD) of lumbar vertebrae can be estimated from unenhanced abdominal CT images. • A strong correlation was observed between the estimated BMD and the BMD obtained with DXA. • By using the estimated BMD, osteoporosis could be diagnosed with high performance.