Computer-Aided Detection AI Reduces Interreader Variability in Grading Hip Abnormalities With MRI

Artificial intelligence in musculoskeletal imaging: realistic clinical applications in the next decade

This article will provide a perspective review of the most extensively investigated deep learning (DL) applications for musculoskeletal disease detection that have the best potential to translate into routine clinical practice over the next decade. Deep learning methods for detecting fractures, estimating pediatric bone age, calculating bone measurements such as lower extremity alignment and Cobb angle, and grading osteoarthritis on radiographs have been shown to have high diagnostic performance with many of these applications now commercially available for use in clinical practice. Many studies have also documented the feasibility of using DL methods for detecting joint pathology and characterizing bone tumors on magnetic resonance imaging (MRI). However, musculoskeletal disease detection on MRI is difficult as it requires multi-task, multi-class detection of complex abnormalities on multiple image slices with different tissue contrasts. The generalizability of DL methods for musculoskeletal disease detection on MRI is also challenging due to fluctuations in image quality caused by the wide variety of scanners and pulse sequences used in routine MRI protocols. The diagnostic performance of current DL methods for musculoskeletal disease detection must be further evaluated in well-designed prospective studies using large image datasets acquired at different institutions with different imaging parameters and imaging hardware before they can be fully implemented in clinical practice. Future studies must also investigate the true clinical benefits of current DL methods and determine whether they could enhance quality, reduce error rates, improve workflow, and decrease radiologist fatigue and burnout with all of this weighed against the costs.

Self-supervised-RCNN for medical image segmentation with limited data annotation

Many successful methods developed for medical image analysis based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data annotation is time-consuming and expensive, especially for segmentation tasks. To overcome the problem of learning with limited labeled medical image data, an alternative deep learning training strategy based on self-supervised pretraining on unlabeled imaging data is proposed in this work. For the pretraining, different distortions are arbitrarily applied to random areas of unlabeled images. Next, a Mask-RCNN architecture is trained to localize the distortion location and recover the original image pixels. This pretrained model is assumed to gain knowledge of the relevant texture in the images from the self-supervised pretraining on unlabeled imaging data. This provides a good basis for fine-tuning the model to segment the structure of interest using a limited amount of labeled training data. The effectiveness of the proposed method in different pretraining and fine-tuning scenarios was evaluated based on the Osteoarthritis Initiative dataset with the aim of segmenting effusions in MRI datasets of the knee. Applying the proposed self-supervised pretraining method improved the Dice score by up to 18% compared to training the models using only the limited annotated data. The proposed self-supervised learning approach can be applied to many other medical image analysis tasks including anomaly detection, segmentation, and classification.

Bone marrow lesions in osteoarthritis: From basic science to clinical implications

Osteoarthritis (OA) is the most prevalent musculoskeletal disease characterized by multiple joint structure damages, including articular cartilage, subchondral bone and synovium, resulting in disability and economic burden. Bone marrow lesions (BMLs) are common and important magnetic resonance imaging (MRI) features in OA patients. Basic and clinical research on subchondral BMLs in the pathogenesis of OA has been a hotspot. New evidence shows that subchondral bone degeneration, including BML and angiogenesis, occurs not only at or after cartilage degeneration, but even earlier than cartilage degeneration. Although BMLs are recognized as important biomarkers for OA, their exact roles in the pathogenesis of OA are still unclear, and disputes about the clinical impact and treatment of BMLs remain. This review summarizes the current basic and clinical research progress of BMLs. We particularly focus on molecular pathways, cellular abnormalities and microenvironmental changes of subchondral bone that contributed to the formation of BMLs, and emphasize the crosstalk between subchondral bone and cartilage in OA development. Finally, potential therapeutic strategies targeting BMLs in OA are discussed, which provides novel strategies for OA treatment.

Utilizing a Digital Swarm Intelligence Platform to Improve Consensus Among Radiologists and Exploring Its Applications

Radiologists today play a central role in making diagnostic decisions and labeling images for training and benchmarking artificial intelligence (AI) algorithms. A key concern is low inter-reader reliability (IRR) seen between experts when interpreting challenging cases. While team-based decisions are known to outperform individual decisions, inter-personal biases often creep up in group interactions which limit nondominant participants from expressing true opinions. To overcome the dual problems of low consensus and interpersonal bias, we explored a solution modeled on bee swarms. Two separate cohorts, three board-certified radiologists, (cohort 1), and five radiology residents (cohort 2) collaborated on a digital swarm platform in real time and in a blinded fashion, grading meniscal lesions on knee MR exams. These consensus votes were benchmarked against clinical (arthroscopy) and radiological (senior-most radiologist) standards of reference using Cohen's kappa. The IRR of the consensus votes was then compared to the IRR of the majority and most confident votes of the two cohorts. IRR was also calculated for predictions from a meniscal lesion detecting AI algorithm. The attending cohort saw an improvement of 23% in IRR of swarm votes (k = 0.34) over majority vote (k = 0.11). Similar improvement of 23% in IRR (k = 0.25) in 3-resident swarm votes over majority vote (k = 0.02) was observed. The 5-resident swarm had an even higher improvement of 30% in IRR (k = 0.37) over majority vote (k = 0.07). The swarm consensus votes outperformed individual and majority vote decision in both the radiologists and resident cohorts. The attending and resident swarms also outperformed predictions from a state-of-the-art AI algorithm.

DomainATM: Domain adaptation toolbox for medical data analysis

Domain adaptation (DA) is an important technique for modern machine learning-based medical data analysis, which aims at reducing distribution differences between different medical datasets. A proper domain adaptation method can significantly enhance the statistical power by pooling data acquired from multiple sites/centers. To this end, we have developed the Domain Adaptation Toolbox for Medical data analysis (DomainATM) - an open-source software package designed for fast facilitation and easy customization of domain adaptation methods for medical data analysis. The DomainATM is implemented in MATLAB with a user-friendly graphical interface, and it consists of a collection of popular data adaptation algorithms that have been extensively applied to medical image analysis and computer vision. With DomainATM, researchers are able to facilitate fast feature-level and image-level adaptation, visualization and performance evaluation of different adaptation methods for medical data analysis. More importantly, the DomainATM enables the users to develop and test their own adaptation methods through scripting, greatly enhancing its utility and extensibility. An overview characteristic and usage of DomainATM is presented and illustrated with three example experiments, demonstrating its effectiveness, simplicity, and flexibility. The software, source code, and manual are available online.

A More Posterior Tibial Tubercle (Decreased Sagittal Tibial Tubercle-Trochlear Groove Distance) Is Significantly Associated With Patellofemoral Joint Degenerative Cartilage Change: A Deep Learning Analysis

PURPOSE

To perform patellofemoral joint (PFJ) geometric measurements on knee magnetic resonance imaging scans and determine their relations with chondral lesions in a multicenter cohort using deep learning.

METHODS

The sagittal tibial tubercle-trochlear groove (sTTTG) distance, tibial tubercle-trochlear groove distance, trochlear sulcus angle, trochlear depth, Caton-Deschamps Index (CDI), and flexion angle were measured by use of deep learning-generated segmentations on a subset of the Osteoarthritis Initiative study with radiologist-graded PFJ cartilage grades (n = 2,461). Kruskal-Wallis H tests were performed to compare differences in PFJ morphology between subjects without PFJ osteoarthritis (OA) and those with PFJ OA. PFJ morphology was correlated with secondary outcomes of mean patellar cartilage thickness and mean patellar cartilage T2 relaxation time using linear regression models controlling for age, sex, and body mass index.

RESULTS

A total of 1,626 knees did not have PFJ OA, whereas 835 knees had PFJ OA. Knees without PFJ OA had an increased (anterior) sTTTG distance (mean ± standard deviation, 11.1 ± 12.8 mm) compared with knees with PFJ OA (8.4 ± 12.7 mm) (P < .001), indicating a more posterior tibial tubercle in subjects with PFJ OA. Knees without PFJ OA had a decreased sulcus angle (127.4° ± 7.1° vs 128.0° ± 8.4°, P = .01) and increased trochlear depth (9.1 ± 1.7 mm vs 9.0 ± 2.0 mm, P = .03) compared with knees with PFJ OA. Decreased patellar cartilage thickness was associated with decreased trochlear depth (β = 0.12, P = .002) and increased CDI (β = -0.07, P < .001). Increased patellar cartilage T2 relaxation time was correlated with decreased sTTTG distance (β = -0.08, P = .01), decreased sulcus angle (β = -0.12, P = .04), and decreased CDI (β = -0.12, P < .001).

CONCLUSIONS

PFJ OA, patellar cartilage thickness, and patellar cartilage T2 relaxation time were shown to be associated with the underlying geometries within the PFJ. This large longitudinal study highlights that a decreased sTTTG distance (i.e., a more posterior tibial tubercle) is significantly associated with PFJ degenerative cartilage change.

LEVEL OF EVIDENCE

Level III, retrospective comparative prognostic trial.

Studying osteoarthritis with artificial intelligence applied to magnetic resonance imaging

The 3D nature and soft-tissue contrast of MRI makes it an invaluable tool for osteoarthritis research, by facilitating the elucidation of disease pathogenesis and progression. The recent increasing employment of MRI has certainly been stimulated by major advances that are due to considerable investment in research, particularly related to artificial intelligence (AI). These AI-related advances are revolutionizing the use of MRI in clinical research by augmenting activities ranging from image acquisition to post-processing. Automation is key to reducing the long acquisition times of MRI, conducting large-scale longitudinal studies and quantitatively defining morphometric and other important clinical features of both soft and hard tissues in various anatomical joints. Deep learning methods have been used recently for multiple applications in the musculoskeletal field to improve understanding of osteoarthritis. Compared with labour-intensive human efforts, AI-based methods have advantages and potential in all stages of imaging, as well as post-processing steps, including aiding diagnosis and prognosis. However, AI-based methods also have limitations, including the arguably limited interpretability of AI models. Given that the AI community is highly invested in uncovering uncertainties associated with model predictions and improving their interpretability, we envision future clinical translation and progressive increase in the use of AI algorithms to support clinicians in optimizing patient care.

Osteoarthritis year in review 2021: imaging

PURPOSE

To provide a narrative review of original articles on imaging of osteoarthritis (OA) published between January 1, 2020 and March 31, 2021, with a special focus on imaging of inflammation, imaging of bone, cartilage and bone-cartilage interactions, imaging of peri-articular tissues, imaging scoring methods for OA, and artificial intelligence (AI) applied to OA imaging.

METHODS

The Embase, Pubmed, Medline, Cochrane databases were searched for original research articles in the English language on human, in vivo, imaging of OA published between January 1, 2020 and March 31, 2021. Search terms related to osteoarthritis combined with all imaging modalities and artificial intelligence were applied. A selection of articles reporting on one of the focus topics was discussed further.

RESULTS

The search resulted in 651 articles, of which 214 were deemed relevant to human OA imaging. Among the articles included, the knee joint (69%) and magnetic resonance imaging (MRI) (52%) were the predominant anatomical area and imaging modality studied. There were also a substantial number of papers (n = 46) reporting on AI applications in the field of OA imaging.

CONCLUSION

Imaging continues to play an important role in the assessment of OA. Recent advances in OA imaging include quantitative, non-contrast, and hybrid imaging techniques for improved characterization of multiple tissue processes in OA. In addition, an increasing effort in AI techniques is undertaken to enhance OA imaging acquisition and analysis.

Automated delineation of orbital abscess depicted on CT scan using deep learning

OBJECTIVES

To develop and validate a deep learning algorithm to automatically detect and segment an orbital abscess depicted on computed tomography (CT).

METHODS

We retrospectively collected orbital CT scans acquired on 67 pediatric subjects with a confirmed orbital abscess in the setting of infectious orbital cellulitis. A context-aware convolutional neural network (CA-CNN) was developed and trained to automatically segment orbital abscess. To reduce the requirement for a large dataset, transfer learning was used by leveraging a pre-trained model for CT-based lung segmentation. An ophthalmologist manually delineated orbital abscesses depicted on the CT images. The classical U-Net and the CA-CNN models with and without transfer learning were trained and tested on the collected dataset using the 10-fold cross-validation method. Dice coefficient, Jaccard index, and Hausdorff distance were used as performance metrics to assess the agreement between the computerized and manual segmentations.

RESULTS

The context-aware U-Net with transfer learning achieved an average Dice coefficient and Jaccard index of 0.78 ± 0.12 and 0.65 ± 0.13, which were consistently higher than the classical U-Net or the context-aware U-Net without transfer learning (P < 0.01). The average differences of the abscess between the computerized results and the experts in terms of volume and Hausdorff distance were 0.10 ± 0.11 mL and 1.94 ± 1.21 mm, respectively. The context-aware U-Net detected all orbital abscess without false positives.

CONCLUSIONS

The deep learning solution demonstrated promising performance in detecting and segmenting orbital abscesses on CT images in strong agreement with a human observer.

Deep learning for large scale MRI-based morphological phenotyping of osteoarthritis

Osteoarthritis (OA) develops through heterogenous pathophysiologic pathways. As a result, no regulatory agency approved disease modifying OA drugs are available to date. Stratifying knees into MRI-based morphological phenotypes may provide insight into predicting future OA incidence, leading to improved inclusion criteria and efficacy of therapeutics. We trained convolutional neural networks to classify bone, meniscus/cartilage, inflammatory, and hypertrophy phenotypes in knee MRIs from participants in the Osteoarthritis Initiative (n = 4791). We investigated cross-sectional association between baseline morphological phenotypes and baseline structural OA (Kellgren Lawrence grade > 1) and symptomatic OA. Among participants without baseline OA, we evaluated association of baseline phenotypes with 48-month incidence of structural OA and symptomatic OA. The area under the curve of bone, meniscus/cartilage, inflammatory, and hypertrophy phenotype neural network classifiers was 0.89 ± 0.01, 0.93 ± 0.03, 0.96 ± 0.02, and 0.93 ± 0.02, respectively (mean ± standard deviation). Among those with no baseline OA, bone phenotype (OR: 2.99 (95%CI: 1.59-5.62)) and hypertrophy phenotype (OR: 5.80 (95%CI: 1.82-18.5)) each respectively increased odds of developing incident structural OA and symptomatic OA at 48 months. All phenotypes except meniscus/cartilage increased odds of undergoing total knee replacement within 96 months. Artificial intelligence can rapidly stratify knees into structural phenotypes associated with incident OA and total knee replacement, which may aid in stratifying patients for clinical trials of targeted therapeutics.

Deep learning for brain disorders: from data processing to disease treatment

In order to reach precision medicine and improve patients' quality of life, machine learning is increasingly used in medicine. Brain disorders are often complex and heterogeneous, and several modalities such as demographic, clinical, imaging, genetics and environmental data have been studied to improve their understanding. Deep learning, a subpart of machine learning, provides complex algorithms that can learn from such various data. It has become state of the art in numerous fields, including computer vision and natural language processing, and is also growingly applied in medicine. In this article, we review the use of deep learning for brain disorders. More specifically, we identify the main applications, the concerned disorders and the types of architectures and data used. Finally, we provide guidelines to bridge the gap between research studies and clinical routine.