Method for Diagnosing the Bone Marrow Edema of Sacroiliac Joint in Patients with Axial Spondyloarthritis Using Magnetic Resonance Image Analysis Based on Deep Learning

Bone marrow edema detection for diagnostic support of axial spondyloarthritis using MRI

PURPOSE

This study proposes a process for detecting slices with bone marrow edema (BME), a typical finding of axSpA, using MRI scans as the input. This process does not require manual input of ROIs and provides the results of the judgment of the presence or absence of BME on a slice and the location of edema as the rationale for the judgment.

METHODS

First, the signal intensity of the MRI scans of the sacroiliac joint was normalized to reduce the variation in signal values between scans. Next, slices containing synovial joints were extracted using a slice selection network. Finally, the BME slice detection network determines the presence or absence of the BME in each slice and outputs the location of the BME.

RESULTS

The proposed method was applied to 86 MRI scans collected from 15 hospitals in Japan. The results showed that the average absolute error of the slice selection process was 1.49 slices for the misalignment between the upper and lower slices of the synovial joint range. The accuracy, sensitivity, and specificity of the BME slice detection network were 0.905, 0.532, and 0.974, respectively.

CONCLUSION

This paper proposes a process to detect the slice with BME and its location as the rationale of the judgment from an MRI scan and shows its effectiveness using 86 MRI scans. In the future, we plan to develop a process for detecting other findings such as bone erosion from MR scans, followed by the development of a diagnostic support system.

Enhancing the Diagnostic Accuracy of Sacroiliitis: A Machine Learning Approach Applied to Computed Tomography Imaging

Aims/Background Sacroiliitis is a challenging condition to diagnose accurately due to the subtle nature of its presentation in imaging studies. This study aims to improve the diagnostic accuracy of sacroiliitis by applying advanced machine learning techniques to computed tomography (CT) images. Methods We employed five convolutional neural network (CNN) models-Visual Geometry Group 16-layer Network (VGG16), ResNet101, DenseNet, Inception-v4, and ResNeXt-50-to analyze a dataset of 830 CT images, including both sacroiliitis and non-sacroiliitis cases. Each model's performance was evaluated using metrics such as accuracy, precision, recall, F1 score, Receiver Operating Characteristic (ROC), and Area Under the Curve (AUC). The interpretability of the models' decisions was enhanced using Gradient-weighted Class Activation Mapping (Grad-CAM) visualization. Results The ResNeXt-50 and Inception-v4 models demonstrated superior performance, achieving the highest accuracy and F1 scores among the tested models. Grad-CAM visualizations offered insights into the decision-making processes, highlighting the models' focus on relevant anatomical features critical for accurate diagnosis. Conclusion The use of CNN models, particularly ResNeXt-50 and Inception-v4, significantly improves the diagnosis of sacroiliitis from CT images. These models not only provide high diagnostic accuracy but also offer transparency in their decision-making processes, aiding clinicians in understanding and trusting Artificial Intelligence (AI)-driven diagnostics.

Artificial intelligence improves the diagnosis of human leukocyte antigen (HLA)-B27-negative axial spondyloarthritis based on multi-sequence magnetic resonance imaging and clinical features

Background

Axial spondyloarthritis (axSpA) is frequently diagnosed late, particularly in human leukocyte antigen (HLA)-B27-negative patients, resulting in a missed opportunity for optimal treatment. This study aimed to develop an artificial intelligence (AI) tool, termed NegSpA-AI, using sacroiliac joint (SIJ) magnetic resonance imaging (MRI) and clinical SpA features to improve the diagnosis of axSpA in HLA-B27-negative patients.

Methods

We retrospectively included 454 HLA-B27-negative patients with rheumatologist-diagnosed axSpA or other diseases (non-axSpA) from the Third Affiliated Hospital of Southern Medical University and Nanhai Hospital between January 2010 and August 2021. They were divided into a training set (n=328) for 5-fold cross-validation, an internal test set (n=72), and an independent external test set (n=54). To construct a prospective test set, we further enrolled 87 patients between September 2021 and August 2023 from the Third Affiliated Hospital of Southern Medical University. MRI techniques employed included T1-weighted (T1W), T2-weighted (T2W), and fat-suppressed (FS) sequences. We developed NegSpA-AI using a deep learning (DL) network to differentiate between axSpA and non-axSpA at admission. Furthermore, we conducted a reader study involving 4 radiologists and 2 rheumatologists to evaluate and compare the performance of independent and AI-assisted clinicians.

Results

NegSpA-AI demonstrated superior performance compared to the independent junior rheumatologist (≤5 years of experience), achieving areas under the curve (AUCs) of 0.878 [95% confidence interval (CI): 0.786-0.971], 0.870 (95% CI: 0.771-0.970), and 0.815 (95% CI: 0.714-0.915) on the internal, external, and prospective test sets, respectively. The assistance of NegSpA-AI promoted discriminating accuracy, sensitivity, and specificity of independent junior radiologists by 7.4-11.5%, 1.0-13.3%, and 7.4-20.6% across the 3 test sets (all P<0.05). On the prospective test set, AI assistance also improved the diagnostic accuracy, sensitivity, and specificity of independent junior rheumatologists by 7.7%, 7.7%, and 6.9%, respectively (all P<0.01).

Conclusions

The proposed NegSpA-AI effectively improves radiologists' interpretations of SIJ MRI and rheumatologists' diagnoses of HLA-B27-negative axSpA.

Artificial intelligence and machine learning in axial spondyloarthritis

PURPOSE OF REVIEW

To evaluate the current applications and prospects of artificial intelligence and machine learning in diagnosing and managing axial spondyloarthritis (axSpA), focusing on their role in medical imaging, predictive modelling, and patient monitoring.

RECENT FINDINGS

Artificial intelligence, particularly deep learning, is showing promise in diagnosing axSpA assisting with X-ray, computed tomography (CT) and MRI analyses, with some models matching or outperforming radiologists in detecting sacroiliitis and markers. Moreover, it is increasingly being used in predictive modelling of disease progression and personalized treatment, and could aid risk assessment, treatment response and clinical subtype identification. Variable study designs, sample sizes and the predominance of retrospective, single-centre studies still limit the generalizability of results.

SUMMARY

Artificial intelligence technologies have significant potential to advance the diagnosis and treatment of axSpA, providing more accurate, efficient and personalized healthcare solutions. However, their integration into clinical practice requires rigorous validation, ethical and legal considerations, and comprehensive training for healthcare professionals. Future advances in artificial intelligence could complement clinical expertise and improve patient care through improved diagnostic accuracy and tailored therapeutic strategies, but the challenge remains to ensure that these technologies are validated in prospective multicentre trials and ethically integrated into patient care.

Artificial intelligence to analyze magnetic resonance imaging in rheumatology

Rheumatic disorders present a global health challenge, marked by inflammation and damage to joints, bones, and connective tissues. Accurate, timely diagnosis and appropriate management are crucial for favorable patient outcomes. Magnetic resonance imaging (MRI) has become indispensable in rheumatology, but interpretation remains laborious and variable. Artificial intelligence (AI), including machine learning (ML) and deep learning (DL), offers a means to improve and advance MRI analysis. This review examines current AI applications in rheumatology MRI analysis, addressing diagnostic support, disease classification, activity assessment, and progression monitoring. AI demonstrates promise, with high sensitivity, specificity, and accuracy, achieving or surpassing expert performance. The review also discusses clinical implementation challenges and future research directions to enhance rheumatic disease diagnosis and management.

Automatic segmentation of fat metaplasia on sacroiliac joint MRI using deep learning

OBJECTIVE

To develop a deep learning (DL) model for segmenting fat metaplasia (FM) on sacroiliac joint (SIJ) MRI and further develop a DL model for classifying axial spondyloarthritis (axSpA) and non-axSpA.

MATERIALS AND METHODS

This study retrospectively collected 706 patients with FM who underwent SIJ MRI from center 1 (462 axSpA and 186 non-axSpA) and center 2 (37 axSpA and 21 non-axSpA). Patients from center 1 were divided into the training, validation, and internal test sets (n = 455, 64, and 129). Patients from center 2 were used as the external test set. We developed a UNet-based model to segment FM. Based on segmentation results, a classification model was built to distinguish axSpA and non-axSpA. Dice Similarity Coefficients (DSC) and area under the curve (AUC) were used for model evaluation. Radiologists' performance without and with model assistance was compared to assess the clinical utility of the models.

RESULTS

Our segmentation model achieved satisfactory DSC of 81.86% ± 1.55% and 85.44% ± 6.09% on the internal cross-validation and external test sets. The classification model yielded AUCs of 0.876 (95% CI: 0.811-0.942) and 0.799 (95% CI: 0.696-0.902) on the internal and external test sets, respectively. With model assistance, segmentation performance was improved for the radiological resident (DSC, 75.70% vs. 82.87%, p < 0.05) and expert radiologist (DSC, 85.03% vs. 85.74%, p > 0.05).

CONCLUSIONS

DL is a novel method for automatic and accurate segmentation of FM on SIJ MRI and can effectively increase radiologist's performance, which might assist in improving diagnosis and progression of axSpA.

CRITICAL RELEVANCE STATEMENT

DL models allowed automatic and accurate segmentation of FM on sacroiliac joint MRI, which might facilitate quantitative analysis of FM and have the potential to improve diagnosis and prognosis of axSpA.

KEY POINTS

• Deep learning was used for automatic segmentation of fat metaplasia on MRI. • UNet-based models achieved automatic and accurate segmentation of fat metaplasia. • Automatic segmentation facilitates quantitative analysis of fat metaplasia to improve diagnosis and prognosis of axial spondyloarthritis.

Deep learning in rheumatological image interpretation

Artificial intelligence techniques, specifically deep learning, have already affected daily life in a wide range of areas. Likewise, initial applications have been explored in rheumatology. Deep learning might not easily surpass the accuracy of classic techniques when performing classification or regression on low-dimensional numerical data. With images as input, however, deep learning has become so successful that it has already outperformed the majority of conventional image-processing techniques developed during the past 50 years. As with any new imaging technology, rheumatologists and radiologists need to consider adapting their arsenal of diagnostic, prognostic and monitoring tools, and even their clinical role and collaborations. This adaptation requires a basic understanding of the technical background of deep learning, to efficiently utilize its benefits but also to recognize its drawbacks and pitfalls, as blindly relying on deep learning might be at odds with its capabilities. To facilitate such an understanding, it is necessary to provide an overview of deep-learning techniques for automatic image analysis in detecting, quantifying, predicting and monitoring rheumatic diseases, and of currently published deep-learning applications in radiological imaging for rheumatology, with critical assessment of possible limitations, errors and confounders, and conceivable consequences for rheumatologists and radiologists in clinical practice.

Use of MRI-based deep learning radiomics to diagnose sacroiliitis related to axial spondyloarthritis

OBJECTIVES

This study aimed to evaluate the performance of a deep learning radiomics (DLR) model, which integrates multimodal MRI features and clinical information, in diagnosing sacroiliitis related to axial spondyloarthritis (axSpA).

MATERIAL & METHODS

A total of 485 patients diagnosed with sacroiliitis related to axSpA (n = 288) or non-sacroiliitis (n = 197) by sacroiliac joint (SIJ) MRI between May 2018 and October 2022 were retrospectively included in this study. The patients were randomly divided into training (n = 388) and testing (n = 97) cohorts. Data were collected using three MRI scanners. We applied a convolutional neural network (CNN) called 3D U-Net for automated SIJ segmentation. Additionally, three CNNs (ResNet50, ResNet101, and DenseNet121) were used to diagnose axSpA-related sacroiliitis using a single modality. The prediction results of all the CNN models across different modalities were integrated using a stacking method based on different algorithms to construct ensemble models, and the optimal ensemble model was used as DLR signature. A combined model incorporating DLR signature with clinical factors was developed using multivariable logistic regression. The performance of the models was evaluated using receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA).

RESULTS

Automated deep learning-based segmentation and manual delineation showed good correlation. ResNet50, as the optimal basic model, achieved an area under the curve (AUC) and accuracy of 0.839 and 0.804, respectively. The combined model yielded the highest performance in diagnosing axSpA-related sacroiliitis (AUC: 0.910; accuracy: 0.856) and outperformed the best ensemble model (AUC: 0.868; accuracy: 0.825) (all P < 0.05). Moreover, the DCA showed good clinical utility in the combined model.

CONCLUSION

We developed a diagnostic model for axSpA-related sacroiliitis by combining the DLR signature with clinical factors, which resulted in excellent diagnostic performance.

A deep neural network for MRI spinal inflammation in axial spondyloarthritis

OBJECTIVE

To develop a deep neural network for the detection of inflammatory spine in short tau inversion recovery (STIR) sequence of magnetic resonance imaging (MRI) on patients with axial spondyloarthritis (axSpA).

METHODS

A total 330 patients with axSpA were recruited. STIR MRI of the whole spine and clinical data were obtained. Regions of interests (ROIs) were drawn outlining the active inflammatory lesion consisting of bone marrow edema (BME). Spinal inflammation was defined by the presence of an active inflammatory lesion on the STIR sequence. The 'fake-color' images were constructed. Images from 270 and 60 patients were randomly separated into the training/validation and testing sets, respectively. Deep neural network was developed using attention UNet. The neural network performance was compared to the image interpretation by a radiologist blinded to the ground truth.

RESULTS

Active inflammatory lesions were identified in 2891 MR images and were absent in 14,590 MR images. The sensitivity and specificity of the derived deep neural network were 0.80 ± 0.03 and 0.88 ± 0.02, respectively. The Dice coefficient of the true positive lesions was 0.55 ± 0.02. The area under the curve of the receiver operating characteristic (AUC-ROC) curve of the deep neural network was 0.87 ± 0.02. The performance of the developed deep neural network was comparable to the interpretation of a radiologist with similar sensitivity and specificity.

CONCLUSION

The developed deep neural network showed similar sensitivity and specificity to a radiologist with four years of experience. The results indicated that the network can provide a reliable and straightforward way of interpreting spinal MRI. The use of this deep neural network has the potential to expand the use of spinal MRI in managing axSpA.

Deep Learning Algorithm of the SPARCC Scoring System in SI Joint MRI

BACKGROUND

The Spondyloarthritis Research Consortium of Canada (SPARCC) scoring system is a sacroiliitis grading system.

PURPOSE

To develop a deep learning-based pipeline for grading sacroiliitis using the SPARCC scoring system.

STUDY TYPE

Prospective.

POPULATION

The study included 389 participants (42.2-year-old, 44.6% female, 317/35/37 for training/validation/testing). A pretrained algorithm was used to differentiate image with/without sacroiliitis.

FIELD STRENGTH/SEQUENCE

3-T, short tau inversion recovery (STIR) sequence, fast spine echo.

ASSESSMENT

The regions of interest as ground truth for models' training were identified by a rheumatologist (HYC, 10-year-experience) and a radiologist (KHL, 6-year-experience) using the Assessment of Spondyloarthritis International Society definition of MRI sacroiliitis independently. Another radiologist (YYL, 4.5-year-experience) solved the discrepancies. The bone marrow edema (BME) and sacroiliac region models were for segmentation. Frangi-filter detected vessels used as intense reference. Deep learning pipeline scored using SPARCC scoring system evaluating presence and features of BMEs. A rheumatologist (SCWC, 6-year-experience) and a radiologist (VWHL, 14-year-experience) scored using the SPARCC scoring system once. The radiologist (YYL) scored twice with 5-day interval.

STATISTICAL TESTS

Independent samples t-tests and Chi-squared tests were used. Interobserver and intraobserver reliability by intraclass correlation coefficient (ICC) and Pearson coefficient evaluated consistency between readers and the deep learning pipeline. We evaluated the performance using sensitivity, accuracy, positive predictive value, and Dice coefficient. A P-value <0.05 was considered statistically significant.

RESULTS

The ICC and the Pearson coefficient between the SPARCC scores from three readers and the deep learning pipeline were 0.83 and 0.86, respectively. The sensitivity in identifying BME and accuracy of identifying SI joints and blood vessels was 0.83, 0.90, and 0.88, respectively. The dice coefficients were 0.82 (sacrum) and 0.80 (ilium).

DATA CONCLUSION

The high consistency with human readers indicated that deep learning pipeline may provide a SPARCC-informed deep learning approach for scoring of STIR images in spondyloarthritis.

EVIDENCE LEVEL

1 TECHNICAL EFFICACY: Stage 2.

Implementation of artificial intelligence models in magnetic resonance imaging with focus on diagnosis of rheumatoid arthritis and axial spondyloarthritis: narrative review

Early diagnosis in rheumatoid arthritis (RA) and axial spondyloarthritis (axSpA) is essential to initiate timely interventions, such as medication and lifestyle changes, preventing irreversible joint damage, reducing symptoms, and improving long-term outcomes for patients. Since magnetic resonance imaging (MRI) of the wrist and hand, in case of RA and MRI of the sacroiliac joints (SIJ) in case of axSpA can identify inflammation before it is clinically discernible, this modality may be crucial for early diagnosis. Artificial intelligence (AI) techniques, together with machine learning (ML) and deep learning (DL) have quickly evolved in the medical field, having an important role in improving diagnosis, prognosis, in evaluating the effectiveness of treatment and monitoring the activity of rheumatic diseases through MRI. The improvements of AI techniques in the last years regarding imaging interpretation have demonstrated that a computer-based analysis can equal and even exceed the human eye. The studies in the field of AI have investigated how specific algorithms could distinguish between tissues, diagnose rheumatic pathology and grade different signs of early inflammation, all of them being crucial for tracking disease activity. The aim of this paper is to highlight the implementation of AI models in MRI with focus on diagnosis of RA and axSpA through a literature review.

The Development and Validation of an AI Diagnostic Model for Sacroiliitis: A Deep-Learning Approach

PURPOSE

Sacroiliitis refers to the inflammatory condition of the sacroiliac joints, frequently causing lower back pain. It is often associated with systemic conditions. However, its signs on radiographic images can be subtle, which may result in it being overlooked or underdiagnosed. This study aims to utilize artificial intelligence (AI) to create a diagnostic tool for more accurate sacroiliitis detection in radiological images, with the goal of optimizing treatment plans and improving patient outcomes.

MATERIALS AND METHOD

The study included 492 patients who visited our hospital. Right sacroiliac joint films were independently evaluated by two musculoskeletal radiologists using the Modified New York criteria (Normal, Grades 1-4). A consensus reading resolved disagreements. The images were preprocessed with Z-score standardization and histogram equalization. The DenseNet121 algorithm, a convolutional neural network with 201 layers, was used for learning and classification. All steps were performed on the DEEP:PHI platform.

RESULT

The AI model exhibited high accuracy across different grades: 94.53% (Grade 1), 95.83% (Grade 2), 98.44% (Grade 3), 96.88% (Grade 4), and 96.09% (Normal cases). Sensitivity peaked at Grade 3 and Normal cases (100%), while Grade 4 achieved perfect specificity (100%). PPVs ranged from 82.61% (Grade 1) to 100% (Grade 4), and NPVs peaked at 100% for Grade 3 and Normal cases. The F1 scores ranged from 64.41% (Grade 1) to 95.38% (Grade 3).

CONCLUSIONS

The AI diagnostic model showcased a robust performance in detecting and grading sacroiliitis, reflecting its potential to enhance diagnostic accuracy in clinical settings. By facilitating earlier and more accurate diagnoses, this model could substantially impact treatment strategies and patient outcomes.

Machine Learning Pipeline for Predicting Bone Marrow Edema Along the Sacroiliac Joints on Magnetic Resonance Imaging

OBJECTIVE

We aimed to develop and validate a fully automated machine learning (ML) algorithm that predicts bone marrow edema (BME) on a quadrant level in sacroiliac (SI) joint magnetic resonance imaging (MRI).

METHODS

A computer vision workflow automatically locates the SI joints, segments regions of interest (ilium and sacrum), performs objective quadrant extraction, and predicts presence of BME, suggestive of inflammatory lesions, on a quadrant level in semicoronal slices of T1/T2-weighted MRI scans. Ground truth was determined by consensus among human readers. The inflammation classifier was trained using a ResNet18 backbone and five-fold cross-validated on scans of patients with spondyloarthritis (SpA) (n = 279), postpartum individuals (n = 71), and healthy subjects (n = 114). Independent SpA patient MRI scans (n = 243) served as test data set. Patient-level predictions were derived from aggregating quadrant-level predictions, ie, at least one positive quadrant.

RESULTS

The algorithm automatically detects the SI joints with a precision of 98.4% and segments ilium/sacrum with an intersection over union of 85.6% and 67.9%, respectively. The inflammation classifier performed well in cross-validation: area under the curve (AUC) 94.5%, balanced accuracy (B-ACC) 80.5%, and F1 score 64.1%. In the test data set, AUC was 88.2%, B-ACC 72.1%, and F1 score 50.8%. On a patient level, the model achieved a B-ACC of 81.6% and 81.4% in the cross-validation and test data set, respectively.

CONCLUSION

We propose a fully automated ML pipeline that enables objective and standardized evaluation of BME along the SI joints on MRI. This method has the potential to screen large numbers of patients with (suspected) SpA and is a step closer towards artificial intelligence-assisted diagnosis and follow-up.

Performances of machine learning algorithms in discriminating sacroiliitis features on MRI: a systematic review

OBJECTIVES

Summarise the evidence of the performance of the machine learning algorithm in discriminating sacroiliitis features on MRI and compare it with the accuracy of human physicians.

METHODS

MEDLINE, EMBASE, CIHNAL, Web of Science, IEEE, American College of Rheumatology and European Alliance of Associations for Rheumatology abstract archives were searched for studies published between 2008 and 4 June 2023. Two authors independently screened and extracted the variables, and the results are presented using tables and forest plots.

RESULTS

Ten studies were selected from 2381. Over half of the studies used deep learning models, using Assessment of Spondyloarthritis International Society sacroiliitis criteria as the ground truth, and manually extracted the regions of interest. All studies reported the area under the curve as a performance index, ranging from 0.76 to 0.99. Sensitivity and specificity were the second-most commonly reported indices, with sensitivity ranging from 0.56 to 1.00 and specificity ranging from 0.67 to 1.00; these results are comparable to a radiologist's sensitivity of 0.67-1.00 and specificity of 0.78-1.00 in the same cohort. More than half of the studies showed a high risk of bias in the analysis domain of quality appraisal owing to the small sample size or overfitting issues.

CONCLUSION

The performance of machine learning algorithms in discriminating sacroiliitis features on MRI varied owing to the high heterogeneity between studies and the small sample sizes, overfitting, and under-reporting issues of individual studies. Further well-designed and transparent studies are required.

[Multi-sequence relation attention network for diagnosing HLA-B27-negative axial spondyloarthritis]

OBJECTIVE

To develop a new 3D multi-sequence relation attention network for exploring the complementary and correlation information of different magnetic resonance imaging (MRI) modalities and improving the diagnostic performance of HLA-B27-negative axial spondyloarthropathy (axSpA).

METHODS

We retrospectively collected T1-weighted imaging (T1WI) and fat suppuration MRI (FS-MRI) data and clinical data of 375 HLA-B27-negative patients from the Third Affiliated Hospital of Southern Medical University (including 164 axSpA and 211 non-axSpA patients) and 49 patients from Nanhai Hospital (including 27 axSpA and 22 non-axSpA patients) between January, 2010 and August, 2021.A 3D relation attention network MSFANet based on multi-sequence MRI was used for automatic diagnosis of axSpA against non-axSpA in these patients.MSFANet consisted of a shallow shared feature learning module and a class-aware feature learning module, and latter module used a 3D multi-sequence relation attention mechanism to refine and fuse multi-sequence MRI features.A hybrid loss function was used to enhance the recognition ability of MSFANet by learning the loss weight coefficients of different branches to improve the classification performance.

RESULTS

The experimental results demonstrated that MSFANet outperformed several state-of-the-art fusion algorithms (P<0.05) with AUC, accuracy, sensitivity, and specificity of 0.840, 77.93%, 83.70%, and 70.29% in the internal validation set, and of 0.783, 74.47%, 82.43% and 70.40% in the independent external validation set, respectively.The ablation studies showed that under the same architecture, the fusion model was superior to single-sequence models, which confirmed the effectiveness and necessity of fusing multi-sequence MRI.The visualization results demonstrated that MSFANet could focus on learning information from abnormal areas on MRI during the classification.

CONCLUSION

We successfully constructed a 3D deep neural network based on multi-sequence MRI for differential diagnosis of HLA-B27-negative axSpA against nonaxSpA and verified the effectiveness of the multisequence relation attention mechanism for promoting classification performance of the network.

Artificial intelligence for the detection of sacroiliitis on magnetic resonance imaging in patients with axial spondyloarthritis

Background

Magnetic resonance imaging (MRI) is important for the early detection of axial spondyloarthritis (axSpA). We developed an artificial intelligence (AI) model for detecting sacroiliitis in patients with axSpA using MRI.

Methods

This study included MRI examinations of patients who underwent semi-coronal MRI scans of the sacroiliac joints owing to chronic back pain with short tau inversion recovery (STIR) sequences between January 2010 and December 2021. Sacroiliitis was defined as a positive MRI finding according to the ASAS classification criteria for axSpA. We developed a two-stage framework. First, the Faster R-CNN network extracted regions of interest (ROIs) to localize the sacroiliac joints. Maximum intensity projection (MIP) of three consecutive slices was used to mimic the reading of two adjacent slices. Second, the VGG-19 network determined the presence of sacroiliitis in localized ROIs. We augmented the positive dataset six-fold. The sacroiliitis classification performance was measured using the sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC). The prediction models were evaluated using three-round three-fold cross-validation.

Results

A total of 296 participants with 4,746 MRI slices were included in the study. Sacroiliitis was identified in 864 MRI slices of 119 participants. The mean sensitivity, specificity, and AUROC for the detection of sacroiliitis were 0.725 (95% CI, 0.705-0.745), 0.936 (95% CI, 0.924-0.947), and 0.830 (95%CI, 0.792-0.868), respectively, at the image level and 0.947 (95% CI, 0.912-0.982), 0.691 (95% CI, 0.603-0.779), and 0.816 (95% CI, 0.776-0.856), respectively, at the patient level. In the original model, without using MIP and dataset augmentation, the mean sensitivity, specificity, and AUROC were 0.517 (95% CI, 0.493-0.780), 0.944 (95% CI, 0.933-0.955), and 0.731 (95% CI, 0.681-0.780), respectively, at the image level and 0.806 (95% CI, 0.729-0.883), 0.617 (95% CI, 0.523-0.711), and 0.711 (95% CI, 0.660-0.763), respectively, at the patient level. The performance was improved by MIP techniques and data augmentation.

Conclusion

An AI model was developed for the detection of sacroiliitis using MRI, compatible with the ASAS criteria for axSpA, with the potential to aid MRI application in a wider clinical setting.

T1-weighted images-based radiomics for structural lesions evaluation in patients with suspected axial spondyloarthritis

PURPOSE

The aim of this study was to investigate the feasibility of radiomics based on T1-weighted images (T1WI) for assessing sacroiliac joint (SIJ) structural lesions in patients with suspected axial spondyloarthritis (axSpA).

MATERIALS AND METHODS

A total of 266 patients with clinical suspicion of axSpA between December 2016 and January 2022 were enrolled. Structural lesions were assessed on low-dose CT (ldCT) and MRI, respectively. Radiomic features, extracted from SIJ T1WI, were included to generate the radiomics model. The performance of the radiomics model was evaluated using receiver operating characteristic (ROC) curve. Furthermore, point-biserial correlation analysis was used to interpret the associations between the radiomic feature and structural lesions.

RESULTS

Using ldCT as the reference standard, the radiomics model showed favorable performance for detecting positive global structural lesions in the training cohort (AUC, 0.82 [95% CI: 0.76, 0.88]) and validation cohort (AUC, 0.82 [95% CI: 0.72, 0.91]. Experienced MRI raters yielded predictive AUCs of 0.73 (95% CI: 0.67, 0.79), and 0.74 (95% CI: 0.66, 0.83) in the training and validation cohort, respectively. The seven radiomic features included in the radiomics model showed significant correlation with different kinds of structural lesions (P all < 0.05). Among them, Wavelet.LHL_firstorder_90Percentile showed the strongest association with fat lesion (r = 0.48, P < 0.05).

CONCLUSION

The radiomics analysis with T1WI could effectively detect SIJ structural lesions and achieved expert-level performance. Each radiomic feature was correlated with different structural lesions significantly, which might inform radiomic-based applications for axSpA intelligent diagnosis.

A deep learning model for the diagnosis of sacroiliitis according to Assessment of SpondyloArthritis International Society classification criteria with magnetic resonance imaging

PURPOSE

The purpose of this study was to develop and evaluate a deep learning model to detect bone marrow edema (BME) in sacroiliac joints and predict the MRI Assessment of SpondyloArthritis International Society (ASAS) definition of active sacroiliitis in patients with chronic inflammatory back pain.

MATERIALS AND METHODS

MRI examinations of patients from the French prospective multicenter DESIR cohort (DEvenir des Spondyloarthropathies Indifférenciées Récentes) were used for training, validation and testing. Patients with inflammatory back pain lasting three months to three years were recruited. Test datasets were from MRI follow-ups at five years and ten years. The model was evaluated using an external test dataset from the ASAS cohort. A neuronal network classifier (mask-RCNN) was trained and evaluated for sacroiliac joints detection and BME classification. Diagnostic capabilities of the model to predict ASAS MRI active sacroiliitis (BME in at least two half-slices) were assessed using Matthews correlation coefficient (MCC), sensitivity, specificity, accuracy and AUC. The gold standard was experts' majority decision.

RESULTS

A total of 256 patients with 362 MRI examinations from the DESIR cohort were included, with 27% meeting the ASAS definition for experts. A total of 178 MRI examinations were used for the training set, 25 for the validation set and 159 for the evaluation set. MCCs for DESIR baseline, 5-years, and 10-years follow-up were 0.90 (n = 53), 0.64 (n = 70), and 0.61 (n = 36), respectively. AUCs for predicting ASAS MRI were 0.98 (95% CI: 0.93-1), 0.90 (95% CI: 0.79-1), and 0.80 (95% CI: 0.62-1), respectively. The ASAS external validation cohort included 47 patients (mean age 36 ± 10 [SD] years; women, 51%) with 19% meeting the ASAS definition. MCC was 0.62, sensitivity 56% (95% CI: 42-70), specificity 100% (95% CI: 100-100) and AUC 0.76 (95% CI: 0.57-0.95).

CONCLUSION

The deep learning model achieves performance close to those of experts for BME detection in sacroiliac joints and determination of active sacroiliitis according to the ASAS definition.

DCNAS-Net: deformation convolution and neural architecture search detection network for bone marrow oedema

Background

Lumbago is a global disease that affects more than 500 million people worldwide. Bone marrow oedema is one of the main causes of the condition and clinical diagnosis is mainly made by radiologists manually reviewing MRI images to determine whether oedema is present. However, the number of patients with Lumbago has risen dramatically in recent years, which has brought a huge workload to radiologists. In order to improve the efficiency of diagnosis, this paper is devoted to developing and evaluating a neural network for detecting bone marrow edema in MRI images.

Related work

Inspired by the development of deep learning and image processing techniques, we design a deep learning detection algorithm specifically for the detection of bone marrow oedema from lumbar MRI images. We introduce deformable convolution, feature pyramid networks and neural architecture search modules, and redesign the existing neural networks. We explain in detail the construction of the network and illustrate the setting of the network hyperparameters.

Results and discussion

The detection accuracy of our algorithm is excellent. And its accuracy of detecting bone marrow oedema reached up to 90.6\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\%$$\end{document}%, an improvement of 5.7\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\%$$\end{document}% compared to the original. The recall of our neural network is 95.1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\%$$\end{document}%, and the F1-measure also reaches 92.8\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\%$$\end{document}%. And our algorithm is fast in detecting it, taking only 0.144 s per image.

Conclusion

Extensive experiments have demonstrated that deformable convolution and aggregated feature pyramid structures are conducive for the detection of bone marrow oedema. Our algorithm has better detection accuracy and good detection speed compared to other algorithms.

Can radiomics replace the SPARCC scoring system in evaluating bone marrow edema of sacroiliac joints in patients with axial spondyloarthritis?

OBJECTIVES

To develop an objective and efficient method based on radiomics to evaluate bone marrow edema (BMO) of sacroiliac joints (SIJs) by magnetic resonance imaging (MRI) in patients with axial spondyloarthritis (axSpA) and to compare with the Spondyloarthritis Research Consortium of Canada (SPARCC) scoring system.

METHODS

From September 2013 to March 2022, patients with axSpA who underwent 3.0T SIJ-MRI were included and were randomly divided into training and validation cohorts at a ratio of 7:3. The optimal radiomics features selected from the SIJ-MRI in the training cohort were included to generate the radiomics model. The performance of the model was evaluated by ROC analysis and decision curve analysis (DCA). Rad scores were calculated using the radiomics model. The responsiveness was compared for Rad scores and SPARCC scores. We also assessed the correlation between the Rad score and SPARCC score.

RESULTS

A total of 558 patients were finally included. The radiomics model showed favorable discrimination of a SPARCC score <2 or ≥2 both in the training (AUC, 0.90; 95% CI: 0.87-0.93) and validation cohorts (AUC, 0.90; 95% CI, 0.86-0.95). DCA confirmed that the model was clinically useful. Rad score showed higher responsiveness to treatment-related change than SPARCC score. Furthermore, a significant correlation was noted between the Rad score and SPARCC score when scoring the status of BMO (r_s=0.80, P < 0.001), and a strong correlation was noted when scoring the change in BMO (r=0.70, P < 0.001).

CONCLUSION

The study proposed a radiomics model to accurately quantify the BMO of SIJs in patients with axSpA, providing an alternative to the SPARCC scoring system. Key Points • The Rad score is an index with high validity for the objective and quantitative evaluation of bone marrow edema (BMO) of the sacroiliac joints in axial spondyloarthritis. • The Rad score is a promising tool to monitor the change of BMO upon treatment.

Comprehensive AI-assisted tool for ankylosing spondylitis based on multicenter research outperforms human experts

Introduction

The diagnosis and treatment of ankylosing spondylitis (AS) is a difficult task, especially in less developed countries without access to experts. To address this issue, a comprehensive artificial intelligence (AI) tool was created to help diagnose and predict the course of AS.

Methods

In this retrospective study, a dataset of 5389 pelvic radiographs (PXRs) from patients treated at a single medical center between March 2014 and April 2022 was used to create an ensemble deep learning (DL) model for diagnosing AS. The model was then tested on an additional 583 images from three other medical centers, and its performance was evaluated using the area under the receiver operating characteristic curve analysis, accuracy, precision, recall, and F1 scores. Furthermore, clinical prediction models for identifying high-risk patients and triaging patients were developed and validated using clinical data from 356 patients.

Results

The ensemble DL model demonstrated impressive performance in a multicenter external test set, with precision, recall, and area under the receiver operating characteristic curve values of 0.90, 0.89, and 0.96, respectively. This performance surpassed that of human experts, and the model also significantly improved the experts' diagnostic accuracy. Furthermore, the model's diagnosis results based on smartphone-captured images were comparable to those of human experts. Additionally, a clinical prediction model was established that accurately categorizes patients with AS into high-and low-risk groups with distinct clinical trajectories. This provides a strong foundation for individualized care.

Discussion

In this study, an exceptionally comprehensive AI tool was developed for the diagnosis and management of AS in complex clinical scenarios, especially in underdeveloped or rural areas that lack access to experts. This tool is highly beneficial in providing an efficient and effective system of diagnosis and management.