Automatic segmentation and grading of ankylosing spondylitis on MR images via lightweight hybrid multi-scale convolutional neural network with reinforcement learning

Sacroiliitis diagnosis based on interpretable features and multi-task learning

Objective.Sacroiliitis is an early pathological manifestation of ankylosing spondylitis (AS), and a positive sacroiliitis test on imaging may help clinical practitioners diagnose AS early. Deep learning based automatic diagnosis algorithms can deliver grading findings for sacroiliitis, however, it requires a large amount of data with precise labels to train the model and lacks grading features visualization. In this paper, we aimed to propose a radiomics and deep learning based deep feature visualization positive diagnosis algorithm for sacroiliitis on CT scans. Visualization of grading features can enhance clinical interpretability with visual grading features, which assist doctors in diagnosis and treatment more effectively.Approach.The region of interest (ROI) is identified by segmenting the sacroiliac joint (SIJ) 3D CT images using a combination of the U-net model and certain statistical approaches. Then, in addition to extracting spatial and frequency domain features from ROI according to the radiographic manifestations of sacroiliitis, the radiomics features have also been integrated into the proposed encoder module to obtain a powerful encoder and extract features effectively. Finally, a multi-task learning technique and five-class labels are utilized to help with performing positive tests to reduce discrepancies in the evaluation of several radiologists.Main results.On our private dataset, proposed methods have obtained an accuracy rate of 87.3%, which is 9.8% higher than the baseline and consistent with assessments made by qualified medical professionals.Significance.The results of the ablation experiment and interpreting analysis demonstrated that the proposed methods are applied in automatic CT scan sacroiliitis diagnosis due to their excellently interpretable and portable advantages.

ASNET: A Novel AI Framework for Accurate Ankylosing Spondylitis Diagnosis from MRI

BACKGROUND

Ankylosing spondylitis (AS) is a chronic, painful, progressive disease usually seen in the spine. Traditional diagnostic methods have limitations in detecting the early stages of AS. The early diagnosis of AS can improve patients' quality of life. This study aims to diagnose AS with a pre-trained hybrid model using magnetic resonance imaging (MRI).

MATERIALS AND METHODS

In this research, we collected a new MRI dataset comprising three cases. Furthermore, we introduced a novel deep feature engineering model. Within this model, we utilized three renowned pretrained convolutional neural networks (CNNs): DenseNet201, ResNet50, and ShuffleNet. Through these pretrained CNNs, deep features were generated using the transfer learning approach. For each pretrained network, two feature vectors were generated from an MRI. Three feature selectors were employed during the feature selection phase, amplifying the number of features from 6 to 18 (calculated as 6 × 3). The k-nearest neighbors (kNN) classifier was utilized in the classification phase to determine classification results. During the information phase, the iterative majority voting (IMV) algorithm was applied to secure voted results, and our model selected the output with the highest classification accuracy. In this manner, we have introduced a self-organized deep feature engineering model.

RESULTS

We have applied the presented model to the collected dataset. The proposed method yielded 99.80%, 99.60%, 100%, and 99.80% results for accuracy, recall, precision, and F1-score for the collected axial images dataset. The collected coronal image dataset yielded 99.45%, 99.20%, 99.70%, and 99.45% results for accuracy, recall, precision, and F1-score, respectively. As for contrast-enhanced images, accuracy of 95.62%, recall of 80.72%, precision of 94.24%, and an F1-score of 86.96% were attained.

CONCLUSIONS

Based on the results, the proposed method for classifying AS disease has demonstrated successful outcomes using MRI. The model has been tested on three cases, and its consistently high classification performance across all cases underscores the model's general robustness. Furthermore, the ability to diagnose AS disease using only axial images, without the need for contrast-enhanced MRI, represents a significant advancement in both healthcare and economic terms.