Use of artificial intelligence in imaging in rheumatology - current status and future perspectives

Comparative performance of artificial intelligence models in rheumatology board-level questions: evaluating Google Gemini and ChatGPT-4o

OBJECTIVES

This study evaluates the performance of AI models, ChatGPT-4o and Google Gemini, in answering rheumatology board-level questions, comparing their effectiveness, reliability, and applicability in clinical practice.

METHOD

A cross-sectional study was conducted using 420 rheumatology questions from the BoardVitals question bank, excluding 27 visual data questions. Both artificial intelligence models categorized the questions according to difficulty (easy, medium, hard) and answered them. In addition, the reliability of the answers was assessed by asking the questions a second time. The accuracy, reliability, and difficulty categorization of the AI models' response to the questions were analyzed.

RESULTS

ChatGPT-4o answered 86.9% of the questions correctly, significantly outperforming Google Gemini's 60.2% accuracy (p < 0.001). When the questions were asked a second time, the success rate was 86.7% for ChatGPT-4o and 60.5% for Google Gemini. Both models mainly categorized questions as medium difficulty. ChatGPT-4o showed higher accuracy in various rheumatology subfields, notably in Basic and Clinical Science (p = 0.028), Osteoarthritis (p = 0.023), and Rheumatoid Arthritis (p < 0.001).

CONCLUSIONS

ChatGPT-4o significantly outperformed Google Gemini in rheumatology board-level questions. This demonstrates the success of ChatGPT-4o in situations requiring complex and specialized knowledge related to rheumatological diseases. The performance of both AI models decreased as the question difficulty increased. This study demonstrates the potential of AI in clinical applications and suggests that its use as a tool to assist clinicians may improve healthcare efficiency in the future. Future studies using real clinical scenarios and real board questions are recommended. Key Points •ChatGPT-4o significantly outperformed Google Gemini in answering rheumatology board-level questions, achieving 86.9% accuracy compared to Google Gemini's 60.2%. •For both AI models, the correct answer rate decreased as the question difficulty increased. •The study demonstrates the potential for AI models to be used in clinical practice as a tool to assist clinicians and improve healthcare efficiency.

The emerging paradigm in pediatric rheumatology: harnessing the power of artificial intelligence

Artificial intelligence algorithms, with roots extending into the past but experiencing a resurgence and evolution in recent years due to their superiority over traditional methods and contributions to human capabilities, have begun to make their presence felt in the field of pediatric rheumatology. In the ever-evolving realm of pediatric rheumatology, there have been incremental advancements supported by artificial intelligence in understanding and stratifying diseases, developing biomarkers, refining visual analyses, and facilitating individualized treatment approaches. However, like in many other domains, these strides have yet to gain clinical applicability and validation, and ethical issues remain unresolved. Furthermore, mastering different and novel terminologies appears challenging for clinicians. This review aims to provide a comprehensive overview of the current literature, categorizing algorithms and their applications, thus offering a fresh perspective on the nascent relationship between pediatric rheumatology and artificial intelligence, highlighting both its advancements and constraints.

Reliability of a generative artificial intelligence tool for pediatric familial Mediterranean fever: insights from a multicentre expert survey

BACKGROUND

Artificial intelligence (AI) has become a popular tool for clinical and research use in the medical field. The aim of this study was to evaluate the accuracy and reliability of a generative AI tool on pediatric familial Mediterranean fever (FMF).

METHODS

Fifteen questions repeated thrice on pediatric FMF were prompted to the popular generative AI tool Microsoft Copilot with Chat-GPT 4.0. Nine pediatric rheumatology experts rated response accuracy with a blinded mechanism using a Likert-like scale with values from 1 to 5.

RESULTS

Median values for overall responses at the initial assessment ranged from 2.00 to 5.00. During the second assessment, median values spanned from 2.00 to 4.00, while for the third assessment, they ranged from 3.00 to 4.00. Intra-rater variability showed poor to moderate agreement (intraclass correlation coefficient range: -0.151 to 0.534). A diminishing level of agreement among experts over time was documented, as highlighted by Krippendorff's alpha coefficient values, ranging from 0.136 (at the first response) to 0.132 (at the second response) to 0.089 (at the third response). Lastly, experts displayed varying levels of trust in AI pre- and post-survey.

CONCLUSIONS

AI has promising implications in pediatric rheumatology, including early diagnosis and management optimization, but challenges persist due to uncertain information reliability and the lack of expert validation. Our survey revealed considerable inaccuracies and incompleteness in AI-generated responses regarding FMF, with poor intra- and extra-rater reliability. Human validation remains crucial in managing AI-generated medical information.

Guideline for RSA and CT-RSA implant migration measurements: an update of standardizations and recommendations

Opening remarks: These guidelines are the result of discussions within a diverse group of RSA researchers. They were approved in December 2023 by the board and selected members of the International Radiostereometry Society to update the guidelines by Valstar et al. [1]. By adhering to these guidelines, RSA studies will become more transparent and consistent in execution, presentation, reporting, and interpretation. Both authors and reviewers of scientific papers using RSA may use these guidelines, summarized in the Checklist, as a reference. Deviations from these guidelines should have the underlying rationale stated.

Machine learning diagnosis of active Juvenile Idiopathic Arthritis on blood pool [ 99M Tc] Tc-MDP scintigraphy images

PURPOSE

Neural network has widely been applied for medical classifications and disease diagnosis. This study employs deep learning to best discriminate Juvenile Idiopathic Arthritis (JIA), a pediatric chronic joint inflammatory disease, from healthy joints by exploring blood pool images of 2phase [ 99m Tc] Tc-MDP bone scintigraphy.

METHODS

Self-deigned multi-input Convolutional Neural Network (CNN) in addition to three available pre-trained models including VGG16, ResNet50 and Xception are applied on 1304 blood pool images of 326 healthy and known JIA children and adolescents (aged 1-16).

RESULTS

The self-designed model ROC analysis shows diagnostic efficiency with Area Under the Curve (AUC) 0.82 and 0.86 for knee and ankle joints, respectively. Among the three pertained models, VGG16 ROC analysis reveals AUC 0.76 and 0.81 for knee and ankle images, respectively.

CONCLUSION

The self-designed model shows best performance on blood pool scintigraph diagnosis of patients with JIA. VGG16 was the most efficient model rather to other pre-trained networks. This study can pave the way of artificial intelligence (AI) application in nuclear medicine for the diagnosis of pediatric inflammatory disease.

Artificial intelligence to analyze magnetic resonance imaging in rheumatology

Rheumatic disorders present a global health challenge, marked by inflammation and damage to joints, bones, and connective tissues. Accurate, timely diagnosis and appropriate management are crucial for favorable patient outcomes. Magnetic resonance imaging (MRI) has become indispensable in rheumatology, but interpretation remains laborious and variable. Artificial intelligence (AI), including machine learning (ML) and deep learning (DL), offers a means to improve and advance MRI analysis. This review examines current AI applications in rheumatology MRI analysis, addressing diagnostic support, disease classification, activity assessment, and progression monitoring. AI demonstrates promise, with high sensitivity, specificity, and accuracy, achieving or surpassing expert performance. The review also discusses clinical implementation challenges and future research directions to enhance rheumatic disease diagnosis and management.

A Stepwise Approach to Analyzing Musculoskeletal Imaging Data With Artificial Intelligence

The digitization of medical records and expanding electronic health records has created an era of "Big Data" with an abundance of available information ranging from clinical notes to imaging studies. In the field of rheumatology, medical imaging is used to guide both diagnosis and treatment of a wide variety of rheumatic conditions. Although there is an abundance of data to analyze, traditional methods of image analysis are human resource intensive. Fortunately, the growth of artificial intelligence (AI) may be a solution to handle large datasets. In particular, computer vision is a field within AI that analyzes images and extracts information. Computer vision has impressive capabilities and can be applied to rheumatologic conditions, necessitating a need to understand how computer vision works. In this article, we provide an overview of AI in rheumatology and conclude with a five step process to plan and conduct research in the field of computer vision. The five steps include (1) project definition, (2) data handling, (3) model development, (4) performance evaluation, and (5) deployment into clinical care.

Systemic lupus in the era of machine learning medicine

Artificial intelligence and machine learning applications are emerging as transformative technologies in medicine. With greater access to a diverse range of big datasets, researchers are turning to these powerful techniques for data analysis. Machine learning can reveal patterns and interactions between variables in large and complex datasets more accurately and efficiently than traditional statistical methods. Machine learning approaches open new possibilities for studying SLE, a multifactorial, highly heterogeneous and complex disease. Here, we discuss how machine learning methods are rapidly being integrated into the field of SLE research. Recent reports have focused on building prediction models and/or identifying novel biomarkers using both supervised and unsupervised techniques for understanding disease pathogenesis, early diagnosis and prognosis of disease. In this review, we will provide an overview of machine learning techniques to discuss current gaps, challenges and opportunities for SLE studies. External validation of most prediction models is still needed before clinical adoption. Utilisation of deep learning models, access to alternative sources of health data and increased awareness of the ethics, governance and regulations surrounding the use of artificial intelligence in medicine will help propel this exciting field forward.

What does artificial intelligence mean in rheumatology?

Intelligence is the ability of humans to learn from experiences to ascribe conscious weights and unconscious biases to modulate their outputs from given inputs. Transferring this ability to computers is artificial intelligence (AI). The ability of computers to understand data in an intelligent manner is machine learning. When such learning is with images and videos, which involves deeper layers of artificial neural networks, it is described as deep learning. Large language models are the latest development in AI which incorporate self-learning into deep learning through transformers. AI in Rheumatology has immense potential to revolutionize healthcare and research. Machine learning could aid clinical diagnosis and decision-making, and deep learning could extend this to analyze images of radiology or positron emission tomography scans or histopathology images to aid a clinician's diagnosis. Analysis of routinely obtained patient data or continuously collected information from wearables could predict disease flares. Analysis of high-volume genomics, transcriptomics, proteomics, or metabolomics data from patients could help identify novel markers of disease prognosis. AI might identify newer therapeutic targets based on in-silico modelling of omics data. AI could help automate medical administrative work such as inputting information into electronic health records or transcribing clinic notes. AI could help automate patient education and counselling. Beyond the clinic, AI has the potential to aid medical education. The ever-expanding capabilities of AI models bring along with them considerable ethical challenges, particularly related to risks of misuse. Nevertheless, the widespread use of AI in Rheumatology is inevitable and a progress with great potential.

Machine learning application in autoimmune diseases: State of art and future prospectives

Autoimmune diseases are a group of disorders resulting from an alteration of immune tolerance, characterized by the formation of autoantibodies and the consequent development of heterogeneous clinical manifestations. Diagnosing autoimmune diseases is often complicated, and the available prognostic tools are limited. Machine learning allows us to analyze large amounts of data and carry out complex calculations quickly and with minimal effort. In this work, we examine the literature focusing on the use of machine learning in the field of the main systemic (systemic lupus erythematosus and rheumatoid arthritis) and organ-specific autoimmune diseases (type 1 diabetes mellitus, autoimmune thyroid, gastrointestinal, and skin diseases). From our analysis, interesting applications of machine learning emerged for developing algorithms useful in the early diagnosis of disease or prognostic models (risk of complications, therapeutic response). Subsequent studies and the creation of increasingly rich databases to be supplied to the algorithms will eventually guide the clinician in the diagnosis, allowing intervention when the pathology is still in an early stage and immediately directing towards a correct therapeutic approach.

Implementation of artificial intelligence models in magnetic resonance imaging with focus on diagnosis of rheumatoid arthritis and axial spondyloarthritis: narrative review

Early diagnosis in rheumatoid arthritis (RA) and axial spondyloarthritis (axSpA) is essential to initiate timely interventions, such as medication and lifestyle changes, preventing irreversible joint damage, reducing symptoms, and improving long-term outcomes for patients. Since magnetic resonance imaging (MRI) of the wrist and hand, in case of RA and MRI of the sacroiliac joints (SIJ) in case of axSpA can identify inflammation before it is clinically discernible, this modality may be crucial for early diagnosis. Artificial intelligence (AI) techniques, together with machine learning (ML) and deep learning (DL) have quickly evolved in the medical field, having an important role in improving diagnosis, prognosis, in evaluating the effectiveness of treatment and monitoring the activity of rheumatic diseases through MRI. The improvements of AI techniques in the last years regarding imaging interpretation have demonstrated that a computer-based analysis can equal and even exceed the human eye. The studies in the field of AI have investigated how specific algorithms could distinguish between tissues, diagnose rheumatic pathology and grade different signs of early inflammation, all of them being crucial for tracking disease activity. The aim of this paper is to highlight the implementation of AI models in MRI with focus on diagnosis of RA and axSpA through a literature review.

Artificial intelligence-based preventive, personalized and precision medicine for cardiovascular disease/stroke risk assessment in rheumatoid arthritis patients: a narrative review

The challenges associated with diagnosing and treating cardiovascular disease (CVD)/Stroke in Rheumatoid arthritis (RA) arise from the delayed onset of symptoms. Existing clinical risk scores are inadequate in predicting cardiac events, and conventional risk factors alone do not accurately classify many individuals at risk. Several CVD biomarkers consider the multiple pathways involved in the development of atherosclerosis, which is the primary cause of CVD/Stroke in RA. To enhance the accuracy of CVD/Stroke risk assessment in the RA framework, a proposed approach involves combining genomic-based biomarkers (GBBM) derived from plasma and/or serum samples with innovative non-invasive radiomic-based biomarkers (RBBM), such as measurements of synovial fluid, plaque area, and plaque burden. This review presents two hypotheses: (i) RBBM and GBBM biomarkers exhibit a significant correlation and can precisely detect the severity of CVD/Stroke in RA patients. (ii) Artificial Intelligence (AI)-based preventive, precision, and personalized (aiP3) CVD/Stroke risk AtheroEdge™ model (AtheroPoint™, CA, USA) that utilizes deep learning (DL) to accurately classify the risk of CVD/stroke in RA framework. The authors conducted a comprehensive search using the PRISMA technique, identifying 153 studies that assessed the features/biomarkers of RBBM and GBBM for CVD/Stroke. The study demonstrates how DL models can be integrated into the AtheroEdge™-aiP3 framework to determine the risk of CVD/Stroke in RA patients. The findings of this review suggest that the combination of RBBM with GBBM introduces a new dimension to the assessment of CVD/Stroke risk in the RA framework. Synovial fluid levels that are higher than normal lead to an increase in the plaque burden. Additionally, the review provides recommendations for novel, unbiased, and pruned DL algorithms that can predict CVD/Stroke risk within a RA framework that is preventive, precise, and personalized.

Imaging in inflammatory arthritis: progress towards precision medicine

Imaging techniques such as ultrasonography and MRI have gained ground in the diagnosis and management of inflammatory arthritis, as these imaging modalities allow a sensitive assessment of musculoskeletal inflammation and damage. However, these techniques cannot discriminate between disease subsets and are currently unable to deliver an accurate prediction of disease progression and therapeutic response in individual patients. This major shortcoming of today's technology hinders a targeted and personalized patient management approach. Technological advances in the areas of high-resolution imaging (for example, high-resolution peripheral quantitative computed tomography and ultra-high field MRI), functional and molecular-based imaging (such as chemical exchange saturation transfer MRI, positron emission tomography, fluorescence optical imaging, optoacoustic imaging and contrast-enhanced ultrasonography) and artificial intelligence-based data analysis could help to tackle these challenges. These new imaging approaches offer detailed anatomical delineation and an in vivo and non-invasive evaluation of the immunometabolic status of inflammatory reactions, thereby facilitating an in-depth characterization of inflammation. By means of these developments, the aim of earlier diagnosis, enhanced monitoring and, ultimately, a personalized treatment strategy looms closer.

A deep registration method for accurate quantification of joint space narrowing progression in rheumatoid arthritis

Rheumatoid arthritis (RA) is a chronic autoimmune inflammatory disease that leads to progressive articular destruction and severe disability. Joint space narrowing (JSN) has been regarded as an important indicator for RA progression and has received significant attention. Radiology plays a crucial role in the diagnosis and monitoring of RA through the assessment of joint space. A new framework for monitoring joint space by quantifying joint space narrowing (JSN) progression through image registration in radiographic images has emerged as a promising research direction. This framework offers the advantage of high accuracy; however, challenges still exist in reducing mismatches and improving reliability. In this work, we utilize a deep intra-subject rigid registration network to automatically quantify JSN progression in the early stages of RA. In our experiments, the mean-square error of the Euclidean distance between the moving and fixed images was 0.0031, the standard deviation was 0.0661 mm and the mismatching rate was 0.48%. Our method achieves sub-pixel level accuracy, surpassing manual measurements significantly. The proposed method is robust to noise, rotation and scaling of joints. Moreover, it provides misalignment visualization, which can assist radiologists and rheumatologists in assessing the reliability of quantification, exhibiting potential for future clinical applications. As a result, we are optimistic that our proposed method will make a significant contribution to the automatic quantification of JSN progression in RA. Code is available at https://github.com/pokeblow/Deep-Registration-QJSN-Finger.git.

Understanding the role and adoption of artificial intelligence techniques in rheumatology research: An in-depth review of the literature

The major and upward trend in the number of published research related to rheumatic and musculoskeletal diseases, in which artificial intelligence plays a key role, has exhibited the interest of rheumatology researchers in using these techniques to answer their research questions. In this review, we analyse the original research articles that combine both worlds in a five- year period (2017-2021). In contrast to other published papers on the same topic, we first studied the review and recommendation articles that were published during that period, including up to October 2022, as well as the publication trends. Secondly, we review the published research articles and classify them into one of the following categories: disease identification and prediction, disease classification, patient stratification and disease subtype identification, disease progression and activity, treatment response, and predictors of outcomes. Thirdly, we provide a table with illustrative studies in which artificial intelligence techniques have played a central role in more than twenty rheumatic and musculoskeletal diseases. Finally, the findings of the research articles, in terms of disease and/or data science techniques employed, are highlighted in a discussion. Therefore, the present review aims to characterise how researchers are applying data science techniques in the rheumatology medical field. The most immediate conclusions that can be drawn from this work are: multiple and novel data science techniques have been used in a wide range of rheumatic and musculoskeletal diseases including rare diseases; the sample size and the data type used are heterogeneous, and new technical approaches are expected to arrive in the short-middle term.

Performance of Fully Automated Algorithm Detecting Bone Marrow Edema in Sacroiliac Joints

This study evaluates the performance of a fully automated algorithm to detect active inflammation in the form of bone marrow edema (BME) in iliac and sacral bones, depending on the quality of the coronal oblique plane in patients with axial spondyloarthritis (axSpA). The results were assessed based on the technical correctness of MRI examination of the sacroiliac joints (SIJs). A total of 173 patients with suspected axSpA were included in the study. In order to verify the correctness of the MRI, a deviation angle was measured on the slice acquired in the sagittal plane in the T2-weighted sequence. This angle was located between the line drawn between the posterior edges of S1 and S2 vertebrae and the line that marks the actual plane in which the slices were acquired in T1 and STIR sequences. All examinations were divided into quartiles according to the deviation angle measured in degrees as follows: 1st group [0; 2.2], 2nd group (2.2; 5.7], 3rd group (5.7; 10] and 4th group (10; 29.2]. Segmentations of the sacral and iliac bones were acquired manually and automatically using the fully automated algorithm on the T1 sequence. The Dice coefficient for automated bone segmentations with respect to reference manual segmentations was 0.9820 (95% CI [0.9804, 0.9835]). Examinations of BME lesions were assessed using the SPARCC scale (in 68 cases SPARCC > 0). Manual and automatic segmentations of the lesions were performed on STIR sequences and compared. The sensitivity of detection of BME ranged from 0.58 (group 1) to 0.83 (group 2) versus 0.76 (total), while the specificity was equal to 0.97 in each group. The study indicates that the performance of the algorithm is satisfactory regardless of the deviation angle.

A survey of artificial intelligence in rheumatoid arthritis

The article offers a survey of currently notable artificial intelligence methods (released between 2019-2023), with a particular emphasis on the latest advancements in detecting rheumatoid arthritis (RA) at an early stage, providing early treatment, and managing the disease. We discussed challenges in these areas followed by specific artificial intelligence (AI) techniques and summarized advances, relevant strengths, and obstacles. Overall, the application of AI in the fields of RA has the potential to enable healthcare professionals to detect RA at an earlier stage, thereby facilitating timely intervention and better disease management. However, more research is required to confirm the precision and dependability of AI in RA, and several problems such as technological and ethical concerns related to these approaches must be resolved before their widespread adoption.

Artificial Intelligence and laboratory data in rheumatic diseases

Artificial intelligence (AI)-based medical technologies are rapidly evolving into actionable solutions for clinical practice. Machine learning (ML) algorithms can process increasing amounts of laboratory data such as gene expression immunophenotyping data and biomarkers. In recent years, the analysis of ML has become particularly useful for the study of complex chronic diseases, such as rheumatic diseases, heterogenous conditions with multiple triggers. Numerous studies have used ML to classify patients and improve diagnosis, to stratify the risk and determine disease subtypes, as well as to discover biomarkers and gene signatures. This review aims to provide examples of ML models for specific rheumatic diseases using laboratory data and some insights into relevant strengths and limitations. A better understanding and future application of these analytical strategies could facilitate the development of precision medicine for rheumatic patients.

Narrative Review of Machine Learning in Rheumatic and Musculoskeletal Diseases for Clinicians and Researchers: Biases, Goals, and Future Directions

There has been rapid growth in the use of artificial intelligence (AI) analytics in medicine in recent years, including in rheumatic and musculoskeletal diseases (RMDs). Such methods represent a challenge to clinicians, patients, and researchers, given the "black box" nature of most algorithms, the unfamiliarity of the terms, and the lack of awareness of potential issues around these analyses. Therefore, this review aims to introduce this subject area in a way that is relevant and meaningful to clinicians and researchers. We hope to provide some insights into relevant strengths and limitations, reporting guidelines, as well as recent examples of such analyses in key areas, with a focus on lessons learned and future directions in diagnosis, phenotyping, prognosis, and precision medicine in RMDs.

Peripheral spondyloarthritis and psoriatic arthritissine psoriase: are we dealing with semantics or clinically meaningful differences?

Diagnosing peripheral spondyloarthritis (pSpA) remains a significant challenge due to the lack of specific disease biomarkers and the overlap with other SpA subtypes, mainly psoriatic arthritis (PsA), which represents a diagnostic challenge particularly in the absence of skin psoriasis (PsAsine psoriase). This narrative review aimed to compare the epidemiology, genetic susceptibility, pathophysiology, classification criteria, disease phenotype and burden, and therapeutic guidelines between patients diagnosed with pSpA and those with PsAsine psoriase,to determine if the two entities should be considered jointly or distinctly. Globally, pSpA appears to be more inclusive compared with PsAsine psoriase. Areas of similarities include age of onset, number of joints involved and prevalence of axial involvement. However, patients with pSpA have a male gender predominance, a higher prevalence of HLA-B27, enthesitis and involvement of large joints of the lower limbs, whereas patients with PsAsine psoriasehave a higher prevalence HLA-Cw6, dactylitis and involvement of hand distal interphalangeal joints. Therefore, the difference between pSpA and PsAsine psoriasegoes beyond semantics. The few dissimilarities should drive scientific efforts to reach a better characterisation of pSpA as an individual disease. Accordingly, randomised clinical trials should target patients with well-defined pSpA to identify effective therapies in this population.

Multilevel Modeling of Joint Damage in Rheumatoid Arthritis

While most deep learning approaches are developed for single images, in real world applications, images are often obtained as a series to inform decision making. Due to hardware (memory) and software (algorithm) limitations, few methods have been developed to integrate multiple images so far. In this study, we present an approach that seamlessly integrates deep learning and traditional machine learning models, to study multiple images and score joint damages in rheumatoid arthritis. This method allows the quantification of joining space narrowing to approach the clinical upper limit. Beyond predictive performance, we integrate the multilevel interconnections across joints and damage types into the machine learning model and reveal the cross-regulation map of joint damages in rheumatoid arthritis.

How Artificial Intelligence in Imaging Can Better Serve Patients with Bronchial and Parenchymal Lung Diseases?

With the rapid development of computing today, artificial intelligence has become an essential part of everyday life, with medicine and lung health being no exception. Big data-based scientific research does not mean simply gathering a large amount of data and letting the machines do the work by themselves. Instead, scientists need to identify problems whose solution will have a positive impact on patients’ care. In this review, we will discuss the role of artificial intelligence from both physiological and anatomical standpoints, starting with automatic quantitative assessment of anatomical structures using lung imaging and considering disease detection and prognosis estimation based on machine learning. The evaluation of current strengths and limitations will allow us to have a broader view for future developments.

Recent advances in the use of machine learning and artificial intelligence to improve diagnosis, predict flares, and enrich clinical trials in lupus

PURPOSE OF REVIEW

Machine learning is a computational tool that is increasingly used for the analysis of medical data and has provided the promise of more personalized care.

RECENT FINDINGS

The frequency with which machine learning analytics are reported in lupus research is comparable with that of rheumatoid arthritis and cancer, yet the clinical application of these computational tools has yet to be translated into better care. Considerable work has been applied to the development of machine learning models for lupus diagnosis, flare prediction, and classification of disease using histology or other medical images, yet few models have been tested in external datasets and independent centers. Application of machine learning has yet to be reported for lupus clinical trial enrichment and automated identification of eligible patients. Integration of machine learning into lupus clinical care and clinical trials would benefit from collaborative development between clinicians and data scientists.

SUMMARY

Although the application of machine learning to lupus data is at a nascent stage, initial results suggest a promising future.

Computer-Assisted Image Analysis in Assessment of Peripheral Joint MRI in Inflammatory Arthritis: A Systematic Review and Meta-analysis

OBJECTIVE

To summarize the feasibility of computer-assisted quantification of joint pathologies on magnetic resonance imaging (MRI) in patients with inflammatory arthritis by evaluating the published data on reliability, validity, and feasibility.

METHODS

A systematic literature search was performed for original articles published from January 1, 1985, to January 1, 2021. We selected studies in which patients with inflammatory arthritis were enrolled, and arthritis-related structural damage/synovitis in peripheral joints was assessed on non-contrast-enhanced, contrast-enhanced (CE), or dynamic CE (DCE)-MRI using (semi)automated methods. Data were pooled using random-effects model.

RESULTS

Twenty-eight studies consisting of 1342 MRIs were included (mean age, 54.8 years; 66.7% female; duration of arthritis, 3.6 years). Among clinical/laboratory factors, synovial membrane volume (SV) was moderately correlated with erthrocyte sedimentation rate (ESR) level (P < 0.01). Pooled analysis showed an overall excellent intra- and inter-reader reliability for computer-aided quantification of bone erosion volume (BEV; r = 0.97 [95% CI: 0.92-0.99], 0.93 [0.87-0.97]), SV (r = 0.98 [95% CI: 0.90-0.99], 0.86 [0.78-0.91]), and DCE-MRI perfusion parameters (r = 0.96-0.99). Meta-regression showed that computer-aided and manual methods provide comparable reliability (P > 0.05). Computer-aided measurement of BEV (r = 0.92), SV (r = 0.82), and DCE-MRI biomarkers (r = 0.72 N-total; r = 0.74 N-plateau; r = 0.64 N-washout) were significantly correlated with the Rheumatoid Arthritis Magnetic Resonance Imaging Score (RAMRIS; P < 0.01), allowing for earlier assessment of drug efficacy. On average, (semi)automated analysis of BEV/SV took 17 minutes (vs. 9 minutes for the RAMRIS) and DCE-MRI took 4 minutes (vs. 33 minutes for manual assessment).

CONCLUSION

Computer-aided image quantification technologies demonstrate excellent reliability and validity when used to quantify MRI pathologies of peripheral joints in patients with inflammatory arthritis. Computer-aided evaluation of inflammatory arthritis is an emerging field and should be considered as a viable complement to conventional observer-based scoring methods for clinical trials application.

The Use and Utility of Machine Learning in Achieving Precision Medicine in Systemic Sclerosis: A Narrative Review

BACKGROUND

Systemic sclerosis (SSc) is a rare connective tissue disease that can affect different organs and has extremely heterogenous presentations. This complexity makes it difficult to perform an early diagnosis and a subsequent subclassification of the disease. This hinders a personalized approach in clinical practice. In this context, machine learning (ML), a branch of artificial intelligence (AI), is able to recognize relationships in data and predict outcomes.

METHODS

Here, we performed a narrative review concerning the application of ML in SSc to define the state of art and evaluate its role in a precision medicine context.

RESULTS

Currently, ML has been used to stratify SSc patients and identify those at high risk of severe complications. Additionally, ML may be useful in the early detection of organ involvement. Furthermore, ML might have a role in target therapy approach and in predicting drug response.

CONCLUSION

Available evidence about the utility of ML in SSc is sparse but promising. Future improvements in this field could result in a big step toward precision medicine. Further research is needed to define ML application in clinical practice.

The value of MRI for detecting subclinical joint inflammation in clinically suspect arthralgia

In the last decade, much research has focused on the development of rheumatoid arthritis (RA) and the symptomatic phase preceding the onset of clinical arthritis. Observational studies on imaging have revealed that subclinical joint inflammation in patients with arthralgia at risk for RA precedes and predicts the onset of clinically apparent arthritis. Moreover, the results of two placebo-controlled randomised proof-of-concept trials in patients with arthralgia and MRI-detected subclinical inflammation studies will soon be available. The initial results are encouraging and suggest a beneficial effect of DMARD treatment on subclinical inflammation. Since this may increase the necessity to detect subclinical joint inflammation in persons with arthralgia that are at risk for RA, we will here review what has been learnt about subclinical inflammation in at-risk individuals by means of imaging. We will focus on MRI as this method has the best sensitivity and reproducibility. We evaluate the prognostic value of MRI-detected subclinical inflammation and assess the lessons learnt from MRIs about the tissues that are inflamed early on and are associated with the clinical phenotype in arthralgia at risk for RA, for example, subclinical tenosynovitis underlying pain and impaired hand function. Finally, because long scan times and the need for intravenous-contrast agent contribute to high costs and limited feasibility of current MRI protocols, we discuss progress that is being made in the field of MRI and that can result in a future-proof way of imaging that is useful for assessment of joint inflammation on a large scale, also in a society with social distancing due to COVID-19 restrictions.

Improved diagnosis of rheumatoid arthritis using an artificial neural network

Rheumatoid arthritis (RA) is chronic systemic disease that can cause joint damage, disability and destructive polyarthritis. Current diagnosis of RA is based on a combination of clinical and laboratory features. However, RA diagnosis can be difficult at its disease onset on account of overlapping symptoms with other arthritis, so early recognition and diagnosis of RA permit the better management of patients. In order to improve the medical diagnosis of RA and evaluate the effects of different clinical features on RA diagnosis, we applied an artificial neural network (ANN) as the training algorithm, and used fivefold cross-validation to evaluate its performance. From each sample, we obtained data on 6 features: age, sex, rheumatoid factor, anti-citrullinated peptide antibody (CCP), 14-3-3η, and anti-carbamylated protein (CarP) antibodies. After training, this ANN model assigned each sample a probability for being either an RA patient or a non-RA patient. On the validation dataset, the F1 for all samples by this ANN model was 0.916, which was higher than the 0.906 we previously reported using an optimal threshold algorithm. Therefore, this ANN algorithm not only improved the accuracy of RA diagnosis, but also revealed that anti-CCP had the greatest effect while age and anti-CarP had a weaker on RA diagnosis.

Responding to and Driving Change in Rheumatology: Report from the 12th International Immunology Summit 2021

The coronavirus disease 2019 (COVID-19) pandemic has accelerated changes to rheumatology daily clinical practice. The main goal of the 12th International Immunology Summit, held 25-26 June, 2021 (virtual meeting), was to provide direction for these active changes rather than undergoing change reactively in order to improve patient outcomes. This review describes and explores the concept of change in rheumatology clinical practice based on presentations from the Immunology Summit. Many of the changes to rheumatology practice brought about by the COVID-19 pandemic may be considered as having a positive impact on disease management and may help with the long-term development of more patient-focused treatment. Rheumatologists can contribute key knowledge regarding the use of immunosuppressive agents in the context of the pandemic, and according to the European League Against Rheumatism, they should be involved in any multidisciplinary COVID-19 guideline committees. New technologies, including telemedicine and artificial intelligence, represent an opportunity for physicians to individualise patient treatment and improve disease management. Despite major advances in the treatment of rheumatic diseases, the efficacy of available disease-modifying anti-rheumatic drugs (DMARDs) remains suboptimal and data regarding serological biomarkers are limited. Synovial tissue biomarkers, such as CD68+ macrophages, have shown promise in elucidating pathogenesis and targeting treatment to the individual patient. In spondyloarthritis (SpA) or psoriatic arthritis (PsA), information regarding the effectiveness of the available agents with different mechanisms of action may be integrated to manage patients using a treat-to-target approach. Early diagnosis of SpA and PsA is important for optimisation of treatment response and long-term outcomes. Improving our understanding of disease pathogenesis and practice methods may help reduce diagnostic delays, thereby optimising disease outcomes in patients with rheumatic diseases.

Development of a convolutional neural network for the identification and the measurement of the median nerve on ultrasound images acquired at carpal tunnel level

Background

Deep learning applied to ultrasound (US) can provide a feedback to the sonographer about the correct identification of scanned tissues and allows for faster and standardized measurements. The most frequently adopted parameter for US diagnosis of carpal tunnel syndrome is the increasing of the cross-sectional area (CSA) of the median nerve. Our aim was to develop a deep learning algorithm, relying on convolutional neural networks (CNNs), for the localization and segmentation of the median nerve and the automatic measurement of its CSA on US images acquired at the proximal inlet of the carpal tunnel.

Methods

Consecutive patients with rheumatic and musculoskeletal disorders were recruited. Transverse US images were acquired at the carpal tunnel inlet, and the CSA was manually measured. Anatomical variants were registered. The dataset consisted of 246 images (157 for training, 40 for validation, and 49 for testing) from 103 patients each associated with manual annotations of the nerve boundary. A Mask R-CNN, state-of-the-art CNN for image semantic segmentation, was trained on this dataset to accurately localize and segment the median nerve section. To evaluate the performances on the testing set, precision (Prec), recall (Rec), mean average precision (mAP), and Dice similarity coefficient (DSC) were computed. A sub-analysis excluding anatomical variants was performed. The CSA was automatically measured by the algorithm.

Results

The algorithm correctly identified the median nerve in 41/49 images (83.7%) and in 41/43 images (95.3%) excluding anatomical variants. The following metrics were obtained (with and without anatomical variants, respectively): Prec 0.86 ± 0.33 and 0.96 ± 0.18, Rec 0.88 ± 0.33 and 0.98 ± 0.15, mAP 0.88 ± 0.33 and 0.98 ± 0.15, and DSC 0.86 ± 0.19 and 0.88 ± 0.19. The agreement between the algorithm and the sonographer CSA measurements was excellent [ICC 0.97 (0.94–0.98)].

Conclusions

The developed algorithm has shown excellent performances, especially if excluding anatomical variants. Future research should aim at expanding the US image dataset including a wider spectrum of normal anatomy and pathology. This deep learning approach has shown very high potentiality for a fully automatic support for US assessment of carpal tunnel syndrome.

A deep-learning framework for metacarpal-head cartilage-thickness estimation in ultrasound rheumatological images

OBJECTIVE

Rheumatoid arthritis (RA) is a chronic disease characterized by erosive symmetrical polyarthritis. Bone and cartilage are the main joint targets of this disease. Cartilage damage is one of the most relevant determinants of physical disability in RA patients. Cartilage damage is nowadays assessed by clinicians, which manually measure cartilage thickness in ultrasound (US) imaging. This poses issues relevant to intra-and inter-observer variability. Relying on the acquisition of metacarpal-head US images from 38 subjects, this work addresses the problem of automatic cartilage-thickness measurement by designing a new deep-learning (DL) framework.

METHODS

The framework consists of a Convolutional Neural Network (CNN), responsible for regressing cartilage-interface distance fields, followed by a post-processing step to delineate the two cartilage interfaces from the predicted distance fields and compute the cartilage thickness.

RESULTS

Our framework achieved encouraging results with a mean absolute difference (ADF) of 0.032 (±0.026) mm against manual thickness annotation by an expert clinician. When evaluating the intra-observer variability, we obtained an ADF = 0.036 (±0.028) mm.

CONCLUSION

The proposed framework achieved an ADF against manual annotation that was comparable to the intra-observer variability, proving the potential of DL in the field.

SIGNIFICANCE

This work is the first to address the problem of automatic cartilage-thickness estimation in US rheumatological images with DL, paving the way for future research in the field. From a clinical perspective, the proposed framework proved to be a valuable tool to support the clinical routine increasing the reproducibility of cartilage thickness measurements.

Machine learning approaches to improve disease management of patients with rheumatoid arthritis: review and future directions

INTRODUCTION

Although the management of rheumatoid arthritis (RA) has improved in major way over the last decades, this disease still leads to an important burden for patients and society, and there is a need to develop more personalized approaches. Machine learning (ML) methods are more and more used in health-related studies and can be applied to different sorts of data (clinical, radiological, or 'omics' data). Such approaches may improve the management of patients with RA.

AREAS COVERED

In this paper, we propose a review regarding ML approaches applied to RA. A scoping literature search was performed in PubMed, in September 2021 using the following MeSH terms: 'arthritis, rheumatoid' and 'machine learning'. Based on this search, the usefulness of ML methods for RA diagnosis, monitoring, and prediction of response to treatment and RA outcomes, is discussed.

EXPERT OPINION

ML methods have the potential to revolutionize RA-related research and improve disease management and patient care. Nevertheless, these models are not yet ready to contribute fully to rheumatologists' daily practice. Indeed, these methods raise technical, methodological, and ethical issues, which should be addressed properly to allow their implementation. Collaboration between data scientists, clinical researchers, and physicians is therefore required to move this field forward.

Juvenile Idiopathic Arthritis: A Review of Novel Diagnostic and Monitoring Technologies

Juvenile idiopathic arthritis (JIA) is the most common rheumatic disease of childhood and is characterized by an often insidious onset and a chronic relapsing-remitting course, once diagnosed. With successive flares of joint inflammation, joint damage accrues, often associated with pain and functional disability. The progressive nature and potential for chronic damage and disability caused by JIA emphasizes the critical need for a prompt and accurate diagnosis. This article provides a review of recent studies related to diagnosis, monitoring and management of JIA and outlines recent novel tools and techniques (infrared thermal imaging, three-dimensional imaging, accelerometry, artificial neural networks and fuzzy logic) which have demonstrated potential value in assessment and monitoring of JIA. The emergence of novel techniques to assist clinicians' assessments for diagnosis and monitoring of JIA has demonstrated promise; however, further research is required to confirm their clinical utility.

An introduction to machine learning and analysis of its use in rheumatic diseases

Machine learning (ML) is a computerized analytical technique that is being increasingly employed in biomedicine. ML often provides an advantage over explicitly programmed strategies in the analysis of multidimensional information by recognizing relationships in the data that were not previously appreciated. As such, the use of ML in rheumatology is increasing, and numerous studies have employed ML to classify patients with rheumatic autoimmune inflammatory diseases (RAIDs) from medical records and imaging, biometric or gene expression data. However, these studies are limited by sample size, the accuracy of sample labelling, and absence of datasets for external validation. In addition, there is potential for ML models to overfit or underfit the data and, thereby, these models might produce results that cannot be replicated in an unrelated dataset. In this Review, we introduce the basic principles of ML and discuss its current strengths and weaknesses in the classification of patients with RAIDs. Moreover, we highlight the successful analysis of the same type of input data (for example, medical records) with different algorithms, illustrating the potential plasticity of this analytical approach. Altogether, a better understanding of ML and the future application of advanced analytical techniques based on this approach, coupled with the increasing availability of biomedical data, may facilitate the development of meaningful precision medicine for patients with RAIDs.

Wearable activity trackers and artificial intelligence in the management of rheumatic diseases : Where are we in 2021?

Wearable activity trackers are playing an increasingly important role in healthcare. In the field of rheumatic and musculoskeletal diseases (RMDs), various applications are currently possible. This review will present the use of activity trackers to promote physical activity levels in rheumatology, as well as the use of trackers to measure health parameters and detect flares using artificial intelligence. Challenges and limitations of the use of artificial intelligence will be discussed, as well as technical issues when using activity trackers in clinical practice.

Machine Learning in Rheumatic Diseases

With advances in information technology, the demand for using data science to enhance healthcare and disease management is rapidly increasing. Among these technologies, machine learning (ML) has become ubiquitous and indispensable for solving complex problems in many scientific fields, including medical science. ML allows the development of guidelines and framing of the evaluation system for complex diseases based on massive data. In the analysis of rheumatic diseases, which are chronic and remarkably heterogeneous, ML can be anticipated to be extremely helpful in deciphering and revealing the inherent interrelationships in disease development and progression, which can further enhance the overall understanding of the disease, optimize patients' stratification, calibrate therapeutic strategies, and predict prognosis and outcomes. In this review, the basics of ML, its potential clinical applications in rheumatology, together with its strengths and limitations are summarized.

Right Ventricular Function Predicts Adverse Clinical Outcomes in Patients With Chronic Thromboembolic Pulmonary Hypertension: A Three-Dimensional Echocardiographic Study

Background: Right ventricular (RV) function plays a vital role in the prognosis of patients with chronic thromboembolic pulmonary hypertension (CTEPH). We used new machine learning (ML)-based fully automated software to quantify RV function using three-dimensional echocardiography (3DE) to predict adverse clinical outcomes in CTEPH patients.

Methods: A total of 151 consecutive CTEPH patients were registered in this prospective study between April 2015 and July 2019. New ML-based methods were used for data management, and quantitative analysis of RV volume and ejection fraction (RVEF) was performed offline. RV structural and functional parameters were recorded using 3DE. CTEPH was diagnosed using right heart catheterization, and 62 patients underwent cardiac magnetic resonance to assess right heart function. Adverse clinical outcomes were defined as PH-related hospitalization with hemoptysis or increased RV failure, including conditions requiring balloon pulmonary angioplasty or pulmonary endarterectomy, as well as death.

Results: The median follow-up time was 19.7 months (interquartile range, 0.5–54 months). Among the 151 CTEPH patients, 72 experienced adverse clinical outcomes. Multivariate Cox proportional-hazard analysis showed that ML-based 3DE analysis of RVEF was a predictor of adverse clinical outcomes (hazard ratio, 1.576; 95% confidence interval (CI), 1.046~2.372; P = 0.030).

Conclusions: The new ML-based 3DE algorithm is a promising technique for rapid 3D quantification of RV function in CTEPH patients.

Right Ventricular Function and Its Coupling With Pulmonary Circulation in Precapillary Pulmonary Hypertension: A Three-Dimensional Echocardiographic Study

Objective: To assess right ventricular (RV) function and RV-pulmonary arterial (PA) coupling by three-dimensions echocardiography and investigate the ability of RV-PA coupling to predict adverse clinical outcomes in patients with precapillary pulmonary hypertension (PH). Methods: We retrospectively collected a longitudinal cohort of 203 consecutive precapillary PH patients. RV volume, RV ejection fraction (RVEF), and RV longitudinal strain (RVLS) were quantitatively determined offline by 3D echocardiography. RV-PA coupling parameters including the RVEF/PA systolic pressure (PASP) ratio, pulmonary arterial compliance (PAC), and total pulmonary resistance (TPR) were recorded. Results: Over a median follow-up period of 20.9 months (interquartile range, 0.1-67.4 months), 87 (42.9%) of 203 patients experienced adverse clinical outcomes. With increasing World Health Organization functional class (WHO-FC), significant trends were observed in increasing RV volume, decreasing RVEF, and worsening RVLS. RV arterial coupling (RVAC) and PAC were lower and TPR was higher for WHO-FC III+IV than WHO-FC I or II. The RVEF/PASP ratio showed a significant correlation with RVLS. RVAC had a stronger correlation with the RVEF/PASP ratio than other indices. Multivariate Cox proportional-hazard analysis identified a lower 3D RVEF and worse RVLS as strong predictors of adverse clinical events. RVAC, TPR, and PAC had varying degrees of predictive value, with optimal cutoff values of 0.74, 11.64, and 1.18, respectively. Conclusions: Precapillary-PH with RV-PA uncoupling as expressed by a RVEF/PASP ratio <0.44 was associated with adverse clinical outcomes. PAC decreased and TPR increased with increasing WHO-FC, with TPR showing better independent predictive value.

An Efficient CNN for Hand X-Ray Classification of Rheumatoid Arthritis

Hand Radiography (RA) is one of the prime tests for checking the progress of rheumatoid joint inflammation in human bone joints. Recognizing the specific phase of RA is a difficult assignment, as human abilities regularly curb the techniques for it. Convolutional neural network (CNN) is the center for hand recognition for recognizing complex examples. The human cerebrum capacities work in a high-level way, so CNN has been planned depending on organic neural-related organizations in humans for imitating its unpredictable capacities. This article accordingly presents the convolutional neural network (CNN) which has the ability to naturally gain proficiency with the qualities and anticipate the class of hand radiographs from an expansive informational collection. The reproduction of the CNN halfway layers, which depict the elements of the organization, is likewise appeared. For arrangement of the model, a dataset of 290 radiography images is utilized. The result indicates that hand X-rays are rated with an accuracy of 94.46% by the proposed methodology. Our experiments show that the network sensitivity is observed to be 0.95 and the specificity is observed to be 0.82.

Artificial Intelligence for Ultrasound Informative Image Selection of Metacarpal Head Cartilage. A Pilot Study

Objectives: This study aims to develop an automatic deep-learning algorithm, which is based on Convolutional Neural Networks (CNNs), for ultrasound informative-image selection of hyaline cartilage at metacarpal head level. The algorithm performance and that of three beginner sonographers were compared with an expert assessment, which was considered the gold standard.

Methods: The study was divided into two steps. In the first one, an automatic deep-learning algorithm for image selection was developed using 1,600 ultrasound (US) images of the metacarpal head cartilage (MHC) acquired in 40 healthy subjects using a very high-frequency probe (up to 22 MHz). The algorithm task was to identify US images defined informative as they show enough information to fulfill the Outcome Measure in Rheumatology US definition of healthy hyaline cartilage. The algorithm relied on VGG16 CNN, which was fine-tuned to classify US images in informative and non-informative ones. A repeated leave-four-subject out cross-validation was performed using the expert sonographer assessment as gold-standard. In the second step, the expert assessed the algorithm and the beginner sonographers' ability to obtain US informative images of the MHC.

Results: The VGG16 CNN showed excellent performance in the first step, with a mean area (AUC) under the receiver operating characteristic curve, computed among the 10 models obtained from cross-validation, of 0.99 ± 0.01. The model that reached the best AUC on the testing set, which we named “MHC identifier 1,” was then evaluated by the expert sonographer. The agreement between the algorithm, and the expert sonographer was almost perfect [Cohen's kappa: 0.84 (95% confidence interval: 0.71–0.98)], whereas the agreement between the expert and the beginner sonographers using conventional assessment was moderate [Cohen's kappa: 0.63 (95% confidence interval: 0.49–0.76)]. The conventional obtainment of US images by beginner sonographers required 6.0 ± 1.0 min, whereas US videoclip acquisition by a beginner sonographer lasted only 2.0 ± 0.8 min.

Conclusion: This study paves the way for the automatic identification of informative US images for assessing MHC. This may redefine the US reliability in the evaluation of MHC integrity, especially in terms of intrareader reliability and may support beginner sonographers during US training.

Artificial Intelligence and the Medical Physicist: Welcome to the Machine

Artificial intelligence (AI) is a branch of computer science dedicated to giving machines or computers the ability to perform human-like cognitive functions, such as learning, problem-solving, and decision making. Since it is showing superior performance than well-trained human beings in many areas, such as image classification, object detection, speech recognition, and decision-making, AI is expected to change profoundly every area of science, including healthcare and the clinical application of physics to healthcare, referred to as medical physics. As a result, the Italian Association of Medical Physics (AIFM) has created the “AI for Medical Physics” (AI4MP) group with the aims of coordinating the efforts, facilitating the communication, and sharing of the knowledge on AI of the medical physicists (MPs) in Italy. The purpose of this review is to summarize the main applications of AI in medical physics, describe the skills of the MPs in research and clinical applications of AI, and define the major challenges of AI in healthcare.

Deep Learning Classification of Systemic Sclerosis Skin Using the MobileNetV2 Model

Goal: Systemic sclerosis (SSc) is a rare autoimmune, systemic disease with prominent fibrosis of skin and internal organs. Early diagnosis of the disease is crucial for designing effective therapy and management plans. Machine learning algorithms, especially deep learning, have been found to be greatly useful in biology, medicine, healthcare, and biomedical applications, in the areas of medical image processing and speech recognition. However, the need for a large training data set and the requirement for a graphics processing unit (GPU) have hindered the wide application of machine learning algorithms as a diagnostic tool in resource-constrained environments (e.g., clinics). Methods: In this paper, we propose a novel mobile deep learning network for the characterization of SSc skin. The proposed network architecture consists of the UNet, a dense connectivity convolutional neural network (CNN) with added classifier layers that when combined with limited training data, yields better image segmentation and more accurate classification, and a mobile training module. In addition, to improve the computational efficiency and diagnostic accuracy, the highly efficient training model called “MobileNetV2,” which is designed for mobile and embedded applications, was used to train the network. Results: The proposed network was implemented using a standard laptop (2.5 GHz Intel Core i7). After fine tuning, our results showed the proposed network reached 100% accuracy on the training image set, 96.8% accuracy on the validation image set, and 95.2% on the testing image set. The training time was less than 5 hours. We also analyzed the same normal vs SSc skin image sets using the CNN using the same laptop. The CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. Additionally, it took more than 14 hours to train the CNN architecture. We also utilized the MobileNetV2 model to analyze an additional dataset of images and classified them as normal, early (mid and moderate) SSc or late (severe) SSc skin images. The network reached 100% accuracy on the training image set, 97.2% on the validation set, and 94.8% on the testing image set. Using the same normal, early and late phase SSc skin images, the CNN reached 100% accuracy on the training image set, 87.7% accuracy on the validation image set, and 82.9% on the testing image set. These results indicated that the MobileNetV2 architecture is more accurate and efficient compared to the CNN to classify normal, early and late phase SSc skin images. Conclusions: Our preliminary study, intended to show the efficacy of the proposed network architecture, holds promise in the characterization of SSc. We believe that the proposed network architecture could easily be implemented in a clinical setting, providing a simple, inexpensive, and accurate screening tool for SSc.

Novel Muscle Imaging in Inflammatory Rheumatic Diseases-A Focus on Ultrasound Shear Wave Elastography and Quantitative MRI

In recent years, imaging has played an increasing role in the clinical management of patients with rheumatic diseases with respect to aiding diagnosis, guiding therapy and monitoring disease progression. These roles have been underpinned by research which has enhanced our understanding of disease pathogenesis and pathophysiology of rheumatology conditions, in addition to their key role in outcome measurement in clinical trials. However, compared to joints, imaging research of muscles is less established, despite the fact that muscle symptoms are very common and debilitating in many rheumatic diseases. Recently, it has been shown that even though patients with rheumatoid arthritis may achieve clinical remission, defined by asymptomatic joints, many remain affected by lingering constitutional systemic symptoms like fatigue, tiredness, weakness and myalgia, which may be attributed to changes in the muscles. Recent improvements in imaging technology, coupled with an increasing clinical interest, has started to ignite new interest in the area. This perspective discusses the rationale for using imaging, particularly ultrasound and MRI, for investigating muscle pathology involved in common inflammatory rheumatic diseases. The muscles associated with rheumatic diseases can be affected in many ways, including myositis-an inflammatory muscle condition, and myopathy secondary to medications, such as glucocorticoids. In addition to non-invasive visual assessment of muscles in these conditions, novel imaging techniques like shear wave elastography and quantitative MRI can provide further useful information regarding the physiological and biomechanical status of the muscle.