Automated diagnosis of myositis from muscle ultrasound: Exploring the use of machine learning and deep learning methods

Imaging Modalities in Myositis: A Clinical Review

This review highlights the key role of imaging modalities in diagnosing and managing myositis. The authors underscore MRI's superiority in identifying muscle edema and fat infiltration, marking it as essential for evaluating disease activity and damage. They also suggest ultrasound's emerging significance for diagnosis and monitoring of the disease, valued for its ease of use, and real-time capabilities. Furthermore, PET scans' unique physiologic capabilities, especially useful for malignancy detection and assessing lung disease, are emphasized. Collectively, these imaging techniques offer a tailored approach to myositis management, facilitate precise diagnosis, effective treatment planning, and disease activity monitoring, thereby enhancing patient outcomes in rheumatology practice.

[A lightweight convolutional neural network for myositis classification from muscle ultrasound images]

Existing classification methods for myositis ultrasound images have problems of poor classification performance or high computational cost. Motivated by this difficulty, a lightweight neural network based on a soft threshold attention mechanism is proposed to cater for a better IIMs classification. The proposed network was constructed by alternately using depthwise separable convolution (DSC) and conventional convolution (CConv). Moreover, a soft threshold attention mechanism was leveraged to enhance the extraction capabilities of key features. Compared with the current dual-branch feature fusion myositis classification network with the highest classification accuracy, the classification accuracy of the network proposed in this paper increased by 5.9%, reaching 96.1%, and its computational complexity was only 0.25% of the existing method. The obtained results support that the proposed method can provide physicians with more accurate classification results at a lower computational cost, thereby greatly assisting them in their clinical diagnosis.

The state of artificial intelligence for systemic dermatoses: Background and applications for psoriasis, systemic sclerosis, and much more

Artificial intelligence (AI) has been steadily integrated into dermatology, with AI platforms already attempting to identify skin cancers and diagnose benign versus malignant lesions. Although not as widely known, AI programs have also been utilized as diagnostic and prognostic tools for dermatologic conditions with systemic or extracutaneous involvement, especially for diseases with autoimmune etiologies. We have provided a primer on commonly used AI platforms and the practical applicability of these algorithms in dealing with psoriasis, systemic sclerosis, and dermatomyositis as a microcosm for future directions in the field. With a rapidly changing landscape in dermatology and medicine as a whole, AI could be a versatile tool to support clinicians and enhance access to care.

Ultrasound Imaging in Knee Osteoarthritis: Current Role, Recent Advancements, and Future Perspectives

While conventional radiography and MRI have a well-established role in the assessment of patients with knee osteoarthritis, ultrasound is considered a complementary and additional tool. Moreover, the actual usefulness of ultrasound is still a matter of debate in knee osteoarthritis assessment. Despite that, ultrasound offers several advantages and interesting aspects for both current clinical practice and future perspectives. Ultrasound is potentially a helpful tool in the detection of anomalies such as cartilage degradation, osteophytes, and synovitis in cases of knee osteoarthritis. Furthermore, local diagnostic and minimally invasive therapeutic operations pertaining to knee osteoarthritis can be safely guided by real-time ultrasound imaging. We are constantly observing a growing knowledge and awareness among radiologists and other physicians, concerning ultrasound imaging. Ultrasound studies can be extremely useful to track the response to various therapies. For this specific aim, tele-ultrasonography may constitute an easy tool aiding precise and repeated follow-up controls. Moreover, raw radio-frequency data from US backscattering signals contain more information than B-mode imaging. This paves the way for quantitative in-depth analyses of cartilage, bone, and other articular structures. Overall, ultrasound technologies and their rapid evolution have the potential to make a difference at both the research and clinical levels. This narrative review article describes the potential of such technologies and their possible future implications.

Real-time artificial intelligence-based texture analysis of muscle ultrasound data for neuromuscular disorder assessment

Objective

Many artificial intelligence approaches to muscle ultrasound image analysis have not been implemented on usable devices in clinical neuromuscular medicine practice, owing to high computational demands and lack of standardised testing protocols. This study evaluated the feasibility of using real-time texture analysis to differentiate between various pathological conditions.

Methods

We analysed 17,021 cross-sectional ultrasound images of the biceps brachii of 75 participants, including 25 each with neurogenic disorders, myogenic disorders, and healthy controls. The size and location of the regions of interest were randomly selected to minimise bias. A random forest classifier utilising texture features such as Dissimilarity and Homogeneity was developed and deployed on a mobile PC, enabling real-time analysis.

Results

The classifier distinguished patients with an accuracy of 81 %. Echogenicity and Contrast from the Co-Occurrence Matrix were significant predictive features. Validation on 15 patients achieved accuracies of 78 %/93 % per image/patient over 15-second videos, respectively. The use of a mobile PC facilitated real-time estimation of the underlying pathology during ultrasound examination, without influencing procedures.

Conclusions

Real-time automatic texture analysis is feasible as an adjunct for the diagnosis of neuromuscular disorders.

Significance

Artificial intelligence using texture analysis with a light computational load supports the semi-quantitative evaluation of neuromuscular ultrasound.

Myositis and Its Mimics: Guideline Updates, MRI Characteristics, and New Horizons

Myositis is defined as inflammation within skeletal muscle and is a subcategory of myopathy, which is more broadly defined as any disorder affecting skeletal muscle. Myositis may be encountered as a component of autoimmune and connective tissue diseases, where it is described as idiopathic inflammatory myopathy (IIM). Myositis can also be caused by infections as well as toxins and drugs, including newer classes of medications. MRI plays an important role in the diagnosis and evaluation of patients with suspected myositis, but many entities may have imaging features similar to those of myositis and can be considered myositis mimics. These include muscular dystrophies, denervation, deep venous thrombosis, diabetic myonecrosis, muscle injury, heterotopic ossification, and even neoplasms. In patients with suspected myositis, definitive diagnosis may require integrated analysis of imaging findings with clinical, laboratory, and pathology data. The objectives of this article are to review the fundamental features of myositis, including recent updates in terminology and consensus guidelines for IIMs; the most important MRI differential diagnostic considerations for myositis (i.e., myositis mimics); and new horizons, including the potential importance of artificial intelligence and multimodal integrated diagnostics in the evaluation of patients with muscle disorders.

MGB-Unet: An Improved Multiscale Unet with Bottleneck Transformer for Myositis Segmentation from Ultrasound Images

Myositis is the inflammation of the muscles that can arise from various sources with diverse symptoms and require different treatments. For treatment to achieve optimal results, it is essential to obtain an accurate diagnosis promptly. This paper presents a new supervised segmentation architecture that can efficiently perform precise segmentation and classification of myositis from ultrasound images with few computational resources. The architecture of our model includes a unique encoder-decoder structure that integrates the Bottleneck Transformer (BOT) with a newly developed Residual block named Multi-Conv Ghost switchable bottleneck Residual Block (MCG_RB). This block effectively captures and analyzes ultrasound image input inside the encoder segment at several resolutions. Moreover, the BOT module is a transformer-style attention module designed to bridge the feature gap between the encoding and decoding stages. Furthermore, multi-level features are retrieved using the MCG-RB module, which combines multi-convolution with ghost switchable residual connections of convolutions for both the encoding and decoding stages. The suggested method attains state-of-the-art performance on a benchmark set of myositis ultrasound images across all parameters, including accuracy, precision, recall, dice coefficient, and Jaccard index. Despite its limited training data, the suggested approach demonstrates remarkable generalizability by yielding exceptional results. The proposed model showed a substantial enhancement in accuracy when compared to segmentation state-of-the-art methods such as Unet++, DeepLabV3, and the Duck-Net. The dice coefficient and Jaccard index obtained improvements of up to 3%, 6%, and 7%, respectively, surpassing the other methods.

Deep learning in rheumatological image interpretation

Artificial intelligence techniques, specifically deep learning, have already affected daily life in a wide range of areas. Likewise, initial applications have been explored in rheumatology. Deep learning might not easily surpass the accuracy of classic techniques when performing classification or regression on low-dimensional numerical data. With images as input, however, deep learning has become so successful that it has already outperformed the majority of conventional image-processing techniques developed during the past 50 years. As with any new imaging technology, rheumatologists and radiologists need to consider adapting their arsenal of diagnostic, prognostic and monitoring tools, and even their clinical role and collaborations. This adaptation requires a basic understanding of the technical background of deep learning, to efficiently utilize its benefits but also to recognize its drawbacks and pitfalls, as blindly relying on deep learning might be at odds with its capabilities. To facilitate such an understanding, it is necessary to provide an overview of deep-learning techniques for automatic image analysis in detecting, quantifying, predicting and monitoring rheumatic diseases, and of currently published deep-learning applications in radiological imaging for rheumatology, with critical assessment of possible limitations, errors and confounders, and conceivable consequences for rheumatologists and radiologists in clinical practice.

Clinical Applications, Challenges, and Recommendations for Artificial Intelligence in Musculoskeletal and Soft-Tissue Ultrasound: AJR Expert Panel Narrative Review

Artificial intelligence (AI) is increasingly used in clinical practice for musculoskeletal imaging tasks, such as disease diagnosis and image reconstruction. AI applications in musculoskeletal imaging have focused primarily on radiography, CT, and MRI. Although musculoskeletal ultrasound stands to benefit from AI in similar ways, such applications have been relatively underdeveloped. In comparison with other modalities, ultrasound has unique advantages and disadvantages that must be considered in AI algorithm development and clinical translation. Challenges in developing AI for musculoskeletal ultrasound involve both clinical aspects of image acquisition and practical limitations in image processing and annotation. Solutions from other radiology subspecialties (e.g., crowdsourced annotations coordinated by professional societies), along with use cases (most commonly rotator cuff tendon tears and palpable soft-tissue masses), can be applied to musculoskeletal ultrasound to help develop AI. To facilitate creation of high-quality imaging datasets for AI model development, technologists and radiologists should focus on increasing uniformity in musculoskeletal ultrasound performance and increasing annotations of images for specific anatomic regions. This Expert Panel Narrative Review summarizes available evidence regarding AI's potential utility in musculoskeletal ultrasound and challenges facing its development. Recommendations for future AI advancement and clinical translation in musculoskeletal ultrasound are discussed.

The role of artificial intelligence in electrodiagnostic and neuromuscular medicine: Current state and future directions

The rapid advancements in artificial intelligence (AI), including machine learning (ML), and deep learning (DL) have ushered in a new era of technological breakthroughs in healthcare. These technologies are revolutionizing the way we utilize medical data, enabling improved disease classification, more precise diagnoses, better treatment selection, therapeutic monitoring, and highly accurate prognostication. Different ML and DL models have been used to distinguish between electromyography signals in normal individuals and those with amyotrophic lateral sclerosis and myopathy, with accuracy ranging from 67% to 99.5%. DL models have also been successfully applied in neuromuscular ultrasound, with the use of segmentation techniques achieving diagnostic accuracy of at least 90% for nerve entrapment disorders, and 87% for inflammatory myopathies. Other successful AI applications include prediction of treatment response, and prognostication including prediction of intensive care unit admissions for patients with myasthenia gravis. Despite these remarkable strides, significant knowledge, attitude, and practice gaps persist, including within the field of electrodiagnostic and neuromuscular medicine. In this narrative review, we highlight the fundamental principles of AI and draw parallels with the intricacies of human brain networks. Specifically, we explore the immense potential that AI holds for applications in electrodiagnostic studies, neuromuscular ultrasound, and other aspects of neuromuscular medicine. While there are exciting possibilities for the future, it is essential to acknowledge and understand the limitations of AI and take proactive steps to mitigate these challenges. This collective endeavor holds immense potential for the advancement of healthcare through the strategic and responsible integration of AI technologies.

Development of Continuous Assessment of Muscle Quality and Frailty in Older Patients Using Multiparametric Combinations of Ultrasound and Blood Biomarkers: Protocol for the ECOFRAIL Study

BACKGROUND

Frailty resulting from the loss of muscle quality can potentially be delayed through early detection and physical exercise interventions. There is a demand for cost-effective tools for the objective evaluation of muscle quality, in both cross-sectional and longitudinal assessments. Literature suggests that quantitative analysis of ultrasound data captures morphometric, compositional, and microstructural muscle properties, while biological assays derived from blood samples are associated with functional information.

OBJECTIVE

This study aims to assess multiparametric combinations of ultrasound and blood-based biomarkers to offer a cross-sectional evaluation of the patient frailty phenotype and to track changes in muscle quality associated with supervised exercise programs.

METHODS

This prospective observational multicenter study will include patients aged 70 years and older who are capable of providing informed consent. We aim to recruit 100 patients from hospital environments and 100 from primary care facilities. Each patient will undergo at least two examinations (baseline and follow-up), totaling a minimum of 400 examinations. In hospital environments, 50 patients will be measured before/after a 16-week individualized and supervised exercise program, while another 50 patients will be followed up after the same period without intervention. Primary care patients will undergo a 1-year follow-up evaluation. The primary objective is to compare cross-sectional evaluations of physical performance, functional capacity, body composition, and derived scales of sarcopenia and frailty with biomarker combinations obtained from muscle ultrasound and blood-based assays. We will analyze ultrasound raw data obtained with a point-of-care device, along with a set of biomarkers previously associated with frailty, using quantitative real-time polymerase chain reaction and enzyme-linked immunosorbent assay. Additionally, we will examine the sensitivity of these biomarkers to detect short-term muscle quality changes and functional improvement after a supervised exercise intervention compared with usual care.

RESULTS

At the time of manuscript submission, the enrollment of volunteers is ongoing. Recruitment started on March 1, 2022, and ends on June 30, 2024.

CONCLUSIONS

The outlined study protocol will integrate portable technologies, using quantitative muscle ultrasound and blood biomarkers, to facilitate an objective cross-sectional assessment of muscle quality in both hospital and primary care settings. The primary objective is to generate data that can be used to explore associations between biomarker combinations and the cross-sectional clinical assessment of frailty and sarcopenia. Additionally, the study aims to investigate musculoskeletal changes following multicomponent physical exercise programs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05294757; https://clinicaltrials.gov/ct2/show/NCT05294757.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/50325.

Novel multiclass classification machine learning approach for the early-stage classification of systemic autoimmune rheumatic diseases

OBJECTIVE

Systemic autoimmune rheumatic diseases (SARDs) encompass a diverse group of complex conditions with overlapping clinical features, making accurate diagnosis challenging. This study aims to develop a multiclass machine learning (ML) model for early-stage SARDs classification using accessible laboratory indicators.

METHODS

A total of 925 SARDs patients were included, categorised into SLE, Sjögren's syndrome (SS) and inflammatory myositis (IM). Clinical characteristics and laboratory markers were collected and nine key indicators, including anti-dsDNA, anti-SS-A60, anti-Sm/nRNP, antichromatin, anti-dsDNA (indirect immunofluorescence assay), haemoglobin (Hb), platelet, neutrophil percentage and cytoplasmic patterns (AC-19, AC-20), were selected for model building. Various ML algorithms were used to construct a tripartite classification ML model.

RESULTS

Patients were divided into two cohorts, cohort 1 was used to construct a tripartite classification model. Among models assessed, the random forest (RF) model demonstrated superior performance in distinguishing SLE, IM and SS (with area under curve=0.953, 0.903 and 0.836; accuracy= 0.892, 0.869 and 0.857; sensitivity= 0.890, 0.868 and 0.795; specificity= 0.910, 0.836 and 0.748; positive predictive value=0.922, 0.727 and 0.663; and negative predictive value= 0.854, 0.915 and 0.879). The RF model excelled in classifying SLE (precision=0.930, recall=0.985, F1 score=0.957). For IM and SS, RF model outcomes were (precision=0.793, 0.950; recall=0.920, 0.679; F1 score=0.852, 0.792). Cohort 2 served as an external validation set, achieving an overall accuracy of 87.3%. Individual classification performances for SLE, SS and IM were excellent, with precision, recall and F1 scores specified. SHAP analysis highlighted significant contributions from antibody profiles.

CONCLUSION

This pioneering multiclass ML model, using basic laboratory indicators, enhances clinical feasibility and demonstrates promising potential for SARDs classification. The collaboration of clinical expertise and ML offers a nuanced approach to SARDs classification, with potential for enhanced patient care.

A Review of Recent Advances in Computer-Aided Detection Methods Using Hyperspectral Imaging Engineering to Detect Skin Cancer

Skin cancer, a malignant neoplasm originating from skin cell types including keratinocytes, melanocytes, and sweat glands, comprises three primary forms: basal cell carcinoma (BCC), squamous cell carcinoma (SCC), and malignant melanoma (MM). BCC and SCC, while constituting the most prevalent categories of skin cancer, are generally considered less aggressive compared to MM. Notably, MM possesses a greater capacity for invasiveness, enabling infiltration into adjacent tissues and dissemination via both the circulatory and lymphatic systems. Risk factors associated with skin cancer encompass ultraviolet (UV) radiation exposure, fair skin complexion, a history of sunburn incidents, genetic predisposition, immunosuppressive conditions, and exposure to environmental carcinogens. Early detection of skin cancer is of paramount importance to optimize treatment outcomes and preclude the progression of disease, either locally or to distant sites. In pursuit of this objective, numerous computer-aided diagnosis (CAD) systems have been developed. Hyperspectral imaging (HSI), distinguished by its capacity to capture information spanning the electromagnetic spectrum, surpasses conventional RGB imaging, which relies solely on three color channels. Consequently, this study offers a comprehensive exploration of recent CAD investigations pertaining to skin cancer detection and diagnosis utilizing HSI, emphasizing diagnostic performance parameters such as sensitivity and specificity.

Update on muscle imaging in myositis

PURPOSE OF REVIEW

Imaging techniques such as MRI, ultrasound and PET/computed tomography (CT) have roles in the detection, diagnosis and management of myositis or idiopathic inflammatory myopathy (IIM). Imaging research has also provided valuable knowledge in the understanding of the pathology of IIM. This review explores the latest advancements of these imaging modalities in IIM.

RECENT FINDINGS

Recent advancements in imaging of IIM have seen a shift away from manual and qualitative analysis of the images. Quantitative MRI provides more objective, and potentially more sensitive characterization of fat infiltration and inflammation in muscles. In addition to B-mode ultrasound changes, shearwave elastography offers a new dimension to investigating IIM. PET/CT has the added advantage of including IIM-associated findings such as malignancies.

SUMMARY

It is evident that MRI, ultrasound and PET/CT have important roles in myositis. Continued technological advancement and a quest for more sophisticated applications help drive innovation; this has especially been so of machine learning/deep learning using artificial intelligence and the developing promise of texture analysis.

Musculoskeletal ultrasound: a technical and historical perspective

During the past four decades, musculoskeletal ultrasound has become popular as an imaging modality due to its low cost, accessibility, and lack of ionizing radiation. The development of ultrasound technology was possible in large part due to concomitant advances in both solid-state electronics and signal processing. The invention of the transistor and digital computer in the late 1940s was integral in its development. Moore's prediction that the number of microprocessors on a chip would grow exponentially, resulting in progressive miniaturization in chip design and therefore increased computational power, added to these capabilities. The development of musculoskeletal ultrasound has paralleled technical advances in diagnostic ultrasound. The appearance of a large variety of transducer capabilities and rapid image processing along with the ability to assess vascularity and tissue properties has expanded and continues to expand the role of musculoskeletal ultrasound. It should also be noted that these developments have in large part been due to a number of individuals who had the insight to see the potential applications of this developing technology to a host of relevant clinical musculoskeletal problems. Exquisite high-resolution images of both deep and small superficial musculoskeletal anatomy, assessment of vascularity on a capillary level and tissue mechanical properties can be obtained. Ultrasound has also been recognized as the method of choice to perform a large variety of interventional procedures. A brief review of these technical developments, the timeline over which these improvements occurred, and the impact on musculoskeletal ultrasound is presented below.

255th ENMC workshop: Muscle imaging in idiopathic inflammatory myopathies. 15th January, 16th January and 22nd January 2021 - virtual meeting and hybrid meeting on 9th and 19th September 2022 in Hoofddorp, The Netherlands

The 255th ENMC workshop on Muscle Imaging in Idiopathic Inflammatory myopathies (IIM) aimed at defining recommendations concerning the applicability of muscle imaging in IIM. The workshop comprised of clinicians, researchers and people living with myositis. We aimed to achieve consensus on the following topics: a standardized protocol for the evaluation of muscle images in various types of IIMs; the exact parameters, anatomical localizations and magnetic resonance imaging (MRI) techniques; ultrasound as assessment tool in IIM; assessment methods; the pattern of muscle involvement in IIM subtypes; the application of MRI as biomarker in follow-up studies and clinical trials, and the place of MRI in the evaluation of swallowing difficulty and cardiac manifestations. The following recommendations were formulated: In patients with suspected IIM, muscle imaging is highly recommended to be part of the initial diagnostic workup and baseline assessment. MRI is the preferred imaging modality due to its sensitivity to both oedema and fat accumulation. Ultrasound may be used for suspected IBM. Repeat imaging should be considered if patients do not respond to treatment, if there is ongoing diagnostic uncertainty or there is clinical or laboratory evidence of disease relapse. Quantitative MRI is established as a sensitive biomarker in IBM and could be included as a primary or secondary outcome measure in early phase clinical trials, or as a secondary outcome measure in late phase clinical trials. Finally, a research agenda was drawn up.

Identification of tophi in ultrasound imaging based on transfer learning and clinical practice

Gout is a common metabolic disorder characterized by deposits of monosodium urate monohydrate crystals (tophi) in soft tissue, triggering intense and acute arthritis with intolerable pain as well as articular and periarticular inflammation. Tophi can also promote chronic inflammatory and erosive arthritis. 2015 ACR/EULAR Gout Classification criteria include clinical, laboratory, and imaging findings, where cases of gout are indicated by a threshold score of ≥ 8. Some imaging-related findings, such as a double contour sign in ultrasound, urate in dual-energy computed tomography, or radiographic gout-related erosion, generate a score of up to 4. Clearly, the diagnosis of gout is largely assisted by imaging findings; however, dual-energy computed tomography is expensive and exposes the patient to high levels of radiation. Although musculoskeletal ultrasound is non-invasive and inexpensive, the reliability of the results depends on expert experience. In the current study, we applied transfer learning to train a convolutional neural network for the identification of tophi in ultrasound images. The accuracy of predictions varied with the convolutional neural network model, as follows: InceptionV3 (0.871 ± 0.020), ResNet101 (0.913 ± 0.015), and VGG19 (0.918 ± 0.020). The sensitivity was as follows: InceptionV3 (0.507 ± 0.060), ResNet101 (0.680 ± 0.056), and VGG19 (0.747 ± 0.056). The precision was as follows: InceptionV3 (0.767 ± 0.091), ResNet101 (0.863 ± 0.098), and VGG19 (0.825 ± 0.062). Our results demonstrate that it is possible to retrain deep convolutional neural networks to identify the patterns of tophi in ultrasound images with a high degree of accuracy.

Neuromuscular Ultrasound in Intensive Care Unit-Acquired Weakness: Current State and Future Directions

Intensive care unit-acquired weakness (ICUAW) is one of the most common causes of muscle atrophy and functional disability in critically ill intensive care patients. Clinical examination, manual muscle strength testing and monitoring are frequently hampered by sedation, delirium and cognitive impairment. Many different attempts have been made to evaluate alternative compliance-independent methods, such as muscle biopsies, nerve conduction studies, electromyography and serum biomarkers. However, they are invasive, time-consuming and often require special expertise to perform, making them vastly impractical for daily intensive care medicine. Ultrasound is a broadly accepted, non-invasive, bedside-accessible diagnostic tool and well established in various clinical applications. Hereby, neuromuscular ultrasound (NMUS), in particular, has been proven to be of significant diagnostic value in many different neuromuscular diseases. In ICUAW, NMUS has been shown to detect and monitor alterations of muscles and nerves, and might help to predict patient outcome. This narrative review is focused on the recent scientific literature investigating NMUS in ICUAW and highlights the current state and future opportunities of this promising diagnostic tool.

Imaging biomarkers in the idiopathic inflammatory myopathies

Idiopathic inflammatory myopathies (IIMs) are a group of acquired muscle diseases with muscle inflammation, weakness, and other extra-muscular manifestations. IIMs can significantly impact the quality of life, and management of IIMs often requires a multi-disciplinary approach. Imaging biomarkers have become an integral part of the management of IIMs. Magnetic resonance imaging (MRI), muscle ultrasound, electrical impedance myography (EIM), and positron emission tomography (PET) are the most widely used imaging technologies in IIMs. They can help make the diagnosis and assess the burden of muscle damage and treatment response. MRI is the most widely used imaging biomarker of IIMs and can assess a large volume of muscle tissue but is limited by availability and cost. Muscle ultrasound and EIM are easy to administer and can even be performed in the clinical setting, but they need further validation. These technologies may complement muscle strength testing and laboratory studies and provide an objective assessment of muscle health in IIMs. Furthermore, this is a rapidly progressing field, and new advances are going to equip care providers with a better objective assessment of IIMS and eventually improve patient management. This review discusses the current state and future direction of imaging biomarkers in IIMs.

Automatic Analysis of Transverse Musculoskeletal Ultrasound Images Based on the Multi-Task Learning Model

Musculoskeletal ultrasound imaging is an important basis for the early screening and accurate treatment of muscle disorders. It allows the observation of muscle status to screen for underlying neuromuscular diseases including myasthenia gravis, myotonic dystrophy, and ankylosing muscular dystrophy. Due to the complexity of skeletal muscle ultrasound image noise, it is a tedious and time-consuming process to analyze. Therefore, we proposed a multi-task learning-based approach to automatically segment and initially diagnose transverse musculoskeletal ultrasound images. The method implements muscle cross-sectional area (CSA) segmentation and abnormal muscle classification by constructing a multi-task model based on multi-scale fusion and attention mechanisms (MMA-Net). The model exploits the correlation between tasks by sharing a part of the shallow network and adding connections to exchange information in the deep network. The multi-scale feature fusion module and attention mechanism were added to MMA-Net to increase the receptive field and enhance the feature extraction ability. Experiments were conducted using a total of 1827 medial gastrocnemius ultrasound images from multiple subjects. Ten percent of the samples were randomly selected for testing, 10% as the validation set, and the remaining 80% as the training set. The results show that the proposed network structure and the added modules are effective. Compared with advanced single-task models and existing analysis methods, our method has a better performance at classification and segmentation. The mean Dice coefficients and IoU of muscle cross-sectional area segmentation were 96.74% and 94.10%, respectively. The accuracy and recall of abnormal muscle classification were 95.60% and 94.96%. The proposed method achieves convenient and accurate analysis of transverse musculoskeletal ultrasound images, which can assist physicians in the diagnosis and treatment of muscle diseases from multiple perspectives.

Detecting hand joint ankylosis and subluxation in radiographic images using deep learning: A step in the development of an automatic radiographic scoring system for joint destruction

We propose a wrist joint subluxation/ankylosis classification model for an automatic radiographic scoring system for X-ray images. In managing rheumatoid arthritis, the evaluation of joint destruction is important. The modified total Sharp score (mTSS), which is conventionally used to evaluate joint destruction of the hands and feet, should ideally be automated because the required time depends on the skill of the evaluator, and there is variability between evaluators. Since joint subluxation and ankylosis are given a large score in mTSS, we aimed to estimate subluxation and ankylosis using a deep neural network as a first step in developing an automatic radiographic scoring system for joint destruction. We randomly extracted 216 hand X-ray images from an electronic medical record system for the learning experiments. These images were acquired from patients who visited the rheumatology department of Keio University Hospital in 2015. Using our newly developed annotation tool, well-trained rheumatologists and radiologists labeled the mTSS to the wrist, metacarpal phalangeal joints, and proximal interphalangeal joints included in the images. We identified 21 X-ray images containing one or more subluxation joints and 42 X-ray images with ankylosis. To predict subluxation/ankylosis, we conducted five-fold cross-validation with deep neural network models: AlexNet, ResNet, DenseNet, and Vision Transformer. The best performance on wrist subluxation/ankylosis classification was as follows: accuracy, precision, recall, F1 value, and AUC were 0.97±0.01/0.89±0.04, 0.92±0.12/0.77±0.15, 0.77±0.16/0.71±0.13, 0.82±0.11/0.72±0.09, and 0.92±0.08/0.85±0.07, respectively. The classification model based on a deep neural network was trained with a relatively small dataset; however, it showed good accuracy. In conclusion, we provided data collection and model training schemes for mTSS prediction and showed an important contribution to building an automated scoring system.

New International Guidelines and Consensus on the Use of Lung Ultrasound

Following the innovations and new discoveries of the last 10 years in the field of lung ultrasound (LUS), a multidisciplinary panel of international LUS experts from six countries and from different fields (clinical and technical) reviewed and updated the original international consensus for point-of-care LUS, dated 2012. As a result, a total of 20 statements have been produced. Each statement is complemented by guidelines and future developments proposals. The statements are furthermore classified based on their nature as technical (5), clinical (11), educational (3), and safety (1) statements.

Muscle ultrasound in hereditary muscle disease

In this review we summarise the key techniques of muscle ultrasound as they apply to hereditary muscle disease. We review the diagnostic utility of muscle ultrasound including its role in guiding electromyography and muscle biopsy sampling. We summarize the different patterns of sonographic muscle involvement in the major categories of genetic muscle disorders and discuss the limitations of the technique. We hope to encourage others to adopt ultrasound in their care for patients with hereditary muscle diseases.

Evaluation of Hepatic Fibrosis Using Ultrasound Backscattered Radiofrequency Signals and One-Dimensional Convolutional Neural Networks

The early detection of hepatic fibrosis is of critical importance. Ultrasound backscattered radiofrequency signals from the liver contain abundant information about its microstructure. We proposed a method for characterizing human hepatic fibrosis using one-dimensional convolutional neural networks (CNNs) based on ultrasound backscattered signals. The proposed CNN model was composed of four one-dimensional convolutional layers, four one-dimensional max-pooling layers, and four fully connected layers. Ultrasound radiofrequency signals collected from 230 participants (F0: 23; F1: 46; F2: 51; F3: 49; F4: 61) with a 3-MHz transducer were analyzed. Liver regions of interest (ROIs) that contained most of the liver ultrasound backscattered signals were manually delineated using B-mode images reconstructed from the backscattered signals. ROI signals were normalized and augmented by using a sliding window technique. After data augmentation, the radiofrequency signal segments were divided into training sets, validation sets and test sets at a ratio of 80%:10%:10%. In the test sets, the proposed algorithm produced an area under the receive operating characteristic curve of 0.933 (accuracy: 91.30%; sensitivity: 92.00%; specificity: 90.48%), 0.997 (accuracy: 94.29%; sensitivity: 94.74%; specificity: 93.75%), 0.818 (accuracy: 75.00%; sensitivity: 69.23%; specificity: 81.82%), and 0.934 (accuracy: 91.67%; sensitivity: 88.89%; specificity: 94.44%) for diagnosis liver fibrosis stage ≥F1, ≥F2, ≥F3, and ≥F4, respectively. Experimental results indicated that the proposed deep learning algorithm based on ultrasound backscattered signals yields a satisfying performance when diagnosing hepatic fibrosis stages. The proposed method may be used as a new quantitative ultrasound approach to characterizing hepatic fibrosis.

Analysis of facial ultrasonography images based on deep learning

Transfer learning using a pre-trained model with the ImageNet database is frequently used when obtaining large datasets in the medical imaging field is challenging. We tried to estimate the value of deep learning for facial US images by assessing the classification performance for facial US images through transfer learning using current representative deep learning models and analyzing the classification criteria. For this clinical study, we recruited 86 individuals from whom we acquired ultrasound images of nine facial regions. To classify these facial regions, 15 deep learning models were trained using augmented or non-augmented datasets and their performance was evaluated. The F-measure scores average of all models was about 93% regardless of augmentation in the dataset, and the best performing model was the classic model VGGs. The models regarded the contours of skin and bones, rather than muscles and blood vessels, as distinct features for distinguishing regions in the facial US images. The results of this study can be used as reference data for future deep learning research on facial US images and content development.

Comparison of Quantitative Ultrasound Methods to Classify Dystrophic and Obese Models of Skeletal Muscle

In this study, we compared multiple quantitative ultrasound metrics for the purpose of differentiating muscle in 20 healthy, 10 dystrophic and 10 obese mice. High-frequency ultrasound scans were acquired on dystrophic (D2-mdx), obese (db/db) and control mouse hindlimbs. A total of 248 image features were extracted from each scan, using brightness-mode statistics, Canny edge detection metrics, Haralick features, envelope statistics and radiofrequency statistics. Naïve Bayes and other classifiers were trained on single and pairs of features. The a parameter from the Homodyned K distribution at 40 MHz achieved the best univariate classification (accuracy = 85.3%). Maximum classification accuracy of 97.7% was achieved using a logistic regression classifier on the feature pair of a² (K distribution) at 30 MHz and brightness-mode variance at 40MHz. Dystrophic and obese mice have muscle with distinct acoustic properties and can be classified to a high level of accuracy using a combination of multiple features.

Ultrasound assessment of sarcopenia in patients with rheumatoid arthritis

OBJECTIVES

To evaluate the efficacy of ultrasound (US) as a diagnostic tool for sarcopenia in patients with rheumatoid arthritis (RA).

METHODS

Female RA patients aged >50 years and matched controls were cross-sectionally assessed. Sarcopenia was diagnosed based on the 2019-updated Asian Working Group for Sarcopenia definition. The cross-sectional area (CSA) and echo intensity (EI) of the biceps brachii, rectus femoris, and EI of the vastus lateralis were examined bilaterally. Correction for subcutaneous fat and calculation of the recorrected EI (rcEI) were performed. We performed logistic regression using both muscle rcEI and CSA with receiver operating curve analysis to evaluate the discriminative performance per muscle group.

RESULTS

Seventy-eight consecutive RA patients and 15 age-and sex-matched controls were assessed. Sarcopenia was diagnosed in 34 RA patients (43.6%). The rcEI of examined muscles were significantly higher, whereas CSA were significantly lower in sarcopenic RA patients than in non-sarcopenic patients and matched controls. The combined discriminative performance of rcEI and CSA was superior to those of rcEI or CSA alone.

CONCLUSIONS

This study suggests the use of US for the diagnosis of sarcopenia in RA patients. The diagnostic performance increases when both echogenicity and CSA are considered together rather than individually.

Visual versus quantitative analysis of muscle ultrasound in neuromuscular disease

Introduction/Aims

Visual and quantitative muscle ultrasound are both valid diagnostic tools in neuromuscular diseases. To optimize muscle ultrasound evaluation and facilitate its use in neuromuscular disease, we examined the correlation between visual and quantitative muscle ultrasound analysis and their pitfalls.

Methods

Retrospective data from 994 patients with 13,562 muscle ultrasound images were analyzed. Differences in echogenicity z‐score distribution per Heckmatt grade and corresponding correlation coefficients were calculated.

Results

Overall, there was a correlation of 0.60 between the two scoring systems, with a gradual increase in z‐score with increasing Heckmatt grades and vice versa. Patients with a neuromuscular disorder had higher Heckmatt grades (p < 0.001) and z‐scores (median z‐score = 0.30, p < 0.001) than patients without. The highest Heckmatt grades and z‐scores were found in patients with either a dystrophy or inflammatory myopathy (both median Heckmatt grade of 2 and median z score of 0.74 and 1.20, respectively). Discrepant scores were infrequent (<2%), but revealed important pitfalls in both grading systems.

Discussion

Visual and quantitative muscle ultrasound are complementary techniques to evaluate neuromuscular disease and have a moderate positive correlation. Importantly, we identified specific pitfalls for visual and quantitative muscle ultrasound and how to overcome them in clinical practice.

A machine learning analysis to predict the response to intravenous and subcutaneous immunoglobulin in inflammatory myopathies. A proposal for a future multi-omics approach in autoimmune diseases

OBJECTIVE

To evaluate the response to treatment with intravenous (IVIg) and subcutaneous (20%SCIg) immunoglobulin in our series of patients with Inflammatory idiopathic myopathies (IIM) by the means of artificial intelligence.

BACKGROUND

IIM are rare diseases mainly involving the skeletal muscle with particular clinical, laboratory and radiological characteristics. Artificial intelligence (AI) represents computer processes which allows to perform complex calculations and data analyses, with the least human intervention. Recently, the use an AI in medicine significantly expanded, especially through machine learning (ML) which analyses huge amounts of information and accordingly makes decisions, and deep learning (DL) which uses artificial neural networks to analyse data and automatically learn.

METHODS

In this study, we employed AI in the evaluation of the response to treatment with IVIg and 20%SCIg in our series of patients with IIM. The diagnoses were determined on the established EULAR/ACR criteria. The treatment response was evaluated employing the following: serum creatine kinase levels, muscle strength (MMT8 score), disease activity (MITAX score) and disability (HAQ-DI score). We evaluated all the above parameters, applying, with R, different supervised ML algorithms, including Least Absolute Shrinkage and Selection Operator, Ridge, Elastic Net, Classification and Regression Trees and Random Forest to estimate the most important predictors for a good response to IVIg and 20%SCIg treatment.

RESULTS AND CONCLUSION

By the means of AI we have been able to identify the scores that best predict a good response to IVIg and 20%SCIg treatment. The muscle strength as evaluated by MMT8 score at the follow-up is predicted by the presence of dysphagia and of skin disorders, and the myositis activity index (MITAX) at the beginning of the treatment. The relationship between muscle strength and MITAX indicates a better action of IVIg therapy in patients with more active systemic disease. Considering our results, Elastic Net and similar approaches were seen to be the most viable, efficient, and effective ML methods for predicting the clinical outcome (MMT8 and MITAX at most) in myositis.

A Progressive and Cross-Domain Deep Transfer Learning Framework for Wrist Fracture Detection

There has been an amplified focus on and benefit from the adoption of artificial intelligence (AI) in medical imaging applications. However, deep learning approaches involve training with massive amounts of annotated data in order to guarantee generalization and achieve high accuracies. Gathering and annotating large sets of training images require expertise which is both expensive and time-consuming, especially in the medical field. Furthermore, in health care systems where mistakes can have catastrophic consequences, there is a general mistrust in the black-box aspect of AI models. In this work, we focus on improving the performance of medical imaging applications when limited data is available while focusing on the interpretability aspect of the proposed AI model. This is achieved by employing a novel transfer learning framework, progressive transfer learning, an automated annotation technique and a correlation analysis experiment on the learned representations.

Progressive transfer learning helps jump-start the training of deep neural networks while improving the performance by gradually transferring knowledge from two source tasks into the target task. It is empirically tested on the wrist fracture detection application by first training a general radiology network RadiNet and using its weights to initialize RadiNetwrist , that is trained on wrist images to detect fractures. Experiments show that RadiNetwrist achieves an accuracy of 87% and an AUC ROC of 94% as opposed to 83% and 92% when it is pre-trained on the ImageNet dataset.

This improvement in performance is investigated within an explainable AI framework. More concretely, the learned deep representations of RadiNetwrist are compared to those learned by the baseline model by conducting a correlation analysis experiment. The results show that, when transfer learning is gradually applied, some features are learned earlier in the network. Moreover, the deep layers in the progressive transfer learning framework are shown to encode features that are not encountered when traditional transfer learning techniques are applied.

In addition to the empirical results, a clinical study is conducted and the performance of RadiNetwrist is compared to that of an expert radiologist. We found that RadiNetwrist exhibited similar performance to that of radiologists with more than 20 years of experience.

This motivates follow-up research to train on more data to feasibly surpass radiologists’ performance, and investigate the interpretability of AI models in the healthcare domain where the decision-making process needs to be credible and transparent.

Machine Learning in Rheumatic Diseases

With advances in information technology, the demand for using data science to enhance healthcare and disease management is rapidly increasing. Among these technologies, machine learning (ML) has become ubiquitous and indispensable for solving complex problems in many scientific fields, including medical science. ML allows the development of guidelines and framing of the evaluation system for complex diseases based on massive data. In the analysis of rheumatic diseases, which are chronic and remarkably heterogeneous, ML can be anticipated to be extremely helpful in deciphering and revealing the inherent interrelationships in disease development and progression, which can further enhance the overall understanding of the disease, optimize patients' stratification, calibrate therapeutic strategies, and predict prognosis and outcomes. In this review, the basics of ML, its potential clinical applications in rheumatology, together with its strengths and limitations are summarized.

Deep learning segmentation of transverse musculoskeletal ultrasound images for neuromuscular disease assessment

Ultrasound imaging is a patient-friendly and robust technique for studying physiological and pathological muscles. An automatic deep learning (DL) system for the analysis of ultrasound images could be useful to support an expert operator, allowing the study of large datasets requiring less human interaction. The purpose of this study is to present a deep learning algorithm for the cross-sectional area (CSA) segmentation in transverse musculoskeletal ultrasound images, providing a quantitative grayscale analysis which is useful for studying muscles, and to validate the results in a large dataset. The dataset included 3917 images of biceps brachii, tibialis anterior and gastrocnemius medialis acquired on 1283 subjects (mean age 50 ± 21 years, 729 male). The algorithm was based on multiple deep-learning architectures, and its performance was compared to a manual expert segmentation. We compared the mean grayscale value inside the automatic and manual CSA using Bland-Altman plots and a correlation analysis. Classification in healthy and abnormal muscles between automatic and manual segmentation were compared using the grayscale value z-scores. In the test set, a Precision of 0.88 ± 0.12 and a Recall of 0.92 ± 0.09 was achieved. The network segmentation performance was slightly less in abnormal muscles, without a loss of discrimination between healthy and abnormal muscle images. Bland-Altman plots showed no clear trend in the error distribution and the two readings have a 0.99 Pearson's correlation coefficient (p < 0.001, test set). The ICC(A, 1) calculated between the z-score readings was 0.99. The algorithm achieves robust CSA segmentation performance and gives mean grayscale level information comparable to a manual operator. This could provide a helpful tool for clinicians in neuromuscular disease diagnosis and follow-up. The entire dataset and code are made available for the research community.

Digital health, big data and smart technologies for the care of patients with systemic autoimmune diseases: Where do we stand?

The past decade has seen tremendous development in digital health, including in innovative new technologies such as Electronic Health Records, telemedicine, virtual visits, wearable technology and sophisticated analytical tools such as artificial intelligence (AI) and machine learning for the deep-integration of big data. In the field of rare connective tissue diseases (rCTDs), these opportunities include increased access to scarce and remote expertise, improved patient monitoring, increased participation and therapeutic adherence, better patient outcomes and patient empowerment. In this review, we discuss opportunities and key-barriers to improve application of digital health technologies in the field of autoimmune diseases. We also describe what could be the fully digital pathway of rCTD patients. Smart technologies can be used to provide real-world evidence about the natural history of rCTDs, to determine real-life drug utilization, advanced efficacy and safety data for rare diseases and highlight significant unmet needs. Yet, digitalization remains one of the most challenging issues faced by rCTD patients, their physicians and healthcare systems. Digital health technologies offer enormous potential to improve autoimmune rCTD care but this potential has so far been largely unrealized due to those significant obstacles. The need for robust assessments of the efficacy, affordability and scalability of AI in the context of digital health is crucial to improve the care of patients with rare autoimmune diseases.

MRI and muscle imaging for idiopathic inflammatory myopathies

Although idiopathic inflammatory myopathies (IIM) are a heterogeneous group of diseases nearly all patients display muscle inflammation. Originally, muscle biopsy was considered as the gold standard for IIM diagnosis. The development of muscle imaging led to revisiting not only the IIM diagnosis strategy but also the patients' follow-up. Different techniques have been tested or are in development for IIM including positron emission tomography, ultrasound imaging, ultrasound shear wave elastography, though magnetic resonance imaging (MRI) remains the most widely used technique in routine. Whereas guidelines on muscle imaging in myositis are lacking here we reviewed the relevance of muscle imaging for both diagnosis and myositis patients' follow-up. We propose recommendations about when and how to perform MRI on myositis patients, and we describe new techniques that are under development.

Deep Learning of Ultrasound Imaging for Evaluating Ambulatory Function of Individuals with Duchenne Muscular Dystrophy

Duchenne muscular dystrophy (DMD) results in loss of ambulation and premature death. Ultrasound provides real-time, safe, and cost-effective routine examinations. Deep learning allows the automatic generation of useful features for classification. This study utilized deep learning of ultrasound imaging for classifying patients with DMD based on their ambulatory function. A total of 85 individuals (including ambulatory and nonambulatory subjects) underwent ultrasound examinations of the gastrocnemius for deep learning of image data using LeNet, AlexNet, VGG-16, VGG-16_TL, VGG-19, and VGG-19_TL models (the notation TL indicates fine-tuning pretrained models). Gradient-weighted class activation mapping (Grad-CAM) was used to visualize features recognized by the models. The classification performance was evaluated using the confusion matrix and receiver operating characteristic (ROC) curve analysis. The results show that each deep learning model endows muscle ultrasound imaging with the ability to enable DMD evaluations. The Grad-CAMs indicated that boundary visibility, muscular texture clarity, and posterior shadowing are relevant sonographic features recognized by the models for evaluating ambulatory function. Of the proposed models, VGG-19 provided satisfying classification performance (the area under the ROC curve: 0.98; accuracy: 94.18%) and feature recognition in terms of physical characteristics. Deep learning of muscle ultrasound is a potential strategy for DMD characterization.

Artificial intelligence in dermatology and healthcare: An overview

Many aspects of our life are affected by technology. One of the most discussed advancements of modern technologies is artificial intelligence. It involves computational methods which in some way mimic the human thought process. Just like other branches, the medical field also has come under the ambit of artificial intelligence. Almost every field in medicine has been touched by its effect in one way or the other. Prominent among them are medical diagnosis, medical statistics, robotics, and human biology. Medical imaging is one of the foremost specialties with artificial intelligence applications, wherein deep learning methods like artificial neural networks are commonly used. artificial intelligence application in dermatology was initially restricted to the analysis of melanoma and pigmentary skin lesions, has now expanded and covers many dermatoses. Though the applications of artificial intelligence are ever increasing, large data requirements, interpretation of data and ethical concerns are some of its limitations in the present day.

Artificial intelligence in ultrasound

Ultrasound (US), a flexible green imaging modality, is expanding globally as a first-line imaging technique in various clinical fields following with the continual emergence of advanced ultrasonic technologies and the well-established US-based digital health system. Actually, in US practice, qualified physicians should manually collect and visually evaluate images for the detection, identification and monitoring of diseases. The diagnostic performance is inevitably reduced due to the intrinsic property of high operator-dependence from US. In contrast, artificial intelligence (AI) excels at automatically recognizing complex patterns and providing quantitative assessment for imaging data, showing high potential to assist physicians in acquiring more accurate and reproducible results. In this article, we will provide a general understanding of AI, machine learning (ML) and deep learning (DL) technologies; We then review the rapidly growing applications of AI-especially DL technology in the field of US-based on the following anatomical regions: thyroid, breast, abdomen and pelvis, obstetrics heart and blood vessels, musculoskeletal system and other organs by covering image quality control, anatomy localization, object detection, lesion segmentation, and computer-aided diagnosis and prognosis evaluation; Finally, we offer our perspective on the challenges and opportunities for the clinical practice of biomedical AI systems in US.

COVID-19 Detection Empowered with Machine Learning and Deep Learning Techniques: A Systematic Review

COVID-19 has infected 223 countries and caused 2.8 million deaths worldwide (at the time of writing this article), and the death rate is increasing continuously. Early diagnosis of COVID patients is a critical challenge for medical practitioners, governments, organizations, and countries to overcome the rapid spread of the deadly virus in any geographical area. In this situation, the previous epidemic evidence on Machine Learning (ML) and Deep Learning (DL) techniques encouraged the researchers to play a significant role in detecting COVID-19. Similarly, the rising scope of ML/DL methodologies in the medical domain also advocates its significant role in COVID-19 detection. This systematic review presents ML and DL techniques practiced in this era to predict, diagnose, classify, and detect the coronavirus. In this study, the data was retrieved from three prevalent full-text archives, i.e., Science Direct, Web of Science, and PubMed, using the search code strategy on 16 March 2021. Using professional assessment, among 961 articles retrieved by an initial query, only 40 articles focusing on ML/DL-based COVID-19 detection schemes were selected. Findings have been presented as a country-wise distribution of publications, article frequency, various data collection, analyzed datasets, sample sizes, and applied ML/DL techniques. Precisely, this study reveals that ML/DL technique accuracy lay between 80% to 100% when detecting COVID-19. The RT-PCR-based model with Support Vector Machine (SVM) exhibited the lowest accuracy (80%), whereas the X-ray-based model achieved the highest accuracy (99.7%) using a deep convolutional neural network. However, current studies have shown that an anal swab test is super accurate to detect the virus. Moreover, this review addresses the limitations of COVID-19 detection along with the detailed discussion of the prevailing challenges and future research directions, which eventually highlight outstanding issues.

Muscle ultrasound: Present state and future opportunities

Muscle ultrasound is a valuable addition to the neuromuscular toolkit in both the clinic and research settings, with proven value and reliability. However, it is currently not fulfilling its full potential in the diagnostic care of patients with neuromuscular disease. This review highlights the possibilities and pitfalls of muscle ultrasound as a diagnostic tool and biomarker, and discusses challenges to its widespread implementation. We expect that limitations in visual image interpretation, posed by user inexperience, could be overcome with simpler scoring systems and the help of deep-learning algorithms. In addition, more information should be collected on the relation between specific neuromuscular disorders, disease stages, and expected ultrasound abnormalities, as this will enhance specificity of the technique and enable the use of muscle ultrasound as a biomarker. Quantified muscle ultrasound gives the most sensitive results but is hampered by the need for device-specific reference values. Efforts in creating dedicated muscle ultrasound systems and artificial intelligence to help with image interpretation are expected to improve usability. Finally, the standard inclusion of muscle and nerve ultrasound in neuromuscular teaching curricula and guidelines will facilitate further implementation in practice. Our hope is that this review will help in unleashing muscle ultrasound's full potential.

Juvenile Dermatomyositis: New Clues to Diagnosis and Therapy

PURPOSE OF REVIEW

To identify clues to disease activity and discuss therapy options.

RECENT FINDINGS

The diagnostic evaluation includes documenting symmetrical proximal muscle damage by exam and MRI, as well as elevated muscle enzymes-aldolase, creatine phosphokinase, LDH, and SGOT-which often normalize with a longer duration of untreated disease. Ultrasound identifies persistent, occult muscle inflammation. The myositis-specific antibodies (MSA) and myositis-associated antibodies (MAA) are associated with specific disease course variations. Anti-NXP-2 is found in younger children and is associated with calcinosis; anti-TIF-1γ+ juvenile dermatomyositis has a longer disease course. The diagnostic rash-involving the eyelids, hands, knees, face, and upper chest-is the most persistent symptom and is associated with microvascular compromise, reflected by loss of nailfold (periungual) end row capillaries. This loss is associated with decreased bioavailability of oral prednisone; the bioavailability of other orally administered medications should also be considered. At diagnosis, at least 3 days of intravenous methyl prednisolone may help control the HLA-restricted and type 1/2 interferon-driven inflammatory process. The requirement for avoidance of ultraviolet light exposure mandates vitamin D supplementation.

SUMMARY

This often chronic illness targets the cardiovascular system; mortality has decreased from 30 to 1-2% with corticosteroids. New serological biomarkers indicate occult inflammation: ↑CXCL-10 predicts a longer disease course. Some biologic therapies appear promising.

Comparison of Intraoperative Ultrasound B-Mode and Strain Elastography for the Differentiation of Glioblastomas From Solitary Brain Metastases. An Automated Deep Learning Approach for Image Analysis

Background

The differential diagnosis of glioblastomas (GBM) from solitary brain metastases (SBM) is essential because the surgical strategy varies according to the histopathological diagnosis. Intraoperative ultrasound elastography (IOUS-E) is a relatively novel technique implemented in the surgical management of brain tumors that provides additional information about the elasticity of tissues. This study compares the discriminative capacity of intraoperative ultrasound B-mode and strain elastography to differentiate GBM from SBM.

Methods

We performed a retrospective analysis of patients who underwent craniotomy between March 2018 to June 2020 with glioblastoma (GBM) and solitary brain metastases (SBM) diagnoses. Cases with an intraoperative ultrasound study were included. Images were acquired before dural opening, first in B-mode, and then using the strain elastography module. After image pre-processing, an analysis based on deep learning was conducted using the open-source software Orange. We have trained an existing neural network to classify tumors into GBM and SBM via the transfer learning method using Inception V3. Then, logistic regression (LR) with LASSO (least absolute shrinkage and selection operator) regularization, support vector machine (SVM), random forest (RF), neural network (NN), and k-nearest neighbor (kNN) were used as classification algorithms. After the models’ training, ten-fold stratified cross-validation was performed. The models were evaluated using the area under the curve (AUC), classification accuracy, and precision.

Results

A total of 36 patients were included in the analysis, 26 GBM and 10 SBM. Models were built using a total of 812 ultrasound images, 435 of B-mode, 265 (60.92%) corresponded to GBM and 170 (39.8%) to metastases. In addition, 377 elastograms, 232 (61.54%) GBM and 145 (38.46%) metastases were analyzed. For B-mode, AUC and accuracy values of the classification algorithms ranged from 0.790 to 0.943 and from 72 to 89%, respectively. For elastography, AUC and accuracy values ranged from 0.847 to 0.985 and from 79% to 95%, respectively.

Conclusion

Automated processing of ultrasound images through deep learning can generate high-precision classification algorithms that differentiate glioblastomas from metastases using intraoperative ultrasound. The best performance regarding AUC was achieved by the elastography-based model supporting the additional diagnostic value that this technique provides.

Quantitative evaluation of liver fibrosis based on ultrasound radio frequency signals: An animal experimental study

BACKGROUND

Chronic liver disease is an important cause of liver failure and death worldwide, and liver fibrosis is a common pathological process of most chronic liver diseases. There still lacks a useful tool for evaluating liver fibrosis progression precisely and non-invasively. The purpose of this study was to explore the use of ultrasound radio frequency (RF) signals combined with deep learning approach to evaluate the degree of liver fibrosis quantitatively.

METHODS

In this study, by extracting the output of deep learning models as a prediction value, a quantitative liver fibrosis prediction method was achieved based on the bidirectional long short-term memory (Bi-LSTM) network to analyze radio frequency (RF) signals. The dataset consisted of 160 sets of ultrasound RF signals of rat livers, including five fibrosis stages 0-4, upon pathological diagnosis. In total, 150 sets of RF signals were used to train four deep learning classification models, the output of which contained quantitative information. In each training stage of the four models, a large number of signal segments were extracted from the 150 sets and divided randomly into training and validation sets in a ratio of 80:20. Ten sets of RF data using the gold standard of quantitative fibrosis parameter (q-FP) of liver tissues were left for independent testing. To validate the proposed method, correlation analysis was carried out between q-FP and the quantitative prediction results based on the independent test data.

RESULTS

The accuracy of the four deep learning networks using the training and validation data was above 0.83 and 0.80, and the corresponding areas under the receiver operating characteristic curves were higher than 0.95 and 0.93, respectively. For the quantitative analysis in the independent test set, the determination coefficient, R², of the linear regression analysis between the quantitative prediction results and q-FP was above 0.93. liver fibrosis is a common pathological process of most chronic liver diseases.

CONCLUSIONS

This study indicates that a prediction system based on ultrasound RF signals and a deep learning approach is promising for realizing quantitative and visualized diagnosis of liver fibrosis, which would be of great value in monitoring liver fibrosis non-invasively.

Artificial intelligence in musculoskeletal ultrasound imaging

Ultrasonography (US) is noninvasive and offers real-time, low-cost, and portable imaging that facilitates the rapid and dynamic assessment of musculoskeletal components. Significant technological improvements have contributed to the increasing adoption of US for musculoskeletal assessments, as artificial intelligence (AI)-based computer-aided detection and computer-aided diagnosis are being utilized to improve the quality, efficiency, and cost of US imaging. This review provides an overview of classical machine learning techniques and modern deep learning approaches for musculoskeletal US, with a focus on the key categories of detection and diagnosis of musculoskeletal disorders, predictive analysis with classification and regression, and automated image segmentation. Moreover, we outline challenges and a range of opportunities for AI in musculoskeletal US practice.

Texture analysis and machine learning to predict water T2 and fat fraction from non-quantitative MRI of thigh muscles in Facioscapulohumeral muscular dystrophy

PURPOSE

Quantitative MRI (qMRI) plays a crucial role for assessing disease progression and treatment response in neuromuscular disorders, but the required MRI sequences are not routinely available in every center. The aim of this study was to predict qMRI values of water T2 (wT2) and fat fraction (FF) from conventional MRI, using texture analysis and machine learning.

METHOD

Fourteen patients affected by Facioscapulohumeral muscular dystrophy were imaged at both thighs using conventional and quantitative MR sequences. Muscle FF and wT2 were calculated for each muscle of the thighs. Forty-seven texture features were extracted for each muscle on the images obtained with conventional MRI. Multiple machine learning regressors were trained to predict qMRI values from the texture analysis dataset.

RESULTS

Eight machine learning methods (linear, ridge and lasso regression, tree, random forest (RF), generalized additive model (GAM), k-nearest-neighbor (kNN) and support vector machine (SVM) provided mean absolute errors ranging from 0.110 to 0.133 for FF and 0.068 to 0.115 for wT2. The most accurate methods were RF, SVM and kNN to predict FF, and tree, RF and kNN to predict wT2.

CONCLUSION

This study demonstrates that it is possible to estimate with good accuracy qMRI parameters starting from texture analysis of conventional MRI.