Interrater Reliability of Muscle Ultrasonography Image Acquisition by Physical Therapists in Patients Who Have or Who Survived Critical Illness

MyoVision-US: an Artificial Intelligence-Powered Software for Automated Analysis of Skeletal Muscle Ultrasonography

Introduction/Aims

Muscle ultrasound has high utility in clinical practice and research; however, the main challenges are the training and time required for manual analysis to achieve objective quantification of morphometry. This study aimed to develop and validate a software tool powered by artificial intelligence (AI) by measuring its consistency and predictability of expert manual analysis quantifying lower limb muscle ultrasound images across healthy, acute, and chronic illness subjects.

Methods

Quadriceps complex (QC [rectus femoris and vastus intermedius]) and tibialis anterior (TA) muscle ultrasound images of healthy, intensive care unit, and/or lung cancer subjects were captured with portable devices. Automated analyses of muscle morphometry were performed using a custom-built deep-learning model (MyoVision-US), while manual analyses were performed by experts. Consistency between manual and automated analyses was determined using intraclass correlation coefficients (ICC), while predictability of MyoVision -US was calculated using adjusted linear regression (adj.R 2 ).

Results

Manual analysis took approximately 24 hours to analyze all 180 images, while MyoVision - US took 247 seconds, saving roughly 99.8%. Consistency between the manual and automated analyses by ICC was good to excellent for all QC (ICC:0.85-0.99) and TA (ICC:0.93-0.99) measurements, even for critically ill (ICC:0.91-0.98) and lung cancer (ICC:0.85-0.99) images. The predictability of MyoVision-US was moderate to strong for QC (adj.R 2 :0.56-0.94) and TA parameters (adj.R 2 :0.81-0.97).

Discussion

The application of AI automating lower limb muscle ultrasound analyses showed excellent consistency and strong predictability compared with human analysis. Future work needs to explore AI-powered models for the evaluation of other skeletal muscle groups.

Ultrasound for measurement of skeletal muscle mass quantity and muscle composition/architecture in critically ill patients: A scoping review on studies' aims, methods, and findings

AIMS

This scoping review aimed to identify, explore, and map the objectives, methodological aspects, and results of studies that used ultrasound (US) to assess skeletal muscle (SM) in critically ill patients.

METHODS

A scoping review was conducted according to the Joanna Briggs Institute's methodology. All studies that evaluated SM parameters from the US in patients admitted to the intensive care unit (ICU) were considered eligible. We categorized muscle thickness and cross-sectional area as parameters for assessing SM quantity, while echogenicity, fascicle length, and pennation angle analysis were used to evaluate muscle "quality" (composition/architecture). A literature search was conducted using four databases for articles published until December 2022. Independent reviewers selected the studies and extracted data. Descriptive statistics were calculated to present the results.

RESULTS

A total of 107 studies were included, the majority of which were prospective cohort studies (59.8 %) conducted in general ICUs (49.5 %). The most frequent objective of the studies was to evaluate SM quantity depletion during the ICU stay (25.2 %), followed by determining whether a specific intervention would modify SM (21.5 %). Most studies performed serial SM evaluations (76.1 %). The rectus femoris muscle thickness was evaluated in most studies (67.9 %), followed by the rectus femoris cross-sectional area (54.3 %) and the vastus intermedius muscle thickness (40.2 %). The studies demonstrated the feasibility and reproducibility of US for SM evaluation, especially related to quantitative parameters. Most studies (70.3 %) reported significant SM quantity depletion during hospitalization. However, the accuracy of the US in measuring SM varied across the studies.

CONCLUSIONS

The lack of detailed description and standardization in the protocols adopted by the studies included in this scoping review precludes the translation of the evidence related to US for SM assessment into clinical practice.

Construct and criterion validity of muscle ultrasonography for assessment of skeletal muscle in patients recovering from COVID-19

Background: The purpose was to investigate the content, construct, and criterion validity of muscle ultrasound in a mixed cohort of participants recovering from mild and critical COVID-19. Methods: A secondary analysis of a prospective cross-sectional study was conducted on data obtained from a battery of muscle and physical function assessments including a muscle biopsy and muscle ultrasonography (US). Rectus femoris (RF) muscle thickness (mT), quadricep complex (QC) mT, RF muscle cross-sectional area (CSA) using 2D freeform trace and estimated from Feret's diameter, and RF echo intensity (EI) were assessed with US. Muscle fiber CSA, fiber type, protein content in muscle fibers, extracellular matrix content (ECM; wheat-germ agglutin), and percent area of collagen in ECM (picrosirius red) were examined from vastus lateralis muscle biopsies. Spearman rho correlations (r) were performed to assess validity of ultrasound parameters. Results: Thirty-three individuals participated including 11 patients surviving critical COVID-19, 15 individuals recovering from mild-COVID, and 7 controls. There were several significant correlations between RF mT, QC mT, RF CSA, and RF EI with age, comorbid burden, body-mass index, and measures of muscle strength, muscle power, and physical function (range r = 0.35-0.83). RF Feret's CSA correlated to CSA of type II muscle fibers (r = 0.41, p = 0.022) and the average size of all muscle fibers (r = 0.39, p = 0.031). RF EI was correlated with collagen in muscle ECM (r = 0.53, p = 0.003) and protein content in muscle tissue (r = -0.52, p = 0.012). Conclusion: Muscle size and quality measured using US has moderate content and construct validity, and to lesser extent, fair to moderate criterion validity in a mixed cohort of individuals recovering from COVID. Muscle ultrasound quality (EI) appears to be sensitive at detecting muscle dysfunction as it is associated with strength, power, physical function, and collagen distribution in a mixed group of individuals recovering from COVID-19.

Critical illness myopathy and trajectory of recovery in acute kidney injury requiring continuous renal replacement therapy: a prospective observational trial protocol

INTRODUCTION

Acute kidney injury requiring renal replacement therapy (AKI-RRT) is common in the intensive care unit (ICU) and is associated with significant morbidity and mortality. Continuous RRT (CRRT) non-selectively removes large amounts of amino acids from plasma, lowering serum amino acid concentrations and potentially depleting total-body amino acid stores. Therefore, the morbidity and mortality associated with AKI-RRT may be partly mediated through accelerated skeletal muscle atrophy and resulting muscle weakness. However, the impact of AKI-RRT on skeletal muscle mass and function during and following critical illness remains unknown. We hypothesise that patients with AKI-RRT have higher degrees of acute muscle loss than patients without AKI-RRT and that AKI-RRT survivors are less likely to recover muscle mass and function when compared with other ICU survivors.

METHODS AND ANALYSIS

This protocol describes a prospective, multicentre, observational trial assessing skeletal muscle size, quality and function in ICU patients with AKI-RRT. We will perform musculoskeletal ultrasound to longitudinally evaluate rectus femoris size and quality at baseline (within 48 hours of CRRT initiation), day 3, day 7 or at ICU discharge, at hospital discharge, and 1-3 months postdischarge. Additional skeletal muscle and physical function tests will be performed at hospital discharge and postdischarge follow-up. We will analyse the effect of AKI-RRT by comparing the findings in enrolled subjects to historical controls of critically ill patients without AKI-RRT using multivariable modelling.

ETHICS AND DISSEMINATION

We anticipate our study will reveal that AKI-RRT is associated with greater degrees of muscle loss and dysfunction along with impaired postdischarge recovery of physical function. These findings could impact the in-hospital and postdischarge treatment plan for these patients to include focused attention on muscle strength and function. We intend to disseminate findings to participants, healthcare professionals, the public and other relevant groups via conference presentation and publication without any publication restrictions.

TRIAL REGISTRATION NUMBER

NCT05287204.

Inter-Examiner and Intra-Examiner Reliability of Quantitative and Qualitative Ultrasonography Assessment of Peripheral and Respiratory Muscles in Critically Ill Patients

ICU patients are exposed to several factors that can lead to muscle structural and functional changes, and ultrasonography can identify them. Although several studies have analyzed the reliability of muscle ultrasonography assessment, a protocol with more muscle assessments becomes a challenge. The aim of this study was to analyze the inter and intra-examiner reliability of peripheral and respiratory muscle ultrasonography assessment in critically ill patients. The sample size was 10 individuals aged ≥ 18 years who were admitted to the ICU. Practical training of four health professionals from different backgrounds was performed. After training, each examiner acquired three images to assess the thickness and echogenicity of the muscle groups: biceps brachii, forearm flexor group, quadriceps femoris, tibialis anterior and diaphragm. For the reliability analysis, an intraclass correlation coefficient was performed. Six hundred US images were analyzed for muscle thickness and 150 for echogenicity. Excellent intra-examiner reliability for echogenicity (ICC: 0.867-0.973) and inter-examiner reliability for thickness were found in all muscle groups (ICC: 0.778-0.942). For muscle thickness intra-examiner reliability, excellent results were found (ICC: 0.798-0.988), with a "good" correlation in one diaphragm assessment (ICC: 0.718). Excellent inter- and intra-examiner reliability of the thickness assessment and intra-examiner echogenicity of all muscles analyzed were found.

Update on Lean Body Mass Diagnostic Assessment in Critical Illness

Acute critical illnesses can alter vital functions with profound biological, biochemical, metabolic, and functional modifications. Despite etiology, patient's nutritional status is pivotal to guide metabolic support. The assessment of nutritional status remains complex and not completely elucidated. Loss of lean body mass is a clear marker of malnutrition; however, the question of how to investigate it still remains unanswered. Several tools have been implemented to measure lean body mass, including a computed tomography scan, ultrasound, and bioelectrical impedance analysis, although such methods unfortunately require validation. A lack of uniform bedside measurement tools could impact the nutrition outcome. Metabolic assessment, nutritional status, and nutritional risk have a pivotal role in critical care. Therefore, knowledge about the methods used to assess lean body mass in critical illnesses is increasingly required. The aim of the present review is to update the scientific evidence regarding lean body mass diagnostic assessment in critical illness to provide the diagnostic key points for metabolic and nutritional support.

Musculoskeletal health state and physical function of intensive care unit survivors: protocol for a UK multicentre prospective cohort study (the MSK-ICU study)

INTRODUCTION

Survivors of critical illness frequently experience long-term physical impairment, decreased health-related quality of life and low rates of return to employment. There has been limited investigation of the underlying problems affecting physical function post-intensive care unit (ICU) admission. Musculoskeletal (MSK) conditions may be complex in presentation, with ICU survivors potentially at greater risk of their development due to the rapid muscle mass loss seen in ICU. The MSK health state of ICU survivors and its impact on physical function remain largely unknown. The aim of the MSK-ICU study is to determine and characterise the MSK health state of ICU survivors 6 months following admission to ICU, in order to inform development of targeted rehabilitation interventions.

METHODS AND ANALYSIS

The MSK-ICU study is a multicentre prospective longitudinal cohort study, evaluating the MSK health state of ICU survivors 6 months after admission to ICU. The study consists of a primary study and two substudies. The primary study will be a telephone follow-up of adults admitted to ICU for more than 48 hours, collecting data on MSK health state, quality of life, employment, anxiety and depression and symptoms of post-traumatic stress disorder. The planned sample size is 334 participants. Multivariable regression will be used to identify prognostic factors for a worse MSK health state, as measured by the MSK-Health Questionnaire. In substudy 1, participants who self-report any MSK problem will undergo a detailed, in-person MSK physical assessment of pain, peripheral joint range of movement and strength. In substudy 2, participants reporting a severe MSK problem will undergo a detailed physical assessment of mobility, function and muscle architecture.

ETHICS AND DISSEMINATION

Ethical approval has been obtained through the North of Scotland Research Ethics Committee 2 (21/NS/0143). We aim to disseminate the findings through international conferences, international peer-reviewed journals and social media.

TRIAL REGISTRATION NUMBER

ISRCTN24998809.

Relationship between quadriceps femoris muscle architecture and muscle strength and physical function in older adults with heart failure with preserved ejection fraction

Heart failure (HF)-related factors potentially lead to sarcopenia. Ultrasound (US) assessment has all the advantages of being used in clinical practice to assess muscle architecture. This study aimed to assess the relationship between the quadriceps femoris (QF) muscle architecture with the gender, age, body mass index (BMI), muscle strength and physical function in older adults with HF with preserved ejection fraction (HFpEF) as well as to assess the difference in these relationships between the two genders. Patients 70 years and older with HFpEF were included. The gender, age and BMI were collected. The QF muscle thickness, the QF muscle echo-intensity, the subcutaneous fat tissue thickness (FT) and the subcutaneous fat tissue echo-intensity were assessed by the US. The six-minute walk test, the short physical performance battery (SPPB), the timed up and go test (TUG), and the gait speed test (UGS) were used to assess physical function. The five-repetitions sit-to-stand test (5-STS) was performed to assess muscle strength. Bivariant Pearson correlations and subsequent multivariate linear regression analysis were conducted. Seventy older adults with HFpEF [81.00 (5.97) years] were recruited. The FT showed a correlation between poor and moderate muscle strength and physical function in women with HFpEF. The FT explained 24.5% of the 5-STS variance, 32.4% of the SPPB variance, 31.5% of the TUG variance, 28.6% of the UGS variance, and 21.4% of the FGS variance in women. The US assessment could allow clinicians to assess muscle architecture biomarkers related to muscle strength and physical function in older adults with HFpEF.Trial registration NCT03909919. April 10, 2019. Retrospectively registered.

Reliability of point-of-care ultrasound for measuring quadriceps femoris muscle thickness

BACKGROUND

Point-of-care ultrasound can be used to assess muscle thickness. However, its reliability has not been fully evaluated.

AIM

This study aimed to assess the intrarater and inter-rater reliability of point-of-care ultrasound for the estimation of quadriceps and rectus femoris thickness in patients from a rehabilitation setting.

DESIGN

This is a cross-sectional study.

SETTING

This study was conducted at the Department of Physical Medicine and Rehabilitation of a tertiary care hospital.

POPULATION

Twenty-nine inpatients consecutively selected after admission.

METHODS

Four observers, two trained and two untrained, used point-of-care ultrasound to measure quadriceps femoris and rectus femoris thickness. Each observer performed two measurements followed by a second set of two measurements three hours later. Intraclass correlation coefficients (ICC) were then calculated.

RESULTS

Both intrarater and inter-rater ICC were higher than 0.888 for both quadriceps and rectus femoris measurements. Reliability was highest when ICC were calculated based on the average of two measurements, with the intrarater ICC being of 0.956 (95% CI: 0.937-0.970) for rectus femoris and of 0.966 (95% CI: 0.951-0.976) for quadriceps femoris; and with the inter-rater ICC being of 0.919 (95% CI: 0.863-0.957) for rectus femoris and 0.945 (95% CI: 0.907- 0.971) for quadriceps femoris. Trained and untrained observers did not have significantly different ICC values.

CONCLUSIONS

These results suggest that point-of-care ultrasound is a reliable option to measure muscle thickness of knee extensors by the same or different observers.

CLINICAL REHABILITATION IMPACT

Measuring knee extensors thickness may aid to adequately modulate treatment choices in patients with disability. This study suggests that quadriceps and rectus femoris muscle thickness measured after a short training course, by either an experienced or inexperienced clinician, presents high reliability. Reliability can be increased if the average of two measurements is used. Besides being inexpensive and portable, point-of-care ultrasound is a reliable tool for measuring knee extensors' thickness, rendering it potentially adequate to be used in clinical practice.

Biomarkers and the quadriceps femoris muscle architecture assessed by ultrasound in older adults with heart failure with preserved ejection fraction: a cross-sectional study

BACKGROUND

Sarcopenia is an important comorbidity in patients with heart failure with preserved ejection fraction (HFpEF). The ultrasound (US) assessment has all the advantages of being used in primary care to assess muscle quantity and quality. Some biomarkers could be indicative of muscle mass loss.

AIMS

To describe the quantitative and qualitative characteristics of the quadriceps femoris assessed by US in older adults with HFpEF and to assess the relationship of the blood and urinary biomarkers, the polypharmacy and comorbidities with US outcomes in older adults with HFpEF.

METHODS

A cross-sectional study was conducted. 76 older adults with HFpEF were included. The quadriceps femoris muscle thickness (MT, cm), the subcutaneous fat tissue thickness (FT, cm), the muscle echo intensity (MEI) and the subcutaneous fat tissue echo intensity (FEI) were assessed by US in a non-contraction (non-con) and contraction (con) situations. Polypharmacy, comorbidities, blood and urine biomarkers were also collected.

RESULTS

The carbohydrate antigen 125 (CA-125), the folic acid and the urine creatinine shared the 86.6% variance in the non-con MT, adjusted by age, sex and body mass index (BMI). The folic acid shared the 38.5% of the variance in the con MT, adjusted by age, sex and BMI. The glycosylated haemoglobin explained the 39.6% variance in the non-con MEI, adjusted by age, sex and BMI. The chlorine (Cl-) explained the 40.2% of the variance in the non-con FT, adjusted by age, sex and BMI. The polypharmacy and the folic acid explained the 37.9% of variance in the non-con FEI, while the polypharmacy and the thyrotropin (TSH) shared the 44.4% of variance in the con FEI, both adjusted by age, sex and BMI. No comorbidities, polypharmacy, or blood and urinary biomarkers could explain the con MEI and the con FT variance.

CONCLUSIONS

Blood and urinary biomarkers obtained in routine analyses could help clinicians detect US outcome changes in older adults with HFpEF and identify a worsening of sarcopenia.

TRIAL REGISTRATION

NCT03909919. April 10, 2019. Retrospectively registered.

The Influence of Sonographer Experience on Skeletal Muscle Image Acquisition and Analysis

The amount of experience with ultrasonography may influence measurement outcomes while images are acquired or analyzed. The purpose of this study was to identify the interrater reliability of ultrasound image acquisition and image analysis between experienced and novice sonographers and image analysts, respectively. Following a brief hands-on training session (2 h), the experienced and novice sonographers and analysts independently performed image acquisition and analyses on the biceps brachii, vastus lateralis, and medial gastrocnemius in a sample of healthy participants (n = 17). Test-retest reliability statistics were computed for muscle thickness (transverse and sagittal planes), muscle cross-sectional area, echo intensity and subcutaneous adipose tissue thickness. The results show that image analysis experience generally has a greater impact on measurement outcomes than image acquisition experience. Interrater reliability for measurements of muscle size during image acquisition was generally good-excellent (ICC2,1: 0.82-0.98), but poor-moderate for echo intensity (ICC2,1: 0.43-0.77). For image analyses, interrater reliability for measurements of muscle size for the vastus lateralis and biceps brachii was poor-moderate (ICC2,1: 0.48-0.70), but excellent for echo intensity (ICC2,1: 0.90-0.98). Our findings have important implications for laboratories and clinics where members possess varying levels of ultrasound experience.

Evaluating a Muscle Ultrasound Education Program: Theoretical Knowledge, Hands-on Skills, Reliability, and Satisfaction of Critical Care Physiotherapists

OBJECTIVE

To evaluate learning results of critical care physiotherapists participating in a muscle ultrasound (MUS) educational program.

DESIGN

Cross-sectional study.

SETTING

A custom-made 20-hour MUS course was performed over a 2-week time period, including knobs familiarization, patient positioning, anatomic landmarks, image acquisition, and limb muscle measurements.

PARTICIPANTS

Nineteen critical care physiotherapists with little to no prior experience in ultrasound (N=19).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Theoretical knowledge, hands-on skills acquisition, and satisfaction were assessed. Inter- and intrarater reliability on landmarks, thickness, and pennation angle of quadriceps between participants was evaluated using intraclass correlation coefficients (ICCs). Reliability among instructors measured prior to the course was also reported as a reference.

RESULTS

The percentage score (mean±SD) of knowledge questionnaires was 69±11 (pre-course), 89±10 (post-course), and 92±9 (hands-on skills). Course satisfaction scores ranged from 90%-100%. Pooled interrater reliability of participants (median ICC [interquartile range]) was good (0.70 [0.59-0.79]) for thickness, moderate (0.47 [0.46-0.92]) for landmarks, and absent (0.00 [0.00-0.05]) for pennation angle and the intrarater reliability was good (0.76 [0.51-0.91]) for thickness and weak (0.35 [0.29-0.52]) for pennation angle. Interrater ICC values for instructors were excellent (0.90) for thickness, good (0.67) for landmarks, and moderate (0.41) for pennation angle and intrarater ICC values were excellent (0.94) for thickness and good (0.75) for pennation angle.

CONCLUSIONS

Although our sample was quite small and homogeneous, increased theoretical knowledge, high hands-on performance acquisition, and good satisfaction of physiotherapists were observed. Reliability was moderate to excellent for thickness and landmarks and absent to weak for pennation angle. Landmarking and pennation angle remain challenges for physiotherapist training in the application of MUS. Further studies are needed to identify variables that could modify reliability during MUS training.

Acute skeletal muscle wasting and dysfunction predict physical disability at hospital discharge in patients with critical illness

BACKGROUND

Patients surviving critical illness develop muscle weakness and impairments in physical function; however, the relationship between early skeletal muscle alterations and physical function at hospital discharge remains unclear. The primary purpose of this study was to determine whether changes in muscle size, strength and power assessed in the intensive care unit (ICU) predict physical function at hospital discharge.

METHODS

Study design is a single-center, prospective, observational study in patients admitted to the medicine or cardiothoracic ICU with diagnosis of sepsis or acute respiratory failure. Rectus femoris (RF) and tibialis anterior (TA) muscle ultrasound images were obtained day one of ICU admission, repeated serially and assessed for muscle cross-sectional area (CSA), layer thickness (mT) and echointensity (EI). Muscle strength, as measured by Medical Research Council-sum score, and muscle power (lower-extremity leg press) were assessed prior to ICU discharge. Physical function was assessed with performance on 5-times sit-to-stand (5STS) at hospital discharge.

RESULTS

Forty-one patients with median age of 61 years (IQR 55-68), 56% male and sequential organ failure assessment score of 8.1 ± 4.8 were enrolled. RF muscle CSA decreased significantly a median percent change of 18.5% from day 1 to 7 (F = 26.6, p = 0.0253). RF EI increased at a mean percent change of 10.5 ± 21% in the first 7 days (F = 3.28, p = 0.081). At hospital discharge 25.7% of patients (9/35) met criteria for ICU-acquired weakness. Change in RF EI in first 7 days of ICU admission and muscle power measured prior to ICU were strong predictors of ICU-AW at hospital discharge (AUC = 0.912). Muscle power at ICU discharge, age and ICU length of stay were predictive of performance on 5STS at hospital discharge.

CONCLUSION

ICU-assessed muscle alterations, specifically RF EI and muscle power, are predictors of diagnosis of ICU-AW and physical function assessed by 5x-STS at hospital discharge in patients surviving critical illness.