Technology-outcome measures in neuromuscular disorders: a systematic review

Methodological quality of 100 recent systematic reviews of health-related outcome measurement instruments: an overview of reviews

PURPOSE

Systematic reviews evaluating and comparing the measurement properties of outcome measurement instruments (OMIs) play an important role in OMI selection. Earlier overviews of review quality (2007, 2014) evidenced substantial concerns with regards to alignment to scientific standards. This overview aimed to investigate whether the quality of recent systematic reviews of OMIs lives up to the current scientific standards.

METHODS

One hundred systematic reviews of OMIs published from June 1, 2021 onwards were randomly selected through a systematic literature search performed on March 17, 2022 in MEDLINE and EMBASE. The quality of systematic reviews was appraised by two independent reviewers. An updated data extraction form was informed by the earlier studies, and results were compared to these earlier studies' findings.

RESULTS

A quarter of the reviews had an unclear research question or aim, and in 22% of the reviews the search strategy did not match the aim. Half of the reviews had an incomprehensive search strategy, because relevant search terms were not included. In 63% of the reviews (compared to 41% in 2014 and 30% in 2007) a risk of bias assessment was conducted. In 73% of the reviews (some) measurement properties were evaluated (58% in 2014 and 55% in 2007). In 60% of the reviews the data were (partly) synthesized (42% in 2014 and 7% in 2007); evaluation of measurement properties and data syntheses was not conducted separately for subscales in the majority. Certainty assessments of the quality of the total body of evidence were conducted in only 33% of reviews (not assessed in 2014 and 2007). The majority (58%) did not make any recommendations on which OMI (not) to use.

CONCLUSION

Despite clear improvements in risk of bias assessments, measurement property evaluation and data synthesis, specifying the research question, conducting the search strategy and performing a certainty assessment remain poor. To ensure that systematic reviews of OMIs meet current scientific standards, more consistent conduct and reporting of systematic reviews of OMIs is needed.

Measuring gait parameters from a single chest-worn accelerometer in healthy individuals: a validation study

Digital health technologies (DHTs) are increasingly being adopted in clinical trials, as they enable objective evaluations of health parameters in free-living environments. Although lumbar accelerometers notably provide reliable gait parameters, embedding accelerometers in chest devices, already used for vital signs monitoring, could capture a more comprehensive picture of participants' wellbeing, while reducing the burden of multiple devices. Here we assess the validity of gait parameters measured from a chest accelerometer. Twenty healthy adults (13 females, mean ± sd age: 33.9 ± 9.1 years) instrumented with lumbar and chest accelerometers underwent in-lab and outside-lab walking tasks, while monitored with reference devices (an instrumented mat, and a 6-accelerometers set). Gait parameters were extracted from chest and lumbar accelerometers using our open-source Scikit Digital Health gait (SKDH-gait) algorithm, and compared against reference values via Bland-Altman plots, Pearson's correlation, and intraclass correlation coefficient. Mixed effects regression models were performed to investigate the effect of device, task, and their interaction. Gait parameters derived from chest and lumbar accelerometers showed no significant difference and excellent agreement across all tasks, as well as good-to-excellent agreement and strong correlation against reference values, thus supporting the deployment of a single multimodal chest device in clinical trials, to simultaneously measure gait and vital signs.Trial Registration: The study was reviewed and approved by the Advarra IRB (protocol number: Pro00043100).

Walking test outcomes in adults with genetic neuromuscular diseases: a systematic literature review of their measurement properties

INTRODUCTION

Neuromuscular diseases (NMDs) include a large group of heterogeneous diseases. NMDs frequently involve gait disorders, which affect quality of life. Several walking tests and tools have been described in the literature, but there is no consensus regarding the use of walking tests and tools in NMDs or of their measurement properties for walking outcomes. The aim of this review is to present an overview of walking tests, including their measurement properties when used in adults with inherited or genetic NMDs. The aim is to help clinicians and researchers choose the most appropriate test for their objective.

EVIDENCE ACQUISITION

A systematic review was conducted after consulting MEDLINE (via PubMed), EMBASE, Science direct, Google Scholar and Cochrane Central Register of Controlled Trials databases for published studies in which walking outcome measurement properties were assessed. The validity, reliability, measurement error and responsiveness properties were evaluated in terms of statistical methods and methodological design qualities using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines.

EVIDENCE SYNTHESIS

We included 46 studies in NMDs. These studies included 15 different walking tests and a wide variety of walking outcomes, assessed with six types of walking tools. Overall, the 6MWT was the most studied test in terms of measurement properties. The methodological design and statistical methods of most studies evaluating construct validity, reliability and measurement error were "very good." The majority of outcome measurements were valid and reliable. However, studies on responsiveness as minimal important difference or minimal important change were lacking or were found to have inadequate methodological and statistical methods according to the COSMIN guidelines.

CONCLUSIONS

Most walking outcomes were found to be valid and reliable in NMDs. However, in view of the growing number of clinical trials, further studies are needed to clarify additional measurement properties.

Multidisciplinary team meetings in treatment of spinal muscular atrophy adult patients: a real-life observatory for innovative treatments

BACKGROUND

In 2017, a new treatment by nusinersen, an antisense oligonucleotide delivered by repeated intrathecal injections, became available for patients with spinal muscular atrophy (SMA), whereas clinical trials had mainly involved children. Since 2020, the oral, selective SMN2-splicing modifier risdiplam has been available with restrictions evolving with time. In this peculiar context of lack of data regarding adult patients, many questions were raised to define the indications of treatment and the appropriate follow-up in this population. To homogenize access to treatment in France, a national multidisciplinary team meeting dedicated to adult SMA patients, named SMA multidisciplinary team meeting, (SMDTs) was created in 2018. Our objective was to analyze the value of SMDTs in the decision-making process in SMA adult patients and to provide guidelines about treatment.

METHODS

From October 2020 to September 2021, data extracted from the SMDT reports were collected. The primary outcome was the percentage of cases in which recommendations on validating treatment plans were given. The secondary outcomes were type of treatment requested, description of expectations regarding treatment and description of recommendations or follow-up and discontinuation. Data were analyzed using descriptive statistics. Comparisons between the type of treatment requested were performed using Mann-Whitney test or the Student t test for quantitative data and the Fisher's exact test or the χ2 test for qualitative data.

RESULTS

Cases of 107 patients were discussed at the SMDTs with a mean age of 35.3 (16-62). Forty-seven were SMA type 2, and 57 SMA type 3. Twelve cases were presented twice. Out of 122 presentations to the SMDTs, most of requests related to the initiation of a treatment (nusinersen (n = 46), risdiplam (n = 54), treatment without mentioning preferred choice (n = 5)) or a switch of treatment (n = 12). Risdiplam requests concerned significantly older patients (p = 0.002), mostly SMA type 2 (p < 0.0001), with greater disease severity in terms of motor and respiratory function compared to requests for nusinersen. In the year prior to presentation to the SMDTs, most of the patients experienced worsening of motor weakness assessed by functional tests as MFM32 or other meaningful scales for the most severe patients. Only 12% of the patients discussed had a stable condition. Only 49/122 patients (40.1%) expressed clear expectations regarding treatment. The treatment requested was approved by the SMDTs in 72 patients (67.2%). The most common reasons to decline treatment were lack of objective data on the disease course prior discussion to the SMDTs or inappropriate patient's expectations. Treatment requests were more likely to be validated by the SMDTs if sufficient pre-therapeutic functional assessment had been performed to assess the natural history (55% vs. 32%) and if the patient had worsening rather than stable motor function (p = 0.029). In patients with approved treatment, a-priori criteria to define a further ineffectiveness of treatment (usually after 14 months of treatment) were proposed for 67/72 patients.

CONCLUSIONS

In the context of costly treatments with few controlled studies in adults with SMA, in whom assessment of efficacy can be complex, SMDTs are 'real-world observatories' of great interest to establish national recommendations about indications of treatment and follow-up.

LAMA2-Related Muscular Dystrophy Across the Life Span: A Cross-sectional Study

Background and Objectives

LAMA2-related muscular dystrophy (LAMA2-MD) is a rare neuromuscular disease characterized by proximal and axial muscle weakness, rigidity of the spine, scoliosis, and respiratory impairment. No curative treatment options exist, yet promising preclinical studies are ongoing. Currently, there is a paucity on natural history data, and appropriate clinical and functional outcome measures are needed. We aim for deep clinical phenotyping, establishment of a well-characterized baseline cohort for prospective follow-up and recruitment for future clinical trials, improvement of clinical care, and selection of outcome measures for reaching trial readiness.

Methods

We performed a cross-sectional, single-center, observational study. This study included neurologic examination and functional measurements among others the Motor Function Measure 20/32 (MFM-20/32) as primary outcome measure, accelerometry, questionnaires, muscle ultrasound, respiratory function tests, electrocardiography and echocardiography, and dual-energy X-ray absorptiometry.

Results

Twenty-seven patients with genetically confirmed LAMA2-MD were included (21 ± 13 years; M = 9; ambulant = 7). Axial and proximal muscle weakness was most pronounced. The mean MFM-20/32 score was 42.0% ± 29.4%, with domain 1 (standing and transfers) being severely affected and domain 3 (distal muscle function) relatively spared. Physical activity as measured through accelerometry showed very strong correlations to MFM-20/32 (Pearson correlation, -0.928, p < 0.01). Muscle ultrasound showed symmetrically increased echogenicity, with the sternocleidomastoid muscle most affected. Respiratory function was impaired in 85% of patients without prominent diaphragm dysfunction and was independent of age. Ten patients (37%) needed (non)invasive ventilatory support. Cardiac assessment revealed QRS fragmentation in 62%, abnormal left ventricular global longitudinal strain in 25%, and decreased left ventricular ejection fraction in 14% of patients. Decreased bone quality leading to fragility fractures was seen in most of the patients.

Discussion

LAMA2-MD has a widely variable phenotype. Based on the results of this cross-sectional study and current standards of care for congenital muscular dystrophies, we advise routine cardiorespiratory follow-up and optimization of bone quality. We propose MFM-20/32, accelerometry, and muscle ultrasound for assessing disease severity and progression. For definitive clinical recommendations and outcome measures, natural history data are needed.

Clinical Trials Registration

This study was registered at clinicaltrials.gov (NCT04478981, 21 July 2020). The first patient was enrolled in September 2020.

The use of digital outcome measures in clinical trials in rare neurological diseases: a systematic literature review

Developing drugs for rare diseases is challenging, and the precision and objectivity of outcome measures is critical to this process. In recent years, a number of technologies have increasingly been used for remote monitoring of patient health. We report a systematic literature review that aims to summarize the current state of progress with regard to the use of digital outcome measures for real-life motor function assessment of patients with rare neurological diseases. Our search of published literature identified 3826 records, of which 139 were included across 27 different diseases. This review shows that use of digital outcome measures for motor function outside a clinical setting is feasible and employed in a broad range of diseases, although we found few outcome measures that have been robustly validated and adopted as endpoints in clinical trials. Future research should focus on validation of devices, variables, and algorithms to allow for regulatory qualification and widespread adoption.

SELENON-Related Myopathy Across the Life Span, a Cross-Sectional Study for Preparing Trial Readiness

BACKGROUND

SELENON(SEPN1)-related myopathy (SELENON-RM) is a rare congenital neuromuscular disease characterized by proximal and axial muscle weakness, spinal rigidity, scoliosis and respiratory impairment. No curative treatment options exist, but promising preclinical studies are ongoing. Currently, natural history data are lacking, while selection of appropriate clinical and functional outcome measures is needed to reach trial readiness.

OBJECTIVE

We aim to identify all Dutch and Dutch-speaking Belgian SELENON-RM patients, deep clinical phenotyping, trial readiness and optimization of clinical care.

METHODS

This cross-sectional, single-center, observational study comprised neurological examination, functional measurements including Motor Function Measurement 20/32 (MFM-20/32) and accelerometry, questionnaires, muscle ultrasound, respiratory function tests, electro- and echocardiography, and dual-energy X-ray absorptiometry.

RESULTS

Eleven patients with genetically confirmed SELENON-RM were included (20±13 (3-42) years, 73% male). Axial and proximal muscle weakness were most pronounced. The mean MFM-20/32 score was 71.2±15.1%, with domain 1 (standing and transfers) being most severely affected. Accelerometry showed a strong correlation with MFM-20/32. Questionnaires revealed impaired quality of life, pain and problematic fatigue. Muscle ultrasound showed symmetrically increased echogenicity in all muscles. Respiratory function, and particularly diaphragm function, was impaired in all patients, irrespective of the age. Cardiac assessment showed normal left ventricular systolic function in all patients but abnormal left ventricular global longitudinal strain in 43% of patients and QRS fragmentation in 80%. Further, 80% of patients showed decreased bone mineral density on dual-energy X-ray absorptiometry scan and 55% of patients retrospectively experienced fragility long bone fractures.

CONCLUSIONS

We recommend cardiorespiratory follow-up as a part of routine clinical care in all patients. Furthermore, we advise vitamin D supplementation and optimization of calcium intake to improve bone quality. We recommend management interventions to reduce pain and fatigue. For future clinical trials, we propose MFM-20/32, accelerometry and muscle ultrasound to capture disease severity and possibly disease progression.

"Technology Proficiency" in Medical Education: Worthiness for Worldwide Wonderful Competency and Sophistication

PURPOSE

Advances in bioinformatics, information technology, advanced computing, imaging techniques are changing fundamentally the way physicians define, diagnose, treat, and prevent disease. New disciplines - Artificial Intelligence, Machine Learning, Computational Biology - are improving healthcare. Digital health solutions have immense scope. Education and practice need to keep pace.

METHODS

We aimed at assessment of "Technology proficiency" required by medical graduates and its implementation, if found useful. All this in a conceptual framework of "TP" model, having categories (a) proper assessment (b) pertinent treatment (c) progress monitoring (d) prevention applications (e) professional standards. A search of the literature was performed using MedLine & Cochrane Central Register of Controlled Trials databases, for systematic reviews and meta-analysis articles published in the last five years using keyword "technology". Analysis of those relevant to the role all medical graduates should play. An analysis of worldwide statutory medical institutions guidelines.

RESULTS

Twenty-three systematic studies and meta-analysis were studied. Eighteen show clear evidence for 'Technology proficiency", while 5 recommend further studies. The findings are discussed suiting the roles of doctors in the "TP" model. Medical institutions guidelines worldwide diligence suggests need of including "Technology proficiency" as a definite and distinct strategic plan. Medical Council of India mandates "use information technology for appropriate patient care and continued learning". General Medical Council, UK and Medical Council India have been proactive in technology training. GMC recommends technology use for learning, prescribing, communication, and interpersonal skills. It should be expanding technology proficiency in practice as an essential professional capability.

CONCLUSION

"Technology proficiency" is found pertinently fruitful. It should be included as a definitive requirement and a distinct strategic plan worldwide. Modern curriculum development is proposed (i) Educational goals and objectives as the proposed Conceptual framework "Technology proficiency" model (ii) Instructional strategies 'Five Bs' (iii) Implementation 'Five Ms'.