Rasch analysis of clinical outcome measures in spinal muscular atrophy

Assessing disease progression in spinal muscular atrophy, current gaps, and opportunities: a narrative review

Spinal Muscular Atrophy is a genetic disorder causing muscle atrophy and progressive weakness. People living with the condition can have a significant heterogenous phenotype ranging from arrest of motor development to mild impairment. Assessing disease severity has been done using a range of outcome measures that can be classified by body structure or function, by activities or by participation. Functional outocome measures can be generic measures, used to compare individuals or populations against general norms, or disease-specific measures designed to fit disease characteristics. Outcome measures assessing participation are primarily used to capture patients' perceptions of health-related quality of life, daily activity abilities, caregiver burden, and the impact of physical symptoms like fatigue or pain. When assessing disease progression, often the focus on functional abilities has served as an overall indicator of change. With the appearance of disease modifying therapies and the need to evaluate the impact that they had in the course of the disease, new requirements for the existing assessments measure had appeared. The current available toolkit is able to capture a significant spectrum of both, natural history and effect of new treatments but the increased survival, changes in fatigue, bulbar function and others will benefit from further assessment.

Concomitant telomere attrition is associated with spinal muscular atrophy in highly inbred region of North India: unraveling the thread in Kashmir region

Spinal muscular atrophy (SMA) is a rare genetic disorder that unequivocally results in the degeneration of motor neurons, leading to muscle weakness and atrophy. This condition is caused by a mutation in the survival motor neuron 1 (SMN1) gene, which inevitably results in a deficiency of the SMN protein. In present study, we investigated the potential role of telomere attrition in SMA patients. Relative telomere length in peripheral blood lymphocytes was measured by Monochrome Multiplex Quantitative Polymerase Chain Reaction (MMQPCR) in 98 subjects and we conclusively found that SMA cases exhibit telomere attrition compared to healthy controls (P = 4 × 10- 2). Moreover, significant attrition was also observed in severe form of SMA, i.e. SMA type 0 (P = 0.04) as well.Although, the exact mechanism through which telomere shortening contributes to the pathogenesis of SMA is not fully understood and is yet to be delineated. However, one possibility is that telomere shortening leads to genomic instability and DNA damage, which can contribute to motor neuron degeneration. Another possibility is that telomere shortening leads to cellular senescence, which can impair the ability of motor neurons to regenerate and repair themselves. Recent studies have suggested that telomere shortening may be a potential therapeutic target in SMA. Thus, understanding the role of SMN1 gene in disease pathogenesis & its effect on telomere length will aid in estimating the risk & prognosis of SMA in genetically less explored & highly inbred region of Kashmir, Northern India.

Validation of Neuromyotype: a smart keyboard for the evaluation of spinal muscular atrophy patients

INTRODUCTION

Spinal muscular atrophy 5q (SMA) is a genetic neurodegenerative disease that affects alpha motor neurons producing progressive weakness. New outcome measures are currently required to accurately characterise the disease progression and the efficacy of new available treatments. The objective of this work is to preliminarily validate a new intelligent keyboard (Neuromyotype) measuring typing strength and speed in patients with SMA.

MATERIAL AND METHODS

Twenty two SMA patients older than 15 years, and 26 healthy controls were included. Three measurements were obtained with the keyboard (maximum strength, execution time of a random typing task, execution time of a sequential typing task) together with the time to complete the Nine-Hole Peg Test (9HPT). Patients were also administered motor (Hammersmith Functional Motor Scale Expanded, HFMSE; Revised Upper Limb module, RULM), and functional scales (Egen Klassification, EK2; and the revised version of Amyotrophic Lateral Sclerosis Functional Rating Scale, ALSFRS-R). The viability and construct validity of the Neuromyotype were analysed, measuring the discriminative power between patients and controls (using ROC curves and the Bangdiwala's B statistic), between the different functional types of SMA (walker, sitter and non-sitter) and their correlation with the rest of motor scales.

RESULTS

Neuromyotype measurements could be performed in all patients, unlike the rest of the scales. Its administration was quick and easy. The 3 variables on the keyboard discriminated very well between patients and controls, with strength (ROC = 0.963) being the one that best differentiates from the 3, equaling 9HPT (ROC = 0.966). They also showed a good ability to differentiate by functional type (especially non-sitters from sitters and walkers), with sequential time (B = 0.83) being the tool that best discriminates between the three groups above the rest of motor scales. All motor and functional scales showed strong or very strong correlations with each other (rs = 0.71-0.99), with strength correlating better with motor scales and timed variables with functional scales.

CONCLUSION

This study shows the feasibility and validity of Neuromyotype for the evaluation of adolescent and adult patients with SMA. Data obtained with this tool could be of great clinical relevance, saving time and resources compared to the rest of the scales.

Taldefgrobep Alfa and the Phase 3 RESILIENT Trial in Spinal Muscular Atrophy

Spinal muscular atrophy (SMA) is a rare, genetic neurodegenerative disorder caused by insufficient production of survival motor neuron (SMN) protein. Diminished SMN protein levels lead to motor neuron loss, causing muscle atrophy and weakness that impairs daily functioning and reduces quality of life. SMN upregulators offer clinical improvements and increased survival in SMA patients, although significant unmet needs remain. Myostatin, a TGF-β superfamily signaling molecule that binds to the activin II receptor, negatively regulates muscle growth; myostatin inhibition is a promising therapeutic strategy for enhancing muscle. Combining myostatin inhibition with SMN upregulation, a comprehensive therapeutic strategy targeting the whole motor unit, offers promise in SMA. Taldefgrobep alfa is a novel, fully human recombinant protein that selectively binds to myostatin and competitively inhibits other ligands that signal through the activin II receptor. Given a robust scientific and clinical rationale and the favorable safety profile of taldefgrobep in patients with neuromuscular disease, the RESILIENT phase 3, randomized, placebo-controlled trial is investigating taldefgrobep as an adjunct to SMN upregulators in SMA (NCT05337553). This manuscript reviews the role of myostatin in muscle, explores the preclinical and clinical development of taldefgrobep and introduces the phase 3 RESILIENT trial of taldefgrobep in SMA.

Exploring functional strength changes during nusinersen treatment in symptomatic children with SMA types 2 and 3

The Hammersmith Functional Motor Scale-Expanded (HFMSE) is a validated outcome measure for monitoring changes in functional strength in patients with spinal muscular atrophy (SMA). The objective of this study was to explore changes in HFMSE item-scores in children with SMA types 2 and 3a treated with nusinersen over a period of six to twenty months. We stratified patients according to motor ability (sitting and walking), and calculated numbers and percentages for each specific improvement (positive score change) or decrease (negative score change) for the total group and each subgroup and calculated frequency distributions of specific score changes. Ninety-one percent of the children showed improvement in at least 1 item, twenty-eight percent showed a score decrease in 1 or more items. In the first six to twenty months of nusinersen treatment motor function change was characterized by the acquisition of the ability to perform specific tasks with compensation strategies (score changes from 0 to 1). Children with the ability to sit were most likely to improve in items that assess rolling, whilst children with the ability to walk most likely improved in items that assess half-kneeling. The ability most frequently lost was hip flexion in supine position.

Criterion validity of the spatial exploration test of upper limb mobility to evaluate the active horizontal workspace of children with spinal muscular atrophy

PURPOSE

To determine the criterion validity of the SET-ULM (Spatial Exploration Test of Upper Limb Mobility), a functional workspace test.

MATERIALS AND METHODS

A prospective study from July 2017 to November 2018 in 30 children with SMA type 1 or 2. All children underwent assessment with the SET-ULM and the Motor Function Measure (MFM).

RESULTS

We included 30 children. Median (Q1; Q3) MFM D1 (standing ability, ambulation and transfers), D2 (axial and proximal motor function), D3 (distal motor function) scores, Total MFM and Total SET-ULM active score were respectively 2.6% (2.6-3.8); 45.8% (19.9-65.3); 57.7% (36.9-80.9); 35.4% (16.7-43.2) and 70.2% (49.7-97.9). Total SET-ULM active score was strongly correlated with the MFM D2 dimension score (rho 0.82; p < 001), with the D3 dimension (rho 0.86; p < 0.001) and with the Total MFM score (rho 0.89; p < 0.005). Total SET-ULM active score differed between SMA types (p < 0.01).

CONCLUSION

The SET-ULM has good criterion validity for the evaluation of available horizontal active upper limb workspace in children with SMA1 and SMA2. Future studies should evaluate reliability and sensitivity to change during a longitudinal follow-up study, as well as in a longitudinal trial of therapeutic effectiveness.

CLINICAL TRIALS

NCT03223051IMPLICATIONS FOR REHABILITATIONThe Spatial Exploration Test for Upper Limb Mobility is a useful adjunct to the Motor Function Measure.It provides a precise evaluation of horizontal reaching ability.The Spatial Exploration Test for Upper Limb Mobility will be of great clinical utility for the evaluation of the effects of treatments for spinal muscular atrophy.

Design and Validation of a Clinical Outcome Measure for Adolescents and Adult Patients with Spinal Muscular Atrophy: SMA Life Study Protocol

INTRODUCTION

The objective of this study is to develop a clinical tool for the evaluation and follow-up of adolescent and adult patients with 5q spinal muscular atrophy (SMA) and to design its validation.

METHODS

This prospective, non-interventional study will be carried out at five centres in Spain and will include patients aged 16 years or older with a confirmed diagnosis of 5q SMA (biallelic mutation of the survival motor neuron 1 [SMN1] gene). A panel of experts made up of neurologists, physiatrists and Spanish patients' association (FundAME), participated in the design of the clinical tool. Physicians will administer the tool at three time points (baseline, 12 months and 24 months). Additionally, data from other questionnaires and scales will be collected. Once recruitment is achieved, an interim statistical analysis will be performed to assess its psychometric properties by applying Rasch analysis and classical statistical tests.

RESULTS

The tool will consist of up to 53 items to assess functional status from a clinical perspective in seven key dimensions (bulbar, respiratory, axial, lower, upper, fatigability and other symptoms), which will be collected together with objective clinical measures (body mass index, forced vital capacity, pinch strength and 6-minute walk test).

CONCLUSIONS

The validation of this tool will facilitate the clinical evaluation of adult and adolescent patients with SMA and the quantification of their response to new treatments in both clinical practice and research.

Disease Trajectories in the Revised Hammersmith Scale in a Cohort of Untreated Patients with Spinal Muscular Atrophy types 2 and 3

Background

Spinal muscular atrophy (SMA) is a neuromuscular disorder characterised by progressive motor function decline. Motor function is assessed using several functional outcome measures including the Revised Hammersmith Scale (RHS).

Objective

In this study, we present longitudinal trajectories for the RHS in an international cohort of 149 untreated paediatric SMA 2 and 3 patients (across 531 assessments collected between March 2015 and July 2019).

Methods

We contextualise these trajectories using both the Hammersmith Functional Motor Scale Expanded (HFMSE) and Revised Upper Limb Module (RULM). At baseline, this cohort included 50% females and 15% of patients had undergone spinal fusion surgery. Patient trajectories were modelled using a natural cubic spline with age, sex, and random effects for each patient.

Results

RHS and HFMSE scores show similar trends over time in this cohort not receiving disease modifying therapies. The results confirm the strong correlation between the RHS and RULM previously observed in SMA types 2 and 3a. Scoliosis surgery is associated with a reduction of 3 points in the RHS, 4.5 points in the HFMSE for the SMA 2 population, and a reduction of 11.8 points in the RHS, and 13.4 points in the HFMSE for the SMA 3a populations. When comparing the RHS and RULM, there is a lower correlation in the type 3a's than the type 2 patients. In the SMA 2 population, there is no significant difference between the sexes in either the RHS or HFMSE trajectories. There is no significant difference in the RULM trajectory in the SMA 2 or 3a participants by sex.

Conclusions

This study demonstrates that the RHS could be used in conjunction with other functional measures such as the RULM to holistically detect SMA disease progression. This will assist with fully understanding changes that occur with treatments, further defining trajectories and therapy outcomes.

Smartphone-Based Assessment of Mobility and Manual Dexterity in Adult People with Spinal Muscular Atrophy

Background

More responsive, reliable, and clinically valid endpoints of disability are essential to reduce size, duration, and burden of clinical trials in adult persons with spinal muscular atrophy (aPwSMA).

Objective

The aim is to investigate the feasibility of smartphone-based assessments in aPwSMA and provide evidence on the reliability and construct validity of sensor-derived measures (SDMs) of mobility and manual dexterity collected remotely in aPwSMA.

Methods

Data were collected from 59 aPwSMA (23 walkers, 20 sitters and 16 non-sitters) and 30 age-matched healthy controls (HC). SDMs were extracted from five smartphone-based tests capturing mobility and manual dexterity, which were administered in-clinic and remotely in daily life for four weeks. Reliability (Intraclass Correlation Coefficients, ICC) and construct validity (ability to discriminate between HC and aPwSMA and correlations with Revised Upper Limb Module, RULM and Hammersmith Functional Scale - Expanded HFMSE) were quantified for all SDMs.

Results

The smartphone-based assessments proved feasible, with 92.1% average adherence in aPwSMA. The SDMs allowed to reliably assess both mobility and dexterity (ICC > 0.75 for 14/22 SDMs). Twenty-one out of 22 SDMs significantly discriminated between HC and aPwSMA. The highest correlations with the RULM were observed for SDMs from the manual dexterity tests in both non-sitters (Typing, ρ= 0.78) and sitters (Pinching, ρ= 0.75). In walkers, the highest correlation was between mobility tests and HFMSE (5 U-Turns, ρ= 0.79).

Conclusions

This exploratory study provides preliminary evidence for the usability of smartphone-based assessments of mobility and manual dexterity in aPwSMA when deployed remotely in participants' daily life. Reliability and construct validity of SDMs remotely collected in real-life was demonstrated, which is a pre-requisite for their use in longitudinal trials. Additionally, three novel smartphone-based performance outcome assessments were successfully established for aPwSMA. Upon further validation of responsiveness to interventions, this technology holds potential to increase the efficiency of clinical trials in aPwSMA.

Assessing the Measurement Properties of the Self-Administered Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R): A Rasch Analysis

OBJECTIVE

The self-administered version of the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is used to monitor function and disease progression in individuals with amyotrophic lateral sclerosis (ALS). However, the performance of the self-administered ALSFRS-R has not been assessed using Rasch Measurement Theory. Therefore, the purpose of this study was to examine the psychometric properties of the self-administered ALSFRS-R using Rasch analysis.

METHODS

Rasch analysis was performed on self-administered ALSFRS-R data from individuals with ALS across Canada. The following 6 aspects of Rasch analysis were examined using RUMM2030: fit via residuals and chi-square statistics, targeting via person-item threshold maps, dependency via item residual correlations, unidimensionality through principal components analysis of residuals, reliability via person separation index, and stability through differential item functioning analyses for sex, age, and language.

RESULTS

Analysis was performed on 122 participants (mean age: 52.9 years; 62.8% men). The overall scale demonstrated good fit, reliability, and stability; however, multidimensionality was found. To address this issue, items were divided into 3 subscales (bulbar, motor, and respiratory function), and Rasch analysis was performed for each subscale. The subscales demonstrated good fit, reliability, stability, and unidimensionality. However, there were still issues with item dependency for all subscale and targeting for bulbar and respiratory subscales.

CONCLUSIONS

The self-administered ALSFRS-R is reliable, internally valid, and stable across sex, age, and language subgroups; however, it is recommended that the ALSFRS-R be scored by subscale. Future studies can look at revising and/or adding items to tackle misfit, redundancy, and ceiling effects.

IMPACT

Self-administered measures are simple to administer and inexpensive. The self-administered ALSFRS-R was found to be psychometrically sound and can be used as a tool to monitor disease progression and function in ALS.

Digital measures of respiratory and upper limb function in spinal muscular atrophy: design, feasibility, reliability, and preliminary validity of a smartphone sensor-based assessment suite

Spinal muscular atrophy (SMA) is characterized by progressive muscle weakness and paralysis. Motor function is monitored in the clinical setting using assessments including the 32-item Motor Function Measure (MFM-32), but changes in disease severity between clinical visits may be missed. Digital health technologies may assist evaluation of disease severity by bridging gaps between clinical visits. We developed a smartphone sensor-based assessment suite, comprising nine tasks, to assess motor and muscle function in people with SMA. We used data from the risdiplam phase 2 JEWELFISH trial to assess the test-retest reliability and convergent validity of each task. In the first 6 weeks, 116 eligible participants completed assessments on a median of 6.3 days per week. Eight of the nine tasks demonstrated good or excellent test-retest reliability (intraclass correlation coefficients >0.75 and >0.9, respectively). Seven tasks showed a significant association (P < 0.05) with related clinical measures of motor function (individual items from the MFM-32 or Revised Upper Limb Module scales) and seven showed significant association (P < 0.05) with disease severity measured using the MFM-32 total score. This cross-sectional study supports the feasibility, reliability, and validity of using smartphone-based digital assessments to measure function in people living with SMA.

Psychometric evaluation of modified spinal muscular atrophy functional rating scale (SMAFRS) in adult patients using Rasch analysis

INTRODUCTION/AIMS

The Spinal Muscular Atrophy Functional Rating Scale (SMAFRS) was first developed as a secondary functional outcome measure to detect changes over time in patients with spinal muscular atrophy (SMA) in clinical trials. Its modified version evaluates 10 activities of daily living. The aim of the study was to analyze modified SMAFRS data using item response theory psychometric models.

METHODS

A total of 253 responses from 41 adult patients with ambulatory and non-ambulatory SMA types 2, 3, and 4 were analyzed. Rasch analysis was used to explore item-person targeting, fit statistics, category response functioning, dimensionality, and differential item functioning.

RESULTS

Most items had good fitting with the exception of "toileting" and "respiratory." There were no major floor or ceiling effects, and most items covered a good range of disability with only a negligible breech of uni-dimensionality from eating, dressing, and respiratory items. Differential item function highlighted differences in toileting, turning, transferring, walking, and respiratory items between ambulatory and non-ambulatory populations.

DISCUSSION

Despite subtle misfitting of certain items, mainly related to respiratory and bulbar function, overall modified SMAFRS remained a psychometrically stable and unidimensional outcome measure. There were some differences in measuring properties of certain functional items between ambulatory and non-ambulatory items that need to be taken into consideration in clinical trial design. Overall, the modified SMAFRS is a psychometrically reliable tool in assessment of adult patients with SMA.

A Mixed-method Approach to Develop an Ambulatory Module of the SMA Independence Scale

BACKGROUND

Limited qualitative data exist on the symptoms and impacts of spinal muscular atrophy (SMA) experienced by ambulant individuals. An ambulant module of the SMA Independence Scale (SMAIS) was developed to quantify the assistance required to perform everyday mobility-related activities.

OBJECTIVE

The objective of this study was to develop a patient-centered module that provides key insights into what constitutes independence for ambulant and near-ambulant individuals with SMA.

METHODS

A stepwise, mixed-method approach was used. Semi-structured interviews were conducted in three waves with individuals with SMA and caregivers of children with SMA who were ambulant or near-ambulant (can walk ≥5 steps with support). Wave 1 interviews (n = 20) focused on concept elicitation. Wave 2 and 3 interviews (n = 15, both) involved completion and cognitive debriefing of items generated based on Wave 1 interviews. Therapeutic area experts were consulted throughout all key steps of the study. In particular, feedback was provided for item refinement and response option decisions. A macro-level preliminary, exploratory analysis, using Rasch Measurement Theory (RMT), provided insight on measurement properties.

RESULTS

Wave 1 resulted in 42 mobility and 11 instrumental activity of daily living (iADL) items. During Wave 2, participants defined independence as completing a task with supportive aids but without help from another person, leading to item refinement and modifications to the response scale. Lack of conceptual relevance and ceiling effects led to the removal of all iADL items after Wave 2, and 41 mobility items were tested in Wave 3. Final exploratory RMT and item refinement to reduce overlap led to a 27-item set related to mobility tasks.

CONCLUSIONS

Our study provides preliminary support for using the 27-item SMAIS-Ambulatory Module for ambulant or near-ambulant individuals with SMA. Larger-scale analyses to further assess the psychometric properties of the scale are warranted.

Revised Hammersmith Scale for spinal muscular atrophy: Inter and intra-rater reliability and agreement

The Revised Hammersmith Scale (RHS) for Spinal Muscular Atrophy (SMA) was designed as a psychometrically robust clinical outcome assessment to assess physical abilities of patients with type 2 and 3 SMA. The reliability properties of the RHS have not yet been reported. A prospective RHS reliability study was undertaken in a UK cohort of experienced neuromuscular paediatric Physiotherapists. Reliability testing was conducted via a virtual survey platform two weeks apart. Through the virtual platform participants scored videos of two RHS assessments, one of a child with SMA 2 and one of a child with SMA 3. Inter and intra-rater reliability was analysed using a type 3 Intraclass Correlation Coefficient (ICC). Intra-rater agreement was further analysed using Bland Altman (BA) Limits of Agreement (LOA) and plots. The acceptable inter and intra-rater variability was set as a change of ± 2 by the international team of expert physiotherapists who developed the RHS. Inter-rater agreement, n = 22 raters, type 3 ICC was 0.989 (95% CI 0.944 to 1.00), 97.7% of scores were within the acceptable limits of ± 2 points. Intra-rater agreement, n = 21 raters, type 3 ICC ranged from 0.922 to 1.0, with 97.6% of scores within the acceptable limits of ± 2 points. The mean SMA 2 intra-rater difference was -0.10 (-0.6 to 0.4), with lower LOA -2.24 and upper LOA +2.04. Intra-rater difference between tests for SMA 3 intra-rater difference was -0.05 (-0.6 to 0.5), with lower LOA -2.48 and upper LOA +2.38. Intra-rater scoring precision fell within BA agreement limits of ±2 points. The results demonstrate that the RHS is highly reliable when used by experienced UK physiotherapists, and variability of test scores regarding inter and intra-rater reliability was confirmed to lie within ±2 points.

Validation of motor and functional scales for the evaluation of adult patients with 5q spinal muscular atrophy

BACKGROUND AND PURPOSE

Mos scales currently used to evaluate spinal muscular atrophy (SMA) patients have only been validated in children. The aim of this study was to assess the construct validity and responsiveness of several outcome measures in adult SMA patients.

METHODS

Patients older than 15 years and followed up in five referral centres for at least 6 months, between October 2015 and August 2020, with a motor function scale score (Hammersmith Functional Motor Scale Expanded [HFMSE], Revised Upper Limb module [RULM]) were included. Bedside functional scales (Egen Klassification [EK2], Revised Amyotrophic Lateral Sclerosis Functional Rating Scale [ALSFRS-R]) were also collected when available. Spearman's rho correlations (rs) and Bangdiwala's concordance test (B) were used to evaluate the scales' construct validity. Monthly slopes of change were used to calculate their responsiveness of the scales.

RESULTS

The study included 79 SMA patients, followed up for a mean of 16 months. All scales showed strong correlations with each other (rs &gt; 0.70). A floor effect in motor function scales was found in the weakest patients (HFMSE &lt; 5 and RULM &lt; 10), and a ceiling effect was found in stronger patients (HFMSE &gt; 60 and RULM &gt; 35). The ALSFRS-R (B = 0.72) showed a strong ability to discriminate between walkers, sitters and non-sitters, and the HFMSE (B = 0.86) between walkers and sitters. The responsiveness was low overall, although in treated patients a moderate responsiveness was found for the ALSFRS-R and HFMSE in walkers (0.69 and 0.61, respectively) and for EK2 in sitters (0.65) and non-sitters (0.60).

CONCLUSIONS

This study shows the validity and limitations of the scales most frequently used to assess adult SMA patients. Overall, bedside functional scales showed some advantages over motor scales, although all showed limited responsiveness.

Rasch Measurement Theory's contribution to the psychometric properties of a co-created measure of health and wellness for Indigenous children and youth

OBJECTIVES

To determine how Rasch Measurement Theory (RMT) methods can be used to assess the psychometric properties of the Aaniish Naa Gegii: the Children's Health and Wellbeing Measure (ACHWM) and Qanuippit.

STUDY DESIGN AND SETTING

Indigenous children aged 8-18 years, from five communities, completed the 62-item ACHWM. We applied RMT methods to ACHWM data from 401 children (mean age 13.4 ± 3.4 years; 51% male) from across Ontario to examine how well the items captured the full range (±3 logit) of the concept of interest in each domain, targeted the needs of Indigenous children, and met the criteria for unidimensional and invariant measurement.

RESULTS

RMT results indicated moderate-fit overall fit (raw χ² = 809, P < 0.001). This model was further improved by aggregating the five response categories into three categories. All four domains showed excellent overall fit to the Rasch model (P > 0.05), with items covering between -4.51 and 6.02 logit, with no gaps along the theoretical continua.

CONCLUSION

This study provides evidence that a set of conceptually derived items was able to produce a measure that fits the Rasch model. These results aid our understanding of wellness by establishing the clinical meaning of the scale scores.

Systematic Review of Motor Function Scales and Patient-Reported Outcomes in Spinal Muscular Atrophy

ABSTRACT

Spinal muscular atrophy is a heterogeneous disease that results in loss of motor function. In an evolving treatment landscape, establishing the suitability and limitations of existing motor function scales and patient-reported outcomes used to monitor patients with this disease is important. A systematic review was conducted to examine utility of motor function scales and patient-reported outcomes in evaluating patients with spinal muscular atrophy. Published literature was reviewed up to June 2021 with no start date restriction. Of the reports screened, 122 were deemed appropriate for inclusion and are discussed in this review (including 24 validation studies for motor function scales or patient-reported outcomes). Fifteen motor function scales and patient-reported outcomes were identified to be commonly used (≥5 studies), of which 11 had available validation assessments. Each instrument has its strengths and limitations. It is imperative that the patient population (e.g., age, mobility), goals of treatment, and outcomes or endpoints of interest be considered when selecting the appropriate motor function scales and patient-reported outcomes for clinical studies.

Systematic Literature Review to Assess Economic Evaluations in Spinal Muscular Atrophy (SMA)

BACKGROUND

Spinal muscular atrophy (SMA) is a rare, progressive neuromuscular disease that affects individuals with a broad age range. SMA is typically characterised by symmetrical muscle weakness but is also associated with cardiac defects, life-limiting impairments in respiratory function and bulbar function defects that affect swallowing and speech. Despite the advent of three innovative disease-modifying therapies (DMTs) for SMA, the cost of DMTs in addition to the costs of standard of care can be a barrier to treatment access for patients. Health Technology Assessment (HTA) decision makers evaluate the cost effectiveness of a new treatment before making a reimbursement decision.

OBJECTIVE

The primary objective was to conduct a systematic literature review (SLR) to identify the modelling approaches used in economic evaluations that assess current approved treatments in SMA, with a secondary objective to widen the scope and identify economic evaluations assessing other (non-SMA) neuromuscular disorders.

METHODS

An SLR was performed to identify available economic evaluations associated with any type of SMA (Type 1, 2, 3 and/or 4). Economic evaluations associated with other (non-SMA) neuromuscular disorders were identified but not further analysed. Electronic searches were conducted in Embase, MEDLINE, Evidence-Based Medicine Reviews and EconLit via the Ovid platform in August 2019, and were supplemented by searches of the grey literature (reference lists, conference proceedings, global HTA body websites and other relevant sources). Eligibility criteria were based on the population, interventions, comparators and outcomes (PICO) framework. Quality assessment of full publications was conducted with reference to a published checklist.

RESULTS

Nine publications covering eight unique studies met all eligibility criteria for inclusion in the SLR, including four conference abstracts, two peer-reviewed original research articles and three HTA submissions (conducted in Canada, the US and the UK). Evaluations considered patients with early infantile-onset (most likely to develop Type 1 or Type 2 SMA), later-onset SMA and both infantile- and later-onset SMA. Data for the identified economic models were collected from literature reviews and relatively short-term clinical trials. Several intent-to-treat clinical trial populations were used in the studies, which resulted in variation in cycle length and different outcome measures to determine clinical efficacy. The results of the quality assessment on the five full-text, peer-reviewed publications found that they generally provided clear descriptions of objectives, modelling methods and results. However, key decisions, such as choice of economic evaluation, model type and choice of variables for sensitivity analysis, were often not adequately justified.

CONCLUSIONS

This SLR highlights the need for economic evaluations in SMA to better align in modelling approaches with respect to (i) consistency in model structure and use of motor function milestones as health states; (ii) consensus on measuring quality of life to estimate utilities; (iii) consistency in data collection by registries; and (iv) consensus on SMA-type classification and endpoints that determine intervention efficacy. Future economic evaluations should also incorporate the review group critiques of previous HTA submissions relating to data inputs and approaches to modelling and should include patient data reflective of the SMA population being modelled. Economic evaluations would also be improved with inclusion of long-term efficacy and safety data from clinical trials and valid patient and caregiver utility data.

A Patient-Centered Evaluation of Meaningful Change on the 32-Item Motor Function Measure in Spinal Muscular Atrophy Using Qualitative and Quantitative Data

The 32-item Motor Function Measure (MFM32) is an assessment of motor function used to evaluate fine and gross motor ability in patients with neuromuscular disorders, including spinal muscular atrophy (SMA). Reliability and validity of the MFM32 have been documented in individuals with SMA. Through semi-structured qualitative interviews (N = 40) and an online survey in eight countries (N = 217) with individuals with Types 2 and 3 SMA aged 2–59 years old and caregivers, the meaning of changes on a patient-friendly version of the MFM32 was explored. In an independent analysis of clinical trial data, anchor- and distribution-based analyses were conducted in a sample of individuals with Type 2 and non-ambulant Type 3 SMA to estimate patient-centered quantitative MFM32 meaningful change thresholds. The results from this study demonstrate that, based on patient and caregiver insights, maintaining functional ability as assessed by a patient-friendly version of the MFM32 is an important outcome. Quantitative analyses using multiple anchors (median age range of 5–8 years old across anchor groups) indicated that an ~3-point improvement in MFM32 total score represents meaningful change at the individual patient level. Overall, the qualitative and quantitative findings from this study support the importance of examining a range of meaningful change thresholds on the MFM32 including ≥0 points change reflecting stabilization or improvement and ≥3 points change reflecting a higher threshold of improvement. Future research is needed to explore quantitative differences in meaningful change on the MFM32 based on age and functional subgroups.

Development of the SMA independence scale-upper limb module (SMAIS-ULM): A novel scale for individuals with Type 2 and non-ambulant Type 3 SMA

BACKGROUND

The amount of assistance required to perform daily activities for individuals with Type 2 and non-ambulant Type 3 spinal muscular atrophy (SMA) is often cited as meaningful for quality of life, and important to routinely assess.

METHODS

The SMA Independence Scale (SMAIS), a patient-reported outcome measure for individuals with SMA aged ≥12 years, and an observer-reported outcome measure for caregivers of individuals aged ≥2 years, was developed and evaluated in two phases. In Phase 1, 30 draft items were developed following review of the literature. Semi-structured interviews were then conducted with individuals with SMA and caregivers to establish content validity, resulting in a 29-item measure. In Phase 2, classical test theory and Rasch measurement theory methods were used to examine the cross-sectional and longitudinal measurement performance of the SMAIS in two independent datasets.

RESULTS

Phase 1 qualitative findings supported the relevance, acceptability, and comprehensibility of 29 items. In Phase 2, psychometric analyses indicated that the five response options were poorly discriminated and were thus collapsed to three options for subsequent analyses. Items showed statistical misfit, implying that the SMAIS was not assessing a single underlying construct. Based on conceptual evaluation of the items, and assessment of item performance, a more targeted 22-item upper limb score was derived. Reliability and validity analyses confirmed acceptable measurement properties of this score.

CONCLUSIONS

Qualitative and quantitative analyses support the use of the 22-item SMAIS-Upper Limb Module in individuals with Type 2 and non-ambulant Type 3 SMA, aged ≥2 years.

Using Rasch Analysis to Validate the Michigan Hand Outcomes Questionnaire from the Wrist and Radius Injury Surgical Trial

BACKGROUND

The Michigan Hand Outcomes Questionnaire is a patient-reported outcome measure that has been validated in many upper extremity disorders using classic test theory. Rasch measurement analysis is a rigorous method of questionnaire validation that offers several advantages over classic test theory and was used to assess the psychometric properties of the Michigan Hand Outcomes Questionnaire. This study used Rasch analysis to evaluate the questionnaire for distal radius fractures in older adults. The incidence and costs of distal radius fractures are rising, and reliable assessment tools are needed to measure outcomes in this growing concern.

METHODS

Rasch analysis was performed using 6-month assessment data from the Wrist and Radius Injury Surgical Trial. Each domain in the Michigan Hand Outcomes Questionnaire was independently analyzed for threshold ordering, person-item targeting, item fit, differential-item functioning, response dependency, unidimensionality, and internal consistency.

RESULTS

After collapsing disordered thresholds and removing any misfitting items from the model, five domains (Function, Activities of Daily Living, Work, Pain, and Satisfaction) demonstrated excellent fit to the Rasch model. The Aesthetics domain demonstrated high reliability and internal consistency but had poor fit to the Rasch model.

CONCLUSIONS

Rasch analysis further supports the reliability and validity of using the Michigan Hand Outcomes Questionnaire to assess hand outcomes in older adults following treatment for distal radius fractures. Results from this study suggest that questionnaire scores should be interpreted in a condition-specific manner, with more emphasis placed on interpreting individual domain scores, rather than the summary Michigan Hand Outcomes Questionnaire score.

Clinical outcome assessments in Duchenne muscular dystrophy and spinal muscular atrophy: past, present and future

Scores and scales used in pediatric motor development for neuromuscular disorders have evolved greatly since the beginning of their development. In this review we provide a brief history of scales used in pediatric patients with neuromuscular disorders and an update regarding the advancement of the scales commonly used in patients with spinal muscular atrophy and Duchenne muscular dystrophy. We focus on the collaborative effort that has led to the development of outcomes and speak to the possible future of Clinical Outcome Assessments.

Measuring Outcomes in Adults with Spinal Muscular Atrophy - Challenges and Future Directions - Meeting Report

Spinal muscular atrophy (SMA) is a progressive autosomal recessive motor neuron disease which affects 1 in 6,000-10,000 live births, caused by loss of the survival motor neuron 1 gene (SMN1). A major focus of therapeutic developments has been on increasing the full-length SMN protein by increasing the inclusion of exon 7 in SMN2 transcripts, enhancing SMN2 gene expression, stabilizing the SMN protein or replacing the SMN1 gene.In June 2017, FDA and EMA have approved the antisense oligonucleotide Nusinersen as the first treatment for all SMA subtypes without age restriction. While prominent treatment effects have been observed in the earlier stages of the disease and in patients up to 15 years of age, there is only limited data from clinical trials in adult SMA patients. First real-world data from neuromuscular clinical centers suggest a therapeutic benefit of nusinersen with a favourable safety profile also in adult SMA patients: in several cases, relevant improvements of motor function is achieved, which might lead to enhanced autonomy in daily life activities and improved quality of life. Systematic follow-up of the motor status with validated instruments is crucial for an adequate monitoring of the therapeutic effects but most of the widely used scales and scores have been developed and evaluated for the pediatric population only. International neuromuscular experts have met in Frankfurt/Main, Germany in May 2019 to discuss relevant aspects of the diagnostic pathway and patient management in adult SMA. The recommendations and challenges in this patient population are discussed.

Spinal Muscular Atrophy: The Use of Functional Motor Scales in the Era of Disease-Modifying Treatment

Spinal muscular atrophy (SMA) is a genetic condition characterized by progressive motoneuron loss. Infants affected by SMA type 1 do not gain developmental milestones and acutely decline, requiring ventilatory support. Several scales are used to assess motor disability and its progression in SMA. Recently, 3 disease-modifying therapies have been approved for SMA patients: nusinersen, an intrathecal antisense oligonucleotide enhancing SMN protein production by the SMN2 gene, risdiplam, also influencing the SMN2 gene to stimulate SMN production but administered orally, and onasemnogene abeparvovec-xioi, an SMN1 gene replacement therapy. Thus, the functional scales should now be applicable for patients improving their motor function over time to assess treatment efficacy. In this paper, we compare different functional scales used in SMA patients. Their usefulness in different SMA types, age groups, and feasibility in daily clinical practice is described below. Some changes in motor function assessments in SMA are also suggested.

Assessment of the validity and reliability of the 32-item Motor Function Measure in individuals with Type 2 or non-ambulant Type 3 spinal muscular atrophy

The 32-item Motor Function Measure (MFM32) is an assessment of motor function, and its measurement properties were established in a broad neuromuscular disease population. This study sought to investigate the reliability, validity, and ability to detect change of MFM32 in individuals with Type 2 and non-ambulant Type 3 spinal muscular atrophy (SMA). Data were used from the Phase 2 study assessing the efficacy and safety of olesoxime. A total of 110 individuals with Type 2 or 3 SMA were included in the analyses. Test-retest reliability (intraclass-correlation coefficient in global impression-defined stable individuals), internal consistency (Cronbach’s alpha), convergent validity (Spearman rank order correlations with other measures), known-groups validity (analysis of covariance comparing Hammersmith Functional Motor Scale -defined groups), and ability to detect change (analysis of covariance comparing global impression-defined groups) were calculated. Strong evidence of test-retest reliability (intraclass-correlation coefficient = 0.93–0.95), internal consistency (Cronbach’s alpha = 0.89), convergent validity (Hammersmith Functional Motor Scale: rho = 0.87; forced vital capacity: rho = 0.61), known-groups validity (all p<0.0001), and ability to detect change (all p<0.001) were demonstrated. These results provide evidence of the MFM32’s measurement properties, supporting its use in longitudinal research in individuals with Type 2 and non-ambulant Type 3 SMA.

Muscle strength and motor function in adolescents and adults with spinal muscular atrophy

OBJECTIVE

To assess longitudinal patterns of muscle strength, motor function, and maximal compound muscle action potential amplitudes (CMAP_MAX) in older patients with spinal muscular atrophy (SMA), hypothesizing a continued decline of motor function parameters throughout life.

METHODS

We measured muscle strength (Medical Research Council), motor function (Hammersmith Functional Motor Scale Expanded [HFMSE] and Motor Function Measure), and CMAP_MAX in treatment-naive patients. We used both longitudinal and cross-sectional data in mixed models to analyze natural history patterns.

RESULTS

We included 250 patients with SMA types 1c through 4. Median patient age at assessment was 26.8 years, the number of assessments per patient ranged from 1 to 6. Baseline muscle strength and motor function scores differed significantly between SMA types, but annual rates of decline were largely similar and mostly linear. HFMSE floor effects were present for all patients with SMA type 1c, and adolescents and adults with types 2 and 3a. CMAP_MAX differed significantly between SMA types but did not decline significantly with increasing age. Muscle strength correlated very strongly with motor function (τ ≥ 0.8) but only moderately with CMAP_MAX (τ ≈ 0.5-0.6).

CONCLUSION

Muscle strength and motor function decline in older patients with SMA are constant without periods of slower progression or a plateau phase. The floor effects of the HFMSE preclude its use for long-term follow-up of adult patients with SMA types 1c through 3a. Muscle strength sum scores represent an alternative, feasible outcome measure for adolescent and adult patients with SMA.

ACTIVE (Ability Captured Through Interactive Video Evaluation) workspace volume video game to quantify meaningful change in spinal muscular atrophy

AIM

To evaluate the utility of Ability Captured Through Interactive Video Evaluation (ACTIVE) scaled scores to quantify meaningful change in individuals with spinal muscular atrophy (SMA) types 2 or 3 due to disease progression or treatment.

METHOD

ACTIVE is a custom-designed video game that measures workspace volume (WSV). Participants included 62 individuals with SMA (mean age [SD] 10y 9mo [5y], range 2y 9mo-24y) and 362 frequency-matched controls (mean age [SD] 10y 9mo [3y 6mo], range 3y 2mo-24y 9mo). Participants completed ACTIVE, other traditional assessments, and patient-reported outcomes. Responsiveness to change was evaluated by comparing longitudinal data on untreated participants to those receiving Spinraza.

RESULTS

ACTIVE was significantly correlated to the Hammersmith Functional Motor Scales Expanded and Revised Upper Limb Module (ρ=0.85 and ρ=0.92 respectively; p<0.001). Relevance to patients and families was established by strong correlations to the Patient Reported Outcomes Measurement Information System self- and parent proxy-measures of upper extremity ability (ρ=0.63 and ρ=0.70 respectively; p<0.001). Responsiveness to change was demonstrated by significant change in scaled scores after treatment (median 15.9 points, Wilcoxon signed-rank test p<0.01). A preliminary minimum clinically important difference is presented.

INTERPRETATION

These results suggest that ACTIVE WSV scores are a meaningful assessment with which to quantify change over time in individuals with SMA types 2 and 3.

WHAT THIS PAPER ADDS

Ability Captured Through Interactive Video Evaluation (ACTIVE) quantifies upper extremity function in spinal muscular atrophy. ACTIVE's scaled workspace volume strongly correlates to self- and parent-report of function. ACTIVE quantifies meaningful change after treatment.

A critical review of patient and parent caregiver oriented tools to assess health-related quality of life, activity of daily living and caregiver burden in spinal muscular atrophy

The positive outcome of different therapeutic approaches for spinal muscular atrophy (SMA) in clinical trials and in clinical practice have highlighted the need to establish if functional changes are associated with possible changes of patient health-related quality of life or have an effect on activities of daily living and caregiver burden. The aim of this paper is to provide a critical review of the tools previously or currently used to measure quality of life, activity of daily living, and caregiver burden in SMA. We identified 36 measures. Only 6 tools were specifically developed for SMA while the others had been used and at least partially validated in wider groups of neuromuscular disorders including SMA. Twelve of the 36 focused on health-related quality of life, 5 on activities of daily living and 9 on caregiver burden. Ten included a combination of items. The review provides a roadmap of the different tools indicating their suitability for different SMA types or age groups. Scales assessing activities of daily living and care burden can provide patients and carers perspective on functional changes over time that should be added to the observer rated scales used in clinic.

A Rasch analysis of the lumbar spine instability questionnaire

Purpose: A 2014 study found that the Lumbar Spine Instability questionnaire predicts response to two different types of exercise therapy. This is the first decision tool that has predicted response to exercise for chronic low back pain. The objective of this study was to evaluate the Lumbar Spine Instability questionnaire using Rasch analysis. Methods: Baseline data from patients included in a randomized controlled trial with chronic non-specific low back pain were included. Rasch Measurement Theory was used to assess the ordering of items along a common scale, data-to-model fit, Person Separation Index, unidimensionality and Differential Item Functioning. Results: Responses from 172 patients (102 females) underwent Rasch analysis. All Lumbar Spine Instability questionnaire items had fit residuals between ± 2.5 and Chi-Square values were non-significant with Bonferroni corrections. The Lumbar Spine Instability questionnaire demonstrated a Person Separation Index of 0.64, which is below the recommended cut-off of 0.7. Differential Item Functioning by different pain levels was identified for one item. Conclusion: The Lumbar Spine Instability questionnaire was found to be unidimensional, suggesting that the use of a summary score is appropriate. However, the low Person Separation Index value suggests that more items may be needed to increase the questionnaire's ability to discriminate among individuals with high and low clinical instability.

Evaluating Benefit-risk Decision-making in Spinal Muscular Atrophy: A First-ever Study to Assess Risk Tolerance in the SMA Patient Community

PURPOSE

Patients' perceptions of benefit-risk are essential to informing the regulatory process and the context in which potential therapies are evaluated. To bring this critical information to regulators, Cure SMA launched a first-ever Benefit-Risk Survey for spinal muscular atrophy (SMA) to characterize decision-making and benefit-risk trade-offs in SMA associated with a potential therapy. We hypothesized that risk tolerance would be correlated with SMA type/severity and disease progression. This article presents the results of a benefit-risk survey to enhance understanding of how patients with SMA and caregivers evaluate specific benefits and risks associated with potential therapies.

METHODS

Affected adults, representing all SMA types (I-IV) within the Cure SMA database, and caregivers of affected individuals of all ages/types were invited via e-mail to participate. Best-worst scaling (BWS) was used to assess participants' priorities on benefit-risk trade-offs, as it provides higher discrimination and importance scaling among tested attributes. Twelve potentially clinically meaningful treatment benefits and 11 potential risks (ranging in severity and immediacy) were tested. Multiple factors were correlated with individual responses, including: SMA type/disease severity, stage of disease, respondent type, sex, and quality of life/level of independence (current and expected). Survey respondents were also evaluated for "risk-taking attitudes."

FINDINGS

A total of 298 responses were evaluated (28% affected adults and 72% caregivers, mostly parents). Most respondents were diagnosed >5 years ago (67.3%), with 22.1% SMA type I, 45.6% SMA type II, and 27.9% SMA type III. No strong correlation was found between risk tolerance and SMA type, stage of disease progression, respondent type, sex, quality of life assessment, or rated levels of independence. Irrespective of SMA type, respondents consistently rated the following risks, associated with a potential treatment, as "least tolerable": life-threatening allergic reactions; 1 in 1000 risk of life-threatening side effects leading to possible organ failure; or worsening quality of life. Furthermore, all SMA type respondents rated these risks as "most tolerable": invasive mode of treatment administration (including need for general anesthesia); side effect of dizziness; and other common side effects such as nausea, vomiting, loss of appetite, headaches, back pain, or fatigue.

IMPLICATIONS

With the approval of the first SMA treatment, these findings offer a unique opportunity to assess and characterize baseline risk-tolerance in SMA against which to evaluate future SMA treatment options. Although differences had been expected in risk tolerance among respondents based on disease baseline and certain patient attributes, this was not observed. Survey results should inform future SMA drug development and benefit-risk assessments.

Longitudinal evaluation of SMN levels as biomarker for spinal muscular atrophy: results of a phase IIb double-blind study of salbutamol

Background

Spinal muscular atrophy (SMA) is an autosomal recessive neuromuscular disorder, due to the loss of function of the survival motor neuron (SMN1) gene. The first treatment for the condition, recently approved, is based on the reduction of exon 7 skipping in mRNAs produced by a highly homologous gene (SMN2). The primary objective of the present study was to evaluate the applicability of the dosage of SMN gene produts in blood, as biomarker for SMA, and the safety of oral salbutamol, a beta2-adrenergic agonist modulating SMN2 levels.

Methods

We have performed a 1-year multicentre, double-blind, placebo-controlled study with salbutamol in 45 adult patients with SMA. Patients assumed 4 mg of salbutamol or placebo/three times a day. Molecular tests were SMN2 copy number, SMN transcript and protein levels. We have also explored the clinical effect, by the outcome measures available at the time of study design.

Results

Thirty-six patients completed the study. Salbutamol was safe and well tolerated. We observed a significant and progressive increase in SMN2 full-length levels in peripheral blood of the salbutamol-treated patients (p<0.00001). The exploratory analysis of motor function showed an improvement in most patients.

Conclusions

Our data demonstrate safety and molecular efficacy of salbutamol. We provide the first longitudinal evaluation of SMN levels (both transcripts and protein) in placebo and in response to a compound modulating the gene expression: SMN transcript dosage in peripheral blood is reliable and may be used as pharmacodynamic marker in clinical trials with systemic compounds modifying SMN2levels.

Trial registration number

EudraCT no. 2007-001088-32.

A continuous repetitive task to detect fatigability in spinal muscular atrophy

Background

To determine the value of a continuous repetitive task to detect and quantify fatigability as additional dimension of impaired motor function in patients with hereditary proximal spinal muscular atrophy (SMA).

Results

In this repeated measure case-control study 52 patients with SMA types 2–4, 17 healthy and 29 disease controls performed five consecutive rounds of the Nine-Hole Peg test to determine the presence of fatigability. We analysed differences in test performance and associations with disease characteristics. Five patients with SMA type 2 (22%) and 1 disease control (3%) could not finish five rounds due to fatigue (p = 0.01). Patients with SMA type 2 performed the test significantly more slowly than all other groups (p < 0.005) and disease controls were slower than healthy controls (p < 0.05). Patients with SMA type 2 performed round five 27% slower than round one, while healthy controls performed round five 14% faster than round one (p = 0.005). There was no difference between SMA type 3a, type 3b/4 or disease controls and healthy controls (p > 0.4). Time needed to complete each round during the five-round task increased in 15 patients with SMA type 2 (65%), 4 with type 3a (36%), 4 with type 3b/4 (22%), 9 disease controls (31%) and 1 healthy control (6%). There was no effect of age at disease onset or disease duration in SMA type 2 (p = 0.39). Test-retest reliability was high.

Conclusion

Fatigability of remaining arm function is a feature of SMA type 2 and can be determined with continuous repetitive tasks.

Prospective and longitudinal natural history study of patients with Type 2 and 3 spinal muscular atrophy: Baseline data NatHis-SMA study

Spinal muscular atrophy (SMA) is a monogenic disorder caused by loss of function mutations in the survival motor neuron 1 gene, which results in a broad range of disease severity, from neonatal to adult onset. There is currently a concerted effort to define the natural history of the disease and develop outcome measures that accurately capture its complexity. As several therapeutic strategies are currently under investigation and both the FDA and EMA have recently approved the first medical treatment for SMA, there is a critical need to identify the right association of responsive outcome measures and biomarkers for individual patient follow-up. As an approved treatment becomes available, untreated patients will soon become rare, further intensifying the need for a rapid, prospective and longitudinal study of the natural history of SMA Type 2 and 3. Here we present the baseline assessments of 81 patients aged 2 to 30 years of which 19 are non-sitter SMA Type 2, 34 are sitter SMA Type 2, 9 non-ambulant SMA Type 3 and 19 ambulant SMA Type 3. Collecting these data at nine sites in France, Germany and Belgium established the feasibility of gathering consistent data from numerous and demanding assessments in a multicenter SMA study. Most assessments discriminated between the four groups well. This included the Motor Function Measure (MFM), pulmonary function testing, strength, electroneuromyography, muscle imaging and workspace volume. Additionally, all of the assessments showed good correlation with the MFM score. As the untreated patient population decreases, having reliable and valid multi-site data will be imperative for recruitment in clinical trials. The pending two-year study results will evaluate the sensitivity of the studied outcomes and biomarkers to disease progression.

Trial Registration: ClinicalTrials.gov (NCT02391831).

Patient reported outcome measures in rare diseases: a narrative review

BACKGROUND

Rare diseases can lead to a significant reduction in quality of life for patients and their families. Ensuring the patients voice is central to clinical decision making is key to delivering, evaluating and understanding the efficacy of therapeutic interventions. Patient reported outcome measures (PROMs) are used to capture the patient's views about their health status and facilitate our understanding of the impact of these diseases and their treatments on patient's quality of life and symptoms.

MAIN TEXT

This review explores some of the current issues around the utilisation of PROMs in rare diseases, including small patient populations and dearth of valid PROMs. Difficulties in validating new or current PROMs for use in clinical trials and research are discussed. The review highlights potential solutions for some of the issues outlined in the review and the implementation of PROMs in research and clinical practice are discussed.

CONCLUSION

Patient input throughout the development of PROMs including qualitative research is essential to ensure that outcomes that matter to people living with rare disease are appropriately captured. Given the large number of rare diseases, small numbers of patients living with each condition and the cost of instrument development, creative and pragmatic solutions to PROM development and use may be necessary. Solutions include qualitative interviews, modern psychometrics and resources such as item banking and computer adaptive testing. Use of PROMs in rare disease research and clinical practice offers the potential to improve patient care and clinical outcomes.

New quantitative method for evaluation of motor functions applicable to spinal muscular atrophy

OBJECTIVE

The aim of this study was to develop and introduce new method to quantify motor functions of the upper extremity.

METHODS

The movement was recorded using a three-dimensional motion capture system, and the movement trajectory was analyzed using newly developed two indices, which measure precise repeatability and directional smoothness. Our target task was shoulder flexion repeated ten times. We applied our method to a healthy adult without and with a weight, simulating muscle impairment. We also applied our method to assess the efficacy of a drug therapy for amelioration of motor functions in a non-ambulatory patient with spinal muscular atrophy. Movement trajectories before and after thyrotropin-releasing hormone therapy were analyzed.

RESULTS

In the healthy adult, we found the values of both indices increased significantly when holding a weight so that the weight-induced deterioration in motor function was successfully detected. From the efficacy assessment of drug therapy in the patient, the directional smoothness index successfully detected improvements in motor function, which were also clinically observed by the patient's doctors.

CONCLUSION

We have developed a new quantitative evaluation method of motor functions of the upper extremity. Clinical usability of this method is also greatly enhanced by reducing the required number of body-attached markers to only one. This simple but universal approach to quantify motor functions will provide additional insights into the clinical phenotypes of various neuromuscular diseases and developmental disorders.

An Objective and Child-friendly Assessment of Arm Function by Using a 3-D Sensor

Progressive and irreversible muscle atrophy characterizes Spinal Muscular Atrophy (SMA) and other similar muscle disorder diseases. Objective assessment of muscle functions is an essential and important, although challenging, prerequisite for successful clinical trials. Current clinical rating scales restrain the movement abnormalities to certain predefined coarse-grained individual items. The Kinect 3-D sensor has emerged as a low-cost and portable motion sensing technology used to capture and track people's movement in many medical and research fields. A novel approach using this 3-D sensor was developed and a game-like test was designed to objectively measure the upper limb function of patients with SMA. The prototype test targeted joint movement capability. While sitting in a virtual scene, the patient was instructed to extend, flex, and lift the whole arm in order to reach and place some objects. Both kinematic and spatiotemporal characteristics of upper limb movement were extracted and analyzed, e.g., elbow extension and flexion angles, hand velocity, and acceleration. The first study included a small cohort of 18 ambulant SMA patients and 19 age- and gender-matched healthy controls. A comprehensive analysis of arm movement was achieved; however, no significant difference between the groups were found due to the mismatch of patient's capability and the test difficulty. Based on this experience, a second version of the test consisting of a modified version of the first game with increased difficulties and a second game targeting muscle endurance were designed and implemented. The new test has not been conducted in any patient groups yet. Our work has demonstrated the potential capability of the 3-D sensor in assessing such muscle function and suggested an objective approach to complement the clinical rating scales.

Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study

BACKGROUND

The NeuroNEXT SMA Infant Biomarker Study, a two year, longitudinal, multi-center study of infants with SMA type 1 and healthy infants, presented a unique opportunity to assess multi-site rater reliability on three infant motor function tests (MFTs) commonly used to assess infants with SMA type 1.

OBJECTIVE

To determine the effect of prospective MFT rater training and the effect of rater experience on inter-rater and intra-rater reliability for the Test of Infant Motor Performance Screening Items (TIMPSI), the Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP-INTEND) and the Alberta Infant Motor Scale (AIMS).

METHODS

Training was conducted utilizing a novel set of motor function test (MFT) videos to optimize accurate MFT administration and reliability for the study duration. Inter- and intra-rater reliability of scoring for the TIMPSI and inter-rater reliability of scoring for the CHOP INTEND and the AIMS was assessed using intraclass correlation coefficients (ICC). Effect of rater experience on reliability was examined using ICC. Agreement with 'expert' consensus scores was examined using Pearson's correlation coefficients.

RESULTS

Inter-rater reliability on all MFTs was good to excellent. Intra-rater reliability for the primary MFT, the TIMPSI, was excellent for the study duration. Agreement with 'expert' consensus was within predetermined limits (≥85%) after training. Evaluator experience with SMA and MFTs did not affect reliability.

CONCLUSIONS

Reliability of scores across evaluators was demonstrated for all three study MFTs and scores were reproducible on repeated administration. Evaluator experience had no effect on reliability.

Factor validation and Rasch analysis of the individual recovery outcomes counter

OBJECTIVE

The individual recovery outcomes counter is a 12-item personal recovery self-assessment tool for adults with mental health problems. Although widely used across Scotland, limited research into its psychometric properties has been conducted. We tested its' measurement properties to ascertain the suitability of the tool for continued use in its' present form.

MATERIALS AND METHODS

Anonymised data from the assessments of 1743 adults using mental health services in Scotland were subject to tests based on principles of Rasch measurement theory, principal components analysis and confirmatory factor analysis.

RESULTS

Rasch analysis revealed that the six-point response structure of the individual recovery outcomes counter (I.ROC) was problematic. Re-scoring on a four-point scale revealed well-ordered items that measure a single, recovery-related construct, and has acceptable fit statistics. Confirmatory factor analysis supported this. Scale items covered around 75% of the recovery continuum; those individuals least far along the continuum were least well addressed.

CONCLUSIONS

A modified tool worked well for many, but not all, service users. The study suggests specific developments are required if the I.ROC is to maximise its' utility for service users and provide meaningful data for service providers. Implications for Rehabilitation Agencies and services working with people with mental health problems aim to help them with their recovery. The individual recovery outcomes counter has been developed and is used widely in Scotland to help service users track their progress to recovery. Using a large sample of routinely collected data we have demonstrated that a number of modifications are needed if the tool is to adequately measure recovery. This will involve consideration of the scoring system, item content and inclusion, and theoretical basis of the tool.

Building the patient community

There are many challenges in conducting rare disease research. The conditions are often poorly understood, small patient populations are dispersed around the world, and there are limited funding opportunities. Patient groups can serve as a key partner in overcoming these challenges, as they understand the impact of rare conditions on patients' lives. This gives patient groups valuable scientific insights into the disease. This can be used to create research strategies, address research bottlenecks and directly fund research that appropriately addresses patient needs. Patient groups can also play a critical role in recruiting and retaining patients for clinical trials, which reduces time and resource waste. By partnering with patient groups, research teams can improve efficiency of research and best meet the needs of patients. Researchers can also play an important role in building and supporting patient groups to unlock these benefits.

Longitudinal characterization of biomarkers for spinal muscular atrophy

Objective

Recent advances in understanding Spinal Muscular Atrophy (SMA) etiopathogenesis prompted development of potent intervention strategies and raised need for sensitive outcome measures capable of assessing disease progression and response to treatment. Several biomarkers have been proposed; nevertheless, no general consensus has been reached on the most feasible ones. We observed a wide range of measures over 1 year to assess their ability to monitor the disease status and progression.

Methods

18 SMA patients and 19 healthy volunteers (HV) were followed in this 52‐weeks observational study. Quantitative‐MRI (qMRI) of both thighs and clinical evaluation of motor function was performed at baseline, 6, 9 and 12 months follow‐up. Blood samples were taken in patients for molecular characterization at screening, 9 and 12 month follow‐up. Progression, responsiveness and reliability of collected indices were quantified. Correlation analysis was performed to test for potential associations.

Results

QMRI indices, clinical scales and molecular measures showed high to excellent reliability. Significant differences were found between qMRI of SMA patients and HV. Significant associations were revealed between multiple qMRI measures and functional clinical scales. None of the qMRI, clinical, or molecular measures was able to detect significant disease progression over 1 year.

Interpretation

We probed a variety of quantitative measures for SMA in a slowly‐progressing disease population over 1 year. The presented measures demonstrated potential to provide a closer link to underlying disease biology as compared to conventional functional scales. The proposed biomarker framework can guide implementation of more sensitive endpoints in future clinical trials and prove their utility in search for novel disease‐modifying therapies.

Hyperleptinemia in children with autosomal recessive spinal muscular atrophy type I-III

Background

Autosomal-recessive proximal spinal muscular atrophies (SMA) are disorders characterized by a ubiquitous deficiency of the survival of motor neuron protein that leads to a multisystemic disorder, which mostly affects alpha motor neurons. Disease progression is clinically associated with failure to thrive or weight loss, mainly caused by chewing and swallowing difficulties. Although pancreatic involvement has been described in animal models, systematic endocrinological evaluation of the energy metabolism in humans is lacking.

Methods

In 43 patients with SMA type I-III (8 type I; 22 type II; 13 type III), aged 0.6–21.8 years, auxological parameters, pubertal stage, motor function (Motor Function Measurement 32 –MFM32) as well as levels of leptin, insulin glucose, hemoglobin A1c, Homeostasis Model Assessment index and an urinary steroid profile were determined.

Results

Hyperleptinemia was found in 15/35 (43%) of our patients; 9/15 (60%) of the hyperleptinemic patients were underweight, whereas 1/15 (7%) was obese. Hyperleptinemia was associated with SMA type (p = 0.018). There was a significant association with decreased motor function (MFM32 total score in hyperleptinemia 28.5%, in normoleptinemia 54.7% p = 0.008, OR 0.969; 95%-CI: 0.946–0.992). In addition, a higher occurrence of hirsutism, premature pubarche and a higher variability of the urinary steroid pattern were found.

Conclusion

Hyperleptinemia is highly prevalent in underweight children with SMA and is associated with disease severity and decreased motor function. Neuronal degradation of hypothalamic cells or an increase in fat content by muscle remodeling could be the cause of hyperleptinemia.

Revised Hammersmith Scale for spinal muscular atrophy: A SMA specific clinical outcome assessment tool

Recent translational research developments in Spinal Muscular Atrophy (SMA), outcome measure design and demands from regulatory authorities require that clinical outcome assessments are 'fit for purpose'. An international collaboration (SMA REACH UK, Italian SMA Network and PNCRN USA) undertook an iterative process to address discontinuity in the recorded performance of the Hammersmith Functional Motor Scale Expanded and developed a revised functional scale using Rasch analysis, traditional psychometric techniques and the application of clinical sensibility via expert panels. Specifically, we intended to develop a psychometrically and clinically robust functional clinician rated outcome measure to assess physical abilities in weak SMA type 2 through to strong ambulant SMA type 3 patients. The final scale, the Revised Hammersmith Scale (RHS) for SMA, consisting of 36 items and two timed tests, was piloted in 138 patients with type 2 and 3 SMA in an observational cross-sectional multi-centre study across the three national networks. Rasch analysis demonstrated very good fit of all 36 items to the construct of motor performance, good reliability with a high Person Separation Index PSI 0.98, logical and hierarchical scoring in 27/36 items and excellent targeting with minimal ceiling. The RHS differentiated between clinically different groups: SMA type, World Health Organisation (WHO) categories, ambulatory status, and SMA type combined with ambulatory status (all p < 0.001). Construct and concurrent validity was also confirmed with a strong significant positive correlation with the WHO motor milestones rs = 0.860, p < 0.001. We conclude that the RHS is a psychometrically sound and versatile clinical outcome assessment to test the broad range of physical abilities of patients with type 2 and 3 SMA. Further longitudinal testing of the scale with regards change in scores over 6 and 12 months are required prior to its adoption in clinical trials.

Disease impact on general well-being and therapeutic expectations of European Type II and Type III spinal muscular atrophy patients

Spinal muscular atrophy (SMA) is a neurodegenerative disorder showing a broad clinical spectrum and no cure to date. To design and select evaluation criteria for the potential assessment of drugs currently being developed, the patient's perspective is critical. A survey, aiming to obtain a view on the current clinical state of European Type II and Type III SMA patients, the impact of this situation on their quality of life and their expectations regarding clinical development, was carried out by SMA-Europe member organizations in July 2015. A questionnaire was set up, translated into 8 European languages and sent out directly via electronic mailing to the targeted SMA patient population by the respective European patient organizations. We were able to collect 822 valid replies in less than two weeks. The questionnaire captured the current abilities of the respondents, their perception of the disease burden which appeared very similar across Europe despite some regional variations in care. According to the great majority of the respondents, stabilization of their current clinical state would represent a therapeutic progress for a compelling majority of the respondents to the questionnaire.

Feasibility of Using Microsoft Kinect to Assess Upper Limb Movement in Type III Spinal Muscular Atrophy Patients

Although functional rating scales are being used increasingly as primary outcome measures in spinal muscular atrophy (SMA), sensitive and objective assessment of early-stage disease progression and drug efficacy remains challenging. We have developed a game based on the Microsoft Kinect sensor, specifically designed to measure active upper limb movement. An explorative study was conducted to determine the feasibility of this new tool in 18 ambulant SMA type III patients and 19 age- and gender-matched healthy controls. Upper limb movement was analysed elaborately through derived features such as elbow flexion and extension angles, arm lifting angle, velocity and acceleration. No significant differences were found in the active range of motion between ambulant SMA type III patients and controls. Hand velocity was found to be different but further validation is necessary. This study presents an important step in the process of designing and handling digital biomarkers as complementary outcome measures for clinical trials.