Study to Assess Content Validity and Interrater and Intrarater Reliability of the Inclusion Body Myositis Functional Rating Scale

Background and Objectives

Sporadic inclusion body myositis (IBM) is a rare, muscle-wasting disease that negatively affects health-related quality of life. Although a measure that has been developed to assess the impact of IBM, the IBM Functional Rating Scale (IBMFRS) has limited evidence of content validity or reliability, and what constitutes a meaningful change threshold; this study was conducted to address these gaps.

Methods

Adult patients with a clinical diagnosis of IBM from the United Kingdom and disease area expert health care professionals from the United States and United Kingdom took part in this study. This study consisted of 5 stages including phone interviews (physicians), face-to-face interviews (patients), face-to-face ratings, phone ratings, and ratings of videos using the IBMFRS.

Results

The IBMFRS adequately captures all core functional impacts of IBM, which was corroborated by both patient participants and physicians when debriefing the measure. Physicians and patient participants all thought any change on the measure would be meaningful change for a patient, either improvement or worsening. The quantitative analysis demonstrated good interrater reliability for face-to-face ratings (intraclass correlation coefficient [ICC] >0.7) and for video ratings (ICC >0.9). Intrarater reliability was excellent for face-to-face and video ratings (ICC >0.9). Equivalence between the modes of administration, face-to-face vs phone, was also excellent (ICC >0.9).

Discussion

The IBMFRS is content valid in assessing the key functional impacts of IBM, and any change would be meaningful. It is reliable both within and across raters, and there is equivalence between different modes of administration (face-to-face vs phone).

Impacts and Burden of Niemann pick Type-C: a patient and caregiver perspective

Background

Niemann-Pick disease type C (NPC) is a debilitating condition that impacts patients’ and caregivers’ quality of life (QOL) and reduces the patient’s life expectancy. Since there is little qualitative research from the perspective of patients and family caregivers, this study explored the impact of NPC on patients’ and caregivers’ daily lives to understand the burden of disease.

Results

A survey of caregivers for patients with NPC and adult patients with NPC (n = 49; patient age: 13 months–65 years) assessed NPC severity, importance of NPC symptoms, and how symptoms impacted patients’ and caregivers’ activities of daily living (ADLs) and health-related QOL (HRQOL). Follow-up interviews with a subset of survey participants (n = 28) explored the ranking of NPC symptom importance and impact on ADLs and HRQOL. Findings indicated that the most important manifestations of NPC were ambulation, swallowing, speech, fine motor skills, and cognition, which were those that had the most significant impact on ADLs and HRQOL. A wide range of ADLs were affected by NPC, mainly eating/drinking and the ability to perform daily tasks, including self-care, communicating, participating in school or work, and moving indoors as well as outside the home. Along with these impacts, there was an increased risk of experiencing dangerous or life-threatening situations leading to loss of patient independence and additional caregiver burden, often requiring changes in lifestyle such as giving up work. All aspects of patients’ and caregivers’ HRQOL were affected. Participants reported feelings of social isolation, loss of enjoyment in activities (patients), and feelings of sadness or worry (caregivers).

Conclusions

Ambulation, swallowing, speech, fine motor skills, and cognition are important manifestations of NPC. ADLs and HRQOL were impaired in the majority of patients as well as their caregivers. The findings were independent of current age, age of onset of symptoms, and level of NPC disease-related disability; however, the impact increased at higher levels of disease disability. Knowing the impact of NPC on patients and caregivers is important for understanding the lived experience of NPC and for identifying potential areas of support.

International consensus on clinical severity scale use in evaluating Niemann-Pick disease Type C in paediatric and adult patients: results from a Delphi Study

Background

Several scales have been developed in the past two decades to evaluate Niemann–Pick disease Type C (NPC) severity in clinical practice and trials. However, a lack of clarity concerning which scale to use in each setting is preventing the use of standardised assessments across the world, resulting in incomparable data sets and clinical trial outcome measures. This study aimed to establish agreed approaches for the use of NPC severity scales in clinical practice and research.

Methods

A Delphi method of consensus development was used, comprising three survey rounds. In Round 1, participants were asked nine multiple-choice and open-ended questions to gather opinions on the six severity scales and domains. In Rounds 2 and 3, questions aimed to gain consensus on the opinions revealed in Round 1 using a typical Likert scale.

Results

Nineteen experts, active in NPC paediatric and adult research and treatment, participated in this study. Of these, 16/19 completed Rounds 1 and 2 and 19/19 completed Round 3. Consensus (defined as ≥ 70% agreement or neutrality, given the study aim to identify the severity scales that the clinical community would accept for international consistency) was achieved for 66.7% of the multiple-choice questions in Round 2 and 83% of the multiple-choice questions in Round 3. Consensus was almost reached (68%) on the use of the 5-domain NPCCSS scale as the first choice in clinical practice. Consensus was reached (74%) for the 17-domain NPCCSS scale as the first choice in clinical trial settings, but the domains measured in the 5-domain scale should be prioritised as the primary endpoints. Experts called for educational and training materials on how to apply the NPCCSS (17- and 5-domains) for clinicians working in NPC.

Conclusions

In achieving a consensus on the use of the 17-domain NPCCSS scale as the first choice for assessing clinical severity of NPC in clinical trial settings but prioritising the domains in the 5-domain NPCCSS scale for routine clinical practice, this study can help to inform future discussion around the use of the existing NPC clinical severity scales. For routine clinical practice, the study helps provide clarity on which scale is favoured by a significant proportion of a representative body of experts, in this case, the 5-domain NPCCSS scale.

Validation of the 5-domain Niemann-Pick type C Clinical Severity Scale

Background

Niemann-Pick disease type C (NPC) is an ultra-rare, progressive, genetic disease leading to impaired lysosomal function and neurodegeneration causing serious morbidity and shortened life expectancy.

The Niemann-Pick type C Clinical Severity Scale (NPCCSS) is a 17 domain, disease-specific, clinician-reported outcome measure of disease severity and progression. An abbreviated 5-domain NPCCSS scale has been developed (measuring Ambulation, Swallow, Cognition, Speech, and Fine Motor Skills) and the scale reliability has been established. Additional psychometric properties and meaningful change of the scale need, however, to be assessed.

Methods

Mixed method studies were conducted to ascertain which NPCCSS domains were most important, as well as to explore meaningful change: 1) surveys in caregivers/patients (n = 49) and 2) interviews with clinicians (n = 5) as well as caregivers/patients (n = 28). Clinical trial data (n = 43) assessed construct validity and meaningful change through an anchor-based approach.

Results

Domains identified as most important by clinicians, caregivers, and patients (independent of current age, age of onset, and disease severity) were Ambulation, Swallow, Cognition, Speech, and Fine Motor Skills, indicating content validity of the 5-domain NPCCSS.

Criterion validity was shown with the 5-domain NPCCSS being highly correlated with the 17-item NPCCSS total score (excluding hearing domains), r² = 0.97. Convergent validity was demonstrated against the 9 Hole Peg Test, r² = 0.65 (n = 31 patients), and the Scale for Assessment and Rating of Ataxia (SARA), r² = 0.86 (n = 49 patients). Any change was seen as meaningful by patients/caregivers across domains. Meaningful change using trial data and interviews with NPC experts (n = 5) and patients/caregivers (n = 28) suggested that a 1-category change on a domain is equivalent to 1-point change or greater in the 5-domain NPCCSS total score.

Conclusions

Qualitative and quantitative data support content and construct validity of the 5-domain NPCCSS score as a valid endpoint in NPC trials. A 1-category change on any domain is equivalent to 1-point change or greater in the 5 domain NPCCSS total score, representing a clinically meaningful transition and reflecting loss of complex function and increased disability.

Trial registration NCT02612129. Registered 23 November 2015, https://clinicaltrials.gov/ct2/show/NCT02612129

Clinical disease progression and biomarkers in Niemann-Pick disease type C: a prospective cohort study

Background

Niemann–Pick disease type C (NPC) is a rare, progressive, neurodegenerative disease associated with neurovisceral manifestations resulting from lysosomal dysfunction and aberrant lipid accumulation. A multicentre, prospective observational study (Clinical Trials.gov ID: NCT02435030) of individuals with genetically confirmed NPC1 or NPC2 receiving routine clinical care was conducted, to prospectively characterize and measure NPC disease progression and to investigate potential NPC-related biomarkers versus healthy individuals. Progression was measured using the abbreviated 5-domain NPC Clinical Severity Scale (NPCCSS), 17-domain NPCCSS and NPC clinical database (NPC-cdb) score. Cholesterol esterification and heat shock protein 70 (HSP70) levels were assessed from peripheral blood mononuclear cells (PBMCs), cholestane-3β,5α-,6β-triol (cholestane-triol) from serum, and unesterified cholesterol from both PBMCs and skin biopsy samples. The inter- and intra-rater reliability of the 5-domain NPCCSS was assessed by 13 expert clinicians’ rating of four participants via video recordings, repeated after ≥ 3 weeks. Intraclass correlation coefficients (ICCs) were calculated.

Results

Of the 36 individuals with NPC (2–18 years) enrolled, 31 (86.1%) completed the 6–14-month observation period; 30/36 (83.3%) were receiving miglustat as part of routine clinical care. A mean (± SD) increase in 5-domain NPCCSS scores of 1.4 (± 2.9) was observed, corresponding to an annualized progression rate of 1.5. On the 17-domain NPCCSS, a mean (± SD) progression of 2.7 (± 4.0) was reported. Compared with healthy individuals, the NPC population had significantly lower levels of cholesterol esterification (p < 0.0001), HSP70 (p < 0.0001) and skin unesterified cholesterol (p = 0.0006). Cholestane-triol levels were significantly higher in individuals with NPC versus healthy individuals (p = 0.008) and correlated with the 5-domain NPCCSS (Spearman’s correlation coefficient = 0.265, p = 0.0411). The 5-domain NPCCSS showed high ICC agreement in inter-rater reliability (ICC = 0.995) and intra-rater reliability (ICC = 0.937).

Conclusions

Progression rates observed were consistent with other reports on disease progression in NPC. The 5-domain NPCCSS reliability study supports its use as an abbreviated alternative to the 17-domain NPCCSS that focuses on the most relevant domains of the disease. The data support the use of cholestane-triol as a disease monitoring biomarker and the novel methods of measuring unesterified cholesterol could be applicable to support NPC diagnosis. Levels of HSP70 in individuals with NPC were significantly decreased compared with healthy individuals.

Trial registration

CT-ORZY-NPC-001: ClincalTrials.gov NCT02435030, Registered 6 May 2015, https://clinicaltrials.gov/ct2/show/NCT02435030; EudraCT 2014–005,194-37, Registered 28 April 2015, https://www.clinicaltrialsregister.eu/ctr-search/trial/2014-005194-37/DE. OR-REL-NPC-01: Unregistered.

Shortened duration of untreated first episode of psychosis: changes in patient characteristics at treatment

OBJECTIVE

This study examined whether duration of untreated psychosis can be shortened in patients with first episodes of DSM-IV schizophrenia spectrum disorders and whether shorted duration alters patient appearance at treatment.

METHOD

Two study groups were ascertained in the same Norwegian health care sector: one from 1993-1994 with usual detection methods and one from 1997-1998 with early detection strategies that included education about psychosis.

RESULTS

Patients with early detection had a shorter median duration of untreated psychosis by 21.5 weeks than patients with usual detection. The number with psychosis was greater in the early detection group; the number with schizophrenia was less. Early detection patients had more substance abuse and were younger, better adjusted premorbidly, and less ill.

CONCLUSIONS

Early detection can shorten duration of untreated psychosis and help more patients when they are less severely ill. Given the devastation of psychosis, this is a significant treatment advance.

Langfeldt's schizophreniform psychoses fifty years later

As a result of follow-up studies published in 1937 and 1939, Langfeldt divided schizophrenia into two groups; 'typical schizophrenia' which had a poor outcome, and the 'schizophreniform psychoses' which had a less typical clinical picture of schizophrenia and a good outcome. Langfeldt's cases of schizophreniform psychoses were reclassified according to the ICD-9 and DSM-III-R diagnostic systems. Most of the schizophreniform psychoses did not appear 'schizophrenia-like' at all, but turned out to be mainly affective disorders. Those included in Langfeldt's diagnosis of 'schizophreniform psychoses' were found to be too heterogenous to validate the existence of this syndrome.

Comparing the performance of two gamma cameras under high counting rates: principles and practice

The performance of two large Anger cameras at high counting rates was compared, and the principles for measuring the relevant parameters, especially deadtime loss and coincidence artifacts, are discussed. The results demonstrate the importance of the following factors: modern pulse-shaping circuitry with short paralyzable deadtime, and anti-pileup circuit, and uniform energy information within the field of view, which requires separate summing matrices for energy and position. Elaborate testing of the specifications should be carried out before purchase of a gamma camera.

Anger camera imaging of perfused and nonperfused brain tissue with intra-arterial 133Xenon technique

The regional cerebral blood flow, the regional blood flow distribution, and the regional distribution of perfused (= vital) brain tissue been imaged with a digitalized conventional Anger camer. An analog scaler was placed behind the PM-tubes to reduce dead-time loss. The input pulse rate was doubled to counteract the effect of scaling on counting statistics, and the gamma emission was filtered through 1 mm of brass to increase the fraction of the integral count rate within the 40% window. In this way the 31 keV peak disappears, and Compton scatter and disturbing coincidences are markedly reduced. This improves spatial resolution. The flow parameters are imaged regionally in 3 X 3 mm2 matrix elements after flat field correction and smoothing. The matrix is 64 X 64 interpolated to 128 X 128. Patient studies emphasized the importance of imaging the distribution of perfused and nonperfused tissue in cases of infarctions, dilacerations, etc., where angiography and conventional brain scanning may often be negative.