Responsiveness and meaningful thresholds of PROMIS pain interference, fatigue, and physical function forms in adults with idiopathic inflammatory myopathies: Report from the OMERACT Myositis Working Group

BACKGROUND

A series of qualitative studies conducted by the OMERACT Myositis Working Group identified pain interference, fatigue, and physical function as highly important life impact domains for adults with idiopathic inflammatory myositis (IIM). In this study, our goal was to assess the responsiveness and minimal important difference of PROMIS pain interference (6a), fatigue (7a), and physical function (8b).

METHODS

Adults with IIM from USA, Netherlands, Korea, Sweden, and Australia with two "clinical" visits were enrolled in this prospective study. Anchor questions on a Likert scale were collected at baseline, and manual muscle testing (MMT), physician and patient reported global disease activity, and PROMIS instruments were collected at both visits. Responsiveness was assessed with i) ANOVA, ii) paired t-test, effect size and standardized response mean, and iii) Pearson correlation. Minimal important difference (MID), minimal important change (MIC) and minimal detectable change (MDC) values were calculated.

RESULTS

114 patients with IIM (median age 60, 60 % female) completed both visits. Changes in PROMIS instruments were significantly different among anchor categories. Patients who reported improvement had a significant improvement in their PROMIS scores with at least medium effect size, while patients who reported worsening and stability did not show a significant change with weak effect size. PROMIS instruments had weak to moderate correlations with MMT, patient and physician global disease activity. MID was approximately 2-3 points for Pain Interference and 3-4 points for Fatigue and Physical Function forms based on the method used. MIC was approximately 4-5 for improvement of all the instruments, while MDC was 1.7-2 points for Pain Interference and Physical Function and 3.2-3.9 for Fatigue.

CONCLUSION

This study provides evidence towards the responsiveness of the PROMIS instruments in a large international prospective cohort of adults with IIM supporting their use as PROMs in adult myositis.

Reliability and validity of PROMIS physical function, pain interference, and fatigue as patient reported outcome measures in adult idiopathic inflammatory myopathies: International study from the OMERACT myositis working group

OBJECTIVE

Pain interference, fatigue, and impaired physical function are common features of idiopathic inflammatory myopathies (IIM). The objective of this study was to evaluate the construct validity and test-retest reliability of the Patient Reported Outcome Information System (PROMIS) Pain Interference 6av1.0, Fatigue 7av1.0, and Physical Function 8bv2.0 instruments.

METHODS

Patient-Reported Outcome Measures (PROMs) were deployed to adult IIM patients from OMERACT Myositis Working Group (MWG) international clinic sites via two online surveys (2019, 2021). Internal consistency of each PROM was analyzed by Cronbach's α. Construct validity was determined by a priori hypotheses generated by the MWG with >75% agreement for each hypothesis and calculated with Pearson correlations. Test-retest reliability was assessed using intraclass correlation coefficient with PROMIS instruments administered at time zero and 7 days.

RESULTS

Surveys were sent to 368 participants in total; participants who completed each questionnaire varied (n=65 to 263). For construct validity, 10 out of 13 a priori hypotheses were met supporting construct validity of PROMIS instruments (Pain Interference 3/4, fatigue 4/4, and Physical Function 3/5). Test-retest reliability was strong for all PROMIS instruments. All PROMIS instruments demonstrated excellent internal consistency. None of the measures demonstrated any ceiling or floor effects except for a ceiling effect in the Pain Interference instrument.

CONCLUSIONS

This study presents test-retest reliability and construct validity evidence supporting PROMIS Pain Interference (6a v1.0), Fatigue (7a v1.0), and Physical Function (8b v2.0) using a large international cohort of patients with IIM. Internal consistency of these instruments was excellent. A ceiling effect was noted in the Pain Interference instrument.

World Health Organization (WHO) International Classification of Functioning, Disability and Health (ICF) Core Set Development for Interstitial Lung Disease

Background: The World Health Organization (WHO) introduced the International Classification of Functioning, Disability, and Health (ICF) as a scientific method of disability data collection comprised of >1,200 categories describing the spectrum of impairment types (functional, symptoms-based and anatomical) under the bio-psycho-social model with consideration of environmental and personal factors (pf). ICF Core Sets and ICF Checklists are streamlined disease-specific resources for clinical use, service provision, and for use in health economics and health policy. ICF can disclose strengths and weaknesses across multiple patient-reported outcome measures (PROMs) and help consolidate best-fitting question-items from multiple PROMs. Interstitial lung diseases (ILDs), are generally progressive, with restrictive physiology sometimes occurring in the context of multi-organ autoimmunity/inflammatory conditions such as connective tissue diseases (CTDs). In spite of significant associated morbidity and potential disability, ILD has yet to be linked to the ICF. Methods: Each instrument and their question-items within the consensus-recommended core sets for clinical trials in ILD were deconstructed to single concept units, and then linked per updated ICF linkage rules. Inter-linker agreement was established. Three additional subsequently validated measures were also included. Results: One-hundred-eleven ICF categories were identified for ten PROMs and three traditional objective measures that were amenable to ICF linkage. The proportion of agreement ranged from 0.79 (95% CI: 0.62, 0.91) to 0.93 (0.76, 0.99) with the overall proportion of inter-linker agreement being very high 0.86 (0.82, 0.89) for the initial instruments, with 94-100% for the three additional PROMs. Thirty-four new 'Personal Factors' emerged to capture disease-specific qualities not elsewhere described in ICF, e.g. 'pf_embarrassed by cough' or 'pf_panic/afraid when can't get a breath'. Conclusion: This first known effort in ICF linkage of ILD has provided important revelations on the current utility of the ICF in lung disease. Results have indicated areas for meaningful assessment of ICF descriptors for lung impairment. The mapping across PROMs provides insight into possibilities of developing more streamline and precise instrumentation. Finally, familiarity with the ICF in ILD may enable clinicians to experience a smoother transition with the imminent harmonization of ICD and ICF, ICD-11.

Assessing the content validity of patient-reported outcome measures in adult myositis: A report from the OMERACT myositis working group

OBJECTIVE

To investigate the content validity of several patient-reported outcome measures (PROMs) in patients with idiopathic inflammatory myopathies (IIM).

METHODS

Seven individual PROM instruments were selected by the Outcome Measures in Rheumatology (OMERACT) Myositis Working Group relating to the following domains: pain, fatigue, physical function and physical activity. Twenty patients from the Johns Hopkins Myositis Center were selected for one-on-one face-to-face or phone interviews for cognitive interviewing of individual PROMs to assess comprehension and content validity. Additionally, patients were asked if they thought muscle symptoms, an area originally identified in qualitative studies, were encapsulated by the other four domains.

RESULTS

The majority of patients (>70%) felt that each of the instruments was clear, easy to read and understand, and could be used for assessment of its domain. Two-thirds (66%) of patients felt that 'muscle symptoms' were captured by the other domains.

CONCLUSIONS

We provided evidence to support adequate content validity for several PROMs. Further research is needed to determine whether 'muscle symptoms' warrant a separate domain.

OMERACT 2018 Modified Patient-reported Outcome Domain Core Set in the Life Impact Area for Adult Idiopathic Inflammatory Myopathies

OBJECTIVE

To present and vote on a myositis modified patient-reported outcome core domain set in the life impact area at the Outcome Measures in Rheumatology (OMERACT) 2018.

METHODS

Based on results from international focus groups and Delphi surveys, a draft core set was developed.

RESULTS

Domains muscle symptoms, fatigue, level of physical activity, and pain reached ≥ 70% consensus and were mandatory to assess in all trials. Domains lung, joint, and skin symptoms were mandatory in specific circumstances. This core set was endorsed by > 85% at OMERACT 2018.

CONCLUSION

We propose a life impact core set for patients with idiopathic inflammatory myopathies and will proceed with instrument selections.

Perceptions of Patients, Caregivers, and Healthcare Providers of Idiopathic Inflammatory Myopathies: An International OMERACT Study

OBJECTIVE

Patient-reported outcome measures (PROM) that incorporate the patient perspective have not been well established in idiopathic inflammatory myopathies (IIM). As part of our goal to develop IIM-specific PROM, the Outcome Measures in Rheumatology (OMERACT) Myositis special interest group sought to determine which aspects of disease and its effects are important to patients and healthcare providers (HCP).

METHODS

Based on a prior qualitative content analysis of focus groups, an initial list of 24 candidate domains was constructed. We subsequently conducted an international survey to identify the importance of each of the 24 domains to be assessed in clinical research. Patients with IIM, their caregivers, and HCP treating IIM completed the survey.

RESULTS

In this survey, a total of 638 respondents completed the survey, consisting of 510 patients, 101 HCP, and 27 caregivers from 48 countries. Overall, patients were more likely to rank "fatigue," "cognitive impact," and "difficulty sleeping" higher compared with HCP, who ranked "joint symptoms," "lung symptoms," and "dysphagia" higher. Both patients and providers rated muscle symptoms as their top domain. In general, patients from different countries were in agreement on which domains were most important. One notable exception was that patients from Sweden and the Netherlands ranked lung symptoms significantly higher compared to other countries including the United States and Australia (mean weighted rankings of 2.86 and 2.04 vs 0.76 and 0.80, respectively; p < 0.0001).

CONCLUSION

Substantial differences exist in how IIM is perceived by patients compared to HCP, with different domains prioritized. In contrast, patients' ratings across the world were largely similar.

Advancing the Development of Patient-reported Outcomes for Adult Myositis at OMERACT 2016: An International Delphi Study

OBJECTIVE

To define a set of core patient-reported domains and respective instruments for use in idiopathic inflammatory myopathies (IIM). Previously, we reported a systematic literature review on patient-reported outcomes (PRO) in IIM followed by conducting international focus groups to elicit patient perspectives of myositis symptoms and effects.

METHODS

Based on qualitative content analysis of focus groups, an initial list of 26 candidate domains was constructed. We subsequently conducted an international modified Delphi survey to identify the importance of each of the 26 domains. Participants were asked to rate each domain on a scale of 0-10 (0 = not important, 10 = very important).

RESULTS

In this first round of the Delphi survey, 643 patients participated from the United States (n = 543), Sweden (n = 49), and South Korea (n = 51). Of the 26 domains, 19 (73%) were rated of high importance (≥ 7/10). The top 5 domains were muscle symptoms, fatigue, interactions with healthcare, medication side effects, and pain. During Outcome Measures in Rheumatology (OMERACT) 2016, we discussed the goal for ultimate reduction in the number of domains and the importance of considering representation of healthcare providers from other specialties, caregivers, representatives of pharmaceutical industries, and regulatory authorities in the next rounds of Delphi to represent broader perspectives on IIM.

CONCLUSION

Further prioritization and a reduction in the number of domains will be needed for the next Delphi. At the next biennial OMERACT meeting, we aim to present and seek voting on a Myositis Preliminary PRO Core Set to enable ultimate measure selection and development.

Patients’ Experience of Myositis and Further Validation of a Myositis-specific Patient Reported Outcome Measure — Establishing Core Domains and Expanding Patient Input on Clinical Assessment in Myositis. Report from OMERACT 12

Objective.

The Outcome Measures in Rheumatology (OMERACT) myositis working group was established to examine patient-reported outcomes (PRO) as well as to validate patient-reported outcome measures (PROM) in myositis.

Methods.

Qualitative studies using focus group interviews and cognitive debriefing of the myositis-specific Myositis Activities Profile (MAP) were used to explore the experience of adults living with polymyositis (PM) and dermatomyositis (DM).

Results.

Preliminary results underscore the importance of patient input in the development of PROM to ensure content validity. Results from multicenter focus groups indicate the range of symptoms experienced including pain, fatigue, and impaired cognitive function, which are not currently assessed in myositis. Preliminary cognitive debriefing of the MAP indicated that while content was deemed relevant and important, several activities were not included; and that questionnaire construction and wording may benefit from revision. A research agenda was developed to continue work toward optimizing PRO assessment in myositis with 2 work streams. The first would continue to conduct and analyze focus groups until saturation in the thematic analysis was achieved to develop a framework that encompassed the patient-relevant aspects of myositis. The second would continue cognitive debriefing of the MAP to identify potential areas for revision. There was agreement that further work would be needed for inclusion body myositis and juvenile dermatomyositis, and that the inclusion of additional contributors such as caregivers and individuals from the pharmaceutical/regulatory spheres would be desirable.

Conclusions.

The currently used PROM do not assess symptoms or the effects of disease that are most important to patients; this emphasizes the necessity of patient involvement. Our work provides concrete examples for PRO identification.

Outcome Measures for Clinical Trials in Interstitial Lung Diseases

The chronic fibrosing idiopathic interstitial pneumonias (IIPs) are a group of heterogeneous pulmonary parenchymal disorders described by radiologic and histological patterns termed usual interstitial pneumonia (UIP) and non-specific interstitial pneumonia (NSIP). These include idiopathic pulmonary fibrosis (IPF) and those related to connective tissue disease (CTD) and are associated with substantial morbidity and mortality. Beyond the importance of establishing an appropriate diagnosis, designing optimal clinical trials for IIPs has been fraught with difficulties in consistency of clinical endpoints making power analyses, and the establishment of efficacy and interpretation of results across trials challenging. Preliminary recommendations, developed by rigorous consensus methods, proposed a minimum set of outcome measures, a 'core set', to be incorporated into future clinical trials (Saketkoo et al, THORAX. 2014.). This paper sets out to examine the candidate instruments for each domain (Dyspnea, Cough, Health Related Quality of Life, Imaging, Lung Physiology and Function, Mortality). Candidate measures that were not selected as well as measures that were not available for examination at the time of the consensus process will also be discussed.

Reconciling healthcare professional and patient perspectives in the development of disease activity and response criteria in connective tissue disease-related interstitial lung diseases

Interstitial lung diseases (ILD), including those related to connective tissue disease (CTD), and idiopathic pulmonary fibrosis (IPF) carry high morbidity and mortality. Great efforts are under way to develop and investigate meaningful treatments in the context of clinical trials. However, efforts have been challenged by a lack of validated outcome measures and by inconsistent use of measures in clinical trials. Lack of consensus has fragmented effective use of strategies in CTD-ILD and IPF, with a history of resultant difficulties in obtaining agency approval of treatment interventions. Until recently, the patient perspective to determine domains and outcome measures in CTD-ILD and IPF had never been applied. Efforts described here demonstrate unequivocally the value and influence of patient involvement on core set development. Regarding CTD-ILD, this is the first OMERACT working group to directly address a manifestation/comorbidity of a rheumatic disease (ILD) as well as a disease not considered rheumatic (IPF). The OMERACT 11 proceedings of the CTD-ILD Working Group describe the forward and lateral process to include both the medical and patient perspectives in the urgently needed identification of a core set of preliminary domains and outcome measures in CTD-ILD and IPF.

Patient-reported outcomes and adult patients' disease experience in the idiopathic inflammatory myopathies. report from the OMERACT 11 Myositis Special Interest Group

The newly formed Outcome Measures in Rheumatology (OMERACT) Myositis Special Interest Group (SIG) was established to examine patient-reported outcome measures (PROM) in myositis. At OMERACT 11, a literature review of PROM used in the idiopathic inflammatory myopathies (IIM) and other neuromuscular conditions was presented. The group examined in more detail 2 PROM more extensively evaluated in patients with IIM, the Myositis Activities Profile, and the McMaster-Toronto Arthritis Patient Preference Disability Questionnaire, through the OMERACT filter of truth, discrimination, and feasibility. Preliminary results from a qualitative study of patients with myositis regarding their symptoms were discussed that emphasized the range of symptoms experienced: pain, physical tightness/stiffness, fatigue, disease effect on emotional life and relationships, and treatment-related side effects. Following discussion of these results and following additional discussions since OMERACT 11, a research agenda was developed. The next step in evaluating PROM in IIM will require additional focus groups with a spectrum of patients with different myositis disease phenotypes and manifestations across a range of disease activity, and from multiple international settings. The group will initially focus on dermatomyositis and polymyositis in adults. Qualitative analysis will facilitate the identification of commonalities and divergent patient-relevant aspects of disease, insights that are critical given the heterogeneous manifestations of these diseases. Based on these qualitative studies, existing myositis PROM can be examined to more thoroughly assess content validity, and will be important to identify gaps in domain measurement that will be required to develop a preliminary core set of patient-relevant domains for IIM.

Connective tissue disease related interstitial lung diseases and idiopathic pulmonary fibrosis: provisional core sets of domains and instruments for use in clinical trials

RATIONALE

Clinical trial design in interstitial lung diseases (ILDs) has been hampered by lack of consensus on appropriate outcome measures for reliably assessing treatment response. In the setting of connective tissue diseases (CTDs), some measures of ILD disease activity and severity may be confounded by non-pulmonary comorbidities.

METHODS

The Connective Tissue Disease associated Interstitial Lung Disease (CTD-ILD) working group of Outcome Measures in Rheumatology-a non-profit international organisation dedicated to consensus methodology in identification of outcome measures-conducted a series of investigations which included a Delphi process including >248 ILD medical experts as well as patient focus groups culminating in a nominal group panel of ILD experts and patients. The goal was to define and develop a consensus on the status of outcome measure candidates for use in randomised controlled trials in CTD-ILD and idiopathic pulmonary fibrosis (IPF).

RESULTS

A core set comprising specific measures in the domains of lung physiology, lung imaging, survival, dyspnoea, cough and health-related quality of life is proposed as appropriate for consideration for use in a hypothetical 1-year multicentre clinical trial for either CTD-ILD or IPF. As many widely used instruments were found to lack full validation, an agenda for future research is proposed.

CONCLUSION

Identification of consensus preliminary domains and instruments to measure them was attained and is a major advance anticipated to facilitate multicentre RCTs in the field.