Psychometric properties of outcome measurement instruments for ANCA-associated vasculitis: a systematic literature review

A systematic review of patient-reported outcome measures in patients with anti-neutrophil cytoplasmic antibody associated vasculitis

OBJECTIVES

ANCA-associated vasculitis (AAV) is associated with significant morbidity, fatigue, pain and poor health-related quality of life (HRQoL). This review aims to assess the comprehensiveness of existing patient reported outcome measures (PROMs) used in AAV and identify associations with poorer HRQoL outcomes.

METHODS

A literature review of studies using PROMs, including those labelled HRQoL in people with AAV as a primary or secondary study outcome were screened and reviewed up to July 2023. Quality was assessed using the Critical Appraisal Skills Programme.

RESULTS

A total of 30 articles were included which utilised 22 different PROM tools, 76.7% (n = 23) used the SF-36 or a variation as a generic measure of health status and or HRQoL. Two studies developed a disease-specific PROM. The AAV-PRO showed good psychometric properties but potential limitations in capturing all relevant aspects of the disease experience for AAV patients. Factors associated with poorer HRQoL included: neurological and sinonasal involvement, women and younger patients. A total of 86.6% of studies showed no meaningful relationships between the SF-36 and BVAS, VDI or disease duration. Depression and anxiety were common and socioeconomic factors such as unemployment were significantly associated with poorer mental health outcomes. Glucocorticoids were found to be independently associated with worse SF-36 scores.

CONCLUSION

Generic PROMs are useful in measuring significant changes but lack sensitivity to specific symptoms and unique AAV-related issues, while existing disease-specific PROMs have some limitations and may not fully capture the AAV patient's perspective on disease and treatment burden.

Treatment goals in ANCA-associated vasculitis: defining success in a new era

Health-related quality of life is a key contributor to overall well-being, and this is becoming an increasingly prominent factor when making therapeutic choices in the management of ANCA-associated vasculitis (AAV). Progress in available therapeutic strategies for AAV has resulted in this historically acute disease with a potentially fatal short-term outcome, becoming a relapsing-remitting chronic disorder. This new perspective on AAV means that patient survival should no longer be considered as the only major treatment target. Additional outcomes in this context that should be portrayed in order to consider a therapeutic approach as successful include patient quality of life, as well as the burden of treatment-induced morbidity. Comorbidities and impaired quality of life in patients with AAV, as with many other autoimmune diseases, may be a consequence of the disease itself as well as a result of the therapy employed. The AAV disease process may induce organ damage, including kidney failure and structural lung damage, and increase the risk of cardiovascular disease. On top of this, treatments employed to manage the disease may contribute further to the overall comorbidities burden. Furthermore, pre-existing comorbidities can increase AAV severity and may also be contraindications that limit potential therapeutic options. Quality of life is another central topic that can have a huge impact on patient wellbeing as well as adherence to treatment. Ongoing monitoring of comorbidity risk and of quality of life is thus key for successful AAV management. This process, however, may be complicated; the identification of the correct parameters on which to focus is not always straightforward and, more importantly, it is sometimes the symptoms that may appear trivial to physicians that are most detrimental to a patient's quality of life. With these shifts in treatment capabilities and understanding of patient burden, it is necessary to adjust the treatment paradigm accordingly. Treatment success is no longer defined solely by the control of disease activity; treatment success requires holistic improvement determined through the assessment of all aspects of the disease, ranging from disease control to comorbidity risk through to the assessment of health-related quality of life. This review explores the burden of AAV itself as well as treatment-related side effects with a special focus on the tools available to measure outcomes. The management of AAV has entered a new era with a strong focus on both the management and prevention of comorbidities as well as patient-reported outcomes, both of which are now considered key factors in defining treatment success.

Developing a disease-specific patient reported outcome measure to enhance understanding of the lived experiences of ANCA associated vasculitis: A protocol paper

Anti-neutrophil cytoplasmic antibody (ANCA) associated vasculitis (AAV) is a chronic, relapsing-remitting condition associated with increased morbidity. Previous research has shown patients with AAV report high levels of fatigue, pain, depression and anxiety. Over recent years successful work has been carried out to improve clinical outcomes, resulting in reduced mortality and end stage kidney disease (ESKD). Despite this, little work has been done to better understand the role of the patient within this condition. The prevalence of AAV is increasing and to date, there is a shortage of specific tools that assess and measure key features relating to patient reported outcomes (PROs). This protocol details how we can better understand the lived experiences of those with AAV through the development of a disease specific, patient reported outcome measure (PROM), to be used in clinic practice. This will allow us to recognise and validate PROs and the impact the disease and its treatment has on patients' health related quality of life (HRQoL). In addition, we aim to identify potential differences in PRO's between demographics, organ involvement and treatment subgroups in AAV as well as outcomes relating to the patient experience. Patients from a single centre in the UK will be recruited to take part in the exploratory qualitative study which will include focus groups and semi-structured interviews. The inclusion criteria comprise anyone with a diagnosis of AAV and willing to participate, including those who have active or relapsing disease, those are economically active, unemployed, retired and patients receiving renal replacement therapy. The aim of the project is to identify key issues patients experience in relation to their disease and its management and how these can be better assessed in a new PROM developed for use in the clinic setting. This will enable better delivery of individualised care and inform shared decision making, while also serving as a platform for future research looking at PROs in other glomerulonephritides.

Validation of the Italian version of the ANCA-associated vasculitis patient-reported outcome (AAV-PRO) questionnaire

Objectives

The primary objective of this study was the translation and validation of the ANCA-associated vasculitis patient-reported outcome (AAV-PRO) questionnaire into Italian, denoted as AAV-PRO_ita. The secondary objective was to evaluate the impact of ANCA-associated vasculitis (AAV) on quality of life (QoL) and work impairment in a large cohort of Italian patients.

Methods

The study design took a prospective cohort study approach. First, the AAV-PRO was translated into Italian following the step guidelines for translations. The new AAV-PRO_ita questionnaire covered three disease domains: organ-specific and systemic symptoms and signs; physical function; and social and emotional impact. Second, Italian-speaking AAV patients were recruited from 17 Italian centres belonging to the Italian Vasculitis Study Group. Participants completed the AAV-PRO_ita questionnaire at three time points. Participants were also requested to complete the work productivity and activity impairment: general health questionnaire.

Results

A total of 276 AAV patients (56.5% women) completed the questionnaires. The AAV-PRO_ita questionnaire demonstrated a good internal consistency and test-retest reliability. Female AAV patients scored higher (i.e. worse) in all thee domains, especially in the social and emotional impact domain (P < 0.001). Patients on glucocorticoid therapy (n = 199) had higher scores in all domains, especially in the physical function domain (P < 0.001), compared with patients not on glucocorticoid therapy (n = 77). Furthermore, patients who had at least one relapse of disease (n = 114) had higher scores compared with those who had never had one (n = 161) in any domain (P < 0.05). Finally, nearly 30% of the patients reported work impairment.

Conclusion

The AAV-PRO_ita questionnaire is a new 29-item, disease-specific patient-reported outcome measuring tool that can be used in AAV research in the Italian language. Sex, glucocorticoids and relapsing disease showed the greatest impact on QoL.

How is the patient perspective captured in ANCA-associated vasculitis research? An integrative review

Objective

The aim was to describe how the patient perspective is captured in clinical research on ANCA-associated vasculitis (AAV).

Methods

This integrative review included 2149 publications found in four different databases and manual searches. After screening, 156 articles remained. All articles were sorted and categorized, and 77 original articles were analysed further.

Results

The patient perspective was captured with patient-reported outcome measures (PROMs), single-item questionnaires, project-specific questionnaires and interviews. The most common aspects measured were health-related quality of life, anxiety and depression, and fatigue, and the least common were lifestyle habits, relationships and self-management.

Conclusion

The patient perspective was captured predominantly with generic PROMs and occasionally with a qualitative approach. AVV is a lifelong disease, and the results from this review show that not all aspects of importance to patients are covered with the PROMs used in research. Future studies should include the areas that are the most important for patients.

Development and internal validation of a model to predict long-term survival of ANCA associated vasculitis

Objectives

Risk stratification and prognosis prediction are critical for appropriate management of anti-neutrophil cytoplasmic antibody (ANCA) associated vasculitis (AAV). Herein, we aim to develop and internally validate a prediction model specifically for long-term survival of patients with AAV.

Methods

We thoroughly reviewed the medical charts of patients with AAV admitted to Peking Union Medical College Hospital from January 1999 to July 2019. The Least Absolute Shrinkage and Selection Operator method and the COX proportional hazard regression was used to develop the prediction model. The Harrell's concordance index (C-index), calibration curves and Brier scores were calculated to evaluate the model performance. The model was internally validated by bootstrap resampling methods.

Results

A total of 653 patients were included in the study, including 303 patients with microscopic polyangiitis, 245 patients with granulomatosis with polyangiitis and 105 patients with eosinophilic granulomatosis with polyangiitis, respectively. During a median follow-up of 33 months (interquartile range 15-60 months), 120 deaths occurred. Age at admission, chest and cardiovascular involvement, serum creatinine grade, hemoglobin levels at baseline and AAV sub-types were selected as predictive parameters in the final model. The optimism-corrected C-index and integrated Brier score of our prediction model were 0.728 and 0.109. The calibration plots showed fine agreement between observed and predicted probability of all-cause death. The decision curve analysis (DCA) showed that in a wide range of threshold probabilities, our prediction model had higher net benefits compared with the revised five factor score (rFFSand) and the birmingham vasculitis activity score (BVAS) system.

Conclusion

Our model performs well in predicting outcomes of AAV patients. Patients with moderate-to-high probability of death should be followed closely and personalized monitoring plan should be scheduled.

Patient-reported outcomes in ANCA-associated vasculitis: a cross-sectional study to explore the interactions between patients' and physicians' perspectives

To evaluate associations between the domains of the ANCA-associated vasculitis patient-reported outcome (AAV-PRO) instrument and clinical variables. Patients with granulomatosis with polyangiitis (GPA), microscopic polyangiitis (MPA), eosinophilic granulomatosis with polyangiitis (EGPA), or renal-limited vasculitis (RLV) were recruited from a tertiary care center in Mexico City. Demographic, clinical, serological, and treatment-related data were retrieved. Disease activity, damage, patient and physician global assessments (PtGA and PhGA) were evaluated. All patients completed the AAV-PRO questionnaire, male patients also completed the International Index of Erectile Function (IIEF-5) questionnaire. Seventy patients (44 women and 26 men) were included, with a median age of 53.5 years (43-61), and a disease duration of 82 months (34-135). Moderate correlations were identified between the PtGA and the AAV-PRO domains: social and emotional impact, treatment side effects, organ-specific symptoms, and physical function. The PhGA correlated with the PtGA and prednisone doses. Subanalyses of the AAV-PRO domains according to sex, age, and disease duration showed significant differences in the treatment side effects domain, with higher scores in women, in patients < 50 years, and in patients with disease duration < 5 years. The domain of concerns about the future showed a higher score in patients with disease duration < 5 years. A total of 17/24 (70.8%) of men who completed the IIEF-5 questionnaire were classified as having some degree of erectile dysfunction. The domains of AAV-PRO correlated with other outcome measures, while differences were found between some of the domains according to sex, age, and disease duration.

Patient and Physician Global Assessments of Disease Status in Systemic Sclerosis

Global assessments of disease by both patients and physicians are widely used in clinical studies of systemic sclerosis (SSc). They are commonly secondary end points in randomized controlled trials (RCTs) and are considered important items in composite measures of treatment response. A comprehensive literature review was conducted of the formats, wording, and clinimetric properties of the patient global assessment of disease status (PtGA) and physician global assessment of disease status (PhGA) used in RCTs of SSc. Marked heterogeneity was found in the wording and measurement scales of the global assessments applied in RCTs. These instruments were not developed using rigorous methodology and have not been fully validated. There is a pressing need for standardization and validation of patient and physician global assessment tools in SSc to enable universal application of these measures across RCTs in SSc.