Development and calibration of an item bank for the assessment of activities of daily living in cardiovascular patients using Rasch analysis

Dimensionality and invariance of ADL, IADL, BI-M2/WG-SS, and GALI in large surveys in France (2008-2014) and implications for measuring disability in epidemiology

BACKGROUND

The epidemiological investigation and surveillance of disability requires well-constructed, invariant, and, if possible, exchangeable measures. However, the current or recommended measures have not been thoroughly investigated with respect to these issues. Here we examined the dimensional structure and invariance of four measures across sociodemographic groups: Activities of Daily Living (ADL), Instrumental Activities of Daily Living (IADL), Budapest Initiative Mark 2 (BI-M2) and Washington Group on Disability Statistics Short Set (WG-SS), and Global Activity Limitation Indicator (GALI).

METHODS

We used data from three large nationwide representative surveys conducted in France between 2008 and 2014. The surveys included these four measures and classical and modern approaches (correlations, principal component analysis, Rasch modeling) were used to assess their dimensional structure as well as their invariance through differential item functioning (DIF) for sociodemographic characteristics. Polytomous logistic regression models were used to assess gradients in health inequalities associated with these measures.

RESULTS

For many items of ADL, IADL, and BI-M2/WG-SS, we consistently observed disordered response thresholds, rejection of unidimensionality, and DIF evidence for sociodemographic characteristics across the survey samples. Health inequality gradients were erratic. In addition, it was impossible to identify a common continuum for GALI, ADL, IADL, and BI-M2/WG-SS or their constituent items.

CONCLUSION

This study warns against the current practice of investigating disability in epidemiology using measures that are unsuitable for epidemiological use, incommensurable, and inadequate regarding the basic requisites of dimensionality and invariance. Developing invariant measures and equating them along a common continuum to enlarge the common bases of measurement should therefore be a priority.

Patient-centered care in Coronary Heart Disease: what do you want to measure? A systematic review of reviews on patient-reported outcome measures

Background

The number of published articles on Patient-Reported Outcomes Measures (PROMs) in Coronary Heart Disease (CHD), a leading cause of disability-adjusted life years lost worldwide, has been growing in the last decades. The aim of this study was to identify all the disease-specific PROMs developed for or used in CHD and summarize their characteristics (regardless of the construct), to facilitate the selection of the most adequate one for each purpose.

Methods

A systematic review of reviews was conducted in MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews. PROQOLID and BiblioPRO libraries were also checked. PROMs were classified by construct and information was extracted from different sources regarding their main characteristics such as aim, number of items, specific dimensions, original language, and metric properties that have been assessed.

Results

After title and abstract screening of 1224 articles, 114 publications were included for full text review. Finally, we identified 56 PROMs: 12 symptoms scales, 3 measuring functional status, 21 measuring Health-Related Quality of Life (HRQL), and 20 focused on other constructs. Three of the symptoms scales were specifically designed for a study (no metric properties evaluated), and only five have been included in a published study in the last decade. Regarding functional status, reliability and validity have been assessed for Duke Activity Index and Seattle Angina Questionnaire, which present multiple language versions. For HRQL, most of the PROMs included physical, emotional, and social domains. Responsiveness has only been evaluated for 10 out the 21 HRQL PROMs identified. Other constructs included psychological aspects, self-efficacy, attitudes, perceptions, threats and expectations about the treatment, knowledge, adjustment, or limitation for work, social support, or self-care.

Conclusions

There is a wide variety of instruments to assess the patients’ perspective in CHD, covering several constructs. This is the first systematic review of specific PROMs for CHD including all constructs. It has practical significance, as it summarizes relevant information that may help clinicians, researchers, and other healthcare stakeholders to choose the most adequate instrument for promoting shared decision making in a trend towards value-based healthcare.

Calibration of an item bank in 474 orthopedic patients using Rasch analysis for computer-adaptive assessment of anxiety

OBJECTIVE

To calibrate an item bank of anxiety-related questions for use in orthopedic patients within a computer-adaptive test.

DESIGN

This is a psychometric study.

SETTING

The sample of orthopedic patients was recruited in two orthopedic rehabilitation clinics in Germany.

SUBJECTS

A total of 474 orthopedic rehabilitation patients were recruited for this study.

INTERVENTIONS

Not applicable.

MAIN MEASURES

The main measure is an adapted version of an existing anxiety item pool for cardiovascular rehabilitation patients.

RESULTS

The results of the confirmatory factor analysis and Mokken analysis confirmed a one-factor structure and double monotonicity. An anxiety item bank (48 items) could be developed and calibrated using Rasch analysis. It fitted to the Rasch model with a non-significant item-trait interaction (χ²(203) = 172.59; P = .94) and was free of differential item functioning. Unidimensionality could be verified and the person separation reliability was .96. The category threshold parameters varied between 4.72 and 3.16 (7.88 logits).

CONCLUSION

The unidimensional anxiety item bank provides the basis for a computer-adaptive test to assess a wide range of anxiety in rehabilitation patients with orthopedic diseases with very good psychometric characteristics.

Development of Rasch-based short screenings for the assessment of treatment motivation in patients with cardiovascular diseases

Purpose: The aim of the study was to develop unidimensional test-fair and economic short screenings to assess treatment motivation in patients with cardiovascular diseases using the Rasch analysis.Materials and methods: After pretesting for relevance and comprehension, a pool of 132 items on treatment motivation was completed by a sample consisting of 1168 patients with cardiovascular diseases recruited in two German cardiological rehabilitation centers. Confirmatory factor analyses and the Rasch analyses were conducted.Results: The confirmatory factor analyses confirmed a three-factor structure of the treatment motivation construct with task self-efficacy, outcome expectancies and intention as factors. Using the Rasch analysis for each of the three factors and removing items with misfit, differential item functioning and local response dependency reduced the initial item pool to the three short screenings. The short screenings fit to the Rasch model with a root mean square error of approximation (RMSEA = 0.021 (task self-efficacy; seven items); RMSEA = 0.024 (outcome expectancies; 12 items), RMSEA = 0.027 (intention; nine items). Person-separation reliability was 0.81, 0.82, and 0.73. Unidimensionality could be verified.Conclusions: The calibrated, unidimensional short screenings provide a psychometrically sound option for an initial- and follow-up assessment of treatment motivation in rehabilitation patients with cardiovascular diseases. Further testing in other cardiovascular diseases populations is needed to increase generalizability.Implications for rehabilitationNew short screenings for the assessment of treatment motivation: task self-efficacy, outcome expectancies, intention in rehabilitation patients with cardiovascular diseases are available.Treatment motivation short screenings_{self-efficacy/outcome expectancies/intention} consist of seven items (treatment motivation short screening_{self-efficacy}), 12 items (treatment motivation short screening_{outcome expectancies}), nine items (treatment motivation short screening_intention) and are therefore especially timesaving.The short screenings demonstrate good psychometric properties, cover a wide spectrum of task self-efficacy, outcome expectancies and intention, and are free of local dependencies and of differential item functioning regarding to gender, age and cardiovascular diagnoses.Using a Rasch based unidimensional short screening is a test-fair and economic method to assess patients' treatment motivation, which might help to improve rehabilitation health care tailored to patients' needs.

Do patients have a say? A narrative review of the development of patient-reported outcome measures used in elective procedures for coronary revascularisation

PURPOSE

Patient-reported outcome measures (PROMs) capture health information from the patient's perspective that can be used when weighing up benefits, risks and costs of treatment. This is important for elective procedures such as those for coronary revascularisation. Patients should be involved in the development of PROMs to accurately capture outcomes that are important for the patient. The aims of this review are to identify if patients were involved in the development of cardiovascular-specific PROMs used for assessing outcomes from elective coronary revascularisation, and to explore what methods were used to capture patient perspectives.

METHODS

PROMs for evaluating outcomes from elective coronary revascularisation were identified from a previous review and an updated systematic search. The studies describing the development of the PROMs were reviewed for information on patient input in their conceptual and/or item development.

RESULTS

24 PROMs were identified from a previous review and three additional PROMs were identified from the updated search. Full texts were obtained for 26 of the 27 PROMs. The 26 studies (11 multidimensional, 15 unidimensional) were reviewed. Only nine studies reported developing PROMs using patient input. For eight PROMs, the inclusion of patient input could not be judged due to insufficient information in the full text.

CONCLUSIONS

Only nine of the 26 reviewed PROMs used in elective coronary revascularisation reported involving patients in their conceptual and/or item development, while patient input was unclear for eight PROMs. These findings suggest that the patient's perspective is often overlooked or poorly described in the development of PROMs.

Parallel short forms for the assessment of activities of daily living in cardiovascular rehabilitation patients (PADL-cardio): development and validation

PURPOSE

To develop and validate parallel short forms for the assessment of activities of daily living in cardiac rehabilitation patients (PADL-cardio I & II).

METHOD

PADL-cardio I & II were developed based on a sample of 106 patients [mean age  =  57.6; standard deviation (SD) = 11.1; 72.6% males] using Rasch analysis and validated with a sample of 81 patients (mean age  =  59.1; SD  =  11.1; 88.9% males). All patients answered PADL-cardio and the Short Form 12 Health Survey.

RESULTS

Both versions of PADL-cardio are composed of 10 items. The fit to the Rasch model was given documented by a non-significant Item-trait interaction score (PADL-cardio I: χ² = 31.08, df  =  30, p  =  0.41; PADL-cardio II: χ² = 45.6, df  =  40, p  =  0.25). The two versions were free of differential item functioning. Person-separation reliability was 0.72/0.78 and unidimensionality was given. The two versions correlated with r = 0.98 and the correlation between PADL-cardio and the underlying item bank was 0.99 for both versions. Concurrent validity is indicated through correlations with the Short Form 12 Health Survey (r  = -0.37 to -0.40).

CONCLUSION

PADL-cardio provides a short and psychometrically sound option for the assessment of activities of daily living in cardiovascular rehabilitation patients. The two versions of PADL-cardio are equivalent. Hence, they can be used to reduce practice and retest effects in repeated measurement, facilitating the longitudinal assessment of activities of daily living. Implications for Rehabilitation New parallel test forms for the assessment of activities of daily living in cardiac rehabilitation (PADL-cardio I & PADL-cardio II) are available. PADL-cardio I & II consist of 10 items and are therefore especially timesaving. Concurrent validity is given through correlations with the Short Form Health Survey 12. Therapeutic success could be determined more precisely by the parallel forms reducing practice and retest effects.

Development and validation of parallel short forms PaSA-cardio for the assessment of general anxiety in cardiovascular rehabilitation patients using Rasch analysis

OBJECTIVE

To develop and validate parallel short forms for the assessment of general anxiety in cardiovascular rehabilitation patients, that facilitate repeated measurement over time without contamination from residual practice effect variance.

DESIGN

Development of the parallel short forms using Rasch analysis. Validation study.

SETTING

Cardiac rehabilitation centres in Germany.

SUBJECTS

Cardiovascular rehabilitation patients.

INTERVENTIONS

Not applicable.

MAIN MEASURES

Parallel short forms PaSA-cardio, Hospital Anxiety and Depression Scale, Short Form Health Survey SF-12 and Structured Clinical Interview for DSM-IV Axis I Disorders.

RESULTS

Each version of the parallel short forms (PaSA-cardio-I and PaSA-cardio-II) comprises ten items. The two forms fitted to the Rasch model with a non-significant item-trait interaction (PaSA-cardio-I: chi-square = 39.49, degrees of freedom = 30, probability = 0.12; PaSA-cardio-II: chi-square = 26.56, degrees of freedom = 30, probability = 0.65). Person-separation reliability was 0.75/0.76. Unidimensionality could be verified. Correlation between the two models was 0.94 and 0.95, and correlations with the underlying item bank were 0.95 and 0.93. Validity could be confirmed. The area under the curve was between 0.88 and 0.97 for PaSA-cardio-I and between 0.92 and 0.95 for PaSA-cardio-II.

CONCLUSIONS

Assessment of general anxiety in cardiovascular rehabilitation patients with the PaSA-cardio was valid, economical and accurate. The two forms of the PaSA-cardio are equivalent and allow retest without contamination from residual practice effect variance.

Development and evaluation of a computer adaptive test to assess anxiety in cardiovascular rehabilitation patients

OBJECTIVE

To develop and evaluate a computer adaptive test for the assessment of anxiety in cardiovascular rehabilitation patients (ACAT-cardio) that tailors an optimal test for each patient and enables precise and time-effective measurement.

DESIGN

Simulation study, validation study (against the anxiety subscale of the Hospital Anxiety and Depression Scale and the physical component summary scale of the 12-Item Short-Form Health Survey), and longitudinal study (beginning and end of rehabilitation).

SETTING

Cardiac rehabilitation centers.

PARTICIPANTS

Cardiovascular rehabilitation patients: simulation study sample (n=106; mean age, 57.8y; 25.5% women) and validation and longitudinal study sample (n=138; mean age, 58.6 and 57.9y, respectively; 16.7% and 12.1% women, respectively).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Hospital Anxiety and Depression Scale, 12-Item Short-Form Health Survey, and ACAT-cardio.

RESULTS

The mean number of items was 9.2 with an average processing time of 1:13 minutes when an SE ≤.50 was used as a stopping rule; with an SE ≤.32, there were 28 items and a processing time of 3:47 minutes. Validity could be confirmed via correlations between .68 and .81 concerning convergent validity (ACAT-cardio vs Hospital Anxiety and Depression Scale anxiety subscale) and correlations between -.47 and -.30 concerning discriminant validity (ACAT-cardio vs 12-Item Short-Form Health Survey physical component summary scale). Sensitivity to change was moderate to high with standardized response means between .45 and .82.

CONCLUSIONS

The ACAT-cardio shows good psychometric properties and provides the opportunity for an innovative and time-effective assessment of anxiety in cardiovascular rehabilitation. A more flexible stopping rule might further improve the ACAT-cardio. Additionally, testing in other cardiovascular populations would increase generalizability.