Evaluation of measurement equivalence of the Family Satisfaction with the End-of-Life Care in an ethnically diverse cohort: tests of differential item functioning

The Rasch Analysis Shows Poor Construct Validity and Low Reliability of the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 (QUEST 2.0) Questionnaire

This study aims to test the construct validity and reliability of the Quebec User Evaluation of Satisfaction with assistive Technology 2.0 (QUEST)-device, an eight-item questionnaire for measuring satisfaction with assistive devices. We collected 250 questionnaires from 79 patients and 32 caregivers. One QUEST was completed for each assistive device. Five assistive device types were included. QUEST was tested with the Rasch analysis (Many-Facet Rating Scale Model: persons, items, and device type). Most patients were affected by neurological disabilities, and most questionnaires were about mobility devices. All items fitted the Rasch model (InfitMS range: 0.88-1.1; OutfitMS: 0.84-1.28). However, the ceiling effect of the questionnaire was large (15/111 participants totalled the maximum score), its targeting poor (respondents mean measure: 1.90 logits), and its reliability was 0.71. The device classes had different calibrations (range: -1.18 to 1.26 logits), and item 3 functioned differently in patients and caregivers. QUEST satisfaction measures have low reliability and weak construct validity. Lacking invariance, the QUEST total score is unsuitable for comparing the satisfaction levels of users of different device types. The differential item functioning suggests that the QUEST could also be problematic for comparing satisfaction in patients and caregivers.

Evaluation of measurement equivalence of the Family Satisfaction with the End-of-Life Care (FAMCARE): Tests of differential item functioning between Hispanic and non-Hispanic White caregivers

OBJECTIVE

Although the psychometric properties of the Family Satisfaction with End-of-Life Care measure have been examined in diverse settings internationally; little evidence exists regarding measurement equivalence in Hispanic caregivers. The aim was to examine the psychometric properties of a short-form of the FAMCARE in Hispanics using latent variable models and place information on differential item functioning (DIF) in an existing family satisfaction item bank.

METHOD

The graded form of the item response theory model was used for the analyses of DIF; sensitivity analyses were performed using a latent variable logistic regression approach. Exploratory and confirmatory factor analyses to examine dimensionality were performed within each subgroup studied. The sample included 1,834 respondents: 317 Hispanic and 1,517 non-Hispanic White caregivers of patients with Alzheimer's disease and cancer, respectively.

RESULTS

There was strong support for essential unidimensionality for both Hispanic and non-Hispanic White subgroups. Modest DIF of low magnitude and impact was observed; flagged items related to information sharing. Only 1 item was flagged with significant DIF by both a primary and sensitivity method after correction for multiple comparisons: "The way the family is included in treatment and care decisions." This item was more discriminating for the non-Hispanic, White responders than for the Hispanic subsample, and was also a more severe indicator at some levels of the trait; the Hispanic respondents located at higher satisfaction levels were more likely than White non-Hispanic respondents to report satisfaction.

SIGNIFICANCE OF RESULTS

The magnitude of DIF was below the salience threshold for all items. Evidence supported the measurement equivalence and use for cross-cultural comparisons of the short-form FAMCARE among Hispanic caregivers, including those interviewed in Spanish.

Psychometric Properties of a Spanish-Language Version of a Short-Form FAMCARE: Applications to Caregivers of Patients With Alzheimer's Disease and Related Dementias

Although family satisfaction is recognized as a critical indicator of quality care for persons with serious illness, Spanish-language measures are limited. The study aims were to develop a Spanish translation of the short-form Family Satisfaction With End-of-Life Care (FAMCARE), investigate its psychometric properties in Hispanic caregivers to patients with Alzheimer's disease and related dementias (ADRD; N = 317; 209 interviewed in Spanish), and add parameters to an existing item bank. Based on factor analyses, the measure was found to be essentially unidimensional. Reliabilities from a graded item response theory model were high; the average estimate was 0.93 for the total and Spanish-language subsample. Discrimination parameters were high, and the model fit adequate. This is the first study to examine the performance of the short-form FAMCARE measure among Hispanics and caregivers to patients with ADRD. The short-form measure can be recommended for Hispanics and caregivers to patients with ADRD.

The Use of a Brief 5-Item Measure of Family Satisfaction as a Critical Quality Indicator in Advanced Cancer Care: A Multisite Comparison

BACKGROUND

Although family satisfaction is recognized as a critical indicator of quality for patients with advanced cancer, it is rarely assessed as part of routine clinical care. Measurement burden may be one barrier to widespread use of family satisfaction measures.

OBJECTIVE

The goal of this study was to test the ability of a new, brief 5-item measure of family satisfaction with care to accurately capture differences across hospital settings.

DESIGN

Using data from the Palliative Care for Cancer Patients study, a prospective study of 1979 patients and caregivers, we used multivariate regression analysis to detect significant differences across five sites.

SETTINGS

Hospitalized patients with advanced cancer and their caregivers Methods: We used both the shortened 5-item version of the FAMCARE scale (previously developed using Item Response Theory) and the original 20-item FAMCARE to measure family satisfaction.

RESULTS

On the 5-item FAMCARE, sites ranged from mean scores of 5.5-6.9 out of a possible high score of 10. Family members at one care site (n = 783) were significantly (p < 0.05) less satisfied with their care than family members at four other care sites. The original 20-item measure failed to differentiate satisfaction levels between all hospital sites.

DISCUSSION

Variability in family satisfaction with advanced cancer care across hospital settings can be more sensitively detected using a brief 5-item questionnaire versus longer measures. The development of less lengthy and burdensome measures for monitoring family satisfaction, which are still valid, can facilitate routine assessments to maintain and promote high-quality care across care settings.

The Spectrum of Caregiving in Palliative Care for Serious, Advanced, Rare Diseases: Key Issues and Research Directions

Rare diseases are often life-limiting conditions, the majority of which require constant caregiving needs. The realization of a spectrum of palliative care throughout the trajectory of rare diseases could ensure individualized and caregiver-focused approaches to the care of patients and families. In June 2015, the National Institute of Nursing Research (NINR), the lead institute at the National Institutes of Health for end-of-life research, in conjunction with the National Center for Advancing Translational Sciences, Office of Rare Diseases Research (ORDR) held an interdisciplinary workshop on the unique challenges of caregiving and palliative care in adult and pediatric rare diseases. The panel identified gaps in current knowledge, and afforded suggestions for research opportunities in palliative care science to improve the care of individuals with serious, advanced, rare diseases and their caregivers. This meeting provided an in-depth opportunity to incorporate new concepts into palliative and end-of-life care for individuals with a range of rare diseases and their caregivers. This report presents a summary of the workshop.

Use of an Item Bank to Develop Two Short-Form FAMCARE Scales to Measure Family Satisfaction With Care in the Setting of Serious Illness

CONTEXT

Family satisfaction is an important and commonly used research measure. Yet current measures of family satisfaction are lengthy and may be unnecessarily burdensome--particularly in the setting of serious illness.

OBJECTIVES

To use an item bank to develop short forms of the Family Satisfaction with End-of-Life Care (FAMCARE) scale, which measures family satisfaction with care.

METHODS

To shorten the existing 20-item FAMCARE measure, item response theory parameters from an item bank were used to select the most informative items. The psychometric properties of the new short-form scales were examined. The item bank was based on data from family members from an ethnically diverse sample of 1983 patients with advanced cancer.

RESULTS

Evidence for the new short-form scales supported essential unidimensionality. Reliability estimates from several methods were relatively high, ranging from 0.84 for the five-item scale to 0.94 for the 10-item scale across different age, gender, education, ethnic, and relationship groups.

CONCLUSION

The FAMCARE-10 and FAMCARE-5 short-form scales evidenced high reliability across sociodemographic subgroups and are potentially less burdensome and time-consuming scales for monitoring family satisfaction among seriously ill patients.