Assessing the construct validity of the Quality-of-Life-Aged Care Consumers (QOL-ACC): an aged care-specific quality-of-life measure

Reliability of the quality of life-aged care consumers (QOL-ACC) and EQ-5D-5L among older people using aged care services at home

PURPOSE

The Quality of Life-Aged Care Consumers (QOL-ACC), a valid preference-based instrument, has been rolled out in Australia as part of the National Quality Indicator (QI) program since April 2023 to monitor and benchmark the quality of life of aged care recipients. As the QOL-ACC is being used to collect quality of life data longitudinally as one of the key aged care QI indicators, it is imperative to establish the reliability of the QOL-ACC in aged care settings. Therefore, we aimed to assess the reliability of the QOL-ACC and compare its performance with the EQ-5D-5L.

METHODS

Home care recipients completed a survey including the QOL-ACC, EQ-5D-5L and two global items for health and quality of life at baseline (T1) and 2 weeks later (T2). Using T1 and T2 data, the Gwet's AC2 and intra-class correlation coefficient (ICC) were estimated for the dimension levels and overall scores agreements respectively. The standard error of measurement (SEM) and the smallest detectable change (SDC) were also calculated. Sensitivity analyses were conducted for respondents who did not change their response to global item of quality of life and health between T1 and T2.

RESULTS

Of the 83 respondents who completed T1 and T2 surveys, 78 respondents (mean ± SD age, 73.6 ± 5.3 years; 56.4% females) reported either no or one level change in their health and/or quality of life between T1 and T2. Gwet's AC2 ranged from 0.46 to 0.63 for the QOL-ACC dimensions which were comparable to the EQ-5D-5L dimensions (Gwet's AC2 ranged from 0.52 to 0.77). The ICC for the QOL-ACC (0.85; 95% CI, 0.77-0.90) was comparable to the EQ-5D-5L (0.83; 95% CI, 0.74-0.88). The SEM for the QOL-ACC (0.08) was slightly smaller than for the EQ-5D-5L (0.11). The SDC for the QOL-ACC and the EQ-5D-5L for individual subjects were 0.22 and 0.30 respectively. Sensitivity analyses stratified by quality of life and health status confirmed the base case results.

CONCLUSIONS

The QOL-ACC demonstrated a good test-retest reliability similar to the EQ-5D-5L, supporting its repeated use in aged care settings. Further studies will provide evidence of responsiveness of the QOL-ACC to aged care-specific interventions in aged care settings.

Further Evidence of Feasibility, Validity, and Reliability of Quality of Life-Aged Care Consumers: Evidence From Home-Based Care Settings

OBJECTIVES

The Quality of Life-Aged Care Consumers (QOL-ACC) is an aged-care-specific preference-based instrument currently being rolled out in residential care across Australia as part of the aged care Quality Indicator program. This study aimed to provide a comprehensive assessment of the feasibility, reliability, and construct validity of the QOL-ACC in a large national sample of older adults receiving aged care services at home.

METHODS

Older adults receiving in-home aged care services completed a survey including the QOL-ACC, Quality of Care Experience-ACC, adult social care outcome tool, EQ-5D-5L, and 2 global single item measures of health and quality of life. Feasibility was assessed by missing responses (≤5%) and ceiling/floor effects (≤15%). Construct validity was assessed by exploring the relationship between the QOL-ACC and other instruments (convergent validity) and its ability to discriminate varying levels of self-rated health and quality of life (known-group validity).

RESULTS

A total of 802 respondents (mean age, 74.5 ± 6.3 years; 56.0% females) completed the survey. The QOL-ACC had no missing responses, no floor effects, and very low ceiling effect (3.5%) and demonstrated moderate correlation with adult social care outcome tool (r = 0.59, P < .001), EQ-5D-5L (r = 0.65, P < .001), EQ-VAS (r = 0.53, P < .001), and a lower correlation with the QCE-ACC (r = 0.41, P < .001). Respondents with poor self-rated health and quality of life had significantly lower preference-weighted scores on the QOL-ACC.

CONCLUSIONS

The QOL-ACC demonstrated adequate feasibility, reliability, and construct validity in a large population of older people accessing government-subsidized aged care services at home. Further studies will explore the responsiveness of the QOL-ACC to aged-care-specific interventions both in home and residential aged care settings.

Examining interrater agreement between self-report and proxy-report responses for the quality of life-aged care consumers (QOL-ACC) instrument

BACKGROUND

Quality of life is an important quality indicator for health and aged care sectors. However, self-reporting of quality of life is not always possible given the relatively high prevalence of cognitive impairment amongst older people, hence proxy reporting is often utilised as the default option. Internationally, there is little evidence on the impact of proxy perspective on interrater agreement between self and proxy report.

OBJECTIVES

To assess the impacts of (i) cognition level and (ii) proxy perspective on interrater agreement using a utility instrument, the Quality of Life-Aged Care Consumers (QOL-ACC).

METHODS

A cross-sectional study was undertaken with aged care residents and family member proxies. Residents completed the self-report QOL-ACC, while proxies completed two proxy versions: proxy-proxy perspective (their own opinion), and proxy-person perspective (how they believe the resident would respond). Interrater agreement was assessed using quadratic weighted kappas for dimension-level data and concordance correlation coefficients and Bland-Altman plots for utility scores.

RESULTS

Sixty-three residents (22, no cognitive impairment; 41, mild-to-moderate cognitive impairment) and proxies participated. In the full sample and in the mild-to-moderate impairment group, the mean self-reported QOL-ACC utility score was significantly higher than the means reported by proxies, regardless of perspective (p < 0.01). Agreement with self-reported QOL-ACC utility scores was higher when proxies adopted a proxy-person perspective.

CONCLUSION

Regardless of cognition level and proxy perspective, proxies tend to rate quality of life lower than residents. Further research is needed to explore the impact of such divergences for quality assessment and economic evaluation in aged care.

Exploring older people's understanding of the QOL-ACC, a new preference-based quality-of-life measure, for quality assessment and economic evaluation in aged care: the impact of cognitive impairment and dementia

BACKGROUND

Quality-of-life is an essential outcome for quality assessment and economic evaluation in health and social care. The-Quality-of-Life - Aged Care Consumers (QOL-ACC) is a new preference-based quality-of-life measure, psychometrically validated with older people in aged care. More evidence is needed to inform the self-report reliability of the QOL-ACC in older people with varying levels of cognitive impairment and dementia.

METHODS

A think-aloud protocol was developed and applied with older residents. The Mini Mental State Examination (MMSE) was applied to assign participants to no cognitive impairment (NCI - MMSE score ≥ 27) and cognitive impairment (MMCI - MMSE score < 27) subgroups. Three independent raters utilised a Tourangeau survey response model-based framework to identify response issues. Data were compared across cognition subgroups and synthesized using a 'traffic light' grading to classify frequency and type of response issues. Gradings were utilised to assess self-report reliability according to different levels of cognitive impairment.

RESULTS

Qualitative data from 44 participants (NCI = 20, MMCI = 24) were included for analysis. Response issues were more evident in the cognitive impairment subgroup than the no cognitive impairment subgroup. All participants who received a 'red' grade had an MMSE score of < 20 and 66% of 'amber' grades occurred in the cognitive impairment subgroup.

CONCLUSIONS

The QOL-ACC is able to be completed reliably by older residents with an MMSE score > 17. Future research is needed to assess the generalisability of these findings to other preference-based quality of life instruments and for older people in other care settings including health systems.

Translation and validation of the Comfort Behaviors Checklist in hospitalized children with chronic diseases

BACKGROUND

Different tools have been developed to measure patients' comfort. This study aims to translate, validate, and apply the Comfort Behaviors Checklist to hospitalized children with chronic diseases.

METHODS

Validity and reliability are assessed using face and content validity, construct validity (known-groups technique and Principal Component Analysis), internal consistency, and inter-rater reliability. The study takes place in a children's hospital in Iran, involving 220 children aged 4 to 6.

RESULTS

The Comfort Behaviors Checklist demonstrates acceptable face and content validity. Construct validity is supported by the lack of correlation between behavioral comfort scores in known groups. The Principal Component analysis results in five components, explaining 70.39% of the total variation. The checklist exhibits acceptable reliability, with a total Cronbach's alpha coefficient of 0.86 and an intraclass correlation coefficient of 0.835.

CONCLUSION

The Comfort Behavior Checklist is a valid and reliable tool for assessing the level of comfort in Iranian children with chronic diseases.

Face Validity of Four Preference-Weighted Quality-of-Life Measures in Residential Aged Care: A Think-Aloud Study

OBJECTIVE

There is an increased use of preference-weighted quality-of-life measures in residential aged care to guide resource allocation decisions or for quality-of-care assessments. However, little is known about their face validity (i.e., how understandable, appropriate and relevant the measures are 'on their face' when respondents complete them). The aim of this study was to assess the face validity of four preference-weighted measures (i.e., EQ-5D-5L, EQ-HWB, ASCOT, QOL-ACC) in older people living in residential aged care.

METHODS

Qualitative cognitive think-aloud interviews were conducted using both concurrent and retrospective think-aloud techniques. To reduce burden, each resident completed two measures, with the four measures randomised across participants. Audio recordings were transcribed and framework analysis was used for data analysis, based on an existing framework derived from the Tourangeau four-stage response model.

RESULTS

In total, 24 interviews were conducted with residents living across three residential aged care facilities in Melbourne, Australia. Response issues were identified across all four measures, often related to comprehension and difficulty selecting a response level due to double-barrelled and ambiguous items that have different meanings in the residential aged care context. We also identified issues related to understanding instructions, non-adherence to the recall period, and noted positive responding that requires attention when interpreting the data.

CONCLUSIONS

Our findings provide further evidence on the appropriateness of existing measures, indicating numerous response issues that require further research to guide the selection process for research and practice.

What Quality-of-Life Dimensions Are Most Important to Older Adults from Culturally and Linguistically Diverse Backgrounds Receiving Aged Care Services? An Exploratory Study

There is little research on what aspects of quality of life (QoL) are most important to culturally and linguistically diverse (CALD) older adults. This study aimed to identify what QoL dimensions were most important to CALD older adults receiving aged care services, and therefore, how relevant a new six dimensions QoL instrument developed for use in aged care is to this population. A three-stage, mixed-methods study was undertaken. Stage 1: n = 3 focus groups with aged care providers. Stage 2: n = 30 semi-structured interviews with Italian-born older adults in ethno-specific residential aged care. Stage 3: survey of n = 63 older adults from mixed CALD backgrounds receiving community aged care services. Overall, older adults asserted the importance of the six dimensions of the new QoL instrument. The importance of 'identity' and 'purpose and meaning' were identified via the focus groups; however, the community-based CALD older adults identified these aspects of quality of life as more important than older Italians in residential care. Being in ethno-specific residential aged care where needs relating to language, food, and religion were met and they continued to live with others from their community may have meant that the meeting of cultural needs was more taken for granted.

Assessing feasibility, construct validity, and reliability of a new aged care-specific preference-based quality of life instrument: evidence from older Australians in residential aged care

BACKGROUND

Quality of Life-Aged Care Consumers (QOL-ACC) is a new older-person-specific quality of life instrument designed for application in quality assessment and economic evaluation in aged care. The QOL-ACC was designed from its inception with older people receiving aged care services ensuring its strong content validity. Given that the QOL-ACC has already been validated in home care settings and a preference-weighted value set developed, we aimed to assess feasibility, construct validity and reliability of the QOL-ACC in residential aged care settings.  METHODS: Individuals living in residential aged care facilities participated in an interviewer-facilitated survey. The survey included the QOL-ACC, QCE-ACC (quality of aged care experience measure) and two other preference-based quality of life instruments (ASCOT and EQ-5D-5L). Feasibility was assessed using missing data and ceiling/floor effects. Construct validity was assessed by exploring the relationship between the QOL-ACC and other instruments (convergent validity) and the QOL-ACC's ability to discriminate varying levels of self-rated health and quality of life. Internal consistency reliability was assessed using Cronbach's alpha (α).

RESULTS

Of the 200 residents (mean age, 85 ± 7.7 years) who completed the survey, 60% were female and 69% were born in Australia. One in three participating residents self-rated their health as fair/poor. The QOL-ACC had no missing data but had small floor effects (0.5%) and acceptable ceiling effects (7.5%). It demonstrated moderate correlation with ASCOT (r = 0.51, p < 0.001) and EQ-5D-5L (r = 0.52, p < 0.001) and a stronger correlation with the QCE-ACC (r = 0.57, p < 0.001). Residents with poor self-rated health and quality of life had significantly lower scores on the QOL-ACC. The internal consistency reliability of the QOL-ACC and its dimensions was good (α = 0.70-0.77).

CONCLUSIONS

The QOL-ACC demonstrated good feasibility, construct validity and internal consistency reliability to assess aged care-related quality of life. Moderate correlations of the QOL-ACC and other instruments provide evidence of its construct validity and signifies that the QOL-ACC adds non-redundant and non-interchangeable information beyond the existing instruments. A stronger correlation with the QCE-ACC than other instruments may indicate that quality of life is more intimately connected with the care experience than either health- or social-related quality of life in residential aged care settings.