Social care-related outcomes in Finland. Construct validity and structural characteristics of the Finnish ASCOT measure with older home care users

Exploratory factor analysis and Rasch analysis to assess the structural validity of the Adult Social Care Outcomes Toolkit Proxy version (ASCOT-Proxy) completed by care home staff

PURPOSE

Rasch analysis and exploratory factor analysis (EFA) were used to evaluate the structural validity of the ASCOT-Proxy measures completed by staff on behalf of older adults resident in care homes, by comparison to the ASCOT-SCT4, the measure of social care-related quality of life (SCRQoL) from which the ASCOT-Proxy was developed.

METHODS

EFA was conducted on the ASCOT-SCT4 and the two ASCOT-Proxy measures (Proxy-Proxy, Proxy-Resident), to determine if they retained the single factor of the original ASCOT-SCT4 measure found in samples of older community-dwelling adults. Rasch analysis was also applied to measures with a single factor structure in the EFA.

RESULTS

ASCOT-Proxy-Resident had a single factor structure, as did the original ASCOT-SCT4 (also, found in this analysis when completed by care home staff). The ASCOT-Proxy-Proxy had a two factor structure. Rasch analysis of ASCOT-Proxy-Resident and ASCOT-SCT4 had an acceptable model fit, internal consistency and met the assumptions of unidimensionality and local independence. There was evidence of less than optimal distinguishability at some thresholds between responses, and low frequency of rating of the 'high level needs'.

CONCLUSION

The ASCOT-Proxy-Resident is a valid instrument of SCRQoL for older adults resident in care homes, completed by staff proxies. Due to the two-factor structure, which differs from the original ASCOT-SCT4, we do not recommend the use of the ASCOT-Proxy-Proxy measure, although collecting data as part of the ASCOT-Proxy questionnaire may support its feasibility and acceptability. Further qualitative study of how care home staff complete and perceive the ASCOT-Proxy is encouraged for future studies.

How well do the adult social care outcomes toolkit for carers, carer experience scale and care-related quality of life capture aspects of quality of life important to informal carers in Australia?

PURPOSE

Identify aspects of quality of life (QoL) important to Australian informal carers and explore how well the Adult Social Care Outcomes Toolkit for Carers, Care-related Quality of Life instrument and Carer Experience Scale capture these aspects in the Australian context.

METHODS

Online questionnaires were completed by Australian informal carers. Socio-demographics, open-ended questions: positive/negative aspects of caring and QoL aspects missing from the instruments, and ranking of the instrument domains was used to explore the content of the instruments. Instruments were scored using preference-weighted value sets (reported in another paper). Content analysis was used to analyse the open-ended responses. Chi-squared test looked at differences in domain importance. Descriptive analyses summarised all other information.

RESULTS

Eight themes were identified: Behaviour-mood of the care recipient, Caring responsibilities, Finances, Health, Own life, Perception of carers, Relationship with care recipient and Support. Many aspects of carer QoL mentioned as missing in the instruments appeared covered by the domains, of which all were reported as important. The highest ranked domain was relationship with the care recipient. The influence of the care recipient specific support, behaviour/mood and health on carer QoL appear absent in all instruments.

CONCLUSION

The content of the three instruments appears relevant in an Australian setting. The influence of care recipient's health and well-being on carer QoL should be considered, along with spillover effects. A content and/or face validity analysis is required to confirm differences in item interpretation in Australian informal carers.

Measuring quality of life in care homes when self-report is challenging: the construct validity, structural characteristics and internal consistency of the mixed-methods adult social care outcomes toolkit

INTRODUCTION

The adult social care outcomes toolkit (ASCOT) measures social care-related quality of life (SCRQoL) using self-completion questionnaires and interviews. Many care home residents find such methods inaccessible, leading to a reliance on proxy-reporting. This study aimed to establish the psychometric properties of the mixed-methods toolkit [ASCOT-Care Homes, 4 outcome (CH4)] for measuring SCRQoL when residents cannot self-report.

METHODS

Two cross-sectional, mixed-methods studies were undertaken in care homes for older people in England between 2015 and 2020. We used the ASCOT-CH4 (observation, and interviews with residents and proxies) to collect information about SCRQoL and collected additional data on residents' needs and characteristics, and variables hypothesised to be related to SCRQoL.Hypothesis testing was applied to establish construct validity, Cronbach's alpha for internal consistency and exploratory factor analysis for structural validity.

RESULTS

The combined dataset included 475 residents from 54 care homes (34 nursing, 20 residential). Half had a diagnosis of dementia. Less than a third of residents were able to complete an ASCOT interview. Observations and proxy interviews informed researcher ratings, meaning there were no missing ASCOT-CH4 scores. ASCOT-CH4 was found to be a weak unidimensional scale, consistent with other ASCOT measures, with acceptable internal consistency (α = 0.77, 8 items). Construct validity was supported by the findings.

CONCLUSIONS

The ASCOT-CH4 is an alternative to conventional proxy-questionnaires for measuring the SCRQoL of care home residents, with good psychometric properties. A limitation is that users need a range of data collection skills. Future research should explore whether findings are replicable when data are collected by other researchers.

Feasibility, validity and reliability of the ASCOT-Proxy and ASCOT-Carer among unpaid carers of people living with dementia in England

BACKGROUND

People with dementia living at home represent a growing group of social care services users in England. Many are unable to complete questionnaires due to cognitive impairment. The ASCOT-Proxy is an adapted version of an established measure, ASCOT, which was developed as a way of collecting social care-related quality of life (SCRQoL) data from this group of service users, either alone or alongside the ASCOT-Carer, a measure of SCRQoL for unpaid carers. The ASCOT-Proxy includes two perspectives, the proxy-proxy perspective ('My opinion: What I think') and proxy-person perspective ('What I think the person I represent thinks'). We aimed to establish the feasibility, construct validity and reliability of the ASCOT-Proxy and ASCOT-Carer, with unpaid carers of people with dementia living at home unable to self-report. We also aimed to establish structural characteristics of the ASCOT-Proxy.

METHODS

Cross-sectional data were collected using self-administered questionnaire (paper or online) among unpaid carers living in England between January 2020 and April 2021. Unpaid carers could take part if they supported someone living with dementia who was unable to self-complete a structured questionnaire. The person living with dementia or their unpaid carer had to use at least one social care service. We used the proportion of missing data to establish feasibility, ordinal exploratory factor analysis to establish structural characteristics, Zumbo's ordinal alpha for internal reliability, and hypothesis testing for construct validity. We also conducted Rasch analysis.

RESULTS

We analysed data for 313 carers (62.4(± 12.0) years, 75.7% (N=237) females). We were able to calculate the ASCOT-Proxy-proxy overall score for 90.7% of our sample, the ASCOT-Proxy-person overall score for 88.8% of our sample and in case of the ASCOT-Carer for 99.7% of our sample. As there was an issue with structural characteristics of the ASCOT-Proxy-proxy we conducted Rasch, reliability and construct validity analysis for the ASCOT-Proxy-person and ASCOT-Carer only.

CONCLUSIONS

This was a first study to explore psychometric characteristics of the ASCOT-Proxy and ASCOT-Carer with unpaid carers of people with dementia living at home unable to self-report. There are some aspects of the psychometric characteristics of the ASCOT-Proxy and ASCOT-Carer that warrant further investigation in future. Trial registration NA.

Exploring the structural characteristics of the Adult Social Care Outcomes Toolkit (ASCOT) and ASCOT-Carer

Background

Measurement models inform the approach to assess a measure's validity and also how a measure is understood, applied and interpreted. With preference-based measures (PBMs), it is generally accepted that they are formative; however, if they are applied without preferences, they may be reflective, formative or mixed. In this study, we sought to empirically test whether the reflective, formative or mixed measurement model best describes PBMs of social care-related quality of life (SCRQoL) - specifically, the ASCOT and ASCOT-Carer. We also explored the network approach, as an alternative.

Methods

ASCOT and ASCOT-Carer data were analyzed using confirmatory factor analysis and Multiple Indicators Multiple Causes models to test reflective, formative or mixed measurement models, respectively. Network analysis of partial correlations using the Gaussian graphical model was also conducted.

Results

The results indicated that the reflective measurement model is the worst fit for ASCOT and ASCOT-Carer. The formative or mixed measurement models may apply to ASCOT. The mixed measurement model was the best fit for ASCOT-Carer. The network analysis indicated that the most important or influential items were Occupation and Personal cleanliness and comfort (ASCOT) and Time and space and Self-care (ASCOT-Carer).

Conclusions

The ASCOT and ASCOT-Carer are best described as formative/mixed or mixed measurement models, respectively. These findings may guide the approach to the validation of cross-culturally adapted and translated versions. Specifically, we recommend that EFA be applied to establish structural characteristics, especially if the measure will be applied as a PBM and as a measure of SCRQoL. Network analysis may also provide further useful insights into structural characteristics.

Social care-related quality of life of people with dementia and their carers in England

People with dementia and their carers are a growing subgroup of people who use community-based social care. These services are designed to maintain people's quality of life while living at home. The ASCOT measure of social care-related quality of life (SCRQoL), designed to evaluate quality and effectiveness of social care, has been adapted for proxy-report when someone is unable to self-report. The ASCOT-Carer has been developed to measure carer's own SCRQoL. This study sought to establish the factors related to SCRQoL of people living with dementia (PLWD, proxy-reported by carers) and their carers. Data were collected via a self-administered postal or online survey of 313 carers in England, from January 2020 to April 2021. Carers were eligible if they supported someone living with dementia at home, who was unable to self-complete questionnaires. The person living with dementia or their carer had to use at least one social care service, e.g. home care. We recruited participants via an online volunteer panel and NHS sites. Multiple regression was applied to explore the factors significantly related to ASCOT SCRQoL by self- and proxy-report. Key influences on carers' own SCRQoL were their health, financial difficulties associated with caring, and satisfaction with social care support. Inadequate home design was significantly negatively associated with SCRQoL for PLWD. The latter stages of the pandemic-related restrictions (the tier system from 2nd December 2020 to study end, April 2021) were associated with significantly worse SCRQoL for PLWD, but not for carers. The study offers insight into the factors associated with SCRQoL. In particular, the findings highlight the importance of adequate home design for people with dementia; satisfactory social care support and limiting any adverse financial impact of caring are important for carers. The findings indicate a negative effect of COVID restrictions on SCRQoL of people with dementia.

Do You Prefer Safety to Social Participation? Finnish Population-Based Preference Weights for the Adult Social Care Outcomes Toolkit (ASCOT) for Service Users

Introduction. The Adult Social Care Outcomes Toolkit (ASCOT) was developed in England to measure people’s social care–related quality of life (SCRQoL). Objectives. The aim of this article is to estimate preference weights for the Finnish ASCOT for service users (ASCOT). In addition, we tested for learning and fatigue effects in the choice experiment used to elicit the preference weights. Methods. The analysis data (n = 1000 individuals) were obtained from an online survey sample of the Finnish adult general population using gender, age, and region as quotas. The questionnaire included a best-worst scaling (BWS) experiment using ASCOT. Each respondent sequentially selected four alternatives (best, worst; second-best, second-worst) for eight BWS tasks (n = 32,000 choice observations). A scale multinomial logit model was used to estimate the preference parameters and to test for fatigue and learning. Results. The most and least preferred attribute-levels were “I have as much control over my daily life as I want” and “I have no control over my daily life.” The preference weights were not on a cardinal scale. The ordering effect was related to the second-best choices. Learning effect was in the last four tasks. Conclusions. This study has developed a set of preference weights for the ASCOT instrument in Finland, which can be used for investigating outcomes of social care interventions on adult populations. The learning effect calls for the development of study designs that reduce possible bias relating to preference uncertainty at the beginning of sequential BWS tasks. It also supports the adaptation of a modelling strategy in which the sequence of tasks is explicitly modelled as a scale factor.

Cross-cultural adaptation and construct validity of the German version of the Adult Social Care Outcomes Toolkit for service users (German ASCOT)

BACKGROUND

There has been considerable interest in using the Adult Social Care Outcomes Toolkit (ASCOT), developed in England, to measure quality-of-life outcomes of long-term care (LTC-QoL) service provision in national and cross-national studies.

OBJECTIVES

The aim of this study was to translate and culturally adapt the original ASCOT service user measure into German and to evaluate its content and construct validity in Austrian home care service users.

METHODS

The translation and cultural adaptation process followed the ISPOR TCA guidelines. We used qualitative data from six cognitive debriefing interviews with Austrian recipients of home care services to assess linguistic and content validity. In addition, cross-sectional survey data (n = 633) were used to evaluate construct validity by testing hypothesized associations established in a previous study for the original English ASCOT service user instrument.

RESULTS

Cognitive debriefing interviews confirmed that the German adaptation of the ASCOT service user instrument was understood as intended, although two domains ('Control over daily life' and 'Dignity') and selected phrases of the response options were challenging to translate into German. All ASCOT domains were statistically significantly associated with related constructs and sensitive to service user sub-group differences.

CONCLUSIONS

We found good evidence for a valid cross-cultural adaptation of the German version of ASCOT for service users. The analysis also supports the construct validity of the translated instrument and its use in evaluations of QoL-effects of LTC service provision in German-speaking countries. Further research on the reliability and feasibility in different care settings is encouraged.