1
|
Rand S, Towers AM, Allan S, Webster L, Palmer S, Carroll R, Gordon A, Akdur G, Goodman C. Exploratory factor analysis and Rasch analysis to assess the structural validity of the Adult Social Care Outcomes Toolkit Proxy version (ASCOT-Proxy) completed by care home staff. Qual Life Res 2024; 33:1555-1567. [PMID: 38507142 PMCID: PMC11116179 DOI: 10.1007/s11136-024-03631-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/06/2024] [Indexed: 03/22/2024]
Abstract
PURPOSE Rasch analysis and exploratory factor analysis (EFA) were used to evaluate the structural validity of the ASCOT-Proxy measures completed by staff on behalf of older adults resident in care homes, by comparison to the ASCOT-SCT4, the measure of social care-related quality of life (SCRQoL) from which the ASCOT-Proxy was developed. METHODS EFA was conducted on the ASCOT-SCT4 and the two ASCOT-Proxy measures (Proxy-Proxy, Proxy-Resident), to determine if they retained the single factor of the original ASCOT-SCT4 measure found in samples of older community-dwelling adults. Rasch analysis was also applied to measures with a single factor structure in the EFA. RESULTS ASCOT-Proxy-Resident had a single factor structure, as did the original ASCOT-SCT4 (also, found in this analysis when completed by care home staff). The ASCOT-Proxy-Proxy had a two factor structure. Rasch analysis of ASCOT-Proxy-Resident and ASCOT-SCT4 had an acceptable model fit, internal consistency and met the assumptions of unidimensionality and local independence. There was evidence of less than optimal distinguishability at some thresholds between responses, and low frequency of rating of the 'high level needs'. CONCLUSION The ASCOT-Proxy-Resident is a valid instrument of SCRQoL for older adults resident in care homes, completed by staff proxies. Due to the two-factor structure, which differs from the original ASCOT-SCT4, we do not recommend the use of the ASCOT-Proxy-Proxy measure, although collecting data as part of the ASCOT-Proxy questionnaire may support its feasibility and acceptability. Further qualitative study of how care home staff complete and perceive the ASCOT-Proxy is encouraged for future studies.
Collapse
Affiliation(s)
- Stacey Rand
- Personal Social Services Research Unit (PSSRU), University of Kent, Canterbury, UK.
| | - Ann-Marie Towers
- Centre for Health Services Studies (CHSS), University of Kent, Canterbury, UK
| | - Stephen Allan
- Personal Social Services Research Unit (PSSRU), University of Kent, Canterbury, UK
| | - Lucy Webster
- Centre for Health Services Studies (CHSS), University of Kent, Canterbury, UK
| | - Sinead Palmer
- Personal Social Services Research Unit (PSSRU), University of Kent, Canterbury, UK
| | | | | | | | | |
Collapse
|
2
|
Bucholc J, McCaffrey N, Ugalde A, Muldowney A, Rand S, Hoefman R, Mihalopoulos C, Engel L. How well do the adult social care outcomes toolkit for carers, carer experience scale and care-related quality of life capture aspects of quality of life important to informal carers in Australia? Qual Life Res 2023; 32:3109-3121. [PMID: 37356076 PMCID: PMC10522516 DOI: 10.1007/s11136-023-03459-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/03/2023] [Indexed: 06/27/2023]
Abstract
PURPOSE Identify aspects of quality of life (QoL) important to Australian informal carers and explore how well the Adult Social Care Outcomes Toolkit for Carers, Care-related Quality of Life instrument and Carer Experience Scale capture these aspects in the Australian context. METHODS Online questionnaires were completed by Australian informal carers. Socio-demographics, open-ended questions: positive/negative aspects of caring and QoL aspects missing from the instruments, and ranking of the instrument domains was used to explore the content of the instruments. Instruments were scored using preference-weighted value sets (reported in another paper). Content analysis was used to analyse the open-ended responses. Chi-squared test looked at differences in domain importance. Descriptive analyses summarised all other information. RESULTS Eight themes were identified: Behaviour-mood of the care recipient, Caring responsibilities, Finances, Health, Own life, Perception of carers, Relationship with care recipient and Support. Many aspects of carer QoL mentioned as missing in the instruments appeared covered by the domains, of which all were reported as important. The highest ranked domain was relationship with the care recipient. The influence of the care recipient specific support, behaviour/mood and health on carer QoL appear absent in all instruments. CONCLUSION The content of the three instruments appears relevant in an Australian setting. The influence of care recipient's health and well-being on carer QoL should be considered, along with spillover effects. A content and/or face validity analysis is required to confirm differences in item interpretation in Australian informal carers.
Collapse
Affiliation(s)
- Jessica Bucholc
- Deakin Health Economics, Institute for Health Transformation, School of Health and Social Development, Deakin University, Geelong, VIC, Australia.
| | - Nikki McCaffrey
- Deakin Health Economics, Institute for Health Transformation, School of Health and Social Development, Deakin University, Geelong, VIC, Australia
| | - Anna Ugalde
- Quality and Patient Safety, Institute for Health Transformation, School of Nursing and Midwifery, Deakin University, Geelong, VIC, Australia
| | | | - Stacey Rand
- Personal Social Services Research Unit (PSSRU), Cornwallis Building, University of Kent, Canterbury, UK
| | - Renske Hoefman
- The Netherlands Institute for Social Research (SCP), The Hague, The Netherlands
| | - Cathrine Mihalopoulos
- Health Economics Division, School of Public Health and Preventive Medicine, Monash University, Melbourne, Melbourne, VIC, Australia
| | - Lidia Engel
- Health Economics Division, School of Public Health and Preventive Medicine, Monash University, Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
3
|
Towers AM, Rand S, Collins G, Smith N, Palmer S, Cassell J. Measuring quality of life in care homes when self-report is challenging: the construct validity, structural characteristics and internal consistency of the mixed-methods adult social care outcomes toolkit. Age Ageing 2023; 52:afad168. [PMID: 37659095 PMCID: PMC10474903 DOI: 10.1093/ageing/afad168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Indexed: 09/04/2023] Open
Abstract
INTRODUCTION The adult social care outcomes toolkit (ASCOT) measures social care-related quality of life (SCRQoL) using self-completion questionnaires and interviews. Many care home residents find such methods inaccessible, leading to a reliance on proxy-reporting. This study aimed to establish the psychometric properties of the mixed-methods toolkit [ASCOT-Care Homes, 4 outcome (CH4)] for measuring SCRQoL when residents cannot self-report. METHODS Two cross-sectional, mixed-methods studies were undertaken in care homes for older people in England between 2015 and 2020. We used the ASCOT-CH4 (observation, and interviews with residents and proxies) to collect information about SCRQoL and collected additional data on residents' needs and characteristics, and variables hypothesised to be related to SCRQoL.Hypothesis testing was applied to establish construct validity, Cronbach's alpha for internal consistency and exploratory factor analysis for structural validity. RESULTS The combined dataset included 475 residents from 54 care homes (34 nursing, 20 residential). Half had a diagnosis of dementia. Less than a third of residents were able to complete an ASCOT interview. Observations and proxy interviews informed researcher ratings, meaning there were no missing ASCOT-CH4 scores. ASCOT-CH4 was found to be a weak unidimensional scale, consistent with other ASCOT measures, with acceptable internal consistency (α = 0.77, 8 items). Construct validity was supported by the findings. CONCLUSIONS The ASCOT-CH4 is an alternative to conventional proxy-questionnaires for measuring the SCRQoL of care home residents, with good psychometric properties. A limitation is that users need a range of data collection skills. Future research should explore whether findings are replicable when data are collected by other researchers.
Collapse
Affiliation(s)
- Ann-Marie Towers
- Centre for Health Services Studies (CHSS), University of Kent, Kent, UK
| | - Stacey Rand
- Personal Social Services Research Unit (PSSRU), University of Kent, Kent, UK
| | - Grace Collins
- Personal Social Services Research Unit (PSSRU), University of Kent, Kent, UK
| | - Nick Smith
- Personal Social Services Research Unit (PSSRU), University of Kent, Kent, UK
| | - Sinead Palmer
- Personal Social Services Research Unit (PSSRU), University of Kent, Kent, UK
| | - Jackie Cassell
- Primary Care and Public Health, Brighton and Sussex Medical School (BSMS), Brighton, UK
| |
Collapse
|
4
|
Silarova B, Rand S, Towers AM, Jones K. Feasibility, validity and reliability of the ASCOT-Proxy and ASCOT-Carer among unpaid carers of people living with dementia in England. Health Qual Life Outcomes 2023; 21:54. [PMID: 37270560 DOI: 10.1186/s12955-023-02122-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 04/25/2023] [Indexed: 06/05/2023] Open
Abstract
BACKGROUND People with dementia living at home represent a growing group of social care services users in England. Many are unable to complete questionnaires due to cognitive impairment. The ASCOT-Proxy is an adapted version of an established measure, ASCOT, which was developed as a way of collecting social care-related quality of life (SCRQoL) data from this group of service users, either alone or alongside the ASCOT-Carer, a measure of SCRQoL for unpaid carers. The ASCOT-Proxy includes two perspectives, the proxy-proxy perspective ('My opinion: What I think') and proxy-person perspective ('What I think the person I represent thinks'). We aimed to establish the feasibility, construct validity and reliability of the ASCOT-Proxy and ASCOT-Carer, with unpaid carers of people with dementia living at home unable to self-report. We also aimed to establish structural characteristics of the ASCOT-Proxy. METHODS Cross-sectional data were collected using self-administered questionnaire (paper or online) among unpaid carers living in England between January 2020 and April 2021. Unpaid carers could take part if they supported someone living with dementia who was unable to self-complete a structured questionnaire. The person living with dementia or their unpaid carer had to use at least one social care service. We used the proportion of missing data to establish feasibility, ordinal exploratory factor analysis to establish structural characteristics, Zumbo's ordinal alpha for internal reliability, and hypothesis testing for construct validity. We also conducted Rasch analysis. RESULTS We analysed data for 313 carers (62.4(± 12.0) years, 75.7% (N=237) females). We were able to calculate the ASCOT-Proxy-proxy overall score for 90.7% of our sample, the ASCOT-Proxy-person overall score for 88.8% of our sample and in case of the ASCOT-Carer for 99.7% of our sample. As there was an issue with structural characteristics of the ASCOT-Proxy-proxy we conducted Rasch, reliability and construct validity analysis for the ASCOT-Proxy-person and ASCOT-Carer only. CONCLUSIONS This was a first study to explore psychometric characteristics of the ASCOT-Proxy and ASCOT-Carer with unpaid carers of people with dementia living at home unable to self-report. There are some aspects of the psychometric characteristics of the ASCOT-Proxy and ASCOT-Carer that warrant further investigation in future. Trial registration NA.
Collapse
Affiliation(s)
- Barbora Silarova
- Personal Social Services Research Unit, University of Kent, Cornwallis Central, Canterbury, Kent, CT2 7NF, UK.
| | - Stacey Rand
- Personal Social Services Research Unit, University of Kent, Cornwallis Central, Canterbury, Kent, CT2 7NF, UK
| | - Ann-Marie Towers
- Centre For Health Services Studies, University of Kent, Cornwallis Central, Canterbury, Kent, CT2 7NF, UK
| | - Karen Jones
- Personal Social Services Research Unit, University of Kent, Cornwallis Central, Canterbury, Kent, CT2 7NF, UK
| |
Collapse
|
5
|
Rand S, Towers AM, Malley J, Silarova B. Exploring the structural characteristics of the Adult Social Care Outcomes Toolkit (ASCOT) and ASCOT-Carer. NIHR OPEN RESEARCH 2023; 2:21. [PMID: 37881301 PMCID: PMC10593358 DOI: 10.3310/nihropenres.13259.2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 03/10/2023] [Indexed: 10/27/2023]
Abstract
Background Measurement models inform the approach to assess a measure's validity and also how a measure is understood, applied and interpreted. With preference-based measures (PBMs), it is generally accepted that they are formative; however, if they are applied without preferences, they may be reflective, formative or mixed. In this study, we sought to empirically test whether the reflective, formative or mixed measurement model best describes PBMs of social care-related quality of life (SCRQoL) - specifically, the ASCOT and ASCOT-Carer. We also explored the network approach, as an alternative. Methods ASCOT and ASCOT-Carer data were analyzed using confirmatory factor analysis and Multiple Indicators Multiple Causes models to test reflective, formative or mixed measurement models, respectively. Network analysis of partial correlations using the Gaussian graphical model was also conducted. Results The results indicated that the reflective measurement model is the worst fit for ASCOT and ASCOT-Carer. The formative or mixed measurement models may apply to ASCOT. The mixed measurement model was the best fit for ASCOT-Carer. The network analysis indicated that the most important or influential items were Occupation and Personal cleanliness and comfort (ASCOT) and Time and space and Self-care (ASCOT-Carer). Conclusions The ASCOT and ASCOT-Carer are best described as formative/mixed or mixed measurement models, respectively. These findings may guide the approach to the validation of cross-culturally adapted and translated versions. Specifically, we recommend that EFA be applied to establish structural characteristics, especially if the measure will be applied as a PBM and as a measure of SCRQoL. Network analysis may also provide further useful insights into structural characteristics.
Collapse
Affiliation(s)
- Stacey Rand
- Personal Social Services Research Unit, University of Kent, Canterbury, UK
| | - Ann-Marie Towers
- Centre for Health Services Studies, University of Kent, Canterbury, UK
| | - Juliette Malley
- Care Policy and Evaluation Centre, London School of Economics and Political Science, London, UK
| | - Barbora Silarova
- Personal Social Services Research Unit, University of Kent, Canterbury, UK
| |
Collapse
|
6
|
Rand SE, Silarova B, Towers A, Jones K. Social care-related quality of life of people with dementia and their carers in England. HEALTH & SOCIAL CARE IN THE COMMUNITY 2022; 30:e2406-e2418. [PMID: 34921481 PMCID: PMC9541270 DOI: 10.1111/hsc.13681] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Revised: 11/16/2021] [Accepted: 12/01/2021] [Indexed: 06/14/2023]
Abstract
People with dementia and their carers are a growing subgroup of people who use community-based social care. These services are designed to maintain people's quality of life while living at home. The ASCOT measure of social care-related quality of life (SCRQoL), designed to evaluate quality and effectiveness of social care, has been adapted for proxy-report when someone is unable to self-report. The ASCOT-Carer has been developed to measure carer's own SCRQoL. This study sought to establish the factors related to SCRQoL of people living with dementia (PLWD, proxy-reported by carers) and their carers. Data were collected via a self-administered postal or online survey of 313 carers in England, from January 2020 to April 2021. Carers were eligible if they supported someone living with dementia at home, who was unable to self-complete questionnaires. The person living with dementia or their carer had to use at least one social care service, e.g. home care. We recruited participants via an online volunteer panel and NHS sites. Multiple regression was applied to explore the factors significantly related to ASCOT SCRQoL by self- and proxy-report. Key influences on carers' own SCRQoL were their health, financial difficulties associated with caring, and satisfaction with social care support. Inadequate home design was significantly negatively associated with SCRQoL for PLWD. The latter stages of the pandemic-related restrictions (the tier system from 2nd December 2020 to study end, April 2021) were associated with significantly worse SCRQoL for PLWD, but not for carers. The study offers insight into the factors associated with SCRQoL. In particular, the findings highlight the importance of adequate home design for people with dementia; satisfactory social care support and limiting any adverse financial impact of caring are important for carers. The findings indicate a negative effect of COVID restrictions on SCRQoL of people with dementia.
Collapse
Affiliation(s)
- Stacey E. Rand
- Personal Social Services Research Unit (PSSRU)University of KentCanterburyUK
| | - Barbora Silarova
- Personal Social Services Research Unit (PSSRU)University of KentCanterburyUK
| | - Ann‐Marie Towers
- Centre for Health Services Research (CHSS)University of KentCanterburyUK
| | - Karen Jones
- Personal Social Services Research Unit (PSSRU)University of KentCanterburyUK
| |
Collapse
|
7
|
Nguyen L, Jokimäki H, Linnosmaa I, Saloniki EC, Batchelder L, Malley J, Lu H, Burge P, Trukeschitz B, Forder J. Do You Prefer Safety to Social Participation? Finnish Population-Based Preference Weights for the Adult Social Care Outcomes Toolkit (ASCOT) for Service Users. MDM Policy Pract 2021; 6:23814683211027902. [PMID: 34291174 PMCID: PMC8274113 DOI: 10.1177/23814683211027902] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Accepted: 06/01/2021] [Indexed: 12/12/2022] Open
Abstract
Introduction. The Adult Social Care Outcomes Toolkit (ASCOT) was developed in England to measure people’s social care–related quality of life (SCRQoL). Objectives. The aim of this article is to estimate preference weights for the Finnish ASCOT for service users (ASCOT). In addition, we tested for learning and fatigue effects in the choice experiment used to elicit the preference weights. Methods. The analysis data (n = 1000 individuals) were obtained from an online survey sample of the Finnish adult general population using gender, age, and region as quotas. The questionnaire included a best-worst scaling (BWS) experiment using ASCOT. Each respondent sequentially selected four alternatives (best, worst; second-best, second-worst) for eight BWS tasks (n = 32,000 choice observations). A scale multinomial logit model was used to estimate the preference parameters and to test for fatigue and learning. Results. The most and least preferred attribute-levels were “I have as much control over my daily life as I want” and “I have no control over my daily life.” The preference weights were not on a cardinal scale. The ordering effect was related to the second-best choices. Learning effect was in the last four tasks. Conclusions. This study has developed a set of preference weights for the ASCOT instrument in Finland, which can be used for investigating outcomes of social care interventions on adult populations. The learning effect calls for the development of study designs that reduce possible bias relating to preference uncertainty at the beginning of sequential BWS tasks. It also supports the adaptation of a modelling strategy in which the sequence of tasks is explicitly modelled as a scale factor.
Collapse
Affiliation(s)
- Lien Nguyen
- Finnish Institute for Health and Welfare (THL), Helsinki, Finland
| | - Hanna Jokimäki
- Finnish Institute for Health and Welfare (THL), Helsinki, Finland
| | - Ismo Linnosmaa
- Finnish Institute for Health and Welfare (THL), Helsinki, Finland
| | | | - Laurie Batchelder
- Personal Social Services Research Unit, University of Kent, Kent, UK
| | - Juliette Malley
- Care Policy and Evaluation Centre, London School of Economics and Political Science, London, UK
| | - Hui Lu
- RAND Europe, Cambridge, UK
| | | | - Birgit Trukeschitz
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Vienna, Austria
| | - Julien Forder
- Personal Social Services Research Unit, University of Kent, Kent, UK
| |
Collapse
|
8
|
Trukeschitz B, Litschauer J, Hajji A, Kieninger J, Schoch A, Malley J, Rand S, Linnosmaa I, Forder J. Cross-cultural adaptation and construct validity of the German version of the Adult Social Care Outcomes Toolkit for service users (German ASCOT). Health Qual Life Outcomes 2020; 18:326. [PMID: 33023573 PMCID: PMC7541247 DOI: 10.1186/s12955-020-01533-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Accepted: 08/11/2020] [Indexed: 12/16/2022] Open
Abstract
BACKGROUND There has been considerable interest in using the Adult Social Care Outcomes Toolkit (ASCOT), developed in England, to measure quality-of-life outcomes of long-term care (LTC-QoL) service provision in national and cross-national studies. OBJECTIVES The aim of this study was to translate and culturally adapt the original ASCOT service user measure into German and to evaluate its content and construct validity in Austrian home care service users. METHODS The translation and cultural adaptation process followed the ISPOR TCA guidelines. We used qualitative data from six cognitive debriefing interviews with Austrian recipients of home care services to assess linguistic and content validity. In addition, cross-sectional survey data (n = 633) were used to evaluate construct validity by testing hypothesized associations established in a previous study for the original English ASCOT service user instrument. RESULTS Cognitive debriefing interviews confirmed that the German adaptation of the ASCOT service user instrument was understood as intended, although two domains ('Control over daily life' and 'Dignity') and selected phrases of the response options were challenging to translate into German. All ASCOT domains were statistically significantly associated with related constructs and sensitive to service user sub-group differences. CONCLUSIONS We found good evidence for a valid cross-cultural adaptation of the German version of ASCOT for service users. The analysis also supports the construct validity of the translated instrument and its use in evaluations of QoL-effects of LTC service provision in German-speaking countries. Further research on the reliability and feasibility in different care settings is encouraged.
Collapse
Affiliation(s)
- Birgit Trukeschitz
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Welthandelsplatz 1, 1020 Vienna, Austria
| | - Judith Litschauer
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Welthandelsplatz 1, 1020 Vienna, Austria
| | - Assma Hajji
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Welthandelsplatz 1, 1020 Vienna, Austria
| | - Judith Kieninger
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Welthandelsplatz 1, 1020 Vienna, Austria
| | - Adiam Schoch
- Research Institute for Economics of Aging, WU Vienna University of Economics and Business, Welthandelsplatz 1, 1020 Vienna, Austria
| | - Juliette Malley
- Care Policy and Evaluation Centre, London School of Economics and Political Science, London, UK
| | - Stacey Rand
- Personal Social Services Research Unit, University of Kent, Canterbury, UK
| | - Ismo Linnosmaa
- Centre for Health and Social Economics, Finnish Institute for Health and Welfare, Helsinki, Finland
- Department of Health and Social Management, University of Eastern Finland, Kuopio, Finland
| | - Julien Forder
- Personal Social Services Research Unit, University of Kent, Canterbury, UK
| |
Collapse
|