Can capabilities be self-reported? A think aloud study

Precognition of Known And Unknown Biothreats: A Risk-Based Approach

Data mining and artificial intelligence algorithms can estimate the probability of future occurrences with defined precision. Yet, the prediction of infectious disease outbreaks remains a complex and difficult task. This is demonstrated by the limited accuracy and sensitivity of current models in predicting the emergence of previously unknown pathogens such as Zika, Chikungunya, and SARS-CoV-2, and the resurgence of Mpox, along with their impacts on global health, trade, and security. Comprehensive analysis of infectious disease risk profiles, vulnerabilities, and mitigation capacities, along with their spatiotemporal dynamics at the international level, is essential for preventing their transnational propagation. However, annual indexes about the impact of infectious diseases provide a low level of granularity to allow stakeholders to craft better mitigation strategies. A quantitative risk assessment by analytical platforms requires billions of near real-time data points from heterogeneous sources, integrating and analyzing univariable or multivariable data with different levels of complexity and latency that, in most cases, overwhelm human cognitive capabilities. Autonomous biosurveillance can open the possibility for near real-time, risk- and evidence-based policymaking and operational decision support.

Exploring older people's understanding of the QOL-ACC, a new preference-based quality-of-life measure, for quality assessment and economic evaluation in aged care: the impact of cognitive impairment and dementia

BACKGROUND

Quality-of-life is an essential outcome for quality assessment and economic evaluation in health and social care. The-Quality-of-Life - Aged Care Consumers (QOL-ACC) is a new preference-based quality-of-life measure, psychometrically validated with older people in aged care. More evidence is needed to inform the self-report reliability of the QOL-ACC in older people with varying levels of cognitive impairment and dementia.

METHODS

A think-aloud protocol was developed and applied with older residents. The Mini Mental State Examination (MMSE) was applied to assign participants to no cognitive impairment (NCI - MMSE score ≥ 27) and cognitive impairment (MMCI - MMSE score < 27) subgroups. Three independent raters utilised a Tourangeau survey response model-based framework to identify response issues. Data were compared across cognition subgroups and synthesized using a 'traffic light' grading to classify frequency and type of response issues. Gradings were utilised to assess self-report reliability according to different levels of cognitive impairment.

RESULTS

Qualitative data from 44 participants (NCI = 20, MMCI = 24) were included for analysis. Response issues were more evident in the cognitive impairment subgroup than the no cognitive impairment subgroup. All participants who received a 'red' grade had an MMSE score of < 20 and 66% of 'amber' grades occurred in the cognitive impairment subgroup.

CONCLUSIONS

The QOL-ACC is able to be completed reliably by older residents with an MMSE score > 17. Future research is needed to assess the generalisability of these findings to other preference-based quality of life instruments and for older people in other care settings including health systems.

How do older adults receiving aged care services understand and respond to the EQ-5D-5L? A think-aloud study in residential care

PURPOSE

The EQ-5D-5L is a preference-based instrument for measuring and valuing health-related quality of life (HRQoL). The EQ-5D-5L has been used extensively in economic evaluation, including in aged care. However, older adults' understanding of the EQ-5D-5L has not been comprehensively investigated to date. This research aimed to assess older adults' understanding of the EQ-5D-5L using a think-aloud protocol with two cognition groups: no cognitive impairment and mild/moderate cognitive impairment.

METHODS

Participants' cognition was assessed using the Standardised Mini-Mental State Examination (SMMSE). Face-to face interviews were conducted with concurrent and retrospective think-aloud encouraged through verbal probing. Audio recordings were transcribed, and qualitative analysis, informed by the Tourangeau four-stage Response Model (comprehension, retrieval, decision process, response process) was conducted in NVivo.

RESULTS

In total, 46 older adults (age 65 +) were recruited from 10 residential care facilities across South Australia (n = 25 no cognitive impairment, n = 21 mild/moderate cognitive impairment). Comprehension, retrieval, judgement and response mapping issues were common across all cognition levels and EQ-5D-5L dimensions. The two dimensions resulting in the most response issues were usual activities and personal care.

CONCLUSION

Older adults may bring a different understanding to the EQ-5D-5L descriptive system than that expected given testing with general population samples. Dimension descriptors that are more relevant to this population may facilitate responses that better align with the underlying EQ-5D-5L concept model.

The Feasibility and Validity of Preference-Based Quality of Life Measures With Informal Carers: A Think-Aloud Study

OBJECTIVES

A range of preference-based quality of life (QoL) measures have been proposed for use with informal carers. Qualitative evaluation of validity and feasibility of the measures is an important step in understanding whether measures will work as intended. At present, little is known about the performance of different types of preference-based QoL measures with informal carers. The objective of this study was to qualitatively assess the feasibility, content validity (including face validity), and acceptability of 5 QoL measures (the Carer Experience Scale, CarerQoL-7D, ASCOT-C, ICECAP-A, and EQ-5D-5L) with informal carers.

METHODS

A total of 24 "think-aloud" interviews were conducted with a cross-section of carers of adults in the United Kingdom. This think-aloud process was followed by semistructured discussion to probe issues of validity and feasibility in more detail. The interview data were transcribed, coded to identify the frequency of errors in completing the QoL measures and thematically analyzed to study the validity, feasibility, and acceptability of the measures.

RESULTS

Few errors (3%-7% per item) were identified in completing each of the measures with little distinct pattern. Most participants found the measures to be concise, clear, and relevant. Challenges included relevance, context, time period, missing items, multiple questions, and response options. Informal carers generally expressed a preference for using a care-related QoL measure.

CONCLUSIONS

Existing preference-based QoL measures have encouraging validity and feasibility within a mixed sample of informal carers, with minor challenges raised. These challenges ought to be considered, alongside the decision context, when administering QoL measures in this context.

What does a "good life" mean for people living with dementia? A protocol for a think-aloud study informing the value of care

Introduction

Economic evaluation currently focuses almost exclusively on the maximization of health, using the Quality-Adjusted Life-Year (QALY) framework with instruments such as the EQ-5D, with a limited number of health-focused dimensions providing the assessment of health benefit. This evaluative framework is likely to be insufficient for setting priorities in dementia care because of its exclusive concern with health. Data are also often collected from the perspective of a proxy, limiting the voice of those living with dementia in decision-making. This protocol describes a research project that aims to gather the perspectives of people living with dementia, their insights, and preferences for assessing their quality of life to inform economic evaluation outcome measurement and design with a goal of creating a more robust evidence base for the value of healthcare services. Specifically, this study will elucidate what a "good life" means to people living with dementia and how well instruments currently used in economic evaluation meet this description. This project will further test the acceptability of capability wellbeing instruments as self-report instruments and compare them to generic and dementia-specific preference-based instruments.

Methods and analysis

People living with dementia, diagnosed, or waiting to receive a formal diagnosis and with the capacity to participate in research, will be invited to participate in an hour "think aloud" interview. Participants will be purposefully selected to cover a range of dementia diagnoses, age, and sex, recruited through the integrated care, geriatric, and post-diagnostic clinics at St James' and Tallaght University Hospitals and dementia support groups in the Ireland. During the interview, participants will be invited to reflect on a "good life" and "think aloud" while completing four economic quality of life instruments with a perspective that goes beyond health (AD-5D/QOL-AD, AQOL-4D, ICECAP-O, ICECAP-SCM). An interviewer will then probe areas of difficulty when completing the instruments in a semi-structured way. The analysis will identify the frequency of errors in comprehension, retrieval, judgment, and response from verbatim transcripts. Qualitative data will be analyzed using constant comparison.

Ethics

The St James's Hospital and Tallaght University Hospital Joint Research Ethics Committee approved the study (Approval Date: 11 April 2022).

A think-aloud study of the feasibility of patients with end-stage organ failure completing the ICECAP-SCM

BACKGROUND

The ICECAP-Supportive Care Measure (SCM) is a self-complete measure developed to inform economic decision making at the end-of-life. Previous research has demonstrated its feasibility in hospice and nursing home settings. This is the first study of its use with patients on the organ failure trajectory.

AIM

To determine the feasibility of using the ICECAP-SCM with patients experiencing end-stage organ failure in a hospital setting.

DESIGN

Participants were asked to 'think aloud' when completing the ICECAP-SCM, ICECAP-A and EQ-5D-5L measures. The interviews were transcribed verbatim and examined for errors in comprehension, retrieval, judgement, and response by five raters. Qualitative data were collected to explore reasons for errors in completing the measures and participants' views about the measures.

SETTING/PARTICIPANTS

Sixty patients (with end-stage renal failure n = 18; end-stage heart failure n = 21; end-stage chronic obstructive pulmonary disease n = 21) participated. Senior clinicians applied prognostic criteria to determine eligibility.

RESULTS

Participants reported that the measures were acceptable, clear, and easy to complete. Error rates in completing the measures were low (ICECAP-A = 3%,and ICECAP-SCM = 5.7% and EQ-5D-5L = 6.3%). There was some variation in responses between patients with different end-stage conditions, particularly those with symptom fluctuation. Some patients had not considered their end-of-life (i.e. advance care planning) and reported finding questions about this difficult to answer.

CONCLUSION

It is feasible to use the ICECAP-SCM with patients with end-stage organ failure receiving care in hospital settings. This study provides evidence for researchers and policy makers involved in measuring end-of-life care globally. The ICECAP-SCM can be recommended for research with patients in end-stage organ failure to appropriately capture the broader benefits of end-of-life care.

Challenges in Using Recommended Quality of Life Measures to Assess Fluctuating Health: A Think-Aloud Study to Understand How Recall and Timing of Assessment Influence Patient Responses

BACKGROUND

It can be challenging to measure quality of life to calculate quality-adjusted life-years in recurrent fluctuating health states, as quality of life can constantly change. It is not clear how patients who experience fluctuations complete measures and how assessment timing and recall influence responses.

OBJECTIVE

We aimed to understand how patients with fluctuating health complete widely recommended and commonly used measures (EQ-5D-5L, EORTC QLQ-C30 and SF-12) and the extent to which the recall period ('health today', 'past week' and 'past 4 weeks') and timing of assessment influence the way that patients complete these questionnaires.

METHODS

Twenty-four adult patients undergoing chemotherapy for urological, gynaecological or bowel cancers in the UK participated in think-aloud interviews, while completing the measures, completed a pictorial task illustrating how quality of life changed during the chemotherapy cycle and took part in semi-structured interviews. Transcripts were analysed using constant comparison.

RESULTS

Patients were consistent in describing their quality of life as changing considerably throughout a chemotherapy cycle. The shorter recall period of 'health today' does not adequately represent patients' quality of life because of fluctuations, patients remarked they could give a different answer depending on the timing of assessment, and many struggled to combine the "ups and downs" to answer measures with longer recall ('past week' and 'past 4 weeks'). Across all measures, patients attempted to provide averages, adopt the peak-end rule or focus on the best part of their experience. Patients commonly used more than one approach when completing a given questionnaire as well as across questionnaires.

CONCLUSIONS

Patients who experience recurrent fluctuations in health are unable to provide meaningful responses about their quality of life when completing quality-of-life measures due to the recall period and timing of assessment. The use of such responses to calculate health state values in economic evaluations to inform resource allocation decisions in fluctuating conditions must be questioned.

Do we agree or disagree? A systematic review of the application of preference-based instruments in self and proxy reporting of quality of life in older people

PURPOSE

Quality of life is an important person-centred outcome in health and aged care settings. Due to an increasing prevalence of cognitive decline and dementia in ageing populations, a proportion of older people receiving health and aged care services may not be able to reliably assess their own quality of life, highlighting the need for proxy assessment. This systematic review sought to investigate the level of agreement between self and proxy-report of older people's quality of life using established preference-based instruments of quality of life suitable for economic evaluation.

METHODS

A systematic review was conducted following PRISMA guidelines. Eight databases were searched: Web of Science, Scopus, Medline, Econlit, PsychINFO, CINAHL, Ageline and Cochrane Library. Information was extracted on the instruments, population samples (including any cognitive thresholds applied), mean scores, type of proxy, and measures of inter-rater agreement.

RESULTS

A total of 50 studies using eight different preference-based quality of life instruments were identified. Most studies were cross-sectional (72%) with a wide variety of cognitive assessments and thresholds applied to define older participants with cognitive impairment. The most common proxies were family members, mostly spouses. The level of agreement between self and proxy-report was generally poor - irrespective of the instrument applied or type of proxy - with proxy-report generally indicating lower levels of quality of life than self-report. There was some evidence of stronger agreement on more observable quality of life domains e.g., physical health and mobility, relative to less observable domains e.g. emotional well-being. Few studies tracked self and/or proxy-report of quality of life longitudinally.

CONCLUSIONS

More research is needed to develop evidence to inform guidance on self-report versus proxy-report of quality of life for older people receiving health and aged care services. Until then, the collection of both self and proxy reports as complementary measures is indicated.

Qualitative Review on Domains of Quality of Life Important for Patients, Social Care Users, and Informal Carers to Inform the Development of the EQ-HWB

OBJECTIVES

To identify the themes to inform the content of a new generic measure, the EQ-HWB (EQ Health and Wellbeing), that can be used in economic evaluation across health, social care, and public health, based on the views of users and beneficiaries of these services including informal carers.

METHODS

A qualitative review was undertaken. Systematic and citation searches were undertaken focusing on qualitative evidence of the impact on quality of life from reviews for selected health conditions, informal carers, social care users, and primary qualitative work used in the development of selected measures. A subset of studies was included in the review. Framework analysis and synthesis were undertaken based on a conceptual model.

RESULTS

A total of 42 reviews and 24 primary studies were selected for inclusion in the review. Extraction and synthesis resulted in 7 high-level themes (with subthemes): (1) feelings and emotions (sadness, anxiety, hope, frustration, safety, guilt/shame); (2) cognition (concentration, memory, confusion, thinking clearly); (3) self-identity (dignity/respect, self-esteem); (4) "coping, autonomy, and control" relationships; (5) social connections (loneliness, social engagement, stigma, support, friendship, belonging, burden); (6) physical sensations (pain, discomfort, sleep, fatigue); and (7) activity (self-care, meaningful activities, mobility, communication, hearing, vision). Apart from physical sensations, most of the other themes and subthemes were relevant across both health and social care, including for informal carers.

CONCLUSIONS

The findings from this broad review identified themes that go beyond health and that are relevant to patients, informal carers, and social care users. The themes and subthemes informed the domains for the EQ-HWB.

The use of composite time trade-off and discrete choice experiment methods for the valuation of the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): a think-aloud study

Purpose

To identify patterns and problems in completing composite time trade-off (C-TTO) and discrete choice experiment (DCE) exercises for the valuation of the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS) to inform the optimisation of a valuation protocol.

Methods

Fourteen cognitive interviews were conducted in the UK using concurrent and retrospective think-aloud and probing techniques. Each participant completed 8 C-TTO tasks and 8 DCE tasks within a computer-assisted personal interview setting. Verbal information was transcribed verbatim. Axial coding and thematic analysis were used to organise the qualitative data and identify patterns and problems with the completion of tasks.

Results

While participants found the tasks generally manageable, five broad themes emerged to explain and optimise the response to the tasks. (1) Format and structure: attention to the design of practice examples, instructions, and layout were needed. (2) Items and levels: underlying relationships were discovered across different combinations of levels of SWEMWBS items. (3) Decision heuristics: participants engaged in diverse strategies to assist trade-off decisions. (4) Valuation feasibility: certain states were difficult to imagine, compare and quantify. (5) Valuation outcome: the data quality was affected by participants’ discriminatory ability across states and their time trade-off decisions.

Conclusion

The interviews contributed insights regarding the robustness of the proposed methods. The application of C-TTO and DCE valuation techniques was practical and suitable for capturing individual attitudes towards different mental well-being scenarios. A modified protocol informed by the results is being tested in a larger sample across the UK.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-022-03123-0.

Challenges in developing capability measures for children and young people for use in the economic evaluation of health and care interventions

Methods for measuring outcomes suitable for economic evaluations of health and care interventions have primarily focused on adults. The validity of such methods for children and young people is questionable in areas including the outcome domains measured and how they are measured and valued, with most existing measures narrowly focusing on health. Novel methods for assessing benefits beyond health by focusing on a person's capability have also concentrated on adults to date. This paper aims to set out the rationale for capability measures in children and young people. It argues for the need to expand the evaluative space beyond health functioning towards broader capabilities, with children and young people playing an integral role in capability measure development. Drawing from existing literature, specific challenges related to the identification, measurement, and valuation of capabilities in children and young people are also discussed. Finally, the practical implications for conducting economic evaluation when measuring and valuing capabilities at different stages across the life-course are illustrated. We develop an alternative framework based on conceiving capabilities as evolving across the life-course. This framework may also be helpful in thinking about how to model health outcomes across the life-course.

Content validation of the Well-being of Older People measure (WOOP)

BACKGROUND

Valid measures of the well-being of older people are important for the evaluation of health and social care services. The nine-item Well-being of Older People measure (WOOP) was based on a novel framework derived from a recent Q-methodology study, and was developed to capture a comprehensive set of well-being domains relevant to older people, as identified by themselves. This study introduces the WOOP and describes the qualitative assessment of its feasibility and content validity.

METHODS

Between December 2017 and January 2018, a sampling agency retrieved data from 269 adults aged 65 years and older in the Netherlands. Using an online survey, participants were asked to complete the WOOP and to indicate the importance of each item to their well-being. Open-ended questions were used to collect information about participants' own definition of well-being, their interpretation of the items of the WOOP, and their assessment of the descriptions and response options provided with each item. Data were analysed using inductive content analysis with the software package ATLAS.ti.

RESULTS

The WOOP closely resembled respondents' own description of what well-being means to them. The majority of the respondents reported no important well-being aspects to be missing from the WOOP, and indicated all WOOP items to be at least 'reasonably important' to their well-being. Many linked the WOOP items to well-being aspects as intended, and only a few had suggestions for improving the items' descriptions and response options.

CONCLUSIONS

Given these results, all nine items were retained, and no items were added to the measure. Based on respondents' feedback, minor changes were made to the wording of some descriptions and response options of items. Concluding, the feasibility and content validity of the WOOP seem satisfactory. Further validation of this new measure is required, in different health and social care settings and among subgroups of older people with potentially different views on what constitutes well-being.

Known and Unknown Transboundary Infectious Diseases as Hybrid Threats

The pathogenicity, transmissibility, environmental stability, and potential for genetic manipulation make microbes hybrid threats that could blur the distinction between peace and war. These agents can fall below the detection, attribution, and response capabilities of a nation and seriously affect their health, trade, and security. A framework that could enhance horizon scanning regarding the potential risk of microbes used as hybrid threats requires not only accurately discriminating known and unknown pathogens but building novel scenarios to deploy mitigation strategies. This demands the transition of analyst-based biosurveillance tracking a narrow set of pathogens toward an autonomous biosurveillance enterprise capable of processing vast data streams beyond human cognitive capabilities. Autonomous surveillance systems must gather, integrate, analyze, and visualize billions of data points from different and unrelated sources. Machine learning and artificial intelligence algorithms can contextualize capability information for different stakeholders at different levels of resolution: strategic and tactical. This document provides a discussion of the use of microorganisms as hybrid threats and considerations to quantitatively estimate their risk to ensure societal awareness, preparedness, mitigation, and resilience.

Exploring young people's preferences for STI screening in the UK: A qualitative study and discrete choice experiment

INTRODUCTION

Stigma remains a key issue for many health screening interventions such as screening for sexually transmitted infections (STIs). Young people continue to experience the greatest burden of STI infection. In order to increase uptake, screening services need to be more patient-focused. This study sought to examine young people's preferences for sexual health screening to understand how scarce public health resources can optimise screening uptake.

METHODS

This study involved both qualitative and quantitative components. Focus groups and individual interviews were undertaken with young people aged 16-24 recruited from community settings and a specialist clinic. Themes which emerged from the focus groups were used to inform the design of a discrete choice experiment (DCE). A questionnaire survey (incorporating the DCE) was conducted with members of an internet panel, with over-sampling of black, Asian and minority ethnic groups.

RESULTS

Overall, 41 participants took part in eight focus groups and two in individual interviews. Six major themes emerged as important when making decisions about STI screening - stigma and embarrassment; knowledge about STIs and risk; where to get tested; how staff would treat them; what STIs to be tested for; and convenience (waiting times). Overall, 1946 participants took part in the survey. The DCE results revealed that the most important factors for young people are that all STIs are tested for, and that staff attitude is non-judgemental. The results also suggest that there is a preference for screening in specialist clinics and for full appointments over limited ones. Although respondents preferred shorter time periods for appointments and results, other 'process' factors were also important.

CONCLUSION

This study demonstrates that by combining qualitative and quantitative methods, a richer understanding of STI screening preferences is possible. The findings show that comprehensive testing and a perceived 'non-judgemental' attitude are particularly important to young people, as well as convenience.

Self- and proxy-rating of the ICECAP-O for people with dementia: A cross-sectional linguistic validation study in Germany and Portugal

BACKGROUND

The capability concept became a recognized approach to the measurement of quality of life. The ICECAP-O for older people aims to measure capabilities and has recently been used in people with dementia (self-rating) and informal carers (substituted judgement). However, linguistic validation studies have so far been lacking.

METHODS

A cross-sectional cognitive interview study with 15 people with dementia (PwD) and 23 informal carers (ICs) was conducted in Germany and Portugal. Respondents were asked to reveal their understanding of the ICECAP-O and the capability approach as well as the response process. A summarising content analysis was performed.

RESULTS

Despite the small sample, our linguistic validation of the German and Portuguese translations detected considerable difficulties or deviations in item comprehension when compared with the intended meaning. In some cases, the item interpretations did not reflect the entire scope of the associated capability dimension, though they were basically correct. Moreover, participants were not able to differentiate some items appropriately from one another, and some misinterpretations occurred. ICs relied mainly on observable behaviour, emotions, or verbal expressions of the PwD. Therefore, ICs found items that ask about the achievement of individual expectations or thoughts about the future difficult to assess. Only very few PwD clearly indicated that they understood the capability approach. ICs in Germany had more difficulties in understanding the capability concept than in ICs Portugal.

DISCUSSION

This linguistic validation study in Germany and Portugal indicates a need for some rephrasing and refinements of the ICECAP-O translated items in both countries to fully encompass some dimensions and avoid misinterpretations. Further studies with larger samples are necessary. Based on our findings, the current German version for ICs' substituted judgement cannot be recommended for this kind of respondents without further advancements.

Longer-term health and social care strategies for stroke survivors and their carers: the LoTS2Care research programme including cluster feasibility RCT

Background

It is reported that the longer-term outcomes for stroke survivors are poor, with a range of unmet needs identified.

Objectives

The aims were to develop and test a longer-term stroke care strategy focused on improving the quality of life of stroke survivors and their carers by addressing unmet needs, and maintenance and enhancement of participation (i.e. involvement in life situations).

Design

Five overlapping workstreams were undertaken – (1) refinement of content by semistructured interviews with stroke survivors and their carers and by a review of the literature to inform content and delivery of the care strategy; (2) exploration of service models by national survey and focus groups with purposely selected services; (3) intervention development by interaction with a reference group of stroke survivors, carers, and health and social care professionals; (4) refinement and pilot implementation of the developed intervention in three stroke services (case studies); and (5) a cluster randomised controlled feasibility trial in 10 stroke services across England and Wales.

Setting

The intervention development work and feasibility trial were in stroke services (inclusive of primary, secondary, community and social care provision) across England and Wales.

Participants

Participants were stroke survivors resident in the community and their carers, and health and social care professionals in the included stroke services.

Data sources

Interviews with 28 stroke survivors and their carers at least 9 months post stroke ascertained their needs and the barriers to and facilitators of addressing those needs. Additional literature reviews identified 23 needs. No evidence-based interventions to address these needs were reported; self-management was highlighted as a possible delivery mechanism. In workstream 2, a national survey revealed that the most common model of stroke service provision was care up to 12 months post stroke, reported by 46 (40%) services. Thirty-five (30%) services provided care up to 6 months post stroke and 35 (30%) provided care beyond 12 months, thus identifying 6 months post stroke as an appropriate delivery point for a new intervention. Through focus groups in a range of services, stroke survivors’ perceived unmet needs and the barriers to and enablers of service provision were identified.

Intervention

Using information obtained in workstreams 1 and 2 and working closely with a stakeholder reference group, we developed an intervention based on the unmet needs prioritised by stroke survivors and their carers (workstream 3). In workstream 4, action groups (clinicians, stroke survivors and researchers) were established in three stroke services that led implementation in their service and contributed to the iterative refinement of the intervention, associated training programme and implementation materials. The intervention (called New Start) was delivered at 6 months post stroke. Key components were problem-solving self-management with survivors and carers, help with obtaining usable information, and helping survivors and their carers build sustainable, flexible support networks.

Results

A cluster randomised feasibility trial (workstream 5) was successfully implemented in 10 stroke services across England and Wales, with associated process and health economic evaluations. Five services were randomised to provide New Start, while five continued with usual care; 269 participants were recruited. Progression criteria – in terms of our pre-determined (red, amber, green) criteria for progress to a full trial: target stroke survivor recruitment rates were achieved, on average, across sites (24.1 per site over 6 months, green); 216 (80.3%) registered stroke survivors returned follow-up questionnaires at 9 months (84.1% in the intervention arm and 75.8% in the usual care arm, green); according to data reported by sites, overall, 95.2% of registered stroke survivors were offered at least one session of the intervention (green); all five intervention sites had at least two facilitators deemed competent, delivered the New Start intervention and provided it to stroke survivors (green). However, at some sites, there were concerns regarding the number of stroke survivors being offered, accepting and receiving the intervention. Only small differences in outcomes and costs were observed between the New Start and usual care groups, and considerable uncertainty around the cost-effectiveness remains.

Conclusions

We report a complex programme of work that has described the longer-term needs of stroke survivors and highlighted evidence and service gaps. Working closely with stroke survivors, an intervention was developed that has been refined in three services and feasibility tested in a cluster randomised controlled trial. Further refinement of the target population and optimisation of the intervention materials is required prior to a full randomised controlled trial evaluation.

Future work

Optimisation of the intervention, and clearer specification of recipients, are required prior to a full trial evaluation.

Trial registration

Current Controlled Trials ISRCTN38920246.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 9, No. 3. See the NIHR Journals Library website for further project information.

Using Everyday Technology Independently When Living with Forgetfulness: Experiences of Older Adults in Barcelona

Older adults living with forgetfulness encounter difficulties when engaging with changing and dynamic everyday technology (ET). The capability to use ET is important for independence in later life and is affected by the contextual and individual characteristics of older adults. Using the capability approach as a theoretical lens, this phenomenological study aims to explore the experiences of older adults living with forgetfulness, in order to identify contextual and individual factors that facilitate the use of ET in everyday life. A qualitative methodology was used to interview 16 community-dwelling older adults participating in memory and technology workshops at local community centres in Barcelona. Findings show that motivation and openness to learning played a facilitating role in our participants’ use of ET. The presence of social support in the form of “technology experts” and community centres offering learning opportunities were also enhancing factors that encourage independence when engaging with ET. In conclusion, our study demonstrates the importance of expanding intergenerational ET learning opportunities, through the creation of age-friendly spaces.

Measuring capabilities in health and physical activity promotion: a systematic review

BACKGROUND

The capability approach by Amartya Sen and Martha Nussbaum has gained increasing attention in the field of public health. As it combines individual, social and structural factors and shifts the focus of attention from the actual behavior towards available options for health behaviors that people can actually choose from, it may help advance our understanding of complex health issues.

OBJECTIVES

The aim of this article is to identify and describe tools available to measure capabilities within the context of health, with a specific focus on capabilities for health-enhancing physical activity.

METHOD

We conducted a systematic literature review using 11 databases covering scientific journal articles published in English or German between the years 2000 and 2020 with a focus on capabilities for health or physical activity.

RESULTS

We found a total of 51 articles meeting our inclusion criteria. Four articles measured capabilities using qualitative methods, one combined qualitative and quantitative methods, while the rest used quantitative methods. We identified a total 11 different capability questionnaires, all showing moderate to good validity/reliability. Only one questionnaire and one interview-based tool specifically dealt with capabilities for health enhancing physical activity.

CONCLUSION

Although we were able to identify measurement tools for capabilities in health, this review has shown that there is no generic tool available for the measurement across all population- and age-groups, and tools focusing on physical activity are scarce. However, our results can be used as guide for future projects that aim at measuring capabilities.

Assessing the reliability and validity of the ICECAP-A instrument in Chinese type 2 diabetes patients

PURPOSE

We aimed to conduct psychometric tests for the Chinese version of ICECAP-A and compare the differences between ICECAP-A and EQ-5D-3L for patients with T2DM and explore the relationship between clinical conditions and ICECAP-A through diabetes-related clinical indicators.

METHODS

Data were collected from a sample of 492 Chinese T2DM patients. The reliability and validity of the ICECAP-A were verified. Exploratory factor analysis (EFA), correlation analysis and regression analysis were conducted for both the ICECAP-A and EQ-5D-3L.

RESULTS

Our results show that the Chinese version of ICECAP-A has good internal consistency with an overall Cronbach's Alpha coefficient of 0.721. The mean scores of ICECAP-A and EQ-5D-3L are 0.85 vs. 0.94. A weak correlation (r = 0.116) was found between the ICECAP-A tariff and EQ-5D-3L utility. EFA showed that although the five dimensions of the ICECAP-A and EQ-5D-3L scales were loaded into two different factors respectively. However, the two scales captured different dimensions of quality of life and can complement each other. The ICECAP-A, EQ-5D-3L, and EQ-VAS scores showed differences across different socio-demographic characteristics and clinic conditions groups.

CONCLUSION

The Chinese version of the ICECAP-A capability instrument can be for assessing outcomes in adults with T2DM. It may capture more dimensions of QoL than traditional Health-related QoL (HRQoL) instruments and may be useful for economic evaluations of health care and social care for people with T2DM or other chronic diseases.

Measuring capability wellbeing in adults at different stages of life for use in economic evaluation of health and care interventions: a qualitative investigation in people requiring kidney care

PURPOSE

Capability wellbeing measures, such as the ICECAP measures, have been proposed for use in economic evaluations to capture broader outcomes of health and care interventions. The ICECAP measures have been developed to reflect capabilities at different stages of life. Some patient groups include patients of different ages and at different stages of life, so it is not always apparent which ICECAP measure is most relevant. This study explores the impact of age and life stage on completion, where both ICECAP-A and ICECAP-O were completed by the same patient.

METHODS

A think-aloud study, and an associated semi-structured interview were conducted with people receiving kidney care as a renal outpatient, kidney transplant outpatient, or through receiving facility-based haemodialysis. Qualitative analysis focused on (1) differences in responses across measures by individuals, where attributes had conceptual overlap, (2) key factors in self-reported capability levels, and (3) measure preference.

RESULTS

Thirty participants were included in the study, with a mix of older and younger adults. Attributes with similar wording across measures produced similar responses compared to attributes where wording differed. Age and health were key factors for self-reported capability levels. ICECAP-A was slightly preferred overall, including by older adults.

CONCLUSION

This study suggests use of ICECAP-A in patients with certain chronic health conditions that include a mix of adults across the life course. This study highlights the importance of considering the stage of life when using capability measures and in economic evaluations of health and care interventions more generally.

Empirical Validity of a Generic, Preference-Based Capability Wellbeing Instrument (ICECAP-A) in the Context of Spinal Cord Injury

BACKGROUND

Assessing the validity of generic instruments across different clinical contexts is an important area of methodological research in economic evaluation and outcomes measurement.

OBJECTIVE

Our objective was to examine the empirical validity of a generic, preference-based capability wellbeing instrument (ICECAP-A) in the context of spinal cord injury.

METHODS

This study consisted of a secondary analysis of data collected using an online cross-sectional survey. The survey included questions regarding demographics, injury classifications and characteristics, secondary health conditions, quality of life and wellbeing, and functioning in activities of daily living. Analysis comprised the descriptive assessment of Spearman's rank correlations between item-/dimension-level data for the ICECAP-A and four preference-based health-related quality of life (HRQoL) instruments, and discriminant and convergent validity approaches to examine 21 evidence-informed or theoretically derived constructs. Constructs were defined using participant and injury characteristics and responses to a range of health, wellbeing and functioning outcomes.

RESULTS

Three hundred sixty-four individuals completed the survey. Mean index score for the ICECAP-A was 0.761; 12 (3%) individuals reported full capability (upper anchor; score = 1), and there were no reports of zero capabilities (lower anchor; score = 0). The strongest correlations were dominated by items and dimensions on the comparator (HRQoL) instruments that are non-health aspects of quality of life, such as happiness and control over one's life (including self-care). Of 21 hypothesised constructs, 19 were confirmed in statistical tests, the exceptions being the exploratory hypotheses regarding education and age at injury.

CONCLUSION

The ICECAP-A is an empirically valid outcome measure for assessing capability wellbeing in people with spinal cord injury living in a community setting. The extent to which the ICECAP-A provides complementary information to preference-based HRQoL instruments is dependent on the comparator.

Proxy responses to ICECAP-A: Exploring variation across multiple proxy assessments of capability well-being for the same individuals

Background

The ICECAP capability measures are increasingly being used to capture the impact of health and social care interventions on well-being. In cases where the recipient of an intervention is highly vulnerable, proxy completion may be necessary. This study adds to the limited existing evidence on proxy completion of ICECAP-A specifically and adopts the novel approach of investigating multiple proxy responses for the same four (hypothetical) individuals.

Methods

62 members of the public who were participating in a series of one day deliberative workshops on public health and social care completed ICECAP-A on behalf of four hypothetical individuals, described in vignettes. Quantitative analysis explored the range of proxy responses for each of the four hypothetical individuals, and any possible correlation between participants’ own characteristics and their proxy responses. Participants discussed their proxy responses after completing the task; this discussion was audio recorded and analysed using Framework Analysis.

Results

Wide variation in ICECAP-A scores was observed across proxy respondents for each hypothetical individual. Participants’ demographic characteristics and own well-being do not appear to have systematically influenced proxy responses. Qualitative analysis suggests two principal approaches (or perspectives) were adopted by participants: Empathetic (adopting the perspective of the ‘subject’) and factual (a factual assessment of the subject’s well-being). Participants also drew on their own experiences to varying degrees. There were differing interpretations of the Independence attribute on ICECAP-A and some evidence that participants’ ideas of what constituted achievement were context (including life-stage and condition/health) specific.

Conclusions

The factual versus empathetic approaches identified from qualitative analysis in this study match to the concept of a proxy-proxy versus proxy-patient perspective, previously outlined in the literature. Researchers should consider specifying which perspective proxy raters should adopt. Findings also suggest proxy responses can be influenced by external points of reference and interpretation of measure attributes.

Well-being of Older People (WOOP): Quantitative validation of a new outcome measure for use in economic evaluations

There is a need for comprehensive measures to evaluate the benefits of health and social care services for older people. The newly developed Well-being of Older People measure (WOOP) aims to capture all aspects that older people find important to their well-being. This study explores the validity and test-retest reliability of the WOOP. Between December 2017 and January 2018, an online survey was used to retrieve data from 1113 people aged 65 years and older in the Netherlands. Regression analyses on Cantril's Ladder scores were conducted to explore the relative importance of the items of the WOOP. Dimensionality was checked using exploratory factor analysis. Convergent and discriminant validity were investigated by relating the WOOP to several measures of health and well-being. Test-retest reliability was examined using data from 269 respondents that participated in a second online survey, distributed one week after the first. The items of the WOOP were significantly associated with Cantril's Ladder scores. When regressed simultaneously this was still true for all but the 'social contacts' item and one level of the 'acceptance and resilience' item. The dimensionality analysis revealed three factors, of which two included items of the WOOP and the EQ-5D-5L and the third only items of the WOOP. The WOOP correlated moderately to highly with physical health, and (very) highly with (mental) health and well-being measures. The test-retest reliability in terms of ICC was high, whereas the kappa for the items was fair to good, except for two items. Overall, the WOOP seems to capture aspects relevant to the well-being of older people adequately, and the results of first validity and reliability tests were satisfactory. Before the WOOP can be used in economic evaluations, further validation in a variety of health and social care settings is recommended, and utility weights need to be determined.

A qualitative exploration of the content and face validity of preference-based measures within the context of dementia

BACKGROUND

Assessing the cost-effectiveness of interventions for people with dementia, based on cost per quality-adjusted life years (QALYs) gained, requires that the measures used to derive QALYs are preference-based whilst also being valid, feasible to use, comprehensible and acceptable for people with dementia. The aim of this study was to assess the content and face validity of six preference-based measures (PBMs) within the context of dementia.

METHODS

Qualitative focus groups and interviews were conducted with community-dwelling individuals with mild dementia and carers of people with dementia. After exploring participants' understanding of 'quality of life' (QoL), six PBMs were assessed for content and face validity: two measures assessing health-related QoL (EQ-5D-5L and AQoL-8D); two covering broader aspects of capability wellbeing and social care-related QoL (ICECAP-O and ASCOT); and two dementia-specific QoL measures (DEMQOL-U and AD-5D). A random mix of one health-related QoL measure, one wellbeing measure, and one dementia-specific measure was explored in each session. All sessions were audiotaped and transcribed verbatim. Data were analysed thematically.

RESULTS

Nine individuals with mild dementia and 17 carers of people with dementia participated across 4 focus groups and 10 interviews. Participants perceived 9 broad QoL domains as relevant to them: Activity, Autonomy, Cognition, Communication, Coping, Emotions, End-of-Life, Physical Functioning, and Relationships. These domains had limited overlap with the content of the six PBMs. Assessment of face validity was summarized into eight themes: (1) ambiguous questions, (2) double -barrelled questions, (3) difficult/abstract questions, (4) judgemental/confronting questions, (5) lack of relevance and comprehensiveness, (6) response options, (7) layout/format and (8) proxy-response. There was no clear preference for one of the six measures explored; participants identified advantages and disadvantages across all measures. Although particularly designed for individuals with dementia, dementia-specific QoL measures were not always favoured over non-specific measures.

CONCLUSION

Given the shortcomings of PBMs identified in this study, further empirical comparative analyses are necessary to guide the selection of PBMs for future dementia research.

Capability instruments in economic evaluations of health-related interventions: a comparative review of the literature

PURPOSE

Given increasing interest in using the capability approach for health economic evaluations and a growing literature, this paper aims to synthesise current information about the characteristics of capability instruments and their application in health economic evaluations.

METHODS

A systematic literature review was conducted to assess studies that contained information on the development, psychometric properties and valuation of capability instruments, or their application in economic evaluations.

RESULTS

The review identified 98 studies and 14 instruments for inclusion. There is some evidence on the psychometric properties of most instruments. Most papers found moderate-to-high correlation between health and capability measures, ranging between 0.41 and 0.64. ASCOT, ICECAP-A, -O and -SCM instruments have published valuation sets, most frequently developed using best-worst scaling. Thirteen instruments were originally developed in English and one in Portuguese; however, some translations to other languages are available. Ten economic evaluations using capability instruments were identified. The presentation of results show a lack of consensus regarding the most appropriate way to use capability instruments in economic evaluations with discussion about capability-adjusted life years (CALYs), years of capability equivalence and the trade-off between maximisation of capability versus sufficient capability.

CONCLUSION

There has been increasing interest in applying the capability-based approach in health economic evaluations, but methodological and conceptual issues remain. There is still a need for direct comparison of the different capability instruments and for clear guidance on when and how they should be used in economic evaluations.

Response process validity of three patient reported outcome measures for people requiring kidney care: a think-aloud study using the EQ-5D-5L, ICECAP-A and ICECAP-O

OBJECTIVES

To determine the response process validity, feasibility of completion, acceptability and preferences for three patient-reported outcome measures that could be used in economic evaluation-the EQ-5D-5L, ICECAP-A and ICECAP-O-in people requiring kidney care.

DESIGN

Participants were asked to 'think-aloud' while completing the EQ-5D-5L, ICECAP-A and ICECAP-O, followed by a semistructured interview. Five raters identified errors or struggles in completing the measures from the think-aloud component of the transcripts. Patient preferences for measures were extracted from the semistructured interview.

SETTING

Eligible patients were identified through a large UK secondary care renal centre.

PARTICIPANTS

In total, 30 participants were included in the study, consisting of patients attending renal outpatients for chronic kidney disease (n=18), with a functioning kidney transplant (n=6) and receiving haemodialysis (n=6).

RESULTS

Participants had few errors and struggles in completing the EQ-5D-5L (11% error rate, 3% struggle rate), ICECAP-A (2% error rate, 2% struggle rate) and ICECAP-O (4% error rate, 3% struggle rate). The main errors with the EQ-5D-5L were judgements that did not comply with the 'your health today' instruction. Comprehension errors were most prominent on ICECAP-O. Judgement errors were the only errors reported on ICECAP-A. Although the EQ-5D-5L had slightly more errors and struggles, it was the measure most preferred, with participants able to make a clearer link with EQ-5D-5L and their health condition.

CONCLUSIONS

The EQ-5D-5L, ICECAP-A and ICECAP-O are feasible for people requiring kidney care to complete and can be included in studies conducting economic evaluations of kidney care interventions. Further research is required to assess how health (eg, EQ-5D) and capability (eg, ICECAP) measures can be included in an economic evaluation simultaneously, as well as what ICECAP measure(s) to include when patient groups straddle the age ranges for ICECAP-A (18 years and older) and ICECAP-O (65 years and older).

A Systematic Review of the Feasibility and Psychometric Properties of the ICEpop CAPability Measure for Adults and Its Use So Far in Economic Evaluation

OBJECTIVES

Development of the ICEpop CAPability measure for Adults (ICECAP-A) was reported in 2012; use of certain capability measures was suggested in the context of social or long-term care soon afterward by decision-making organizations in the United Kingdom and The Netherlands. Despite enthusiasm for the ICECAP-A, this study represents the first attempt to collate evidence on its psychometric properties and its use in economic analysis.

METHODS

A systematic review of studies published between January 2012 and February 2019 that have either explored the psychometric properties of the ICECAP-A (validity, reliability, and responsiveness) or report its use in economic analysis.

RESULTS

Twenty-seven studies were identified, 11 undertaking some form of economic analysis (including pilot and feasibility studies) and 16 assessing psychometric properties (7 assessing construct validity). The ICECAP-A has mainly been used in the United Kingdom, but also in other English-speaking countries and in Europe, across a wide range of healthcare contexts. There is promising evidence on content validity, construct validity, and responsiveness. Although there was consistently strong associations between the ICECAP-A and the Assessment of Quality of Life-Eight Dimension, associations with the EuroQol 5-dimension 3-level and EuroQol 5-dimension 5-level were inconsistent. In some cases, it was found that a switch in evaluative space from health to capability well-being would alter resource allocation decisions.

CONCLUSION

The ICECAP-A is correlated with health-related quality of life but is most appropriately regarded as a complement for and not a substitute to the EuroQol 5-dimension 3-level and EuroQol 5-dimension 5-level in particular. Positive evidence of the measure's content and construct validity is beginning to accumulate, but further conceptual and policy debate is needed regarding the equity implications of switching between evaluative spaces.

Cross-Cultural Adaptation and Psychometric Analysis of the Persian Version of the ICEpop CAPability Measure for Adults Capability Measure in the Iranian General Population

OBJECTIVES

The ICEpop CAPability measure for adults (ICECAP-A) is a measure of capability well-being for adults and, by focusing on more than health, can extend the evaluative space of economic evaluations. The aim of this study was to translate and culturally adapt the ICECAP-A questionnaire into Persian to assess the construct validity and reliability of the ICECAP-A in the Iranian general population.

METHODS

In this study, we followed Beaton's guidelines for cross-cultural adaptation of self-report measures. The questionnaire was administered to a sample of 1200 members of the general population using a stratified probability sampling method. The construct validity and reliability of the ICECAP-A were evaluated in relation to the EuroQol 5-dimension questionnaire (EQ-5D-5L).

RESULTS

After translating and adapting the questionnaire, the term "being settled" was changed to "stability" for the Iranian cultural context. A moderate correlation (r = 0.48) was found between the ICECAP-A and EQ-5D-5L index scores, and the ICECAP-A scores showed differences across different health and socio-economic groups. The results of the exploratory factor analysis indicated that the 2 instruments measured 2 different constructs. In terms of reliability, the internal consistency of the measure using Cronbach's alpha was found to be 0.82 and for test-retest reliability, the intraclass correlation coefficient (ICC) was found to be 0.90 for total scores.

CONCLUSIONS

The results of this study suggest that the Persian version of the ICECAP-A is a valid and reliable questionnaire and can complement EQ-5D measures already used in Iran.

A group intervention to improve quality of life for people with advanced dementia living in care homes: the Namaste feasibility cluster RCT

BACKGROUND

People with advanced dementia who live and die in nursing homes experience variable quality of life, care and dying. There is a need to identify appropriate, cost-effective interventions that facilitate high-quality end-of-life care provision.

OBJECTIVES

To establish the feasibility and acceptability to staff and family of conducting a cluster randomised controlled trial of the Namaste Care intervention for people with advanced dementia in nursing homes.

DESIGN

The study had three phases: (1) realist review and (2) intervention refinement to inform the design of (3) a feasibility cluster randomised controlled trial with a process evaluation and economic analysis. Clusters (nursing homes) were randomised in a 3 : 1 ratio to intervention or control (usual care). The nature of the intervention meant that blinding was not possible.

SETTING

Nursing homes in England providing care for people with dementia.

PARTICIPANTS

Residents with advanced dementia (assessed as having a Functional Assessment Staging Test score of 6 or 7), their informal carers and nursing home staff.

INTERVENTION

Namaste Care is a complex group intervention that provides structured personalised care in a dedicated space, focusing on enhancements to the physical environment, comfort management and sensory engagement.

MAIN OUTCOME MEASURES

The two contender primary outcome measures were Comfort Assessment in Dying - End of Life Care in Dementia for quality of dying (dementia) and Quality of Life in Late Stage Dementia for quality of life. The secondary outcomes were as follows: person with dementia, sleep/activity (actigraphy), neuropsychiatric symptoms, agitation and pain; informal carers, satisfaction with care at the end of life; staff members, person-centred care assessment, satisfaction with care at the end of life and readiness for change; and other data - health economic outcomes, medication/service use and intervention activity.

RESULTS

Phase 1 (realist review; 86 papers) identified that a key intervention component was the activities enabling the development of moments of connection. In phase 2, refinement of the intervention enabled the production of a user-friendly 16-page A4 booklet. In phase 3, eight nursing homes were recruited. Two homes withdrew before the intervention commenced; four intervention and two control homes completed the study. Residents with advanced dementia (n = 32) were recruited in intervention (n = 18) and control (n = 14) homes. Informal carers (total, n = 12: intervention, n = 5; control, n = 7) and 97 staff from eight sites (intervention, n = 75; control, n = 22) were recruited over a 6-month period. Recruitment is feasible. Completion rates of the primary outcome questionnaires were high at baseline (100%) and at 4 weeks (96.8%). The Quality of Life in Late Stage Dementia was more responsive to change over 24 weeks. Even where economic data were missing, these could be collected in a full trial. The intervention was acceptable; the dose varied depending on the staffing and physical environment of each care home. Staff and informal carers reported changes for the person with dementia in two ways: increased social engagement and greater calm. No adverse events related to the intervention were reported.

CONCLUSIONS

A subsequent definitive trial is feasible if there are amendments to the recruitment process, outcome measure choice and intervention specification.

FUTURE WORK

In a full trial, consideration is needed of the appropriate outcome measure that is sensitive to different participant responses, and of clear implementation principles for this person-centred intervention in a nursing home context.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN14948133.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 6. See the NIHR Journals Library website for further project information.

Adaptation, Acceptance and Adaptive Preferences in Health and Capability Well-Being Measurement Amongst Those Approaching End of Life

BACKGROUND AND OBJECTIVES

Adaptive preferences occur when people subconsciously alter their views to account for the possibilities available to them. Adaptive preferences may be problematic where these views are used in resource allocation decisions because they may lead to underestimation of the true benefits of providing services. This research explored the nature and extent of both adaptation (changing to better suit the context) and adaptive preferences (altering preferences in response to restricted options) in individuals approaching the end of life (EoL).

METHODS

Qualitative data from 'thinkaloud' interviews with 33 hospice patients, 22 close persons and 17 health professionals were used alongside their responses to three health/well-being measures for use in resource allocation decisions: EQ-5D-5L (health status); ICECAP-A (adult capability); and ICECAP-SCM (Supportive Care Measure; EoL capability). Constant comparative analysis combined a focus on both verbalised perceptions across the three groups and responses to the measures.

RESULTS

Data collection took place between October 2012 and February 2014. Informants spoke clearly about how patients had adapted their lives in response to symptoms associated with their terminal condition. It was often seen as a positive choice to accept their state and adapt in this way but, at the same time, most patients were fully aware of the health and capability losses that they had faced. Self-assessments of health and capability generally appeared to reflect the pre-adaptation state, although there were exceptions.

CONCLUSION

Despite adapting to their conditions, the reference group for individuals approaching EoL largely remained a healthy, capable population, and most did not show evidence of adaptive preferences.

Hospice patients' participation in choice experiments to value supportive care outcomes

BACKGROUND

Values used in economic evaluation are typically obtained from the general public, which is problematic when measures are to be used with people experiencing a life-course stage such as the end of life.

OBJECTIVE

To assess the feasibility of obtaining values for the ICECAP-Supportive Care Measure (SCM) from patients receiving advanced supportive care through a hospice.

METHODS

Participants completed eight best-worst scaling questions in a think-aloud interview to explain choices in different hypothetical end-of-life scenarios. Three independent raters identified errors in completion of the best-worst scaling task, and thematic analysis of associated qualitative data was undertaken to explore task difficulty and choices.

RESULTS

Twelve hospice patients were recruited. Most were able to complete the task and prioritise aspects of supportive care with either no difficulty (n=50%) or difficulty in just one of the eight scenarios (n=25%). Two patients (n=17%) were unable to comprehend the hypothetical nature of the task. The qualitative data confirmed there was good engagement with the task and identified the importance the respondents attached to maintaining dignity.

CONCLUSION

The findings suggest that people at the end of life will be able to complete a short, interviewer-administered, best-worst scaling task. To maximise engagement, it is recommended that the task is short and initiated with an example. Scenarios are best presented on show-cards in large print. A full evaluation of the ICECAP-SCM with those at the end of life is feasible.

Does freedom make a difference? : An empirical investigation of differences between subjective well-being and perceived capabilities amongst cancer patients

Perceived capabilities-a subjective operationalization of Sen's concept of capability-and subjective well-being are increasingly regarded as relevant information about individual well-being to guide resources allocation in healthcare. Although they refer to different notions, both types of measures rely on self-reported information and little is known as to how they compare together empirically. The aim of this paper is to investigate differences between measures of subjective well-being and of perceived capabilities in terms of their correlation with dimensions of health-related quality of life using panel data concerning a sample of 293 breast cancer and melanoma patients. Regression analyses suggest that the measures capture quite different aspects of the patients' welfare. Differences in the correlation with dimensions of health also seem consistent with the underlying notions to which these measures refer. However, our findings also suggest that future researches should aim at determining how measures of perceived capabilities may be influenced by individual personality traits.

The Definition of Health: Towards New Perspectives

The definition of health is not just a theoretical issue, because it has many implications for practice, policy, and health services. The current definition of health, formulated by the WHO, is no longer adequate for dealing with the new challenges in health care systems. Despite many attempts to replace it, no alternative definition has reached a wide level of consensus. Assuming an epistemological perspective, the need for a unique definition has to be rejected in favor of a plural approach in which cannot exist the best definition of health but many different definitions, more or less useful depending on the scope of application. Nevertheless, it should be noted that not all potential definitions of health are fit to pursue clinical scientific goals. Based on recent scientific debate, one can maintain that each definition of health should have at least 9 features to work well within the clinical scientific field. Moving from this perspective, a new definition has been developed for pursuing health, especially in the fields of chronic patients and older people.

An intervention to support stroke survivors and their carers in the longer term (LoTS2Care): study protocol for a cluster randomised controlled feasibility trial

BACKGROUND

Despite the evidence that many stroke survivors report longer term unmet needs, the provision of longer term care is limited. To address this, we are conducting a programme of research to develop an evidence-based and replicable longer term care strategy. The developed complex intervention (named New Start), which includes needs identification, exploration of social networks and components of problem solving and self-management, was designed to improve quality of life by addressing unmet needs and increasing participation.

METHODS/DESIGN

A multicentre, cluster randomised controlled feasibility trial designed to inform the design of a possible future definitive cluster randomised controlled trial (cRCT) and explore the potential clinical and cost-effectiveness of New Start. Ten stroke services across the UK will be randomised on a 1:1 basis either to implement New Start or continue with usual care only. New Start will be delivered by trained facilitators and will be offered to all stroke survivors within the services allocated to the intervention arm. Stroke survivors will be eligible for the trial if they are 4-6 months post-stroke and residing in the community. Carers (if available) will also be invited to take part. Invitation to participate will be initiated by post and outcome measures will be collected via postal questionnaires at 3, 6 and 9 months after recruitment. Outcome data relating to perceived health and disability, wellbeing and quality of life as well as unmet needs will be collected. A 'study within a trial' (SWAT) is planned to determine the most acceptable format in which to provide the postal questionnaires. Details of health and social care service usage will also be collected to inform the economic evaluation. The feasibility of recruiting services and stroke survivors to the trial and of collecting postal outcomes will be assessed and the potential for effectiveness will be investigated. An embedded process evaluation (reported separately) will assess implementation fidelity and explore and clarify causal assumptions regarding implementation.

DISCUSSION

This feasibility trial with embedded process evaluation will allow us to gather important and detailed data regarding methodological and implementation issues to inform the design of a possible future definitive cRCT of this complex intervention.

TRIAL REGISTRATION

ISRCTN38920246 . Registered 22 June 2016.

Adaptation and assessments of the Chinese version of the ICECAP-A measurement

BACKGROUND

This study adapts the ICECAP measure for Adults (ICECAP-A) to assess its capacity to measure the quality of life in China for economic evaluation.

METHODS

Qualitative and quantitative methods were used to translate the ICECAP-A measure for wellbeing, established by the University of Birmingham, UK, to the Chinese cultural context. A focus group discussion solved the appropriateness and wording of the ICECAP attributes in Chinese; and a randomly selected sample of 1000 adults aged over 18 years were online surveyed. We conducted psychometric tests and compared the factors influencing the ICECAP-A measure with those influencing EQ-5D-3 L.

RESULTS

Members of the focus group discussion agreed that the five attributes of the ICECAP-A measure are sufficient to evaluate wellbeing in China. However, the terms "being settled" and "friendship" were changed to "stability" and "kindness" for the Chinese cultural context. Our results show that the Chinese version of ICECAP-A has good internal consistency with an overall Cronbach's Alpha coefficient of 0.7999. The concurrent validity indicates that ICECAP-A is moderately correlated with EQ-5D-3 L (r ≤ 0.52).

CONCLUSIONS

The ICECAP-A measure can be adapted to evaluate wellbeing in China, but cultural changes to the wording are necessary. It is a valid measurement of wellbeing and can complement the EQ-5D already used in China. However, further work is still needed to evaluate the sensitivity of the ICECAP-A measure in relation to public health and social care.

Do capability and functioning differ? A study of U.K. survey responses

A core feature of the capability approach is that a person's capabilities (what they are able to do and be in their life) can differ from their functionings (what they actually do and are in their life). However, the degree to which capability and functioning differ in practice is unclear. This paper investigates this issue, focusing on capability and functioning differences (CFD) across different aspects of life and different individuals. In the study, the ICECAP-A capability questionnaire was modified to measure both functionings and capabilities and was completed by U.K.-based convenience sample of 943 people. Around one third of people reported CFD in at least one area of their life, most commonly in terms of their "achievement." People were more likely to report CFD when they had a degree-level education and when they had impaired health. An additional finding was that capability varied more with education whereas functioning varied more with health status. This finding needs further examination, but it suggests that the choice of evaluative space may influence how priorities are set for public spending.

Qualitative assessment of the primary care outcomes questionnaire: a cognitive interview study

BACKGROUND

The Primary Care Outcomes Questionnaire (PCOQ) is a new patient-reported outcome measure designed specifically for primary care. This paper describes the developmental process of improving the item quality and testing the face validity of the PCOQ through cognitive interviews with primary care patients.

METHODS

Two formats of the PCOQ were developed and assessed: the PCOQ-Status (which has an adjectival scale) and the PCOQ-Change (which has the same items as the PCOQ-Status, but a transitional scale). Three rounds of cognitive interviews were held with twenty patients from four health centres in Bristol. Patients seeking healthcare were recruited directly by their GP or practice nurse, and others not currently seeking healthcare were recruited from patient participation groups. An adjusted form of Tourangeau's model of cognitive processing was used to identify problems. This contained four categories: general comprehension, temporal comprehension, decision process, and response process. The resultant pattern of problems was used to assess whether the items and scales were working as intended, and to make improvements to the questionnaires.

RESULTS

The problems identified in the PCOQ-Status reduced from 41 in round one to seven in round three. It was noted that the PCOQ-Status seemed to be capturing a subjective view of health which might not vary with age or long-term conditions. However, as it is designed to be evaluative (measuring change over time) as opposed to discriminative (measuring change between different groups of people), this does not present a problem for validity. The PCOQ-Status was both understood by patients and was face valid. The PCOQ-Change had less face validity, and was misunderstood by three out of six patients in round 1. It was not taken forward after this round.

CONCLUSIONS

The cognitive interviews successfully contributed to the development of the PCOQ. Through this study, the PCOQ-Status was found to be well understood by patients, and it was possible to improve comprehension through each round of interviews. The PCOQ-Change was poorly understood and, given that this corroborates existing research, this may call into question the use of transitional questionnaires generally.

Quality of life in a broader perspective: Does ASCOT reflect the capability approach?

Purpose

Economic evaluation of services and interventions in care services tends to focus on quality of life(QoL) based on health-related measures such as EQ5D, with a major focus on health and functioning. The Capability Approach (CA) provides an alternative framework for measuring QoL and challenges some of the conventional issues in the current practice of measurement of QoL. The Adult Social Care Outcomes Toolkit (ASCOT) aims to measure social care-related QoL in a broad sense. This article investigates whether and, if so, how the ASCOT addresses issues put on the agenda by the CA.

Methods

Literature analysis concerning theoretical assumptions and arguments of CA and ASCOT.

Results

The Capability Approach (CA) puts three issues on the agenda regarding QoL. First, the focus of evaluation should not be on functioning, but on freedom of choice. Second, evaluation should be critical about adaptive preferences, which entail that people lower expectations in situations of limited possibilities. Third, evaluation should not only address health, but also other domains of life. Our analysis shows that freedom of choice is reflected in the response option ‘as I want’ in the ASCOT questionnaire. The problem of adaptive preferences is countered in the ASCOT by developing a standard based on preferences of the general population. Third, the ASCOT contains several domains of life.

Conclusions

We conclude that the CA and the ASCOT contribute to the discussion on QoL, and that the ASCOT operationalizes core assumptions of the CA, translating the issues raised by the CA in a practical way.

Are Quality-Adjusted Life Years a Good Proxy Measure of Individual Capabilities?

BACKGROUND

There is a debate in the health economics literature concerning the most appropriate way of applying Amartya Sen's capability approach in economic evaluation studies. Some suggest that quality-adjusted life years (QALYs) alone are adequate while others argue that this approach is too narrow and that direct measures of capability wellbeing provide a more extensive application of Sen's paradigm.

OBJECTIVE

This paper empirically explores whether QALYs provide a good proxy for individual capabilities.

METHODS

Data is taken from a multinational cross-sectional survey of individuals with seven health conditions (asthma, arthritis, cancer, depression, diabetes, hearing loss, heart disease) and a healthy population. Each individual completed the ICECAP-A measure of capability wellbeing for adults and six health utility instruments that are used to generate QALYs, including EQ-5D and SF-6D. Primary analysis examines how well health utility instruments can explain variation in the ICECAP-A using ordinary least squares regression.

RESULTS

The findings show that all seven health conditions have a negative association on overall capability as measured by the ICECAP-A index. Inclusion of health utility instruments into separate regressions improves the predictive power of capability but on average, explains less than half of the variation in capability wellbeing. Individuals with arthritis appear to be less inhibited in terms of capability losses when accounting for health utility, yet those who have depression record significant reductions in capability relative to the healthy population even after accounting for the most commonly used health utility instruments.

CONCLUSION

The study therefore casts doubt on the ability of QALYs to act as a reliable proxy measure of individuals' capability.

Assessing the validity of the ICECAP-A capability measure for adults with depression

BACKGROUND

Effectiveness and cost-effectiveness are increasingly important considerations in determining which mental health services are funded. Questions have been raised concerning the validity of generic health status instruments used in economic evaluation for assessing mental health problems such as depression; measuring capability wellbeing offers a possible alternative. The aim of this study is to assess the validity of the ICECAP-A capability instrument for individuals with depression.

METHODS

Hypotheses were developed using concept mapping. Validity tests and multivariable regression analysis were applied to data from a cross-sectional dataset to assess the performance of ICECAP-A in individuals who reported having a primary condition of depression. The ICECAP-A was collected alongside instruments used to measure: 1. depression using the depression scale of the Depression, Anxiety and Stress Scale (DASS-D of DASS-21); 2. mental health using the Kessler Psychological Distress Scale (K10); 3. generic health status using a common measure collected for use in economic evaluations, the five level version of EQ-5D (EQ-5D-5L).

RESULTS

Hypothesised associations between the ICECAP-A (items and index scores) and depression constructs were fully supported in statistical tests. In the multivariable analysis, instruments designed specifically to measure depression and mental health explained a greater proportion of the variation in ICECAP-A than the EQ-5D-5L.

CONCLUSION

The ICECAP-A instrument appears to be suitable for assessing outcome in adults with depression for resource allocation purposes. Further research is required on its responsiveness and use in economic evaluation. Using a capability perspective when assessing cost-effectiveness could potentially re-orientate resource provision across physical and mental health care services.

How do individuals value health states? A qualitative investigation

Despite the importance of health state values in informing resource allocation in health care, there is arguably little known about how individuals value health. Previous studies have shown that a variety of non-health factors and beliefs are important in valuing health, but there is less evidence in the literature about how individuals' beliefs affect their preferences or what role non-health factors play in the process of forming preferences. This study investigated the thought processes of 21 U.K. based participants in March 2013 who valued health states using semi-structured interviews and a think-aloud protocol, with the aim to better understand the relationship between health states, the individual's underlying beliefs, and the individual's preferences. Participants followed several stages in valuing health. First, participants interpreted the health states more concretely, relying on their imagination and their experience of ill health. Participants judged how the concrete health problems combined with their personal interests, circumstances, and environment would affect them personally. Ultimately, participants valued health by estimating and weighing the non-health consequences of the health states. Six consequences were most frequently mentioned: activities, enjoyment, independence, relationships, dignity, and avoiding being a burden. At each stage participants encountered difficulties and expressed concerns. The findings have implications for methods of describing health, for example, whether the focus should be on health or a broader notion of well-being and capability. This is because the consequences are similar to the domains of broader measures such as the ICECAP measures for adults and older people, and the Warwick-Edinburgh Mental Wellbeing Scale. The findings suggest the need for testing whether individuals are informed about the health states they are valuing. Participants valued health by estimating the non-health consequences of health states and these estimates relied on individuals' beliefs about the interaction of the health state and their personal and social circumstances.

The Capability Approach: A Critical Review of Its Application in Health Economics

The capability approach is an approach to assessing well-being developed by Amartya Sen. Interest in this approach has resulted in several attempts to develop questionnaires to measure and value capability at an individual level in health economics. This commentary critically reviews the ability of these questionnaires to measure and value capability. It is argued that the method used in the questionnaires to measure capability will result in a capability set that is an inaccurate description of the individual's true capability set. The measured capability set will either represent only one combination and ignore the value of choice in the capability set, or represent one combination that is not actually achievable by the individual. In addition, existing methods of valuing capability may be inadequate because they do not consider that capability is a set. It may be practically more feasible to measure and value capability approximately rather than directly. Suggestions are made on how to measure and value an approximation to capability, but further research is required to implement the suggestions.

The development of capability measures in health economics: opportunities, challenges and progress

Recent years have seen increased engagement amongst health economists with the capability approach developed by Amartya Sen and others. This paper focuses on the capability approach in relation to the evaluative space used for analysis within health economics. It considers the opportunities that the capability approach offers in extending this space, but also the methodological challenges associated with moving from the theoretical concepts to practical empirical applications. The paper then examines three 'families' of measures, Oxford Capability instruments (OxCap), Adult Social Care Outcome Toolkit (ASCOT) and ICEpop CAPability (ICECAP), in terms of the methodological choices made in each case. The paper concludes by discussing some of the broader issues involved in making use of the capability approach in health economics. It also suggests that continued exploration of the impact of different methodological choices will be important in moving forward.

‘The positive feel’: Unpacking the role of positive thinking in people with multiple sclerosis’s thinking aloud about staying physically active

People with multiple sclerosis experience barriers to physical activity. Thought processes are interwoven with garnering motivation to overcome these barriers. This study investigated in-depth the role of positive thinking in physical activity motivation of two women and two men with multiple sclerosis. Participants thought aloud while completing standardised measures of physical activity, stages of change and self-efficacy, and in response to planned and spontaneous questions. Four themes were formulated using inductive thematic analysis: thoughts about purpose, self-efficacy, the past and reinforcement through positive thinking. These findings have implications for physical activity theories and delivering appropriate physical activity interventions to the multiple sclerosis community.

'The ICECAP-SCM tells you more about what I'm going through': A think-aloud study measuring quality of life among patients receiving supportive and palliative care

BACKGROUND

The ICECAP-Supportive Care Measure is a self-complete questionnaire developed to aid economic evaluation of supportive care interventions.

AIM

To determine the feasibility of completing ICECAP-Supportive Care Measure alongside EQ-5D-5L and ICECAP-A (generic measures used in economic evaluation) among patients receiving hospice care, close persons and healthcare professionals.

DESIGN

Participants were asked to 'think aloud' while completing ICECAP-Supportive Care Measure and two other generic measures used in economic evaluation, EQ-5D-5L and ICECAP-A, and then participate in a semi-structured interview. From verbatim transcripts, five raters identified the frequency of errors in comprehension, retrieval, judgement and response. Qualitative data were analysed using constant comparison.

SETTING/PARTICIPANTS

Eligible patients were identified from one UK hospice by a research nurse. Close persons and healthcare professionals were identified by the patient. In all, 72 semi-structured interviews were conducted with patients (n = 33), close persons (n = 22) and healthcare professionals (n = 17).

RESULTS

Patients and close persons reported that the ICECAP-Supportive Care Measure was most appropriate for measuring their quality of life. It appeared more meaningful, easier to complete and had fewest errors (3.9% among patients, 4.5% among close persons) compared to EQ-5D-5L (9.7% among patients, 5.5% among close persons). Healthcare professionals acknowledged the value of the ICECAP-Supportive Care Measure but had fewer errors in completing the EQ-5D-5L (3.5% versus 6.7%). They found it easier to complete because it focuses on observable health states.

CONCLUSIONS

The ICECAP-Supportive Care Measure is feasible to use and perceived as appropriate for evaluating palliative care interventions. Healthcare professionals with limited knowledge of the patient who act as proxy completers may find the measure difficult to complete.

The Relative Impacts of Disease on Health Status and Capability Wellbeing: A Multi-Country Study

BACKGROUND

Evaluations of the impact of interventions for resource allocation purposes commonly focus on health status. There is, however, also concern about broader impacts on wellbeing and, increasingly, on a person's capability. This study aims to compare the impact on health status and capability of seven major health conditions, and highlight differences in treatment priorities when outcomes are measured by capability as opposed to health status.

METHODS

The study was a cross-sectional four country survey (n = 6650) of eight population groups: seven disease groups with: arthritis, asthma, cancer, depression, diabetes, hearing loss, and heart disease and one health population 'comparator' group. Two simple self-complete questionnaires were used to measure health status (EQ-5D-5L) and capability (ICECAP-A). Individuals were classified by illness severity using condition-specific questionnaires. Effect sizes were used to estimate: (i) the difference in health status and capability for those with conditions, relative to a healthy population; and (ii) the impact of the severity of the condition on health status and capability within each disease group.

FINDINGS

5248 individuals were included in the analysis. Individuals with depression have the greatest mean reduction in both health (effect size, 1.26) and capability (1.22) compared to the healthy population. The effect sizes for capability for depression are much greater than for all other conditions, which is not the case for health. For example, the arthritis group effect size for health (1.24) is also high and similar to that of depression, whereas for the same arthritis group, the effect size for capability is much lower than that for depression (0.55). In terms of severity within disease groups, individuals categorised as 'mild' have similar capability levels to the healthy population (effect sizes <0.2, excluding depression) but lower health status than the healthy population (≥0.4).

CONCLUSION

Significant differences exist in the relative effect sizes across diseases when measured by health status and capability. In terms of treating morbidity, a shift in focus from health gain to capability gain would increase funding priorities for patients with depression specifically and severe illnesses more generally.

Exploration of the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults

Background

In economic evaluations of care services for older adults health-related quality of life (QoL) measures such as the EQ-5D are increasingly replaced by the ICECAP-O and ASCOT, which cover a broader scope of QoL than health alone. Little is known about the content validity and feasibility of these measures. The purpose of this study was to explore the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults.

Methods

Ten older adults were purposively sampled using a maximum variation principle. Think-aloud and verbal probing techniques were used to identify response issues encountered during the interpretation of items and the selection of response options. We used constant comparative methods to analyse the data.

Results

Two types of response issues were identified for various items in all three measures: interpretation issues and positive responses. Issues with the mapping of a response on one of the response options were least often encountered for the EQ-5D-3L items. Older adults considered the items of the ICECAP-O and ASCOT valuable though more abstract than the EQ-5D-3L.

Conclusions

Researchers who intend to use the EQ-5D, ICECAP-O or ASCOT in economic evaluations of care services for older adults, should be aware of the response issues that occur during the administration of these measures. Older adults perceived none of the measures as providing a comprehensive picture of their QoL. A preference from older adults for one of the measures depends on the extent to which the items reflect current personal concerns in life.

Test-retest reliability of capability measurement in the UK general population

Although philosophically attractive, it may be difficult, in practice, to measure individuals' capabilities (what they are able to do in their lives) as opposed to their functionings (what they actually do). To examine whether capability information could be reliably self-reported, we administered a measure of self-reported capability (the Investigating Choice Experiments Capability Measure for Adults, ICECAP-A) on two occasions, 2 weeks apart, alongside a self-reported health measure (the EuroQol Five Dimensional Questionnaire with 3 levels, EQ-5D-3L). We found that respondents were able to report capabilities with a moderate level of consistency, although somewhat less reliably than their health status. The more socially orientated nature of some of the capability questions may account for the difference.