Valuing the economic benefits of complex interventions: when maximising health is not sufficient

The effect of outdoor activities on the medical expenditure of older people: multiple chain mediating effects of health benefits

BACKGROUND

With the global aging population, attention to the health and medical issues of older adults is increasing. By analyzing the relationship between older people's participation in outdoor activities and medical expenditure, this study aims to provide a scientific basis for improving their quality of life and reducing the medical burden.

METHODS

Data on outdoor activity participation, medical expenditures, and relevant variables were collected through questionnaires and databases. A multi-chain mediation effect model was established to analyze the impact of outdoor activities on the medical expenditure of older people, considering mediation effects and heterogeneity.

RESULTS

Results revealed that increased participation in outdoor activities among older adults correlated with lower medical expenditures. Outdoor activities positively influenced their health by improving mental health, cognition, eating habits, and activities of daily living, resulting in reduced medical expenditures. Robustness tests confirmed the consistent effect of outdoor activities on older people's medical expenditure.

CONCLUSION

These findings contribute to understanding the relationship between outdoor activities, health, and medical expenditure in older people, guiding policy formulation and interventions. Encouraging and supporting older adults in outdoor activities can enhance their quality of life and alleviate medical resource strain. The study's conclusions can also inform health promotion measures for other populations and serve as a basis for future research in this area.

Cost and economic evidence for asset-based approaches to health improvement and their evaluation methods: a systematic review

BACKGROUND

Asset-based approaches (ABAs) tackle health inequalities by empowering people in more disadvantaged communities, or targeted populations, to better utilise pre-existing local community-based resources. Using existing resources supports individuals to better manage their own health and its determinants, potentially at low cost. Targeting individuals disengaged with traditional service delivery methods offers further potential for meaningful cost-savings, since these people often require costly care. Thus, improving prevention, and management, of ill-health in these groups may have considerable cost implications.

AIM

To systematically review the extent of current cost and economic evidence on ABAs, and methods used to develop it.

METHODS

Search strategy terms encompassed: i) costing; ii) intervention detail; and iii) locality. Databases searched: Medline, CENTRAL and Wed of Science. Researchers screened 9,116 articles. Risk of bias was assessed using the Critical Appraisal Skills Programme (CASP) tool. Narrative synthesis summarised findings.

RESULTS

Twelve papers met inclusion criteria, representing eleven different ABAs. Within studies, methods varied widely, not only in design and comparators, but also in terms of included costs and outcome measures. Studies suggested economic efficiency, but lack of suitable comparators made more definitive conclusions difficult.

CONCLUSION

Economic evidence around ABAs is limited. ABAs may be a promising way to engage underserved or minority groups, that may have lower net costs compared to alternative health and wellbeing improvement approaches. ABAs, an example of embedded services, suffer in the context of economic evaluation, which typically consider services as mutually exclusive alternatives. Economics of the surrounding services, mechanisms of information sharing, and collaboration underpin the success of assets and ABAs. The economic evidence, and evaluations in general, would benefit from increased context and detail to help ensure more nuanced and sophisticated understanding of the economics of ABAs. Further evidence is needed to reach conclusions about cost-effectiveness of ABAs.

Arts and creativity interventions for improving health and wellbeing in older adults: a systematic literature review of economic evaluation studies

BACKGROUND

As the population ages, older people account for a larger proportion of the health and social care budget. A significant body of evidence suggests that arts and creativity interventions can improve the physical, mental and social wellbeing of older adults, however the value and/or cost-effectiveness of such interventions remains unclear.

METHODS

We systematically reviewed the economic evidence relating to such interventions, reporting our findings according to PRISMA guidelines. We searched bibliographic databases (MEDLINE, EMBASE, Econlit and Web of Science and NHSEED), trial registries and grey literature. No language or temporal restrictions were applied. Two screening rounds were conducted independently by health economists experienced in systematic literature review. Methodological quality was assessed, and key information extracted and tabulated to provide an overview of the published literature. A narrative synthesis without meta-analysis was conducted.

RESULTS

Only six studies were identified which provided evidence relating to the value or cost-effectiveness of arts and creativity interventions to improve health and wellbeing in older adults. The evidence which was identified was encouraging, with five out of the six studies reporting an acceptable probability of cost-effectiveness or positive return on investment (ranging from £1.20 to over £8 for every £1 of expenditure). However, considerable heterogeneity was observed with respect to study participants, design, and outcomes assessed. Of particular concern were potential biases inherent in social value analyses.

CONCLUSIONS

Despite many studies reporting positive health and wellbeing benefits of arts and creativity interventions in this population, we found meagre evidence on their value or cost-effectiveness. Such evidence is costly and time-consuming to generate, but essential if innovative non-pharmacological interventions are to be introduced to minimise the burden of illness in this population and ensure efficient use of public funds. The findings from this review suggests that capturing data on the value and/or cost-effectiveness of such interventions should be prioritised; furthermore, research effort should be directed to developing evaluative methods which move beyond the confines of current health technology assessment frameworks, to capture a broader picture of 'value' more applicable to arts and creativity interventions and public health interventions more generally.

PROSPERO REGISTRATION

CRD42021267944 (14/07/2021).

Defining Need Amid Exponential Change: Conceptual Challenges in Workforce Planning for Clinical Genetic Services

Rapid growth in the volume of referrals to clinical genetics services in many countries during the past 15 years makes workforce planning a critical policy tool in ensuring that the capacity of the clinical genetics workforce is large enough to meet current and future needs. This article explores the distinctive challenges of workforce planning in clinical genetics and provides recommendations for addressing these challenges using a needs-based planning approach. Specifically, at least 3 features complicate efforts to estimate the need for clinical genetic services: the difficulty in linking many clinical genetic services to concrete health outcomes; the rapidly changing nature of genetic medicine, which creates intrinsic uncertainty about the appropriate level of service; and the heightened relevance of patient preferences in this context. Our recommendations call for needs-based planning studies to include an explicit definition of necessary care, to be flexible in considering nonhealth benefits, to err on the side of including services currently funded by health systems even when evidence about outcomes is limited, and to use scenario analysis and expert input to explore the impact of uncertainty about patients' preferences and future technologies on estimates of workforce requirements.

Sensitivity and Specificity of Different Prognostic Systems in Guiding Surveillance for Metastases in Uveal Melanoma

Uveal melanoma (UM) metastasises in ~50% of patients, most frequently to the liver. Surveillance imaging can provide early detection of hepatic metastases; however, guidance regarding UM patient risk stratification for surveillance is unclear. This study compared sensitivity and specificity of four current prognostic systems, when used for risk stratification for surveillance, on patients treated at the Liverpool Ocular Oncology Centre (LOOC) between 2007-2016 (n = 1047). It found that the Liverpool Uveal Melanoma Prognosticator Online III (LUMPOIII) or Liverpool Parsimonious Model (LPM) offered greater specificity at equal levels of sensitivity than the American Joint Committee on Cancer (AJCC) system or monosomy 3 alone, and suggests guidance to achieve 95% sensitivity and 51% specificity (i.e., how to detect the same number of patients with metastases, while reducing the number of negative scans). For example, 180 scans could be safely avoided over 5 years in 200 patients using the most specific approach. LUMPOIII also offered high sensitivity and improved specificity over the AJCC in the absence of genetic information, making the result relevant to centres that do not perform genetic testing, or where such testing is inappropriate or fails. This study provides valuable information for clinical guidelines for risk stratification for surveillance in UM.

Health economic evaluation of digital nursing technologies: a review of methodological recommendations

BACKGROUND

Health economic evaluation of digital nursing technologies (DNT) is important to provide information that helps avoid undesirable developments and implementations as well as increase the chances of success of developed applications. At the same time, studies and evidence on cost-effectiveness are still very rare in this field. Review studies in related technology areas such as telemedicine frequently criticise the quality and comparability of health economic evaluations conducted in this field. Based on a content analysis of methodological literature on the economic evaluation of innovative (digital) technologies in health and nursing, this article aims to identify specific challenges in this research area and offers recommendations on how to address these challenges to promote more sound health economic evaluations in the future.

METHODS

A rapid review was conducted, consisting of a systematic search in the Pubmed database as well as Google Scholar. In addition, the literature lists of the analysed texts were scoured for additional texts to be included. Methodological literature, single studies, and reviews were included. A total of 536 studies were screened, of which 29 were included in the full text analysis.

RESULTS

Based on the systematic content analysis of the studies under consideration, 10 specific methodological challenges are identified, and the methodological recommendations were examined for consideration. A particular focus was given to whether specific methodological approaches might be needed in the context of evaluating the efficiency of DNT.

CONCLUSION

Many of the challenges identified for the health economic evaluations of digital nursing technologies are comparable to those of other complex health care interventions. The recommendations discussed can help to alleviate those challenges. Future research should focus on alternative approaches to assessing causality in different phases of technology development while maintaining high evidence standards. High-evidence economic assessment of technologies in nursing care should be carried out in routine use, especially if they are intended to be reimbursed by the social insurance.

Economic evaluation of genomic/genetic tests: a review and future directions

It has been suggested that health economists need to improve their methods in order to meet the challenges of evaluating genomic/genetic tests. In this article, we set out twelve challenges identified from a rapid review of the literature and suggest solutions to the challenges identified. Two challenges were common to all economic evaluations: choice of perspective and time-horizon. Five challenges were relevant for all diagnostic technologies: complexity of analysis; range of costs; under-developed evidence base; behavioral aspects; and choice of outcome metrics. The final five challenges were pertinent for genomic tests and only these may require methodological development: heterogeneity of tests and platforms, increasing stratification, capturing personal utility; incidental findings; and spillover effects. Current methods of economic evaluation are generally able to cope with genomic/genetic tests, although a renewed focus on specific decision-makers’ needs and a willingness to move away from cost-utility analysis may be required. Certain analysts may be constrained by reference cases developed primarily for the assessment of pharmaceuticals. The combined impact of multiple challenges may require analysts to be particularly careful in setting the scope of their analysis in order to ensure that feasibility is balanced with usefulness to the decision maker. A key issue is the under-developed evidence-base and it may be necessary to rethink translation processes to ensure sufficient, relevant evidence is available to support economic evaluation and adoption of genomic/genetic tests.

Conceptualising 'Benefits Beyond Health' in the Context of the Quality-Adjusted Life-Year: A Critical Interpretive Synthesis

There is growing interest in extending the evaluative space of the quality-adjusted life-year framework beyond health. Using a critical interpretive synthesis approach, the objective was to review peer-reviewed literature that has discussed non-health outcomes within the context of quality-adjusted life-years and synthesise information into a thematic framework. Papers were identified through searches conducted in Web of Science, using forward citation searching. A critical interpretive synthesis allows for the development of interpretations (synthetic constructs) that go beyond those offered in the original sources. The final output of a critical interpretive synthesis is the synthesising argument, which integrates evidence from across studies into a coherent thematic framework. A concept map was developed to show the relationships between different types of non-health benefits. The critical interpretive synthesis was based on 99 papers. The thematic framework was constructed around four themes: (1) benefits affecting well-being (subjective well-being, psychological well-being, capability and empowerment); (2) benefits derived from the process of healthcare delivery; (3) benefits beyond the recipient of care (spillover effects, externalities, option value and distributional benefits); and (4) benefits beyond the healthcare sector. There is a wealth of research concerning non-health benefits and the evaluative space of the quality-adjusted life-year. Further dialogue and debate are necessary to address conceptual and normative challenges, to explore the societal willingness to sacrifice health for benefits beyond health and to consider the equity implications of different courses of action.

Methodological issues in economic evaluations of disease prevention and health promotion: an overview of systematic and scoping reviews

Background

We aimed to provide a comprehensive overview of methodological challenges in economic evaluations of disease prevention and health promotion (DPHP)-measures.

Methods

We conducted an overview of reviews searching MEDLINE, EMBASE, NHS Economic Evaluation Database, Database of Promoting Health Effectiveness Reviews, Cochrane Database of Systematic Reviews (CDSR) and Database of Promoting Health Effectiveness Reviews (DOPHER) (from their inception to October 2021). We included both systematic and scoping reviews of economic evaluations in DPHP addressing following methodological aspects: (i) attribution of effects, (ii) outcomes, (iii) inter-sectoral (accruing to non-health sectors of society) costs and consequences and (iv) equity. Data were extracted according to the associated sub-criteria of the four methodological aspects including study design economic evaluation (e.g. model-based), type/scope of the outcomes (e.g. outcomes beyond health), perspective, cost categories related to non-health sectors of society, and consideration of equity (method of inclusion). Two reviewers independently screened all citations, full-text articles, and extracted data. A narrative synthesis without a meta-analysis or other statistical synthesis methods was conducted.

Results

The reviewing process resulted in ten systematic and one scoping review summarizing 494 health economic evaluations. A lifelong time horizon was adopted in about 23% of DPHP evaluations, while 64% of trial-based evaluations had a time horizon up to 2 years. Preference-based outcomes (36%) and non-health outcomes (8%) were only applied in a minority of studies. Although the inclusion of inter-sectoral costs (i.e. costs accruing to non-health sectors of society) has increased in recent years, these were often neglected (between 6 and 23% depending on the cost category). Consideration to equity was barely given in economic evaluations, and only addressed in six of the eleven reviews.

Conclusions

Economic evaluations of DPHP measures give only little attention to the specific methodological challenges related to this area. For future economic DPHP evaluations a tool with structured guidance should be developed.

This overview of reviews was not registered and a published protocol does not exist.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-12174-w.

An Introduction to the Main Types of Economic Evaluations Used for Informing Priority Setting and Resource Allocation in Healthcare: Key Features, Uses, and Limitations

Economic evidence is increasingly being used for informing health policies. However, the underlining principles of health economic analyses are not always fully understood by non-health economists, and inappropriate types of analyses, as well as inconsistent methodologies, may be being used for informing health policy decisions. In addition, there is a lack of open access information and methodological guidance targeted to public health professionals, particularly those based in low- and middle-income country (LMIC) settings. The objective of this review is to provide a comprehensive and accessible introduction to economic evaluations for public health professionals with a focus on LMIC settings. We cover the main principles underlining the most common types of full economic evaluations used in healthcare decision making in the context of priority setting (namely cost-effectiveness/cost-utility analyses, cost-benefit analyses), and outline their key features, strengths and weaknesses. It is envisioned that this will help those conducting such analyses, as well as stakeholders that need to interpret their output, gain a greater understanding of these methods and help them select/distinguish between the different approaches. In particular, we highlight the need for greater awareness of the methods used to place a monetary value on the health benefits of interventions, and the potential for such estimates to be misinterpreted. Specifically, the economic benefits reported are typically an approximation, summarising the health benefits experienced by a population monetarily in terms of individual preferences or potential productivity gains, rather than actual realisable or fiscal monetary benefits to payers or society.

Economic evaluation of nutrition interventions: Does one size fit all?

BACKGROUND

Nutrition interventions have specific features that might warrant modifications to the methods used for economic evaluations of healthcare interventions.

AIM

The aim of the article is to identify these features and when they challenge the use of cost-utility analysis (CUA).

METHODS

A critical review of the literature is conducted and a 2 by 2 classification matrix for nutrition interventions is proposed based on 1) who the main party responsible for the implementation and funding of the intervention is; and 2) who the target recipient of the intervention is. The challenges of conducting economic evaluations for each group of nutrition interventions are then analysed according to four main aspects: attribution of effects, measuring and valuing outcomes, inter-sectorial costs and consequences and equity considerations.

RESULTS AND CONCLUSIONS

CUA is appropriate for nutrition interventions when they are funded from the healthcare sector, have no (or modest) spill-overs to other sectors of the economy and have only (or mainly) health consequences. For other interventions, typically involving different government agencies, with cost implications for the private sector, with important wellbeing consequences outside health and with heterogeneous welfare effects across socio-economic groups, other economic evaluation methods need to be developed in order to offer valid guidance to policy making. For these interventions, checklists for critical appraisal of economic evaluations may require some substantial changes.

"Willingness to Pay": The Value Attributed to Program Location by Pulmonary Rehabilitation Participants

The "contingent valuation" method is used to quantify the value of services not available in traditional markets, by assessing the monetary value an individual ascribes to the benefit provided by an intervention. The aim of this study was to determine preferences for home or center-based pulmonary rehabilitation for participants with chronic obstructive pulmonary disease (COPD) using the "willingness to pay" (WTP) approach, the most widely used technique to elicit strengths of individual preferences. This is a secondary analysis of a randomized controlled equivalence trial comparing center-based and home-based pulmonary rehabilitation. At their final session, participants were asked to nominate the maximum that they would be willing to pay to undertake home-based pulmonary rehabilitation in preference to a center-based program. Regression analyses were used to investigate relationships between participant features and WTP values. Data were available for 141/163 eligible study participants (mean age 69 [SD 10] years, n = 82 female). In order to undertake home-based pulmonary rehabilitation in preference to a conventional center-based program, participants were willing to pay was mean $AUD176 (SD 255) (median $83 [IQR 0 to 244]). No significant difference for WTP values was observed between groups (p = 0.98). A WTP value above zero was related to home ownership (odds ratio [OR] 2.95, p = 0.02) and worse baseline SF-36 physical component score (OR 0.94, p = 0.02). This preliminary evidence for WTP in the context of pulmonary rehabilitation indicated the need for further exploration of preferences for treatment location in people with COPD to inform new models of service delivery.

Estimating the monetary value of health and capability well-being applying the well-being valuation approach

BACKGROUND

Quality of life measures going beyond health, like the ICECAP-A, are gaining importance in health technology assessment. The assessment of the monetary value of gains in this broader quality of life is needed to use these measurements in a cost-effectiveness framework.

METHODS

We applied the well-being valuation approach to calculate a first monetary value for capability well-being in comparison to health, derived by ICECAP-A and EQ-5D-5L, respectively. Data from an online survey administered in February 2018 to a representative sample of UK citizens aged 18-65 was used (N = 1512). To overcome the endogeneity of income, we applied an instrumental variable regression. Several alternative model specifications were calculated to test the robustness of the results.

RESULTS

The base case empirical estimate for the implied monetary value of a year in full capability well-being was £66,597. The estimate of the monetary value of a QALY, obtained from the same sample and using the same methodology amounted to £30,786, which compares well to previous estimates from the willingness to pay literature. Throughout the conducted robustness checks, the value of capability well-being was found to be between 1.7 and 2.6 times larger than the value of health.

CONCLUSION

While the applied approach is not without limitations, the generated insights, especially concerning the relative magnitude of valuations, may be useful for decision-makers having to decide based on economic evaluations using the ICECAP-A measure or, to a lesser extent, other (capability) well-being outcome measures.

Strength of public preferences for endovascular or open aortic aneurysm repair

Background

This study evaluated public preferences for the treatment processes for abdominal aortic aneurysm repair in order to allow them to be incorporated into a cost-effectiveness analysis.

Methods

This was a telephone survey using a trade-off method in UK resident adults (aged at least 18 years) with no previous diagnosis of a vascular condition.

Results

Some 167 of 209 participants (79·9 per cent) stated that they would prefer endovascular aneurysm repair (EVAR), 40 (19·1 per cent) preferred open surgery and two (1·0 per cent) stated no preference. Participants preferred EVAR because of the less invasive nature of the intervention and quicker recovery. Participants preferring open surgery cited reasons such as having a single follow-up appointment, and a procedure that felt more permanent. When participants were asked to make a sacrifice in order to have their preferred treatment, 122 (58·4 per cent) favoured EVAR, 18 (8·6 per cent) favoured open surgery and 69 (33·0 per cent) had no preference. Those preferring EVAR were willing to give up a mean of 0·135 expected quality-adjusted life-years (QALYs) to have EVAR, compared with a willingness to give up 0·033 expected QALYs among those preferring open repair.

Conclusion

These results indicate a clear preference for EVAR over open surgery for aortic aneurysm.

Methods for public health economic evaluation: A Delphi survey of decision makers in English and Welsh local government

Standard reference case methods recommended for health technology appraisals do not translate well to a public health setting. This paper reports on a Delphi survey designed to elicit views of public health decision makers in England and Wales, about different methodological elements of economic evaluation. This is important as methods should align with the objective function of decision makers. The Delphi survey comprised two rounds, with round 1 allowing open-ended recommendations in addition to 5-point Likert scale responses. The final survey comprised 36 questions, and levels and strength of agreement were assessed using median values and mean absolute deviation of the median. The Delphi panel (n = 66) achieved high levels of agreement for costs, health, well-being, and productivity impact to be important elements within an economic evaluation. The panel agreed that evaluations should be relevant to the local context and include costs and consequences over a lifetime horizon. There was a call for the transparent reporting of costs and effects for different population subgroups, and for different sectors. Overall, the panel revealed a preference for a flexible approach, understanding that economic evidence fits within a dynamic process of decision making. These results provide empirical evidence to inform guidelines for public health economic evaluation.

PRIMEtime CE: a multistate life table model for estimating the cost-effectiveness of interventions affecting diet and physical activity

BACKGROUND

Non-communicable diseases are the leading cause of death in England, and poor diet and physical inactivity are two of the principle behavioural risk factors. In the context of increasingly constrained financial resources, decision makers in England need to be able to compare the potential costs and health outcomes of different public health policies aimed at improving these risk factors in order to know where to invest so that they can maximise population health. This paper describes PRIMEtime CE, a multistate life table cost-effectiveness model that can directly compare interventions affecting multiple disease outcomes.

METHODS

The multistate life table model, PRIMEtime Cost Effectiveness (PRIMEtime CE), is developed from the Preventable Risk Integrated ModEl (PRIME) and the PRIMEtime model. PRIMEtime CE uses routinely available data to estimate how changing diet and physical activity in England affects morbidity and mortality from heart disease, stroke, diabetes, liver disease, and cancers either directly or via raised blood pressure, cholesterol, and body weight.

RESULTS

Model outcomes are change in quality adjusted life years, and change in English National Health Service and social care costs.

CONCLUSION

This paper describes PRIMEtime CE and highlights its main strengths and limitations. The model can be used to compare any number of public policies affecting diet and physical activity, allowing decision makers to understand how they can maximise population health with limited financial resources.

Measuring the Benefits of Decision Aids for Economic Evaluation

Decision aids, sometimes known as decision-support tools, are increasingly used to help patients to understand treatment options and to reach an informed decision consistent with their own values, yet methods for their economic evaluation have received limited attention. This is at odds with the increasingly rigorous methods being applied to assess the cost effectiveness of other health technologies. This paper reviews current approaches to evaluating decision aids and proposes a new method for assessing their benefits relative to other interventions in a resource-constrained health system that seeks to improve health, equity and patient satisfaction. Current evaluation frameworks are found to be unsuitable for the economic evaluation of decision aids since their objectives are broader than health maximisation. Decision aids may generate significant non-health benefits such as improved patient knowledge and satisfaction, which cannot be assessed using cost-utility analysis. A stated-preference consultation time trade-off (CTTO) is proposed in which a proportion of hypothetical physician consultation is traded for use of the decision aid. A decision aid provides information for a patient to make an informed choice and therefore may be considered to be a substitute for physician time. The CTTO can be reported in consultation minutes or converted to monetary units using the cost of physician time. These values may be used, alongside the implementation cost, for economic evaluation.

Assessing the Joint Value of Genomic-Based Diagnostic Tests and Gene Therapies

Gene therapy is an emerging type of treatment that may aim to provide a cure to individuals with a genetic mutation known to be causative of a specific disease. A diagnosis of the causative mutation must precede treatment with a in vivo gene therapy. Both achieving a genomic-based diagnosis and treatment with a gene therapy may result in substantial expenditures for health care systems. Uncertainties around the health care costs, risks, and benefits derived from diagnosis and treatment with a subsequent gene therapy suggests a need for developing an evidence base, underpinned by opportunity cost, to inform if, and how, these health technologies should be introduced into health care systems funded by finite budgets. This article discusses why current methods to evaluate health technologies (decision-analytic model-based cost-effectiveness analysis from the perspective of a health care system over a lifetime time horizon) are appropriate to quantify the costs and consequences of using genomic-based diagnostic tests and gene therapies in combination, rather than as separate interventions, within clinical practice. Evaluating the economic impact of test-and-treatment strategies will ensure that the opportunity cost of these health technologies is quantified fully for decision-makers who are responsible for allocating limited resources in health care systems.

Health economics methods for public health resource allocation: a qualitative interview study of decision makers from an English local authority

Local authorities in England have responsibility for public health, however, in recent years, budgets have been drastically reduced placing decision makers under unprecedented financial pressure. Although health economics can offer support for decision making, there is limited evidence of it being used in practice. The aim of this study was to undertake in-depth qualitative research within one local authority to better understand the context for public health decision making; what, and how economics evidence is being used; and invite suggestions for how methods could be improved to better support local public health decision making. The study included both observational methods and in-depth interviews. Key meetings were observed and semi-structured interviews conducted with participants who had a decision-making role to explore views on economics, to understand the barriers to using evidence and to invite suggestions for improvements to methods. Despite all informants valuing the use of health economics, many barriers were cited: including a perception of a narrow focus on the health sector; lack of consideration of population impact; and problems with translating long timescales to short term impact. Methodological suggestions included the broadening of frameworks; increased use of natural experiments; and capturing wider non-health outcomes that resonate with the priorities of multiple stakeholders.

Early cost-effectiveness modeling for better decisions in public research investment of personalized medicine technologies

Millions of dollars are spent on the development of new personalized medicine technologies. While these research costs are often supported by public research funds, many diagnostic tests and biomarkers are not adopted by the healthcare system due to lack of evidence on their cost-effectiveness. We describe a stepwise approach to conducting cost-effectiveness analyses that are performed early in the technology's development process and can help mitigate the potential risks of investment. Decision analytic modeling can identify the key drivers of cost effectiveness and provide minimum criteria that the technology needs to meet for adoption by public and private healthcare systems. A value of information analysis can quantify the added value of conducting more research to provide further evidence for policy decisions. These steps will allow public research funders to make better decisions on their investments to maximize the health benefits and to minimize the number of suboptimal technologies.

Social return on investment for community-based alcohol consumption control program during Buddhist Lent

Purpose

The purpose of this paper is to evaluate the cost and benefit of a community-based alcohol consumption control program during the Buddhist Lent (BL) period in terms of social return on investment (SROI).

Design/methodology/approach

The research team evaluated the program in four selected villages from four regions using standard SROI. Relevant stakeholders were involved in the evaluation design and program impact map construction. Data, including costs, were collected from literatures, official documents, stakeholder interviews and focus group discussions. Alcohol abstinence and related data during and after the 2015 BL period were gathered from a survey questionnaire. The SROI ratio presented the social benefits compared against the total social investment.

Findings

The program was effective in producing a greater social value (2.7–5.9 times) than the cost of investment in every village. Cost savings from alcohol consumption constituted a major proportion of the program’s value.

Originality/value

The community-based alcohol consumption control program during BL can provide value for investment. Information from this study can be used by policy makers in their decision to continue or scale up the program. The SROI approach mainly relies on stakeholders that may present a bias; however, further study such as social cost-benefit analysis could provide additional insights.

Methodological Challenges in the Economic Evaluation of Occupational Health and Safety Programmes

An emerging issue in occupational health and safety (OHS) is that interventions increasingly have to demonstrate that they offer sufficient value for money. To this end, the last decennia have seen more and more economic evaluation methods being employed in this field. However, several recent publications have indicated that many of the published studies suffer from important shortcomings. This paper aims to highlight difficulties in assessing the value of OHS by use of current economic evaluation methods. First, a summary framework presents an overview of the costs and benefits relevant for OHS interventions. Next, three elements from this framework are selected that are at the same time crucial to OHS value, but also challenging to measure and monetise: Effects on worker productivity, 'intangible' benefits, such as reputation effects, and the influence of the broader legal⁻fiscal context in which an intervention takes place. The following sections then discuss the following research questions for each of these elements: Why is it difficult to exclude these factors from OHS economic evaluations? Why do they pose a challenge to the quality of economic evaluations in OHS? How can they be included, and what are the known advantages and disadvantages of the methods to measure these factors? Future work should investigate (and standardise) better methods to include these elements.

Methodological Issues in Assessing the Economic Value of Next-Generation Sequencing Tests: Many Challenges and Not Enough Solutions

BACKGROUND

Clinical use of next-generation sequencing (NGS) tests has been increasing, but few studies have examined their economic value. Several studies have noted that there are methodological challenges to conducting economic evaluations of NGS tests.

OBJECTIVE

Our objective was to examine key methodological challenges for conducting economic evaluations of NGS tests, prioritize these challenges for future research, and identify how studies have attempted solutions to address these challenges.

METHODS

We identified challenges for economic evaluations of NGS tests using prior literature and expert judgment of the co-authors. We used a modified Delphi assessment to prioritize challenges, based on importance and probability of resolution. Using a structured literature review and article extraction we then assessed whether published economic evaluations had addressed these challenges.

RESULTS

We identified 11 challenges for conducting economic evaluations of NGS tests. The experts identified three challenges as the top priorities for future research: complex model structure, timeframe, and type of analysis and comparators used. Of the 15 published studies included in our literature review, four studies described specific solutions relevant to five of the 11 identified challenges.

CONCLUSIONS

Major methodological challenges to economic evaluations of NGS tests remain to be addressed. Our results can be used to guide future research and inform decision-makers on how to prioritize research on the economic assessment of NGS tests.

Cost-effectiveness of Genome and Exome Sequencing in Children Diagnosed with Autism Spectrum Disorder

BACKGROUND

Genome (GS) and exome sequencing (ES) could potentially identify pathogenic variants with greater sensitivity than chromosomal microarray (CMA) in autism spectrum disorder (ASD) but are costlier and result interpretation can be uncertain. Study objective was to compare the costs and outcomes of four genetic testing strategies in children with ASD.

METHODS

A microsimulation model estimated the outcomes and costs (in societal and public payer perspectives in Ontario, Canada) of four genetic testing strategies: CMA for all, CMA for all followed by ES for those with negative CMA and syndromic features (CMA+ES), ES or GS for all.

RESULTS

Compared to CMA, the incremental cost-effectiveness ratio (ICER) per additional child identified with rare pathogenic variants within 18 months of ASD diagnosis was $CAN5997.8 for CMA+ES, $CAN13,504.2 for ES and $CAN10,784.5 for GS in the societal perspective. ICERs were sensitive to changes in ES or GS diagnostic yields, wait times for test results or pre-test genetic counselling, but were robust to changes in the ES or GS costs.

CONCLUSION

Strategic integration of ES into ASD care could be a cost-effective strategy. Long wait times for genetic services and uncertain utility, both clinical and personal, of sequencing results could limit broader clinical implementation.

Amisulpride augmentation in clozapine-unresponsive schizophrenia (AMICUS): a double-blind, placebo-controlled, randomised trial of clinical effectiveness and cost-effectiveness

BACKGROUND

When treatment-refractory schizophrenia shows an insufficient response to a trial of clozapine, clinicians commonly add a second antipsychotic, despite the lack of robust evidence to justify this practice.

OBJECTIVES

The main objectives of the study were to establish the clinical effectiveness and cost-effectiveness of augmentation of clozapine medication with a second antipsychotic, amisulpride, for the management of treatment-resistant schizophrenia.

DESIGN

The study was a multicentre, double-blind, individually randomised, placebo-controlled trial with follow-up at 12 weeks.

SETTINGS

The study was set in NHS multidisciplinary teams in adult psychiatry.

PARTICIPANTS

Eligible participants were people aged 18-65 years with treatment-resistant schizophrenia unresponsive, at a criterion level of persistent symptom severity and impaired social function, to an adequate trial of clozapine monotherapy.

INTERVENTIONS

Interventions comprised clozapine augmentation over 12 weeks with amisulpride or placebo. Participants received 400 mg of amisulpride or two matching placebo capsules for the first 4 weeks, after which there was a clinical option to titrate the dosage of amisulpride up to 800 mg or four matching placebo capsules for the remaining 8 weeks.

MAIN OUTCOME MEASURES

The primary outcome measure was the proportion of 'responders', using a criterion response threshold of a 20% reduction in total score on the Positive and Negative Syndrome Scale.

RESULTS

A total of 68 participants were randomised. Compared with the participants assigned to placebo, those receiving amisulpride had a greater chance of being a responder by the 12-week follow-up (odds ratio 1.17, 95% confidence interval 0.40 to 3.42) and a greater improvement in negative symptoms, although neither finding had been present at 6-week follow-up and neither was statistically significant. Amisulpride was associated with a greater side effect burden, including cardiac side effects. Economic analyses indicated that amisulpride augmentation has the potential to be cost-effective in the short term [net saving of between £329 and £2011; no difference in quality-adjusted life-years (QALYs)] and possibly in the longer term.

LIMITATIONS

The trial under-recruited and, therefore, the power of statistical analysis to detect significant differences between the active and placebo groups was limited. The economic analyses indicated high uncertainty because of the short duration and relatively small number of participants.

CONCLUSIONS

The risk-benefit of amisulpride augmentation of clozapine for schizophrenia that has shown an insufficient response to a trial of clozapine monotherapy is worthy of further investigation in larger studies. The size and extent of the side effect burden identified for the amisulpride-clozapine combination may partly reflect the comprehensive assessment of side effects in this study. The design of future trials of such a treatment strategy should take into account that a clinical response may be not be evident within the 4- to 6-week follow-up period usually considered adequate in studies of antipsychotic treatment of acute psychotic episodes. Economic evaluation indicated the need for larger, longer-term studies to address uncertainty about the extent of savings because of amisulpride and impact on QALYs. The extent and nature of the side effect burden identified for the amisulpride-clozapine combination has implications for the nature and frequency of safety and tolerability monitoring of clozapine augmentation with a second antipsychotic in both clinical and research settings.

TRIAL REGISTRATION

EudraCT number 2010-018963-40 and Current Controlled Trials ISRCTN68824876.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 49. See the NIHR Journals Library website for further project information.

Decision Making for Healthcare Resource Allocation: Joint v. Separate Decisions on Interacting Interventions

Standard guidance for allocating healthcare resources based on cost-effectiveness recommends using different decision rules for independent and mutually exclusive alternatives, although there is some confusion around the definition of “mutually exclusive.” This paper reviews the definitions used in the literature and shows that interactions (i.e., non-additive effects, whereby the effect of giving 2 interventions simultaneously does not equal the sum of their individual effects) are the defining feature of mutually exclusive alternatives: treatments cannot be considered independent if the costs and/or benefits of one treatment are affected by the other treatment. The paper then identifies and categorizes the situations in which interventions are likely to have non-additive effects, including interventions targeting the same goal or clinical event, or life-saving interventions given to overlapping populations. We demonstrate that making separate decisions on interventions that have non-additive effects can prevent us from maximizing health gained from the healthcare budget. In contrast, treating combinations of independent options as though they were “mutually exclusive” makes the analysis more complicated but does not affect the conclusions. Although interactions are considered by the World Health Organization, other decision makers, such as the National Institute for Health and Care Excellence (NICE), currently make independent decisions on treatments likely to have non-additive effects. We propose a framework by which interactions could be considered when selecting, prioritizing, and appraising healthcare technologies to ensure efficient, evidence-based decision making.

Cost-effectiveness analyses of genetic and genomic diagnostic tests

Developments in next-generation sequencing technologies have driven the clinical application of diagnostic tests that interrogate the whole genome, which offer the chance to diagnose rare inherited diseases or inform the targeting of therapies. New genomic diagnostic tests compete with traditional approaches to diagnosis, including the genetic testing of single genes and other clinical strategies, for finite health-care budgets. In this context, decision analytic model-based cost-effectiveness analysis is a useful method to help evaluate the costs versus consequences of introducing new health-care interventions. This Perspective presents key methodological, technical, practical and organizational challenges that must be considered by decision-makers responsible for the allocation of health-care resources to obtain robust and timely information about the relative cost-effectiveness of the increasing numbers of emerging genomic tests.

The economic case for precision medicine

Introduction: The advancement of precision medicine into routine clinical practice has been highlighted as an agenda for national and international health care policy. A principle barrier to this advancement is in meeting requirements of the payer or reimbursement agency for health care. This special report aims to explain the economic case for precision medicine, by accounting for the explicit objectives defined by decision-makers responsible for the allocation of limited health care resources. Areas covered: The framework of cost-effectiveness analysis, a method of economic evaluation, is used to describe how precision medicine can, in theory, exploit identifiable patient-level heterogeneity to improve population health outcomes and the relative cost-effectiveness of health care. Four case studies are used to illustrate potential challenges when demonstrating the economic case for a precision medicine in practice. Expert commentary: The economic case for a precision medicine should be considered at an early stage during its research and development phase. Clinical and economic evidence can be generated iteratively and should be in alignment with the objectives and requirements of decision-makers. Programmes of further research, to demonstrate the economic case of a precision medicine, can be prioritized by the extent that they reduce the uncertainty expressed by decision-makers.

Economic evaluations of alcohol prevention interventions: Is the evidence sufficient? A review of methodological challenges

•

There are few economic evaluations of alcohol prevention interventions.

•

Consideration of impacts beyond an individual’s health in evaluations is limited.

•

No published studies using other priority-setting methods in the alcohol area.

•

Consideration of wider societal perspectives and health inequalities is minimal.

•

Including inter-sectoral costs and consequences in evaluations is challenging.

Public health interventions have unique characteristics compared to health technologies, which present additional challenges for economic evaluation (EE). High quality EEs that are able to address the particular methodological challenges are important for public health decision-makers. In England, they are even more pertinent given the transition of public health responsibilities in 2013 from the National Health Service to local government authorities where new agents are shaping policy decisions.

Addressing alcohol misuse is a globally prioritised public health issue. This article provides a systematic review of EE and priority-setting studies for interventions to prevent and reduce alcohol misuse published internationally over the past decade (2006–2016). This review appraises the EE and priority-setting evidence to establish whether it is sufficient to meet the informational needs of public health decision-makers.

619 studies were identified via database searches. 7 additional studies were identified via hand searching journals, grey literature and reference lists. 27 met inclusion criteria. Methods identified included cost-utility analysis (18), cost-effectiveness analysis (6), cost-benefit analysis (CBA) (1), cost-consequence analysis (CCA) (1) and return-on-investment (1). The review identified a lack of consideration of methodological challenges associated with evaluating public health interventions and limited use of methods such as CBA and CCA which have been recommended as potentially useful for EE in public health. No studies using other specific priority-setting tools were identified.

Quantifying the Relationship between Capability and Health in Older People: Can't Map, Won't Map

BACKGROUND

Intuitively, health and capability are distinct but linked concepts. This study aimed to quantify the link between a measure of health status (EQ-5D-3L) and capability (ICECAP-O) using regression-based methods.

METHODS

EQ-5D-3L and ICECAP-O data were collected from a sample of older people ( n = 584), aged over 65 years, requiring a hospital visit and/or care home resident, and recruited to one of 3 studies forming the Medical Crisis in Older People (MCOP) program in England. The link of EQ-5D-3L with 1) ICECAP-O tariff scores were estimated using ordinary least squares (OLS) or censored least absolute deviation (CLAD) regression models; and 2) ICECAP-O domain scores was estimated using multinomial logistic (MNL) regression. Mean absolute error (MAE), root mean squared error (RMSE), absolute difference (AD) between mean observed and estimated values, and the R² statistic were used to judge model performance.

RESULTS

In this sample of older people ( n = 584), higher scores on the EQ-5D-3L were shown to be linked with higher ICECAP-O scores when using linear regression. An OLS-regression model was identified to be the best performing model with the lowest error statistics (AD = 0.0000; MAE = 0.1208; MSE = 0.1626) and highest goodness of fit ( R² = 0.3532); model performance was poor when predicting the lower ICECAP-O tariff scores. The three domains of the EQ-5D-3L showing a statistically significant quantifiable link with the ICECAP-O tariff score were self-care, usual activities, and anxiety/depression.

CONCLUSION

A quantifiable, but weak, link between health (EQ-5D-3L) and capability (ICECAP-O) was identified. The findings from this study add further support that the ICECAP-O is providing complimentary information to the EQ-5D-3L. Mapping between the 2 measures is not advisable and the measures should not be used as direct substitutes to capture the impact of interventions in economic evaluations.

Using Cost-Effectiveness Analysis to Quantify the Value of Genomic-Based Diagnostic Tests: Recommendations for Practice and Research

AIMS

New sequencing technologies allow increased opportunities to use genomic-based diagnostic tests (genomic tests) in routine clinical practice, which will impact healthcare budgets and patients' outcomes. This article aims to generate a list of recommendations on how the principles and methods of cost-effectiveness analysis (CEA) can be used to quantify the costs and benefits of genomic tests.

METHODS

A systematic literature search identified publications describing the use of CEA to evaluate genomic tests. Data were extracted as key concepts to produce a thematic list of previously described challenges and solutions to using CEA to evaluate genomic tests. Defining features of evaluating genomic tests were categorized into a list of key recommendations for applying methods in practice and for research needs.

RESULTS

Features producing challenges in the implementation of CEA to evaluate genomic tests were as follows: the ability of the tests to diagnose multiple disorders; potential consequences for future generations suggesting an infinite time horizon; and the potential need to consider nonhealth benefits.

CONCLUSIONS

CEA was identified as an appropriate evaluative framework for genomic tests, although standard methods may need modification and important method research questions remain. Key recommendations suggest a need for research to reflect: sharing genomic information across generations; genomic tests for multiple disorders; and health and nonhealth benefits.

Are Quality-Adjusted Life Years a Good Proxy Measure of Individual Capabilities?

BACKGROUND

There is a debate in the health economics literature concerning the most appropriate way of applying Amartya Sen's capability approach in economic evaluation studies. Some suggest that quality-adjusted life years (QALYs) alone are adequate while others argue that this approach is too narrow and that direct measures of capability wellbeing provide a more extensive application of Sen's paradigm.

OBJECTIVE

This paper empirically explores whether QALYs provide a good proxy for individual capabilities.

METHODS

Data is taken from a multinational cross-sectional survey of individuals with seven health conditions (asthma, arthritis, cancer, depression, diabetes, hearing loss, heart disease) and a healthy population. Each individual completed the ICECAP-A measure of capability wellbeing for adults and six health utility instruments that are used to generate QALYs, including EQ-5D and SF-6D. Primary analysis examines how well health utility instruments can explain variation in the ICECAP-A using ordinary least squares regression.

RESULTS

The findings show that all seven health conditions have a negative association on overall capability as measured by the ICECAP-A index. Inclusion of health utility instruments into separate regressions improves the predictive power of capability but on average, explains less than half of the variation in capability wellbeing. Individuals with arthritis appear to be less inhibited in terms of capability losses when accounting for health utility, yet those who have depression record significant reductions in capability relative to the healthy population even after accounting for the most commonly used health utility instruments.

CONCLUSION

The study therefore casts doubt on the ability of QALYs to act as a reliable proxy measure of individuals' capability.

Toward health technology assessment of whole-genome sequencing diagnostic tests: challenges and solutions

Whole-genome sequencing (WGS) is being applied within research settings across Europe to develop genomic WGS-based diagnostic tests. The focus of this perspective paper is to describe if, and how, current approaches of health technology assessment could be applied to WGS-based diagnostic tests. This perspective draws on the collective view from a trans-European multidisciplinary consortium of methodologists, clinicians and scientists. Specific challenges can be described by using the PICO (population, intervention, comparator, outcome) framework to inform health technology assessment. Practical solutions are suggested which require joined-up, multidisciplinary working across healthcare systems using existing expert networks so that emergent issues for the health technology assessment of WGS can be met in a timely fashion.

Winship I, M. Forrest S, P. Hansen D, Clark J, M. Waring P, South M, H. Sinclair A. Preparing for genomic medicine: a real world demonstration of health system change

Organisations and governments seeking to implement genomics into clinical practice face numerous challenges across multiple, diverse aspects of the health care system. It is not sufficient to tackle any one aspect in isolation: to create a system that supports genomic medicine, they must be addressed simultaneously. The growing body of global knowledge can guide decision-making, but each jurisdiction or organisation needs a model for genomic (or personalised) medicine that is tailored to its unique context, its priorities and the funds available. Poor decisions could greatly reduce the benefits that could potentially arise from genomic medicine. Demonstration projects enable models to be tested, providing valuable evidence and experience for subsequent implementation. Here, we present the Melbourne Genomics Health Alliance demonstration project as an exemplar of a collaborative, holistic approach to phased implementation of genomics across multiple autonomous institutions. The approach and lessons learned may assist others in determining how best to integrate genomics into their healthcare system.

Eliciting Preferences for Information Provision in Newborn Bloodspot Screening Programs

BACKGROUND

The national newborn bloodspot screening programs (NBSPs) are continually expanding to screen for more conditions.

OBJECTIVES

To quantify parents' preferences for information and the way in which this is provided in example NBSPs.

METHODS

A hybrid choice experiment, combining a conjoint analysis and a discrete choice experiment, was designed. A sample of current and future parents between the ages of 18 and 45 years was identified via an Internet panel. Respondents completed one of two survey versions (9 conditions and 20 conditions) comprising a validated measure of attitudes toward involvement in decision making, 6 CA questions (11 information attributes), 10 DCE questions (4 attributes: 3 process and the ability to make an informed decision), and demographic questions.

RESULTS

Of the 702 respondents who completed the survey, 58% were women, 48% were between 25 and 34 years old, and 48% were current parents. All types of information were identified to statistically significantly improve parents' ability to make a decision. Participants preferred taking an "active" role in decision making. Respondents to the 9-condition survey preferred information before 20 weeks (willingness to pay [WTP] £11.88; CI £5.56 to £19.53) and the 20-condition group after 20 weeks (WTP £15.91; CI £10.64 to £21.63). All respondents disliked receiving information 3 days after birth, with the 20-condition group also being averse to receiving it on day 5 (WTP -£11.20; CI -£18.40 to 5.72). Respondents in both groups preferred to receive their information in an individual discussion.

CONCLUSIONS

This study suggests that parents' preferences for receiving NBS information differ from how this information is given in current UK practice.

Valuing Meta-Health Effects for Use in Economic Evaluations to Inform Reimbursement Decisions: A Review of the Evidence

OBJECTIVE

This review explores the evidence from the literature regarding how meta-health effects (effects other than health resulting from the consumption of health care) are valued for use in economic evaluations.

METHODS

A systematic review of the published literature (the EMBASE, MEDLINE, PsycINFO, CINAHL, EconLit and SocINDEX databases were searched for publications in March 2016, plus manual searching) investigated the associations between study methods and the resulting values for meta-health effects estimated for use in economic evaluations. The review considered which meta-health effects were being valued and how this differed by evaluation approach, intervention investigated, source of funds and year of publication. Detailed reasons for differences observed between values for comparable meta-health effects were explored, accounting for the method of valuation.

RESULTS

The search of the literature revealed 71 studies of interest; 35% involved drug interventions, with convenience, information and process of care the three meta-health effects most often investigated. Key associations with the meta-health effects were the evaluation method, the intervention, and the source of funds. Relative values for meta-health effects ranged from 0.9% to 68% of the overall value reported in a study. For a given meta-health effect, the magnitude of the effect evaluated and how the meta-health effect was described and framed relative to overall health explained the differences in relative values.

CONCLUSIONS

Evidence from the literature shows variability in how meta-health effects are being measured for use in economic evaluations. Understanding the sources of that variability is important if decision makers are to have confidence in how meta-health effects are valued.

Assessing the validity of the ICECAP-A capability measure for adults with depression

BACKGROUND

Effectiveness and cost-effectiveness are increasingly important considerations in determining which mental health services are funded. Questions have been raised concerning the validity of generic health status instruments used in economic evaluation for assessing mental health problems such as depression; measuring capability wellbeing offers a possible alternative. The aim of this study is to assess the validity of the ICECAP-A capability instrument for individuals with depression.

METHODS

Hypotheses were developed using concept mapping. Validity tests and multivariable regression analysis were applied to data from a cross-sectional dataset to assess the performance of ICECAP-A in individuals who reported having a primary condition of depression. The ICECAP-A was collected alongside instruments used to measure: 1. depression using the depression scale of the Depression, Anxiety and Stress Scale (DASS-D of DASS-21); 2. mental health using the Kessler Psychological Distress Scale (K10); 3. generic health status using a common measure collected for use in economic evaluations, the five level version of EQ-5D (EQ-5D-5L).

RESULTS

Hypothesised associations between the ICECAP-A (items and index scores) and depression constructs were fully supported in statistical tests. In the multivariable analysis, instruments designed specifically to measure depression and mental health explained a greater proportion of the variation in ICECAP-A than the EQ-5D-5L.

CONCLUSION

The ICECAP-A instrument appears to be suitable for assessing outcome in adults with depression for resource allocation purposes. Further research is required on its responsiveness and use in economic evaluation. Using a capability perspective when assessing cost-effectiveness could potentially re-orientate resource provision across physical and mental health care services.

Intervention Now to Eliminate Repeat Unintended Pregnancy in Teenagers (INTERUPT): a systematic review of intervention effectiveness and cost-effectiveness, and qualitative and realist synthesis of implementation factors and user engagement

BACKGROUND

The UK has one of the highest rates of teenage pregnancies in Western Europe. One-fifth of these are repeat pregnancies. Unintended conceptions can cause substantial emotional, psychological and educational harm to teenagers, often with enduring implications for life chances. Babies of teenage mothers have increased mortality and are at a significantly increased risk of poverty, educational underachievement and unemployment later in life, with associated costs to society. It is important to identify effective, cost-effective and acceptable interventions.

OBJECTIVES

To identify who is at the greatest risk of repeat unintended pregnancies; which interventions are effective and cost-effective; and what the barriers to and facilitators of the uptake of these interventions are.

DATA SOURCES

We conducted a multistreamed, mixed-methods systematic review informed by service user and provider consultation to examine worldwide peer-reviewed evidence and UK-generated grey literature to find and evaluate interventions to reduce repeat unintended teenage pregnancies. We searched the following electronic databases: MEDLINE and MEDLINE In-Process & Other Non-Indexed Citations, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library (Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and the Health Technology Assessment Database), EMBASE (Excerpta Medica database), British Nursing Index, Educational Resources Information Center, Sociological Abstracts, Applied Social Sciences Index and Abstracts, BiblioMap (the Evidence for Policy and Practice Information and Co-ordinating Centre register of health promotion and public health research), Social Sciences Citation Index (supported by Web of Knowledge), Research Papers in Economics, EconLit (American Economic Association's electronic bibliography), OpenGrey, Scopus, Scirus, Social Care Online, National Research Register, National Institute for Health Research Clinical Research Network Portfolio and Index to THESES. Searches were conducted in May 2013 and updated in June 2014. In addition, we conducted a systematic search of Google (Google Inc., Mountain View, CA, USA) in January 2014. Database searches were guided by an advisory group of stakeholders.

REVIEW METHODS

To address the topic's complexities, we used a structured, innovative and iterative approach combining methods tailored to each evidence stream. Quantitative data (effectiveness, cost-effectiveness, risk factors and effect modifiers) were synthesised with reference to Cochrane guidelines for evaluating evidence on public health interventions. Qualitative evidence addressing facilitators of and barriers to the uptake of interventions, experience and acceptability of interventions was synthesised thematically. We applied the principles of realist synthesis to uncover theories and mechanisms underpinning interventions (what works, for whom and in what context). Finally, we conducted an overarching narrative of synthesis of evidence and gathered service user feedback.

RESULTS

We identified 8664 documents initially, and 816 in repeat searches. We filtered these to 12 randomised controlled trials (RCTs), four quasi-RCTs, 10 qualitative studies and 53 other quantitative studies published between 1996 and 2012. None of the RCTs was based in the UK. The RCTs evaluated an emergency contraception programme and psychosocial interventions. We found no evidence for effectiveness with regard to condom use, contraceptive use or rates of unprotected sex or use of birth control. Our primary outcome was repeat conception rate: the event rate was 132 of 308 (43%) in the intervention group versus 140 of 289 (48%) for the control goup, with a non-significant risk ratio (RR) of 0.92 [95% confidence interval (CI) 0.78 to 1.08]. Four studies reported subsequent birth rates: 29 of 237 (12%) events for the intervention arm versus 46 out of 224 (21%) for the control arm, with a RR of 0.60 (95% CI 0.39 to 0.93). Many repeat conceptions occurred in the context of poverty, low expectations and aspirations, and negligible opportunities. Service user feedback suggested that there were specific motivations for many repeat conceptions, for example to replace loss or to please a partner. Realist synthesis highlighted that context, motivation, planning for the future and letting young women take control with connectedness and tailoring provide a conceptual framework for future research.

LIMITATIONS

Included studies rarely characterised adolescent pregnancy as intended or unintended, that is interventions to reduce repeat conceptions rarely addressed whether or not pregnancies were intended. Furthermore, interventions were often not clearly defined, had multiple aims and did not indicate which elements were intended to address which aims. Nearly all of the studies were conducted in the USA and focused largely on African American or Hispanic and Latina American populations.

CONCLUSIONS

We found no evidence to indicate that existing interventions to reduce repeat teenage pregnancy were effective; however, subsequent births were reduced by home-based interventions. Qualitative and realist evidence helped to explain gaps in intervention design that should be addressed. More theory-based, rigorously evaluated programmes need to be developed to reduce repeat teenage pregnancy in the UK.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42012003168. Cochrane registration number: i=fertility/0068.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

What, who and when? Incorporating a discrete choice experiment into an economic evaluation

BACKGROUND

Economic evaluation focuses on Quality-Adjusted-Life-Years (QALYs) as the main valuation method. However, it is well known that factors beyond health related quality of life are important to patients and the public. Whilst discrete-choice-experiments (DCE) have been extensively used to value such factors, their incorporation within an economic evaluation framework is limited. This study is the first to incorporate patient preferences for factors beyond QALYs into an economic evaluation and compare results with the standard cost-per-QALY approach, using randomised-controlled-trial (RCT) participants.

METHODS

Costings, clinical-effectiveness (appropriateness-of-treatment), QALYs and patient satisfaction data were collected at baseline and 12-month follow-up for a new pharmacy-service within a randomised-controlled-trial. Trial participants who replied to the follow-up survey and had not subsequently withdrawn from the study were mailed a DCE questionnaire at 24-months. WTP for the standard and new service was derived from the DCE. Results from QALYs and the DCE were compared.

RESULTS

At 12 months, costs, clinical-effectiveness and QALYs did not differ between the intervention and control; however there was a significant increase in satisfaction in the intervention. The DCE valued this increased satisfaction in the intervention (positive net-benefit). The longer the time patients experienced the new service the greater the reported net-benefit.

CONCLUSION

When incorporating a DCE into an economic evaluation a number of questions are raised: what factors should be valued, whose values (trial-groups vs. all-trial-population) and when should they be elicited (still-receiving-the-intervention or afterwards). Consideration should also be given to status quo bias.

Maximizing Health or Sufficient Capability in Economic Evaluation? A Methodological Experiment of Treatment for Drug Addiction

Conventional practice within the United Kingdom and beyond is to conduct economic evaluations with "health" as evaluative space and "health maximization" as the decision-making rule. However, there is increasing recognition that this evaluative framework may not always be appropriate, and this is particularly the case within public health and social care contexts. This article presents a methodological case study designed to explore the impact of changing the evaluative space within an economic evaluation from health to capability well-being and the decision-making rule from health maximization to the maximization of sufficient capability. Capability well-being is an evaluative space grounded on Amartya Sen's capability approach and assesses well-being based on individuals' ability to do and be the things they value in life. Sufficient capability is an egalitarian approach to decision making that aims to ensure everyone in society achieves a normatively sufficient level of capability well-being. The case study is treatment for drug addiction, and the cost-effectiveness of 2 psychological interventions relative to usual care is assessed using data from a pilot trial. Analyses are undertaken from a health care and a government perspective. For the purpose of the study, quality-adjusted life years (measured using the EQ-5D-5L) and years of full capability equivalent and years of sufficient capability equivalent (both measured using the ICECAP-A [ICEpop CAPability measure for Adults]) are estimated. The study concludes that different evaluative spaces and decision-making rules have the potential to offer opposing treatment recommendations. The implications for policy makers are discussed.

Performing Economic Evaluation of Integrated Care: Highway to Hell or Stairway to Heaven?

Health economists are increasingly interested in integrated care in order to support decision-makers to find cost-effective solutions able to tackle the threat that chronic diseases pose on population health and health and social care budgets. However, economic evaluation in integrated care is still in its early years, facing several difficulties. The aim of this paper is to describe the unique nature of integrated care as a topic for economic evaluation, explore the obstacles to perform economic evaluation, discuss methods and techniques that can be used to address them, and set the basis to develop a research agenda for health economics in integrated care. The paper joins the voices that call health economists to pay more attention to integrated care and argues that there should be no more time wasted for doing it.

Measuring Health and Broader Well-Being Benefits in the Context of Opiate Dependence: The Psychometric Performance of the ICECAP-A and the EQ-5D-5L

BACKGROUND

Measuring outcomes in economic evaluations of social care interventions is challenging because both health and well-being benefits are evident. The ICEpop CAPability instrument for adults (ICECAP-A) and the five-level EuroQol five-dimensional questionnaire (EQ-5D-5L) are measures potentially suitable for the economic evaluation of treatments for substance use disorders. Evidence for their validity in this context is, however, lacking.

OBJECTIVES

To assess the construct validity of the ICECAP-A and the EQ-5D-5L in terms of convergent and discriminative validity and sensitivity to change on the basis of standard clinical measures (Clinical Outcomes in Routine Evaluation-Outcome Measure, Treatment Outcomes Profile, Interpersonal Support Evaluation List, Leeds Dependence Questionnaire, and Social Satisfaction Questionnaire).

METHODS

A secondary analysis of pilot trial data for heroin users in opiate substitution treatment was conducted. Baseline convergence with clinical measures was assessed using the Pearson correlation coefficient. Discriminative validity was assessed using one-way analysis of variance and stepwise regressions. Sensitivity to changes in clinical indicators was assessed at 3 and 12 months using the standardized response mean statistic and parametric and nonparametric testing.

RESULTS

Both measures had the same level of construct validity, except for clinical indicators of well-being, for which the ICECAP-A performed better. The ICECAP-A was sensitive to changes in both health and well-being indicators. The EQ-5D-5L had lower levels of sensitivity to change, and a ceiling effect (27%), particularly evident in the dimensions of self-care (89%), mobility (75%), and usual activities (72%).

CONCLUSIONS

The findings support the construct validity of both measures, but the ICECAP-A gives more attention to broader impacts and is more sensitive to change. The ICECAP-A shows promise in evaluating treatments for substance use disorders for which recovery is the desired outcome.

Economic Evaluation of Childhood Obesity Interventions: Reflections and Suggestions

Rising levels of childhood obesity present a serious global public health problem amounting to 7 % of GDP in developed countries and affecting 14 % of children. As such, many countries are investing increasingly large quantities of resource towards treatment and prevention. Whilst it is important to demonstrate the clinical effectiveness of any intervention, it is equally as important to demonstrate cost effectiveness as policy makers strive to get the best value for money from increasingly limited public resources. Economic evaluation assists with making these investment decisions and whilst it can offer considerable support in many healthcare contexts, applying it to a childhood obesity context is not straightforward. Childhood obesity is a complex disease with interventions being multi-component in nature. Furthermore, the interventions are implemented in a variety of settings such as schools, the community, and the home, and have costs and benefits that fall outside the health sector. This paper provides a reflection from a UK perspective on the application of the conventional approach to economic evaluation to childhood obesity. It offers suggestions for how evaluations should be designed to fit better within this context, and to meet the needs of local decision makers. An excellent example is the need to report costs using a micro-costing format and for benefit measurement to go beyond a health focus. This is critical as the organisation and commissioning of childhood obesity services is done from a Local Authority setting and this presents further challenges for what is the most appropriate economic evaluation approach to use. Given that adult obesity is now of epidemic proportions, the accurate assessment of childhood obesity interventions to support public health decision making is critical.