Bridging the gap: exploring the barriers to using economic evidence in healthcare decision making and strategies for improving uptake

EQ-5D-5L Population Scores in Mainland China: Results From a Nationally Representative Survey 2021

OBJECTIVES

There is a lack of monitoring changes in the population scores of the most recent version, EQ-5D-5L, in mainland China. This study aimed to address this knowledge gap by assessing the EQ-5D-5L scores in mainland China using a nationally representative sample.

METHODS

Data were extracted from the 2021 Survey of Health Index of Chinese Families, which covered 31 provinces/autonomous regions/municipalities in mainland China. The survey used a multistage quota sampling strategy encompassing 120 prefecture-level cities. Quotas were allocated to each prefecture-level city in accordance with the 2020 China Population Census. This approach resulted in a final sample of 11 030 eligible questionnaires. The utility index (UI) and EuroQol Visual Analog Scale (EQ VAS) scores were reported for the entire sample (age-gender-urban/rural weighted) and by the characteristics of the study participants.

RESULTS

The study participants had a weighted mean UI of 0.939 (SD 0.135) and EQ VAS score of 80.19 (SD 18.39). The most commonly reported problem was anxiety/depression (26.37%), whereas self-care was the least reported problem (6.18%). Those who were male, were younger, lived without chronic conditions and disabilities, had higher levels of education, earned higher monthly household income, and were covered by basic medical insurance for urban employees had higher scores in both the UI and EQ VAS.

CONCLUSION

This study revealed slightly lower UI scores despite a much higher drop in EQ VAS scores whereas China maintained minimum cases of COVID-19 in 2021 compared with the population norms recorded in 2019. Further studies are warranted to unveil the full impacts of COVID-19 outbreaks.

Is Economic Evaluation and Care Commissioning Focused on Achieving the Same Outcomes? Resource-Allocation Considerations and Challenges Using England as a Case Study

Commissioning describes the process of contracting appropriate care services to address pre-identified needs through pre-agreed payment structures. Outcomes-based commissioning (i.e., paying services for pre-agreed outcomes) shares a common goal with economic evaluation: achieving value for money for relevant outcomes (e.g., health) achieved from a finite budget. We describe considerations and challenges as to the practical role of relevant outcomes for evaluation and commissioning, seeking to bridge a gap between economic evaluation evidence and care commissioning. We describe conceptual (e.g., what are 'relevant' outcomes) alongside practical considerations (e.g., quantifying and using relevant endpoint or surrogate outcomes) and pertinent issues when linking outcomes to commissioning-based payment mechanisms, using England as a case study. Economic evaluation often focuses on a single endpoint health-focused maximand, e.g., quality-adjusted life-years (QALYs), whereas commissioning often focuses on activity-based surrogate outcomes (e.g., health monitoring), as easier-to-measure key performance indicators that are more acceptable (e.g., by clinicians) and amenable to being linked with payment structures. However, payments linked to endpoint and/or surrogate outcomes can lead to market inefficiencies; for example, when surrogates do not have the intended causal effect on endpoint outcomes or when service activity focuses on only people who can achieve prespecified payment-linked outcomes. Accounting for and explaining direct links from commissioners' payment structures to surrogate and then endpoint economic outcomes is a vital step to bridging a gap between economic evaluation approaches and commissioning. Decision-analytic models could aid this but they must be designed to account for relevant surrogate and endpoint outcomes, the payments assigned to such outcomes, and their interaction with the system commissioners purport to influence.

Local Level Economic Evaluation: What is it? What is its Value? Is it Sustainable?

In Australia, local health services with allocated budgets manage public hospital services for defined geographical areas. The authors were embedded in a local health service for around 2 years and undertook a range of local level economic evaluations for which three decision contexts were defined: intervention development, post-implementation and prioritisation. Despite difficulties in estimating opportunity costs and in the relevance of portfolio-based prioritisation approaches, economic evaluation added value to local decision-making. Development-focused (ex ante) economic evaluations used expert elicitation and calibration methods to synthesise published evidence with local health systems data to evaluate interventions to prevent hospital acquired complications. The use of economic evaluation facilitated the implementation of interventions with additional resource requirements. Decision analytic models were used alongside the implementation of larger scale, more complex service interventions to estimate counterfactual patient pathways, costs and outcomes, providing a transparent alternative to the statistical analyses of intervention effects, which were subject to high risk of bias. Economic evaluations of more established services had less impact due to data limitations and lesser executive interest. Prioritisation-focused economic evaluations compared costs, outcomes and processes of care for defined patient populations across alternative local health services to identify, understand and quantify the effects of unwarranted variation to inform priority areas for improvement within individual local health services. The sustained use of local level economic evaluation could be supported by embedding health economists in local continuous improvement units, perhaps with an initial focus on supporting the development and evaluation of prioritised new service interventions. Shared resources and critical mass are important, which could be facilitated through groups of embedded economists with joint appointments between different local health services and the same academic institution.

Challenges of using evidence in managerial decision-making of the primary health care system

BACKGROUND

Managerial Evidence-Based Decision-Making [EBDM] in the primary is a systematic approach that directs the decision-maker in a conscientious, explicit, and judicious utilization of reliable and best evidence based on the professional experiences and preferences of stakeholders and patients from various sources. This study aimed to investigate the challenges primary healthcare managers encounter while undertaking decision-making processes.

METHOD

A systematic review was conducted in 2022 with the aim of identifying and collecting all qualitative articles pertaining to evidence-based decision-making in the primary healthcare system. To achieve this, a meticulous search was conducted using the relevant keywords, including primary health care and evidence-based decision making, as well as their corresponding synonyms, across the databases Web of Science, Scopus, and Pubmed. Importantly, there were no limitations imposed on the timeframe for the search. To carefully analyze and consolidate the findings of this systematic review, the meta-synthesis approach was employed.

RESULTS

A total of 22 articles were assessed in this systematic review study. The results revealed the main categories including evidence nature, EBDM barriers, utilizing evidence, decision-makers ability, organizational structure, evidence-based, EBDM support, communication for EBDM, evidence sides, EBDM skill development, public health promotion, and health system performance improvement.

CONCLUSION

The primary healthcare system is crucial in improving health outcomes and ensuring access to healthcare services for all individuals. This study explored the utilization of evidence-based EBDM within the primary healthcare system. We identified five key dimensions: causal, contextual, and intervening conditions, strategies, and consequences of EBDM as a core phenomenon. The findings will help policymakers and administrators comprehend the importance of evidence-based decision-making, ultimately leading to enhanced decision quality, community well-being, and efficiency within the healthcare system. EBDM entails considering the best reliable evidence, and incorporating community preferences while also exploiting the professional expertise and experiences of decision-makers. This systematic review has the potential to provide guidance for future reforms and enhance the quality of decision-making at the managerial level in primary healthcare.

Research-to-Policy Partnerships for Evidence-Informed Resource Allocation in Health Systems in Africa: An Example Using the Thanzi Programme

OBJECTIVES

Empirical data on the impact of research-to-policy interventions are scant, with the few attempts mainly focusing on ensuring policymakers' timely access to evidence and evidence-informed dialogs.

METHODS

This article reflects on how the Thanzi Programme cultivates an approach of research-to-policy engagement in health economics. The program is structured around 3 interrelated pillars comprising research evidence generation, capacity and capability building, and research-and-policy engagement. Each pillar is described and examples from the Thanzi Programme are given, including illustrating how each pillar informs the other. Limitations and challenges of the approach are discussed, with examples of a way forward.

RESULTS

This program supports health system strengthening through addressing gaps identified by program partners. This includes providing health economics training and research and strengthened partnerships between in-country researchers and health policymakers, as well as between national and international researchers. Platforms bringing together researchers and policymakers to shape the research agenda, disseminate evidence, and foster an evidence-based dialog are institutionalized at country and regional levels. Health Economics and Policy Units have been established, which sit between the Ministries of Health and Universities, to augment policymakers and health economics researchers' engagements on priority health policy matters and determine researchable policy questions. The establishment of the Health Economics Community of Practice as a substantive expert committee under the East Central and Southern Africa Health Community bolsters the contribution of health economics evidence in policy processes at the regional level.

CONCLUSIONS

The Thanzi Programme is an example of how a research-and-policy partnership framework is being used to support evidence-informed health resource allocation decisions in Africa. It uses a combination of high-quality multidisciplinary research, sustained research and policymakers' engagement and capacity strengthening to use research evidence to guide and support policy makers more effectively.

Using Expert Elicitation to Adjust Published Intervention Effects to Reflect the Local Context

Background. Local health services make limited use of economic evaluation to inform decisions to fund new health service interventions. One barrier is the relevance of published intervention effects to the local setting, given these effects can strongly reflect the original evaluation context. Expert elicitation methods provide a structured approach to explicitly and transparently adjust published effect estimates, which can then be used in local-level economic evaluations to increase their local relevance. Expert elicitation was used to adjust published effect estimates for 2 interventions targeting the prevention of inpatient hypoglycemia. Methods. Elicitation was undertaken with 6 clinical experts. They were systematically presented with information regarding potential differences in patient characteristics and quality of care between the published study and local contexts, and regarding the design and application of the published study. The experts then assessed the intervention effects and provided estimates of the most realistic, most pessimistic, and most optimistic intervention effect sizes in the local context. Results. The experts estimated both interventions would be less effective in the local setting compared with the published effect estimates. For one intervention, the experts expected the lower complexity of admitted patients in the local setting would reduce the intervention's effectiveness. For the other intervention, the reduced effect was largely driven by differences in the scope of implementation (hospital-wide in the local setting compared with targeted implementation in the evaluation). Conclusions. The pragmatic elicitation methods reported in this article provide a feasible and acceptable approach to assess and adjust published intervention effects to better reflect expected effects in the local context. Further development and application of these methods is proposed to facilitate the use of local-level economic evaluation.

Highlights

Local health services make limited use of economic evaluation to inform their decisions on the funding of new health service interventions. One barrier to use is the relevance of published intervention evaluations to the local setting.Expert elicitation methods provide a structured way to consider differences between the evaluation and local settings and to explicitly and transparently adjust published effect estimates for use in local economic evaluations.The pragmatic elicitation methods reported in this article offer a feasible and acceptable approach to adjusting published intervention effects to better reflect the effects expected in the local context. This increases the relevance of economic evaluations for local decision makers.

A framework for local-level economic evaluation to inform implementation decisions: health service interventions to prevent hospital-acquired hypoglycemia

OBJECTIVES

Published evidence on health service interventions should inform decision-making in local health services, but primary effectiveness studies and cost-effectiveness analyses are unlikely to reflect contexts other than those in which the evaluations were undertaken. A ten-step framework was developed and applied to use published evidence as the basis for local-level economic evaluations that estimate the expected costs and effects of new service intervention options in specific local contexts.

METHODS

Working with a multidisciplinary group of local clinicians, the framework was applied to evaluate intervention options for preventing hospital-acquired hypoglycemia. The framework included: clinical audit and analyses of local health systems data to understand the local context and estimate baseline event rates; pragmatic literature review to identify evidence on relevant intervention options; expert elicitation to adjust published intervention effect estimates to reflect the local context; and modeling to synthesize and calibrate data derived from the disparate data sources.

RESULTS

From forty-seven studies identified in the literature review, the working group selected three interventions for evaluation. The local-level economic evaluation generated estimates of intervention costs and a range of cost, capacity and patient outcome-related consequences, which informed working group recommendations to implement two of the interventions.

CONCLUSIONS

The applied framework for modeled local-level economic evaluation was valued by local stakeholders, in particular the structured, formal approach to identifying and interpreting published evidence alongside local data. Key methodological issues included the handling of alternative reported outcomes and the elicitation of the expected intervention effects in the local context.

Evaluating the costs and consequences of computerized clinical decision support systems in hospitals: a scoping review and recommendations for future practice

OBJECTIVE

Sustainable investment in computerized decision support systems (CDSS) requires robust evaluation of their economic impacts compared with current clinical workflows. We reviewed current approaches used to evaluate the costs and consequences of CDSS in hospital settings and presented recommendations to improve the generalizability of future evaluations.

MATERIALS AND METHODS

A scoping review of peer-reviewed research articles published since 2010. Searches were completed in the PubMed, Ovid Medline, Embase, and Scopus databases (last searched February 14, 2023). All studies reported the costs and consequences of a CDSS-based intervention compared with current hospital workflows. Findings were summarized using narrative synthesis. Individual studies were further appraised against the Consolidated Health Economic Evaluation and Reporting (CHEERS) 2022 checklist.

RESULTS

Twenty-nine studies published since 2010 were included. Studies evaluated CDSS for adverse event surveillance (5 studies), antimicrobial stewardship (4 studies), blood product management (8 studies), laboratory testing (7 studies), and medication safety (5 studies). All studies evaluated costs from a hospital perspective but varied based on the valuation of resources affected by CDSS implementation, and the measurement of consequences. We recommend future studies follow guidance from the CHEERS checklist; use study designs that adjust for confounders; consider both the costs of CDSS implementation and adherence; evaluate consequences that are directly or indirectly affected by CDSS-initiated behavior change; examine the impacts of uncertainty and differences in outcomes across patient subgroups.

DISCUSSION AND CONCLUSION

Improving consistency in the conduct and reporting of evaluations will enable detailed comparisons between promising initiatives, and their subsequent uptake by decision-makers.

Danish population health measured by the EQ-5D-5L

AIMS

The aims of this study were to provide Danish population norms for the EQ-5D-5L and to assess the measurement properties of the instrument in a Danish population setting.

METHODS

We used data from the Danish 5L valuation study in which a representative sample of the Danish population completed the EQ-5D-5L and answered socio-demographic questions. We generated population norms for the five EQ-5D-5L dimensions, corresponding utility scores and the EQ-5D visual analogue scale (EQ VAS) according to age and sex. Measurement properties of ceiling effects, known-group construct validity and convergent validity were assessed.

RESULTS

The mean EQ-5D-5L utility score for the 1014 respondents completing the EQ-5D-5L was 0.90 (standard deviation (SD)=0.16). No significant differences emerged across age groups (minimum mean utility score=0.88 (SD=0.19); maximum mean utility score=0.93 (SD=0.11)) or sex (mean utility score for women=0.89 (SD=0.17); mean utility score for men=0.91 (SD=0.15)). Statistical differences were found across educational level, occupational status, income and living situation. Similar patterns were observed for the EQ VAS. Generally, respondents most often reported problems with pain and discomfort, but young women most often reported problems with anxiety/depression. There was a significant strong correlation between EQ-5D-5L utility and the EQ VAS and a significant correlation between overall health and each of the five EQ-5D-5L dimensions. The overall ceiling effect for the EQ-5D-5L was 39% (compared to 56% for the EQ-5D-3L).

CONCLUSIONS

Danish population norms for the EQ-5D-5L are now available. We found fewer ceiling effects for the EQ-5D-5L compared to the EQ-5D-3L, and we provide evidence for convergent and known-group validity of the EQ-5D-5L.

Process mining for healthcare decision analytics with micro-costing estimations

Managing constrained healthcare resources is an important and inescapable role of healthcare decision makers. Allocative decisions are based on downstream consequences of changes to care processes: judging whether the costs involved are offset by the magnitude of the consequences, and therefore whether the change represents value for money. Process mining techniques can inform such decisions by quantitatively discovering, comparing and detailing care processes using recorded data, however the scope of techniques typically excludes anything 'after-the-process' i.e., their accumulated costs and resulting consequences. Cost considerations are increasingly incorporated into process mining techniques, but the majority of healthcare costs for service and overhead components are commonly apportioned and recorded at the patient (trace) level, hiding event level detail. Within decision-analysis, event-driven and individual-level simulation models are sometimes used to forecast the expected downstream consequences of process changes, but are expensive to manually operationalise. In this paper, we address both of these gaps within and between process mining and decision analytics, by better linking them together. In particular, we introduce a new type of process model containing trace data that can be used in individual-level or cohort-level decision-analytical model building. Furthermore, we enhance these models with process-based micro-costing estimations. The approach was evaluated with health economics and decision modelling experts, with discussion centred on how the outputs could be used, and how similar information would otherwise be compiled.

The clinical value and cost-effectiveness of treatments for patients with coronary artery disease

BACKGROUND

The clinical value and cost-effectiveness of invasive treatments for patients with coronary artery disease is unclear. Invasive treatments such as coronary artery bypass grafting and percutaneous coronary intervention are frequently used as a starting treatment, yet they are much more costly than optimal medical therapy. While patients may transition into other treatments over time, the choices of starting treatments are likely important determinants of costs and health outcomes. The aim is to predict by how much costs and health outcomes will change from a decision to use different starting treatments for patients with coronary artery disease in an Asian setting.

METHODS

A cost-effectiveness study using a Markov model informed by data from Singapore General Hospital was done. All patients with initial presentations of stable coronary disease and no acute coronary syndromes who received medical treatments and interventional therapies were included. We compare existing practice, where the starting treatment can be medical therapy or stent percutaneous coronary interventions or coronary artery bypass grafting, with alternate starting treatment strategies.

RESULTS

When compared to 'existing practice' a policy of starting 14% of patients with coronary artery bypass grafting and 86% with optimal medical therapy showed savings of $1,743 per patient and 0.23 additional quality adjusted life years. A change to policy nationwide would save $10 million and generate 1,380 quality adjusted life years.

CONCLUSIONS

Increasing coronary artery bypass grafting and use of medical therapy in the setting of coronary artery disease is likely to saves costs and improve health outcomes. A definitive study to address the question we investigate would be very difficult to undertake and so using existing data to model the expected outcomes is a useful tool. There are likely to be large and complex barriers to the implementation of any policy change based on the findings of this study.

A systematic review of economic evaluations of preoperative smoking cessation for preventing surgical complications

BACKGROUND

Whilst there is a substantial body of evidence on the costs and benefits of smoking cessation generally, the benefits of routinely providing smoking cessation for surgical populations are less well known. This review summarises the evidence on the cost-effectiveness of preoperative smoking cessation to prevent surgical complications.

MATERIALS AND METHODS

A search of the Cochrane, Econlit, EMBASE, Health Technology Assessment, Medline Complete and Scopus databases was conducted from inception until 23/06/2021. Peer-reviewed, English-language articles describing economic evaluations of preoperative smoking cessation interventions to prevent surgical complications were included. Search results were independently screened for potentially eligible studies. Study characteristics, economic evaluation methods and cost-effectiveness results were extracted by one reviewer and details checked by a second. Two authors independently assessed reporting and methodological quality using the Consolidated Health Economic Evaluation Reporting Standards statement (CHEERS) and the Quality of Health Economic Studies Instrument checklist (QHES) respectively.

RESULTS

After removing duplicates, twenty full text articles were screened from 1423 database records, resulting in six included economic evaluations. Studies from the United States (n = 4), France (n = 1) and Spain (n = 1) were reported between 2009 and 2020. Four evaluations were conducted from a payer perspective. Two-thirds of evaluations were well-conducted (mean score 83) and well-reported (on average, 86% items reported). All studies concluded preoperative smoking cessation is cost-effective for preventing surgical complications; results ranged from cost saving to €53,131 per quality adjusted life year gained.

CONCLUSIONS

Preoperative smoking cessation is cost-effective for preventing surgical complications from a payer or provider perspective when compared to standard care. There is no evidence from outside the United States and Europe to inform healthcare providers, funders and policy-makers in other jurisdictions and more information is needed to clarify the optimal point of implementation to maximise cost-effectiveness of preoperative smoking cessation intervention.

SYSTEMATIC REVIEW REGISTRATION NUMBER

PROSPERO 2021 CRD42021257740. RESEARCH REGISTRY REGISTRATION NUMBER: reviewregistry1369.

Open science at the science-policy interface: bringing in the evidence?

Part of the current enthusiasm about open science stems from its promises to reform scientific practice in service of the common good, to ensure that scientific outputs will be found and reused more easily, and to enhance scientific impact on policy and society. With this article, we question this optimism by analysing the potential for open science practices to enhance research uptake at the science–policy interface. Science advice is critical to help policy-makers make informed decisions. Likewise, some interpretations of open science hold that making research processes and outputs more transparent and accessible will also enhance the uptake of results by policy and society at large. However, we argue that this hope is based on an unjustifiably simplistic understanding of the science–policy interface that leaves key terms (“impact”, “uptake”) undefined. We show that this understanding—based upon linear models of research uptake—likewise grounds the influential “evidence–policy gap” diagnosis which holds that to improve research uptake, communication and interaction between researchers and policy-makers need to be improved. The overall normative stance of both discussions has sidelined empirical description of the science–policy interface, ignoring questions about the underlying differences between the policy domain and academia. Importantly, both open science and literature on closing the evidence–policy gap recommend improving communication (in terms of either the content or the means) as a viable strategy. To correct some of these views, we combine insights from policy theory with a narrative review of the literature on the evidence–policy gap in the health domain and find that removing barriers to access by itself will not be enough to foster research uptake.

Resource allocation in dementia care: comparing the views of people with dementia, carers and health and social care professionals under constrained and unconstrained budget scenarios

BACKGROUND

People with dementia and their carers have a wide range of health and social care needs. People with dementia, carers and health and social care professionals (HSCPs) all have different perspectives on dementia care. Differences among these groups are important for commissioners of services and for front-line HSCPs.

OBJECTIVE

To compare the service recommendations of people with dementia and carers with those of HSCPs, under different budgetary conditions.

METHODS

A mixed-methods approach, which builds on the Balance of Care method, was used. Nine workshops were held with 41 participants from three groups: people with dementia, carers and HSCPs. Participants were asked to make decisions on a set of services for case types of dementia under two scenarios: a no budget constraint (NBC) scenario and a budget constraint (BC) scenario.

RESULTS

While each group allocated resources in broadly similar overall proportions, important differences in emphasis emerged: (i) people with dementia and carers placed more emphasis on psychosocial supports than HSCPs; (ii) carers put more emphasis on respite opportunities for carers; and (iii) carers identified residential care as the most suitable setting for the person with dementia more frequently than health care professionals.

CONCLUSION

Our findings suggest that the importance of psychosocial interventions, including counselling and peer support programmes, are currently underestimated by HSCPs. The provision of in-home respite is highly valued by carers. Even with unconstrained resources, some carers do not judge home care to be a viable option for dementia case types with high-level care needs.

Protocol for a systematic review of economic evaluations of preoperative smoking cessation interventions for preventing surgical complications

INTRODUCTION

The short-term economic benefit of embedding best practice tobacco dependence treatment (TDT) into healthcare services prior to surgery across different populations and jurisdictions is largely unknown. The aim of this systematic review is to summarise the cost-effectiveness of preoperative smoking cessation interventions for preventing surgical complications compared with usual care. The results will provide hospital managers, clinicians, healthcare professionals and policymakers with a critical summary of the economic evidence on providing TDT routinely before surgery, aiding the development and dissemination of unified, best practice guidelines, that is, implementation of article 14 of the WHO Framework Convention on Tobacco Control.

METHODS AND ANALYSIS

A comprehensive search of peer-reviewed literature will be conducted from database inception until 23 June 2021 (Cochrane, Econlit, Embase, Health Technology Assessment, Medline Complete, Scopus). Published, English-language articles describing economic evaluations of preoperative smoking cessation interventions for preventing surgical complications will be included. One researcher will complete the searches and two researchers will independently screen results for eligible studies. Any disagreement will be resolved by the third researcher. A narrative summary of included studies will be provided. Study characteristics, economic evaluation methods and cost-effectiveness results will be extracted by one reviewer and descriptive analyses will be undertaken. A second reviewer will review data extracted for accuracy from 10% of the included studies. Reporting and methodological quality of the included studies will be evaluated independently by two reviewers using the Consolidated Health Economic Evaluation Reporting Standards statement and the Quality of Health Economic Studies Instrument checklist, respectively.

ETHICS AND DISSEMINATION

This research does not require ethics approval because the study is a planned systematic review of published literature. Findings will be presented at health economic, public health and tobacco control conferences, published in a peer-reviewed journal and disseminated via social media.

TRIAL REGISTRATION NUMBER

CRD42021257740.

Hospital Investment Decisions in Healthcare 4.0 Technologies: Scoping Review and Framework for Exploring Challenges, Trends, and Research Directions

BACKGROUND

Alternative approaches to analyzing and evaluating health care investments in state-of-the-art technologies are being increasingly discussed in the literature, especially with the advent of Healthcare 4.0 (H4.0) technologies or eHealth. Such investments generally involve computer hardware and software that deal with the storage, retrieval, sharing, and use of health care information, data, and knowledge for communication and decision-making. Besides, the use of these technologies significantly increases when addressed in bundles. However, a structured and holistic approach to analyzing investments in H4.0 technologies is not available in the literature.

OBJECTIVE

This study aims to analyze previous research related to the evaluation of H4.0 technologies in hospitals and characterize the most common investment approaches used. We propose a framework that organizes the research associated with hospitals' H4.0 technology investment decisions and suggest five main research directions on the topic.

METHODS

To achieve our goal, we followed the standard procedure for scoping reviews. We performed a search in the Crossref, PubMed, Scopus, and Web of Science databases with the keywords investment, health, industry 4.0, investment, health technology assessment, healthcare 4.0, and smart in the title, abstract, and keywords of research papers. We retrieved 5701 publications from all the databases. After removing papers published before 2011 as well as duplicates and performing further screening, we were left with 244 articles, from which 33 were selected after in-depth analysis to compose the final publication portfolio.

RESULTS

Our findings show the multidisciplinary nature of the research related to evaluating hospital investments in H4.0 technologies. We found that the most common investment approaches focused on cost analysis, single technology, and single decision-maker involvement, which dominate bundle analysis, H4.0 technology value considerations, and multiple decision-maker involvement.

CONCLUSIONS

Some of our findings were unexpected, given the interrelated nature of H4.0 technologies and their multidimensional impact. Owing to the absence of a more holistic approach to H4.0 technology investment decisions, we identified five promising research directions for the topic: development of economic valuation methodologies tailored for H4.0 technologies; accounting for technology interrelations in the form of bundles; accounting for uncertainties in the process of evaluating such technologies; integration of administrative, medical, and patient perspectives into the evaluation process; and balancing and handling complexity in the decision-making process.

What is the likely impact on surgical site infections in Australian hospitals if smoking rates are reduced? A cost analysis

INTRODUCTION

Assisting smokers to quit before surgery reduces surgical site infection (SSI) risk. The short-term economic benefits of reducing SSIs by embedding tobacco dependence treatment in Australian hospitals are unknown. Estimated annual number of SSIs prevented, and hospital bed-days (HBD) and costs saved from reducing smoking before surgery are calculated.

METHODS

The most recent number of surgical procedures and SSI rates for Australia were sourced. The number of smokers and non-smokers having a SSI were calculated using the UK Royal College of Physicians reported adjusted odds ratio (1.79), and the proportion of SSIs attributable to smoking calculated. The potential impact fraction was used to estimate reductions in SSIs and associated HBDs and costs from reducing the smoking rates among surgical patients from 23.9% to 10% or 5% targets. Uncertainty around the final estimates was calculated using probabilistic sensitivity analysis.

RESULTS

In 2016-17, approximately 40,593 (95% UI 32,543, 50,239) people having a surgical procedure in Australia experienced a SSI leading to 101,888 extra days (95% UI 49,988, 200,822) in hospital. If the smoking rate among surgical patients was reduced to 10%, 3,580 (95% UI 2,312, 5,178) SSIs would be prevented, and 8,985 (95% UI 4,094, 19,153) HBDs and $19.1M (95% UI $7.7M, $42.5M) saved in one year. If the smoking rate was reduced to 5%, 4,867 (95% UI 3,268, 6,867) SSIs would be prevented, and 12,217 (95% UI 5,614, 25,642) HBDs and $26.0M (95% UI $10.8M, $57.0M) would be saved.

CONCLUSIONS

The findings suggest achieving smoking rate targets of 10% or 5% would provide substantial short-term health and economic benefits through reductions in SSIs. Embedding tobacco dependence treatment in Australian hospitals would provide value for money by reducing costs and improving clinical quality and safety. A more comprehensive, modelled economic evaluation synthesising the best available evidence is needed to confirm findings.

French Idiosyncratic Health-Care Reforms, Performance Management and Its Political Repercussions

Context

France has undergone major changes in social policy that made an impact on the health-care sector. The paper reminds readers of the application and shortcomings of the concept of New Public Management (NPM) in the French health system.

Problem

The paper investigates NPM health reforms in France. Reforms aimed at containing costs. What administrative restructuring was implemented? What were reform idiosyncrasies? What were their limitations? Which critical public health emergencies remain?

Methods

We examine the political and economic context of health-care reforms, the rise of the regulatory state, and its core element: the diagnostic-related group (DRG) scale. We critically examine the recentralization of health policy decisions and its impact on care providers and provide an international perspective on reforms.

Results

Reforms put priority on the use of yardsticks and also emphasized regulation and competition but rejected public–private partnerships on the Anglo-Saxon model. Central health authorities regain their authority over health policy decisions, and decentralization was weakened.

Conclusion

Restrictions in public service delivery triggered a general discontent among the population. The political repercussions of reforms eventually crystallized into the Yellow Vest movement.

Health research and knowledge translation for achieving the sustainable development goals: tackling the hurdles

We are far from reaching the sustainable development goals (SDGs) for health despite a wealth of novel insights in disease mechanisms and possible solutions. Why have we failed in knowledge translation and implementation? Starting from the case of cardiovascular diseases as one of the most prevalent non-communicable diseases, we examine barriers and hurdles, and perspectives for future health research. Health has multiple links with other SDGs. To accelerate the progress towards a healthy society, health research needs to take a broader view and become more cross-disciplinary and cross-sectoral. As one example, behavioural studies will underpin better prevention and treatment adherence. The next generation workforce in health and research needs an adapted education and training to implement more effective health approaches. As well, only effective dialogue and communication between researchers, practitioners, society and policymakers can lead to translation of evidence into policies, addressing the complexity of socioeconomic factors and commercial interests. Within Europe, health research needs a comprehensive vision and strategy that connects to achieving better health, as one of the interconnected SDGs.

"Slow science" for 21st century healthcare: reinventing health service research that serves fast-paced, high-complexity care organisations

Purpose

The purpose of this paper is to argue for an improved conceptualisation of health service research, using Stengers' (2018) metaphor of “slow science” as a critical yardstick.

Design/methodology/approach

The paper is structured in three parts. It first reviews the field of health services research and the approaches that dominate it. It then considers the healthcare research approaches whose principles and methodologies are more aligned with “slow science” before presenting a description of a “slow science” project in which the authors are currently engaged.

Findings

Current approaches to health service research struggle to offer adequate resources for resolving frontline complexity, principally because they set more store by knowledge generalisation, disciplinary continuity and integrity and the consolidation of expertise, than by engaging with frontline complexity on its terms, negotiating issues with frontline staff and patients on their terms and framing findings and solutions in ways that key in to the in situ dynamics and complexities that define health service delivery.

Originality/value

There is a need to engage in a paradigm shift that engages health services as co-researchers, prioritising practical change and local involvement over knowledge production. Economics is a research field where the products are of natural appeal to powerful health service managers. A “slow science” approach adopted by the embedded Economist Program with its emphasis on pre-implementation, knowledge mobilisation and parallel site capacity development sets out how research can be flexibly produced to improve health services.

Barriers and facilitators to conducting economic evaluation studies of Gulf Cooperation Council (GCC) countries: a survey of researchers

Background

The number of published economic evaluations of Gulf Cooperation Council (GCC) countries is notably scarce. Limited local evidence could have a major impact on the implementation of economic evaluation recommendations in the decision-making process in GCC countries. Little is known about the factors affecting researchers who seek to conduct economic evaluations. Therefore, we aimed to assess researcher barriers and facilitators in conducting such studies of GCC countries.

Methods

A cross-sectional survey of health economic researchers working in GCC countries was conducted online between January and February 2020. The survey instrument collected researchers’ perceived barriers and facilitators and demographic information. For barriers, respondents rated their agreement on a 5-point Likert scale ranging from “strongly disagree” to “strongly agree”. For facilitators, respondents rated the importance of each facilitator on a six-point scale ranging from “extremely important” to “not very important”. Then, participants were asked to select the three most important barriers and facilitators from the lists. The data collected were examined using descriptive analysis.

Results

Fifty-one researchers completed the survey (37% response rate). The majority of participants (more than 80%) agreed that lack of quality of effectiveness data and restricted access to unit cost data are the main barriers to conducting economic research. Availability of relevant local data was reported as an important facilitator, followed by collaboration between health economic researchers, policy-makers and other stakeholders.

Conclusions

The results of this study provide an exploratory view of the issues faced by health economics researchers in GCC countries. Recommendations to GCC countries based on international experiences, such as to use real-world data in economic evaluation research, were provided.

A cross-sectional study on the determinants of health-related quality of life in the Philippines using the EQ-5D-5L

PURPOSE

The purpose of this study was to identify the determinants of Filipinos' health-related quality of life (HRQoL).

METHODS

Data were collected from 1000 Filipinos across the nation who reported that they did not have known active disease or disability. HRQoL was measured through EuroQoL's (EQ) 5-level tool (EQ-5D-5L) and the EQ Visual Analog Scale (EQ-VAS). Both were implemented via the EQ Valuation Technology software. HRQoL was regressed on socioeconomic characteristics (age, sex, marital status, educational attainment, employment, poverty status, and availability of savings), social support factors (religion, religious attendance, and caregiving status), community- or societal-level factors (type and major island group of residence), and disease status.

RESULTS

Majority of respondents reported that they did not have any problems across all EQ-5D-5L dimensions, namely mobility, self-care, usual activity, pain or discomfort, and anxiety or depression. Pain or discomfort had the highest rate of respondents reporting slight to extreme problems followed by anxiety or depression. Having savings was positively associated with HRQoL, while religious attendance, caregiver status, living in an urban area, living in Visayas or Mindanao, and having a diagnosed disease were negatively associated with HRQoL.

CONCLUSION

This current study confirms that HRQoL varied across socioeconomic statuses and communities in the Philippines.

Embedding an economist in regional and rural health services to add value and reduce waste by improving local-level decision-making: protocol for the 'embedded Economist' program and evaluation

Background

Systematic approaches to the inclusion of economic evaluation in national healthcare decision-making are usual. It is less common for economic evaluation to be routinely undertaken at the ‘local-level’ (e.g. in a health service or hospital) despite the largest proportion of health care expenditure being determined at this service level and recognition by local health service decision makers of the need for capacity building in economic evaluation skills. This paper describes a novel program – the embedded Economist (eE) Program. The eE Program aims to increase local health service staff awareness of, and develop their capacity to access and apply, economic evaluation principles in decision making. The eE program evaluation is also described. The aim of the evaluation is to capture the contextual, procedural and relational aspects that assist and detract from the eE program aims; as well as the outcomes and impact from the specific eE projects.

Methods

The eE Program consists of a embedding a health economist in six health services and the provision of supported education in applied economic evaluation, provided via a community of practice and a university course. The embedded approach is grounded in co-production, embedded researchers and ‘slow science’. The sites, participants, and program design are described. The program evaluation includes qualitative data collection via surveys, semi-structured interviews, observations and field diaries. In order to share interim findings, data are collected and analysed prior, during and after implementation of the eE program, at each of the six health service sites. The surveys will be analysed by calculating frequencies and descriptive statistics. A thematic analysis will be conducted on interview, observation and filed diary data. The Framework to Assess the Impact from Translational health research (FAIT) is utilised to assess the overall impact of the eE Program.

Discussion

This program and evaluation will contribute to knowledge about how best to build capacity and skills in economic evaluation amongst decision-makers working in local-level health services. It will examine the extent to which participants are able to improve their ability to utilise evidence to inform decisions, avoid waste and improve the value of care delivery.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06181-1.

Assessment of health-related quality of life and health utilities in Australian patients with cirrhosis

Background and Aim

Health‐related quality‐of‐life measurements are important to understand lived experiences of patients who have cirrhosis. These measures also inform economic evaluations by modelling quality‐adjusted life years (QALYs). We aimed to describe health‐related quality of life, specifically multiattribute utility (scale anchors of death = 0.00 and full health = 1.00), across various stages and etiologies of cirrhosis.

Methods

Face‐to‐face interviews were used to collect Short Form 36 (SF‐36) questionnaire responses from CirCare study participants with cirrhosis (June 2017 to December 2018). The severity of cirrhosis was assessed using the Child‐Pugh score classified as class A (5–6 points), B (7–9), or C (10–15) and by the absence (“compensated”) versus presence (“decompensated”) of cirrhosis‐related complications.

Results

Patients (n = 562, average 59.8 years [SD = 11.0], male 69.9%) had a range of primary etiologies (alcohol‐related 35.2%, chronic hepatitis C 25.4%, non‐alcoholic fatty liver disease (NAFLD) 25.1%, chronic hepatitis B 5.9%, “other” 8.4%). Significantly lower (all P < 0.001) mean multiattribute utility was observed in the health states of patients with decompensated (mean = 0.62, SD = 0.15) versus compensated cirrhosis (mean = 0.68, SD = 0.12), Child‐Pugh class C (mean = 0.59, SD = 0.15) or B (mean = 0.63, SD = 0.15) versus A (mean = 0.68, SD = 0.16), and between those of working age (18–64 years; mean = 0.64, SD = 0.16) versus those aged 65+ years (mean = 0.70, SD = 0.16). The greatest decrements in health‐related quality of life relative to Australian population norms were observed across physical SF‐36 domains.

Conclusions

Persons with more advanced cirrhosis report greater life impacts. Estimates from this study are suitable for informing economic evaluations, particularly cost‐utility modelling, which captures the benefits of effective prevention, surveillance, and treatments on both the quality and quantity of patients' lives.

Neuropsychological rehabilitation interventions for people with an acquired brain injury. A protocol for a systematic review of economic evaluation

Background: New emerging evidence has demonstrated the need for effective interventions to help people living with an acquired brain injury (ABI). Evidence on cost-effectiveness, which can help inform use of limited resources, is scarce in this area and therefore the purpose of this systematic review is to critically appraise and consolidate the current evidence on economic evaluations of ABI rehabilitation interventions. Methods: Systematic review methodology will be applied to identify, select and extract data from published economic evaluation studies (trial-based, non-trial based, simulation-based, decision model and trial-based model economic evaluations) of ABI treatment interventions in adults. A systematic literature search will be conducted on the following electronic databases: EMBASE, Econlit, CINAHL, Medline, the National Health Service Economic Evaluation Database and PsyclNFO. This review will only include cost-effectiveness analysis studies (e.g., cost per life year gained), cost-benefit and cost minimisation analyses in which the designs were randomised controlled trials (RCTs), non-RCT studies, cost-utility analyses (e.g., cost per quality-adjusted life year (QALY) gained or cost per disability-adjusted life year averted), cohort studies, and modelling studies. Only studies that were published in the english language, associated with adults who have an ABI will be included. There will be no restrictions on perspective, sample size, country, follow-up duration or setting. The search strategy terms will include the following: acquired brain injury, brain*; cost*; or cost-benefit analysis*. Following data extraction, a narrative summary and tables will be used to summarize the characteristics and results of included studies. Discussion: The findings from this review will be beneficial to health policy decision makers when examining the evidence of economic evaluations in this field. In addition, it is anticipated that this review will identify gaps in the current economic literature to inform future-related research. Systematic review registration: PROSPERO CRD42020187469 (25 th June 2020).

Neuropsychological rehabilitation interventions for people with an acquired brain injury and their caregivers. A protocol for a systematic review of economic evaluation

Background: New emerging evidence has demonstrated the need for effective interventions to help people living with an acquired brain injury (ABI). Evidence on cost-effectiveness, which can help inform use of limited resources, is scarce in this area and therefore the purpose of this systematic review is to critically appraise and consolidate the current evidence on economic evaluations of ABI rehabilitation interventions. Methods: Systematic review methodology will be applied to identify, select and extract data from published economic evaluation studies (trial-based, non-trial based, simulation-based, decision model and trial-based model economic evaluations) of ABI treatment interventions in adults. A systematic literature search will be conducted on the following electronic databases: EMBASE, Econlit, CINAHL, Medline, Econlit, the National Health Service Economic Evaluation Database and PsyclNFO. This review will only include cost-effectiveness analysis studies (e.g., cost per life year gained), cost-benefit and cost minimisation analyses in which the designs were randomised controlled trials (RCTs), non-RCT studies, cost-utility analyses (e.g., cost per quality-adjusted life year (QALY) gained or cost per disability-adjusted life year averted), cohort studies, and modeling studies. Only studies that were published in English, associated with adults who have an ABI will be included. There will be no restrictions on perspective, sample size, country, follow-up duration or setting. The search strategy terms will include the following: acquired brain injury, brain*; cost*; or cost-benefit analysis*. Following data extraction, a narrative summary and tables will be used to summarize the characteristics and results of included studies. Discussion: The findings from this review will be beneficial to health policy decision makers when examining the evidence of economic evaluations in this field. In addition, it is anticipated that this review will identify gaps in the current economic literature to inform future-related research. Systematic review registration: PROSPERO CRD42020187469 (25 th June 2020).

Assessing the capacity of Ghana to introduce health technology assessment: a systematic review of economic evaluations conducted in Ghana

OBJECTIVES

Ghana is in the process of formally introducing health technology assessment (HTA) for health decision making. Similar to other low- and middle-income countries, evidence suggests that the lack of data and human capacity is a major barrier to the conduct and use of HTA. This study assessed the current human and data capacity available in Ghana to undertake HTA.

METHODS

As economic evaluation (EE) forms an integral part of HTA, a systematic review of EE studies undertaken in Ghana was conducted to identify the quality and number of studies available, methods and source of data used, and local persons involved. The literature search was undertaken in EMBASE (including MEDLINE), PUBMED, and Google Scholar. The quality of studies was evaluated using the Consolidated Health Economics Evaluation Reporting Standards. The number of local Ghanaians who contributed to authorship were used as a proxy for assessing human capacity for HTA.

RESULTS

Thirty-one studies were included in the final review. Overall, studies were of good quality. Studies derived their effectiveness, resource utilization and cost data mainly from Ghana. The most common source of cost data was from the National Health Insurance Scheme pricing list for medicines and tariffs. Effectiveness data were mostly derived from either single study or intervention programs. Sixty out of 199 authors were Ghanaians (30 percent); these authors were mostly involved in data collection and study conceptualization.

CONCLUSIONS

Human capacity for HTA in Ghana is limited. To introduce HTA successfully in Ghana, policy makers would need to develop more local capacity to undertake Ghanaian-specific HTA.

A Systematic Review of Economic Evaluations in Vascular Surgery

BACKGROUND

With increasing healthcare costs and the emergence of new technologies in vascular surgery, economic evaluations play a critical role in informing decision-making that optimizes patient outcomes while minimizing per capita costs. The objective of this systematic review is to describe all English published economic evaluations in vascular surgery and to identify any significant gaps in the literature.

METHODS

We conducted a comprehensive English literature review of EMBASE, MEDLINE, The Cochrane Library, Ovid Health Star, and Business Source Complete from inception until December 1, 2018. Two independent reviewers screened articles for eligibility using predetermined inclusion criteria and subsequently extracted data. Articles were included if they compared 2 or more vascular surgery interventions using either a partial economic evaluation (cost analysis) or full economic evaluation (cost-utility, cost-benefit, and/or cost-effectiveness analysis). Data extracted included publishing journal, date of publication, country of origin of authors, type of economic evaluation, and domain of vascular surgery.

RESULTS

A total of 234 papers were included in the analysis. The majority of the papers included only a cost analysis (183, 78%), and there were only 51 papers that conducted a full economic analysis (22%). The 51 papers conducted a total of 69 economic analyses. This consisted of 32 cost-effectiveness analyses, 29 cost-utility analyses, and 8 cost-benefit analyses. The most common domains studied were aneurysmal disease (89, 38%) and peripheral vascular disease (50, 21%). Economic evaluations were commonly published in the Journal of Vascular Surgery (83, 35%) and Annals of Vascular Surgery (32, 14%), with most study authors located in the United States (127, 54%). There was a trend of economic evaluations being published more frequently in recent years.

CONCLUSIONS

The majority of vascular surgery economic evaluations used only a cost analysis, rather than a full economic evaluation, which may not be ideal in pursuing interventions that simultaneously optimize cost and patient outcomes. The literature is lacking in full economic evaluations-a trend persistent in other surgical specialties-and there is a need for full economic evaluations to be conducted in the field of vascular surgery.

Incorporation of health economic evaluation into immunization policy-making in Canada: Barriers and facilitators

INTRODUCTION

Despite the WHO recommendation that economic evidence be considered in national vaccine recommendations, this element of decision-making has been lacking or not done routinely in Canada. This study aimed to investigate barriers and facilitators to using economic evaluations in public health immunization programs decision-making across Canadian jurisdictions.

METHODS

This mixed methods study consisted of a cross-sectional survey and semi-structured interviews of national, provincial and territorial public health level key informants, and of members of the national immunization research network in Canada. Barriers were categorized according to accessibility (e.g. access to human resources to conduct the evaluation) and acceptability (e.g. political resistance to using the evaluation).

RESULTS

Of 63 survey participants, 12 were federal, provincial or territorial key informants (response rate 12/31, 39%) and 51 were members from the research network (response rate 51/214, 24%). Eleven stakeholders gave semi-structured interviews. All respondents support increased use of economic evaluation and of it becoming a routine part of immunization policy-making. However, 70% of the survey respondents identified limited resources (human and financial) to perform economic evaluations, and 39% reported lack of expertise to interpret economic evidence. Vaccine effectiveness and the burden of disease were seen as more important than cost-effectiveness by survey respondents and interviewees. Potential facilitators were for economic evaluations to either be conducted at the national level, or through a collaboration between provinces and territories with capacity to address shared needs so that evaluations occurred in a co-ordinated but distributed way.

RECOMMENDATIONS

Barriers to incorporation of economic evaluation in immunization policy-making in Canada include lacking human and financial resources to conduct them and understanding of economic evidence. National, provincial and territorial public health actors reported that facilitators to incorporating economic evidence include developing increased capacity to conduct and use economic evaluations and establishing inter-jurisdictional systems to share the work of conducting economic evaluation and/or by national leadership.

The knowledge and attitude of Ghanaian decision-makers and researchers towards health technology assessment

Although health technology assessment (HTA) is intended to provide policymakers with objective information, the likelihood that a health decision-maker (HDM) will use this information is associated with their knowledge, role and perception of the HTA process. In Ghana, policymakers are working towards formalising the use of HTA, but HDM knowledge of and attitude towards HTA are not known. Between March and May 2016, we conducted in-depth interviews and used inductive thematic analysis to explore Ghanaian HDMs (n = 23) and researchers' (n = 4) perceptions of and barriers to HTA and identify ways to promote HTA. We compare our findings with those reported in previous studies conducted in low-and-middle-income countries. Common themes were that resources, political and cultural factors act as barriers to HTA use. Recommendations made in previous studies which were also identified in this study included the need for the development of both human and data capacity, allocating funds to HTA and stakeholder involvement in HTA processes. Specific recommendations made by Ghanaian HDMs and researchers in this study focused on the establishment of an HTA body: its location, the constitution of the appraisal team, the type of evidence to appraise and who makes the final decision. The findings provide important information in the context of current planning to institutionalise HTA in Ghana. Addressing the identified barriers will enable policymakers to maximise the chances of realising the expected benefits of HTA, as participants who are potential producers and end-users are likely to use what they have contributed to.

Transparency in Decision Modelling: What, Why, Who and How?

Transparency in decision modelling is an evolving concept. Recently, discussion has moved from reporting standards to open-source implementation of decision analytic models. However, in the debate about the supposed advantages and disadvantages of greater transparency, there is a lack of definition. The purpose of this article is not to present a case for or against transparency, but rather to provide a more nuanced understanding of what transparency means in the context of decision modelling and how it could be addressed. To this end, we review and summarise the discourse to date, drawing on our collective experience. We outline a taxonomy of the different manifestations of transparency, including reporting standards, reference models, collaboration, model registration, peer review and open-source modelling. Further, we map out the role and incentives for the various stakeholders, including industry, research organisations, publishers and decision makers. We outline the anticipated advantages and disadvantages of greater transparency with respect to each manifestation, as well as the perceived barriers and facilitators to greater transparency. These are considered with respect to the different stakeholders and with reference to issues including intellectual property, legality, standards, quality assurance, code integrity, health technology assessment processes, incentives, funding, software, access and deployment options, data protection and stakeholder engagement. For each manifestation of transparency, we discuss the 'what', 'why', 'who' and 'how'. Specifically, their meaning, why the community might (or might not) wish to embrace them, whose engagement as stakeholders is required and how relevant objectives might be realised. We identify current initiatives aimed to improve transparency to exemplify efforts in current practice and for the future.

Applying an Implementation Framework to the Use of Evidence from Economic Evaluations in Making Healthcare Decisions

BACKGROUND AND OBJECTIVE

There is a need for the application of theory in understanding the use of evidence from economic evaluations in healthcare decision making. The purpose of this study is to review the published literature on the use of evidence from economic evaluations for healthcare decision making and to map the findings to the Consolidated Framework for Implementation Research (CFIR).

METHODS

A systematic search strategy was used to identify studies investigating the factors that determine the use of evidence from economic evaluation in healthcare decision making. Barriers and facilitators identified in the included studies were mapped across the five CFIR domains, with the "intervention" referring to the use of economic evaluations in decision making. Gaps, inconsistencies and emergent relations were identified through the mapping process.

RESULTS

Fifty-three studies met eligibility criteria and were included in the review. The CFIR constructs associated with the Intervention Characteristics and those associated with the knowledge and beliefs of users of economic evaluations were widely cited in the identified barriers and facilitators. Other constructs from the CFIR had not been reported in the literature, such as 'organisational networks' and 'individual stage of change'. Most of the stages in the implementation process as described by the CFIR were reflected in the identified barriers and facilitators.

DISCUSSION

By categorising barriers and facilitators into domains, the CFIR provides a systematic approach to assess how these factors interact. Literature gaps in the literature regarding the use of economic evaluation in healthcare decision making were identified, specifically issues regarding organisational networks and the role of feedback.

CONCLUSIONS

Through mapping findings from studies of the use of evidence from economic evaluations in healthcare decision making, we present an implementation framework based on the CFIR for understanding the use of economic evaluations into practice.

Accounting for Capacity Constraints in Economic Evaluations of Precision Medicine: A Systematic Review

BACKGROUND AND OBJECTIVE

Precision (stratified or personalised) medicine is underpinned by the premise that it is feasible to identify known heterogeneity using a specific test or algorithm in patient populations and to use this information to guide patient care to improve health and well-being. This study aimed to understand if, and how, previous economic evaluations of precision medicine had taken account of the impact of capacity constraints.

METHODS

A meta-review was conducted of published systematic reviews of economic evaluations of precision medicine (test-treat interventions) and individual studies included in these reviews. Due to the volume of studies identified, a sample of papers published from 2007 to 2015 was collated. A narrative analysis identified whether potential capacity constraints were discussed qualitatively in the studies and, if relevant, which quantitative methods were used to account for capacity constraints.

RESULTS

A total of 45 systematic reviews of economic evaluations of precision medicine were identified, from which 222 studies focusing on test-treat interventions, published between 2007 and 2015, were extracted. Of these studies, 33 (15%) qualitatively discussed the potential impact of capacity constraints, including budget constraints; quality of tests and the testing process; ease of use of tests in clinical practice; and decision uncertainty. Quantitative methods (nine studies) to account for capacity constraints included static methods such as capturing inefficiencies in trials or models and sensitivity analysis around model parameters; and dynamic methods, which allow the impact of capacity constraints on cost effectiveness to change over time.

CONCLUSIONS

Understanding the cost effectiveness of precision medicine is necessary, but not sufficient, evidence for its successful implementation. There are currently few examples of evaluations that have quantified the impact of capacity constraints, which suggests an area of focus for future research.

Changes in health-related quality of life of Chinese populations measured by the EQ-5D-3 L: a comparison of the 2008 and 2013 National Health Services Surveys

BACKGROUNDS

The EuroQol Group Five-Dimensional (EQ-5D) instruments have been validated in China for measuring health-related quality of life (HRQoL) and are increasingly being used in health economic studies. However, there is paucity in the literature documenting long-term changes in the EQ-5D results in the Chinese populations. This study aims to identify such changes and their determinants using the EQ-5D-3 L instrument.

METHODS

Data were obtained from the National Health Services Surveys in China, which included the EQ-5D-3 L since 2008. We compared the differences between the 2008 and 2013 surveys in the percentage of reported problems, visual analogue scale (VAS) scores, and the EQ-5D-3 L utility index derived from the national value sets. Factors associated with population changes in these EQ-5D results were identified using logistic, linear and Tobit regression models, respectively.

RESULTS

Compared with 2008, reported problems in self-care (3.3% vs 3.1%), usual activities (4.8% vs 4.6%) and anxiety/depression (6.4% vs 5.3%) decreased, whereas reported problems in mobility (5.1% vs 5.9%) and pain/discomfort (9.3% vs 12.6%) increased significantly (p < 0.05) in 2013. The regression models revealed a rise (β = 1.61, p < 0.001) in VAS scores, but a slight drop (β = - 0.01, p < 0.001) in utility index in 2013 compared with 2008 after controlling for variations in demographic, behavioral, socioeconomic and residential variables. But the effect sizes of the changes over time (estimated by "average change divided by baseline standard deviation") did not reach the threshold of clinical importance after adjustment for variations in other factors. Higher socioeconomic status (in terms of education, income and residential location) was associated with better EQ-5D-3 L results.

CONCLUSION

The changing trend (decrease) of the utility index is contradictory to that (increase) of the VAS scores, although neither is deemed clinically important. It is evident that socioeconomic and regional disparities in HRQoL exist in China.

Technocratic recentralization in the French health care system: A critical evaluation

The French health care system implemented several corporate management recipes such as diagnostic-related groups (DRGs), benchmarking, and activity-based management in a bid to restore fiscal discipline and to "reassert the center." The government also regrouped health policy decisions with the Regional Health Agencies and opted for a top-down line of command to ensure policy implementation. Though reforms emphasized evidenced-based policy and outputs measurement, outcomes were below expectations in many areas and led to a shift in values. Professional autonomy and patient engagement receded. This leads us to a critical evaluation of the French audit society.

Scepticaemia: The impact on the health system and patients of delaying new treatments with uncertain evidence; a case study of the sepsis bundle

BACKGROUND

A sepsis care bundle of intravenous vitamin C, thiamine, and hydrocortisone was reported to improve treatment outcomes. The data to support it are uncertain and decision makers are likely to be cautious about adopting it. The objective of this study was to model the opportunity costs in dollars and lives of waiting for better information before adopting the bundle.

METHODS

A decision tree was built using information from the literature. We modelled the impact of bundle adoption under three scenarios using a simulation in which the bundle was effective as reported in the primary trial, less effective based on other information, and ineffective. The measurements were health services costs, quality-adjusted life years, and transition probabilities.

RESULTS

If the bundle proves to be effective under either scenario, it will save billions of dollars and millions of life-years in the United States. This is the opportunity cost of delaying an adoption decision and waiting for better quality evidence. We suggest that hospital decision-makers consider implementing the bundle on a trial basis while monitoring costs and outcomes data even while the evidence base is uncertain.

CONCLUSIONS

If the decision maker is unwilling to use the best available evidence now, but rather wishes to wait for definitive evidence they are risking incurring large costs for health care systems and for the patients they serve. An explicit analysis of uncertain clinical outcomes is a useful adjunct to guide decision making where there is clinical ambiguity. This approach offers a valid alternative to the default of clinical inactivity when faced with uncertainty.

Enhancing Capacity for Evidence-Based Policymaking: the Role of Economic Evaluation Standards

This commentary will describe some ongoing activities that are moving the federal government toward stronger use of evidence in decision-making. In particular, the work of the Commission on Evidence-Based Policymaking points to directions that have implications for capacity building and the institutionalization of economic evaluation, as well as mechanisms and resources that could make economic evaluation more feasible. Bipartisan legislation incorporates many of the recommendations of the Commission and reinforces efforts already underway at individual agencies as well as among interagency groups. Understanding the current context of evidence-based policymaking in the federal government can enable economic researchers to better influence the processes of capacity building, shape the designs of evaluations, and inform decision-making. The commentary highlights areas where further elaboration of economic evaluation principles could be useful to support evidence building, implementation, and program improvement.

A systematic review and critical analysis of cost-effectiveness studies for coronary artery disease treatment

Background: Cardiovascular disease remains the primary cause of death among Australians, despite dramatic improvements in overall cardiovascular health since the 1980s. Treating cardiovascular disease continues to place a significant economic strain on the Australian health care system, with direct healthcare costs exceeding those of any other disease. Coronary artery disease accounts for nearly one third of these costs and spending continues to rise. A range of treatments is available for coronary artery disease yet evidence of cost-effectiveness is missing, particularly for the Australian context. Cost-effectiveness evidence can signal waste and inefficiency and so is essential for an efficient allocation of healthcare resources. Methods: We used systematic review methods to search the literature across several electronic databases for economic evaluations of treatments for coronary artery disease.  We critically appraised the literature found in searches, both against the CHEERS statement for quality reporting of economic evaluations and in terms of its usefulness for policy and decision-makers. Results: We retrieved a total of 308 references, 229 once duplicates were removed. Of these, 26 were excluded as they were not full papers (letters, editorials etc.), 55 were review papers, 50 were not cost-effectiveness analyses and 93 related to a highly specific patient sub-group or did not consider all treatment options.  This left five papers to be reviewed in full. Conclusions: The current cost-effectiveness evidence does not support the increased use of PCI that has been seen in Australia and internationally. Due to problems with accessibility, clarity and relevance to policy and decision-makers, some otherwise very scientifically rigorous analyses have failed to generate any policy changes.

A systematic review and critical analysis of cost-effectiveness studies for coronary artery disease treatment

Background: Cardiovascular disease remains the primary cause of death among Australians, despite dramatic improvements in overall cardiovascular health since the 1980s. Treating cardiovascular disease continues to place a significant economic strain on the Australian health care system, with direct healthcare costs exceeding those of any other disease. Coronary artery disease accounts for nearly one third of these costs and spending continues to rise. A range of treatments is available for coronary artery disease yet evidence of cost-effectiveness is missing, particularly for the Australian context. Cost-effectiveness evidence can signal waste and inefficiency and so is essential for an efficient allocation of healthcare resources. Methods: We used systematic review methods to search the literature across several electronic databases for economic evaluations of treatments for stable coronary artery disease.  We critically appraised the literature found in searches, both against the CHEERS statement for quality reporting of economic evaluations and in terms of its usefulness for policy and decision-makers. Results: We retrieved a total of 308 references, 229 once duplicates were removed. Of these, 26 were excluded as they were not full papers (letters, editorials etc.), 55 were review papers, 50 were not cost-effectiveness analyses and 93 related to a highly specific patient sub-group or did not consider all treatment options.  This left five papers to be reviewed in full. Conclusions: The current cost-effectiveness evidence does not support the increased use of PCI that has been seen in Australia and internationally. Due to problems with accessibility, clarity and relevance to policy and decision-makers, some otherwise very scientifically rigorous analyses have failed to generate any policy changes.

Evidence use in decision-making on introducing innovations: a systematic scoping review with stakeholder feedback

BACKGROUND

A range of evidence informs decision-making on innovation in health care, including formal research findings, local data and professional opinion. However, cultural and organisational factors often prevent the translation of evidence for innovations into practice. In addition to the characteristics of evidence, it is known that processes at the individual level influence its impact on decision-making. Less is known about the ways in which processes at the professional, organisational and local system level shape evidence use and its role in decisions to adopt innovations.

METHODS

A systematic scoping review was used to review the health literature on innovations within acute and primary care and map processes at the professional, organisational and local system levels which influence how evidence informs decision-making on innovation. Stakeholder feedback on the themes identified was collected via focus groups to test and develop the findings.

RESULTS

Following database and manual searches, 31 studies reporting primary qualitative data met the inclusion criteria: 24 were of sufficient methodological quality to be included in the thematic analysis. Evidence use in decision-making on innovation is influenced by multi-level processes (professional, organisational, local system) and interactions across these levels. Preferences for evidence vary by professional group and health service setting. Organisations can shape professional behaviour by requiring particular forms of evidence to inform decision-making. Pan-regional organisations shape innovation decision-making at lower levels. Political processes at all levels shape the selection and use of evidence in decision-making.

CONCLUSIONS

The synthesis of results from primary qualitative studies found that evidence use in decision-making on innovation is influenced by processes at multiple levels. Interactions between different levels shape evidence use in decision-making (e.g. professional groups and organisations can use local systems to validate evidence and legitimise innovations, while local systems can tailor or frame evidence to influence activity at lower levels). Organisational leaders need to consider whether the environment in which decisions are made values diverse evidence and stakeholder perspectives. Further qualitative research on decision-making practices that highlights how and why different types of evidence come to count during decisions, and tracks the political aspects of decisions about innovation, is needed.

MOST IMPORTANT BARRIERS AND FACILITATORS REGARDING THE USE OF HEALTH TECHNOLOGY ASSESSMENT

Objectives: Several studies have reported multiple barriers to and facilitators for the uptake of health technology assessment (HTA) information by policy makers. This study elicited, using best-worst scaling (BWS), the most important barriers and facilitators and their relative weight in the use of HTA by policy makers.

Methods: Two BWS object case surveys (one for barriers, one for facilitators) were conducted among sixteen policy makers and thirty-three HTA experts in the Netherlands. A list of twenty-two barriers and nineteen facilitators was included. In each choice task, participants were asked to choose the most important and the least important barrier/facilitator from a set of five. We used Hierarchical Bayes modeling to generate the mean relative importance score (RIS) for each factor and a subgroup analysis was conducted to assess differences between policy makers and HTA experts.

Results: The five most important barriers (RIS > 6.00) were “no explicit framework for decision-making process,” “insufficient support by stakeholders,” “lack of support,” “limited generalizability,” and “absence of appropriate incentives.” The six most important facilitators were: “availability of explicit framework for decision making,” “sufficient support by stakeholders,” “appropriate incentives,” “sufficient quality,” “sufficient awareness,” and “sufficient support within the organization.” Overall, perceptions did not differ markedly between policy makers and HTA experts.

Conclusions: Our study suggests that barriers and facilitators related to “policy characteristics” and “organization and resources” were particularly important. It is important to stimulate a pulse at the national level to create an explicit framework for including HTA in the decision-making context.

Economic Evaluation in Ethiopian Healthcare Sector Decision Making: Perception, Practice and Barriers

BACKGROUND

Globally, economic evaluation (EE) is increasingly being considered as a critical tool for allocating scarce healthcare resources. However, such considerations are less documented in low-income countries, such as in Ethiopia. In particular, to date there has been no assessment conducted to evaluate the perception and practice of and barriers to health EE.

OBJECTIVE

This paper assesses the use and perceptions of EE in healthcare decision-making processes in Ethiopia.

METHODS

In-depth interview sessions with decision makers/healthcare managers and program coordinators across six regional health bureaus were conducted. A qualitative analysis approach was conducted on three thematic areas.

RESULTS

A total of 57 decision makers/healthcare managers were interviewed from all tiers of the health sector in Ethiopia, ranging from the Federal Ministry of Health down to the lower levels of the health facility pyramid. At the high-level healthcare decision-making tier, only 56 % of those interviewed showed a good understanding of EE when explaining in terms of cost and consequences of alternative courses of action and value for money. From the specific program perspective, 50 % of the prevention of mother-to-child transmission of HIV/AIDS program coordinators indicated the relevance of EE to program planning and decision making. These respondents reported a limited application of costing studies on the HIV/AIDS prevention and control program, which were most commonly used during annual planning and budgeting.

CONCLUSION

The study uncovered three important barriers to growth of EE in Ethiopia: a lack of awareness, a lack of expertise and skill, and the traditional decision-making culture.

The influence of cost-per-DALY information in health prioritisation and desirable features for a registry: a survey of health policy experts in Vietnam, India and Bangladesh

Background

Economic evaluation has been implemented to inform policy in many areas, including coverage decisions, technology pricing, and the development of clinical practice guidelines. However, there are barriers to evidence-based policy in low- and middle-income countries (LMICs) that include limited stakeholder awareness, resources and data availability, as well as the lack of capacity to conduct country-specific economic evaluations. This study aims to survey health policy experts’ opinions on barriers to use of cost-effectiveness data in these settings and to obtain their advice on how to make a new cost-per-DALY database being developed by Tufts Medical Center more relevant to LMICs. It also identifies the factors influencing transferability.

Methods

In-depth interviews were conducted with 32 participants, including policymakers, technical advisors, and researchers in Health Ministries, universities and non-governmental organisations in Bangladesh, India (New Delhi, Tamil Nadu and Karnataka) and Vietnam.

Results

The survey revealed that, in all settings, the use of cost-effectiveness information in policy development is lacking, owing to limited knowledge among policymakers and inadequate human resources with health economics expertise in the government sector. Furthermore, researchers in universities do not have close connections with health authorities. In India and Vietnam, the demand for evidence to inform coverage decisions tends to increase as the countries are moving towards universal health coverage. The informants in all countries argue that cost-effectiveness data are useful for decision-makers; however, most of them do not perform data searches by themselves but rely on the information provided by the technical advisor counterparts. Most interviewees were familiar with using evidence from other countries and were also aware of the influences of contextual elements as a limitation of transferability. Finally, strategies to promote the newly developed database include training on basic economic evaluation for policymakers and researchers, and effective communication programs, with support from reputable global agencies.

Conclusions

Although cost-effectiveness information is recognised as essential in resource allocation, there are several impediments in the generation and use of such evidence to inform priority setting in LMICs. As such, the Cost-per-DALY database should be well-designed and introduced with appropriate promotion strategies so that it will be helpful in real-world policymaking.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-016-0156-6) contains supplementary material, which is available to authorized users.

Health-related quality of life measured using the EQ-5D-5L: South Australian population norms

BACKGROUND

Although a five level version of the widely-used EuroQol 5 dimensions (EQ-5D) instrument has been developed, population norms are not yet available for Australia to inform the future valuation of health in economic evaluations. The aim of this study was to estimate HrQOL normative values for the EQ-5D-5L preference-based measure in a large, randomly selected, community sample in South Australia.

METHODS

The EQ-5D-5L instrument was included in the 2013 South Australian Health Omnibus Survey, an interviewer-administered, face-to-face, cross-sectional survey. Respondents rated their level of impairment across dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) and global health rating on a visual analogue scale (EQ-VAS). Utility scores were derived using the newly-developed UK general population-based algorithm and relationships between utility and EQ-VAS scores and socio-demographic factors were also explored using multivariate regression analyses.

RESULTS

Ultimately, 2,908 adults participated in the survey (63.4 % participation rate). The mean utility and EQ-VAS scores were 0.91 (95 CI 0.90, 0.91) and 78.55 (95 % CI 77.95, 79.15), respectively. Almost half of respondents reported no problems across all dimensions (42.8 %), whereas only 7.2 % rated their health >90 on the EQ-VAS (100 = the best health you can imagine). Younger age, male gender, longer duration of education, higher annual household income, employment and marriage/de facto relationships were all independent, statistically significant predictors of better health status (p < 0.01) measured with the EQ-VAS. Only age and employment status were associated with higher utility scores, indicating fundamental differences between these measures of health status.

CONCLUSIONS

This is the first Australian study to apply the EQ-5D-5L in a large, community sample. Overall, findings are consistent with EQ-5D-5L utility and VAS scores reported for other countries and indicate that the majority of South Australian adults report themselves in full health. When valuing health in Australian economic evaluations, the utility population norms can be used to estimate HrQOL. More generally, the EQ-VAS score may be a better measure of population health given the smaller ceiling effect and broader coverage of HrQOL dimensions. Further research is recommended to update EQ-5D-5L population norms using the Australian general population specific scoring algorithm once this becomes publically available.

Diverse approaches to the health economic evaluation of bariatric surgery: a comprehensive systematic review

BACKGROUND

Health economic evaluations inform healthcare resource allocation decisions for treatment options for obesity including bariatric/metabolic surgery. As an important advance on existing systematic reviews, we aimed to capture, summarize and synthesize a diverse range of economic evaluations on bariatric surgery.

METHODS

Studies were identified by electronic screening of all major biomedical/economic databases. Studies included if they reported any quantified health economic cost and/or consequence with a measure of effect for any type of bariatric surgery from 1995 to September 2015. Study screening, data extraction and synthesis followed international guidelines for systematic reviews.

RESULTS

Six thousand one hundred eighty-seven studies were initially identified. After two levels of screening, 77 studies representing 17 countries (56% USA) were included. Despite study heterogeneity, common themes emerged, and important gaps were identified. Most studies adopted the healthcare system/third-party payer perspective; reported costs were generally healthcare resource use (inpatient/shorter-term outpatient). Out-of-pocket costs to individuals, family members (travel time, caregiving) and indirect costs due to lost productivity were largely ignored. Costs due to reoperations/complications were not included in one-third of studies. Body-contouring surgery included in only 14%. One study evaluated long-term waitlisted patients. Surgery was cost-effective/cost-saving for severely obese with type 2 diabetes mellitus. Study quality was inconsistent.

DISCUSSION

There is a need for studies that assume a broader societal perspective (including out-of-pocket costs, costs to family and productivity losses) and longer-term costs (capture reoperations/complications, waiting, body contouring), and consequences (health-related quality-of-life). Full economic evaluation underpinned by reporting standards should inform prioritization of patients (e.g. type 2 diabetes mellitus with body mass index 30 to 34.9 kg/m(2) or long-term waitlisted) for surgery. © 2016 World Obesity.

Limiting the Number of Lumens in Peripherally Inserted Central Catheters to Improve Outcomes and Reduce Cost: A Simulation Study

BACKGROUND

The number of peripherally inserted central catheter (PICC) lumens is associated with thrombotic and infectious complications. Because multilumen PICCs are not necessary in all patients, policies that limit their use may improve safety and cost.

OBJECTIVE

To design a simulation-based analysis to estimate outcomes and cost associated with a policy that encourages single-lumen PICC use.

METHODS

Model inputs, including risk of complications and costs associated with single- and multilumen PICCs, were obtained from available literature and a multihospital collaborative quality improvement project. Cost savings and reduction in central line–associated bloodstream infection and deep vein thrombosis events from institution of a single-lumen PICC default policy were reported.

RESULTS

According to our model, a hospital that places 1,000 PICCs per year (25% of which are single-lumen and 75% multilumen) experiences annual PICC-related maintenance and complication costs of $1,228,598 (95% CI, $1,053,175–$1,430,958). In such facilities, every 5% increase in single-lumen PICC use would prevent 0.5 PICC-related central line-associated bloodstream infections and 0.5 PICC-related deep vein thrombosis events, while saving $23,500. Moving from 25% to 50% single-lumen PICC utilization would result in total savings of $119,283 (95% CI, $74,030–$184,170) per year. Regardless of baseline prevalence, a single-lumen default PICC policy would be associated with approximately 10% cost savings. Findings remained robust in multiway sensitivity analyses.

CONCLUSION

Hospital policies that limit the number of PICC lumens may enhance patient safety and reduce healthcare costs. Studies measuring intended and unintended consequences of this approach, followed by rapid adoption, appear necessary.

Infect Control Hosp Epidemiol 2016;37:811–817

A practical guide for using registry data to inform decisions about the cost effectiveness of new cancer drugs: lessons learned from the PHAROS registry

Decision makers increasingly request evidence on the real-world cost effectiveness of a new treatment. There is, however, a lack of practical guidance on how to conduct an economic evaluation based on registry data and how this evidence can be used in actual decision making. This paper explains the required steps on how to perform a sound economic evaluation using examples from an economic evaluation conducted with real-world data from the Dutch Population based HAematological Registry for Observational Studies. There are three main issues related to using registry data: confounding by indication, missing data, and insufficient numbers of (comparable) patients. If encountered, it is crucial to accurately deal with these issues to maximize the internal validity and generalizability of the outcomes and their value to decision makers. Multivariate regression modeling, propensity score matching, and data synthesis are well-established methods to deal with confounding. Multiple imputation methods should be used in cases where data are missing at random. Furthermore, it is important to base the incremental cost-effectiveness ratio of a new treatment compared with its alternative on comparable groups of (matched) patients, even if matching results in a small analytical population. Unmatched real-world data provide insights into the costs and effects of a treatment in a real-world setting. Decision makers should realize that real-world evidence provides extremely valuable and relevant policy information, but needs to be assessed differently compared with evidence derived from a randomized clinical trial.