Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review

Informing evidence-based medicine for opioid use disorder using pharmacoeconomic studies

INTRODUCTION

The health and economic consequences of inadequately treated opioid use disorder (OUD) are substantial. Healthcare systems in the United States (US) and other countries are facing a growing healthcare crisis due to opioids. Although effective medications for OUD exist, relying solely on clinical information is insufficient for addressing the opioid crisis.

AREAS COVERED

In this review, the role of pharmacoeconomic studies in informing evidence-based medication treatment for OUD is discussed, with a particular emphasis on the US healthcare system, where the economic burden is significantly higher than the global average. The scope/objective of pharmacoeconomics as a distinct scientific research program is briefly defined, followed by a discussion of existing evidence informed by data from systematic reviews, in addition to a convenience sample of recently published pharmacoeconomic studies and protocols. The review also explores the need for methodological advancements in the field.

EXPERT OPINION

Despite the potential of pharmacoeconomic research in shaping evidence-based medicine for OUD, significant challenges limiting its real-world application remain. How to address these challenges are explored, including how to combine cost-effectiveness and budget impact analyses to address the needs of the healthcare system as a whole and specific stakeholders interested in adopting new OUD treatment strategies.

How health technology assessment can help to address challenges in drug repurposing: a conceptual framework

Drug repurposing faces various challenges that can impede its success. We developed a framework outlining key challenges in drug repurposing to explore when and how health technology assessment (HTA) methods can address them. We identified 20 drug-repurposing challenges across the categories of data access, research and development, collaboration, business case, regulatory and legal challenges. Early incorporation of HTA methods, including literature review, empirical research, stakeholder consultation, health economic evaluation and uncertainty assessment, can help to address these challenges. HTA methods canassess the value proposition of repurposed drugs, inform further research and ultimately help to bring cost-effective repurposed drugs to patients.

The role of economic evaluations in advancing HIV multipurpose prevention technologies in early-stage development

Product development is a high-risk undertaking, especially so when investments are prioritized for low- and middle-income countries (LMICs) where markets may be smaller, fragile, and resource-constrained. New HIV prevention technologies, such as the dapivirine vaginal ring (DVR) and long-acting injectable cabotegravir (CAB-LA), are being introduced to these markets with one indication, meeting different needs of groups such as adolescent girls and young women (AGYW) and female sex workers (FSWs) in settings with high HIV burden. However, limited supply and demand have made their uptake a challenge. Economic evaluations conducted before Phase III trials can help optimize the potential public health value proposition of products in early-stage research and development (R&D), targeting investments in the development pathway that result in products likely to be available and taken up. Public investors in the HIV prevention pipeline, in particular those focused on innovative presentations such as multipurpose prevention technologies (MPTs), can leverage early economic evaluations to understand the intrinsic uncertainty in market characterization. In this perspective piece, we reflect on the role of economic evaluations in early product development and on methodological considerations that are central to these analyses. We also discuss methods, in quantitative and qualitative research that can be deployed in early economic evaluations to address uncertainty, with examples applied to the development of future technologies for HIV prevention and MPTs.

Economic evaluations in medical technological innovations a mapping review of methodologies

RATIONALE

Economic evaluations play an important role in the development and implementation of healthcare innovations. For pharmaceutical products, the methodologies used are laid down in guidelines, whereas for medical technologies the guidelines are not as strenuous. The aim of this review was therefore to analyze what types of methodologies are used in economic evaluations of medical technologies.

METHODS

We performed a mapping review to identify economic evaluations for medical technologies. We decided to limit our search to one year (2022) and included cost utility and cost effectiveness analyses in which health technologies were evaluated. For each included study we identified the main methodological characteristics.

RESULTS

A total of 364 papers were included in the analysis, 268 (74%) contained cost-utility analyses and 91 (25%) cost-effectiveness analyses. A model was used in 236 (64%) analyses, 117 analyses were trial based evaluations. Probabilistic sensitivity analyses and/or bootstrapping was performed in 266 (73%) analyses. Deterministic sensitivity analyses were used in 306 (84%). Time horizon and perspective were underreported in 15-25% of the included studies.

CONCLUSIONS

This review shows the wide range of methodologies used in economic evaluations as well as the extent and rigor in which these methodologies are used. Many of the included papers did no use or did not sufficiently report the use of appropriate standard methods. This may lead to research waste, a delay in successful implementation of valuable innovations and in the end may delay improvement patient outcomes.

Development and validation of Medical Device Key Evidence Tool ('MeDKET'): An evidence-based framework to explain success in selected European and US companies

Innovating in Medical Device (MD) industry is challenging. This study aims to develop and validate an evidence-based framework that helps innovators of small and large enterprises (SEs and LEs) assess their readiness for successful MD development and deployment. We conducted a key-informant process (stage 1) where 25 international experts identified a list of emergent Health Technology Assessment (HTA) themes they believed were essential to company success. A sample of 22 European and US selected companies (13 SEs and 9 LEs) then reached a consensus on a list of key themes through a robust Delphi process (stage 2). Finally, we constructed (stage 3) and validated (stage 4) the checklist for SEs and LEs. The checklist for SEs and LEs included 21 and 15 items (i.e., fundamental Yes/No questions) with nine overlapping criteria for both SEs and LEs. In both groups, MD success was driven by three major item categories: (i) R&D assessment strategy; (ii) device-outcome measures; (iii) company profiling. Alongside the retrospective validation study, we collected 40 case studies on MDs (23 successes and 17 failures) across the selected enterprises. The retrospective validation provided the proportion of successful and failed case studies that met the 'MeDKET' criteria. We discovered that early HTA plays a pivotal role in MD industry success with different implications based on enterprise size. This study is the first of its kind to provide a holistic picture of the perceived role of early-stage HTA in MD industry success.

Frameworks for Health Technology Assessment at an Early Stage of Product Development: A Review and Roadmap to Guide Applications

OBJECTIVES

Early health technology assessment (eHTA) can be used to evaluate and optimize a medical product's value proposition and to inform go/no-go decisions by using health economic modeling, literature scanning, and stakeholder preference studies at an early stage of development. eHTA frameworks offer high-level guidance on conducting this complex, iterative, and multidisciplinary process. The objective of this study was to review and summarize existing eHTA frameworks, understood as systematic approaches to guide early evidence generation and decision making.

METHODS

Using a rapid review methodology, we identified all relevant studies published in English, French, and Spanish from PubMed/MEDLINE and Embase until February 2022. We only included frameworks relevant to the preclinical and early clinical (phase I) stages of medical product development.

RESULTS

From 737 reviewed abstracts, 53 publications describing 46 frameworks were selected for inclusion and classified into categories based on their scope: (1) criteria frameworks, which provide an overview of eHTA; (2) process frameworks, which offer stepwise guidance for conducting eHTA, including preferred methods; and (3) methods frameworks, which provide detailed descriptions of specific eHTA methods. Most of the frameworks did not specify their target users or the specific stage of technology development.

CONCLUSIONS

Despite some variability and gaps found across existing frameworks, the structure provided by this review helps inform eHTA applications. Remaining challenges are the frameworks' limited accessibility to users without a background in health economics, poor distinctions being made among early lifecycle stages and technology types, and the inconsistent terminology used to describe eHTA in different contexts.

Headroom Analysis for Early Economic Evaluation: A Systematic Review

OBJECTIVES

The headroom analysis is an early economic evaluation that quantifies the highest price at which an intervention may still be cost effective. Currently, there is no comprehensive review on how it is applied. This study investigated the application of the headroom analysis, specifically (1) how the headroom analysis is framed (2) the analytical approach and sources of evidence used, and (3) how expert judgement is used and reported.

METHODS

A systematic search was conducted in PubMed, Embase, Web of Science, EconLit, and Google Scholar on 28 April 2022. Studies were eligible if they reported an application of the headroom analysis. Data were presented in tabular form and summarised descriptively.

RESULTS

We identified 42 relevant papers. The headroom analysis was applied to medicines (29%), diagnostic or screening tests (29%), procedures, programmes and systems (21%), medical devices (19%), and a combined test and device (2%). All studies used model-based analyses, with 40% using simple models and 60% using more comprehensive models. Thirty-three percent of the studies assumed perfect effectiveness of the health technology, while 67% adopted realistic assumptions. Ten percent of the studies calculated an effectiveness-seeking headroom instead of a cost-seeking headroom. Expert judgement was used in 71% of the studies; 23 studies (55%) used expert opinion, 6 studies (14%) used expert elicitation, and 1 study (2%) used both.

CONCLUSIONS

Because the application of the headroom analysis varies considerably, we recommend its appropriate use and clear reporting of analytical approaches, level of evidence available, and the use of expert judgement.

Decision-analytic modeling for early health technology assessment of medical devices - a scoping review

Objective

The goal of this review was to identify decision-analytic modeling studies in early health technology assessments (HTA) of high-risk medical devices, published over the last three years, and to provide a systematic overview of model purposes and characteristics. Additionally, the aim was to describe recent developments in modeling techniques.

Methods

For this scoping review, we performed a systematic literature search in PubMed and Embase including studies published in English or German. The search code consisted of terms describing early health technology assessment and terms for decision-analytic models. In abstract and full-text screening, studies were excluded that were not modeling studies for a high-risk medical device or an in-vitro diagnostic test. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was used to report on the search and exclusion of studies. For all included studies, study purpose, framework and model characteristics were extracted and reported in systematic evidence tables and a narrative summary.

Results

Out of 206 identified studies, 19 studies were included in the review. Studies were either conducted for hypothetical devices or for existing devices after they were already available on the market. No study extrapolated technical data from early development stages to estimate potential value of devices in development. All studies except one included cost as an outcome. Two studies were budget impact analyses. Most studies aimed at adoption and reimbursement decisions. The majority of studies were on in-vitro diagnostic tests for personalized and targeted medicine. A timed automata model, to our knowledge a model type new to HTA, was tested by one study. It describes the agents in a clinical pathway in separate models and, by allowing for interaction between the models, can reflect complex individual clinical pathways and dynamic system interactions. Not all sources of uncertainty for in-vitro tests were explicitly modeled. Elicitation of expert knowledge and judgement was used for substitution of missing empirical data. Analysis of uncertainty was the most valuable strength of decision-analytic models in early HTA, but no model applied sensitivity analysis to optimize the test positivity cutoff with regard to the benefit-harm balance or cost-effectiveness. Value-of-information analysis was rarely performed. No information was found on the use of causal inference methods for estimation of effect parameters from observational data.

Conclusion

Our review provides an overview of the purposes and model characteristics of nineteen recent early evaluation studies on medical devices. The review shows the growing importance of personalized interventions and confirms previously published recommendations for careful modeling of uncertainties surrounding diagnostic devices and for increased use of value-of-information analysis. Timed automata may be a model type worth exploring further in HTA. In addition, we recommend to extend the application of sensitivity analysis to optimize positivity criteria for in-vitro tests with regard to benefit-harm or cost-effectiveness. We emphasize the importance of causal inference methods when estimating effect parameters from observational data.

Engaging Patients and Caregivers in an Early Health Economic Evaluation: Discerning Treatment Value Based on Lived Experience

BACKGROUND

Traditionally, economic evaluations have engaged clinicians and policymakers; however, patients and their caregivers have insight that can ensure that the economic evaluation process appropriately reflects disease consequences and adequately addresses their priorities related to treatment.

OBJECTIVE

We aimed to identify patient priorities to inform an early economic evaluation of chimeric antigen receptor T-cell therapy for adults with relapsed or refractory B-cell acute lymphoblastic leukemia.

METHODS

We conducted two online group discussions of four participants each, involving patients with experience of hematological cancer and a caregiver. We used an adapted version of the nominal group technique, a consensus-building discussion approach, to generate focused qualitative data.

RESULTS

Patients and a caregiver acknowledged both the costs directly related to clinical care, such as the out-of-pocket cost of drugs, and the indirect treatment costs, such as the cost of transport, accommodation, and food. The emotional and physical toll of treatment and the influence of treatment on employment and education were additional costs emphasized by participants. Treatment benefits prioritized by participants included the efficacy of treatment, manageable side effects, improved quality of life, accessibility of treatment, and short treatment duration.

CONCLUSIONS

Engaging patients and caregivers in an early economic evaluation could help identify additional costs and benefits of therapies that are not typically recognized in economic evaluations but have the potential to increase the commercial viability of novel therapies. This research also demonstrates how patients and caregivers can be engaged at different levels in the development of early economic evaluation models.

An approach to quantify parameter uncertainty in early assessment of novel health technologies

Health economic modeling of novel technology at the early stages of a product lifecycle has been used to identify technologies that are likely to be cost-effective. Such early assessments are challenging due to the potentially limited amount of data. Modelers typically conduct uncertainty analyses to evaluate their effect on decision-relevant outcomes. Current approaches, however, are limited in their scope of application and imposes an unverifiable assumption, that is, uncertainty can be precisely represented by a probability distribution. In the absence of reliable data, an approach that uses the fewest number of assumptions is desirable. This study introduces a generalized approach for quantifying parameter uncertainty, that is, probability bound analysis (PBA), that does not require a precise specification of a probability distribution in the context of early-stage health economic modeling. We introduce the concept of a probability box (p-box) as a measure of uncertainty without necessitating a precise probability distribution. We provide formulas for a p-box given data on summary statistics of a parameter. We describe an approach to propagate p-boxes into a model and provide step-by-step guidance on how to implement PBA. We conduct a case and examine the differences between the status-quo and PBA approaches and their potential implications on decision-making.

The implementation of a noninvasive lymph node staging (NILS) preoperative prediction model is cost effective in primary breast cancer

Purpose

The need for sentinel lymph node biopsy (SLNB) in clinically node-negative (cN0) patients is currently questioned. Our objective was to investigate the cost-effectiveness of a preoperative noninvasive lymph node staging (NILS) model (an artificial neural network model) for predicting pathological nodal status in patients with cN0 breast cancer (BC).

Methods

A health-economic decision-analytic model was developed to evaluate the utility of the NILS model in reducing the proportion of cN0 patients with low predicted risk undergoing SLNB. The model used information from a national registry and published studies, and three sensitivity/specificity scenarios of the NILS model were evaluated. Subgroup analysis explored the outcomes of breast-conserving surgery (BCS) or mastectomy. The results are presented as cost (€) and quality-adjusted life years (QALYs) per 1000 patients.

Results

All three scenarios of the NILS model reduced total costs (–€93,244 to –€398,941 per 1000 patients). The overall health benefit allowing for the impact of SLNB complications was a net health gain (7.0–26.9 QALYs per 1000 patients). Sensitivity analyses disregarding reduced quality of life from lymphedema showed a small loss in total health benefits (0.4–4.0 QALYs per 1000 patients) because of the reduction in total life years (0.6–6.5 life years per 1000 patients) after reduced adjuvant treatment. Subgroup analyses showed greater cost reductions and QALY gains in patients undergoing BCS.

Conclusion

Implementing the NILS model to identify patients with low risk for nodal metastases was associated with substantial cost reductions and likely overall health gains, especially in patients undergoing BCS.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10549-022-06636-x.

Methods for Early Assessment of the Societal Value of Health Technologies: A Scoping Review and Proposal for Classification

OBJECTIVES

Early assessments of health technologies help to better align and integrate their development and assessment. Such assessments can take many forms and serve different purposes, hampering users in their selection of the most appropriate method for a specific goal. The aim of this scoping review was to structure the large set of methods according to their specific goal.

METHODS

A scoping review was conducted using PubMed and reference lists of retrieved articles, to identify review studies with a methodological focus. From the included reviews, all individual methods were listed. Based on additional literature and examples, we extracted the specific goal of each method. All goals were clustered to derive a set of subclasses and methods were grouped into these subclasses.

RESULTS

Of the 404 screened, 5 reviews were included, and 1 was added when searching reference lists. The reviews described 56 methods, of which 43 (77%) were included and classified as methods to (1) explore the nature and magnitude of the problem, (2) estimate the nature and magnitude of the expected (societal) value, (3) identify conditions for the potential value to materialize, and (4) help develop and design the type of research that is needed.

CONCLUSIONS

The wide range of methods for exploring the societal value of health technologies at an early stage of development can be subdivided into a limited number of classes, distinguishing methods according to their specific objective. This facilitates selection of appropriate methods, depending on the specific needs and aims.

Early Health Economic Modeling of Novel Therapeutics in Age-Related Hearing Loss

Background

Health systems face challenges to accelerate access to innovations that add value and avoid those unlikely to do so. This is very timely to the field of age-related sensorineural hearing loss (ARHL), where a significant unmet market need has been identified and sizeable investments made to promote the development of novel hearing therapeutics (NT). This study aims to apply health economic modeling to inform the development of cost-effective NT.

Methods

We developed a decision-analytic model to assess the potential costs and effects of using regenerative NT in patients ≥50 with ARHL. This was compared to the current standard of care including hearing aids and cochlear implants. Input data was collected from systematic literature searches and expert opinion. A UK NHS healthcare perspective was adopted. Three different but related analyses were performed using probabilistic modeling: (1) headroom analysis, (2) scenario analyses, and (3) threshold analyses.

Results

The headroom analysis shows an incremental net monetary benefit (iNMB) of £20,017[£11,299–£28,737] compared to the standard of care due to quality-adjusted life-years (QALY) gains and cost savings. Higher therapeutic efficacy and access for patients with all degrees of hearing loss yields higher iNMBs. Threshold analyses shows that the ceiling price of the therapeutic increases with more severe degrees of hearing loss.

Conclusion

NT for ARHL are potentially cost-effective under current willingness-to-pay (WTP) thresholds with considerable room for improvement in the current standard of care pathway. Our model can be used to help decision makers decide which therapeutics represent value for money and are worth commissioning, thereby paving the way for urgently needed NT.

A toolkit of methods of development-focused health technology assessment

Health technology assessment conducted to inform decisions during technology development (development-focused or DF-HTA) has a number of distinct features compared with HTA conducted to inform reimbursement and usage decisions. In particular, there are a broad range of decisions to be informed related to the development of a technology; multiple markets and decision makers to be considered; a limited (and developing) evidence base; and constrained resources for analysis. These features impact upon methods adopted by analysts. In this paper, we (i) set out methods of DF-HTA against a timeline of technology development; (ii) provide examples of the methods’ use; and (iii) explain how they have been adapted as a result of the features of DF-HTA. We present a toolkit of methods for analysts working with developers of medical technologies. Three categories of methods are described: literature review, stakeholder consultation, and decision analytic modeling. Literature review and stakeholder consultation are often used to fill evidence gaps. Decision analytic modeling is used to synthesize available evidence alongside plausible assumptions to inform developers about price or performance requirements. Methods increase in formality and complexity as the development and evidence base progresses and more resources are available for assessment. We hope this toolkit will be used in conjunction with the framework of features of DF-HTA presented in our earlier article in order to improve the clarity and appropriateness of methods of HTA used in DF-HTA. We also seek to contribute to a continuing dialogue about the nature of, and the best approach to, DF-HTA.

Stakeholder engagement in economic evaluation: Protocol for using the nominal group technique to elicit patient, healthcare provider, and health system stakeholder input in the development of an early economic evaluation model of chimeric antigen receptor T-cell therapy

INTRODUCTION

Chimeric antigen receptor T-cell (CAR-T) therapy is a class of immunotherapy. An economic evaluation conducted at an early stage of development of CAR-T therapy for treatment of adult relapsed or refractory acute lymphoblastic leukaemia could provide insight into factors contributing to the cost of treatment, the potential clinical benefits, and what the health system can afford. Traditionally, stakeholders are engaged in certain parts of health technology assessment processes, such as in the identification and selection of technologies, formulation of recommendations, and implementation of recommendations; however, little is known about processes for stakeholder engagement during the conduct of the assessment. This is especially the case for economic evaluations. Stakeholders, such as clinicians, policy-makers, patients, and their support networks, have insight into factors that can enhance the validity of an economic evaluation model. This research outlines a specific methodology for stakeholder engagement and represents an avenue to enhance health economic evaluations and support the use of these models to inform decision making for resource allocation. This protocol may inform a tailored framework for stakeholder engagement processes in future economic evaluation model development.

METHODS AND ANALYSIS

We will involve clinicians, healthcare researchers, payers, and policy-makers, as well as patients and their support networks in the conduct and verification of an early economic evaluation of a novel health technology to incorporate stakeholder-generated knowledge. Three stakeholder-specific focus groups will be conducted using an online adaptation of the nominal group technique to elicit considerations from each. This study will use CAR-T therapy for adults with relapsed or refractory B-cell acute lymphoblastic leukaemia as a basis for investigating broader stakeholder engagement processes.

ETHICS AND DISSEMINATION

This study received ethics approval from the Ottawa Hospital Research Institute Research Ethics Board (REB 20200320-01HT) and the results will be shared via conference presentations, peer-reviewed publications, and ongoing stakeholder engagement.

Early health technology assessment using the MAFEIP tool. A case study on a wearable device for fall prediction in elderly patients

By using a case-study on a fall-prediction device for elderly patients with orthostatic hypotension we aim to demonstrate how the MAFEIP tool, developed as part of the European Innovation Programme on Active and Healthy Ageing (EIP on AHA), can be used to inform manufacturers on their product development based on a cost-effectiveness criterion. Secondly, we critically appraise the tool and suggest further improvements that may be needed for a larger-scale adoption of MAFEIP within and beside the EIP on AHA initiative. The model was implemented using the MAFEIP tool. Within the tool one way sensitivity analyses were performed to assess the robustness of the model against the relative effectiveness of the fall-prevention device at different price levels. The MAFEIP tool was applied to a novel fall-prediction device and used to estimate the expected cost-effectiveness and perform threshold analysis. In our case study, the device produced estimated gains of 0.035 QALYs per patient and incremental costs of £ 518 (incremental cost-effectiveness ratio £14,719). Based on the one-way sensitivity analysis, the maximum achievable price at a willingness to pay threshold of £20,000 per QALY is estimated close to £900. The MAFEIP allows to quickly create early economic models, and to explore model uncertainty by performing deterministic sensitivity analysis for single parameters. However, the integration within the MAFEIP of common analytical tools such as probabilistic sensitivity analysis and Value of information would greatly contribute to its relevance for evaluating innovative technologies within and beside the EIP on AHA initiative.

The Value of a New Diagnostic Test for Prostate Cancer: A Cost-Utility Analysis in Early Stage of Development

BACKGROUND

Standard biopsy for prostate cancer diagnosis is an unpleasant and sometimes painful procedure with a detection rate as low as around 50%. Consequently, an accurate blood-based test would be highly desirable to improve the predictive accuracy. However, the clinical value of a new blood test for diagnosing prostate cancer depends on its sensitivity and specificity, in relation to the selected target population.

OBJECTIVE

The aim of this analysis was to investigate the health-economic value of introducing a new and more accurate diagnostic blood-based test to identify men in need of a biopsy to diagnose prostate cancer.

METHOD

We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths. The analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region Skåne (population of 1.3 million). A 90% sensitivity and specificity of the new test was assumed.

RESULTS

Among 31,250 men, age 50-69 years, 16.4% had a PSA between 3.0 and 9.9 µg/L and 28.9% a PSA of 2.0-9.9 µg/L. Testing men with PSA 3.0-9.9 µg/L, as in current clinical practice, decreased the number of biopsies by 3595, detected 61 more cancers, resulting in and two more fatalities and subsequently a loss of 14 QALYs. Cost offsets could justify a test value of SEK 4996. Testing a larger population, PSA 2.0-9.9 µg/L prevented 6 deaths, added 50 QALYs, and could justify a value of the test of SEK 5165, given a value of health of SEK 500,000 per QALY.

CONCLUSION

A new blood-based test for prostate cancer has a significant potential to reduce the number of biopsies needed, resulting in reduced health care costs and improve patient care.

Early economic evaluation to guide the development of a spectroscopic liquid biopsy for the detection of brain cancer

OBJECTIVES

An early economic evaluation to inform the translation into clinical practice of a spectroscopic liquid biopsy for the detection of brain cancer. Two specific aims are (1) to update an existing economic model with results from a prospective study of diagnostic accuracy and (2) to explore the potential of brain tumor-type predictions to affect patient outcomes and healthcare costs.

METHODS

A cost-effectiveness analysis from a UK NHS perspective of the use of spectroscopic liquid biopsy in primary and secondary care settings, as well as a cost-consequence analysis of the addition of tumor-type predictions was conducted. Decision tree models were constructed to represent simplified diagnostic pathways. Test diagnostic accuracy parameters were based on a prospective validation study. Four price points (GBP 50-200, EUR 57-228) for the test were considered.

RESULTS

In both settings, the use of liquid biopsy produced QALY gains. In primary care, at test costs below GBP 100 (EUR 114), testing was cost saving. At GBP 100 (EUR 114) per test, the ICER was GBP 13,279 (EUR 15,145), whereas at GBP 200 (EUR 228), the ICER was GBP 78,300 (EUR 89,301). In secondary care, the ICER ranged from GBP 11,360 (EUR 12,956) to GBP 43,870 (EUR 50,034) across the range of test costs.

CONCLUSIONS

The results demonstrate the potential for the technology to be cost-effective in both primary and secondary care settings. Additional studies of test use in routine primary care practice are needed to resolve the remaining issues of uncertainty-prevalence in this patient population and referral behavior.

Linked Pharmacometric-Pharmacoeconomic Modeling and Simulation in Clinical Drug Development

Market access and pricing of pharmaceuticals are increasingly contingent on the ability to demonstrate comparative effectiveness and cost-effectiveness. As such, it is widely recognized that predictions of the economic potential of drug candidates in development could inform decisions across the product life cycle. This may be challenging when safety and efficacy profiles in terms of the relevant clinical outcomes are unknown or highly uncertain early in product development. Linking pharmacometrics and pharmacoeconomics, such that outputs from pharmacometric models serve as inputs to pharmacoeconomic models, may provide a framework for extrapolating from early-phase studies to predict economic outcomes and characterize decision uncertainty. This article reviews the published studies that have implemented this methodology and used simulation to inform drug development decisions and/or to optimize the use of drug treatments. Some of the key practical issues involved in linking pharmacometrics and pharmacoeconomics, including the choice of final outcome measures, methods of incorporating evidence on comparator treatments, approaches to handling multiple intermediate end points, approaches to quantifying uncertainty, and issues of model validation are also discussed. Finally, we have considered the potential barriers that may have limited the adoption of this methodology and suggest that closer alignment between the disciplines of clinical pharmacology, pharmacometrics, and pharmacoeconomics, may help to realize the potential benefits associated with linked pharmacometric-pharmacoeconomic modeling and simulation.

Behavioural activation therapy for post-stroke depression: the BEADS feasibility RCT

BACKGROUND

There is currently insufficient evidence for the clinical effectiveness and cost-effectiveness of psychological therapies for post-stroke depression.

OBJECTIVE

To evaluate the feasibility of undertaking a definitive trial to evaluate the clinical effectiveness and cost-effectiveness of behavioural activation (BA) compared with usual stroke care for treating post-stroke depression.

DESIGN

Parallel-group, feasibility, multicentre, randomised controlled trial with nested qualitative research and a health economic evaluation.

SETTING

Acute and community stroke services in three sites in England.

PARTICIPANTS

Community-dwelling adults 3 months to 5 years post stroke who are depressed, as determined by the Patient Health Questionnaire-9 (PHQ-9) or the Visual Analogue Mood Scales 'Sad' item. Exclusions: patients who are blind and/or deaf, have dementia, are unable to communicate in English, do not have mental capacity to consent, are receiving treatment for depression at the time of stroke onset or are currently receiving psychological intervention.

RANDOMISATION AND BLINDING

Participants were randomised (1 : 1 ratio) to BA or usual stroke care. Randomisation was conducted using a computer-generated list with random permuted blocks of varying sizes, stratified by site. Participants and therapists were aware of the allocation, but outcome assessors were blind.

INTERVENTIONS

The intervention arm received up to 15 sessions of BA over 4 months. BA aims to improve mood by increasing people's level of enjoyable or valued activities. The control arm received usual care only.

MAIN OUTCOME MEASURES

Primary feasibility outcomes concerned feasibility of recruitment to the main trial, acceptability of research procedures and measures, appropriateness of baseline and outcome measures, retention of participants and potential value of conducting the definitive trial. Secondary feasibility outcomes concerned the delivery of the intervention. The primary clinical outcome 6 months post randomisation was the PHQ-9. Secondary clinical outcomes were Stroke Aphasic Depression Questionnaire - Hospital version, Nottingham Leisure Questionnaire, Nottingham Extended Activities of Daily Living, Carer Strain Index, EuroQol-5 Dimensions, five-level version and health-care resource use questionnaire.

RESULTS

Forty-eight participants were recruited in 27 centre-months of recruitment, at a recruitment rate of 1.8 participants per centre per month. The 25 participants randomised to receive BA attended a mean of 8.5 therapy sessions [standard deviation (SD) 4.4 therapy sessions]; 23 participants were allocated to usual care. Outcome assessments were completed by 39 (81%) participants (BA, n = 18; usual care, n = 21). Mean PHQ-9 scores at 6-month follow-up were 10.1 points (SD 6.9 points) and 14.4 points (SD 5.1 points) in the BA and control groups, respectively, a difference of -3.8 (95% confidence interval -6.9 to -0.6) after adjusting for baseline PHQ-9 score and centre, representing a reduction in depression in the BA arm. Therapy was delivered as intended. BA was acceptable to participants, carers and therapists. Value-of-information analysis indicates that the benefits of conducting a definitive trial would be likely to outweigh the costs. It is estimated that a sample size of between 580 and 623 participants would be needed for a definitive trial.

LIMITATIONS

Target recruitment was not achieved, although we identified methods to improve recruitment.

CONCLUSIONS

The Behavioural Activation Therapy for Depression after Stroke trial was feasible with regard to the majority of outcomes. The outstanding issue is whether or not a sufficient number of participants could be recruited within a reasonable time frame for a definitive trial. Future work is required to identify whether or not there are sufficient sites that are able to deliver the services required for a definitive trial.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN12715175.

FUNDING

This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 23, No. 47. See the NIHR Journals Library website for further project information.

Incorporating Pharmacometrics into Pharmacoeconomic Models: Applications from Drug Development

Pharmacometrics is the science of quantifying the relationship between the pharmacokinetics and pharmacodynamics of drugs in combination with disease models and trial information to aid in drug development and dosing optimization for clinical practice. Considering the variability in the dose-concentration-effect relationship of drugs, an opportunity exists in linking pharmacokinetic and pharmacodynamic model-based estimates with pharmacoeconomic models. This link may provide early estimates of the cost effectiveness of drug therapies, thus informing late-stage drug development, pricing, and reimbursement decisions. Published case studies have demonstrated how integrated pharmacokinetic-pharmacodynamic-pharmacoeconomic models can complement traditional pharmacoeconomic analyses by identifying the impact of specific patient sub-groups, dose, dosing schedules, and adherence on the cost effectiveness of drugs, thus providing a mechanistic basis to predict the economic value of new drugs. Greater collaboration between the pharmacoeconomics and pharmacometrics community can enable methodological improvements in pharmacokinetic-pharmacodynamic-pharmacoeconomic models to support drug development.

A different animal? Identifying the features of health technology assessment for developers of medical technologies

Health technology assessment (HTA) conducted to inform developers of health technologies (development-focused HTA, DF-HTA) has a number of distinct features when compared to HTA conducted to inform usage decisions (use-focused HTA). To conduct effective DF-HTA, it is important that analysts are aware of its distinct features as analyses are often not published. We set out a framework of ten features, drawn from the literature and our own experience: a target audience of developers and investors; an underlying user objective to maximize return on investment; a broad range of decisions to inform; wide decision space; reduced evidence available; earlier timing of analysis; fluid business model; constrained resources for analysis; a positive stance of analysis; and a "consumer"-specific burden of proof. This paper presents a framework of ten features of DF-HTA intended to initiate debate as well as provide an introduction for analysts unfamiliar with the field.

The Lean and Agile Multi-dimensional Process (LAMP) - a new framework for rapid and iterative evidence generation to support health-care technology design and development

Introduction: Health technology assessments (HTA) are tools for policymaking and resource allocation. Early HTAs are increasingly used in design and development of new technologies. Conducting early HTAs is challenging, due to a lack of evidence and significant uncertainties in the technology and the market. A multi-disciplinary approach is considered essential. However, an operational framework that can enable the integration of multi-dimensional evidence into commercialization remains lacking.Areas covered: We developed the Lean and Agile Multi-dimensional Process (LAMP), an early HTA framework, for embedding commercial decision-making in structured evidence generation activities, divided into phases. Diverse evidence in unmet needs, user acceptance, cost-effectiveness, and market competitiveness are being generated in increasing depth. This supports the emergence of design and value propositions that align technology capabilities and clinical and user needs.Expert opinion: We have been applying LAMP to working with medical device and diagnostic industry in the UK. The framework can be adapted to suit different technologies, decision needs, time scales, and resources. LAMP offers a practical solution to the multi-disciplinary approach. Methodologists drive the process by performing evidence generation and synthesis as and by enabling interactions between manufacturers, designers, clinicians, and other key stakeholders.

Complexity Stage Model of the Medical Device Development Based on Economic Evaluation—MedDee

The development of a new product is essential for the progress and success of any company. The medical device market is very specific, which is challenging. Therefore, this paper assesses an economic model for medical device evaluation using the economic, health, technology regulatory, and present market knowledge to enable the cost–time conception for any applicant. The purpose of this study is to propose a comprehensive stage model of the medical device development to subsequently describe the financial expenditure of the entire development process. The identification of critical steps was based on the literature review, and analysis, and a comparison of the available medical device development stages and directives. Furthermore, a preliminary assessment of the medical device development steps and procedures on the basis of the interviews was performed. Six interviews were conducted with an average duration of one hour, focusing on areas: relevance and level of detail of the medical device development stages, involvement of economic methods, and applicability of the proposed model. Subsequently, the improvement and modification of the medical device investment process, based on respondents’ responses, were conducted. The authors have proposed the complexity model MedDee—Medical Devices Development by Economic Evaluation. This model is comprised of six phases: initiation, concept, design, production, final verification, and market disposition in which the economic methods are incorporated.

Defining the clinician's role in early health technology assessment during medical device innovation - a systematic review

Background

Early Health Technology Assessment (EHTA) is an evolving field in health policy which aims to provide decision support and mitigate risk during early medical device innovation. The clinician is a key stakeholder in this process and their role has traditionally been confined to assessing device efficacy and safety alone. There is however, no data exploring their role in this process and how they can contribute towards it. This motivated us to carry out a systematic review to delineate the role of the clinician in EHTA as per the PRISMA guidelines.

Methods

A systematic search of peer reviewed literature was undertaken across PUBMED, OVID Medline and Web of science up till June 2018. Studies that were suitable for inclusion focused on clinician input in health technology assessment or early medical device innovation. A qualitative approach was utilised to generate themes on how clinicians could contribute in general and specific areas of EHTA. Data was manually extracted by the authors and themes were agreed in consensus using a grounded theory framework. The specific stages included: All stages of EHTA, Basic research on mechanisms, Targeting for specific product, Proof of principle and Prototype and product development. Bias was assessed utilising the NICE Qualitative checklist.

Results

A total of 33 articles met the inclusion criteria for the review. Areas identified in which the clinicians could contribute to EHTA included: i) needs driven problem solving, ii) conformity assessment of MDs, iii) economic evaluation of MDs and iv) addressing the conflicts in interest. For clinicians’ input across the various specific areas of EHTA, an innovation framework was generated based on the subthemes extracted.

Conclusions

The following review has identified the various segments in which clinicians can contribute to EHTA to inform stakeholders and has also proposed an innovation framework.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4305-9) contains supplementary material, which is available to authorized users.

Early assessment of innovation in a healthcare setting

OBJECTIVES

Early assessment can assist in allocating resources for innovation effectively and produce the most beneficial technology for an institution. The aim of the present study was to identify methods and discuss the analytical approaches applied for the early assessment of innovation in a healthcare setting.

METHODS

Knowledge synthesis based on a structured search (using the MEDLINE, Embase, and Cochrane databases) and thematic analysis was conducted. An analytical framework based on the stage of innovation (developmental, introduction, or early diffusion) was applied to assess whether methods vary according to stage. Themes (type of innovation, study, analysis, study design, method, and main target audience) were then decided among the authors. Identified methods and analysis were discussed according to the innovation stage.

RESULTS

A total of 1,064 articles matched the search strategy. Overall, thirty-nine articles matched the inclusion criteria. The use of methods has a tendency to change according to the stage of innovation. Stakeholder analysis was a prominent method in the innovation stages and particularly in the developmental stage, as the introduction and early diffusion stage has more availability of data and may apply more complex methods. Barriers to the identified methods were also discussed as all of the innovation stages suffered from lack of data and substantial uncertainty.

CONCLUSIONS

Although this review has identified applicable approaches for early assessment in different innovation stages, research is required regarding the value of the available data and methods and tools to enhance interactions between different parties at different stages of innovation.

Economic Evaluation of Stem Cell Therapies in Neurological Diseases: A Systematic Review

OBJECTIVES

To examine economic evaluation studies of stem cell therapies (SCTs) in neurological disorders and to provide an overview of the quality of the economic evidence available on this topic.

METHODS

The review examined studies that performed an economic evaluation of the use of stem cells in adult patients with neurological diseases and that were published in English during the period 2007 to 2017. Data analyzed and reported included study population, disease indication, main analytical approaches for the economic analysis and perspective, key assumptions made or tested in sensitivity analyses, cost outcomes, estimates of incremental cost effectiveness, and approaches to quantifying decision uncertainty.

RESULTS

A total of three studies reporting on the findings of the economic evaluation of the use of SCT in stroke, Parkinson disease, and secondary progressive multiple sclerosis, respectively, were identified. All three studies conducted a cost-utility analysis using decision-analytic models and reported an incremental cost per quality-adjusted life-years gained (incremental cost-effectiveness ratio) versus standard care. These studies reported meaningful cost savings in stroke, Parkinson disease, and secondary progressive multiple sclerosis in the base-case scenarios.

CONCLUSIONS

Despite significant progress in clinical research in the use of SCT in neurological diseases, economic evaluation of these therapies is still at a nascent stage. Given the early stage of research inputs (clinical and cost outcomes data) into the models per se, further research is urgently needed to enable meaningful assessment of the cost effectiveness of these advanced therapies and to ensure sustainable access for population groups most likely to benefit in clinical practice.

A qualitative exploration of early assessment of innovative medical technologies

Background

Hospitals increasingly make decisions about early development of and investment in innovative medical technologies (IMTs), but at present often without an early assessment of their potential to ensure selection of the most promising candidates for further development. This paper explores how early assessment is carried out in different health organisations and then discusses relevant learning points for hospitals.

Methods

A qualitative study design with a structured interview guide covering four themes was used. Content analyses of interview notes were performed covering four predetermined themes: context, basis for decision-making, process and structure, and perceptions. A fifth theme, handling cognitive bias, was identified during data analysis.

Results

A total of 11 organisations participated; eight from the private health industry and three public hospitals. The interviews identified four areas in which early assessment is performed in similar manner across the studied organisations and four areas where differences exist between public hospitals and private organisations. Public hospitals indicate a lower degree of formalised early assessment and less satisfaction with how early assessment is performed, compared to private organisations. Based on the above findings, two learning points may carry promise for hospitals. First, having dedicated prioritising committees for IMTs making stop/go decisions. This committee is separate from the IMT development processes and involved staff. Secondly, the committee should base decisions on a transparent early assessment decision-support tool, which include a broad set of domains, is iterative, describes uncertainty, and minimise cognitive biases.

Conclusions

Similarities and differences in the way early assessment is done in different health organisations were identified. These findings suggest promising learning points for the development of an early assessment model for hospitals.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3647-z) contains supplementary material, which is available to authorized users.

Innovation at the Intersection of Clinical Trials and Real-World Data Science to Advance Patient Care

While efficacy and safety data collected from randomized clinical trials are the evidentiary standard for determining market authorization, this alone may no longer be sufficient to address the needs of key stakeholders (regulators, providers, and payers) and guarantee long-term success of pharmaceutical products. There is a heightened interest from stakeholders on understanding the use of real-world evidence (RWE) to substantiate benefit-risk assessment and support the value of a new drug. This review provides an overview of real-world data (RWD) and related advances in the regulatory framework, and discusses their impact on clinical research and development. A framework for linking drug development decisions with the value proposition of the drug, utilizing pharmacokinetic-pharmacodynamic-pharmacoeconomic models, is introduced. The summary presented here is based on the presentations and discussion at the symposium entitled Innovation at the Intersection of Clinical Trials and Real-World Data to Advance Patient Care at the American Society for Clinical Pharmacology and Therapeutics (ASCPT) 2017 Annual Meeting.

Cell-based therapy for the treatment of female stress urinary incontinence: an early cost-effectiveness analysis

AIM

To perform an early cost-effectiveness analysis of in vitro expanded myoblasts (IVM) and minced myofibers versus midurethral slings (MUS) for surgical treatment of female stress urinary incontinence.

METHODS

Cost-effectiveness and sensitivity analyses were performed using a decision tree comprising previously published data and expert opinions.

RESULTS & CONCLUSION

In the base case scenario, MUS was the cost-effective strategy with a negative incremental cost-effectiveness ratio compared with IVM and a positive incremental cost-effectiveness ratio compared with minced myofibers. However, the sensitivity analysis indicates that IVM may become an alternative providing greater effect at a higher cost. With the possibility of becoming more effective, IVM treatment would be advantageous over MUS given its reduced invasiveness and lower risks of complications.

Economic evaluation of medical tests at the early phases of development: a systematic review of empirical studies

INTRODUCTION

There is little specific guidance on the implementation of cost-effectiveness modelling at the early stage of test development. The aim of this study was to review the literature in this field to examine the methodologies and tools that have been employed to date.

AREAS COVERED

A systematic review to identify relevant studies in established literature databases. Five studies were identified and included for narrative synthesis. These studies revealed that there is no consistent approach in this growing field. The perspective of patients and the potential for value of information (VOI) to provide information on the value of future research is often overlooked. Test accuracy is an essential consideration, with most studies having described and included all possible test results in their analysis, and conducted extensive sensitivity analyses on important parameters. Headroom analysis was considered in some instances but at the early development stage (not the concept stage).

EXPERT COMMENTARY

The techniques available to modellers that can demonstrate the value of conducting further research and product development (i.e. VOI analysis, headroom analysis) should be better utilized. There is the need for concerted efforts to develop rigorous methodology in this growing field to maximize the value and quality of such analysis.

Emerging Use of Early Health Technology Assessment in Medical Product Development: A Scoping Review of the Literature

Early health technology assessment is increasingly being used to support health economic evidence development during early stages of clinical research. Such early models can be used to inform research and development about the design and management of new medical technologies to mitigate the risks, perceived by industry and the public sector, associated with market access and reimbursement. Over the past 25 years it has been suggested that health economic evaluation in the early stages may benefit the development and diffusion of medical products. Early health technology assessment has been suggested in the context of iterative economic evaluation alongside phase I and II clinical research to inform clinical trial design, market access, and pricing. In addition, performing early health technology assessment was also proposed at an even earlier stage for managing technology portfolios. This scoping review suggests a generally accepted definition of early health technology assessment to be "all methods used to inform industry and other stakeholders about the potential value of new medical products in development, including methods to quantify and manage uncertainty". The present review also aimed to identify recent published empirical studies employing an early-stage assessment of a medical product. With most included studies carried out to support a market launch, the dominant methodology was early health economic modeling. Further methodological development is required, in particular, by combining systems engineering and health economics to manage uncertainty in medical product portfolios.

Review of Economic Submissions to NICE Medical Technologies Evaluation Programme

The economic evaluation of medical devices is increasingly used to inform decision making on adopting new or novel technologies; however, challenges are inevitable due to the unique characteristics of devices. Cost-consequence analyses are recommended and employed by the English National Institute for Health and Care Excellence (NICE) Medical Technologies Evaluation Programme (MTEP) to help address these challenges. The aim of this work was to review the critiques raised for previous MTEP submissions and explore if there were common problems across submissions. We reviewed a sample of 12 economic submissions to MTEP representing 50 % of 24 sets of guidance issued to July 2015. For each submission, we reviewed the External Assessment Centre's (EAC) report and the guidance document produced by NICE. We identified the main problems raised by the EAC's assessments and the committee's considerations for each submission, and explored strategies for improvement. We found that the identification and measurement of costs and consequences are the main shortcomings within economic submissions to MTEP. Together, these shortcomings accounted for 42 % of criticisms by the EACs among the reviewed submissions. In certain circumstances problems with these shortcomings may be unavoidable, for example, if there is a limited evidence base for the device being appraised. Nevertheless, strategies can often be adopted to improve submissions, including the use of more appropriate time horizons, whilst cost and resource use information should be taken, where possible, from nationally representative sources.

THE EARLY BIRD CATCHES THE WORM: EARLY COST-EFFECTIVENESS ANALYSIS OF NEW MEDICAL TESTS

Objectives:There is little specific guidance on performing an early cost-effectiveness analysis (CEA) of medical tests. We developed a framework with general steps and applied it to two cases.

Methods:Step 1 is to narrow down the scope of analysis by defining the test's application, target population, outcome measures, and investigating current test strategies and test strategies if the new test were available. Step 2 is to collect evidence on the current test strategy. Step 3 is to develop a conceptual model of the current and new test strategies. Step 4 is to conduct the early-CEA by evaluating the potential (cost-)effectiveness of the new test in clinical practice. Step 5 involves a decision about the further development of the test.

Results:The first case illustrated the impact of varying the test performance on the headroom (maximum possible price) of an add-on test for patients with an intermediate-risk of having rheumatoid arthritis. Analyses showed that the headroom is particularly dependent on test performance. The second case estimated the minimum performance of a confirmatory imaging test to predict individual stroke risk. Different combinations of sensitivity and specificity were found to be cost-effective; if these combinations are attainable, the medical test developer can feel more confident about the value of further development of the test.

Conclusions:A well-designed early-CEA methodology can improve the ability to develop (cost-)effective medical tests in an efficient manner. Early-CEAs should continuously integrate insights and evidence that arise through feedback, which may convince developers to return to earlier steps.

HEADROOM APPROACH TO DEVICE DEVELOPMENT: CURRENT AND FUTURE DIRECTIONS

OBJECTIVES

The headroom approach to medical device development relies on the estimation of a value-based price ceiling at different stages of the development cycle. Such price-ceilings delineate the commercial opportunities for new products in many healthcare systems. We apply a simple model to obtain critical business information as the product proceeds along a development pathway, and indicate some future directions for the development of the approach.

METHODS

Health economic modelling in the supply-side development cycle for new products.

RESULTS

The headroom can be used: initially as a 'reality check' on the viability of the device in the healthcare market; to support product development decisions using a real options approach; and to contribute to a pricing policy which respects uncertainties in the reimbursement outlook.

CONCLUSIONS

The headroom provides a unifying thread for business decisions along the development cycle for a new product. Over the course of the cycle attitudes to uncertainty will evolve, based on the timing and manner in which new information accrues. Within this framework the developmental value of new information can justify the costs of clinical trials and other evidence-gathering activities. Headroom can function as a simple shared tool to parties in commercial negotiations around individual products or groups of products. The development of similar approaches in other contexts holds promise for more rational planning of service provision.

A review of the economic tools for assessing new medical devices

Whereas the economic evaluation of pharmaceuticals is an established practice within international health technology assessment (HTA) and is often produced with the support of comprehensive methodological guidance, the equivalent procedure for medical devices is less developed. Medical devices, including diagnostic products, are a rapidly growing market in healthcare, with over 10,000 medical technology patent applications filed in Europe in 2012-nearly double the number filed for pharmaceuticals. This increase in the market place, in combination with the limited, or constricting, budgets that healthcare decision makers face, has led to a greater level of examination with respect to the economic evaluation of medical devices. However, methodological questions that arise due to the unique characteristics of medical devices have yet to be addressed fully. This review of journal publications and HTA guidance identified these characteristics and the challenges they may subsequently pose from an economic evaluation perspective. These unique features of devices can be grouped into four categories: (1) data quality issues; (2) learning curve; (3) measuring long-term outcomes from diagnostic devices; and (4) wider impact from organisational change. We review the current evaluation toolbox available to researchers and explore potential future approaches to improve the economic evaluation of medical devices.

Early economic evaluation of emerging health technologies: protocol of a systematic review

BACKGROUND

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice.

METHODS/DESIGN

This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status.

DISCUSSION

This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.

Medical devices early assessment methods: systematic literature review

OBJECTIVES

The aim of this study was to get an overview of current theory and practice in early assessments of medical devices, and to identify aims and uses of early assessment methods used in practice.

METHODS

A systematic literature review was conducted in September 2013, using computerized databases (PubMed, Science Direct, and Scopus), and references list search. Selected articles were categorized based on their type, objective, and main target audience. The methods used in the application studies were extracted and mapped throughout the early stages of development and for their particular aims.

RESULTS

Of 1,961 articles identified, eighty-three studies passed the inclusion criteria, and thirty were included by searching reference lists. There were thirty-one theoretical papers, and eighty-two application papers included. Most studies investigated potential applications/possible improvement of medical devices, developed early assessment framework or included stakeholder perspective in early development stages. Among multiple qualitative and quantitative methods identified, only few were used more than once. The methods aim to inform strategic considerations (e.g., literature review), economic evaluation (e.g., cost-effectiveness analysis), and clinical effectiveness (e.g., clinical trials). Medical devices were often in the prototype product development stage, and the results were usually aimed at informing manufacturers.

CONCLUSIONS

This study showed converging aims yet widely diverging methods for early assessment during medical device development. For early assessment to become an integral part of activities in the development of medical devices, methods need to be clarified and standardized, and the aims and value of assessment itself must be demonstrated to the main stakeholders for assuring effective and efficient medical device development.

COST-UTILITY OF SELF-MANAGED COMPUTER THERAPY FOR PEOPLE WITH APHASIA

Objectives: The aim of this study was to examine the potential cost-effectiveness of self-managed computer therapy for people with long-standing aphasia post stroke and to estimate the value of further research.

Methods: The incremental cost-effectiveness ratio of computer therapy in addition to usual stimulation compared with usual stimulation alone was considered in people with long-standing aphasia using data from the CACTUS trial. A model-based approach was taken. Where possible the input parameters required for the model were obtained from the CACTUS trial data, a United Kingdom-based pilot randomized controlled trial that recruited thirty-four people with aphasia and randomized them to computer treatment or usual care. Cost-effectiveness was described using an incremental cost-effectiveness ratio (ICER) together with cost-effectiveness acceptability curves. A value of information analysis was undertaken to inform future research priorities.

Results: The intervention had an ICER of £3,058 compared with usual care. The likelihood of the intervention being cost-effective was 75.8 percent at a cost-effectiveness threshold of £20,000 per QALY gained. The expected value of perfect information was £37 million.

Conclusions: Our results suggest that computer therapy for people with long-standing aphasia is likely to represent a cost-effective use of resources. However, our analysis is exploratory given the small size of the trial it is based upon and therefore our results are uncertain. Further research would be of high value, particularly with respect to the quality of life gain achieved by people who respond well to therapy.

Early evaluation and value-based pricing of regenerative medicine technologies

Since the first pioneering scientists explored the potential of using human cells for therapeutic purposes the branch of regenerative medicine has evolved to become a mature industry. The focus has switched from ‘what can be done‘ to ‘what can be commercialized‘. Timely health economic evaluation supports successful marketing by establishing the value of a product from a healthcare system perspective. This article reports results from a research project on early health economic evaluation in collaboration with developers, clinicians and manufacturers. We present an approach to determine an early value-based price for a new treatment of cartilage defects of the knee from the area of regenerative medicine. Examples of using evaluation results for the purpose of business planning, market entry, preparing the coverage decision and managed entry are discussed.

Challenges in the development and reimbursement of personalized medicine-payer and manufacturer perspectives and implications for health economics and outcomes research: a report of the ISPOR personalized medicine special interest group

BACKGROUND

Personalized medicine technologies can improve individual health by delivering the right dose of the right drug to the right patient at the right time but create challenges in deciding which technologies offer sufficient value to justify widespread diffusion. Personalized medicine technologies, however, do not neatly fit into existing health technology assessment and reimbursement processes.

OBJECTIVES

In this article, the Personalized Medicine Special Interest Group of the International Society for Pharmacoeconomics and Outcomes Research evaluated key development and reimbursement considerations from the payer and manufacturer perspectives.

METHODS

Five key areas in which health economics and outcomes research best practices could be developed to improve value assessment, reimbursement, and patient access decisions for personalized medicine have been identified.

RESULTS

These areas are as follows: 1 research prioritization and early value assessment, 2 best practices for clinical evidence development, 3 best practices for health economic assessment, 4 addressing health technology assessment challenges, and 5 new incentive and reimbursement approaches for personalized medicine.

CONCLUSIONS

Key gaps in health economics and outcomes research best practices, decision standards, and value assessment processes are also discussed, along with next steps for evolving health economics and outcomes research practices in personalized medicine.

Pharmacoeconomics

Pharmacoeconomics is an essential component of health technology assessment and the appraisal of medicines for use by UK National Health Service (NHS) patients. As a comparatively young discipline, its methods continue to evolve. Priority research areas for development include methods for synthesizing indirect comparisons when head-to-head trials have not been performed, synthesizing qualitative evidence (for example, stakeholder views), addressing the limitations of the EQ-5D tool for assessing quality of life, including benefits not captured in quality-adjusted life years (QALYs), ways of assessing valuation methods (for determining utility scores), extrapolation of costs and benefits beyond those observed in trials, early estimation of cost-effectiveness (including mechanism-based economic evaluation), methods for incorporating the impact of non-adherence and the role of behavioural economics in influencing patients and prescribers.

Mechanism-based approach to the economic evaluation of pharmaceuticals: pharmacokinetic/pharmacodynamic/pharmacoeconomic analysis of rituximab for follicular lymphoma

BACKGROUND AND OBJECTIVES

Economic value is an important consideration during all phases of the drug development process. We previously published an article in PharmacoEconomics in which we described a mechanism-based economic modelling approach that incorporates data obtained during phase II clinical studies on the relationships between dose, exposure and response. We now describe case studies of rituximab for the treatment of follicular non-Hodgkin's lymphoma based on this methodology.

METHODS

We utilized a population pharmacokinetic and pharmacodynamic model linking serum rituximab concentration to progression-free survival, to simulate the effectiveness of rituximab in various clinical contexts. These served as inputs to economic models of follicular lymphoma, based on National Institute for Health and Clinical Excellence (NICE) appraisals, to assess the cost effectiveness of rituximab. Our results were compared with trial-based estimates from the NICE appraisals. In a further analysis, we simulated the results of an ongoing trial to generate predictions of cost effectiveness.

RESULTS

Our analyses suggest an acceptable degree of concordance between simulation- and trial-based estimates of cost effectiveness. For first-line and maintenance therapy, deviations of £2,099 and £1,355 per QALY, respectively, from trial-based incremental cost-effectiveness ratio estimates of £8,290 and £7,721 per QALY gained would not affect reimbursement decisions. The probability of rituximab-containing regimens being cost effective at £20,000 and £30,000 per QALY thresholds was 1 for both first-line and maintenance therapy in both simulated and trial-based analyses.

CONCLUSIONS

Our analyses demonstrate the feasibility of mechanism-based economic analyses, which may have applications during drug development to the following: (i) directing future research based on the cost of reducing uncertainty; (ii) assessing subgroups, dosing schedules and protocol deviations; and (iii) informing strategic research and development and pricing decisions.

Early assessment of medical technologies to inform product development and market access: a review of methods and applications

Worldwide, billions of dollars are invested in medical product development and there is an increasing pressure to maximize the revenues of these investments. That is, governments need to be informed about the benefits of spending public resources, companies need more information to manage their product development portfolios and even universities may need to direct their research programmes in order to maximize societal benefits. Assuming that all medical products need to be adopted by the heavily regulated healthcare market at one point in time, it is worthwhile to look at the logic behind healthcare decision making, specifically, decisions on the coverage of medical products and decisions on the use of these products under competing and uncertain conditions. With the growing tension between leveraging economic growth through R&D spending on the one hand and stricter control of healthcare budgets on the other, several attempts have been made to apply the health technology assessment (HTA) methodology to earlier stages of technology development and implementation. For instance, horizon scanning was introduced to systematically assess emerging technologies in order to inform health policy. Others have introduced iterative economic evaluation, e.g. economic evaluations in earlier stages of clinical research. However, most of these methods are primarily intended to support governments in making decisions regarding potentially expensive new medical products. They do not really inform biomedical product developers on the probability of return on investment, nor do they inform about the market needs and specific requirements of technologies in development. It is precisely this aspect that increasingly receives attention, i.e. is it possible to use HTA tools and methods to inform biomedical product development and to anticipate further development and market access. Several methods have been used in previous decades, but have never been compiled in a comprehensive review. The main objective of this article was to provide an overview of previous work and methods in the field of early HTA, and to put these approaches in perspective through a conceptual framework introduced in this paper. A particular goal of the review was to familiarize decision makers with available techniques that can be employed in early-stage decision making, and to identify opportunities for further methodological growth in this emerging field of HTA.

Early-stage valuation of medical devices: the role of developmental uncertainty

BACKGROUND

At the concept stage, many uncertainties surround the commercial viability of a new medical device. These include the ultimate functionality of the device, the cost of producing it and whether, and at what price, it can be sold to a health-care provider (HCP). Simple assessments of value can be made by estimating such unknowns, but the levels of uncertainty may mean that their operational value for investment decisions is unclear. However, many decisions taken at the concept stage are reversible and will be reconsidered later before the product is brought to market. This flexibility can be exploited to enhance early-stage valuations.

OBJECTIVES

To develop a framework for valuing a new medical device at the concept stage that balances benefit to the HCP against commercial costs. This is done within a simplified stage-gated model of the development cycle for new products. The approach is intended to complement existing proposals for the evaluation of the commercial headroom available to new medical products.

CONCLUSIONS

A model based on two decision gates can lead to lower bounds (underestimates) for product value that can serve to support a decision to develop the product. Quantifiable uncertainty that can be resolved before the device is brought to market will generally enhance early-stage valuations of the device, and this remains true even when some components of uncertainty cannot be fully described. Clinical trials and other evidence-gathering activities undertaken as part of the development process can contribute to early-stage estimates of value.

Clearing up the hazy road from bench to bedside: a framework for integrating the fourth hurdle into translational medicine

BACKGROUND

New products evolving from research and development can only be translated to medical practice on a large scale if they are reimbursed by third-party payers. Yet the decision processes regarding reimbursement are highly complex and internationally heterogeneous. This study develops a process-oriented framework for monitoring these so-called fourth hurdle procedures in the context of product development from bench to bedside. The framework is suitable both for new drugs and other medical technologies.

METHODS

The study is based on expert interviews and literature searches, as well as an analysis of 47 websites of coverage decision-makers in England, Germany and the USA.

RESULTS

Eight key steps for monitoring fourth hurdle procedures from a company perspective were determined: entering the scope of a healthcare payer; trigger of decision process; assessment; appraisal; setting level of reimbursement; establishing rules for service provision; formal and informal participation; and publication of the decision and supplementary information. Details are given for the English National Institute for Health and Clinical Excellence, the German Federal Joint Committee, Medicare's National and Local Coverage Determinations, and for Blue Cross Blue Shield companies.

CONCLUSION

Coverage determination decisions for new procedures tend to be less formalized than for novel drugs. The analysis of coverage procedures and requirements shows that the proof of patient benefit is essential. Cost-effectiveness is likely to gain importance in future.