Clearing up the hazy road from bench to bedside: a framework for integrating the fourth hurdle into translational medicine

Frameworks for Health Technology Assessment at an Early Stage of Product Development: A Review and Roadmap to Guide Applications

OBJECTIVES

Early health technology assessment (eHTA) can be used to evaluate and optimize a medical product's value proposition and to inform go/no-go decisions by using health economic modeling, literature scanning, and stakeholder preference studies at an early stage of development. eHTA frameworks offer high-level guidance on conducting this complex, iterative, and multidisciplinary process. The objective of this study was to review and summarize existing eHTA frameworks, understood as systematic approaches to guide early evidence generation and decision making.

METHODS

Using a rapid review methodology, we identified all relevant studies published in English, French, and Spanish from PubMed/MEDLINE and Embase until February 2022. We only included frameworks relevant to the preclinical and early clinical (phase I) stages of medical product development.

RESULTS

From 737 reviewed abstracts, 53 publications describing 46 frameworks were selected for inclusion and classified into categories based on their scope: (1) criteria frameworks, which provide an overview of eHTA; (2) process frameworks, which offer stepwise guidance for conducting eHTA, including preferred methods; and (3) methods frameworks, which provide detailed descriptions of specific eHTA methods. Most of the frameworks did not specify their target users or the specific stage of technology development.

CONCLUSIONS

Despite some variability and gaps found across existing frameworks, the structure provided by this review helps inform eHTA applications. Remaining challenges are the frameworks' limited accessibility to users without a background in health economics, poor distinctions being made among early lifecycle stages and technology types, and the inconsistent terminology used to describe eHTA in different contexts.

[The molecular tumor board]

BACKGROUND

New diagnostic tools in the field of oncology that became available with introduction of the next generation sequencing call for adjustments in the current clinical workflow. To ensure correct interpretation, newly collected data need to be processed and categorized properly. Thus, current experts in oncology need to be trained and new experts from other fields need to be recruited.

OBJECTIVES

The molecular tumor board was introduced to bring experts from various specialties together. The goal is to discuss and assess complex oncological cases in the context of new molecular diagnostics and give recommendations regarding individualized therapy.

RESULTS

After the introduction of the molecular tumor board 2 years ago, the number of cases processed within the molecular tumor board has increased steadily. Of these patients, 70% exhibit molecular alterations that are relevant to therapy. Preliminary results indicate positive responses to the applied therapies and clear improvements in the progression-free and overall survival of patients who would have been considered "untreatable" in the classical clinical setting.

CONCLUSION

The introduction of new molecular diagnostics makes the establishment of advanced clinical structures mandatory. In this regard, the molecular tumor board continues to gain in importance. Preliminary results point towards a significant impact on the therapy of advanced malignancies. The advancements in sequencing and newly established insights into the interpretation of sequencing results will lead to new therapeutic routes. Inevitably, this will make the molecular tumor board indispensable in the future.

Early economic evaluation to guide the development of a spectroscopic liquid biopsy for the detection of brain cancer

OBJECTIVES

An early economic evaluation to inform the translation into clinical practice of a spectroscopic liquid biopsy for the detection of brain cancer. Two specific aims are (1) to update an existing economic model with results from a prospective study of diagnostic accuracy and (2) to explore the potential of brain tumor-type predictions to affect patient outcomes and healthcare costs.

METHODS

A cost-effectiveness analysis from a UK NHS perspective of the use of spectroscopic liquid biopsy in primary and secondary care settings, as well as a cost-consequence analysis of the addition of tumor-type predictions was conducted. Decision tree models were constructed to represent simplified diagnostic pathways. Test diagnostic accuracy parameters were based on a prospective validation study. Four price points (GBP 50-200, EUR 57-228) for the test were considered.

RESULTS

In both settings, the use of liquid biopsy produced QALY gains. In primary care, at test costs below GBP 100 (EUR 114), testing was cost saving. At GBP 100 (EUR 114) per test, the ICER was GBP 13,279 (EUR 15,145), whereas at GBP 200 (EUR 228), the ICER was GBP 78,300 (EUR 89,301). In secondary care, the ICER ranged from GBP 11,360 (EUR 12,956) to GBP 43,870 (EUR 50,034) across the range of test costs.

CONCLUSIONS

The results demonstrate the potential for the technology to be cost-effective in both primary and secondary care settings. Additional studies of test use in routine primary care practice are needed to resolve the remaining issues of uncertainty-prevalence in this patient population and referral behavior.

Evaluation as institution: a contractarian argument for needs-based economic evaluation

BACKGROUND

There is a gap between health economic evaluation methods and the value judgments of coverage decision makers, at least in Germany. Measuring preference satisfaction has been claimed to be inappropriate for allocating health care resources, e.g. because it disregards medical need. The existing methods oriented at medical need have been claimed to disregard non-consequentialist fairness concerns. The aim of this article is to propose a new, contractarian argument for justifying needs-based economic evaluation. It is based on consent rather than maximization of some impersonal unit of value to accommodate the fairness concerns.

MAIN TEXT

This conceptual paper draws upon contractarian ethics and constitution economics to show how economic evaluation can be viewed as an institution to overcome societal conflicts in the allocation of scarce health care resources. For this, the problem of allocating scarce health care resources in a society is reconstructed as a social dilemma. Both disadvantaged patients and affluent healthy individuals can be argued to share interests in a societal contract to provide technologies which ameliorate medical need, based on progressive funding. The use of needs-based economic evaluation methods for coverage determination can be interpreted as institutions for conflict resolution as far as they use consented criteria to ensure the social contract's sustainability and avoid implicit rationing or unaffordable contribution rates. This justifies the use of needs-based evaluation methods by Pareto-superiority and consent (rather than by some needs-based value function per se).

CONCLUSION

The view of economic evaluation presented here may help account for fairness concerns in the further development of evaluation methods. This is because it directs the attention away from determining some unit of value to be maximized towards determining those persons who are most likely not to consent and meeting their concerns. Following this direction in methods development is likely to increase the acceptability of health economic evaluation by decision makers.

The economic case for precision medicine

Introduction: The advancement of precision medicine into routine clinical practice has been highlighted as an agenda for national and international health care policy. A principle barrier to this advancement is in meeting requirements of the payer or reimbursement agency for health care. This special report aims to explain the economic case for precision medicine, by accounting for the explicit objectives defined by decision-makers responsible for the allocation of limited health care resources. Areas covered: The framework of cost-effectiveness analysis, a method of economic evaluation, is used to describe how precision medicine can, in theory, exploit identifiable patient-level heterogeneity to improve population health outcomes and the relative cost-effectiveness of health care. Four case studies are used to illustrate potential challenges when demonstrating the economic case for a precision medicine in practice. Expert commentary: The economic case for a precision medicine should be considered at an early stage during its research and development phase. Clinical and economic evidence can be generated iteratively and should be in alignment with the objectives and requirements of decision-makers. Programmes of further research, to demonstrate the economic case of a precision medicine, can be prioritized by the extent that they reduce the uncertainty expressed by decision-makers.

Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries

BACKGROUND

Although health technology assessment (HTA) systems base their decision making process either on economic evaluations or comparative clinical benefit assessment, a central aim of recent approaches to value measurement, including value based assessment and pricing, points towards the incorporation of supplementary evidence and criteria that capture additional dimensions of value.

OBJECTIVE

To study the practices, processes and policies of value-assessment for new medicines across eight European countries and the role of HTA beyond economic evaluation and clinical benefit assessment.

METHODS

A systematic (peer review and grey) literature review was conducted using an analytical framework examining: (1) 'Responsibilities and structure of HTA agencies'; (2) 'Evidence and evaluation criteria considered in HTAs'; (3) 'Methods and techniques applied in HTAs'; and (4) 'Outcomes and implementation of HTAs'. Study countries were France, Germany, England, Sweden, Italy, Netherlands, Poland and Spain. Evidence from the literature was validated and updated through two rounds of feedback involving primary data collection from national experts.

RESULTS

All countries assess similar types of evidence; however, the specific criteria/endpoints used, their level of provision and requirement, and the way they are incorporated (e.g. explicitly vs. implicitly) varies across countries, with their relative importance remaining generally unknown. Incorporation of additional 'social value judgements' (beyond clinical benefit assessment) and economic evaluation could help explain heterogeneity in coverage recommendations and decision-making.

CONCLUSION

More comprehensive and systematic assessment procedures characterised by increased transparency, in terms of selection of evaluation criteria, their importance and intensity of use, could lead to more rational evidence-based decision-making, possibly improving efficiency in resource allocation, while also raising public confidence and fairness.

Healthcare quality and medicine reimbursement criteria in Iran

Purpose

This study aims to measure the quality of services provided to elderly people at the most crowded governmental ambulatory clinics of Tehran Province using the SERVQUAL scale (Study 1). Moreover, the research indicates the medicine reimbursement criteria to inform the decision-makers of public health insurance organizations using the Borda method (Study 2).

Design/methodology/approach

This study was done as a cross-sectional research on 425 elderly patients who came to the clinics during 2014 and 2015. Finally, using the paired t-test, Friedman test, Borda method, SPSS, Matlab software and Delphi method, the collected data were analysed.

Findings

Regarding the perceived quality, the services assurance dimension was ranked as having the highest quality (4.48) and the accessibility dimension as the lowest one (3.22). Based on the Borda method, the most important criterion for the Iranian health insurance companies to accept a medicine in their reimbursement list is the “life-threatening conditions” factor. On the other hand, “evidence quality” is accounted as the fifth important factor.

Research limitations/implications

The main limitation was the senility of participants that makes it difficult for understanding and completing the questionnaires.

Practical implications

The results can be useful for healthcare policy makers and related authorities. Besides, public health insurers can use the findings for decision-making about the elderly diseases and the problems such as the medical expenses.

Originality/value

The present research has been done in a two-year time frame, and it is more recent than other related studies. Thus, the results are far more authentic and applicable.

Sustainability in Health care by Allocating Resources Effectively (SHARE) 9: conceptualising disinvestment in the local healthcare setting

BACKGROUND

This is the ninth in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. The disinvestment literature has broadened considerably over the past decade; however there is a significant gap regarding systematic, integrated, organisation-wide approaches. This debate paper presents a discussion of the conceptual aspects of disinvestment from the local perspective.

DISCUSSION

Four themes are discussed: Terminology and concepts, Motivation and purpose, Relationships with other healthcare improvement paradigms, and Challenges to disinvestment. There are multiple definitions for disinvestment, multiple concepts underpin the definitions and multiple alternative terms convey these concepts; some definitions overlap and some are mutually exclusive; and there are systematic discrepancies in use between the research and practice settings. Many authors suggest that the term 'disinvestment' should be avoided due to perceived negative connotations and propose that the concept be considered alongside investment in the context of all resource allocation decisions and approached from the perspective of optimising health care. This may provide motivation for change, reduce disincentives and avoid some of the ethical dilemmas inherent in other disinvestment approaches. The impetus and rationale for disinvestment activities are likely to affect all aspects of the process from identification and prioritisation through to implementation and evaluation but have not been widely discussed. A need for mechanisms, frameworks, methods and tools for disinvestment is reported. However there are several health improvement paradigms with mature frameworks and validated methods and tools that are widely-used and well-accepted in local health services that already undertake disinvestment-type activities and could be expanded and built upon. The nature of disinvestment brings some particular challenges for policy-makers, managers, health professionals and researchers. There is little evidence of successful implementation of 'disinvestment' projects in the local setting, however initiatives to remove or replace technologies and practices have been successfully achieved through evidence-based practice, quality and safety activities, and health service improvement programs.

CONCLUSIONS

These findings suggest that the construct of 'disinvestment' may be problematic at the local level. A new definition and two potential approaches to disinvestment are proposed to stimulate further research and discussion.

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders.

Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate.

Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities.

Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability.

From market access to patient access: overview of evidence-based approaches for the reimbursement and pricing of pharmaceuticals in 36 European countries

Background

Coverage decisions determining the benefit baskets of health systems have been increasingly relying on evidence regarding patient benefit and costs. Relevant structures, methodologies, and processes have especially been established for pharmaceuticals but approaches differ. The objective of this work was thus to identify institutions in a broad range of European countries (n = 36) in charge of determining the value of pharmaceuticals for pricing and reimbursement purposes and to map their decision-making process; to examine the different approaches and consider national and supranational possibilities for best practice.

Methods

Institutions were identified through websites of international networks, ministries, and published literature. Details on institutional practices were supplemented with information from institution websites and linked online sources.

Results

The type and extent of information available varied considerably across countries. Different types of public regulatory bodies are involved in pharmaceutical coverage decisions, assuming a range of responsibilities. As a rule, the assessment of scientific evidence is kept structurally separate from its appraisal. Recommendations on value are uniformly issued by specific committees within or commissioned by responsible institutions; these institutions often also act as decision-makers on reimbursement status and level or market price. While effectiveness and costs are important criteria in all countries, the latter are often considered on a case-by-case basis. In all countries, manufacturer applications, including relevant evidence, are used as one of the main sources of information for the assessment.

Conclusion

Transparency of evidence-based coverage decisions should be enhanced. International collaboration can facilitate knowledge exchange, improve efficiency of information production, and strengthen new or developing systems.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-015-0028-5) contains supplementary material, which is available to authorized users.

Health technology assessment of medical devices: a survey of non-European union agencies

Objectives: The aim of this study was to review and compare current health technology assessment (HTA) activities for medical devices across non-European Union HTA agencies.

Methods: HTA activities for medical devices were evaluated from three perspectives: organizational structure, processes, and methods. Agencies were primarily selected upon membership of existing HTA networks. The data collection was performed in two stages: stage 1–agency Web-site assessment using a standardized questionnaire, followed by review and validation of the collected data by a representative of the agency; and stage 2–semi-structured telephone interviews with key informants of a sub-sample of agencies.

Results: In total, thirty-six HTA agencies across twenty non-EU countries assessing medical devices were included. Twenty-seven of thirty-six (75 percent) agencies were judged at stage 1 to have adopted HTA-specific approaches for medical devices (MD-specific agencies) that were largely organizational or procedural. There appeared to be few differences in the organization, process and methods between MD-specific and non–MD-specific agencies. Although the majority (69 percent) of both categories of agency had specific methods guidance or policy for evidence submission, only one MD-specific agency had developed methodological guidelines specific to medical devices. In stage 2, many MD-specific agencies cited insufficient resources (budget, skilled employees), lack of coordination (between regulator and reimbursement bodies), and the inability to generalize findings from evidence synthesis to be key challenges in the HTA of medical devices.

Conclusions: The lack of evidence for differentiation in scientific methods for HTA of devices raises the question of whether HTA needs to develop new methods for medical devices but rather adapt existing methodological approaches. In contrast, organizational and/or procedural adaptation of existing HTA agency frameworks to accommodate medical devices appear relatively commonplace.

From translational research to open technology innovation systems

Purpose

– The purpose of this paper is to question whether the emphasis placed within translational research on a linear model of innovation provides the most effective model for managing health technology innovation. Several alternative perspectives are presented that have potential to enhance the existing model of translational research. A case study is presented of innovation of a clinical decision support system. The paper concludes from the case study that an extending the triple helix model of technology transfer, to one based on a quadruple helix, present a basis for improving the performance translational research.

Design/methodology/approach

– A case study approach is used to help understand development of an innovative technology within a teaching hospital. The case is then used to develop and refine a model of the health technology innovation system.

Findings

– The paper concludes from the case study that existing models of translational research could be refined further through the development of a quadruple helix model of heath technology innovation that encompasses greater emphasis on user-led and open innovation perspectives.

Research limitations/implications

– The paper presents several implications for future research based on the need to enhance the model of health technology innovation used to guide policy and practice.

Practical implications

– The quadruple helix model of innovation that is proposed can potentially guide alterations to the existing model of translational research in the healthcare sector. Several suggestions are made for how innovation activity can be better supported at both a policy and operational level.

Originality/value

– This paper presents a synthesis of the innovation literature applied to a theoretically important case of open innovation in the UK National Health Service. It draws in perspectives from other industrial sectors and applies them specifically to the management and organisation of innovation activities around health technology and the services in which they are embedded.

Concepts of 'personalization' in personalized medicine: implications for economic evaluation

CONTEXT

This study assesses if, and how, existing methods for economic evaluation are applicable to the evaluation of personalized medicine (PM) and, if not, where extension to methods may be required.

METHODS

A structured workshop was held with a predefined group of experts (n = 47), and was run using a modified nominal group technique. Workshop findings were recorded using extensive note taking, and summarized using thematic data analysis. The workshop was complemented by structured literature searches.

RESULTS

The key finding emerging from the workshop, using an economic perspective, was that two distinct, but linked, interpretations of the concept of PM exist (personalization by 'physiology' or 'preferences'). These interpretations involve specific challenges for the design and conduct of economic evaluations. Existing evaluative (extra-welfarist) frameworks were generally considered appropriate for evaluating PM. When 'personalization' is viewed as using physiological biomarkers, challenges include representing complex care pathways; representing spillover effects; meeting data requirements such as evidence on heterogeneity; and choosing appropriate time horizons for the value of further research in uncertainty analysis. When viewed as tailoring medicine to patient preferences, further work is needed regarding revealed preferences, e.g. treatment (non)adherence; stated preferences, e.g. risk interpretation and attitude; consideration of heterogeneity in preferences; and the appropriate framework (welfarism vs. extra-welfarism) to incorporate non-health benefits.

CONCLUSIONS

Ideally, economic evaluations should take account of both interpretations of PM and consider physiology and preferences. It is important for decision makers to be cognizant of the issues involved with the economic evaluation of PM to appropriately interpret the evidence and target future research funding.

Selecting the Acceptance Criteria of Medicines in the Reimbursement List of Public Health Insurance of Iran, Using the "Borda" Method: a Pilot Study

Decision-making for medicines to be accepted in Iran's public health insurance reimbursement list is a complex process and involves factors, which should be considered in applying a coverage for medicine costs. These processes and factors are not wholly assessed, while assessment of these factors is an essential need for getting a transparent and evidence-based approach toward medicine reimbursement in Iran. This paper aims to show an evidence-based approach toward medicine selection criteria to inform the medical reimbursement decision makers in Iranian health insurance organizations. To explore an adaptable decision-making framework while incorporating a method called "Borda" in medicine reimbursement assessment, we used the help of an expert group including decision makers and clinical researchers who are also policy makers to appraise the five chief criteria that have three sub criteria (Precision, Interpretability, and Cost). Also software "Math-lab"7, "SPSS" 17 and Excel 2007 were used in this study. "Borda" estimates the amount of perceived values from different criteria and creates a range from one to five while providing a comprehensive measurement of a large spectrum of criteria. Participants reported that the framework provided an efficient approach to systematic consideration in a pragmatic format consisting of many parts to guide decision-makings, including criteria and value (a model with the core of Borda) and evidences (medicine reimbursement based on criteria). The most important criterion for medicine acceptance in health insurance companies, in Iran, is the "life-threatening" factor and "evidence quality" is accounted as the fifth important factor. This pilot study showed the usefulness of incorporating Borda in medicine reimbursement decisions to support a transparent and systematic appraisal of health insurance companies' deeds. Further research is needed to advance Borda-based approaches that are effective on health insurance decision making.

Using needs-based frameworks for evaluating new technologies: an application to genetic tests

Given the multitude of newly available genetic tests in the face of limited healthcare budgets, the European Society of Human Genetics assessed how genetic services can be prioritized fairly. Using (health) benefit maximizing frameworks for this purpose has been criticized on the grounds that rather than maximization, fairness requires meeting claims (e.g. based on medical need) equitably. This study develops a prioritization score for genetic tests to facilitate equitable allocation based on need-based claims. It includes attributes representing health need associated with hereditary conditions (severity and progression), a genetic service's suitability to alleviate need (evidence of benefit and likelihood of positive result) and costs to meet the needs. A case study for measuring the attributes is provided and a suggestion is made how need-based claims can be quantified in a priority function. Attribute weights can be informed by data from discrete-choice experiments. Further work is needed to measure the attributes across the multitude of genetic tests and to determine appropriate weights. The priority score is most likely to be considered acceptable if developed within a decision process which meets criteria of procedural fairness and if the priority score is interpreted as "strength of recommendation" rather than a fixed cut-off value.

The role of health technology assessment bodies in shaping drug development

The use of health technology assessment (HTA) to inform policy-making is established in most developed countries. Compared to licensing agencies, HTA agencies have different interests and, therefore, different evidence requirements. Criteria for coverage or reimbursement decisions on pharmaceutical compounds vary; however, it is common to include, as part of the HTA, a comparative effectiveness evaluation. This type of clinical data might go beyond that required for market authorization, thus creating an additional evidence gap between the regulatory and the reimbursement submission. The relevance of submissions to HTA agencies is consistently increasing in a pharmaceutical company’s perspective, as market prospects are strongly influenced by third-party payers’ coverage. In this study, we aim to describe current HTA activities with a potential impact throughout the drug development process of pharmaceuticals, with a comparative emphasis on the systems in place in Italy and in the UK. Based on an extensive literature and website review, we identified three major classes of HTA activities, beyond mainstream HTA, with the potential to influence the drug development program: 1) horizon scanning and early HTA; 2) bipartite and tripartite early dialogue between manufacturers, regulators, and HTA assessors; and 3) managed market entry agreements. From early stages of clinical research up to postauthorization studies, there is a trend toward increased collaboration between parties, anticipation of market access evidence collection, and postmarketing risk-sharing. Heterogeneity of HTA practices increases the complexity of the market access environment. Overall, there are signals that market access departments are gaining importance in the pharmaceutical companies, but there is still a lack of evidence and reporting on how the increasing relevance of HTA has reshaped the way clinical development is designed and managed.

Points to consider for prioritizing clinical genetic testing services: a European consensus process oriented at accountability for reasonableness

Given the cost constraints of the European health-care systems, criteria are needed to decide which genetic services to fund from the public budgets, if not all can be covered. To ensure that high-priority services are available equitably within and across the European countries, a shared set of prioritization criteria would be desirable. A decision process following the accountability for reasonableness framework was undertaken, including a multidisciplinary EuroGentest/PPPC-ESHG workshop to develop shared prioritization criteria. Resources are currently too limited to fund all the beneficial genetic testing services available in the next decade. Ethically and economically reflected prioritization criteria are needed. Prioritization should be based on considerations of medical benefit, health need and costs. Medical benefit includes evidence of benefit in terms of clinical benefit, benefit of information for important life decisions, benefit for other people apart from the person tested and the patient-specific likelihood of being affected by the condition tested for. It may be subject to a finite time window. Health need includes the severity of the condition tested for and its progression at the time of testing. Further discussion and better evidence is needed before clearly defined recommendations can be made or a prioritization algorithm proposed. To our knowledge, this is the first time a clinical society has initiated a decision process about health-care prioritization on a European level, following the principles of accountability for reasonableness. We provide points to consider to stimulate this debate across the EU and to serve as a reference for improving patient management.

Funding decisions for newborn screening: a comparative review of 22 decision processes in Europe

Decision-makers need to make choices to improve public health. Population-based newborn screening (NBS) is considered as one strategy to prevent adverse health outcomes and address rare disease patients' needs. The aim of this study was to describe key characteristics of decisions for funding new NBS programmes in Europe. We analysed past decisions using a conceptual framework. It incorporates indicators that capture the steps of decision processes by health care payers. Based on an internet survey, we compared 22 decisions for which answers among two respondents were validated for each observation. The frequencies of indicators were calculated to elicit key characteristics. All decisions resulted in positive, mostly unrestricted funding. Stakeholder participation was diverse focusing on information provision or voting. Often, decisions were not fully transparent. Assessment of NBS technologies concentrated on expert opinion, literature review and rough cost estimates. Most important appraisal criteria were effectiveness (i.e., health gain from testing for the children being screened), disease severity and availability of treatments. Some common and diverging key characteristics were identified. Although no evidence of explicit healthcare rationing was found, processes may be improved in respect of transparency and scientific rigour of assessment.

Medical devices early assessment methods: systematic literature review

OBJECTIVES

The aim of this study was to get an overview of current theory and practice in early assessments of medical devices, and to identify aims and uses of early assessment methods used in practice.

METHODS

A systematic literature review was conducted in September 2013, using computerized databases (PubMed, Science Direct, and Scopus), and references list search. Selected articles were categorized based on their type, objective, and main target audience. The methods used in the application studies were extracted and mapped throughout the early stages of development and for their particular aims.

RESULTS

Of 1,961 articles identified, eighty-three studies passed the inclusion criteria, and thirty were included by searching reference lists. There were thirty-one theoretical papers, and eighty-two application papers included. Most studies investigated potential applications/possible improvement of medical devices, developed early assessment framework or included stakeholder perspective in early development stages. Among multiple qualitative and quantitative methods identified, only few were used more than once. The methods aim to inform strategic considerations (e.g., literature review), economic evaluation (e.g., cost-effectiveness analysis), and clinical effectiveness (e.g., clinical trials). Medical devices were often in the prototype product development stage, and the results were usually aimed at informing manufacturers.

CONCLUSIONS

This study showed converging aims yet widely diverging methods for early assessment during medical device development. For early assessment to become an integral part of activities in the development of medical devices, methods need to be clarified and standardized, and the aims and value of assessment itself must be demonstrated to the main stakeholders for assuring effective and efficient medical device development.

Criteria for fairly allocating scarce health-care resources to genetic tests: which matter most?

The use of genetic tests is expanding rapidly. Given limited health-care budgets throughout Europe and few national coverage decisions specifically for genetic tests, decisions about allocating scarce resources to genetic tests are frequently ad hoc and left to lower-level decision makers. This study assesses substantive ethical and economic criteria to prioritize genetic services in a reasonable and fair manner. Principles for allocating health-care resources can be classified into four categories: need-based allocation; maximizing total benefits; treating people equally; and promoting and rewarding social usefulness. In the face of scarcity, the degree of an individual's need for medical intervention is an important criterion. Also, different economic concepts of efficiency are of relevance in the theory and practice of prioritizing genetic tests. Equity concerns are most likely to be relevant in terms of avoiding undesirable inequities, which may also set boundaries to the use of efficiency as a prioritization criterion. The aim of promoting and rewarding social usefulness is unlikely to be relevant to the question of what priority a genetic test should have in clinical practice. Further work is needed to select an appropriate set of criteria; operationalize them; and assign weights before some kind of standardized priority information can be added to information sources for genetic services. Besides the substantive criteria, formal considerations like those pointed out in the framework of accountability for reasonableness need to be considered in decision making.

Early evaluation and value-based pricing of regenerative medicine technologies

Since the first pioneering scientists explored the potential of using human cells for therapeutic purposes the branch of regenerative medicine has evolved to become a mature industry. The focus has switched from ‘what can be done‘ to ‘what can be commercialized‘. Timely health economic evaluation supports successful marketing by establishing the value of a product from a healthcare system perspective. This article reports results from a research project on early health economic evaluation in collaboration with developers, clinicians and manufacturers. We present an approach to determine an early value-based price for a new treatment of cartilage defects of the knee from the area of regenerative medicine. Examples of using evaluation results for the purpose of business planning, market entry, preparing the coverage decision and managed entry are discussed.

Link between process and appraisal in coverage decisions: an analysis with structural equation modeling

BACKGROUND

To achieve fair-coverage decision making, both material criteria and criteria of procedural justice have been proposed. The relationship between these is still unclear.

OBJECTIVE

To analyze hypotheses underlying the assumption that more assessment, transparency, and participation have a positive impact on the reasonableness of coverage decisions.

METHODS

We developed a structural equation model in which the process components were considered latent constructs and operationalized by a set of observable indicators. The dependent variable "reasonableness" was defined by the relevance of clinical, economic, and other ethical criteria in technology appraisal (as opposed to appraisal based on stakeholder lobbying). We conducted an Internet survey among conference participants familiar with coverage decisions of third-party payers in industrialized countries between 2006 and 2011. Partial least squares path modeling (PLS-PM) was used, which allows analyzing small sample sizes without distributional assumptions. Data on 97 coverage decisions from 15 countries and 40 experts were used for model estimation.

RESULTS

Stakeholder participation (regression coefficient [RC] =0.289; P = 0.005) and scientific rigor of assessment (RC = 0.485; P < 0.001) had a significant influence on the construct of reasonableness. The path from transparency to reasonableness was not significant (RC = 0.289; P = 0.358). For the reasonableness construct, a considerable share of the variance was explained (R (2) = 0.44). Biases from missing data and nesting effects were assessed through sensitivity analyses. Limitations. The results are limited by a small sample size and the overrepresentation of some decision makers.

CONCLUSIONS

Rigorous assessment and intense stakeholder participation appeared effective in promoting reasonable decision making, whereas the influence of transparency was not significant. A sound evidence base seems most important as the degree of scientific rigor of assessment had the strongest effect.

Transparency vs. closed-door policy: do process characteristics have an impact on the outcomes of coverage decisions? A statistical analysis

The aim of this study was to analyze influences of process- and technology-related characteristics on the outcomes of coverage decisions. Using survey data on 77 decisions from 13 countries, we examined whether outcomes differ by 14 variables that describe components of decision-making processes and the technology. We analyzed the likelihood of committees covering a technology, i.e. positive (including partial coverage) vs. negative coverage decisions. We performed non-parametric univariate tests and binomial logistic regression with a stepwise variable selection procedure. We identified a negative association between a positive decision and whether the technology is a prescribed medicine (p=0.0097). Other significant influences on a positive decision outcome included one disease area (p=0.0311) and whether a technology was judged to be (cost-)effective (p<0.0001). The first estimation of the logistic regression yielded a quasi-complete separation for technologies that were clearly judged (cost-)effective. In uncertain decisions, a higher number of stakeholders involved in voting (odds ratio=2.52; p=0.03) increased the likelihood of a positive outcome. The results suggest that decisions followed the lines of evidence-based decision-making. Despite claims for transparent and participative decision-making, the phase of evidence generation seemed most critical as decision-makers usually adopted the assessment recommendations. We identified little impact of process configurations.

An economic theory of the fourth hurdle

Third party payers' decision processes for financing health technologies ('fourth hurdle' processes) are subject to intensive descriptive empirical investigation. This paper addresses the need for a theoretical foundation of this research and develops a theoretical framework for analysing fourth hurdle processes from an economics perspective. On the basis of a decision-analytic framework and the theory of agents, fourth hurdle processes are described as sets of institutions to maximize the value derived from finite healthcare resources. Benefits are assumed to arise from the value of better information about and better implementation of the most cost-effective choice. Implementation is improved by decreased information asymmetries and better alignment of incentives. This decreases the effects of ex ante and ex post moral hazard on service provision. Potential indicators of high benefit include high costs associated with wrong decisions and large population sizes affected by the decision. The framework may serve as a basis both for further theoretical work, for example, on the appropriate degree of participation as well as further empirical work, for example, on comparative assessments of fourth hurdle processes. It needs to be complemented by frameworks for analysing fourth hurdle institutions developed by other disciplines such as bioethics or law.

Eliciting preferences for priority setting in genetic testing: a pilot study comparing best-worst scaling and discrete-choice experiments

Given the increasing number of genetic tests available, decisions have to be made on how to allocate limited health-care resources to them. Different criteria have been proposed to guide priority setting. However, their relative importance is unclear. Discrete-choice experiments (DCEs) and best-worst scaling experiments (BWSs) are methods used to identify and weight various criteria that influence orders of priority. This study tests whether these preference eliciting techniques can be used for prioritising genetic tests and compares the empirical findings resulting from these two approaches. Pilot DCE and BWS questionnaires were developed for the same criteria: prevalence, severity, clinical utility, alternatives to genetic testing available, infrastructure for testing and care established, and urgency of care. Interview-style experiments were carried out among different genetics professionals (mainly clinical geneticists, researchers and biologists). A total of 31 respondents completed the DCE and 26 completed the BWS experiment. Weights for the levels of the six attributes were estimated by conditional logit models. Although the results derived from the DCE and BWS experiments differed in detail, we found similar valuation patterns in the DCE and BWS experiments. The respondents attached greatest value to tests with high clinical utility (defined by the availability of treatments that reduce mortality and morbidity) and to testing for highly prevalent conditions. The findings from this study exemplify how decision makers can use quantitative preference eliciting methods to measure aggregated preferences in order to prioritise alternative clinical interventions. Further research is necessary to confirm the survey results.

The role of health technology assessment in coverage decisions on newborn screening

OBJECTIVES

The role and impact of health technology assessment (HTA) in health policy has been widely discussed. Researchers have started to analyze how decisions on coverage of new technologies are made. Although the involvement of HTA may be an indicator of a well established decision process, this hypothesis requires validation. Also, it is not known whether HTA involvement is associated with other characteristics of decision making like participation or transparency. The primary objective of this study was to develop and test statements on the association between the publication of an HTA and coverage decision making for newborn screening tests in European Union countries.

METHODS

Five statements were defined on the relative role of HTA during the steps of decision processes: trigger, participation, publication, assessment, and appraisal. For this purpose, data on twenty-two decision processes in the area of newborn screening across Europe were analyzed, defined as a coverage decision for a given disorder in a specific country. Decision processes were compared by whether the decision was accompanied by the publication of an HTA report. To test differences, nonparametric statistical tests were used.

RESULTS

The decision steps of trigger, participation and publication differed between the HTA and the non-HTA groups. No clear association between HTA and assessment methods in coverage decision making was identified.

CONCLUSIONS

It appeared that there is an association between HTA and coverage decision processes that are more explicit, inclusive, and transparent. It is unclear whether HTA is associated with formal evidence reviews and economic evaluations.

A systematic review of coverage decision-making on health technologies-evidence from the real world

OBJECTIVE

Quantitative analysis of real-world coverage decision-making offers insights into the revealed preferences of appraisal committees. Aim of this review was to structure empirical evidence of coverage decisions made in practice based on the components 'methods and evidence', 'criteria and standards', 'decision outcome' and 'processes'.

METHODS

Several electronic databases, key journals and decision committees' websites were searched for publications between 1993 and June 2011. Inclusion criteria were the analysis of past decisions and application of quantitative methods. Each study was categorized by the scope of decision-making and the components covered by the variables used in quantitative analysis.

RESULTS

Thirty-two studies were identified. Many focused on pharmaceuticals, the UK NICE or the Australian PBAC. The components were covered comprehensively, but heterogeneously. Seventy-two variables were identified of which the following were more prevalent: specifications of the decision outcome; the indications considered for appraisal, identification of incremental cost-effectiveness ratios, appropriateness of evaluation methods, type of economic or clinical evidence used for assessment, and the decision date.

CONCLUSIONS

Research was dominated by analysis of decision outcomes and appraisal criteria. Although common approaches were identified, the complexity of coverage decision-making - reflected by the heterogeneity of identified variables - will continue to challenge empirical research.

Decision-making in healthcare: a practical application of partial least square path modelling to coverage of newborn screening programmes

Background

Decision-making in healthcare is complex. Research on coverage decision-making has focused on comparative studies for several countries, statistical analyses for single decision-makers, the decision outcome and appraisal criteria. Accounting for decision processes extends the complexity, as they are multidimensional and process elements need to be regarded as latent constructs (composites) that are not observed directly. The objective of this study was to present a practical application of partial least square path modelling (PLS-PM) to evaluate how it offers a method for empirical analysis of decision-making in healthcare.

Methods

Empirical approaches that applied PLS-PM to decision-making in healthcare were identified through a systematic literature search. PLS-PM was used as an estimation technique for a structural equation model that specified hypotheses between the components of decision processes and the reasonableness of decision-making in terms of medical, economic and other ethical criteria. The model was estimated for a sample of 55 coverage decisions on the extension of newborn screening programmes in Europe. Results were evaluated by standard reliability and validity measures for PLS-PM.

Results

After modification by dropping two indicators that showed poor measures in the measurement models’ quality assessment and were not meaningful for newborn screening, the structural equation model estimation produced plausible results. The presence of three influences was supported: the links between both stakeholder participation or transparency and the reasonableness of decision-making; and the effect of transparency on the degree of scientific rigour of assessment. Reliable and valid measurement models were obtained to describe the composites of ‘transparency’, ‘participation’, ‘scientific rigour’ and ‘reasonableness’.

Conclusions

The structural equation model was among the first applications of PLS-PM to coverage decision-making. It allowed testing of hypotheses in situations where there are links between several non-observable constructs. PLS-PM was compatible in accounting for the complexity of coverage decisions to obtain a more realistic perspective for empirical analysis. The model specification can be used for hypothesis testing by using larger sample sizes and for data in the full domain of health technologies.

A structured tool to analyse coverage decisions: development and feasibility test in the field of cancer screening and prevention

OBJECTIVES

The comparison of fourth hurdle processes is challenging because they are heterogeneous and decision practice may deviate from formal process rules. This study applies a published framework consisting of key steps of coverage decision processes to the area of cancer prevention.

METHODS

A research design was developed for analysis of case studies on past decision processes. Decisions were identified and information on the process steps was elicited by semi-structured telephone interviews with decision-makers and experts. The scheme was validated with experts from the areas of screening and prevention and fourth hurdle decision making.

RESULTS

Indicators for a structured empirical comparison of coverage decisions were derived. Corresponding ordinal rankings were proposed. Details on six decisions about cancer screening (colorectal and prostate cancer) and vaccination against human papillomavirus in Sweden, Austria and Lithuania are presented.

CONCLUSIONS

The development of the structured scheme for analysis of coverage decisions allows validation of official statements on decision processes and collection of larger data sets for empirical analysis. However, the semi-structured phone interviews were time-consuming for collecting information on a larger number of decisions. Further validation of the structured scheme and development of a research tool for large-scale empirical studies is still needed.

Health technology assessment in the era of personalized health care

OBJECTIVES

This article examines the challenges for health technology assessment (HTA) in the light of new developments of personalized health care, focusing on European HTA perspectives.

METHODS

Using the example of the Integrated Genome Research Network - Mutanom (IG Mutanom) project, with focus on personalized cancer diagnostics and treatment, we assess the scope of current HTA and examine it prospectively in the context of the translation of basic and clinical research into public health genomics and personalized health care.

RESULTS

The approaches developed within the IG-Mutanom project are based on innovative technology potentially providing targeted therapies for cancer; making translation into clinical practice requires a novel course of action, however. New models of HTA are needed that can account for the unique types of evidence inherent to individualized targeted therapies. Using constructive health technology assessment (CTA) models is an option, but further suitable models should be developed.

CONCLUSIONS

Integrative, systems biology-based approaches toward personalized medicine call for novel assessment methods. The translation of their highly innovative technologies into the practice of health care requires the development of new HTA concepts.

Points to consider in assessing and appraising predictive genetic tests

The use of predictive genetic tests is expanding rapidly. Given limited health care budgets and few national coverage decisions specifically for genetic tests, evidence of benefits and harms is a key requirement in decision making; however, assessing the benefits and harms of genetic tests raises a number of challenging issues. Frequently, evidence of medical benefits and harms is limited due to practical and ethical limitations of conducting meaningful clinical trials. Also, clinical endpoints frequently do not capture the benefit appropriately because the main purpose of many genetic tests is personal utility of knowing the test results, and costs of the tests and counseling can be insufficient indicators of the total costs of care. This study provides an overview of points to consider for the assessment of benefits and harms from genetic tests in an ethically and economically reflected manner. We discuss whether genetic tests are sufficiently exceptional to warrant exceptional methods for assessment and appraisal.

Challenges of translating genetic tests into clinical and public health practice

Research in genetics and genomics has led to an expanding list of molecular genetic tests, which are increasingly entering health care systems. However, the evidence surrounding the benefits and harms of these tests is frequently weak. Here we present the main challenges to the successful translation of new research findings about genotype-phenotype associations into clinical practice. We discuss the means to achieve an accelerated translation research agenda that is conducted in a reasonable, fair and efficient manner.