The role of health technology assessment in coverage decisions on newborn screening

'Integrating Ethics and Equity with Economics and Effectiveness for newborn screening in the genomic age: A qualitative study protocol of stakeholder perspectives

BACKGROUND

Newborn bloodspot screening is a well-established population health initiative that detects serious, childhood-onset, treatable conditions to improve health outcomes. With genomic technologies advancing rapidly, many countries are actively discussing the introduction of genomic assays into newborn screening programs. While adding genomic testing to Australia's newborn screening program could improve outcomes for infants and families, it must be considered against potential harms, ethical, legal, equity and social implications, and economic and health system impacts. We must ask not only 'can' we use genomics to screen newborns?' but 'should we'?' and 'how much should health systems invest in genomic newborn screening?'.

METHODS

This study will use qualitative methods to explore understanding, priorities, concerns and expectations of genomic newborn screening among parents/carers, health professionals/scientists, and health policy makers across Australia. In-depth, semi-structured interviews will be held with 30-40 parents/carers recruited via hospital and community settings, 15-20 health professionals/scientists, and 10-15 health policy makers. Data will be analysed using inductive content analysis. The Sydney Children's Hospital Network Human Research Ethics Committee approved this study protocol [2023/ETH02371]. The Standards for Reporting Qualitative Research will guide study planning, conduct and reporting.

DISCUSSION

Few studies have engaged a diverse range of stakeholders to explore the implications of genomics in newborn screening in a culturally and genetically diverse population, nor in a health system underpinned by universal health care. As the first study within a multi-part research program, findings will be used to generate new knowledge on the risks and benefits and importance of ethical, legal, social and equity implications of genomic newborn screening from the perspective of key stakeholders. As such it will be the foundation on which child and family centered criteria can be developed to inform health technology assessments and drive efficient and effective policy decision-making on the implementation of genomics in newborn screening.

Striving for a pragmatic contribution of biomarkers results to lifelong health care

BACKGROUND

The increased role of preventive medicine in healthcare and the rapid technological advancements, have deeply changed the landscape of laboratory medicine. In particular, increased investments in newborn screening tests and policies have been observed. Aim of this paper is to characterize how laboratory professionals engaged in clinical chemistry or newborn screening, in collaboration with experts in econometric, bioinformatics, and biostatistics may address a pragmatic use of laboratory results in the decision-making process oriented toward improvement of health care outcomes.

CONTENT

The effectiveness of biomarkers on healthcare depends on several factors such as analytical performance, prevalence of the disease, integration of the test within the diagnostic algorithm, associated costs, and social/economic impact of false positive and false negative results. Cost-effectiveness analysis needs to be performed and reliability achieved, by overcoming analytical pitfalls and by improving interpretative criteria. These are challenging issues common to clinical chemistry and newborn screening tests. Following the experience in clinical chemistry, one of the main issues to be approached in newborn screening tests, is the lack of harmonization of results obtained by different methods and the limited healthcare effectiveness.

SUMMARY

The focus on prevention is a crucial opportunity for laboratory medicine to change how to approach the effectiveness of biomarkers on healthcare. The consolidation within clinical laboratories of professionals with different technical and methodological expertise coupled with the need to produce and manage large sets of data, require the cooperation of professionals from other disciplines to characterize the impact of the tests on epidemiological outcomes for health care policy making process.

Assessing the performance of health technology assessment (HTA) agencies: developing a multi-country, multi-stakeholder, and multi-dimensional framework to explore mechanisms of impact

Background

Health technology assessment (HTA) agencies have an important role to play in managing the rising demands on health systems. However, creating and running such agencies potentially diverts resources from frontline services. A large number of studies address the question of ‘what is the impact of HTA?’. Several points of heterogeneity in this literature include: purpose of the study, definition of HTA, definition of impact, and scope and rigour of evaluations. Our study seeks to address several limitations in this literature. This study aims to explore the mechanisms of impact of an HTA agency. In doing so, we consider HTA as an institution rather than a knowledge product to build an impact evaluation framework from an international, multi-stakeholder and multi-dimensional perspective.

Methods

We conducted 9 key informant interviews with experts from the international HTA community. We addressed several questions, informed by existing frameworks of impact within the literature, to understand their perspectives on the mechanisms of impact of an HTA agency. We analyse data using logic modelling and impact mapping, as tools to understand and visualise mechanisms of change.

Findings

Our impact mapping highlights several distinct, but not necessarily mutually exclusive, mechanisms through which the overall impact of an HTA agency is achieved. These are: the effective conduct of HTA studies; effective use of HTA in agenda-setting and policy formulation processes; effective engagement and external communications; good institutional reputation and fit within the healthcare and policy-making system; effective use of HTA as a tool for the negotiation of health technology prices; and the effective implementation of policy change regarding health technologies. We also identify indicators of these effects.

Conclusions

Our findings and resulting evaluation framework complement and add to existing literature by offering a new perspective on the mechanisms by which HTA agencies generate impact. This new perspective considers HTA as an institution rather than a knowledge product, is international, multi-dimensional, and includes multi-stakeholder views. We hope the analysis will be useful to countries interested in managing HTA performance.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12962-021-00290-8.

The Methodological Quality and Challenges in Conducting Economic Evaluations of Newborn Screening: A Scoping Review

INTRODUCTION

Cost-effectiveness (CEA) and cost-utility analyses (CUA) have become popular types of economic evaluations (EE) used for evidence-based decision-making in healthcare resource allocation. Newborn screening programs (NBS) can have significant clinical benefits for society, and cost-effectiveness analysis may help to select the optimal strategy among different screening programs, including the no-screening option, on different conditions. These economic analyses of NBS, however, are hindered by several methodological challenges. This study explored the methodological quality in recent NBS economic evaluations and analyzed the main challenges and strategies adopted by researchers to deal with them.

METHODS

A scoping review was conducted according to PRISMA methodology to identify CEAs and CUAs of NBS. The methodological quality of the retrieved studies was assessed quantitatively using a specific guideline for the quality assessment of NBS economic evaluations, by calculating a general score for each EE. Challenges in the studies were then explored using thematic analysis as a qualitative synthesis approach.

RESULTS

Thirty-five studies met the inclusion criteria. The quantitative analysis showed that the methodological quality of NBS economic evaluations was heterogeneous. Lack of clear description of items related to results, discussion, and discounting were the most frequent flaws. Methodological challenges in performing EEs of neonatal screenings include the adoption of a long time horizon, the use of quality-adjusted life years as health outcome measure, and the assessment of costs beyond the screening interventions.

CONCLUSIONS

The results of this review can support future economic evaluation research, aiding researchers to develop a methodological guidance to perform EEs aimed at producing solid results to inform decisions for resource allocation in neonatal screening.

Challenges in Assessing the Cost-Effectiveness of Newborn Screening: The Example of Congenital Adrenal Hyperplasia

Generalizing about the cost-effectiveness of newborn screening (NBS) is difficult due to the heterogeneity of disorders included in NBS panels, along with data limitations. Furthermore, it is unclear to what extent evidence about cost-effectiveness should influence decisions to screen for specific disorders. Screening newborns for congenital adrenal hyperplasia (CAH) due to 21-hydroxylase deficiency can serve as a useful test case, since there is no global consensus on whether CAH should be part of NBS panels. Published and unpublished cost-effectiveness analyses of CAH screening have yielded mixed findings, largely due to differences in methods and data sources for estimating health outcomes and associated costs of early versus late diagnosis as well as between-country differences. Understanding these methodological challenges can help inform future analyses and could also help interested policymakers interpret the results of economic evaluations.

What Contribution Did Economic Evidence Make to the Adoption of Universal Newborn Hearing Screening Policies in the United States?

Universal newborn hearing screening (UNHS), when accompanied by timely access to intervention services, can improve language outcomes for children born deaf or hard of hearing (D/HH) and result in economic benefits to society. Early Hearing Detection and Intervention (EHDI) programs promote UNHS and using information systems support access to follow-up diagnostic and early intervention services so that infants can be screened no later than 1 month of age, with those who do not pass their screen receiving diagnostic evaluation no later than 3 months of age, and those with diagnosed hearing loss receiving intervention services no later than 6 months of age. In this paper, we first document the rapid roll-out of UNHS/EHDI policies and programs at the national and state/territorial levels in the United States between 1997 and 2005. We then review cost analyses and economic arguments that were made in advancing those policies in the United States. Finally, we examine evidence on language and educational outcomes that pertain to the economic benefits of UNHS/EHDI. In conclusion, although formal cost-effectiveness analyses do not appear to have played a decisive role, informal economic assessments of costs and benefits appear to have contributed to the adoption of UNHS policies in the United States.

The Use of Economic Evaluation to Inform Newborn Screening Policy Decisions: The Washington State Experience

POLICY POINTS

Newborn screening not only saves lives but can also yield net societal economic benefit, in addition to benefits such as improved quality of life to affected individuals and families. Calculations of net economic benefit from newborn screening include the monetary equivalent of avoided deaths and reductions in costs of care for complications associated with late-diagnosed individuals minus the additional costs of screening, diagnosis, and treatment associated with prompt diagnosis. Since 2001 the Washington State Department of Health has successfully implemented an approach to conducting evidence-based economic evaluations of disorders proposed for addition to the state-mandated newborn screening panel.

CONTEXT

Economic evaluations can inform policy decisions on the expansion of newborn screening panels. This article documents the use of cost-benefit models in Washington State as part of the rule-making process that resulted in the implementation of screening for medium-chain acyl-CoA dehydrogenase (MCAD) deficiency and 4 other metabolic disorders in 2004, cystic fibrosis (CF) in 2006, 15 other metabolic disorders in 2008, and severe combined immune deficiency (SCID) in 2014.

METHODS

We reviewed Washington State Department of Health internal reports and spreadsheet models of expected net societal benefit of adding disorders to the state newborn screening panel. We summarize the assumptions and findings for 2 models (MCAD and CF) and discuss them in relation to findings in the peer-reviewed literature.

FINDINGS

The MCAD model projected a benefit-cost ratio of 3.4 to 1 based on assumptions of a 20.0 percentage point reduction in infant mortality and a 13.9 percentage point reduction in serious developmental disability. The CF model projected a benefit-cost ratio of 4.0-5.4 to 1 for a discount rate of 3%-4% and a plausible range of 1-2 percentage point reductions in deaths up to age 10 years.

CONCLUSIONS

The Washington State cost-benefit models of newborn screening were broadly consistent with peer-reviewed literature, and their findings of net benefit appear to be robust to uncertainty in parameters. Public health newborn screening programs can develop their own capacity to project expected costs and benefits of expansion of newborn screening panels, although it would be most efficient if this capacity were shared among programs.

Policy Making in Newborn Screening Needs a Structured and Transparent Approach

PURPOSE

Newborn bloodspot screening (NBS) programs have expanded significantly in the past years and are expected to expand further with the emergence of genetic technologies. Historically, NBS expansion has often occurred following ad hoc consideration of conditions, instead of a structured and transparent approach. In this review, we explore issues pertinent to NBS policy making, through the lens of the policy cycle: (a) agenda setting, (b) policy advice, (c) policy decision, (d) implementation, and (e) evaluation.

METHODS

A literature search was conducted to gather information on the elements specific to NBS and its policy making process.

RESULTS

The review highlighted two approaches to nominate a condition: a structured approach through horizon scanning; and an ad hoc process. For assessment of a condition, there was unanimous support for a robust process based on criteria. While the need to assess harms and benefits was a repeated theme in the articles, there is no agreed-upon threshold for benefit in decision-making. Furthermore, the literature was consistent in its recommendation for an overarching, independent, multidisciplinary group providing recommendations to government. An implementation plan focusing on the different levels on which NBS operates and the information needed on each level is essential for successful implementation. Continuously monitoring, and improving a program is vital, particularly following the implementation of screening for a new condition. An advisory committee could advise on implementation, development, review, modification, and cessation of (parts of) NBS.

CONCLUSION

The results highlight that there are a wave of issues facing NBS programs that policy makers must take into account when developing policy processes. What conditions to screen, and the technologies used in NBS, are both up for debate.

INFLUENCE OF HEALTH TECHNOLOGY ASSESSMENT AND ITS MEASUREMENT

Objectives: The aim of this study was to obtain information on methods used to measure health technology assessment (HTA) influence, decisions that were influenced, and outcomes linked to HTA.

Methods: Electronic databases were used to locate studies in which HTA influence had been demonstrated. Inclusion criteria were studies that reliably reported consideration by decision makers of HTA findings; comparative studies of technology use before and after HTA; and details of changes in policy, health outcomes, or research that could be credibly linked to an HTA.

Results: Fifty-one studies were selected for review. Settings were national (24), regional (12), both national and regional (3) hospitals (9), and multinational (3). The most common approach to appraisal of influence was review of policy or administrative decisions following HTA recommendations (51 percent). Eighteen studies (35 percent) reported interview or survey findings, thirteen (26 percent) reviewed administrative data, and six considered the influence of primary studies. Of 142 decisions informed by HTA, the most common types were on routine clinical practice (67 percent of studies), coverage (63 percent), and program operation (37 percent). The most frequent indications of HTA influence were on decisions related to resource allocation (59 percent), change in practice pattern (31 percent), and incorporation of HTA details in reference material (18 percent). Few publications assessed the contribution of HTA to changing patient outcomes.

Conclusions: The literature on HTA influence remains limited, with little on longer term effects on practice and outcomes. The reviewed publications indicated how HTA is being used in different settings and approaches to measuring its influence that might be more widely applied, such as surveys and monitoring administrative data.

Cost and Cost-Effectiveness Assessments of Newborn Screening for Critical Congenital Heart Disease Using Pulse Oximetry: A Review

Screening newborns for critical congenital heart disease (CCHD) using pulse oximetry is recommended to allow for the prompt diagnosis and prevention of life-threatening crises. The present review summarizes and critiques six previously published estimates of the costs or cost-effectiveness of CCHD screening from the United Kingdom, United States, and China. Several elements that affect CCHD screening costs were assessed in varying numbers of studies, including screening staff time, instrumentation, and consumables, as well as costs of diagnosis and treatment. A previous US study that used conservative assumptions suggested that CCHD screening is likely to be considered cost-effective from the healthcare sector perspective. Newly available estimates of avoided infant CCHD deaths in several US states that implemented mandatory CCHD screening policies during 2011-2013 suggest a substantially larger reduction in deaths than was projected in the previous US cost-effectiveness analysis. Taking into account these new estimates, we estimate that cost per life-year gained could be as low as USD 12,000. However, that estimate does not take into account future costs of health care and education for surviving children with CCHD nor the costs incurred by health departments to support and monitor CCHD screening policies and programs.

International differences in the evaluation of conditions for newborn bloodspot screening: a review of scientific literature and policy documents

Despite international adoption of newborn bloodspot screening (DBS), no two countries' screening programs are the same. This article aims to understand what factors influence DBS decision-making criteria and how conditions are assessed against them. In doing so, it offers unique insights into the international landscape of DBS. A systematic review on DBS criteria in scientific literature was first undertaken. Through this, five topics were identified for consideration when analyzing DBS decision-making. Using these five topics as a template, a side-by-side comparison was conducted on DBS in policy documents of eight countries. Programs are using different approaches to explore the same policy issues, including: the beneficiary of DBS, definition of criteria, the way conditions are assessed, level of evidence required, and recommendations after assessment. These differences have the potential to result in increased disparity across DBS internationally. Ultimately, governments need to decide on their role and develop an approach to DBS decision-making in line with this role. The analyses presented in this article highlight that despite programs' commonalities, no one 'DBS decision-making solution' exists. Understanding the different approaches to decision-making within the literature and policy settings, provides an objective starting point for structured decision-making approaches for DBS programs.

Showing Value in Newborn Screening: Challenges in Quantifying the Effectiveness and Cost-Effectiveness of Early Detection of Phenylketonuria and Cystic Fibrosis

Decision makers sometimes request information on the cost savings, cost-effectiveness, or cost-benefit of public health programs. In practice, quantifying the health and economic benefits of population-level screening programs such as newborn screening (NBS) is challenging. It requires that one specify the frequencies of health outcomes and events, such as hospitalizations, for a cohort of children with a given condition under two different scenarios-with or without NBS. Such analyses also assume that everything else, including treatments, is the same between groups. Lack of comparable data for representative screened and unscreened cohorts that are exposed to the same treatments following diagnosis can result in either under- or over-statement of differences. Accordingly, the benefits of early detection may be understated or overstated. This paper illustrates these common problems through a review of past economic evaluations of screening for two historically significant conditions, phenylketonuria and cystic fibrosis. In both examples qualitative judgments about the value of prompt identification and early treatment to an affected child were more influential than specific numerical estimates of lives or costs saved.

Funding decisions for newborn screening: a comparative review of 22 decision processes in Europe

Decision-makers need to make choices to improve public health. Population-based newborn screening (NBS) is considered as one strategy to prevent adverse health outcomes and address rare disease patients' needs. The aim of this study was to describe key characteristics of decisions for funding new NBS programmes in Europe. We analysed past decisions using a conceptual framework. It incorporates indicators that capture the steps of decision processes by health care payers. Based on an internet survey, we compared 22 decisions for which answers among two respondents were validated for each observation. The frequencies of indicators were calculated to elicit key characteristics. All decisions resulted in positive, mostly unrestricted funding. Stakeholder participation was diverse focusing on information provision or voting. Often, decisions were not fully transparent. Assessment of NBS technologies concentrated on expert opinion, literature review and rough cost estimates. Most important appraisal criteria were effectiveness (i.e., health gain from testing for the children being screened), disease severity and availability of treatments. Some common and diverging key characteristics were identified. Although no evidence of explicit healthcare rationing was found, processes may be improved in respect of transparency and scientific rigour of assessment.

An economic theory of the fourth hurdle

Third party payers' decision processes for financing health technologies ('fourth hurdle' processes) are subject to intensive descriptive empirical investigation. This paper addresses the need for a theoretical foundation of this research and develops a theoretical framework for analysing fourth hurdle processes from an economics perspective. On the basis of a decision-analytic framework and the theory of agents, fourth hurdle processes are described as sets of institutions to maximize the value derived from finite healthcare resources. Benefits are assumed to arise from the value of better information about and better implementation of the most cost-effective choice. Implementation is improved by decreased information asymmetries and better alignment of incentives. This decreases the effects of ex ante and ex post moral hazard on service provision. Potential indicators of high benefit include high costs associated with wrong decisions and large population sizes affected by the decision. The framework may serve as a basis both for further theoretical work, for example, on the appropriate degree of participation as well as further empirical work, for example, on comparative assessments of fourth hurdle processes. It needs to be complemented by frameworks for analysing fourth hurdle institutions developed by other disciplines such as bioethics or law.

Decision-making in healthcare: a practical application of partial least square path modelling to coverage of newborn screening programmes

Background

Decision-making in healthcare is complex. Research on coverage decision-making has focused on comparative studies for several countries, statistical analyses for single decision-makers, the decision outcome and appraisal criteria. Accounting for decision processes extends the complexity, as they are multidimensional and process elements need to be regarded as latent constructs (composites) that are not observed directly. The objective of this study was to present a practical application of partial least square path modelling (PLS-PM) to evaluate how it offers a method for empirical analysis of decision-making in healthcare.

Methods

Empirical approaches that applied PLS-PM to decision-making in healthcare were identified through a systematic literature search. PLS-PM was used as an estimation technique for a structural equation model that specified hypotheses between the components of decision processes and the reasonableness of decision-making in terms of medical, economic and other ethical criteria. The model was estimated for a sample of 55 coverage decisions on the extension of newborn screening programmes in Europe. Results were evaluated by standard reliability and validity measures for PLS-PM.

Results

After modification by dropping two indicators that showed poor measures in the measurement models’ quality assessment and were not meaningful for newborn screening, the structural equation model estimation produced plausible results. The presence of three influences was supported: the links between both stakeholder participation or transparency and the reasonableness of decision-making; and the effect of transparency on the degree of scientific rigour of assessment. Reliable and valid measurement models were obtained to describe the composites of ‘transparency’, ‘participation’, ‘scientific rigour’ and ‘reasonableness’.

Conclusions

The structural equation model was among the first applications of PLS-PM to coverage decision-making. It allowed testing of hypotheses in situations where there are links between several non-observable constructs. PLS-PM was compatible in accounting for the complexity of coverage decisions to obtain a more realistic perspective for empirical analysis. The model specification can be used for hypothesis testing by using larger sample sizes and for data in the full domain of health technologies.