Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening

Benefits and harms of antenatal and newborn screening programmes in health economic assessments: the VALENTIA systematic review and qualitative investigation

Background

Health economic assessments are used to determine whether the resources needed to generate net benefit from an antenatal or newborn screening programme, driven by multiple benefits and harms, are justifiable. It is not known what benefits and harms have been adopted by economic evaluations assessing these programmes and whether they omit benefits and harms considered important to relevant stakeholders.

Objectives

(1) To identify the benefits and harms adopted by health economic assessments in this area, and to assess how they have been measured and valued; (2) to identify attributes or relevance to stakeholders that ought to be considered in future economic assessments; and (3) to make recommendations about the benefits and harms that should be considered by these studies.

Design

Mixed methods combining systematic review and qualitative work.

Systematic review methods

We searched the published and grey literature from January 2000 to January 2021 using all major electronic databases. Economic evaluations of an antenatal or newborn screening programme in one or more Organisation for Economic Co-operation and Development countries were considered eligible. Reporting quality was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist. We identified benefits and harms using an integrative descriptive analysis and constructed a thematic framework.

Qualitative methods

We conducted a meta-ethnography of the existing literature on newborn screening experiences, a secondary analysis of existing individual interviews related to antenatal or newborn screening or living with screened-for conditions, and a thematic analysis of primary data collected with stakeholders about their experiences with screening.

Results

The literature searches identified 52,244 articles and reports, and 336 unique studies were included. Thematic framework resulted in seven themes: (1) diagnosis of screened for condition, (2) life-years and health status adjustments, (3) treatment, (4) long-term costs, (5) overdiagnosis, (6) pregnancy loss and (7) spillover effects on family members. Diagnosis of screened-for condition (115, 47.5%), life-years and health status adjustments (90, 37.2%) and treatment (88, 36.4%) accounted for most of the benefits and harms evaluating antenatal screening. The same themes accounted for most of the benefits and harms included in studies assessing newborn screening. Long-term costs, overdiagnosis and spillover effects tended to be ignored. The wide-reaching family implications of screening were considered important to stakeholders. We observed good overlap between the thematic framework and the qualitative evidence.

Limitations

Dual data extraction within the systematic literature review was not feasible due to the large number of studies included. It was difficult to recruit healthcare professionals in the stakeholder's interviews.

Conclusions

There is no consistency in the selection of benefits and harms used in health economic assessments in this area, suggesting that additional methods guidance is needed. Our proposed thematic framework can be used to guide the development of future health economic assessments evaluating antenatal and newborn screening programmes.

Study registration

This study is registered as PROSPERO CRD42020165236.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: NIHR127489) and is published in full in Health Technology Assessment; Vol. 28, No. 25. See the NIHR Funding and Awards website for further award information.

Policy-making and implementation for newborn bloodspot screening in Europe: a comparison between EURORDIS principles and UK practice

Newborn bloodspot screening (NBS) policy is a contentious area in Europe. Variation in the screening panels on offer, in the approach to evidence assessment and in the use of health economic modelling are some of the issues which are debated on the topic. In this paper we focus on a set of patient-driven principles for newborn screening published by EURORDIS and use these as a reference point for exploration and comparison with NBS policy development and screening practice in the UK. In doing so, we share UK practice; we note the UK is generally well aligned with many of the recommended principles, but we also discuss areas of controversy and challenges. Some of these, like 'actionability', will undoubtedly continue to be debated and may never reach consensus. For others, such as patient and public voice participation in newborn screening systems, there are opportunities to continue improving existing processes and developing new mechanisms for stakeholder participation. Screening bodies in other European countries should also compare their policy-making and implementation practices with the EURORDIS principles to stimulate further discussion on the challenges and opportunities of newborn screening and provide a cross-European baseline.

Benefits and harms adopted by health economic assessments evaluating antenatal and newborn screening programmes in OECD countries: A systematic review of 336 articles and reports

BACKGROUND

Health economic assessments are used to determine whether the resources needed to generate net benefit from a screening programme, driven by multiple complex benefits and harms, are justifiable. We systematically identified the benefits and harms incorporated within economic assessments evaluating antenatal and newborn screening programmes.

METHODS

For this systematic review and thematic analysis, we searched the published and grey literature from January 2000 to January 2021. Studies that included an economic evaluation of an antenatal or newborn screening programme in an OECD country were eligible. We identified benefits and harms using an integrative descriptive analysis, and illustrated a thematic framework. (Systematic review registration PROSPERO, CRD42020165236).

FINDINGS

The searches identified 52,244 articles and reports and 336 (242 antenatal and 95 newborn) were included. Eighty-six subthemes grouped into seven themes were identified: 1) diagnosis of screened for condition, 2) life years and health status adjustments, 3) treatment, 4) long-term costs, 5) overdiagnosis, 6) pregnancy loss, and 7) spillover effects on family members. Diagnosis of screened for condition (115 studies, 47.5%), life-years and health status adjustments (90 studies, 37.2%) and treatment (88 studies, 36.4%) accounted for most of the benefits and harms evaluating antenatal screening. The same themes accounted for most of the benefits and harms included in studies assessing newborn screening. Overdiagnosis and spillover effects tended to be ignored.

INTERPRETATION

Our proposed framework can be used to guide the development of future health economic assessments evaluating antenatal and newborn screening programmes, to prevent exclusion of important potential benefits and harms.

Cost-Effectiveness of Neonatal Hearing Screening Programs: A Micro-Simulation Modeling Analysis

Supplemental Digital Content is available in the text.

Early detection of neonatal hearing impairment moderates the negative effects on speech and language development. Universal neonatal hearing screening protocols vary in tests used, timing of testing and the number of stages of screening. This study estimated the cost-effectiveness of various protocols in the preparation of implementation of neonatal hearing screening in Albania.

The Methodological Quality and Challenges in Conducting Economic Evaluations of Newborn Screening: A Scoping Review

INTRODUCTION

Cost-effectiveness (CEA) and cost-utility analyses (CUA) have become popular types of economic evaluations (EE) used for evidence-based decision-making in healthcare resource allocation. Newborn screening programs (NBS) can have significant clinical benefits for society, and cost-effectiveness analysis may help to select the optimal strategy among different screening programs, including the no-screening option, on different conditions. These economic analyses of NBS, however, are hindered by several methodological challenges. This study explored the methodological quality in recent NBS economic evaluations and analyzed the main challenges and strategies adopted by researchers to deal with them.

METHODS

A scoping review was conducted according to PRISMA methodology to identify CEAs and CUAs of NBS. The methodological quality of the retrieved studies was assessed quantitatively using a specific guideline for the quality assessment of NBS economic evaluations, by calculating a general score for each EE. Challenges in the studies were then explored using thematic analysis as a qualitative synthesis approach.

RESULTS

Thirty-five studies met the inclusion criteria. The quantitative analysis showed that the methodological quality of NBS economic evaluations was heterogeneous. Lack of clear description of items related to results, discussion, and discounting were the most frequent flaws. Methodological challenges in performing EEs of neonatal screenings include the adoption of a long time horizon, the use of quality-adjusted life years as health outcome measure, and the assessment of costs beyond the screening interventions.

CONCLUSIONS

The results of this review can support future economic evaluation research, aiding researchers to develop a methodological guidance to perform EEs aimed at producing solid results to inform decisions for resource allocation in neonatal screening.

Automated generation of decision-tree models for the economic assessment of interventions for rare diseases using the RaDiOS ontology

OBJECTIVE

The development of decision models to assess interventions for rare diseases require huge efforts from research groups, especially regarding collecting and synthesizing the knowledge to parameterize the model. This article presents a method to reuse the knowledge collected in an ontology to automatically generate decision tree models for different contexts and interventions.

MATERIAL AND METHODS

We updated the reference ontology (RaDiOS) to include more knowledge required to generate a model. We implemented a transformation tool (RaDiOS-MTT) that uses the knowledge stored in RaDiOS to automatically generate decision trees for the economic assessment of interventions on rare diseases.

RESULTS

We used a case study to illustrate the potential of the tool, and automatically generate a decision tree that reproduces an actual study on newborn screening for profound biotinidase deficiency.

CONCLUSIONS

RaDiOS-MTT allows research groups to reuse the evidence collected, and thus speeding up the development of health economics assessments for interventions on rare diseases.

Bioaerosol impact on crop health over India due to emerging fungal diseases (EFDs): an important missing link

Atmospheric bioaerosols, which contain a diverse group of various biological materials, also include pathogenic microorganisms such as viruses, bacteria, and fungal spores. The dispersal of various pathogens negatively impacts the human and ecosystem health. While the impact of pathogenic bacteria and viruses on human and ecosystem health is well documented, the impact of fungal spores on crop, however, is poorly characterized. An unprecedented increase in number of fungal and fungal-like diseases (emerging fungal diseases (EFDs)) in plants is threatening the food security and endangering the biodiversity. In present communication, we show an increasing trend in the fungal bioaerosol attacks on crops over India outstripping bacteria and viruses. We further argue about the complex interactions between the fungal species, and crop impact over India is unique and highly interconnected with the topography, meteorological variables, and season of the year. Under constantly warming scenario, the fungal attacks on plants are expected to rise and, in all likelihood, extend to the sensitive and fragile ecosystems like the Himalayan region and the Western Ghats. An increasing trend in EFDs calls for immediate coordinated efforts towards understanding the type and diversity of pathogenic fungal bioaerosols. There is, however, a lack over Indian region about biogeography of pathogenic fungi. The detailed biogeography would help in improving public and political awareness to formulate the effective policy decisions. Any further disregard and delay in recognizing the importance of EFDs to crop and sensitive ecosystems can have severe societal and ecological repercussions over Indian region.

Iron deficiency screening for children at 18 months: a cost-utility analysis

BACKGROUND

The peak prevalence of iron deficiency is in children 6 months to 3 years of age, a sensitive period for neurodevelopment. Our study objective was to examine the cost-utility of a proposed iron deficiency screening program for 18-month-old children.

METHODS

We used a decision tree model to estimate the costs in 2019 Canadian dollars and quality-adjusted life years (QALYs) associated with 3 iron deficiency screening strategies: no screening, universal screening and targeted screening for a high-risk population. We used a societal perspective and assessed lifetime QALY gains. We derived outcomes from the literature and prospectively collected data. We performed one-way and probabilistic sensitivity analyses to assess parameter uncertainty.

RESULTS

The incremental costs to society of universal and targeted screening programs compared to no screening were $2286.06/QALY and $1676.94/QALY, respectively. With a willingness-to-pay threshold of $50 000/QALY, both programs were cost-effective. Compared to a targeted screening program, a universal screening program would cost an additional $2965.96 to gain 1 QALY, which renders it a cost-effective option. The study findings were robust to extensive sensitivity analyses.

INTERPRETATION

A proposed universal screening program for iron deficiency would be cost-effective over the lifespan compared to both no screening (current standard of care) and a targeted screening program for children at high risk. Policy-makers and physicians may consider expanding the recommended 18-month enhanced well-baby visit to include screening for iron deficiency.

Economic Evaluations of Childhood Hearing Loss Screening Programmes: A Systematic Review and Critique

BACKGROUND

Permanent childhood hearing loss is one of the most common birth conditions associated with speech and language delay. A hearing screening can result in early detection and intervention for hearing loss.

OBJECTIVES

To update and expand previous systematic reviews of economic evaluations of childhood hearing screening strategies, and explore the methodological differences.

DATA SOURCES

MEDLINE, Embase, the Cochrane database, National Health Services Economic Evaluation Database (NHS EED), the Health Technology Assessment (HTA) database, and Canadian Agency for Drugs and Technologies in Health's (CADTH) Grey matters.

STUDY ELIGIBILITY CRITERIA, PARTICIPANTS AND INTERVENTIONS

Economic evaluations reporting costs and outcomes for both the intervention and comparator arms related to childhood hearing screening strategies.

RESULTS

Thirty evaluations (from 29 articles) were included for review. Several methodological issues were identified, including: few evaluations reported outcomes in terms of quality-adjusted life years (QALYs); none estimated utilities directly from surveying children; none included disutilities and costs associated with adverse events; few included costs and outcomes that differed by severity; few included long-term estimates; none considered acquired hearing loss; some did not present incremental results; and few conducted comprehensive univariate or probabilistic sensitivity analysis. Evaluations published post-2011 were more likely to report QALYs and disability-adjusted life years (DALYs) as outcome measures, include long-term treatment and productivity costs, and present incremental results.

LIMITATIONS

We were unable to access the economic models and, although we employed an extensive search strategy, potentially not all relevant economic evaluations were identified.

CONCLUSIONS AND IMPLICATIONS

Most economic evaluations concluded that childhood hearing screening is value for money. However, there were significant methodological limitations with the evaluations.

Towards the automated economic assessment of newborn screening for rare diseases

OBJECTIVE

Economic assessments of newborn screening programs for rare diseases involve the use of models and require huge efforts to synthesize information from different sources. Sharing and automatically or semi-automatically reusing this information for new assessments would be desirable, but it is not possible nowadays due to the lack of suitable tools.

MATERIAL AND METHODS

We designed and implemented the Rare Diseases Ontology for Simulation (RaDiOS) after performing two reviews, and critically appraising the existing data repositories on rare diseases. The first review involved previous published economic assessments, and served to identify the main parameters required to model newborn screening. The second review aimed at locating existing data repositories potentially available to inform these parameters.

RESULTS

We found key model parameters on epidemiology, screening methods, diagnose methods, pathogenesis, treatment and follow-up tests. We also identified seven data repositories directly related to rare diseases. None of such repositories was well-suited for the automated generation of simulation models. We incorporated the identified parameters as structured classes and properties of the new ontology (RaDiOS). We carefully set the relationships among the parameters so to allow automated inference from the ontology.

CONCLUSIONS

RaDiOS is an ontology that serves as a data repository to automatically build simulation models for the economic assessment of newborn screening for rare diseases.

Economic impact of screening for X-linked Adrenoleukodystrophy within a newborn blood spot screening programme

BACKGROUND

A decision tree model was built to estimate the economic impact of introducing screening for X-linked adrenoleukodystrophy (X-ALD) into an existing tandem mass spectrometry based newborn screening programme. The model was based upon the UK National Health Service (NHS) Newborn Blood Spot Screening Programme and a public service perspective was used with a lifetime horizon. The model structure and parameterisation were based upon literature reviews and expert clinical judgment. Outcomes included health, social care and education costs and quality adjusted life years (QALYs). The model assessed screening of boys only and evaluated the impact of improved outcomes from hematopoietic stem cell transplantation in patients with cerebral childhood X-ALD (CCALD). Threshold analyses were used to examine the potential impact of utility decrements for non-CCALD patients identified by screening.

RESULTS

It is estimated that screening 780,000 newborns annually will identify 18 (95%CI 12, 27) boys with X-ALD, of whom 10 (95% CI 6, 15) will develop CCALD. It is estimated that screening may detect 7 (95% CI 3, 12) children with other peroxisomal disorders who may also have arisen symptomatically. If results for girls are returned an additional 17 (95% CI 12, 25) cases of X-ALD will be identified. The programme is estimated to cost an additional £402,000 (95% CI £399-407,000) with savings in lifetime health, social care and education costs leading to an overall discounted cost saving of £3.04 (95% CI £5.69, £1.19) million per year. Patients with CCALD are estimated to gain 8.5 discounted QALYs each giving an overall programme benefit of 82 (95% CI 43, 139) QALYs.

CONCLUSION

Including screening of boys for X-ALD into an existing tandem mass spectrometry based newborn screening programme is projected to reduce lifetime costs and improve outcomes for those with CCALD. The potential disbenefit to those identified with non-CCALD conditions would need to be substantial in order to outweigh the benefit to those with CCALD. Further evidence is required on the potential QALY impact of early diagnosis both for non-CCALD X-ALD and other peroxisomal disorders. The favourable economic results are driven by estimated reductions in the social care and education costs.

What Contribution Did Economic Evidence Make to the Adoption of Universal Newborn Hearing Screening Policies in the United States?

Universal newborn hearing screening (UNHS), when accompanied by timely access to intervention services, can improve language outcomes for children born deaf or hard of hearing (D/HH) and result in economic benefits to society. Early Hearing Detection and Intervention (EHDI) programs promote UNHS and using information systems support access to follow-up diagnostic and early intervention services so that infants can be screened no later than 1 month of age, with those who do not pass their screen receiving diagnostic evaluation no later than 3 months of age, and those with diagnosed hearing loss receiving intervention services no later than 6 months of age. In this paper, we first document the rapid roll-out of UNHS/EHDI policies and programs at the national and state/territorial levels in the United States between 1997 and 2005. We then review cost analyses and economic arguments that were made in advancing those policies in the United States. Finally, we examine evidence on language and educational outcomes that pertain to the economic benefits of UNHS/EHDI. In conclusion, although formal cost-effectiveness analyses do not appear to have played a decisive role, informal economic assessments of costs and benefits appear to have contributed to the adoption of UNHS policies in the United States.

Cost-Effectiveness Methods and Newborn Screening Assessment

Nowadays, health funding decisions must be supported by sound arguments in terms of both effectiveness and economic criteria. After more than half a century of newborn screening for rare diseases, the appropriate economic evaluation framework for these interventions is still challenging. The validity of standard methods for economic evaluation heavily relies on the availability of robust evidence, but collection of such evidence is precluded by the rareness of the conditions that may benefit from screening. Furthermore, there are a series of conceptual and methodological limitations that warrant further careful consideration when assessing the cost-effectiveness of newborn screening programs. In this chapter we provide a general overview of current economic evaluation methods and the challenges for their application to newborn screening programs.

The Impact of the Affordable Care Act on Funding for Newborn Screening Services

OBJECTIVE

The Affordable Care Act requires most health plans to cover the federal Recommended Uniform Screening Panel of newborn screening (NBS) tests with no cost sharing. However, state NBS programs vary widely in both the number of mandated tests and their funding mechanisms, including a combination of state laboratory fees, third-party billing, and other federal and state funding. We assessed the potential impact of the Affordable Care Act coverage mandate on states' NBS funding.

METHOD

We performed an extensive review of the refereed literature, federal and state agency reports, relevant organizations' websites, and applicable state laws and regulations; interviewed 28 state and federal officials from August to December 2014; and then assessed the interview findings manually.

RESULTS

Although a majority of states had well-established systems for including laboratory-based NBS tests in bundled charges for newborn care, billing practices for critical congenital heart disease and newborn hearing tests were less uniform. Most commonly, birthing facilities either prepaid the costs of laboratory-based tests when acquiring the filter paper kits, or the facilities paid for the tests when the kits were submitted. Some states had separate arrangements for billing Medicaid, and smaller facilities sometimes contracted with hearing test vendors that billed families separately.

CONCLUSION

Although the Affordable Care Act coverage mandate may offset some state NBS funding for the screenings themselves, federal support is still required to assure access to the full range of NBS program services. Limiting reimbursement to the costs of screening tests alone would undermine the common practice of using screening charges to fund follow-up services counseling, and medical food or formula, particularly for low-income families.

The Role of Information Provision in Economic Evaluations of Newborn Bloodspot Screening: A Systematic Review

BACKGROUND

The extent to which economic evaluations have included the healthcare resource and outcome-related implications of information provision in national newborn bloodspot screening programmes (NBSPs) is not currently known.

OBJECTIVES

To identify if, and how, information provision has been incorporated into published economic evaluations of NBSPs.

METHODS

A systematic review of economic evaluations of NBSPs (up to November 2014) was conducted. Three electronic databases were searched (Ovid: Medline, Embase, CINAHL) using an electronic search strategy combining a published economic search filter with terms related to national NBSPs and screening-related technologies. These electronic searches were supplemented by searching the NHS Economic Evaluations Database (NHS EED) and hand-searching identified study reference lists. The results were tabulated and summarised as part of a narrative synthesis.

RESULTS

A total of 27 economic evaluations [screening-related technologies (n = 11) and NBSPs (n = 16)] were identified. The majority of economic evaluations did not quantify the impact of information provision in terms of healthcare costs or outcomes. Five studies did include an estimate of the time cost associated with information provision. Four studies included a value to reflect the disutility associated with parental anxiety caused by false-positive results, which was used as a proxy for the impact of imperfect information.

CONCLUSION

A limited evidence base currently quantifies the impact of information provision on the healthcare costs and impact on the users of NBSPs; the parents of newborns. We suggest that economic evaluations of expanded NBSPs need to take account of information provision otherwise the impact on healthcare costs and the outcomes for newborns and their parents may be underestimated.

Showing Value in Newborn Screening: Challenges in Quantifying the Effectiveness and Cost-Effectiveness of Early Detection of Phenylketonuria and Cystic Fibrosis

Decision makers sometimes request information on the cost savings, cost-effectiveness, or cost-benefit of public health programs. In practice, quantifying the health and economic benefits of population-level screening programs such as newborn screening (NBS) is challenging. It requires that one specify the frequencies of health outcomes and events, such as hospitalizations, for a cohort of children with a given condition under two different scenarios-with or without NBS. Such analyses also assume that everything else, including treatments, is the same between groups. Lack of comparable data for representative screened and unscreened cohorts that are exposed to the same treatments following diagnosis can result in either under- or over-statement of differences. Accordingly, the benefits of early detection may be understated or overstated. This paper illustrates these common problems through a review of past economic evaluations of screening for two historically significant conditions, phenylketonuria and cystic fibrosis. In both examples qualitative judgments about the value of prompt identification and early treatment to an affected child were more influential than specific numerical estimates of lives or costs saved.

Secondary findings and carrier test frequencies in a large multiethnic sample

BACKGROUND

Besides its growing importance in clinical diagnostics and understanding the genetic basis of Mendelian and complex diseases, whole exome sequencing (WES) is a rich source of additional information of potential clinical utility for physicians, patients and their families. We analyzed the frequency and nature of single nucleotide variants (SNVs) considered secondary findings and recessive disease allele carrier status in the exomes of 8554 individuals from a large, randomly sampled cohort study and 2514 patients from a study of presumed Mendelian disease having undergone WES.

METHODS

We used the same sequencing platform and data processing pipeline to analyze all samples and characterized the distributions of reported pathogenic (ClinVar, Human Gene Mutation Database (HGMD)) and predicted deleterious variants in the pre-specified American College of Medical Genetics and Genomics (ACMG) secondary findings and recessive disease genes in different ethnic groups.

RESULTS

In the 56 ACMG secondary findings genes, the average number of predicted deleterious variants per individual was 0.74, and the mean number of ClinVar reported pathogenic variants was 0.06. We observed an average of 10 deleterious and 0.78 ClinVar reported pathogenic variants per individual in 1423 autosomal recessive disease genes. By repeatedly sampling pairs of exomes, 0.5 % of the randomly generated couples were at 25 % risk of having an affected offspring for an autosomal recessive disorder based on the ClinVar variants.

CONCLUSIONS

By investigating reported pathogenic and novel, predicted deleterious variants we estimated the lower and upper limits of the population fraction for which exome sequencing may reveal additional medically relevant information. We suggest that the observed wide range for the lower and upper limits of these frequency numbers will be gradually reduced due to improvement in classification databases and prediction algorithms.

[Present status of expanded newborn screening project for inborn errors of metabolism by tandem mass spectrometry]

In Japan, screening for six diseases including four inborn errors of metabolism has been performed since 1977 for all neonates to prevent severe mental handicaps or death. A rapid screening procedure for analysis of several amino acids and acylcarnitines in blood spots by tandem mass spectrometry was developed by Millington DS et al. in the early 1990s. Although it is called expanded (or extended) newborn screening, the procedure is insufficiently sensitive to or specific for several diseases. Screening for all diseases that can be screened using this procedure is suggested to be cost-ineffective. Many European countries target only two diseases: medium-chain acyl-CoA dehydrogenase deficiency and phenylketonuria; their prevalence in Caucasian populations is very high, but some countries target more than twenty diseases and others an intermediate number. A pilot study targeting 22 diseases suggests that the combined incidence is one per 9,000 (0.01%) in Japan. This primary screening requires secondary screening to confirm the disease using urine, and either organic acids with solvent extraction or metabolome without fractionation are analyzed by gas chromatography-mass spectrometry. There is no need for primary or secondary screening tests to be performed at the same laboratory because the skills required are quite different. Understanding of the methodological problems of tandem mass screening and amelioration of variation and false positivity rate of this screening method among laboratories are critical to the success of the screening system in Japan. GC/MS-based urine metabolomics is expected to become one of the primary screening methodologies for neonates/infants who are already ill.