Potential transferability of economic evaluations of programs encouraging physical activity in children and adolescents across different countries--a systematic review of the literature

Considerations for transferability of health technology assessments: a scoping review of tools, methods, and practices

Health technology assessment (HTA) is commonly used to guide evidence-informed decisions to optimize resource use, prioritize policies, and support countries to achieve universal health coverage. Producing HTAs requires time, scientific expertise, and political commitment, but these are not available in all settings - especially in low- and middle-income countries (LMIC) where HTA processes may be less institutionalized. Transferring and adapting existing HTAs to local settings may offer a solution while reducing duplication efforts. This scoping review aims to provide an overview of tools, methods, approaches, and considerations which can aid HTA transfers. We systematically searched (from 2005 to 2020) six databases and, using predefined inclusion criteria, included twenty-two studies. Data extraction followed a structured process, while synthesis was more iterative. We identified a common approach for HTA transfers. It follows the de novo process of undertaking original HTAs, but with additional steps to assess relevance (applicability), quality, and transferability, as well as steps to adapt parameters where necessary. The EUnetHTA Adaptation Toolkit was the only tool that provided guidance for adapting multiple HTA domains. Other tools were specific to systematic reviews (n = 1) or economic evaluations (n = 12), where one provided guidance for systematic reviews of economic evaluations. Eight papers reported transferring an HTA, with only one transferring to an LMIC. Finally, we reported issues that may facilitate or hinder transferability. In conclusion, we identified fourteen transfer approaches in the form of guidance or checklists, but harmonized and pragmatic guidance for HTA transfers to suit settings with limited HTA capacity seems warranted.

A systematic review of economic evaluations of public health interventions targeting alcohol, tobacco, illicit drug use and problematic gambling: Using a case study to assess transferability

AIMS

To identify and assess the cost-effectiveness of public health interventions targeting the use of alcohol, illicit drugs and tobacco, as well as problematic gambling behavior (ANDTS), and consider whether the results from these evaluations are transferable to the Swedish setting.

METHODS

A systematic review of economic evaluations within the area of ANDTS was conducted including studies published between January 2000 and November 2018, identified through Medline, PsychINFO, Web of Science, the National Health Service Economic Evaluation Database and Health Technology Assessment. The quality of relevant studies and the possibilities of transferring results were assessed using criteria set out by the Swedish Agency for Health Technology Assessment.

RESULTS

Out of 54 relevant studies, 39 were of moderate to high quality and included in the review, however none for problematic gambling. Eighty-one out of a total of 91 interventions were cost-effective. The interventions largely focusing on taxed-based policies or screening and brief interventions. Thirteen of these studies were deemed to have high potential for transferability, with effect estimates considered relevant, and with good feasibility for implementation in Sweden.

CONCLUSIONS

Interventions targeting alcohol- and illicit-drug use and tobacco use are cost-effective approaches, and results may be transferred to the Swedish setting. Caution must be taken regarding cost estimates and the quality of the evidence which the studies are based upon.

Expert opinions on good practice in evaluation of health promotion and primary prevention measures related to children and adolescents in Germany

Background

Determining what constitutes “good practice” in the measurement of the costs and effects of health promotion and disease prevention measures is of particular importance. The aim of this paper was to gather expert knowledge on (economic) evaluations of health promotion and prevention measures for children and adolescents, especially on the practical importance, the determinants of project success, meaningful parameters for evaluations, and supporting factors, but also on problems in their implementation. This information is targeted at people responsible for the development of primary prevention or health promotion programs.

Methods

Partially structured open interviews were conducted by two interviewers and transcribed, paraphrased, and summarized for further use. Eight experts took part in the interviews.

Results

The interviewed experts saw evaluation as a useful tool to establish the effects of prevention programs, to inform program improvement and further development, and to provide arguments to decision making. The respondents’ thought that determinants of a program’s success were effectiveness with evidence of causality, cost benefit relation, target-group reach and sustainability. It was considered important that hard and soft factors were included in an evaluation; costs were mentioned only by one expert. According to the experts, obstacles to evaluation were lacking resources, additional labor requirements, and the evaluators’ unfamiliarity with a program’s contents. It was recommended to consider evaluation design before a program is launched, to co-operate with people involved in a program and to make use of existing structures.

Conclusion

While in in this study only a partial view of expert knowledge is represented, it could show important points to consider when developing evaluations of prevention programs. By considering these points, researchers could further advance towards a more comprehensive approach of evaluation targeting measures in children and adolescents.

Model-based economic evaluations in smoking cessation and their transferability to new contexts: a systematic review

AIMS

To identify different types of models used in economic evaluations of smoking cessation, analyse the quality of the included models examining their attributes and ascertain their transferability to a new context.

METHODS

A systematic review of the literature on the economic evaluation of smoking cessation interventions published between 1996 and April 2015, identified via Medline, EMBASE, National Health Service (NHS) Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA). The checklist-based quality of the included studies and transferability scores was based on the European Network of Health Economic Evaluation Databases (EURONHEED) criteria. Studies that were not in smoking cessation, not original research, not a model-based economic evaluation, that did not consider adult population and not from a high-income country were excluded.

FINDINGS

Among the 64 economic evaluations included in the review, the state-transition Markov model was the most frequently used method (n = 30/64), with quality adjusted life years (QALY) being the most frequently used outcome measure in a life-time horizon. A small number of the included studies (13 of 64) were eligible for EURONHEED transferability checklist. The overall transferability scores ranged from 0.50 to 0.97, with an average score of 0.75. The average score per section was 0.69 (range = 0.35-0.92). The relative transferability of the studies could not be established due to a limitation present in the EURONHEED method.

CONCLUSION

All existing economic evaluations in smoking cessation lack in one or more key study attributes necessary to be fully transferable to a new context.

Costs and effects of a state-wide health promotion program in primary schools in Germany - the Baden-Württemberg Study: A cluster-randomized, controlled trial

AIM

To evaluate the cost-effectiveness of the state-wide implementation of the health promotion program "Join the Healthy Boat" in primary schools in Germany.

METHODS

Cluster-randomized intervention trial with wait-list control group. Anthropometric data of 1733 participating children (7.1 ± 0.6 years) were taken by trained staff before and after a one year intervention period in the academic year 2010/11. Parents provided information about the health status, and the health behaviour of their children and themselves, parental anthropometrics, and socio-economic background variables. Incidence of abdominal obesity, defined as waist-to-height ratio (WHtR) ≥ 0.5, was determined. Generalized linear models were applied to account for the clustering of data within schools, and to adjust for baseline-values. Losses to follow-up and missing data were analysed. From a societal perspective, the overall costs, costs per pupil, and incremental cost-effectiveness ratio (ICER) to identify the costs per case of averted abdominal obesity were calculated.

RESULTS

The final regression model for the incidence of abdominal obesity shows lower odds for the intervention group after an adjustment for grade, gender, baseline WHtR, and breakfast habits (odds ratio = 0.48, 95% CI [0.25; 0.94]). The intervention costs per child/year were €25.04. The costs per incidental case of averted abdominal obesity varied between €1515 and €1993, depending on the different dimensions of the target group.

CONCLUSION

This study demonstrates the positive effects of state-wide, school-based health promotion on incidental abdominal obesity, at affordable costs and with proven cost-effectiveness. These results should support allocative decisions of policymakers. An early start to the prevention of abdominal obesity is of particular importance because of its close relationship to non-communicable diseases.

TRIAL REGISTRATION

German Clinical Trials Register (DRKS), Freiburg University, Germany, DRKS-ID: DRKS00000494.

Cost effectiveness of a multi-component school-based physical activity intervention targeting adolescents: the 'Physical Activity 4 Everyone' cluster randomized trial

BACKGROUND

Few school-based interventions have been successful in reducing physical activity decline and preventing overweight and obesity in adolescent populations. As a result, few cost effectiveness analyses have been reported. The aim of this paper is to report the cost and cost effectiveness of the Physical Activity 4 Everyone (PA4E1) intervention which was a multi-component intervention implemented in secondary schools located in low-income communities. Cost effectiveness was assessed using both the physical activity and weight status trial outcomes.

METHODS

Intervention and Study Design: The PA4E1 cluster randomised controlled trial was implemented in 10 Australian secondary schools (5 intervention: 5 control) and consisted of intervention schools receiving seven physical activity promotion strategies and six additional strategies that supported school implementation of the intervention components. Costs associated with physical activity strategies, and intervention implementation strategies within the five intervention schools were estimated and compared to the costs of usual physical activity practices of schools in the control group. The total cost of implementing the intervention was estimated from a societal perspective, based on the number of enrolled students in the target grade at the start of the intervention (Grade 7, n = 837). Economic Outcomes: The economic analysis outcomes were cost and incremental cost effectiveness ratios for the following: minutes of moderate-to-vigorous physical activity (MVPA) per day gained, MET hours gained per person/day; Body Mass Index (BMI) unit avoided; and 10% reduction in BMI z-score.

RESULTS

The intervention cost AUD $329,952 over 24 months, or AUD$394 per student in the intervention group. This resulted in a cost effectiveness ratio of AUD$56 ($35-$147) per additional minute of MVPA, AUD$1 ($0.6-$2.7) per MET hour gained per person per day, AUD$1408 ($788-$6,570) per BMI unit avoided, and AUD$563 ($282-$3,942) per 10% reduction in BMI z-score.

CONCLUSION

PA4E1 is a cost effective intervention for increasing the physical activity levels and reducing unhealthy weight gain in adolescence, a period in which physical activity typically declines. Additional modelling could explore the potential economic impact of the intervention on morbidity and mortality.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12612000382875.

Quality assessment of economic evaluations of health promotion programs for children and adolescents-a systematic review using the example of physical activity

An increasing number of primary prevention programs aimed at promoting physical exercise in children and adolescents are being piloted. As resources are limited, it is important to ascertain the costs and benefits of such programs. The aim of this systematic review is to evaluate the currently available evidence on the cost-effectiveness of programs encouraging physical activity in children and adolescents and to assess their quality. A systematic review was conducted searching in well established literature databases considering all studies before February 2015. Citation tracking in Google Scholar and a manual search of the reference lists of included studies were used to consolidate this. The fundamental methodological elements of the included economic evaluations were extracted, and the quality of the included studies was evaluated using the Pediatric Quality Appraisal Questionnaire (PQAQ). In total, 14 studies were included. Considering the performance of the economic evaluation, the studies showed wide variation. Most of the studies used a societal perspective for their analyses and discounted costs and effects. The findings ranged from US$11.59 for a person to become more active (cheapest intervention) up to US$669,138 for a disability adjusted life year (DALY) saved (most expensive intervention), with everything in between. Overall, the results of three studies are below a value of US$3061, with one of them even below US$200.00, for the achieved effects. For the other programs, the context-specific assessment of cost-effectiveness is problematic as there are different thresholds for cost-effectiveness in different countries or no clearly defined thresholds at all. There are multiple methodological difficulties involved in evaluating the cost-effectiveness of interventions aimed at increasing physical activity, which results in little consistency between different evaluations. The quality of the evaluations ranged from poor to excellent while a large majority of them was of very good methodological quality. Better comparability could be reached by greater standardization, especially regarding systematic consideration of implementation costs.