Economic evaluation of health promotion for older people-methodological problems and challenges

Incorporating frailty to address the key challenges to geriatric economic evaluation

BACKGROUND

The multidimensional and dynamically complex process of ageing presents key challenges to economic evaluation of geriatric interventions, including: (1) accounting for indirect, long-term effects of a geriatric shock such as a fall; (2) incorporating a wide range of societal, non-health outcomes such as informal caregiver burden; and (3) accounting for heterogeneity within the demographic group. Measures of frailty aim to capture the multidimensional and syndromic nature of geriatric health. Using a case study of community-based falls prevention, this article explores how incorporating a multivariate frailty index in a decision model can help address the above key challenges.

METHODS

A conceptual structure of the relationship between geriatric shocks and frailty was developed. This included three key associations involving frailty: (A) the shock-frailty feedback loop; (B) the secondary effects of shock via frailty; and (C) association between frailty and intervention access. A case study of economic modelling of community-based falls prevention for older persons aged 60 + was used to show how parameterising these associations contributed to addressing the above three challenges. The English Longitudinal Study of Ageing (ELSA) was the main data source for parameterisation. A new 52-item multivariate frailty index was generated from ELSA. The main statistical methods were multivariate logistic and linear regressions. Estimated regression coefficients were inputted into a discrete individual simulation with annual cycles to calculate the continuous variable value or probability of binary event given individuals' characteristics.

RESULTS

All three conceptual associations, in their parameterised forms, contributed to addressing challenge (1). Specifically, by worsening the frailty progression, falls incidence in the model increased the risk of falling in subsequent cycles and indirectly impacted the trajectories and levels of EQ-5D-3 L, mortality risk, and comorbidity care costs. Intervention access was positively associated with frailty such that the greater access to falls prevention by frailer individuals dampened the falls-frailty feedback loop. Association (B) concerning the secondary effects of falls via frailty was central to addressing challenge (2). Using this association, the model was able to estimate how falls prevention generated via its impact on frailty paid and unpaid productivity gains, out-of-pocket care expenditure reduction, and informal caregiving cost reduction. For challenge (3), frailty captured the variations within demographic groups of key model outcomes including EQ-5D-3 L, QALY, and all-cause care costs. Frailty itself was shown to have a social gradient such that it mediated socially inequitable distributions of frailty-associated outcomes.

CONCLUSION

The frailty-based conceptual structure and parameterisation methods significantly improved upon the methods previously employed by falls prevention models to address the key challenges for geriatric economic evaluation. The conceptual structure is applicable to other geriatric and non-geriatric intervention areas and should inform the data selection and statistical methods to parameterise structurally valid economic models of geriatric interventions.

Alternatives to the quality-adjusted life year: How well do they address common criticisms?

OBJECTIVE

To analyze whether other outcome measures used in health technology assessment (HTA) address the criticisms of quality-adjusted life years (QALYs).

DATA SOURCES AND STUDY SETTING

HTA methods guidance from 11 US comparator countries (the G10 and Australia) and six value frameworks from US organizations were reviewed to identify health outcome measures currently used to evaluate the benefits of a drug.

STUDY DESIGN

The study involved a documentary analysis of guidelines to identify outcome measures used by the sampled HTA organizations. Similar outcomes were grouped together into outcome types. Each type was analyzed to determine the extent to which it replicates key advantages and responds to criticisms of QALYs extracted from the literature.

EXTRACTION METHODS

Outcomes were included if guidance from at least one HTA organization identified the outcome as acceptable for HTA. Outcomes measuring or evaluating the benefit, clinical effect, or impact of a drug or health technology was included; methods of calculating costs were excluded.

PRINCIPAL FINDINGS

Seven types of outcome measures were identified falling into three groups: preference-based, single-dimension outcomes, and outcomes using non-health perspectives. Among the seven QALY alternative outcome measures currently used for HTA by the sampled countries, no one outcome measure addresses all the QALY criticisms while retaining the advantageous features of the QALY.

CONCLUSIONS

Proposals to adopt health technology assessment (HTA) to support value-based pricing of prescription drugs in the US have faced pushback over the use of the QALY. There is no single "right" outcome measure, and the criticisms of QALYs apply to other outcome measures used to evaluate health. The measures identified have different features and strengths, which may be appropriate for specific decision making goals, but the QALY remains the best option for decision making that requires comparisons of the overall societal value of health gains.

Outcome domains measured in randomized controlled trials of physical activity for older adults: a rapid review

BACKGROUND

Toward development of a core outcome set for randomized controlled trials (RCTs) of physical activity (PA) interventions for older adults, the purpose of this study was to identify outcome domains and subdomains ('what' was measured) in previously published RCTs of PA for older adults.

METHODS

We conducted a rapid review and searched Ovid MEDLINE for recently- published (2015-2021), English-language, RCTs of PA interventions for older adults (mean age 60+ yrs). We limited to articles published in Web of Science top-10 journals in general and internal medicine, geriatrics and gerontology, rehabilitation, and sports science. Two reviewers independently completed eligibility screening; two other reviewers abstracted trial descriptors and study outcomes. We classified study outcomes according to the standard outcome classification taxonomy endorsed by the Core Outcome Measures in Effectiveness Trials Initiative.

RESULTS

Our search yielded 548 articles; 67 articles were eligible to be included. Of these, 82% were efficacy/effectiveness trials, 85% included both male and female participants, and 84% recruited community-dwelling older adults. Forty percent of articles reported on interventions that involved a combination of group and individual PAs, and 60% involved a combination of PA modes (e.g., aerobic, resistance). Trial sample size ranged from 14 to 2157 participants, with median (IQR) of 94 (57-517); 28,649 participants were included across all trials. We identified 21 unique outcome domains, spanning 4/5 possible core areas (physiological/clinical; life impact; resource use; adverse events). The five most commonly reported outcome domains were physical functioning (included in n=51 articles), musculoskeletal and connective tissue (n=30), general (n=26), cognitive functioning (n=16), and emotional functioning/wellbeing (n=14). Under these five outcome domains, we further identified 10 unique outcome subdomains (e.g., fall-related; body composition; quality of life). No outcome domains or subdomains were reported consistently in all RCTs.

CONCLUSIONS

We found extensive variability in outcome domains and subdomains used in RCTs of PA for older adults, reflecting the broad range of potential health benefits derived from PA and also investigator interest to monitor a range of safety parameters related to adverse events. This study will inform development of a core outcome set to improve outcome reporting consistency and evidence quality.

Moving Beyond Quality-Adjusted Life-Years in Elderly Care: How Can Multicriteria Decision Analysis Complement Cost-Effectiveness Analysis in Local-Level Decision Making

OBJECTIVES

This study aimed to investigate how multicriteria decision analysis (MCDA) could complement cost-effectiveness analysis (CEA) to support investment decisions in elderly care at local level.

METHODS

We used an integrated elderly care program in The Netherlands as a case study to demonstrate the application of both methods. In a 12-month quasi-experimental study (n = 384), data on the following outcome measures were collected: quality-adjusted life-years (CEA) and physical functioning, psychological well-being, social relationships and participation, enjoyment of life, resilience, person centeredness, continuity of care, and costs (MCDA). We performed regression analysis on inversed probability weighted data and controlled for potential confounders to obtain a double robust estimate of the outcomes. Probabilistic sensitivity analyses determined uncertainty for both methods.

RESULTS

The integrated elderly care program was not likely (ie, 36%) to be cost-effective according to the CEA (incremental cost-effectiveness ratios: €88 249 from a societal perspective) using the conventional Dutch willingness-to-pay threshold (ie, €50 000). The MCDA demonstrated that informal caregivers and professionals slightly preferred the intervention over usual care, driven by enjoyment of life and person centeredness. Patients did not prefer either the intervention or usual care, whereas payers and policy makers slightly preferred usual care, mainly due to higher costs of the intervention.

CONCLUSIONS

MCDA could provide local-level decision makers with a broader measurement of effectiveness by including outcomes beyond health and longevity and the preferences of multiple stakeholders. This additional information could foster the acceptability and implementability of cost-effective innovations in elderly care.

Understanding Health Economics in Joint Replacement Surgery

The number of arthroplasty procedures has been rising at a significant rate, contributing to a notable portion of the nation's health care spending. This growth has contributed to an increase in the number of health care economic studies in the field of adult reconstruction surgery. Although these articles are filled with important information, they can be difficult to understand without a background in business or economics. The goal of this review is to define the common terminology used in health care economic studies, assess their value and benefit in the context of total joint arthroplasty, and highlight shortcomings in the current literature. [Orthopedics. 2022;45(4):e174-e182.].

Systematic review and critical methodological appraisal of community-based falls prevention economic models

BACKGROUND

Falls impose significant health and economic burdens on community-dwelling older persons. Decision modelling can inform commissioning of alternative falls prevention strategies. Several methodological challenges arise when modelling public health interventions including community-based falls prevention. This study aims to conduct a systematic review (SR) to: systematically identify community-based falls prevention economic models; synthesise and critically appraise how the models handled key methodological challenges associated with public health modelling; and suggest areas for further methodological research.

METHODS

The SR followed the 2021 PRISMA reporting guideline and covered the period 2003-2020 and 12 academic databases and grey literature. The extracted methodological features of included models were synthesised by their relevance to the following challenges: (1) capturing non-health outcomes and societal intervention costs; (2) considering heterogeneity and dynamic complexity; (3) considering theories of human behaviour and implementation; and (4) considering equity issues. The critical appraisal assessed the prevalence of each feature across models, then appraised the methods used to incorporate the feature. The methodological strengths and limitations stated by the modellers were used as indicators of desirable modelling practice and scope for improvement, respectively. The methods were also compared against those suggested in the broader empirical and methodological literature. Areas of further methodological research were suggested based on appraisal results.

RESULTS

46 models were identified. Comprehensive incorporation of non-health outcomes and societal intervention costs was infrequent. The assessments of heterogeneity and dynamic complexity were limited; subgroup delineation was confined primarily to demographics and binary disease/physical status. Few models incorporated heterogeneity in intervention implementation level, efficacy and cost. Few dynamic variables other than age and falls history were incorporated to characterise the trajectories of falls risk and general health/frailty. Intervention sustainability was frequently based on assumptions; few models estimated the economic/health returns from improved implementation. Seven models incorporated ethnicity- and severity-based subgroups but did not estimate the equity-efficiency trade-offs. Sixteen methodological research suggestions were made.

CONCLUSION

Existing community-based falls prevention models contain methodological limitations spanning four challenge areas relevant for public health modelling. There is scope for further methodological research to inform the development of falls prevention and other public health models.

Economic evaluation of community-based falls prevention interventions for older populations: a systematic methodological overview of systematic reviews

Background

Falls impose significant health and economic burdens on older people. The volume of falls prevention economic evaluations has increased, the findings from which have been synthesised by systematic reviews (SRs). Such SRs can inform commissioning and design of future evaluations; however, their findings can be misleading and incomplete, dependent on their pre-specified criteria. This study aims to conduct a systematic overview (SO) to: (1) systematically identify SRs of community-based falls prevention economic evaluations; (2) describe the methodology and findings of SRs; (3) critically appraise the methodology of SRs; and (4) suggest commissioning recommendations based on SO findings.

Methods

The SO followed the PRISMA guideline and the Cochrane guideline on SO, covering 12 databases and grey literature for the period 2003–2020. Eligible studies were SRs with 50% or more included studies that were economic evaluations of community-based falls prevention (against any comparator) for older persons (aged 60 +) or high-risk individuals aged 50–59. Identified SRs’ aims, search strategies and results, extracted data fields, quality assessment methods/results, and commissioning and research recommendations were synthesised. The comprehensiveness of previous SRs’ data synthesis was judged against criteria drawn from literature on falls prevention/public health economic evaluation. Outcomes of general population, lifetime decision models were re-analysed to inform commissioning recommendations. The SO protocol is registered in the Prospective Register of Systematic Reviews (CRD42021234379).

Results

Seven SRs were identified, which extracted 8 to 33 data fields from 44 economic evaluations. Four economic evaluation methodological/reporting quality checklists were used; three SRs narratively synthesised methodological features to varying extent and focus. SRs generally did not appraise decision modelling features, including methods for characterising dynamic complexity of falls risk and intervention need. Their commissioning recommendations were based mainly on cost-per-unit ratios (e.g., incremental cost-effectiveness ratios) and neglected aggregate impact. There is model-based evidence of multifactorial and environmental interventions, home assessment and modification and Tai Chi being cost-effective but also the risk that they exacerbate social inequities of health.

Conclusions

Current SRs of falls prevention economic evaluations do not holistically inform commissioning and evaluation. Accounting for broader decisional factors and methodological nuances of economic evaluations, particularly decision models, is needed.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07764-2.

Projecting the long-term societal value of a disease-modifying treatment for Alzheimer's disease in the United States

Introduction

We estimate societal value of a disease‐modifying Alzheimer's disease (AD) treatment that reduces progression by 30% in early stages.

Methods

Using the International Society for Pharmacoeconomics and Outcomes Research value flower as framework, we estimate gross societal value, that is, not including treatment cost, from avoided medical and social care costs, productivity and quality‐adjusted life‐years (QALY) gains for patients and caregivers, adjusting for severity of disease, value of financial insurance, and value of insurance for currently unafflicted adults with a Markov model.

Results

Predicted societal value from 2021 until 2041 is $2.62 trillion for the overall afflicted US population and $986 billion for the 2021 prevalent cohort or $134,418 per person, with valuation of patients’ QALY gains (63%) and avoided nursing‐home costs (20%) as largest components. Delays in access because of health system capacity constraints could reduce realized value between 52% and 69%. The value of insurance for the unafflicted is $4.52 trillion or $18,399 on average per person.

Discussion

With a total of $5.5 trillion, the projected gross societal value of a hypothetical AD treatment is substantial, which may help to put the cost of treatment into perspective.

The application of the QALY measure in the assessment of the effects of health interventions on an older population: a systematic scoping review

Background

One of the most commonly used types of evaluation methods is cost-utility analysis (CUA), using the Quality Adjusted Life Year (QALY) indicator as a preference-based measure for assessing effects of a given programme. Such assessments are often translated into health-care provision priorities; therefore, effectively choosing the method of outcome evaluation is crucial for ensuring the best possible allocation of scarce resources. The main objective of this scoping review is to identify what kinds of problems and limitations may occur when the QALY indicator is used to assess the effects of health interventions in the older population.

Methods

To identify literature in a scoping review, the databases MEDLINE via PubMed and Scopus were searched. A manual search on relevant organizations’ and associations’ websites was also conducted (EUnetHTA, ISPOR and national governmental agencies responsible for allocation decisions). No limits concerning publication dates were set. All relevant data were extracted and analyzed, then a narrative summary was prepared.

Results

The database search identified 10,832 relevant items, finally 32 studies were included in the analysis. The main types of issues indicated in the studies were as follows: (1) lower life expectancy in the older population causes lower QALY gains; (2) an equal value of one QALY is used regardless of age; (3) poorer average health state causes lower QALY gains; (4) inadequate instruments to measure quality of life (QoL); (5) attributes of QoL used regardless of age; and (6) no beyond-health QoL aspects taken into account.

Conclusions

This review shows clearly that many problems of different types are connected with using QALY for the older population, but there is no consensus as to whether QALY discriminates against the older population or not – an opinion regarding this issue depends strongly on accepted principles, particularly the approach to equity and how one understands fairness. Health care resources should not be allocated solely on the basis of the health maximization rule because this can lead to discrimination against certain groups (e.g., older, disabled, and/or chronically ill people). To maintain the balance between efficiency and equity, the issues connected with age-based rationing should be widely discussed.

Evaluation of the Cost-effectiveness of Drug Treatment for Alzheimer Disease in a Simulation Model That Includes Caregiver and Societal Factors

IMPORTANCE

The possibility of widespread use of a novel effective therapy for Alzheimer disease (AD) will present important clinical, policy, and financial challenges.

OBJECTIVE

To describe how including different patient, caregiver, and societal treatment-related factors affects estimates of the cost-effectiveness of a hypothetical disease-modifying AD treatment.

DESIGN, SETTING, AND PARTICIPANTS

In this economic evaluation, the Alzheimer Disease Archimedes Condition Event Simulator was used to simulate the prognosis of a hypothetical cohort of patients selected from the Alzheimer Disease Neuroimaging Initiative database who received the diagnosis of mild cognitive impairment (MCI). Scenario analyses that varied costs and quality of life inputs relevant to patients and caregivers were conducted. The analysis was designed and conducted from June 15, 2019, to September 30, 2020.

EXPOSURES

A hypothetical drug that would delay progression to dementia in individuals with MCI compared with usual care.

MAIN OUTCOMES AND MEASURES

Incremental cost-effectiveness ratio (ICER), measured by cost per quality-adjusted life-year (QALY) gained.

RESULTS

The model included a simulated cohort of patients who scored between 24 and 30 on the Mini-Mental State Examination and had a global Clinical Dementia Rating scale of 0.5, with a required memory box score of 0.5 or higher, at baseline. Using a health care sector perspective, which included only individual patient health care costs, the ICER for the hypothetical treatment was $192 000 per QALY gained. The result decreased to $183 000 per QALY gained in a traditional societal perspective analysis with the inclusion of patient non-health care costs. The inclusion of estimated caregiver health care costs produced almost no change in the ICER, but the inclusion of QALYs gained by caregivers led to a substantial reduction in the ICER for the hypothetical treatment, to $107 000 per QALY gained in the health sector perspective. In the societal perspective scenario, with the broadest inclusion of patient and caregiver factors, the ICER decreased to $74 000 per added QALY.

CONCLUSIONS AND RELEVANCE

The findings of this economic evaluation suggest that policy makers should be aware that efforts to estimate and include the effects of AD treatments outside those on patients themselves can affect the results of the cost-effectiveness analyses that often underpin assessments of the value of new treatments. Further research and debate on including these factors in assessments that will inform discussions on fair pricing for new treatments are needed.

Estimating the cost of implementing a facility and community score card for maternal and newborn care service delivery in a rural district in Uganda

INTRODUCTION

This paper aimed at estimating the resources required to implement a community Score Card by a typical rural district health team in Uganda, as a mechanism for fostering accountability, utilization and quality of maternal and child healthcare service.

METHODS

This costing analysis was done from the payer's perspective using the ingredients approach over five quarterly rounds of scoring between 2017 and 2018. Expenditure data was obtained from project records, entered and analyzed in Microsoft excel. Two scale-up scenarios, scenario one (considered cost inputs by the MakSPH research teams) and scenario two (considering cost inputs based on contextual knowledge from district implementing teams), were simulated to better understand the cost implications of integrating the Community Score Card (CSC) into a district health system.

RESULTS

The total and average cost of implementing CSC for five quarterly rounds over a period of 18 months were USD 59,962 and USD 11,992 per round of scoring, respectively. Considering the six sub-counties (including one Town Council) in Kibuku district that were included in this analysis, the average cost of implementating the CSC in each sub-county was USD 1998 per scoring round. Scaling-up of the intervention across the entire district (included 22 sub-counties) under the first scenario would cost a total of USD 19,003 per scoring round. Under the second scaleup scenario, the cost would be lower at USD 7116. The total annual cost of scaling CSC in the entire district would be USD 76,012 under scenario one compared to USD 28,465 under scenario two. The main cost drivers identified were transportation costs, coordination and supervision costs, and technical support to supplement local implementers.

CONCLUSION

Our analysis suggests that it is financially feasible to implement and scale-up the CSC initiative, as an accountability tool for enhancing service delivery. However, the CSC design and approach needs to be embedded within local systems and implemented in collaboration with existing stakeholders so as to optimise costs. A comprehensive economic analysis of the costs associated with transportation, involvement of the district teams in coordination, supervision as well as provision of technical support is necessary to determine the cost-effectiveness of the CSC approach.

Modelling the value of innovative treatments for Alzheimer's disease in the United States

Alzheimer's disease (AD) is the predominant cause of dementia and a leading cause of death globally. With no cure or treatment to slow disease progression, AD-related healthcare costs are substantial and increase as the severity of the disease progresses. Given the complexity of this disease, including initial pathophysiological damage occurring decades before clinical manifestation, finding new impactful treatments for AD relies on highly innovative research and development. However, such sizable and sustained investments bring into question whether conventional value assessment models are fit for this purpose. In this article, we examine the importance and challenges of assimilating the perspectives of varied stakeholders, including patients, caregivers, health systems, payers, and society at large, into a comprehensive value assessment model that may be well suited for a breakthrough treatment for AD.

The need to incorporate the impact of population ageing into the post-COVID-19 policy and planning reset in Low and Middle Income Countries

The COVID-19 pandemic is likely to widen the health care demand-supply gap, especially in low- and middle-income countries (LMICs). The virus has had the greatest impact on older persons in terms of morbidity and mortality, and is occurring at a time of rapid population ageing, which is happening three times faster in LMICs than in high-income countries. Addressing the demand-supply gap in a post-COVID-19 era, in which resources are further constrained, will require a major 'reset' of the health system. In this article, we argue that the impact of ageing populations needs to be factored into the post-COVID-19 policy and planning reset including explicit, transparent prioritisation processes.

Improving access to community-based pulmonary rehabilitation: 3R protocol for real-world settings with cost-benefit analysis

Background

Pulmonary rehabilitation (PR) has demonstrated patients’ physiological and psychosocial improvements, symptoms reduction and health-economic benefits whilst enhances the ability of the whole family to adjust to illness. However, PR remains highly inaccessible due to lack of awareness of its benefits, poor referral and availability mostly in hospitals. Novel models of PR delivery are needed to enhance its implementation while maintaining cost-efficiency. We aim to implement an innovative community-based PR programme and assess its cost-benefit.

Methods

A 12-week community-based PR will be implemented in primary healthcare centres where programmes are not available. Healthcare professionals will be trained. 73 patients with CRD and their caregivers (dyads patient-caregivers) will compose the experimental group. The control group will include dyads age- and disease-matched willing to collaborate in data collection but not in PR. Patients/family-centred outcomes will be dyspnoea (modified Medical Research Council Questionnaire), fatigue (Checklist of individual strength and Functional assessment of chronic illness therapy – fatigue), cough and sputum (Leicester cough questionnaire and Cough and sputum assessment questionnaire), impact of the disease (COPD Assessment Test), emotional state (The Hospital Anxiety and Depression Scale), number of exacerbations, healthcare utilisation, health-related quality of life and family adaptability/cohesion (Family Adaptation and Cohesion Scale). Other clinical outcomes will be peripheral (biceps and quadriceps-hand held dynamometer, 1 or 10 repetition-maximum) and respiratory (maximal inspiratory and expiratory pressures) muscle strength, muscle thickness and cross sectional area (biceps brachialis, rectus femoris and diaphragm-ultrasound imaging), exercise capacity (six-minute walk test and one-minute sit to stand test), balance (brief-balance evaluation systems test) and physical activity (accelerometer). Data will be collected at baseline, at 12 weeks, at 3- and 6-months post-PR.

Changes in the outcome measures will be compared between groups, after multivariate adjustment for possible confounders, and effect sizes will be calculated. A cost-benefit analysis will be conducted.

Discussion

This study will enhance patients access to PR, by training healthcare professionals in the local primary healthcare centres to conduct such programmes and actively involving caregivers. The cost-benefit analysis of this intervention will provide an evidence-based insight into the economic benefit of community-based PR in chronic respiratory diseases.

Trial registration

The trial was registered in the ClinicalTrials.gov U.S. National Library of Medicine, on 10th January, 2019 (registration number: NCT03799666).

Electronic supplementary material

The online version of this article (10.1186/s12889-019-7045-1) contains supplementary material, which is available to authorized users.

Economic evaluation of health promotion interventions for older people: do applied economic studies meet the methodological challenges?

BACKGROUND

In the light of demographic developments health promotion interventions for older people are gaining importance. In addition to methodological challenges arising from the economic evaluation of health promotion interventions in general, there are specific methodological problems for the particular target group of older people. There are especially four main methodological challenges that are discussed in the literature. They concern measurement and valuation of informal caregiving, accounting for productivity costs, effects of unrelated cost in added life years and the inclusion of 'beyond-health' benefits. This paper focuses on the question whether and to what extent specific methodological requirements are actually met in applied health economic evaluations.

METHODS

Following a systematic review of pertinent health economic evaluations, the included studies are analysed on the basis of four assessment criteria that are derived from methodological debates on the economic evaluation of health promotion interventions in general and economic evaluations targeting older people in particular.

RESULTS

Of the 37 studies included in the systematic review, only very few include cost and outcome categories discussed as being of specific relevance to the assessment of health promotion interventions for older people. The few studies that consider these aspects use very heterogeneous methods, thus there is no common methodological standard.

CONCLUSION

There is a strong need for the development of guidelines to achieve better comparability and to include cost categories and outcomes that are relevant for older people. Disregarding these methodological obstacles could implicitly lead to discrimination against the elderly in terms of health promotion and disease prevention and, hence, an age-based rationing of public health care.

Five indicators were developed to assess the quality of reviews on preventive interventions

OBJECTIVES

The objective of the study was to develop quality indicators for preventive effectiveness and to evaluate their use with Cochrane Reviews of primary preventive interventions.

STUDY DESIGN AND SETTING

Based on the quality of care framework, we searched the literature to develop a set of quality indicators. Two authors applied the quality indicators independently to a sample of Cochrane systematic reviews of primary prevention.

RESULTS

Five quality indicators were developed: sample size, directness of evidence, adherence, harm, and costs. We applied the quality indicators to a random sample of 84 of a total of 264 Cochrane reviews of primary preventive interventions. Only 70% reviews (n = 59) complied with the indicator sample size, whereas 61% (n = 51) complied with directness of the outcome, 48% (n = 40) with adherence, 76% (n = 64) with harm, and 46% (n = 39) with the indicator cost.

CONCLUSION

Applying the five quality indicators is feasible. The quality of evidence in reviews of primary prevention can be substantially improved. Trialists and review authors should provide more information especially on adherence, costs, and indirectness of the outcome. Methodological research is needed on how to incorporate cost information in systematic reviews and how to better deal with indirectness.