Evaluation of community-based injury prevention programmes: methodological issues and challenges

Is Sweden still a role model for safety? An overview of unintentional injury data over the past two decades

This study investigates injury-related mortality and hospitalisations, during 1987-2007 in Sweden. Injuries were classified according to International Classification of Diseases (ICD)--8 for pre-1987 injuries, ICD-9 for 1987-1996 injuries and ICD-10 for injuries occurring in 1997 and later. Data on mortality from injuries during 1987-2007 were collected from Sweden's national Cause-of-Death Register, while data concerning injury diagnoses leading to hospitalisation stays of at least 24 h, occurring during 1987-2007, were obtained from the national Patient Register. Crude rates were derived for injury-related deaths and injury-related hospitalisations for age-gender groups, using population data from Statistics Sweden. Our results showed a mixed picture of injury-related hospitalisations and deaths over the study period. Absolute numbers of injury-related deaths and injury-related hospitalisations decreased over time for the population as a whole and for many, but not all, age-gender groups. When assessing crude injury-related death rates and crude injury-related hospitalisation rates over time, as categorised by gender and age groupings, we also found unchanging or increased risks for injury-related deaths and/or hospitalisations for several age-gender groups. While Sweden has made remarkable progress in reducing injury-related deaths and hospitalisations, there are clear differences in risk that remain.

Why isn't more injury prevention evidence-based?

The focus on evidence-based practice is critical to addressing the issue of injuries, yet advances in the science of injury prevention have not always led to advances in practice. Effective approaches are not always adopted, or when adopted and transferred from one setting to another, they do not always achieve expected results. These challenges were the basis of two breakout sessions at the second European Injury Control and Safety Promotion Conference in Paris, France (October 2008). In summarising the key issues raised during those sessions, this article describes what is meant by evidence-based practice, discusses why evidence-based practice tends not to occur and considers approaches that may facilitate the adoption and implementation of evidence-based strategies. To address the challenge, specific action is required, both on the part of the research community and those responsible for developing and implementing injury prevention policies and programmes.

Population-based prevention of child maltreatment: the U.S. Triple p system population trial

The prevention of child maltreatment necessitates a public health approach. In the U.S. Triple P System Population Trial, 18 counties were randomly assigned to either dissemination of the Triple P-Positive Parenting Program system or to the services-as-usual control condition. Dissemination involved Triple P professional training for the existing workforce (over 600 service providers), as well as universal media and communication strategies. Large effect sizes were found for three independently derived population indicators: substantiated child maltreatment, child out-of-home placements, and child maltreatment injuries. This study is the first to randomize geographical areas and show preventive impact on child maltreatment at a population level using evidence-based parenting interventions.

Quantifying the effect of a community-based injury prevention program in Queensland using a generalized estimating equation approach

OBJECTIVE

To develop a generalized estimating equation (GEE) model of childhood injury rates to quantify the effectiveness of a community-based injury prevention program implemented in 2 communities in Australia, in order to contribute to the discussion of community-based injury prevention program evaluation.

DESIGN

An ecological study was conducted comparing injury rates in two intervention communities in rural and remote Queensland, Australia, with those of 16 control regions. A model of childhood injury was built using hospitalization injury rate data from 1 July 1991 to 30 June 2005 and 16 social variables. The model was built using GEE analysis and was used to estimate parameters and to test the effectiveness of the intervention.

RESULTS

When social variables were controlled for, the intervention was associated with a decrease of 0.09 injuries/10,000 children aged 0-4 years (95% CI -0.29 to 0.11) in logarithmically transformed injury rates; however, this decrease was not significant (p = 0.36).

CONCLUSIONS

The evaluation methods proposed in this study provide a way of determining the effectiveness of a community-based injury prevention program while considering the effect of baseline differences and secular changes in social variables.

The theory of community based health and safety programs: a critical examination

This paper examines the theoretical underpinning of the community based approach to health and safety programs. Drawing upon the literature, a theory is constructed by elucidating assumptions of community based programs. The theory is then put to test by analyzing the extent to which the assumptions are supported by empirical evidence and the extent to which the assumptions have been applied in community based injury prevention practice. Seven principles representing key assumptions of the community based approach to health and safety programs are identified. The analysis suggests that some of the principles may have important shortcomings. Programs overwhelmingly define geographical or geopolitical units as communities, which is problematic considering that these entities can be heterogeneous and characterized by a weak sense of community. This may yield insufficient community mobilization and inadequate program reach. At the same time, none of the principles identified as most plausible appears to be widely or fully applied in program practice. The implication is that many community based health and safety programs do not function at an optimum level, which could explain some of the difficulties in demonstrating effectiveness seen with many of these programs.

Effectiveness of community-based injury prevention. Long-term injury rate levels, changes, and trends for 14 Swedish WHO-designated Safe Communities

This study investigates the injury rate levels, changes, and trends between 1987 and 2002 for the 14 Swedish municipalities designated as WHO Safe Communities. The injury rate was defined as the number of injured patients discharged from hospital per 1000 persons. Injury rates were age standardised. Each municipality was compared with its respective municipality group, according to a classification of Sweden's 288 municipalities into nine groups based on numerous structural parameters. The average injury rate levels for the 14 WHO-designated Safe Community municipalities ranged from 11.54 to 19.09 per 1000 population during the study period, which was defined as the time period during which a municipality's injury prevention program has been operational. Eleven of 14 municipalities had higher levels than their corresponding municipality groups. Five of the 14 municipalities "outperformed" their respective municipality groups and achieved a greater relative injury rate decrease during the study period. The trends for the 14 municipalities in relation to their municipality groups showed an inconsistent pattern, with only four municipalities exhibiting overall favourable trends for the study period.

Targeting evaluations of youth development-oriented community partnerships

Community-based partnerships (CBPs) focused on youth development (YD) have the potential to improve public health outcomes. These partnerships also present opportunities for the design and implementation of innovative, community-level change strategies, which ultimately may result in new capacities for positive YD. Evaluation-driven learning and improvement frameworks facilitate the achievement of these partnership-related benefits. Partnerships are complex because they embody multiple levels of intervention (eg, youth-serving programs, youth participation as partners or evaluators, network development for collaborative projects and resource sharing, YD-oriented organizational or community policy change). This inherent complexity transfers to evaluations of CBPs. This article provides resources for meeting evaluation-related challenges. It includes a framework for articulating relevant evaluation questions for YD-oriented CBPs, a summary of relevant types of evaluation studies, and practical solutions to common evaluation problems using targeted evaluation studies. Concrete examples of relevant, small-scale evaluation studies are provided throughout.