Use of progression criteria to support monitoring and commissioning decision making of public health services: lessons from Better Start Bradford

BACKGROUND

Commissioning and monitoring of community-based interventions is a challenge due to the complex nature of the environment and the lack of any explicit cut-offs to guide decision making. At what point, for example, is participant enrolment to interventions, course completion or satisfaction deemed to be acceptable or sufficient for continued funding? We aimed to identify and quantify key progression criteria for fourteen early years interventions by (1) agreeing the top three criteria for monitoring of successful implementation and progress; and (2) agreeing boundaries to categorise interventions as 'meeting anticipated target' (green); 'falling short of targets' (amber) and 'targets not being met' (red).

METHODS

We ran three workshops in partnership with the UK's Big Lottery Fund commissioned programme 'Better Start Bradford' (implementing more than 20 interventions to improve the health, wellbeing and development of children aged 0-3) to support decision making by agreeing progression criteria for the interventions being delivered. Workshops included 72 participants, representing a range of professional groups including intervention delivery teams, commissioners, intervention-monitoring teams, academics and community representatives. After discussion and activities, final decisions were submitted using electronic voting devices. All participants were invited to reconsider their responses via a post-workshop questionnaire.

RESULTS

Three key progression criteria were assigned to each of the 14 interventions. Overall, criteria that participants most commonly voted for were recruitment, implementation and reach, but these differed according to each intervention. Cut-off values used to indicate when an intervention moved to 'red' varied by criteria; the lowest being for recruitment, where participants agreed that meeting less than 65% of the targeted recruitment would be deemed as 'red' (falling short of target).

CONCLUSIONS

Our methodology for monitoring the progression of interventions has resulted in a clear pathway which will support commissioners and intervention teams in local decision making within the Better Start Bradford programme and beyond. This work can support others wishing to implement a formal system for monitoring the progression of public health interventions.

Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol

Background

Group-based early parenting interventions delivered through community-based services may be a potentially effective means of promoting infant and family health and wellbeing. Process evaluations of these complex interventions provide vital information on how they work, as well as the conditions which shape and influence outcomes. This information is critical to decision makers and service providers who wish to embed prevention and early interventions in usual care settings. In this paper, a process evaluation protocol for an early years parenting intervention, the Parent and Infant (PIN) program, is described. This program combines a range of developmentally-appropriate supports, delivered in a single intervention process, for parents and infants (0–2 years) and aimed at enhancing parental competence, strengthening parent-infant relationships and improving infant wellbeing and adjustment.

Methods

The process evaluation is embedded within a controlled trial and accompanying cost-effectiveness evaluation. Building from extant frameworks and evaluation methods, this paper presents a systematic approach to the process evaluation of the PIN program and its underlying change principles, the implementation of the program, the context of implementation and the change mechanisms which influence and shape parent and infant outcomes. We will use a multi-method strategy, including semi-structured interviews and group discussions with key stakeholders, documentary analysis and survey methodology.

Discussion

The integration of innovations into existing early years systems and services is a challenging multifaceted undertaking. This process evaluation will make an important contribution to knowledge about the implementation of such programs, while also providing an example of how theory-based research can be embedded within the evaluation of community-based interventions. We discuss the strengths of the research, such as the adoption of a collaborative approach to data collection, while we also identify potential challenges, including capturing and assessing complex aspects of the intervention.

Trial registration

ISRCTN17488830 (Date of registration: 27/11/15). This trial was retrospectively registered.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1737-3) contains supplementary material, which is available to authorized users.