Study protocol: a mixed-methods realist evaluation of the Universal Health Visiting Pathway in Scotland

Development of an outcome indicator framework for a universal health visiting programme using routinely collected data

BACKGROUND

Universal health visiting has been a cornerstone of preventative healthcare for children in the United Kingdom (UK) for over 100 years. In 2016, Scotland introduced a new Universal Health Visiting Pathway (UHVP), involving a greater number of contacts with a particular emphasis on the first year, visits within the home setting, and rigorous developmental assessment conducted by a qualified Health Visitor. To evaluate the UHVP, an outcome indicator framework was developed using routine administrative data. This paper sets out the development of these indicators.

METHODS

A logic model was produced with stakeholders to define the group of outcomes, before further refining and aligning of the measures through discussions with stakeholders and inspection of data. Power calculations were carried out and initial data described for the chosen indicators.

RESULTS

Eighteen indicators were selected across eight outcome areas: parental smoking, breastfeeding, immunisations, dental health, developmental concerns, obesity, accidents and injuries, and child protection interventions. Data quality was mixed. Coverage of reviews was high; over 90% of children received key reviews. Individual item completion was more variable: 92.2% had breastfeeding data at 6-8 weeks, whilst 63.2% had BMI recorded at 27-30 months. Prevalence also varied greatly, from 1.3% of children's names being on the Child Protection register for over six months by age three, to 93.6% having received all immunisations by age two.

CONCLUSIONS

Home visiting services play a key role in ensuring children and families have the right support to enable the best start in life. As these programmes evolve, it is crucial to understand whether changes lead to improvements in child outcomes. This paper describes a set of indicators using routinely-collected data, lessening additional burden on participants, and reducing response bias which may be apparent in other forms of evaluation. Further research is needed to explore the transferability of this indicator framework to other settings.

A Low-Cost Method for Understanding How Nature-Based Early Learning and Childcare Impacts Children's Health and Wellbeing

Nature-based play and learning provision is becoming increasingly popular across the early learning and childcare (ELC) sector in Scotland. However, there remains a lack of understanding of how the program is expected to function. This has implications for program learning and may affect wider rollout of the program. Secondary data analysis of parent interviews (n = 22) and observations (n = 7) in Scottish ELC settings, and review of internationally published studies (n = 33) were triangulated to develop a program theory using the Theory of Change approach. This approach makes a program's underlying assumptions explicit by systematically demonstrating the relationship between each component: inputs, activities, outcomes, impact, and the contexts of the program. Findings suggested that location of outdoor nature space, affordances, availability of trained practitioners, and transport to location lead to activities such as free play, educator-led activities, and interactions with nature, resulting in longer durations of physical activity, interactions with peers and educators, and increased engagement with the natural environment. These activities are vital for supporting children's physical, cognitive, social, and emotional development. Our results demonstrate the value of using secondary data analysis to improve our understanding of the underlying theory of nature-based ELC which can support future evaluation designs. These findings will be of interest to program evaluators, researchers, practitioners, and funders, who find themselves with limited resources and want to better understand their program before investing in an evaluation. We encourage researchers and evaluators in the field of early years and outdoor play in other countries to refine this logic model in their own context-specific setting.

Variation in health visiting contacts for children in England: cross-sectional analysis of the 2-2½ year review using administrative data (Community Services Dataset, CSDS)

OBJECTIVE

The 2-2½ year universal health visiting review in England is a key time point for assessing child development and promoting school readiness. We aimed to ascertain which children were least likely to receive their 2-2½ year review and whether there were additional non-mandated contacts for children who missed this review.

DESIGN, SETTING, PARTICIPANTS

Cross-sectional analysis of the 2-2½ year review and additional health visiting contacts for 181 130 children aged 2 in England 2018/2019, stratified by ethnicity, deprivation, safeguarding vulnerability indicator and Looked After Child status.

ANALYSIS

We used data from 33 local authorities submitting highly complete data on health visiting contacts to the Community Services Dataset. We calculated the percentage of children with a recorded 2-2½ year review and/or any additional health visiting contacts and average number of contacts, by child characteristic.

RESULTS

The most deprived children were slightly less likely to receive a 2-2½ year review than the least deprived children (72% vs 78%) and Looked After Children much less likely, compared with other children (44% vs 69%). When all additional contacts were included, the pattern was reversed (deprivation) or disappeared (Looked After children). A substantial proportion of all children (24%), children with a 'safeguarding vulnerability' (22%) and Looked After children (29%) did not have a record of either a 2-2½ year review or any other face-to-face contact in the year.

CONCLUSIONS

A substantial minority of children aged 2 with known vulnerabilities did not see the health visiting team at all in the year. Some higher need children (eg, deprived and Looked After) appeared to be seeing the health visiting team but not receiving their mandated health review. Further work is needed to establish the reasons for this, and potential solutions. There is an urgent need to improve the quality of national health visiting data.