Lessons learned from using linked administrative data to evaluate the Family Nurse Partnership in England and Scotland

Intensive home visiting for adolescent mothers in the Family Nurse Partnership in England 2010-2019: a population-based data linkage cohort study using propensity score matching

Background

We evaluated the effectiveness of the Family Nurse Partnership (FNP), an intensive home visiting programme aiming to improve birth outcomes, child health and development, and to promote economic self-sufficiency among teenage mothers.

Methods

We created a linked cohort of >130 000 mothers aged 13-19 years with live births between April 2010 and March 2019, using administrative data from health (Hospital Episode Statistics), education and children's social care (National Pupil Database). Using propensity score matching, we compared indicators of child maltreatment, health and development outcomes, and maternal hospital utilisation and educational outcomes up to 7 years following birth for mothers who did or did not enrol in FNP.

Results

We found no evidence of an association between FNP and indicators of child maltreatment, except for an increased rate of unplanned admissions for maltreatment/injury-related diagnoses up to age 2 years for children born to FNP mothers (6.6% vs 5.7%, relative risk (RR) 1.15; 95% CI 1.07, 1.24). There was weak evidence that children born to FNP mothers were more likely to achieve a good level of development at age 5 years (57.5% vs 55.4%, RR 1.05; 95% CI 1.00, 1.09). FNP mothers were less likely to have a subsequent delivery within 18 months of the index birth (8.4% vs 9.3%, RR 0.92; 95% CI 0.88, 0.97).

Conclusion

Our study supports findings from previous evaluations of FNP showing no evidence of benefit for child maltreatment or health outcomes measured in administrative data. Bias by indication, and variation in the intervention and usual care, may have limited our ability to detect effects. Future evaluations should capture more information on maternal risk factors and additional outcomes relating to maternal/child well-being.

Evaluating the real-world implementation of the Family Nurse Partnership in England: a data linkage study

Background/objectives

The Family Nurse Partnership is an intensive home visiting programme for adolescent mothers. We aimed to evaluate the effectiveness of the Family Nurse Partnership on outcomes up to age 7 using national administrative data.

Design

We created a linked cohort of all mothers aged 13-19 using data from health, educational and children's social care and defined mothers enrolled in the Family Nurse Partnership or not using Family Nurse Partnership system data. Propensity scores were used to create matched groups for analysis.

Setting

One hundred and thirty-six local authorities in England with active Family Nurse Partnership sites between 2010 and 2017.

Participants

Mothers aged 13-19 at last menstrual period with live births between April 2010 and March 2019, living in a Family Nurse Partnership catchment area and their firstborn child(ren).

Interventions

The Family Nurse Partnership includes up to 64 home visits by a family nurse from early pregnancy until the child's second birthday and is combined with usual health and social care. Controls received usual health and social care.

Main outcome measures

Indicators of child maltreatment (hospital admissions for injury/maltreatment, referral to social care services); child health and development (hospital utilisation and education) outcomes and maternal hospital utilisation and educational outcomes up to 7 years following birth.

Data sources

Family Nurse Partnership Information System, Hospital Episode Statistics, National Pupil Database.

Results

Of 110,520 eligible mothers, 25,680 (23.2%) were enrolled in the Family Nurse Partnership. Enrolment rates varied across 122 sites (range: 11-68%). Areas with more eligible mothers had lower enrolment rates. Enrolment was higher among mothers aged 13-15 (52%), than 18-19 year-olds (21%). Indicators of child maltreatment: we found no evidence of an association between the Family Nurse Partnership and indicators of child maltreatment, except for an increased rate of unplanned admissions for maltreatment/injury-related diagnoses up to age 2 for children born to Family Nurse Partnership mothers (6.6% vs. 5.7%, relative risk 1.15; 95% confidence interval 1.07 to 1.24). Child health and developmental outcomes: there was weak evidence that children born to Family Nurse Partnership mothers were more likely to achieve a Good Level of Development at age 5 (57.5% vs. 55.4%, relative risk 1.05; 95% confidence interval 1.00 to 1.09). Maternal outcomes: There was some evidence that Family Nurse Partnership mothers were less likely to have a subsequent delivery within 18 months of the index birth (8.4% vs. 9.3%, relative risk 0.92; 95% confidence interval 0.88 to 0.97). Younger and more vulnerable mothers received higher numbers of visits and were more likely to achieve fidelity targets. Meeting the fidelity targets was associated with some outcomes.

Limitations

Bias by indication and variation in the intervention and usual care over time and between areas may have limited our ability to detect effects. Multiple testing may have led to spurious, significant results.

Conclusions

This study supports findings from evaluations of the Family Nurse Partnership showing no evidence of benefit for maltreatment outcomes measured in administrative data. Amongst all the outcomes measured, we found weak evidence that the Family Nurse Partnership was associated with improvements in child development at school entry, a reduction in rapid repeat pregnancies and evidence of increased healthcare-seeking in the mother and child.

Future work

Future evaluations should capture better measures of Family Nurse Partnership interventions and usual care, more information on maternal risk factors and additional outcomes relating to maternal well-being.

Study registration

The study is registered as NIHR CRN Portfolio (42900).

Funding

This award was funded by the National Institute of Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 17/99/19) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 11. See the NIHR Funding and Awards website for further award information.