Estimating the effectiveness of an enhanced 'Improving Access to Psychological Therapies' (IAPT) service addressing the wider determinants of mental health: a real-world evaluation

BACKGROUND

Addressing the wider determinants of mental health alongside psychological therapy could improve mental health service outcomes and population mental health.

OBJECTIVES

To estimate the effectiveness of an enhanced 'Improving Access to Psychological Therapies' (IAPT) mental health service compared with traditional IAPT in England. Alongside traditional therapy treatment, the enhanced service included well-being support and community service links.

DESIGN

A real-world evaluation using IAPT's electronic health records.

SETTING

Three National Health Service IAPT services in England.

PARTICIPANTS

Data from 17 642 service users classified as having a case of depression and/or anxiety at baseline.

INTERVENTION

We compared the enhanced IAPT service (intervention) to an IAPT service in a different region providing traditional treatment only (geographical control), and the IAPT service with traditional treatment before additional support was introduced (historical control).

PRIMARY OUTCOME MEASURES

Patient Health Questionnaire-9 (PHQ-9) Depression Scale (score range: 0-27) and Generalised Anxiety Disorder-7 (GAD-7) Anxiety Scale (score range: 0-21); for both, lower scores indicate better mental health. Propensity scores were used to estimate inverse probability of treatment weights, subsequently used in mixed effects regression models.

RESULTS

Small improvements (mean, 95% CI) were observed for PHQ-9 (depression) (-0.21 to -0.32 to -0.09) and GAD-7 (anxiety) (-0.23 to -0.34 to -0.13) scores in the intervention group compared with the historical control. There was little evidence of statistically significant differences between intervention control and geographical control.

CONCLUSIONS

Embedding additional health and well-being (H&W) support into standard IAPT services may lead to improved mental health outcomes. However, the lack of improved outcomes compared with the geographical control may instead reflect a more general improvement to the intervention IAPT service. It is not clear from our findings whether an IAPT service with additional H&W support is clinically superior to traditional IAPT models.

A randomised controlled feasibility trial of an early years language development intervention: results of the 'outcomes of Talking Together evaluation and results' (oTTer) project

BACKGROUND

Early language difficulties are associated with poor school readiness and can impact lifelong attainment. The quality of the early home language environment is linked to language outcomes. However, few home-based language interventions have sufficient evidence of effectiveness in improving preschool children's language abilities. This study reports the first stage in the evaluation of a theory-based programme, Talking Together (developed and delivered by BHT Early Education and Training) given over 6 weeks to families in the home setting. We aimed to test the feasibility and acceptability of delivering Talking Together in the Better Start Bradford community prior to a definitive trial, using a two-armed randomised controlled feasibility study.

METHODS

Families from a single site within the Better Start Bradford reach area were randomly allocated (1:1) to the Talking Together intervention or a wait list control group. Child language and parent-level outcome measures were administered before randomisation (baseline), pre-intervention (pre-test), 2 months post-intervention start (post-test), and 6 months post-intervention start (follow-up). Routine monitoring data from families and practitioners were also collected for eligibility, consent, protocol adherence, and attrition rates. Descriptive statistics on the feasibility and reliability of potential outcome measures were analysed alongside qualitative feedback on trial design acceptability. Pre-defined progression-to-trial criteria using a traffic light system were assessed using routine monitoring data.

RESULTS

Two-hundred and twenty-two families were assessed for eligibility; of these, 164 were eligible. A total of 102 families consented and were randomised (intervention: 52, waitlist control: 50); 68% of families completed outcome measures at 6-month follow-up. Recruitment (eligibility and consent) reached 'green' progression criteria; however, adherence reached 'amber' and attrition reached 'red' criteria. Child- and parent-level data were successfully measured, and the Oxford-CDI was identified as a suitable primary outcome measure for a definitive trial. Qualitative data not only indicated that the procedures were largely acceptable to practitioners and families but also identified areas for improvement in adherence and attrition rates.

CONCLUSIONS

Referral rates indicate that Talking Together is a much-needed service and was positively received by the community. A full trial is feasible with adaptations to improve adherence and reduce attrition.

TRIAL REGISTRATION

ISRCTN registry ISRCTN13251954. Retrospectively registered 21 February 2019.

Natural experiments for the evaluation of place-based public health interventions: a methodology scoping review

Introduction

Place-based public health evaluations are increasingly making use of natural experiments. This scoping review aimed to provide an overview of the design and use of natural experiment evaluations (NEEs), and an assessment of the plausibility of the as-if randomization assumption.

Methods

A systematic search of three bibliographic databases (Pubmed, Web of Science and Ovid-Medline) was conducted in January 2020 to capture publications that reported a natural experiment of a place-based public health intervention or outcome. For each, study design elements were extracted. An additional evaluation of as-if randomization was conducted by 12 of this paper's authors who evaluated the same set of 20 randomly selected studies and assessed 'as-if ' randomization for each.

Results

366 NEE studies of place-based public health interventions were identified. The most commonly used NEE approach was a Difference-in-Differences study design (25%), followed by before-after studies (23%) and regression analysis studies. 42% of NEEs had likely or probable as-if randomization of exposure (the intervention), while for 25% this was implausible. An inter-rater agreement exercise indicated poor reliability of as-if randomization assignment. Only about half of NEEs reported some form of sensitivity or falsification analysis to support inferences.

Conclusion

NEEs are conducted using many different designs and statistical methods and encompass various definitions of a natural experiment, while it is questionable whether all evaluations reported as natural experiments should be considered as such. The likelihood of as-if randomization should be specifically reported, and primary analyses should be supported by sensitivity analyses and/or falsification tests. Transparent reporting of NEE designs and evaluation methods will contribute to the optimum use of place-based NEEs.

Perspectives on an enhanced 'Improving Access to Psychological Therapies' (IAPT) service addressing the wider determinants of mental health: a qualitative study

BACKGROUND

A new Health and Wellbeing pathway was introduced into the Improving Access to Psychological Therapies (IAPT) service in one geographical area of the UK in 2021 to address the wider determinants of mental health problems. It comprised assisted signposting to wider services and physical health promotion. This qualitative study aimed to understand stakeholders' experiences of implementing and receiving this new support and the barriers and facilitators to its delivery.

METHODS

Forty-seven interviews were conducted, with service developers (n = 6), service deliverers (n = 12), service users (n = 22) and community and clinical partners (n = 7), as part of a larger mixed-methods evaluation. Interviews were recorded, transcribed, and analysed using reflexive thematic analysis.

RESULTS

Three themes spanned all participant groups and represented key aspects of the service: (1) identifying suitability, (2) a holistic service, and (3) moving forward. The sub-themes represent the barriers and facilitators to processes working in practice, lending insight into potential service improvements. These included strengthening the quality of communication during referral and assessment, tailoring the support and delivery mode, and increasing transparency around continued care to drive sustained benefits.

LIMITATIONS

Service users may have been selected due to their positive experiences of IAPT and were not demographically representative of the population, although participants' experiences of the service did suggest variation in our sample.

CONCLUSIONS

The Health and Wellbeing pathway was perceived as having a positive impact on mental health and could reduce the burden on therapeutic services. However, service- and individual-level barriers need to be addressed to enhance statutory and community support links, manage service users' expectations, and improve accessibility for certain groups.

Does age moderate the influence of early life language experiences? A Naturalistic home observation study

We explored if children's age moderated associations between their early life language experiences and their linguistic and cognitive skills. For 107 British children, aged 24 to 48 months, and their families, we collected 3 day-long audio-recordings of their naturalistic home environments (M = 15.06 h per day, SD = 1.87). Children's cognitive ability was assessed by parent-ratings and with a cognitive testing booklet that children completed at home. We found that the quantity, lexical diversity and vocabulary sophistication of adult speech were associated with children's linguistic and cognitive skills. However, these associations were not moderated by children's age. Our findings suggest that the influence of early life language experience is not differentiated at age 24 to 48 months, at least in the current sample.

Predicting developmental outcomes in middle childhood from early life language and parenting experiences

Children's early life experiences of language and parenting are thought to have pervasive, long-term influence on their cognitive and behavioural development. However, studies are scarce that collected naturalistic observations to broadly assess children's early life experiences and test their associations with developmental outcomes in middle childhood. Here, we used digital audio-recorders to collect three full days of naturalistic observations from 107 British families with children (46 boys) aged 2-4 years, of whom 89 participated in a follow-up assessment four years later when the children were 5-8 years old. We found that children's early life experiences of language and parenting were not significantly associated with their later language ability, academic performance and behavioural outcomes. We explore differences in methodology, sample characteristics and the role of developmental periods as possible explanations for the discrepancy in findings between the current and previous studies.

Exploring the potential of a school-based online health and wellbeing screening tool: professional stakeholders' perspectives and experiences

Background

Supporting children and young people’s (CYP) mental and physical health is a global policy priority but detecting need and facilitating access to health services and support is challenging. This paper explores professional stakeholders’ perspectives of the acceptability, utility and effectiveness of a school-based online health and wellbeing screening tool, the Digital Health Contact (DHC). The DHC, delivered by Public Health School Nurses (PHSN), aims to identify, and put in place strategies to support, unmet health needs among CYP.

Methods

We employed a qualitative study design, using semi-structured interviews. Fourteen key stakeholders involved in the design and implementation of the DHC (commissioners, providers, PHSN and healthcare staff, school leaders) were purposively sampled. Data were analysed thematically.

Results

Our analysis generated two key themes: the perceived benefits of the DHC; and challenges in delivering the DHC. Stakeholders perceived the universal application of the DHC with linked follow-up intervention as an effective means of identifying and supporting CYP with unmet needs, and an efficient way to target limited service resources. There were barriers around enabling school engagement in the DHC, typically in terms of logistics, school infrastructure, and perspectives of fit with schools. These barriers were seen as being negated through developing effective working relationships between schools and PHSN. Effective relationships could highlight the potential benefits of participation. Overall, the DHC was seen as a valuable and effective use of resources, with a low burden on school staff.

Conclusions

The DHC, as a universal school-based health and wellbeing screening tool with linked follow-up intervention, has great potential in identifying and supporting unmet health needs among CYP. The perspectives and experiences of those involved in delivering the DHC highlight important considerations which may enable effective implementation and delivery of school screening programmes across other areas.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-12748-2.

From Genome-Wide to Environment-Wide: Capturing the Environome

Genome-wide association (GWA) studies have shown that genetic influences on individual differences in affect, behavior, and cognition are driven by thousands of DNA variants, each with very small effect sizes. Here, we propose taking inspiration from GWA studies for understanding and modeling the influence of the environment on complex phenotypes. We argue that the availability of DNA microarrays in genetic research is comparable with the advent of digital technologies in psychological science that enable collecting rich, naturalistic observations in real time of the environome, akin to the genome. These data can capture many thousand environmental elements, which we speculate each influence individual differences in affect, behavior, and cognition with very small effect sizes, akin to findings from GWA studies about DNA variants. We outline how the principles and mechanisms of genetic influences on psychological traits can be applied to improve the understanding and models of the environome.