Do general practitioners adhere to NICE guidelines for depression? Systematic Questionnaire Survey

Replicability and reproducibility of predictive models for diagnosis of depression among young adults using Electronic Health Records

BACKGROUND

Recent advances in machine learning combined with the growing availability of digitized health records offer new opportunities for improving early diagnosis of depression. An emerging body of research shows that Electronic Health Records can be used to accurately predict cases of depression on the basis of individual's primary care records. The successes of these studies are undeniable, but there is a growing concern that their results may not be replicable, which could cast doubt on their clinical usefulness.

METHODS

To address this issue in the present paper, we set out to reproduce and replicate the work by Nichols et al. (2018), who trained predictive models of depression among young adults using Electronic Healthcare Records. Our contribution consists of three parts. First, we attempt to replicate the methodology used by the original authors, acquiring a more up-to-date set of primary health care records to the same specification and reproducing their data processing and analysis. Second, we test models presented in the original paper on our own data, thus providing out-of-sample prediction of the predictive models. Third, we extend past work by considering several novel machine-learning approaches in an attempt to improve the predictive accuracy achieved in the original work.

RESULTS

In summary, our results demonstrate that the work of Nichols et al. is largely reproducible and replicable. This was the case both for the replication of the original model and the out-of-sample replication applying NRCBM coefficients to our new EHRs data. Although alternative predictive models did not improve model performance over standard logistic regression, our results indicate that stepwise variable selection is not stable even in the case of large data sets.

CONCLUSION

We discuss the challenges associated with the research on mental health and Electronic Health Records, including the need to produce interpretable and robust models. We demonstrated some potential issues associated with the reliance on EHRs, including changes in the regulations and guidelines (such as the QOF guidelines in the UK) and reliance on visits to GP as a predictor of specific disorders.

Examining drivers of self-harm guideline implementation by general practitioners: A qualitative analysis using the theoretical domains framework

OBJECTIVES

This study aimed to (1) examine barriers and enablers to General Practitioners' (GP) use of National Institute for Health and Care Excellence (NICE) guidelines for self-harm and (2) recommend potential intervention strategies to improve implementation of them in primary care.

DESIGN

Qualitative interview study.

METHODS

Twenty-one telephone interviews, semi-structured around the capabilities, opportunities and motivations model of behaviour change (COM-B), were conducted with GPs in the United Kingdom. The Theoretical Domains Framework was employed as an analytical framework. Using the Behaviour Change Wheel, Behaviour Change Techniques (BCTs), intervention functions and exemplar interventions were identified.

RESULTS

GPs valued additional knowledge about self-harm risk assessments (knowledge), and communication skills were considered to be fundamental to high-pressure consultations (cognitive and interpersonal skills). GPs did not engage with the guidelines due to concerns that they would be a distraction from patient cues about risk during consultations (memory, attention and decision processes), and perceptions that following the guidance is difficult due to time pressures and lack of access to mental health referrals (environmental context and resources). Clinical uncertainty surrounding longer term care for people that self-harm, particularly patients that are waiting for or cannot access a referral, drives GPs to rely on their professional judgement over the guidance (beliefs about capabilities).

CONCLUSIONS

Three key drivers related to information and skill needs, guideline engagement and clinical uncertainty need to be addressed to support GPs to be able to assess and manage self-harm. Five intervention functions and ten BCT groups were identified as potential avenues for intervention design.

Lessons from the failure of implementing the 'Better Care Better Value' prescribing indicator for renin-angiotensin system drugs in England: a qualitative study of general practitioners' perceptions using behavioural change framework

OBJECTIVES

To explore reasons for the lack of uptake of 'Better Care Better Value (BCBV)' prescribing indicators for renin-angiotensin-aldosterone system (RAAS) inhibitors and identify learning lessons to inform the implementation of future prescribing policies.

DESIGN

In-depth, semistructured interviews to explore: general practitioners' (GPs) experiences in prescribing RAAS, perceptions of the BCBV policy and potential barriers to policy implementation and suggestions for improving future policy implementation. Interviews were audio recorded, transcribed verbatim and analysed thematically, then mapped onto behavioural change frameworks (the Capability, Opportunity, Motivation and Behaviour) model and Behaviour Change Wheel (BCW)).

SETTING

Primary care setting in England PARTICIPANTS: Interviews were conducted with 16 GPs recruited from a purposive sample of 91 GP practices in three English counties.

RESULTS

Four factors/barriers, related mainly to GPs' psychological capability and reflective motivation, emerged as the possible barriers for the BCBV's lack of uptake, including: lack of the policy awareness, negative attitude to the policy, lack of incentives and GPs' reluctance to switch patients from angiotensin receptor blockers (ARBs) to ACE inhibitors (ACEIs). The participating GPs proposed interventions to improve future BCBV implementation and they were related to six intervention/policy functions of the BCW, addressing the four identified barriers: education/communication (increase GPs' awareness) and environmental restructuring/regulations (provide GPs with reminding alerts); incentivisation/fiscal (provide GPs with financial incentives); enablement/guidelines-regulations (provide GPs with benchmarking against peers) and enablement/regulations and education/guidelines (facilitate switching from ARBs to ACEIs).

CONCLUSIONS

The main reason underpinning the low uptake of the BCBV indicator appears to be lack of a proactive implementation strategy. This case study demonstrated that passively disseminating policy without an effective implementation strategy results in low uptake. Furthermore, multifaceted implementation strategies are necessary to influence complex clinical decision making in a time-limited environment, such as prescribing behaviours. These findings suggest that effective policy implementation requires the application of a systematic comprehensive behaviours change framework.

Perspectives on clinical guidelines for severe behavioural problems in children across Europe: a qualitative study with mental health clinicians

Clinical guidelines for severe behavioural problems (SBPs) in children have recently been developed in several European countries. However, questions emerged regarding their applicability to practice. Our study aimed to provide a first European insight into guidelines' fitness-for-purpose by exploring mental health clinicians' familiarity with, use and perceived value of guidelines for SBPs in children. Participants included 161 clinicians, primarily psychiatrists, from 24 countries. Clinicians completed a semi-structured qualitative questionnaire on existing SBPs guidelines and development of new guidelines where not available. Clinicians' responses were mapped against academic experts' perceptions on SBPs guidelines highlighted in a previous study (Gatej et al. in Eur Psychiatry 57:1-9, 2019). Under half of the clinicians reported being unaware of guidelines. Of these, 37.6% represented countries where guidelines were available according to experts. The remaining half of clinicians who were aware of guidelines on average reported being moderately familiar with their content, perceiving them as moderately useful and using them some of the time. Additionally, 60.8% clinicians agreed that SBPs guidelines need to be developed, as these would create a shared scientific knowledge base and common practice. Guideline improvements included taking a multifactorial approach, creating specific case recommendations, and dissemination efforts. The modest familiarity with and use of guidelines amongst practitioners may highlight guidelines poor fitness-for-purpose, or, alternatively, an underlying confusion around the meaning and purpose of guidelines. Moving forward, efforts should be directed at disseminating clearer definitions of guidelines, addressing existing challenges, and unifying efforts to further develop and audit application of international guidelines for SBPs.

They're NICE and Neat, but Are They Useful? A Grounded Theory of Clinical Psychologists' Beliefs About and Use of NICE Guidelines

Guidelines are ubiquitous but inconsistently used in UK mental health services. Clinical psychologists are often influential in guideline development and implementation, but opinion within the profession is divided. This study utilized grounded theory methodology to examine clinical psychologists' beliefs about and use of NICE guidelines. Eleven clinical psychologists working in the NHS were interviewed. The overall emerging theme was; NICE guidelines are considered to have benefits but to be fraught with dangers. Participants were concerned that guidelines can create an unhelpful illusion of neatness. They managed the tension between the helpful and unhelpful aspects of guidelines by relating to them in a flexible manner. The participants reported drawing on specialist skills such as idiosyncratic formulation and integration. However, due to the pressures and dominant discourses within services they tended to practice in ways that prevent these skills from being recognized. This led to fears that their professional identity was threatened, which impacted upon perceptions of the guidelines. To our knowledge, the theoretical framework presented in this paper is the first that attempts to explain why NICE guidelines are not consistently utilized in UK mental health services. The current need for services to demonstrate 'NICE compliance' may be leading to a perverse incentive for clinical psychologists in particular to do one thing but say another and for specialist skills to be obscured. If borne out by future studies, this represents a threat to continued quality improvement and also to the profession. Copyright © 2016 John Wiley & Sons, Ltd.

KEY PRACTITIONER MESSAGE

Guidelines have many benefits, but the current pressure for services to be 'NICE compliant' may be having unintended negative as well as positive effects. Lack of implementation may be partly the result of active choice by clinicians concerned to use the full range of professional skills and to offer flexibility and choice to service users. The current context is creating a perverse incentive for clinicians to say one thing but do another. This is problematic for services and a potential threat to the profession of clinical psychology.

The relationship between waiting times and ‘adherence’ to the Scottish Intercollegiate Guidelines Network 98 guideline in autism spectrum disorder diagnostic services in Scotland

The aim of this study was to explore the extent to which the Scottish Intercollegiate Guidelines Network 98 guidelines on the assessment and diagnosis of autism spectrum disorder were adhered to in child autism spectrum disorder diagnostic services in Scotland and whether there was a significant relationship between routine practice which more closely reflected these recommendations (increased adherence) and increased waiting times. Retrospective, cross-sectional case note analysis was applied to data from 80 case notes. Adherence ranged from a possible 0 (no adherence) to 19 (full adherence). Overall, 17/22 of the recommendations were adhered to in over 50 of the 80 cases and in 70 or more cases for 11/22 of the recommendations, with a mean adherence score of 16 (standard deviation = 1.9). No significant correlation was found between adherence and total wait time for untransformed ( r = 0.15, p = 0.32) or transformed data ( r = 0.12, p = 0.20). The results indicated that the assessment and diagnostic practices were consistent with the relevant Scottish Intercollegiate Guidelines Network 98 guideline recommendations. Increased adherence to the 19 included recommendations was not significantly related to increased total waiting times, indicating that the Scottish Intercollegiate Guidelines Network 98 recommendations have generally been integrated into practice, without a resultant increase in patient waits.

Incentives and disincentives for the treatment of depression and anxiety: a scoping review

OBJECTIVE

There is widespread support for primary care to help address growing mental health care demands. Incentives and disincentives are widely used in the design of health care systems to help steer toward desired goals. The absence of a conceptual model to help understand the range of factors that influence the provision of primary mental health care inspired a scoping review of the literature. Understanding the incentives that promote and the disincentives that deter treatment for depression and anxiety in the primary care context will help to achieve goals of greater access to mental health care.

METHOD

A review of the literature was conducted to answer the question, how are incentives and disincentives conceptualized in studies investigating the treatment of common mental disorders in primary care? A comprehensive search of MEDLINE, PsycINFO, CINAHL, and Google Scholar was undertaken using Arksey and O'Malley's 5-stage methodological framework for scoping reviews.

RESULTS

We identified 27 studies. A range of incentives and disincentives influence the success of primary mental health care initiatives to treat depression and anxiety. Six types of incentives and disincentives can encourage or discourage treatment of depression and anxiety in primary care: attitudes and beliefs, training and core competencies, leadership, organizational, financial, and systemic.

CONCLUSIONS

Understanding that there are 6 different types of incentives that influence treatment for anxiety and depression in primary care may help service planners who are trying to promote improved mental health care.

Impact of the QOF and the NICE guideline in the diagnosis and management of depression: a qualitative study

BACKGROUND

The National Institute for Health and clinical Excellence (NICE) depression guideline (2004) and the updated Quality and Outcomes Framework (QOF) (2006) in general practice have introduced the concepts of screening severity assessment, for example using the Patient Health Questionnaire 9 (PHQ-9), and 'stepped care' for depression.

AIM

To explore primary care practitioner perspectives on the clinical utility of the NICE guideline and the impact of the QOF on diagnosis and management of depression in routine practice.

DESIGN AND SETTING

Qualitative study using focus groups from four multidisciplinary practice teams with diverse populations in south Yorkshire.

METHOD

Four focus groups were conducted, using a topic guide and audiotaping. There were 38 participants: GPs, nurses, doctors in training, mental health workers, and a manager. Data analysis was iterative and thematic.

RESULTS

The NICE guideline, with its embedded principles of holism and evidence-based practice, was viewed positively but its impact was compromised by resource and practitioner barriers to implementation. The perceived imposition of the screening questions and severity assessments (PHQ-9) with no responsive training had required practitioners to work hard to minimise negative impacts on their work, for example: constantly adapting consultations to tick boxes; avoiding triggering open displays of distress without the time to offer appropriate care; positively managing how their patients were labelled. Further confusion was experienced around the evolving content of psychological interventions for depression.

CONCLUSION

Organisational barriers to the implementation of the NICE guideline and the limited scope of the QOF highlight the need for policy makers to work more effectively with the complex realities of general practice in order to systematically improve the quality and delivery of 'managed' care for depression.