Implementing telephone triage in general practice: a process evaluation of a cluster randomised controlled trial

Access systems in general practice: a systematic scoping review

BACKGROUND

Access to GP appointments is increasingly challenging in many high-income countries, with an overstretched workforce and rising demand. Various access systems have been developed and evaluated internationally.

AIM

To systematically consolidate the current international evidence base related to different types of GP access systems.

DESIGN AND SETTING

Scoping review examining international literature.

METHOD

Literature searches were run across relevant databases in May 2022. Title, abstract, and full-text screenings were carried out. Data from included studies were extracted and mapped to synthesise the components and aims within different GP access systems.

RESULTS

In total, 49 studies were included in the review. The majority of these were set in the UK. Some access systems featured heavily in the literature, such as Advanced Access, telephone triage, and online consultations, and others less so. There were two key strategies adopted by systems that related to either changing appointment capacity or modifying patient pathways. Components related to these strategies are summarised and illustrated as a schematic representation. Most rationales behind access systems were practice, rather than patient, focused. 'Add-on' systems and aims for efficiency have become more popular in recent years.

CONCLUSION

This synthesis provides a useful tool in understanding access systems' aims, design, and implementation. With focus on alleviating demand, patient-focused outcomes appear to be underinvestigated and potentially overlooked during design and implementation. More recently, digital services have been promoted as offering patient choice and convenience. But a context where demand outweighs resources challenges the premise that extending choice is possible.

A Symptom-Checker for Adult Patients Visiting an Interdisciplinary Emergency Care Center and the Safety of Patient Self-Triage: Real-Life Prospective Evaluation

BACKGROUND

Symptom-checkers have become important tools for self-triage, assisting patients to determine the urgency of medical care. To be safe and effective, these tools must be validated, particularly to avoid potentially hazardous undertriage without leading to inefficient overtriage. Only limited safety data from studies including small sample sizes have been available so far.

OBJECTIVE

The objective of our study was to prospectively investigate the safety of patients' self-triage in a large patient sample. We used SMASS (Swiss Medical Assessment System; in4medicine, Inc) pathfinder, a symptom-checker based on a computerized transparent neural network.

METHODS

We recruited 2543 patients into this single-center, prospective clinical trial conducted at the cantonal hospital of Baden, Switzerland. Patients with an Emergency Severity Index of 1-2 were treated by the team of the emergency department, while those with an index of 3-5 were seen at the walk-in clinic by general physicians. We compared the triage recommendation obtained by the patients' self-triage with the assessment of clinical urgency made by 3 successive interdisciplinary panels of physicians (panels A, B, and C). Using the Clopper-Pearson CI, we assumed that to confirm the symptom-checkers' safety, the upper confidence bound for the probability of a potentially hazardous undertriage should lie below 1%. A potentially hazardous undertriage was defined as a triage in which either all (consensus criterion) or the majority (majority criterion) of the experts of the last panel (panel C) rated the triage of the symptom-checker to be "rather likely" or "likely" life-threatening or harmful.

RESULTS

Of the 2543 patients, 1227 (48.25%) were female and 1316 (51.75%) male. None of the patients reached the prespecified consensus criterion for a potentially hazardous undertriage. This resulted in an upper 95% confidence bound of 0.1184%. Further, 4 cases met the majority criterion. This resulted in an upper 95% confidence bound for the probability of a potentially hazardous undertriage of 0.3616%. The 2-sided 95% Clopper-Pearson CI for the probability of overtriage (n=450 cases,17.69%) was 16.23% to 19.24%, which is considerably lower than the figures reported in the literature.

CONCLUSIONS

The symptom-checker proved to be a safe triage tool, avoiding potentially hazardous undertriage in a real-life clinical setting of emergency consultations at a walk-in clinic or emergency department without causing undesirable overtriage. Our data suggest the symptom-checker may be safely used in clinical routine.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04055298; https://clinicaltrials.gov/study/NCT04055298.

Workload and workflow implications associated with the use of electronic clinical decision support tools used by health professionals in general practice: a scoping review

BACKGROUND

Electronic clinical decision support tools (eCDS) are increasingly available to assist General Practitioners (GP) with the diagnosis and management of a range of health conditions. It is unclear whether the use of eCDS tools has an impact on GP workload. This scoping review aimed to identify the available evidence on the use of eCDS tools by health professionals in general practice in relation to their impact on workload and workflow.

METHODS

A scoping review was carried out using the Arksey and O'Malley methodological framework. The search strategy was developed iteratively, with three main aspects: general practice/primary care contexts, risk assessment/decision support tools, and workload-related factors. Three databases were searched in 2019, and updated in 2021, covering articles published since 2009: Medline (Ovid), HMIC (Ovid) and Web of Science (TR). Double screening was completed by two reviewers, and data extracted from included articles were analysed.

RESULTS

The search resulted in 5,594 references, leading to 95 full articles, referring to 87 studies, after screening. Of these, 36 studies were based in the USA, 21 in the UK and 11 in Australia. A further 18 originated from Canada or Europe, with the remaining studies conducted in New Zealand, South Africa and Malaysia. Studies examined the use of eCDS tools and reported some findings related to their impact on workload, including on consultation duration. Most studies were qualitative and exploratory in nature, reporting health professionals' subjective perceptions of consultation duration as opposed to objectively-measured time spent using tools or consultation durations. Other workload-related findings included impacts on cognitive workload, "workflow" and dialogue with patients, and clinicians' experience of "alert fatigue".

CONCLUSIONS

The published literature on the impact of eCDS tools in general practice showed that limited efforts have focused on investigating the impact of such tools on workload and workflow. To gain an understanding of this area, further research, including quantitative measurement of consultation durations, would be useful to inform the future design and implementation of eCDS tools.

Reliability and validity of an original nurse telephone triage tool for out-of-hours primary care calls: the SALOMON algorithm

OBJECTIVES

Due to the persistent primary care physicians shortage and the substantial increase in their workload, the organization of primary care calls during out-of-hours periods has become an everyday challenge. The SALOMON algorithm is an original nurse telephone triage tool allowing to dispatch patients to the best level of care according to their conditions. This study evaluated its reliability and criterion validity in rea-life settings.

METHODS

In this 5-year study, out-of-hours primary care calls were dispatched into four categories: Emergency Medical Services Intervention (EMSI), Emergency Department referred Consultation (EDRC), Primary Care Physician Home visit (PCPH), and Primary Care Physician Delayed visit (PCPD). We included data of patients' triage category, resources, and destination. Patients included into the primary care cohort were classified undertriaged if they had to be redirected to an emergency department (ED). Patients from the ED cohort were considered overtriaged if they did not require at least three diagnostic resources, one emergency-specific treatment or any hospitalization. In the ED cohort, only patients from the University Hospitals were considered.

RESULTS

10,207 calls were triaged using the SALOMON tool: 19.2% were classified as EMSI, 15.8% as EDRC, 62.8% as PCPH, and 2.2% as PCPD. The triage was appropriate for 85.5% of the calls with a 14.5% overtriage rate. In the PCPD/PCPH cohort, 96.9% of the calls were accurately triaged and 3.1% were undertriaged. SALOMON sensitivity and specificity reached 76.6% and 98.3%, respectively.

CONCLUSION

SALOMON algorithm is a valid triage tool that has the potential to improve the organization of out-of-hours primary care work.

Exploring implementation processes in general practice in a feedback intervention aiming to reduce potentially inappropriate prescribing: a qualitative study among general practitioners

Background

Potentially inappropriate prescribing (PIP) has been linked with adverse health outcomes and increased healthcare costs. Feedback interventions targeting PIP have shown promising results. However, translation from research to everyday practice remains a challenge. With the Normalisation Process Theory (NPT) as overarching framework, we aimed to explore the implementation processes performed by general practices in a real-life, quality improvement intervention using feedback on practice-level prescribing.

Methods

All 376 general practices in the Central Denmark Region received a prescribing feedback intervention targeting selected types of PIP. Six months later, they received an evaluation questionnaire, to which 45% responded. Among 102 practices reporting to have made changes in response to the intervention, we conducted individual, semi-structured interviews with ten GPs. Maximum variation was sought in terms of baseline prescribing status, implementation activities, practice type and geographical location. The interviews were analysed thematically using NPT.

Results

The implementation processes in general practice reflected the four NPT constructs. Key motivators for implementation included the GPs’ professional values and interests, but pragmatic considerations were also of importance (coherence). A collective versus an individual approach to the engagement and planning of the implementation process (cognitive participation) was observed. Similarly, a distinction was evident between practice-level actions involving the entire practice team as opposed to individual-level actions performed by the individual GP (collective action). Several challenges to the implementation processes were identified, including patient influences and competing priorities at multiple levels (reflexive monitoring). Additionally, internal evaluation and normalisation of new practices occurred in varying degrees.

Conclusion

NPT provided a useful framework for understanding implementation processes in general practice. Our results emphasise that clear professional aims and feasible content of interventions are key for GP motivation. This may be ensured through cooperation with GPs’ professional organisation, which may strengthen intervention legitimacy and uptake. Two main implementation strategies were identified: practice-level and GP-level strategies. Intervention developers need to recognise both strategies to deliver intervention content and implementation support that promote sustainable improvements in prescribing practice. Competing demands and patient influences remain important challenges that need to be addressed in future studies to further facilitate the reduction of PIPs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-020-00106-5.

Quality indicators in telephone nursing - An integrative review

Aim

The aim of this study was to identify factors that indicate quality in telephone nursing.

Design

An integrative literature review.

Method

A literature search was performed in October 2018, in the PubMed, CINAHL, Cochrane Library, Academic Search, PsycINFO, Scopus and Web of Science databases. A total of 30 included were included and data that corresponded to the study's aim were extracted and categorized along the three areas of quality as described by Donabedian (Milbank Quarterly, 83, 691), namely structure, process and outcome.

Results

The analysis revealed ten factors indicating quality in telephone nursing (TN): availability and simplicity of the service, sustainable working conditions, specialist education and TN experience, healthcare resources and organization, good communication, person‐centredness, competence, correct and safe care, efficiency and satisfaction. TN services need to target all ten factors to ensure that the care given is of high quality and able to meet today's requirements for the service.

Registered nurses´ views on telephone nursing for patients with respiratory tract infections in primary healthcare - a qualitative interview study

Background

Telephone nursing in primary healthcare has been suggested as a solution to the increased demand for easy access to healthcare, increased number of patients with complex problems, and lack of general practitioners. Registered nurses’ assessments may also be of great importance for antibiotic prescriptions according to guidelines. The aim of this study was to describe registered nurses’ views of telephone nursing work with callers contacting primary healthcare centres regarding respiratory tract infections.

Methods

A descriptive, qualitative study was performed through interviews with twelve registered nurses in Swedish primary healthcare.

Results

The overarching themes for registered nurses’ views on telephone nursing were captured in two themes: professional challenges and professional support. These included three and two categories respectively: Communicate for optimal patient information; Differentiate harmless from severe problems; Cope with caller expectations; Use working tools; and Use team collaboration. Optimal communication for sufficiently grasping caller symptoms and assess whether harmful or not, without visual input, was underlined. This generated fear of missing something serious. Professional support used in work, were for example guidelines and decision support tool. Colleagues and teamwork collaboration were requested, but not always offered, support for the interviewed registered nurses.

Conclusions

The study deepens the understanding of telephone nursing as an important factor for decreasing respiratory tract infection consultations with general practitioners, thus contributing to decreased antibiotic usage in Sweden. To cope with the challenges of telephone nursing in primary healthcare centres, it seems important to systematically introduce the use of the available decision support tool, and set aside time for inter- and intraprofessional discussions and feedback. The collegial support and team collaboration asked for is likely to get synergy effects such as better work environment and job satisfaction for both registered nurses and general practitioners. Future studies are needed to explore telephone nursing in primary healthcare centres in a broader sense to better understand the function and the effects in the complexity of primary healthcare.

Guiding patients to appropriate care: developing Japanese outpatient triage nurse competencies

Japanese patients often seek hospital services without a primary provider’s referral. A triage nurse who is the initial point of contact for a patient is challenged with the task of expertly evaluating the urgency of the condition and selecting the appropriate specialty service for every patient’s needs. A triage nurse must also recognize any conditions requiring emergency medical services instead of a specialty outpatient service. A modified Delphi method was used to establish expert consensus regarding triage nursing competencies for secondary and higher-level health care facilities in Japan.

The initial Delphi round was completed using a questionnaire of 80 competencies that were evaluated by 85 Japanese nurse experts with in-depth knowledge of triage and/or the current Japanese hospital system. Four additional competency items were added based on the experts’ suggestions for a total of 84 items. The experts rated these items on a 7-point Likert scale based on importance. Minimal attrition rate yielded consistent and rich results.

The results were analyzed to identify items rated as very important by the majority. Twenty-two items were included in the final list of competencies. The authors then refined the language and reorganized the items into four proposed domains. The proposed domains and the refined list of competencies provide a foundation for the development of training programs for outpatient triage nurses in the current Japanese health care system.

GPs' and practice staff's views of a telephone first approach to demand management: a qualitative study in primary care

Background

To better manage patient demand, some general practices have implemented a ‘telephone first’ approach in which all patients seeking a face-to-face appointment first have to speak to a GP on the telephone. Previous studies have suggested that there is considerable scope for this new approach, but there remain significant concerns.

Aim

To understand the views of GPs and practice staff of the telephone first approach, and to identify enablers and barriers to successful adoption of the approach.

Design and setting

A qualitative study of the telephone first approach in 12 general practices that have adopted it, and two general practices that have tried the approach but reverted to their previous system.

Method

A total of 53 qualitative interviews with GPs and practice staff were conducted. Transcriptions of the interviews were systematically analysed.

Results

Staff in the majority of practices reported that the approach was an improvement on their previous system, but all practices experienced challenges; for example, where practices did not have the capacity to meet the increase in demand for telephone consultations. Staff were also aware that the new system suited some patients better than others. Adoption of the telephone first approach could be very stressful, with a negative impact on morale, especially reported in interviews with the two practices that had tried but stopped the approach. Interviewees identified enablers and barriers to the successful adoption of a telephone first approach in primary care. Enablers to successful adoption were: understanding demand, practice staff as pivotal, making modifications to the approach, and educating patients.

Conclusion

Practices considering adopting or clinical commissioning groups considering funding a telephone first approach should consider carefully a practice’s capacity and capability before launching.

A ‘telephone first’ approach to demand management in English general practice: a multimethod evaluation

Background

The increasing difficulty experienced by general practices in meeting patient demand is leading to new approaches being tried, including greater use of telephone consulting.

Objectives

To evaluate a ‘telephone first’ approach, in which all patients requesting a general practitioner (GP) appointment are asked to speak to a GP on the telephone first.

Methods

The study used a controlled before-and-after (time-series) approach using national reference data sets; it also incorporated economic and qualitative elements. There was a comparison between 146 practices using the ‘telephone first’ approach and control practices in England with regard to GP Patient Survey scores and secondary care utilisation (Hospital Episode Statistics). A practice manager survey was used in the ‘telephone first’ practices. There was an analysis of practice data and the patient surveys conducted in 20 practices using the ‘telephone first’ approach. Interviews were conducted with 43 patients and 49 primary care staff. The study also included an analysis of costs.

Results

Following the introduction of the ‘telephone first’ approach, the average number of face-to-face consultations in practices decreased by 38% [95% confidence interval (CI) 29% to 45%; p < 0.0001], whereas there was a 12-fold increase in telephone consultations (95% CI 6.3-fold to 22.9-fold; p < 0.0001). The average durations of consultations decreased, which, when combined with the increased number of consultations, we estimate led to an overall increase of 8% in the mean time spent consulting by GPs, although there was a large amount of uncertainty (95% CI –1% to 17%; p = 0.0883). These average workload figures mask wide variation between practices, with some practices experiencing a substantial reduction in workload. Comparing ‘telephone first’ practices with control practices in England in terms of scores in the national GP Patient Survey, there was an improvement of 20 percentage points in responses to the survey question on length of time to get to see or speak to a doctor or nurse. Other responses were slightly negative. The introduction of the ‘telephone first’ approach was followed by a small (2%) increase in hospital admissions; there was no initial change in accident and emergency (A&E) department attendance, but there was a subsequent small (2%) decrease in the rate of increase in A&E attendances. We found no evidence that the ‘telephone first’ approach would produce net reductions in secondary care costs. Patients and staff expressed a wide range of both positive and negative views in interviews.

Conclusions

The ‘telephone first’ approach shows that many problems in general practice can be dealt with on the telephone. However, the approach does not suit all patients and is not a panacea for meeting demand for care, and it is unlikely to reduce secondary care costs. Future research could include identifying how telephone consulting best meets the needs of different patient groups and practices in varying circumstances and how resources can be tailored to predictable patterns of demand.

Limitations

We acknowledge a number of limitations to our approach. We did not conduct a systematic review of the literature, data collected from clinical administrative records were not originally designed for research purposes and for one element of the study we had no control data. In the economic analysis, we relied on practice managers’ perceptions of staff changes attributed to the ‘telephone first’ approach. In our qualitative work and patient survey, we have some evidence that the practices that participated in that element of the study had a more positive patient experience than those that did not.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

A computer template to enhance patient-centredness in multimorbidity reviews: a qualitative evaluation in primary care

Background

Computer templates for review of single long-term conditions are commonly used to record care processes, but they may inhibit communication and prevent patients from discussing their wider concerns.

Aim

To evaluate the effect on patient-centredness of a novel computer template used in multimorbidity reviews.

Design and setting

A qualitative process evaluation of a randomised controlled trial in 33 GP practices in England and Scotland examining the implementation of a patient-centred complex intervention intended to improve management of multimorbidity. A purpose-designed computer template combining long-term condition reviews was used to support the patient-centred intervention.

Method

Twenty-eight reviews using the intervention computer template and nine usual-care reviews were observed and recorded. Sixteen patient interviews, four patient focus groups, and 23 clinician interviews were also conducted in eight of the 12 intervention practices. Transcripts were thematically analysed based on predefined core components of patient-centredness and template use.

Results

Disrupted communication was more evident in intervention reviews because the template was unfamiliar, but the first template question about patients’ important health issues successfully elicited wide-ranging health concerns. Patients welcomed the more holistic, comprehensive reviews, and some unmet healthcare needs were identified. Most clinicians valued identifying patients’ agendas, but some felt it diverted attention from care of long-term conditions. Goal-setting was GP-led rather than collaborative.

Conclusion

Including patient-centred questions in long-term condition review templates appears to improve patients’ perceptions about the patient-centredness of reviews, despite template demands on a clinician’s attention. Adding an initial question in standardised reviews about the patient’s main concerns should be considered.

Feasibility, acceptability and effectiveness of an online alternative to face-to-face consultation in general practice: a mixed-methods study of webGP in six Devon practices

OBJECTIVES

To evaluate the feasibility, acceptability and effectiveness of webGP as piloted by six general practices.

METHODS

Mixed-methods evaluation, including data extraction from practice databases, general practitioner (GP) completion of case reports, patient questionnaires and staff interviews.

SETTING

General practices in NHS Northern, Eastern and Western Devon Clinical Commissioning Group's area approximately 6 months after implementing webGP (February-July 2016).

PARTICIPANTS

Six practices provided consultations data; 20 GPs completed case reports (regarding 61 e-consults); 81 patients completed questionnaires; 5 GPs and 5 administrators were interviewed.

OUTCOME MEASURES

Attitudes and experiences of practice staff and patients regarding webGP.

RESULTS

WebGP uptake during the evaluation was small, showing no discernible impact on practice workload. The completeness of cross-sectional data on consultation workload varied between practices.GPs judged 41/61 (72%) of webGP requests to require a face-to-face or telephone consultation. Introducing webGP appeared to be associated with shifts in responsibility and workload between practice staff and between practices and patients.81/231 patients completed a postal survey (35.1% response rate). E-Consulters were somewhat younger and more likely to be employed than face-to-face respondents. WebGP appeared broadly acceptable to patients regarding timeliness and quality/experience of care provided. Similar problems were presented by all respondents. Both groups appeared equally familiar with other practice online services; e-consulters were somewhat more likely to have used them.From semistructured staff interviews, it appeared that, while largely acceptable within practice, introducing e-consults had potential for adverse interactions with pre-existing practice systems.

CONCLUSIONS

There is potential to assess the impact of new systems on consultation patterns by extracting routine data from practice databases. Staff and patients noticed subtle changes to responsibilities associated with online options. Greater uptake requires good communication between practice and patients, and organisation of systems to avoid conflicts and misuse. Further research is required to evaluate the full potential of webGP in managing practice workload.

Evaluation of telephone first approach to demand management in English general practice: observational study

Objective To evaluate a "telephone first" approach, in which all patients wanting to see a general practitioner (GP) are asked to speak to a GP on the phone before being given an appointment for a face to face consultation.Design Time series and cross sectional analysis of routine healthcare data, data from national surveys, and primary survey data.Participants 147 general practices adopting the telephone first approach compared with a 10% random sample of other practices in England.Intervention Management support for workload planning and introduction of the telephone first approach provided by two commercial companies.Main outcome measures Number of consultations, total time consulting (59 telephone first practices, no controls). Patient experience (GP Patient Survey, telephone first practices plus controls). Use and costs of secondary care (hospital episode statistics, telephone first practices plus controls). The main analysis was intention to treat, with sensitivity analyses restricted to practices thought to be closely following the companies' protocols.Results After the introduction of the telephone first approach, face to face consultations decreased considerably (adjusted change within practices -38%, 95% confidence interval -45% to -29%; P<0.001). An average practice experienced a 12-fold increase in telephone consultations (1204%, 633% to 2290%; P<0.001). The average duration of both telephone and face to face consultations decreased, but there was an overall increase of 8% in the mean time spent consulting by GPs, albeit with large uncertainty on this estimate (95% confidence interval -1% to 17%; P=0.088). These average workload figures mask wide variation between practices, with some practices experiencing a substantial reduction in workload and others a large increase. Compared with other English practices in the national GP Patient Survey, in practices using the telephone first approach there was a large (20.0 percentage points, 95% confidence interval 18.2 to 21.9; P<0.001) improvement in length of time to be seen. In contrast, other scores on the GP Patient Survey were slightly more negative. Introduction of the telephone first approach was followed by a small (2.0%) increase in hospital admissions (95% confidence interval 1% to 3%; P=0.006), no initial change in emergency department attendance, but a small (2% per year) decrease in the subsequent rate of rise of emergency department attendance (1% to 3%; P=0.005). There was a small net increase in secondary care costs.Conclusions The telephone first approach shows that many problems in general practice can be dealt with over the phone. The approach does not suit all patients or practices and is not a panacea for meeting demand. There was no evidence to support claims that the approach would, on average, save costs or reduce use of secondary care.

Delivering End-of-Life Cancer Care: Perspectives of Providers

OBJECTIVES

Persistent gaps in end-of-life cancer care delivery and growing associated expenditures remain imminent US public health issues. The objective of this study was to understand clinical providers' experiences delivering cancer care for patients at the end of life and their perspectives on potential solutions to improve quality of care.

METHODS

Semistructured interviews were conducted with 75 cancer care providers across the United States. The interviews were recorded, transcribed, and analyzed using constant comparative method of qualitative analysis.

RESULTS

Providers identified 3 major cancer care delivery challenges including lack of time to educate patients and caregivers due to clinical volume and administrative burdens, ambiguity in determining both prognosis and timing of palliative care at the end-of-life, and lack of adequate systems to support non-face-to-face communication with patients. To address these challenges, providers endorsed several options for clinical practice redesign in their settings. These include use of a lay health worker to assist in addressing early advance care planning, proactive non-face-to-face communication with patients specifically regarding symptom management, and community and in-home delivery of cancer care services.

DISCUSSION

Specific strategies for cancer care redesign endorsed by health-care providers may be used to create interventions that can more efficiently and effectively address gaps in end-of-life cancer care.

Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: case study evaluation of adoption and maintenance of a complex intervention to reduce high-risk primary care prescribing

OBJECTIVE

To explore how different practices responded to the Data-driven Quality Improvement in Primary Care (DQIP) intervention in terms of their adoption of the work, reorganisation to deliver the intended change in care to patients, and whether implementation was sustained over time.

DESIGN

Mixed-methods parallel process evaluation of a cluster trial, reporting the comparative case study of purposively selected practices.

SETTING

Ten (30%) primary care practices participating in the trial from Scotland, UK.

RESULTS

Four practices were sampled because they had large rapid reductions in targeted prescribing. They all had internal agreement that the topic mattered, made early plans to implement including assigning responsibility for work and regularly evaluated progress. However, how they internally organised the work varied. Six practices were sampled because they had initial implementation failure. Implementation failure occurred at different stages depending on practice context, including internal disagreement about whether the work was worthwhile, and intention but lack of capacity to implement or sustain implementation due to unfilled posts or sickness. Practice context was not fixed, and most practices with initial failed implementation adapted to deliver at least some elements. All interviewed participants valued the intervention because it was an innovative way to address on an important aspect of safety (although one of the non-interviewed general practitioners in one practice disagreed with this). Participants felt that reviewing existing prescribing did influence their future initiation of targeted drugs, but raised concerns about sustainability.

CONCLUSIONS

Variation in implementation and effectiveness was associated with differences in how practices valued, engaged with and sustained the work required. Initial implementation failure varied with practice context, but was not static, with most practices at least partially implementing by the end of the trial. Practices organised their delivery of changed care to patients in ways which suited their context, emphasising the importance of flexibility in any future widespread implementation.

TRIAL REGISTRATION NUMBER

NCT01425502.

Interventions to reduce emergency department utilisation: A review of reviews

OBJECTIVE

To describe policy interventions that have the objective to reduce ED use and to estimate their effectiveness.

METHODS

Narrative review by searching three electronic databases for scientific literature review papers published between 2010 and October 2015. The quality of the included studies was assessed with AMSTAR, and a narrative synthesis of the retrieved papers was applied.

RESULTS

Twenty-three included publications described six types of interventions: (1) cost sharing; (2) strengthening primary care; (3) pre-hospital diversion (including telephone triage); (4) coordination; (5) education and self-management support; (6) barriers to access emergency departments. The high number of interventions, the divergent methods used to measure outcomes and the different populations complicate their evaluation. Although approximately two-thirds of the primary studies showed reductions in ED use for most interventions the evidence showed contradictory results.

CONCLUSION

Despite numerous publications, evidence about the effectiveness of interventions that aim to reduce ED use remains insufficient. Studies on more homogeneous patient groups with a clearly described intervention and control group are needed to determine for which specific target group what type of intervention is most successful and how the intervention should be designed. The effective use of ED services in general is a complex and multi-factorial problem that requires integrated interventions that will have to be adapted to the specific context of a country with a feedback system to monitor its (un-)intended consequences. Yet, the co-location of GP posts and emergency departments seems together with the introduction of telephone triage systems the preferred interventions to reduce inappropriate ED visits while case-management might reduce the number of ED attendances by frequent ED users.

Process evaluation for complex interventions in health services research: analysing context, text trajectories and disruptions

Background

Process evaluations assess the implementation and sustainability of complex healthcare interventions within clinical trials, with well-established theoretical models available for evaluating intervention delivery within specific contexts. However, there is a need to translate conceptualisations of context into analytical tools which enable the dynamic relationship between context and intervention implementation to be captured and understood.

Methods

In this paper I propose an alternative approach to the design, implementation and analysis of process evaluations for complex health interventions through a consideration of trial protocols as textual documents, distributed and enacted at multiple contextual levels. As an example, I conduct retrospective analysis of a sample of field notes and transcripts collected during the ESTEEM study - a cluster randomised controlled trial of primary care telephone triage. I draw on theoretical perspectives associated with Linguistic Ethnography to examine the delivery of ESTEEM through staff orientation to different texts. In doing so I consider what can be learned from examining the flow and enactment of protocols for notions of implementation and theoretical fidelity (i.e. intervention delivered as intended and whether congruent with the intervention theory).

Results

Implementation of the triage intervention required staff to integrate essential elements of the protocol within everyday practice, seen through the adoption and use of different texts that were distributed across staff and within specific events. Staff were observed deploying texts in diverse ways (e.g. reinterpreting scripts, deviating from standard operating procedures, difficulty completing decision support software), providing numerous instances of disruption to maintaining intervention fidelity. Such observations exposed tensions between different contextual features in which the trial was implemented, offering theoretical explanations for the main trial findings.

Conclusions

The value of following how trial protocols produce new texts is that we can observe the flow of ‘the intervention as intended’ across a series of events which are enacted to meet specific demands of intervention delivery. Such observations are not solely premised on identifying routines or practices of implementation, but where ‘protocols as intended’ breaks down. In doing so, I discuss whether it is here where we might expose the ‘active ingredients’ of interventions in action.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1651-8) contains supplementary material, which is available to authorized users.

The effect of nurses' preparedness and nurse practitioner status on triage call management in primary care: A secondary analysis of cross-sectional data from the ESTEEM trial

Background

Nurse-led telephone triage is increasingly used to manage demand for general practitioner consultations in UK general practice. Previous studies are equivocal about the relationship between clinical experience and the call outcomes of nurse triage. Most research is limited to investigating nurse telephone triage in out-of-hours settings.

Objective

To investigate whether the professional characteristics of primary care nurses undertaking computer decision supported software telephone triage are related to call disposition.

Design

Questionnaire survey of nurses delivering the nurse intervention arm of the ESTEEM trial, to capture role type (practice nurse or nurse practitioner), prescriber status, number of years’ nursing experience, graduate status, previous experience of triage, and perceived preparedness for triage.

Our main outcome was the proportion of triaged patients recommended for follow-up within the practice (call disposition), including all contact types (face-to-face, telephone or home visit), by a general practitioner or nurse.

Settings

15 general practices and 7012 patients receiving the nurse triage intervention in four regions of the UK.

Participants

45 nurse practitioners and practice nurse trained in the use of clinical decision support software.

Methods

We investigated the associations between nursing characteristics and triage call disposition for patient ‘same-day’ appointment requests in general practice using multivariable logistic regression modelling.

Results

Valid responses from 35 nurses (78%) from 14 practices: 31/35 (89%) had ≥10 years’ experience with 24/35 (69%) having ≥20 years. Most patient contacts (3842/4605; 86%) were recommended for follow-up within the practice. Nurse practitioners were less likely to recommend patients for follow-up odds ratio 0.19, 95% confidence interval 0.07; 0.49 than practice nurses. Nurses who reported that their previous experience had prepared them less well for triage were more likely to recommend patients for follow-up (OR 3.17, 95% CI 1.18–5.55).

Conclusion

Nurse characteristics were associated with disposition of triage calls to within practice follow-up. Nurse practitioners or those who reported feeling ‘more prepared’ for the role were more likely to manage the call definitively. Practices considering nurse triage should ensure that nurses transitioning into new roles feel adequately prepared. While standardised training is necessary, it may not be sufficient to ensure successful implementation.

Exploring demographic and lifestyle associations with patient experience following telephone triage by a primary care doctor or nurse: secondary analyses from a cluster randomised controlled trial

BACKGROUND

The ESTEEM trial was a cluster randomised controlled trial that compared two telephone triage management systems (general practitioner (GP) or a nurse supported by computer decision support software) with usual care, in response to a request for same-day consultation in general practice.

AIM

To investigate associations between trial patients' demographic, health, and lifestyle characteristics, and their reported experiences of care.

SETTING

Recruitment of 20 990 patients occurred between May 2011 and December 2012 in 42 GP practices in England (13 GP triage, 15 nurse triage, 14 usual care).

METHOD

Patients reported their experiences via a postal questionnaire issued 4 weeks after their initial request for a same-day consultation. Overall satisfaction, ease of accessing medical help/advice, and convenience of care were analysed using linear hierarchical modelling.

RESULTS

Questionnaires were returned by 12 132 patients (58%). Older patients reported increased overall satisfaction compared with patients aged 25-59 years, but patients aged 16-24 years reported lower satisfaction. Compared with white patients, patients from ethnic minorities reported lower satisfaction in all three arms, although to a lesser degree in the GP triage arm. Patients from ethnic minorities reported higher satisfaction in the GP triage than in usual care, whereas white patients reported higher satisfaction with usual care. Patients unable to take time away from work or who could only do so with difficulty reported lower satisfaction across all three trial arms.

CONCLUSIONS

Patient characteristics, such as age, ethnicity and ability to attend their practice during work hours, were associated with their experiences of care following a same-day consultation request in general practice. Telephone triage did not increase satisfaction among patients who were unable to attend their practice during working hours.

TRIAL REGISTRATION NUMBER

ISCRTN20687662.