Safety, efficiency and health-related quality of telephone triage conducted by general practitioners, nurses, or physicians in out-of-hours primary care: a quasi-experimental study using the Assessment of Quality in Telephone Triage (AQTT) to assess audio-recorded telephone calls

Task shifting from general practitioners to other health professionals in out-of-hours primary care - a systematic literature review on content and quality of task shifting

BACKGROUND

Task shifting from general practitioners (GPs) to other health professionals could solve the increased workload, but an overview of the evidence is lacking for out-of-hours primary care (OOH-PC).

OBJECTIVES

To evaluate the content and quality of task shifting from GPs to other health professionals in clinic consultations and home visits in OOH-PC.

METHODS

Four database literature searches were performed on 13 December 2021, and updated in August 2023. We included articles that studied content (patient characteristics, reason for encounter) and/or quality (patient satisfaction, safety, efficiency) of task shifting in face-to-face contacts at OOH-PC. Two authors independently screened articles for inclusion and assessed the methodological quality of included articles using the JBI critical appraisal checklist. Data was extracted and results were synthesised in a narrative summary.

RESULTS

The search identified 1,829 articles, resulting in the final inclusion of seven articles conducted in the UK or the Netherlands. Studies compared GPs with other health professionals (mainly nurses). These other health professionals saw patients with less urgent health problems, younger patients, and patients with less complex health problems than GPs. Most studies concluded that other health professionals provided safe and vastly efficient care corresponding to the level of GPs but findings about productivity were inconclusive.

CONCLUSION

The level of safety and efficiency of care provided by other health professionals in OOH-PC seems like that of GPs, although they mainly see patients presenting with less urgent and less complex health problems.

How Healthcare Providers Decide on a Referral Location in Telephone Triage: A Cross-sectional Study

BACKGROUND

Approximately 25% of patients that present to the emergency department (ED) do so after contact with a healthcare professional. Many of these patients could be effectively managed in non-ED ambulatory settings. Aligning patients with safe and appropriate outpatient care has the potential to improve ED overcrowding, patient experience, outcomes, and costs. Little is understood about how healthcare providers approach triage decision-making and what factors influence their choices.

OBJECTIVES

To evaluate how providers think about patient triage, and what factors influence their decision-making when triaging patient calls.

DESIGN

Cross-sectional survey-based study in which participants make triage decisions for hypothetical clinical scenarios.

PARTICIPANTS

Healthcare providers in the specialties of internal medicine, family medicine, or emergency medicine within a large integrated healthcare system in the Southeast.

MAIN MEASURES

Differences in individual training and practice characteristics were used to compare observed differences in triage outcomes. Free-response data were evaluated to identify themes and factors affecting triage decisions.

KEY RESULTS

Out of 72 total participants, substantial variability in triage decision-making was observed among all patient cases. Attending physicians triaged 1.4 fewer cases to ED care compared with resident physicians (p < 0.001, 95% CI 0.62-2.1). Academic attendings demonstrated a trend toward fewer cases to ED care compared with community attendings (0.61, p = 0.188, 95% CI - 0.31-1.5). Qualitative data highlighted the complex considerations in provider triage and led to the development of a novel conceptual model to describe the cognitive triage process and the main influencing factors.

CONCLUSIONS

Triage decision-making for healthcare providers is influenced by many factors related to clinical resources, care coordination, patient factors, and clinician factors. The complex considerations involved yield variability in triage decisions that is largely unexplained by descriptive physician factors.

Building a performance measurement framework for telephone triage services in Finland: a consensus-making study based on nominal group technique

BACKGROUND

There has been a significant expansion in the measurement of healthcare system performance. However, there is a lack of a comprehensive performance measurement framework to assess the effects of telephone triage services on the urgent care system. The aim of our Delphi study was to construct and validate a performance measurement framework designed explicitly for telephone triage services.

METHODS

This study was conducted in Finland with a group of eight experienced senior physicians from the country's 20 largest joint emergency departments, serving over 90% of the population for urgent care. The Nominal Group Technique (NGT) was utilised to achieve consensus on measuring telephone triage performance. Initially, performance indicators (PIs) were identified through Delphi method rounds from December 10th to December 27th, 2021, with eight experts participating, and from December 29th, 2021, to January 23rd, 2022, where five of these experts responded. NGT further deepened these themes and perspectives, aiding in the development of a comprehensive performance measurement framework. The final framework validation began with an initial round from February 13th to March 3rd, 2022, receiving five responses. Due to the limited number of responses, an additional validation round was conducted from October 29th to November 7th, 2023, resulting in two more responses, increasing the total number of respondents in the validation phase to seven.

RESULTS

The study identified a strong desire among professionals to implement a uniform framework for measuring telephone triage performance. The finalised framework evaluates telephone triage across five dimensions: service accessibility, patient experience, quality and safety, process outcome, and cost per case. Eight specific PIs were established, including call response metrics, service utility, follow-up care type and distribution, ICPC-2 classified encounter reasons, patient compliance with follow-up care, medical history review during assessment, and service cost per call.

CONCLUSIONS

This study validated a performance measurement framework for telephone triage services, utilising existing literature and the NGT method. The framework includes five key dimensions: patient experience, quality and safety, outcome of the telephone triage process, cost per case, and eight PIs. It offers a structured and comprehensive approach to measuring the overall performance of telephone triage services, enhancing our ability to evaluate these services effectively.

Descriptive analysis and evaluation of Health Link referrals to the emergency department before and during the COVID-19 pandemic

BACKGROUND

In Alberta, Health Link (HL) provides a 24-h, nurse-staffed, phone resource to the public for health-care advice. HL directs callers to either seek care in the emergency department (ED), with a primary care provider or provide self-care at home. This work aims to describe HL ED referrals prior to and during the COVID-19 pandemic.

METHODS

Data from January 1, 2018-December 31, 2019, and July 1, 2020-June 30, 2022, were selected. HL calls were categorized as likely appropriate if the patient was referred and presented to the ED within 24 h and had a Canadian Triage and Acuity Scale (CTAS) of 1-3; or a CTAS of 4-5 and the patient was admitted, specialist consulted, or diagnostic imaging or laboratory tests were completed. The primary outcome was the percentage of likely appropriate referrals among all HL ED referrals.

RESULTS

In the 2018-2019 and 2020-2022 samples, respectively, there were 845,372 and 832,730 calls. Of the 211,723 and 213,486 ED referrals, only 140,614 (66.4%) and 143,322 (67.1%) presented to an ED. Of these, 84.3 and 86.7 per 100 patient visits were categorized as likely appropriate referrals. Health Link referrals account for 3.2% and 3.8% of all ED visits.

IMPACT

HL referrals to the ED represent only a small percentage of all ED visits. Based on our definition, most referrals by HL are likely appropriate. The COVID-19 pandemic does not appear to have altered the rates of calls to HL, the number of HL calls referred to the ED, nor the likely appropriateness of those referrals.

Identifying performance indicators to measure overall performance of telephone triage - a scoping review

OBJECTIVE

This article aims to summarize performance indicators used in telephone triage services research, and make recommendations for the selection of valid indicators to measure the performance of telephone triage. We describe what kind of frameworks, performance indicators, or variables have been used for evaluating telephone triage performance by systematically mapping the telephone triage performance measurement. The objective was to find measures for each Triple Aim dimension.

DESIGN

A scoping review method was used following Joanna Briggs Institute guidelines. Using this method, we defined indicators to measure the performance of telephone triage. We used the Triple Aim framework to identify indicators to measure the overall performance of telephone triage. The Triple Aim framework consists of improving the patient experience of care, improving the health of populations, and reducing cost per capita.

SETTING

The scoping review was performed using CINAHL, Medline, EBSCOhost, and PubMed electronic databases. The eligibility criterion was research published in English between 2015 and 2023. The inclusion focused on the use and performance of telephone triage services and system-focused studies.

RESULTS

A total of 1098 papers were screened for inclusion, with 57 papers included in our review. We identified 13 performance indicators covering all Triple Aim dimensions: waiting times, access, patient satisfaction, the accuracy of triage decision, severity and urgency of the symptoms, triage response, patient compliance with the advice given, follow-up healthcare service use, and running costs of service. We didn't find any earlier framework covering all Triple Aim dimensions properly.

CONCLUSIONS

Measuring the performance of telephone triage requires an extensive and comprehensive approach. We presented performance indicators that may be included in the framework for measuring the performance of telephone triage to support overall performance measurements of telephone triage.

What can we learn from experiences in general practice during the COVID-19 pandemic? A qualitative study

BACKGROUND

Experiences with organizational changes in daytime general practices and out-of-hours (OOH) services during the COVID-19 pandemic may help to address the challenges in general practice care that were already a concern before the crisis. This study aimed to describe these experiences and the potential usefulness of the organizational changes for future general practice care and any future pandemics.

METHODS

Semi-structured interviews were performed among 11 directors of OOH services, and 19 (locum) general practitioners (GPs) or practice managers, who were purposively sampled. Video or telephone interviews were performed in two rounds: between November 2020 and January 2021 and between May 2021 and August 2021. The data were analyzed using thematic analysis methods.

RESULTS

Three themes emerged from the data: (1) Changes in the triage procedures; in GP practices and OOH services, stricter triage criteria were implemented, and GPs were more actively involved in the triage process. These measures helped to reduce the number of 'low urgency' face-to-face consultations. (2) Changes in GP care; there was a shift towards video and telephone consultations, allowing GPs to spend more time with patients during the remaining face-to-face consultations. For chronic patients, the shift towards telemonitoring appeared to encourage self-care, and postponing face-to-face consultations for regular checkups appeared to be unproblematic for stable patients. (3) Coordination of GP care and information communication flow during the COVID-19 pandemic; OOH directors perceived a lack of consistency in the information from various governmental and non-governmental parties on containment measures and guidelines related to COVID-19, making it difficult to act on them. The COVID-19 pandemic intensified collaboration between GPs, OOH services, and other healthcare professionals.

CONCLUSIONS

The results of this study indicate that some of the organizational changes, such as stricter triage, remote consultations, and changes in managed care of chronic patients, may help in tackling the pre-existing challenges in GP care from before the COVID-19 pandemic. However, more extensive research and continuous monitoring are necessary to establish the effects on patients and their health outcomes. To navigate future pandemics, the intensified collaboration between health professionals should be maintained, while there is considerable room for improvement in the provision of unambiguous information.

Factors associated with undertriage and overtriage in telephone triage in Danish out-of-hours primary care: a natural quasi-experimental cross-sectional study of randomly selected and high-risk calls

OBJECTIVES

We aim to explore undertriage and overtriage in a high-risk patient population and explore patient characteristics and call characteristics associated with undertriage and overtriage in both randomly selected and in high-risk telephone calls to out-of-hours primary care (OOH-PC).

DESIGN

Natural quasi-experimental cross-sectional study.

SETTING

Two Danish OOH-PC services using different telephone triage models: a general practitioner cooperative with GP-led triage and the medical helpline 1813 with computerised decision support system-guided nurse-led triage.

PARTICIPANTS

We included audio-recorded telephone triage calls from 2016: 806 random calls and 405 high-risk calls (defined as patients ≥30 years calling with abdominal pain).

MAIN OUTCOME MEASURES

Twenty-four experienced physicians used a validated assessment tool to assess the accuracy of triage. We calculated the relative risk (RR) for clinically relevant undertriage and overtriage for a range of patient characteristics and call characteristics.

RESULTS

We included 806 randomly selected calls (44 clinically relevant undertriaged and 54 clinically relevant overtriaged) and 405 high-risk calls (32 undertriaged and 24 overtriaged). In high-risk calls, nurse-led triage was associated with significantly less undertriage (RR: 0.47, 95% CI 0.23 to 0.97) and more overtriage (RR: 3.93, 95% CI 1.50 to 10.33) compared with GP-led triage. In high-risk calls, the risk of undertriage was significantly higher for calls during nighttime (RR: 2.1, 95% CI 1.05 to 4.07). Undertriage tended to be more likely for calls concerning patients ≥60 years compared with 30-59 years (11.3% vs 6.3%) in high-risk calls. However, this result was not significant.

CONCLUSION

Nurse-led triage was associated with less undertriage and more overtriage compared with GP-led triage in high-risk calls. This study may suggest that to minimise undertriage, the triage professionals should pay extra attention when a call occurs during nighttime or concerns elderly. However, this needs confirmation in future studies.

Development over time in point-of-care test use in Danish daytime and out-of-hours general practice: a register-based study

OBJECTIVE

To describe the development over time of the use of C-reactive protein (CRP) and rapid streptococcal detection test (RADT) point-of-care tests (POCT) in Danish general practice and to explore associations between patient characteristics and POCT use (i.e. CRP and RADT).

DESIGN AND SETTINGS

A register-based study including all general practice clinic consultations in daytime and out-of-hours (OOH) settings in Denmark between 2003 and 2018.

SUBJECTS

All citizens who had at least one clinic consultation in daytime or OOH general practice within the study period.

MAIN OUTCOME MEASURES

We estimated the total and relative use of CRP and RADT POCTs and described the development over time. Crude and adjusted proportion ratios (PRs) were calculated to explore associations between patient characteristics and POCT use.

RESULTS

Overall, the relative use of CRP POCTs increased. At OOH, a steep increase was noticed around 2012. The relative use of RADT decreased. Patient age 40-59 years and existing comorbidity were significantly associated with a higher use of CRP testing in both settings. A significantly lower use of CRP testing was found for patients with higher educational level. We found a significantly higher use of RADT testing for patients aged 0-19 years and with higher household educational level, whereas comorbidity was associated with a lower use of RADT testing.

CONCLUSION

The use of CRP POCT increased over time, whereas the use of RADT POCT decreased. Perhaps the success of implementing CRP as a tool for reducing antibiotic use has reached it limit. Future studies should focus on how and when POCT are used most optimal.Key pointsCRP POC tests and RADT POCTs are frequently used diagnostic tools in general practice, both in daytime and in the out-of-hours setting.There was an increased use of CRP POCTs, particularly in out-of-hours general practice, whereas the use of RADT POCTs declined between 2003 and 2018.CRP POCTs were associated with age of 40-59 years and co-morbidity, while the use of RADT was mostly associated with younger age.

Implementation costs of telephone nurse triage service

Telephone nurse triage services are becoming increasingly common in healthcare systems worldwide. Florianópolis (Santa Catarina State, Brazil) is the first municipality in the country to provide this service in its public health system. This study adopted a quantitative, descriptive, and analytical methodology to evaluate the impact of this program on overall costs of the public health system. The research examined all 33,869 calls received by the telephone triage service from March 16 to October 31 in 2020, and calculated the program costs during the period. Avoided cost were calculated by the difference between estimated consultation costs considering patient-stated first alternative and the program recommendation after triage. Analyzing only the costs for the municipality of Florianópolis, the program's costs exceeded avoided costs by almost BRL 2.5 million during the period. By expanding the analysis to include costs of emergency department consultation - not administered by the municipality - based on data from previous research, we found that the program spares BRL 34.59 per call, a 21% cost reduction for the health system. Considering the preliminary results of the study and its limitations, it is understood that the service of telephone nurse triage can reduce costs in the healthcare system.

Triage Errors in Primary and Pre-Primary Care

Triage errors are a major concern in health care due to resulting harmful delays in treatments or inappropriate allocation of resources. With the increasing popularity of digital symptom checkers in pre–primary care settings, and amid claims that artificial intelligence outperforms doctors, the accuracy of triage by digital symptom checkers is ever more scrutinized. This paper examines the context and challenges of triage in primary care, pre–primary care, and emergency care, as well as reviews existing evidence on the prevalence of triage errors in all three settings. Implications for development, research, and practice are highlighted, and recommendations are made on how digital symptom checkers should be best positioned.

Is tele-diagnosis of dental conditions reliable during COVID-19 pandemic? Agreement between tentative diagnosis via synchronous audioconferencing and definitive clinical diagnosis

Objectives

To assess the reliability of synchronous audioconferencing teledentistry (TD) in making tentative diagnosis compared to definitive clinical face-to-face (CFTF) diagnosis; and whether agreement was influenced by dentist's experience, caller-patient relationship, and time of call.

Methods

All patients calling the TD hotline during COVID-19 pandemic, triaged as emergency/ urgent and referred for CFTF care were included (N=191). Hotline dentists triaged the calls, made tentative audio-dentistry (AD) diagnosis, while dentists at point of referral made the definitive CFTF diagnosis. Cohen's weighted kappa (κ) assessed the extent of agreement between AD vs CFTF diagnosis.

Results

There was significantly very good pair-wise agreement (κ = 0.853, P < 0.0001) between AD and CFTF diagnosis. AD diagnosis of pulpitis and periodontitis exhibited the most frequent disagreements. Tele-dentists with ≥ 20 years’ experience exhibited the highest level of agreement (κ =0.872, P < 0.0001). There was perfect agreement when mothers mediated the call (κ = 1, P < 0.0001), and very good agreement for calls received between 7 am-2 pm (κ = 0.880, P < 0.0001) compared to calls received between 2-10 pm (κ = 0.793, P < 0.0001).

Conclusions

Remote tentative diagnosis using AD is safe and reliable. Reliability was generally very good but varied by dentist's experience, caller-patient relationship, and time of call.

Clinical significance

The findings suggest that using AD in the home environment is safe and reliable, deploying providers with variable years of experience. The findings have generalizability potential to a variety of similar circumstances, healthcare settings and epi/pandemic situations.

Safety of Triage Self-assessment Using a Symptom Assessment App for Walk-in Patients in the Emergency Care Setting: Observational Prospective Cross-sectional Study

Background

Increasing use of emergency departments (EDs) by patients with low urgency, combined with limited availability of medical staff, results in extended waiting times and delayed care. Technological approaches could possibly increase efficiency by providing urgency advice and symptom assessments.

Objective

The purpose of this study is to evaluate the safety of urgency advice provided by a symptom assessment app, Ada, in an ED.

Methods

The study was conducted at the interdisciplinary ED of Marburg University Hospital, with data collection performed between August 2019 and March 2020. This study had a single-center cross-sectional prospective observational design and included 378 patients. The app’s urgency recommendation was compared with an established triage concept (Manchester Triage System [MTS]), including patients from the lower 3 MTS categories only. For all patients who were undertriaged, an expert physician panel assessed the case to detect potential avoidable hazardous situations (AHSs).

Results

Of 378 participants, 344 (91%) were triaged the same or more conservatively and 34 (8.9%) were undertriaged by the app. Of the 378 patients, 14 (3.7%) had received safe advice determined by the expert panel and 20 (5.3%) were considered to be potential AHS. Therefore, the assessment could be considered safe in 94.7% (358/378) of the patients when compared with the MTS assessment. From the 3 lowest MTS categories, 43.4% (164/378) of patients were not considered as emergency cases by the app, but could have been safely treated by a general practitioner or would not have required a physician consultation at all.

Conclusions

The app provided urgency advice after patient self-triage that has a high rate of safety, a rate of undertriage, and a rate of triage with potential to be an AHS, equivalent to telephone triage by health care professionals while still being more conservative than direct ED triage. A large proportion of patients in the ED were not considered as emergency cases, which could possibly relieve ED burden if used at home. Further research should be conducted in the at-home setting to evaluate this hypothesis.

Trial Registration

German Clinical Trial Registration DRKS00024909; https://www.drks.de/drks_web/navigate.do? navigationId=trial.HTML&TRIAL_ID=DRKS00024909

Factors associated with undertriage in patients classified by the need to visit a hospital by telephone triage: a retrospective cohort study

BACKGROUND

Prehospital telephone triage stratifies patients into five categories, "need immediate hospital visit by ambulance," "need to visit a hospital within 1 hour," "need to visit a hospital within 6 hours," "need to visit a hospital within 24 hours," and "do not need a hospital visit" in Japan. However, studies on whether present and past histories cause undertriage are limited in patients triaged as need an early hospital visit. We investigated factors associated with undertriage by comparing patient assessed to be appropriately triaged with those assessed undertriaged.

METHODS

We included all patients classified by telephone triage as need to visit a hospital within 1 h and 6 h who used a single after-hours house call (AHHC) medical service in Tokyo, Japan, between November 1, 2019, and November 31, 2020. After home consultation, AHHC doctors classified patients as grade 1 (treatable with over-the-counter medications), 2 (requires hospital or clinic visit), or 3 (requires ambulance transportation). Patients classified as grade 2 and 3 were defined as appropriately triaged and undertriaged, respectively.

RESULTS

We identified 10,742 eligible patients triaged as need to visit a hospital within 1 h and 6 h, including 10,479 (97.6%) appropriately triaged and 263 (2.4%) undertriaged patients. Multivariable logistic regression analyses revealed patients aged 16-64, 65-74, and ≥ 75 years (adjusted odds ratio [OR], 2.40 [95% confidence interval {CI} 1.71-3.36], 8.57 [95% CI 4.83-15.2], and 14.9 [95% CI 9.65-23.0], respectively; reference patients aged < 15 years); those with diabetes mellitus (2.31 [95% CI 1.25-4.26]); those with dementia (2.32 [95% CI 1.05-5.10]); and those with a history of cerebral infarction (1.98 [95% CI 1.01-3.87]) as more likely to be undertriaged.

CONCLUSIONS

We found that older adults and patients with diabetes mellitus, dementia, or a history of cerebral infarction were at risk of undertriage in patients triaged as need to visit a hospital within 1 h and 6 h, but further studies are needed to validate these findings.

Primary-care registered nurse telehealth policy implications

Coronavirus disease 2019 (COVID-19) has drastically changed health-care delivery models within primary-care settings. Primary-care providers are limiting routine care face-to-face office visits while triaging COVID-19 symptomatic patients to hospital emergency rooms. Primary-care providers are rapidly adopting telehealth modalities for care provisions during this unprecedented pandemic to allow practices to continue delivering primary care while preventing community spread of COVID-19. Federal legislation has responded to emergent public-health needs by removing barriers that have impeded widespread adoption of telehealth modalities. This legislation has omitted professional registered nurses (RNs) from delivering reimbursable telehealth services, which is problematic for primary-care practice. RNs historically have led telehealth service delivery and should therefore be included in new legislation as eligible health professionals permitted to provide reimbursable telehealth services. RNs improve quality outcomes in primary care within innovative team-based care models and are essential clinicians capable of providing ongoing care coordination and disease management for patients needing to stay on track with their usual care needs.