1
|
Vainio H, Soininen L, Castrén M, Torkki P. Identifying performance indicators to measure overall performance of telephone triage - a scoping review. Scand J Prim Health Care 2024; 42:38-50. [PMID: 38078730 PMCID: PMC10851803 DOI: 10.1080/02813432.2023.2283188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Accepted: 11/08/2023] [Indexed: 02/08/2024] Open
Abstract
OBJECTIVE This article aims to summarize performance indicators used in telephone triage services research, and make recommendations for the selection of valid indicators to measure the performance of telephone triage. We describe what kind of frameworks, performance indicators, or variables have been used for evaluating telephone triage performance by systematically mapping the telephone triage performance measurement. The objective was to find measures for each Triple Aim dimension. DESIGN A scoping review method was used following Joanna Briggs Institute guidelines. Using this method, we defined indicators to measure the performance of telephone triage. We used the Triple Aim framework to identify indicators to measure the overall performance of telephone triage. The Triple Aim framework consists of improving the patient experience of care, improving the health of populations, and reducing cost per capita. SETTING The scoping review was performed using CINAHL, Medline, EBSCOhost, and PubMed electronic databases. The eligibility criterion was research published in English between 2015 and 2023. The inclusion focused on the use and performance of telephone triage services and system-focused studies. RESULTS A total of 1098 papers were screened for inclusion, with 57 papers included in our review. We identified 13 performance indicators covering all Triple Aim dimensions: waiting times, access, patient satisfaction, the accuracy of triage decision, severity and urgency of the symptoms, triage response, patient compliance with the advice given, follow-up healthcare service use, and running costs of service. We didn't find any earlier framework covering all Triple Aim dimensions properly. CONCLUSIONS Measuring the performance of telephone triage requires an extensive and comprehensive approach. We presented performance indicators that may be included in the framework for measuring the performance of telephone triage to support overall performance measurements of telephone triage.
Collapse
Affiliation(s)
- Hanna Vainio
- Department of Emergency Medicine and Services, Helsinki University and Helsinki University Hospital, Helsinki, Finland
| | - Leena Soininen
- DigiFinland Ltd., University of Helsinki, Helsinki, Finland
| | - Maaret Castrén
- Emergency Medicine, Department of Emergency Medicine and Services, Helsinki University and Helsinki University Hospital, Helsinki, Finland
| | - Paulus Torkki
- Department of Public Health, University of Helsinki, Helsinki, Finland
| |
Collapse
|
2
|
Chair SY, Chien WT, Kendall S, Zang Y, Liu T, Choi KC. Effects of Telephone Consultation on Safety, Service Use, Patient Satisfaction, and Workload: Systematic Review and Meta-Analysis of Randomized Trials. Telemed J E Health 2024; 30:364-380. [PMID: 37624630 DOI: 10.1089/tmj.2023.0002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/26/2023] Open
Abstract
Objective: Telephone consultation (TC) is widely used for its easy access and convenience. This review aimed to assess the effects of TC including triage on safety, service use, patient satisfaction, and health professionals' workload to inform directions for future health service practice. Methods: CENTRAL, MEDLINE, Embase, CINAHL, ProQuest Dissertation & Theses (Health & Medicine), ClinincalTrials.gov, and International Clinical Trial Registry Platform were searched on April 7, 2022. The included were randomized controlled trials that compared TC with standard (face-to-face [F2F]) management or that by another group of call advisers. Cochrane methods were used to select eligible studies, assess the risk of bias, estimate summary effect measure, and grade evidence certainty. Meta-analysis was performed on important outcomes with moderate- or high-quality evidence. Results: Eight studies were included involving 40,002 participants. TC could increase call resolution-proportion of callers' concerns being addressed by telephone advice alone (two studies; high certainty) and reduce F2F contacts with doctors for the first consultation (two studies, moderate certainty) compared with standard management or TC by doctors. None of included studies reported increases in adverse events, including all-cause mortality, acute and emergency department visit, and hospitalization. There was inadequate evidence regarding the effects of TC on patient satisfaction and length of consultation. Conclusion: The findings support the benefits of TC on improving call resolution and reducing F2F contacts with doctors on the day of first management for regular day service; and TC by nurses can provide better effects than that by doctors for out-of-hours service.
Collapse
Affiliation(s)
- Sek Ying Chair
- The Nethersole School of Nursing, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong
| | - Wai Tong Chien
- The Nethersole School of Nursing, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong
| | - Sally Kendall
- Community Nursing and Public Health, Centre for Health Services Studies, University of Kent, Canterbury, United Kingdom
| | - Yuli Zang
- The Nethersole School of Nursing, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong
| | - Ting Liu
- The Nethersole School of Nursing, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong
| | - Kai Chow Choi
- The Nethersole School of Nursing, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong
| |
Collapse
|
3
|
Chan J, Kirby J, Gardiner KK, Abruzzo V, Bannister S, Bellamy K, Brophy C, Clifford V, Cox L, Elborough H, Freyne BF, Summons F, Morrison C, Wall K, Casalaz DM, Curtis N, Pittet LF. Use of a paediatric advice line for parents of infants recruited to a randomised controlled trial. BMJ Paediatr Open 2023; 7:10.1136/bmjpo-2022-001665. [PMID: 36759016 PMCID: PMC9923309 DOI: 10.1136/bmjpo-2022-001665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 11/07/2022] [Indexed: 02/11/2023] Open
Abstract
BACKGROUND This study aims to describe the use of a paediatric advice line (PAL) provided to parents whose infants were recruited to a large randomised controlled trial (RCT), including the number and types of medical concerns addressed, seasonal variability and call outcomes. Additionally, sociodemographic characteristics of the parents and children of those parents who used the PAL are compared with those who did not. METHODS Prospective cohort of 1246 children nested in the Melbourne Infant Study: BCG for Allergy and Infection Reduction (MIS BAIR) RCT. All MIS BAIR participants were offered access to the PAL. Data were collected over the initial 2 years of a 5-year follow-up. Data were analysed using χ2 tests, and ORs were calculated using multiple logistic regression. RESULTS The PAL was used by 230 (18.5%) participants, who made a total of 586 calls during the 2-year study period. The reasons for calling the PAL were dermatological (24%); gastrointestinal (18%); disturbances in feeding, sleeping and crying (14%); respiratory (7%); and developmental/neurological (6%). Analysis revealed that those who used the PAL were more likely to be first-time parents (OR 1.4, 95% CI 1.1 to 1.9) and mothers who hold a university degree (OR 3.3, 95% CI 1.3 to 8.4). PAL costs were minimal and comprised 15 clinicians with paediatric experience. CONCLUSIONS A cost-effective PAL service for clinical trial participants was used appropriately by parents for relatively minor concerns and may have a role in trials to promote participant engagement and reduce demand for other health services.
Collapse
Affiliation(s)
- Joyce Chan
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia .,The Royal Melbourne Hospital, Parkville, Victoria, Australia
| | - Jordan Kirby
- Department of Obstetrics and Gynaecology, Mercy Hospital for Women, Heidelberg, Victoria, Australia
| | - Kaya Kareela Gardiner
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | - Veronica Abruzzo
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | - Samantha Bannister
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia.,Infectious Diseases Unit, Royal Children's Hospital Research Institute, Parkville, Victoria, Australia
| | - Karen Bellamy
- Australian Technical Advisory Group on Immunisation (ATAGI), Melbourne, Victoria, Australia.,Vaccine Safety Investigation Group (VSIG), Melbourne, Victoria, Australia
| | - Clare Brophy
- Murdoch Children's Research Institute, Parkville, Victoria, Australia.,The Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, Australia
| | - Vanessa Clifford
- Infectious Diseases Unit, Royal Children's Hospital Research Institute, Parkville, Victoria, Australia.,Laboratory Services, Royal Children's Hospital Research Institute, Parkville, Victoria, Australia
| | - Lianne Cox
- Murdoch Children's Research Institute, Parkville, Victoria, Australia.,Royal Children's Hospital Research Institute, Parkville, Victoria, Australia
| | - Hannah Elborough
- Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | | | - Freya Summons
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia.,Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Clare Morrison
- Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | - Kate Wall
- Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | - Daniel M Casalaz
- Department of Paediatrics, Mercy Hospital for Women, Heidelberg, Victoria, Australia
| | - Nigel Curtis
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia.,Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Laure F Pittet
- Infectious Diseases Research Group, Murdoch Children's Research Institute, Parkville, Victoria, Australia.,Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | | |
Collapse
|
4
|
Sexton V, Dale J, Bryce C, Barry J, Sellers E, Atherton H. Service use, clinical outcomes and user experience associated with urgent care services that use telephone-based digital triage: a systematic review. BMJ Open 2022; 12:e051569. [PMID: 34980613 PMCID: PMC8724705 DOI: 10.1136/bmjopen-2021-051569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
OBJECTIVE To evaluate service use, clinical outcomes and user experience related to telephone-based digital triage in urgent care. DESIGN Systematic review and narrative synthesis. DATA SOURCES Medline, Embase, CINAHL, Web of Science and Scopus were searched for literature published between 1 March 2000 and 1 April 2020. ELIGIBILITY CRITERIA FOR SELECTING STUDIES Studies of any design investigating patterns of triage advice, wider service use, clinical outcomes and user experience relating to telephone based digital triage in urgent care. DATA EXTRACTION AND SYNTHESIS Two reviewers extracted data and conducted quality assessments using the mixed methods appraisal tool. Narrative synthesis was used to analyse findings. RESULTS Thirty-one studies were included, with the majority being UK based; most investigated nurse-led digital triage (n=26). Eight evaluated the impact on wider healthcare service use following digital triage implementation, typically reporting reduction or no change in service use. Six investigated patient level service use, showing mixed findings relating to patients' adherence with triage advice. Evaluation of clinical outcomes was limited. Four studies reported on hospitalisation rates of digitally triaged patients and highlighted potential triage errors where patients appeared to have not been given sufficiently high urgency advice. Overall, service users reported high levels of satisfaction, in studies of both clinician and non-clinician led digital triage, but with some dissatisfaction over the relevance and number of triage questions. CONCLUSIONS Further research is needed into patient level service use, including patients' adherence with triage advice and how this influences subsequent use of services. Further evaluation of clinical outcomes using larger datasets and comparison of different digital triage systems is needed to explore consistency and safety. The safety and effectiveness of non-clinician led digital triage also needs evaluation. Such evidence should contribute to improvement of digital triage tools and service delivery. PROSPERO REGISTRATION NUMBER CRD42020178500.
Collapse
Affiliation(s)
- Vanashree Sexton
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| | - Jeremy Dale
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| | - Carol Bryce
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| | - James Barry
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| | - Elizabeth Sellers
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| | - Helen Atherton
- Unit of Academic Primary Care, Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
5
|
Engeltjes B, Rosman A, Bertens LCM, Wouters E, Cronie D, Scheele F. Reliability of Dutch Obstetric Telephone Triage. Risk Manag Healthc Policy 2021; 14:3247-3254. [PMID: 34393531 PMCID: PMC8357617 DOI: 10.2147/rmhp.s319564] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 07/22/2021] [Indexed: 11/23/2022] Open
Abstract
Background Safety and efficiency of emergency care can be optimized with a triage system which uses urgency to prioritize care. The Dutch Obstetric Telephone Triage System (DOTTS) was developed to provide a basis for assessing urgency of unplanned obstetric care requests by telephone. Reliability and validity are important components in evaluating such (obstetric) triage systems. Objective To determine the reliability of Dutch Obstetric Telephone Triage, by calculating the inter-rater and intra-rater reliability. Methods To evaluate the urgency levels of DOTTS by testing inter-rater and intra-rater reliability, 90 vignettes of possible requests were developed. Nineteen participants, from hospitals where DOTTS had been implemented, rated in two rounds a set of ten vignettes. The five urgency levels and five presenting symptoms had an equal spread and had to be entered in accordance with DOTTS per vignette. Urgency levels were dichotomized into high urgency and intermediate urgency. Inter-rater reliability was rated as degree of agreement between two different participants with the same vignette. Intra-rater reliability was rated as agreement by the same participants at different moments in time. The degree of inter-rater and intra-rater reliability was tested using weighted Cohen’s Kappa and ICC. Results The agreement of urgency level between participants in accordance with predefined urgency level per vignette was 90.5% (95% CI 87.5–93.6) [335 of 370]. Agreement of urgency level between participants was 88.5% (95% CI 84.9–93.0) [177 of 200] and 84.9% (95% CI 78.3–91.4) after re-rating [101 of 119]. Inter-rater reliability of DOTTS expressed as Cohen’s Kappa was 0.77 and as ICC 0.87; intra-rater reliability of DOTTS expressed as Cohen’s Kappa was 0.70 and as ICC 0.82. Conclusion Inter-rater and intra-rater reliability of DOTTS showed substantial correlation, and is comparable to other studies. Therefore, DOTTS is considered reliable.
Collapse
Affiliation(s)
- Bernice Engeltjes
- Athena Institute for Transdisciplinary Research, Faculty of Science, VU University, Amsterdam, the Netherlands.,Department of Healthcare Studies, Rotterdam University of Applied Sciences, Rotterdam, the Netherlands
| | - Ageeth Rosman
- Department of Healthcare Studies, Rotterdam University of Applied Sciences, Rotterdam, the Netherlands
| | - Loes C M Bertens
- Department of Obstetrics and Gynecology, Erasmus MC, University Medical Centre Rotterdam, Rotterdam, the Netherlands
| | - Eveline Wouters
- Department of Tranzo, Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, the Netherlands
| | - Doug Cronie
- Department of Healthcare Studies, Rotterdam University of Applied Sciences, Rotterdam, the Netherlands
| | - Fedde Scheele
- Athena Institute for Transdisciplinary Research, Faculty of Science, VU University, Amsterdam, the Netherlands.,Department of Healthcare Education, OLVG Teaching Hospital, Amsterdam, the Netherlands
| |
Collapse
|