Evaluation of tumour marker utilisation and impact of electronic gatekeeping in the province of KwaZulu-Natal, South Africa

Background

Inappropriate testing remains a high healthcare cost driver. Tumour marker tests are more expensive than routine chemistry testing. Implementing test demand management systems like electronic gatekeeping (EGK) has reportedly decreased test requests.

Objective

This study aimed to describe the appropriateness of tumour marker tests, carcinoembryonic antigen, alpha foetal protein, prostate-specific antigen, carbohydrate antigen 19-9, cancer antigen 15-3, cancer antigen 125, and human chorionic gonadotropin, and determine the effectiveness of the EGK used in the public health sector in KwaZulu-Natal, South Africa.

Methods

Tumour marker test data for the KwaZulu-Natal province were extracted from the National Health Laboratory Service Central Data Warehouse for 01 January 2017 - 30 June 2017 (pre-EGK) and 01 January 2018 - 30 June 2018 (post-EGK implementation). Questionnaires were sent to the clinicians in the regional hospitals ordering the most tumour marker tests to assess ordering practices. In addition, we assessed monthly rejection reports to determine the effect of the EGK.

Results

The EGK minimally reduced tumour marker requests or associated costs (1.4% average EGK rejection rate). An overall 18% increase in the tumour marker tests occurred in 2018. The data suggest inappropriate tumour marker test utilisation, particularly for screening.

Conclusion

The introduction of EGK as a test demand management had little impact on tumour marker test requests and costs. Continuous education and reiteration of indications for tumour marker test use are required.

What this study adds

This study demonstrates the ineffectiveness of EGK in tumour marker orders, and provides some insight as to why these markers are being ordered, which is important in trying to decrease inappropriate ordering of these tests.

The usefulness of implementing minimum retest intervals in reducing inappropriate laboratory test requests in a Dutch hospital

OBJECTIVES

Inappropriate use of laboratory testing remains a challenging problem worldwide. Minimum retest intervals (MRI) are used to reduce inappropriate laboratory testing. However, their effectiveness and the usefulness in reducing inappropriate laboratory testing is still a matter of debate. The aim of this study was to evaluate the effectiveness of broadly implemented MRIs as a means of reducing inappropriate laboratory test requests.

METHODS

We performed a retrospective study in a general care and teaching hospital in the Netherlands, where MRI alerts have been implemented as standard care since June 7th 2017. Clinical chemistry test orders in adult internal medicine patients placed between July 13th 2017 and December 31st 2019 were included. The primary outcome was the effectiveness of MRIs, expressed as percentages of tests ordered and barred as a result of MRIs.

RESULTS

Of a total of 218,511 test requests, 4,159 (1.90%) got an MRI alert. These MRIs were overruled by physicians in 21.76% of the cases. As a result of implementing MRIs, 3,254 (1.49%) tests were barred. The financial savings for the department of internal medicine directly related to the included barred laboratory tests during this period were 11,880 euros on a total amount of 636,598 euros for all performed tests.

CONCLUSIONS

Only a small proportion of laboratory tests are barred after implementation of MRIs, with a limited impact on the annual costs. However, MRIs provide a continuous reminder to focus on appropriate testing and the effectiveness of MRIs is potentially higher than described in this study.

A Multimodal Intervention for Reducing Unnecessary Repeat Glycated Hemoglobin Testing

OBJECTIVES

Reducing unnecessary tests that do not enhance quality can promote health-care value. Glycated hemoglobin (A1C) is often ordered at a frequency exceeding the recommendation of once every 3 months. We conducted a quality improvement (QI) initiative aimed to reduce unnecessary repeat testing by 75% at a tertiary care academic hospital.

METHODS

A retrospective baseline analysis was conducted on laboratory data from 2019 that enumerated unnecessary A1C tests, defined as repeat tests ordered within 60 days. A multifaceted change intervention with iterative plan-do-study-act cycles was introduced in March 2019 to educate providers and to automatically cancel A1C tests requested within 60 days. Monthly totals of A1C testing processed were plotted on statistical process control charts.

RESULTS

In 2019, 11% of all A1C tests ordered were unnecessary. Between March 2020 and January 2021, 11% of the tests (N=14,247 tests) were unnecessary, of which 84% were cancelled with our intervention. Providers in cardiology and nephrology accounted for over half (55%) of the unnecessary tests ordered.

CONCLUSIONS

A 2-pronged approach informed by root-cause analysis, and comprised of gatekeeping and provider education, can effectively promote resource stewardship for reducing unnecessary A1C testing.

A systematic literature review on unnecessary diagnostic testing: The role of ICT use

BACKGROUND

The negative impact of unnecessary diagnostic tests on healthcare systems and patients has been widely recognized. Medical researchers in various countries have been devoting effort to reduce unnecessary diagnostic tests by using different types of interventions, including information and communications technology-based (ICT-based) intervention, educational intervention, audit and feedback, the introduction of guidelines or protocols, and the reward and punishment of staff. We conducted a review of ICT based interventions and a comparative analysis of their relative effectiveness in reducing unnecessary tests.

METHOD

A systematic Boolean search in PubMed, EMBase and EBSCOhost research databases was performed. Keyword search and citation analysis were also conducted. Empirical studies reporting ICT based interventions, and their implications on relative effectiveness in reducing unnecessary diagnostic tests (pathology tests or medical imaging) were evaluated independently by two reviewers based on a rigorously developed coding protocol.

RESULTS

92 research articles from peer-reviewed journals were identified as eligible. 47 studies involved a single-method intervention and 45 involved multi-method interventions. Regardless of the number of interventions involved in the studies, ICT-based interventions were utilized by 71 studies and 59 of them were shown to be effective in reducing unnecessary testing. A clinical decision support (CDS) tool appeared to be the most adopted ICT approach, with 46 out of 71 studies using CDS tools. The CDS tool showed effectiveness in reducing test volume in 38 studies and reducing cost in 24 studies.

CONCLUSIONS

This review investigated five frequently utilized intervention methods, ICT-based, education, introduction of guidelines or protocols, audit and feedback, and reward and punishment. It provides in-depth analysis of the efficacy of different types of interventions and sheds insights about the benefits of ICT based interventions, especially those utilising CDS tools, to reduce unnecessary diagnostic testing. The replicability of the studies is limited due to the heterogeneity of the studies in terms of context, study design, and targeted types of tests.

Minimum retesting intervals in practice: 10 years experience

Background

Minimum retesting intervals (MRI) are a popular demand management solution for the identification and reduction of over-utilized tests. In 2011 Association of Clinical Biochemistry and Laboratory Medicines (ACB) published evidence-based recommendations for the use of MRI.

Aim

The aim of the paper was to review the use of MRI over the period since the introduction of these recommendations in 2011 to 2020 and compare it to previous published data between 2000-2010.

Methods

A multi-source literature search was performed to identify studies that reported the use of a MRI in the management or identification of inappropriate testing between the years prior to (2000–2010) and after implementation (2011–2020) of these recommendations.

Results

31 studies were identified which met the acceptance criteria (2000–2010 n=4, 2011–2020 n=27). Between 2000 and 2010 4.6% of tests (203,104/4,425,311) were identified as failing a defined MRI which rose to 11.8% of tests (2,691,591/22,777,288) in the 2011–2020 period. For those studies between 2011 and 2020 reporting predicted savings (n=20), 14.3% of tests (1,079,972/750,580) were cancelled, representing a total saving of 2.9 M Euros or 2.77 Euro/test. The most popular rejected test was Haemoglobin A1c which accounted for nearly a quarter of the total number of rejected tests. 13 out 27 studies used the ACB recommendations.

Conclusions

MRI are now an established, safe and sustainable demand management tool for the identification and management of inappropriate testing. Evidence based consensus recommendations have supported the adoption of this demand management tool into practice across multiple healthcare settings globally and harmonizing laboratory practice.

Inappropriate repeat testing of complete blood count (CBC) and electrolyte panels in inpatients from Alberta, Canada

INTRODUCTION

The avoidance of repeat chemistry testing such as Complete Blood Count (CBC) and Electrolyte Panel (EP) on clinically stable patients was identified as important utilization goals by Choosing Wisely Canada. The purpose of this study was to assess the volume of overutilization of CBC and EP in an inpatient setting in Alberta, Canada, and provide an estimated cost assessment of unnecessary testing.

METHODS

The total laboratory testing volumes of two common test panels were collected retrospectively for one-year from January to December 2018. Data was collected on test panels performed in an emergency room (ER) and inpatient setting from three separate Laboratory Information Systems covering the provincial population in Alberta, Canada. Total initial test panel instances, total repeated panels, repeated panels that were previously normal or abnormal, and estimated costs were examined. Cost assessment was completed based on Reference Median Cost (RMC) analysis for each of these two common test panels.

RESULTS

During the study period, 2,020,467 (CBC) and 1,455,983 (EP) initial test panel instances were recorded, of which 67.7% and 73.5% were repeated for the CBC and EP, respectively. There was a higher proportion of EP repeated inappropriately (previously normal; 35.6%) compared to CBCs (5.4%). The cost to the province for inappropriately repeating CBC and EP were estimated to be RMC $0.52 million and RMC $1.90 million CAD, respectively.

CONCLUSION

Results from this study can assist policy makers in implementing utilization management initiatives and update clinical practice guidelines to reduce costs to healthcare without compromising patient care.

Factors leading to overutilisation of hospital pathology testing: the junior doctor's perspective

Objective Pathology overutilisation is a significant issue affecting the quality and cost of health care. Because junior medical officers (JMOs) order most pathology tests in the hospital setting, the aim of the present study was to identify the main reasons for hospital pathology overutilisation from the perspective of the JMO. Methods A qualitative method, using focus group methodology, was undertaken. Sixteen JMOs from two hospitals participated in three focus groups. Data were analysed using thematic analysis. Results Three major themes contributed to overutilisation: the real and perceived expectations of senior colleagues, the level of JMO clinical experience and strategies to manage JMO workload around clinical systems. Within these themes, 12 subthemes were identified. Conclusions Overutilisation of hospital pathology testing occurs when there are high social costs to JMOs for underordering, with little cost for overordering. Interventions should restore this balance through reframing overutilisation as both a costly and potentially harmful activity, promoting a supportive culture with regular senior guidance, and addressing clinical systems in which missed tests create an excessive workload. What is known about the topic? Mean overutilisation rates of pathology testing are reported to be as high as 44%. Although numerous studies have reported successful efforts to decrease hospital pathology overutilisation, no primary research was identified that examined the JMO perspective on this subject. What does this paper add? Clinical need is not the primary factor guiding the pathology-ordering decisions of junior practitioners; rather, medical team culture, limited JMO experience and systems factors have a significant role. What are the implications for practitioners? The social and behavioural determinants of pathology ordering must be considered to achieve appropriate pathology test utilisation. These include senior medical officer engagement, the guidance of JMOs and clinical workflows.

Reducing Test Utilization in Hospital Settings: A Narrative Review

Background

Studies addressing the appropriateness of laboratory testing have revealed approximately 20% overutilization. We conducted a narrative review to (1) describe current interventions aimed at reducing unnecessary laboratory testing, specifically in hospital settings, and (2) provide estimates of their efficacy in reducing test order volume and improving patient-related clinical outcomes.

Methods

The PubMed, Embase, Scopus, Web of Science, and Canadian Agency for Drugs and Technologies in Health-Health Technology Assessment databases were searched for studies describing the effects of interventions aimed at reducing unnecessary laboratory tests. Data on test order volume and clinical outcomes were extracted by one reviewer, while uncertainties were discussed with two other reviewers. Because of the heterogeneity of interventions and outcomes, no meta-analysis was performed.

Results

Eighty-four studies were included. Interventions were categorized into educational, (computerized) provider order entry [(C)POE], audit and feedback, or other interventions. Nearly all studies reported a reduction in test order volume. Only 15 assessed sustainability up to two years. Patient-related clinical outcomes were reported in 45 studies, two of which found negative effects.

Conclusions

Interventions from all categories have the potential to reduce unnecessary laboratory testing, although long-term sustainability is questionable. Owing to the heterogeneity of the interventions studied, it is difficult to conclude which approach was most successful, and for which tests. Most studies had methodological limitations, such as the absence of a control arm. Therefore, well-designed, controlled trials using clearly described interventions and relevant clinical outcomes are needed.

An Audit of Repeat Testing at an Academic Medical Center: Consistency of Order Patterns With Recommendations and Potential Cost Savings

OBJECTIVES

To evaluate the prevalence of potentially unnecessary repeat testing (PURT) and the associated economic burden for an inpatient population at a large academic medical facility.

METHODS

We evaluated all inpatient test orders during 2016 for PURT by comparing the intertest times to published recommendations. Potential cost savings were estimated using the Centers for Medicare & Medicaid Services maximum allowable reimbursement rate. We evaluated result positivity as a determinant of PURT through logistic regression.

RESULTS

Of the evaluated 4,242 repeated target tests, 1,849 (44%) were identified as PURT, representing an estimated cost-savings opportunity of $37,376. Collectively, the association of result positivity and PURT was statistically significant (relative risk, 1.2; 95% confidence interval, 1.1-1.3; P < .001).

CONCLUSIONS

PURT contributes to unnecessary health care costs. We found that a small percentage of providers account for the majority of PURT, and PURT is positively associated with result positivity.

Errors in the Extra-Analytical Phases of Clinical Chemistry Laboratory Testing

The total testing process consists of various phases from the pre-preanalytical to the post-postanalytical phase, the so-called brain-to-brain loop. With improvements in analytical techniques and efficient quality control programmes, most laboratory errors now occur in the extra-analytical phases. There has been recent interest in these errors with numerous publications highlighting their effect on service delivery, patient care and cost. This interest has led to the formation of various working groups whose mission is to develop standardized quality indicators which can be used to measure the performance of service of these phases. This will eventually lead to the development of external quality assessment schemes to monitor these phases in agreement with ISO15189:2012 recommendations. This review focuses on potential errors in the extra-analytical phases of clinical chemistry laboratory testing, some of the studies performed to assess the severity and impact of these errors and processes that are in place to address these errors. The aim of this review is to highlight the importance of these errors for the requesting clinician.

Demand management by electronic gatekeeping of test requests does not influence requesting behaviour or save costs dramatically

Background

Healthcare budgets face constraints, and laboratories have developed strategies to adapt to the concomitant increase in workload. Some of the tests (7.4%) may be attributed to unnecessary repeat testing. Electronic gatekeeping has been implemented at selected laboratories in South Africa to limit unnecessary repeat testing. We performed a study of chemistry tests subjected to electronic gatekeeping to determine its effectiveness as a sustainable demand management tool.

Methods

A 22-month retrospective study of chemistry test requests at a Pretoria hospital was performed. Tests violating electronic gatekeeping rules were rejected upon registration before analysis, and cost-savings were estimated from electronic gatekeeping-held tests. The impact of electronic gatekeeping on the test requesting pattern of clinicians was derived from the percentage cost of electronic gatekeeping-held tests.

Results

The total savings generated from electronic gatekeeping test rejections amounted to $84,380. Greatest savings were generated from high-cost tests: glycated haemoglobin ($14,139), urea ($8661) and thyroid-stimulating hormone ($7514). The average number of electronic gatekeeping-held tests as a percentage of their total requested number over 22 months was 3.18%.

Discussion

The savings from electronic gatekeeping-held tests were not as dramatic as anticipated, but were modest and may have some impact in a cost-constrained setting. Electronic gatekeeping was concluded not to have a substantial effect on the clinician test requesting pattern, demonstrated by the largely unchanged monthly percentage of electronic gatekeeping-held tests. As a solitary demand management strategy, electronic gatekeeping does not appear to be as effective as anticipated or as demonstrated in other studies.