Routine individual feedback on requests for diagnostic tests: an economic evaluation

The Limited Utility of Routine Pathologic Examination of Ganglion Cyst Excision From the Hand and Digits

BACKGROUND

It is routine practice at many institutions to send surgically excised ganglion cysts for pathologic analysis. This adds significant cost to the procedure with questionable benefit. The purpose of this study was to determine the necessity of routine pathologic examination of ganglion cysts excised from the hand.

METHODS

We conducted a retrospective review of 443 patients who underwent ganglion excision from the hand with routine pathologic examination between 2012 and 2022. The final pathologic diagnosis was compared with the treating surgeon's clinical diagnosis, and the rates of concordant, discrepant, and discordant diagnoses were identified. Discrepant diagnoses were defined as differing clinical and pathologic diagnoses that did not change clinical management. Discordant diagnoses were defined as differing clinical and pathologic diagnoses that altered the treatment plan.

RESULTS

The prevalence of a concordant diagnosis was 96.2% (426 of 443; 95% confidence interval, 94.4%-98.0%). The prevalence of a discrepant diagnosis was 3.8% (17 of 443; 95% confidence interval, 2.1%-5.6%), and the prevalence of a discordant diagnosis was 0. The odds ratio was 0.04 for a discrepant diagnosis and 0 for a discordant diagnosis.

CONCLUSIONS

Our study suggests abandoning routine pathologic analysis in patients undergoing ganglion cyst excision from the hand will not compromise quality of care when the surgeon is able to make a confident diagnosis. Discrepant diagnoses were rare and discordant diagnoses that did not occur. We recommend pathologic evaluation only when there is uncertainty in the clinical diagnosis.

Utility of Routine Pathologic Examination for Fasciectomy for Dupuytren Contracture

PURPOSE

The objective of this study was to examine the routine pathologic examination of surgical specimens obtained during fasciectomy for Dupuytren contracture.

METHODS

A total of 376 consecutive patients who underwent surgical limited fasciectomy with the excised tissue sent for histopathologic evaluation were identified. Patients were excluded for miscoded procedures, cases where no tissue was sent for pathologic review, and excisions of nodules only. Repeat surgeries in the same patient during the study period were excluded. The rates of concordant, discrepant, and discordant diagnoses were reported. Discrepant diagnoses were defined as different clinical diagnosis and pathologic diagnosis that did not change clinical management. Discordant diagnoses were defined as a different clinical diagnosis and a pathologic diagnosis that altered the treatment plan. The reference standard for final clinical decision-making was the pathologic diagnosis.

RESULTS

The prevalence of concordant diagnoses was 97.1% (365 of 376), of discrepant diagnoses was 2.9% (11 of 376), and there were no discordant diagnoses. Of 376 patients, 43 underwent previous surgical fasciectomy before the study surgery, and pathologic examination was obtained in 10 of these patients. All 10 patients had concordant diagnoses.

CONCLUSIONS

Our results suggest that routine pathologic examination did not alter the future treatment plan for patients who underwent limited fasciectomy. Discrepant diagnoses were encountered infrequently, and rarely in the setting of revision fasciectomy. Discordant diagnoses did not occur. Given the cost associated with pathologic evaluation, this raises the question of whether routine pathologic evaluation is necessary for Dupuytren surgery, where the capability of the treating surgeon to make a clinical diagnosis accurately may render confirmatory pathologic assessment redundant.

TYPE OF STUDY/LEVEL OF EVIDENCE

Diagnostic II.

Going beyond audit and feedback: towards behaviour-based interventions to change physician laboratory test ordering behaviour

Studies indicate there are a variety of contributing factors affecting physician test ordering behaviour. Identifying these behaviours allows development of behaviour-based interventions. Methods Through a pilot study, the list of contributing factors in laboratory tests ordering, and the most ordered tests, were identified, and given to 50 medical students, interns, residents and paediatricians in questionnaire form. The results showed routine tests and peer or supervisor pressure as the most influential factors affecting physician ordering behaviour. An audit and feedback mechanism was selected as an appropriate intervention to improve physician ordering behaviour. The intervention was carried out at two intervals over a three-month period. Findings There was a large reduction in the number of laboratory tests ordered; from 908 before intervention to 389 and 361 after first and second intervention, respectively. There was a significant relationship between audit and feedback and the meaningful reduction of 7 out of 15 laboratory tests including complete blood count (p = 0.002), erythrocyte sedimentation rate (p = 0.01), C-reactive protein (p = 0.01), venous blood gas (p = 0.016), urine analysis (p = 0.005), blood culture (p = 0.045) and stool examination (p = 0.001). Conclusion The audit and feedback intervention, even in short duration, affects physician ordering behaviour. It should be designed in terms of behaviour-based intervention and diagnosis of the contributing factors in physicians' behaviour. Further studies are required to substantiate the effectiveness of such behaviour-based intervention strategies in changing physician behaviour.

Are laboratory tests always needed? Frequency and causes of laboratory overuse in a hospital setting

BACKGROUND

Inappropriate utilization of laboratory resources is an increasing concern especially in high-throughput facilities. Until now, no reliable information has been published addressing to which extent laboratory results are actually used for clinical decision-making. Therefore, we aimed to close this gap using a novel retrospective approach including a survey of clinicians and nurses.

METHODS

We retrospectively evaluated the number of re-orders for potassium (K), lactate dehydrogenase (LD), aspartate-aminotransferase (AST), activated partial thromboplastin-time (APTT) and prothrombin-time/INR (PT/INR), after the initial order had to be cancelled due to preanalytical non-conformities. We analyzed subgroups regarding time to re-order, ward and sample priority (urgent vs. routine). Subsequently, we surveyed clinicians and nurses, asking for their estimate of the amount of failed re-orders as well as for possible reasons.

RESULTS

From initially cancelled tests, only ~20% of K, LD, AST and ~30% of APTT and PT/INR tests were re-ordered within 24 h. 70% of the investigated clinical chemistry and 60% of coagulation tests were re-ordered one week after cancellation or not at all. Survey participants quite accurately estimated these numbers. Routine laboratory panels, short stay of out-patients, obsolete test results and avoiding additional phlebotomies were the main reasons for not re-ordering cancelled tests.

CONCLUSIONS

Overall, 60-70% of test results in the investigated assays ordered in a high throughput laboratory are potentially inappropriate or of doubtful clinically importance. Although clinicians and nurses are aware of this situation, it is the duty of laboratory specialists to overcome overutilization in close collaboration with all involved healthcare workers.

Next-generation sequencing-based genome diagnostics across clinical genetics centers: implementation choices and their effects

Implementation of next-generation DNA sequencing (NGS) technology into routine diagnostic genome care requires strategic choices. Instead of theoretical discussions on the consequences of such choices, we compared NGS-based diagnostic practices in eight clinical genetic centers in the Netherlands, based on genetic testing of nine pre-selected patients with cardiomyopathy. We highlight critical implementation choices, including the specific contributions of laboratory and medical specialists, bioinformaticians and researchers to diagnostic genome care, and how these affect interpretation and reporting of variants. Reported pathogenic mutations were consistent for all but one patient. Of the two centers that were inconsistent in their diagnosis, one reported to have found 'no causal variant', thereby underdiagnosing this patient. The other provided an alternative diagnosis, identifying another variant as causal than the other centers. Ethical and legal analysis showed that informed consent procedures in all centers were generally adequate for diagnostic NGS applications that target a limited set of genes, but not for exome- and genome-based diagnosis. We propose changes to further improve and align these procedures, taking into account the blurring boundary between diagnostics and research, and specific counseling options for exome- and genome-based diagnostics. We conclude that alternative diagnoses may infer a certain level of 'greediness' to come to a positive diagnosis in interpreting sequencing results. Moreover, there is an increasing interdependence of clinic, diagnostics and research departments for comprehensive diagnostic genome care. Therefore, we invite clinical geneticists, physicians, researchers, bioinformatics experts and patients to reconsider their role and position in future diagnostic genome care.

Improvement in deployment of MRI of the sacroiliac joints in patients suspected for spondyloarthritis using a targeted intervention: a case study

OBJECTIVE

To assess characteristics of deployment of MRI of the SI joints (MR-SI) in patients with suspected axial spondyloarthritis (SpA) before and after a targeted intervention.

METHODS

In a retrospective chart review study, all MR-SI performed in the period 1 April 2004 to 31 December 2010 were collected. Inclusion criteria were complete patient data and MR-SI ordered by a rheumatologist for suspicion of axial SpA. MR-SI reports were graded as normal, suspected sacroiliitis or sacroiliitis. In April 2007 an intervention was made to improve deployment. Rheumatologists were provided with data on ordering behaviour, patient characteristics and MRI outcomes. An introduction on the effect of pretest chance on positive and negative predictive value was given; the burden for patients and costs was illustrated. An alternative behavioural strategy was offered in the form of a simple diagnostic algorithm. Percentages of MRIs and positive MRI for sacroiliitis were compared before and after intervention.

RESULTS

From April 2004 to April 2007, 198 MR-SIs were performed, of which 166 (83.9%) were normal, 5 (2.5%) were suspicious and 27 (13.6%) were positive. After the intervention, patients displayed significantly more SpA features. More optimal patient selection resulted in 79 MR-SI requests, a decrease of 60.1%. Fifty-seven (72.2%) reports were normal, 0 were suspicious and 22 (27.8%) were positive.

CONCLUSION

A simple, one-time, five-step feedback intervention resulted in a 60% reduction in MR-SI requests with a doubling of the percentage of MR-SI positive for sacroiliitis. This approach may benefit future research in areas with diagnostic uncertainty and suboptimal testing.

Clinical quality indicators in laboratory medicine

Clinical laboratories have an important role in improving patient care. The past decades have seen enormous changes with unpredictable improvements in analytical performance, range of tests and capacity to manage large volumes of work. At the same time, there has been a dramatic fall in the rate of laboratory errors. However, there is now a growing awareness that the testing process includes the time before samples reach the laboratory and after reports have been printed and that these areas need to be included in the quality assessment of the total testing process. Laboratory quality should include a focus on patient safety and clinical effectiveness. Services should be patient-centred, timely, efficient and equitable, and finally, should be moulded to ensure optimal outcomes. There is a need to define quality indicators that will ensure there is appropriate choice and selection of tests, use of the appropriate assay standardization and the correct interpretation of the assay results at the appropriate time. These are the areas in which a quality laboratory can, and should, now involve itself.

The competence of primary care doctors in the investigation of patients with elevated blood pressure: results of a cross-sectional study using clinical vignettes

BACKGROUND

Specific laboratory tests are required to ensure adequate management of patients with hypertension, according to internationally accepted guidelines. There is wide variation in doctor test ordering behaviour. Many factors are known to affect this. Little is known about the interaction between doctor, patient and practice characteristics. The current study was designed to explore this.

METHODS

A series of eight case vignettes was designed to examine test ordering behaviour among primary care doctors in Poland. The cases differed with regard to the level of blood pressure and the presence or absence of other cardiovascular risk factors, including diabetes. Doctors stated their choices of laboratory investigations needed in these cases. Their responses were compared with recommendations in the 2003 European Society of Hypertension/European Society of Cardiology hypertension guidelines. Associations between the correct responses and patient, doctor and practice characteristics were tested.

RESULTS

One hundred and twenty-five out of 192 invited doctors (65%) participated in the study. They ordered a mean of 4.9 laboratory tests per case. This represents 47.9% of the tests recommended by current guidelines. Older doctors working in smaller practices and private settings ordered fewer laboratory tests. Specialization in family medicine was associated with greater compliance with guidelines. Grade 2 hypertension and the presence of other risk factors of cardiovascular disease were associated with ordering more tests but the presence of diabetes did not improve compliance with guidelines.

CONCLUSIONS

Further educational efforts are needed to promote rational test ordering for hypertensive patients by Polish primary health care doctors.

Necessity of routine pathological examination after surgical excision of wrist ganglions

PURPOSE

The value of routine pathological evaluation of ganglion cysts is questionable considering that the pretest odds of a wrist lesion being a ganglion cyst are usually high based on physical examination and surgical findings alone. This study evaluates the necessity of routine pathological examination of specimens derived from surgical removal of wrist ganglion cysts.

METHODS

We identified 429 consecutive adult patients who underwent surgical excision of a wrist ganglion with routine pathological examination of the specimen between 1997 and 2008. The rates of concordant, discrepant, and discordant diagnoses were reported with 95% confidence intervals. The odds of a discrepant or discordant diagnosis were calculated.

RESULTS

The prevalence of a concordant diagnosis was 98.6% (424 of 429; 95% confidence interval, 97.3% to 99.6%). The prevalence of a discrepant diagnosis was 1.4% (5 of 429; 95% confidence interval, 0.38% to 2.7%), and the prevalence of a discordant diagnosis was zero. The odds ratio was 0.012 for a discrepant diagnosis and zero for a discordant diagnosis.

CONCLUSIONS

This study suggests that, in patients with the clinical diagnosis of wrist ganglion cyst, quality of care would not be compromised by abandoning the practice of routinely submitting surgical specimens for pathological examination after excision of the ganglion cyst. Discrepant diagnoses are encountered infrequently and discordant diagnoses did not occur. We recommend pathological examination only when the clear gelatinous fluid typical of a ganglion cyst is not encountered at surgery.

Laboratory medicine quality indicators: a review of the literature

We summarize information on quality indicators related to laboratory testing from published literature and Internet sources to assess current gaps with respect to stages of the laboratory testing process, the Institute of Medicine (IOM) health care domains, and quality measure evaluation criteria. Our search strategy used various general and specific terms for clinical conditions and laboratory procedures. References related to a potential quality indicator associated with laboratory testing and an IOM health care domain were included. With the exception of disease- and condition-related indicators originating from clinical guidelines, the laboratory medicine quality indicators reviewed did not satisfy minimum standard evaluation criteria for quality or performance measures (ie, importance, scientific acceptability, and feasibility) and demonstrated a need across the total laboratory testing process for consistently specified, useful, and evidence-based, laboratory-related quality and performance measures that are important to health outcomes and meaningful to health care stakeholders for which laboratories can be held accountable.

Cost consequences of implementing an electronic decision support system for ordering laboratory tests in primary care: evidence from a controlled prospective study in the Netherlands

BACKGROUND

The economic consequences of interventions to promote rational, evidence-based use of laboratory tests by physicians are not yet fully understood. We evaluated the cost consequences of a computer-based, guideline-driven decision-support system (CDSS) for ordering blood tests in primary care.

METHODS

We installed the CDSS in 118 practices [159 general practitioners (GPs)] throughout The Netherlands and calculated the costs of the intervention in this group. During a period of 6 months before and 6 months after installation of the CDSS, the test-ordering behavior of 87 (109 GPs) of these 118 study practices was studied and the results were compared with those of a nonhistorical control group that did not receive the CDSS. In addition the costs of laboratory requests were calculated for both groups.

RESULTS

Total intervention costs, comprising development costs and installation costs, amounted to 79,000 euro (670 euro per practice). Whereas the introduction of the CDSS did not affect the number of order forms submitted to the laboratories, it did reduce the number of blood tests per order form. As a result, the CDSS yielded mean savings on the costs of laboratory requests of 847 euro per practice per 6 months.

CONCLUSIONS

This study demonstrates that providing electronic decision support for ordering blood tests in primary care represents an economically promising concept. Savings on laboratory costs are achievable and not offset by disproportionally high intervention costs.

Evaluation of an automated test ordering and feedback system for general practitioners in daily practice

OBJECTIVE

To evaluate the use of an automated test ordering and feedback system (named GRIF) in daily practice. The system produces recommendations to general practitioners (GPs) to improve the application of accepted practice guidelines for test ordering.

METHODS

A randomised controlled trial with balanced block design was carried out in general practices in two regions of the Netherlands from August 2000 to July 2001. We implemented the GRIF system on the workstations at the offices of the participating GPs. The GPs (n=11) were asked to use GRIF during patient consultation instead of filling in the paper request form. The system displayed critical comments about their non-adherence to the guidelines as apparent from the request forms.

RESULTS

The median time of producing the comments plus the response time of the GP was 13s. Of the 2780 presented recommendations, 4.3% were accepted. Advice of the GRIF system that presents a concrete test to request in a particular situation is adhered to most frequently. Finally, there seems to be a decrease of accepted comments over the trial period.

CONCLUSION

Computerised recommendations should contain, if possible, suggestions for alternative tests to improve the application of these recommendations. Furthermore, creative solutions must be developed to avoid that GPs get used to the recommendations of critiquing systems and to stimulate a better adherence to these recommendations.

Value for money of changing healthcare services? Economic evaluation of quality improvement

There are many instances of perceived or real inefficiencies in health service delivery. Both healthcare providers and policy makers need to know the impact and cost of applying strategies to change the behaviour of individuals or organisations. Quality improvement or implementation research is concerned with evaluating the methods of behavioural change. Addressing inefficiencies in healthcare services raises a series of issues, beginning with how inefficiency itself should be defined. The basic concepts of cost analysis and economic evaluations are explained and a model for working through the economic issues of quality improvement is discussed. This model combines the costs and benefits of corrected inefficiency with the costs and degree of behavioural change achieved by a quality improvement method in the policy maker's locality. It shows why it may not always be cost effective for policy makers to address suboptimal behaviour. Both the interpretation of quality improvement research findings and their local application need careful consideration. The limited availability of applicable quality improvement research may make it difficult to provide robust advice on the value for money of many behavioural quality improvement strategies.

Pathology tests: is the time for demand management ripe at last?

With the ever increasing demands for pathology testing within the National Health Service there is a need to manage the demand for these tests. This review discusses strategies for the demand management of requests made by clinicians in the disciplines of biochemistry, haematology, and microbiology. The various approaches that have been used to manage demand will be described, along with specific clinical strategies for demand management.

The reliability of assessing the appropriateness of requested diagnostic tests

Despite a poor reliability, peer assessment is the traditional method to assess the appropriateness of health care activities. This article describes the reliability of the human assessment of the appropriateness of diagnostic tests requests. The authors used a random selection of 1217 tests from 253 request forms submitted by general practitioners in the Maastricht region of The Netherlands. Three reviewers independently assessed the appropriateness of each requested test. Interrater kappa values ranged from 0.33 to 0.42, and kappa values of intrarater agreement ranged from 0.48 to 0.68. The joint reliability coefficient of the 3 reviewers was 0.66. This reliability is sufficient to review test ordering over a series of cases but is not sufficient to make case-by-case assessments. Sixteen reviewers are needed to obtain a joint reliability of 0.95. The authors conclude that there is substantial variation in assessment concerning what is an appropriately requested diagnostic test and that this feedback method is not reliable enough to make a case-by-case assessment. Computer support maybe beneficial to support and make the process of peer review more uniform.