Criticizing evidence-based medicine

Progress in the preoperative diagnosis of thyroid nodules: managing uncertainties and the ultimate role for molecular investigation

The preoperative evaluation of thyroid nodules currently relies on a clinical assessment of risk factors and an algorithm based on imprecise tests. With serum TSH, thyroid ultrasound and fine-needle aspiration (FNA) with or without ultrasound guide, accounting for the routine initial evaluation, indeterminate aspirates remain the major obstacle for confidently advising patients whether to have surgery or not. Recent clinical guidelines have attempted to settle various controversies but many inherent errors of clinical testing result in delayed diagnosis and unnecessary surgery. A better solution may ultimately involve the use of molecular markers of thyroid carcinogenesis but further research is still needed regarding the basic biology of thyroid cancer.

Level of evidence in the literature concerning brain tumor resection

Microsurgical resection is a cornerstone in the treatment of brain tumors. However, the benefit of radical resection still remains controversial. We attempted to analyze the level of scientific evidence (LOE) and methodological aspects of studies concerning the impact of the extent of resection (EOR) on outcome. The LOE classification was Ia: 0%, Ib: 0%, IIa: 0.8%, IIb: 5.8%, IIc: 0%, IIIa: 13.3%, IIIb: 52.5%, IV: 10.8%, V:16.8%. 72.5% observed a positive effect of total tumor removal. 84.2% did not report the criteria for treatment assignment, 62.5% did not define the terms gross total; radical; partial; or subtotal resection. The average age of the treatment groups was reported in 29.2%, the Karnofsky index in 75.8%. Tumor size was reported in 32.5%, location in 51.7%. Assessment of EOR was based on the surgeon's impression in 75.0%, determined by postoperative CT/MRI scans in 20.8%, quantified by CT/MRI-based volumetry in 3.4%, and assessed by histological analysis in 0.8%. To date, no studies with high LOE are available addressing the benefit of gross total brain tumor removal. Although the majority of the reports found a positive effect of radical resection, the reviewed articles contain methodological limitations which may significantly influence the results.

The application of special technologies in diagnostic anatomic pathology: is it consistent with the principles of evidence-based medicine?

Proponents of evidence-based medicine (EBM) have emphasized the need to consider the quality of different sources of medical information and have proposed various methods to integrate available "best evidence" into rules, guidelines and other diagnostic, therapeutic and prognostic models. The various factors that can affect the internal validity of studies in anatomic pathology, such as interobserver variability, use of retrospective rather than prospective data and others, are reviewed. The need for testing for the external validity of the results of anatomic pathology studies is introduced, using "test sets" of cases that have not been used to generate the classification or prognostic models. This methodology has been seldom used in anatomic pathology to validate the generalizability of various "entities," usefulness of diagnostic tests under different conditions and other information. Basic concepts of meta-analysis for research synthesis are introduced; these methods have been seldom used in anatomic pathology to integrate information from different studies using quantitative techniques rather than summary tables that merely list the results of various publications. The potential use of decision analysis and value of information analysis for the adoption of new tests is briefly discussed.