Randomized controlled trials in surgery: comic opera no more?

Lessons learned on the path to a healthier brain: dispelling the myths and challenging the hypotheses

Neurologic dysfunction remains the most significant complication associated with cardiopulmonary bypass (CPB). The insidious change of cognitive decline has been perceived as a key factor that has contributed to the shift to percutaneous intervention for coronary disease. Current neuropsychologic testing provides the most sensitive means of demonstrating clinically relevant cerebral damage of this nature. Through extensive experience in randomized clinical trials of over 900 patients undergoing CPB, our team has addressed several key hypotheses related to the embolic/ischemic nature of cerebral injury in cardiac surgery, using this testing. In the first temperature study, patients randomized to hypothermia with passive re-warming had a lower incidence of neurocognitive deficit when compared with those patients who were actively re-warmed to 37°. In order to clarify the role of the hypothermia as opposed to the re-warming process, a second temperature study was completed. In the hypothermic group, patients were cooled and maintained at 34° with no active re-warming whereas, in the normothermic group, the patients were kept at 37° throughout the perioperative period. No difference in neurocognitive outcome in the two groups was seen, implying that the benefit seen in the first temperature study was related not to the hypothermia, but rather to the absence of active re-warming. In the cardiotomy study, patients were randomized to either a control group in which their cardiotomy blood was returned unprocessed, or a treatment group in which this blood was sequestered and processed with centrifugal washing and fat filtration. No significant difference in neurocognitive outcome was found in these two groups. On the other hand, there was a significant increase in bleeding and transfusion requirements in the treatment group. Many of our daily practices in CPB management are based upon assumptions from observational studies without sound reference to evidence-based medicine. Our recent studies have challenged our assumptions related to ischemia and embolic events during CPB. They have also confirmed that, when high standards in trial design are applied, the results can have universal implications in terms of our practice. Perfusion (2007) 22, 153—160.

Standards for reporting randomized controlled trials in medical informatics: a systematic review of CONSORT adherence in RCTs on clinical decision support

INTRODUCTION

The Consolidated Standards for Reporting Trials (CONSORT) were published to standardize reporting and improve the quality of clinical trials. The objective of this study is to assess CONSORT adherence in randomized clinical trials (RCT) of disease specific clinical decision support (CDS).

METHODS

A systematic search was conducted of the Medline, EMBASE, and Cochrane databases. RCTs on CDS were assessed against CONSORT guidelines and the Jadad score.

RESULT

32 of 3784 papers identified in the primary search were included in the final review. 181 702 patients and 7315 physicians participated in the selected trials. Most trials were performed in primary care (22), including 897 general practitioner offices. RCTs assessing CDS for asthma (4), diabetes (4), and hyperlipidemia (3) were the most common. Thirteen CDS systems (40%) were implemented in electronic medical records, and 14 (43%) provided automatic alerts. CONSORT and Jadad scores were generally low; the mean CONSORT score was 30.75 (95% CI 27.0 to 34.5), median score 32, range 21-38. Fourteen trials (43%) did not clearly define the study objective, and 11 studies (34%) did not include a sample size calculation. Outcome measures were adequately identified and defined in 23 (71%) trials; adverse events or side effects were not reported in 20 trials (62%). Thirteen trials (40%) were of superior quality according to the Jadad score (≥3 points). Six trials (18%) reported on long-term implementation of CDS.

CONCLUSION

The overall quality of reporting RCTs was low. There is a need to develop standards for reporting RCTs in medical informatics.

Research productivity in neurosurgery: trends in globalization, scientific focus, and funding

OBJECT

While research is important for the survival, growth, and expansion of neurosurgery, little work has been done to quantify the status and trends of neurosurgical publications. The purpose of this bibliometric study was to quantitatively analyze trends in neurosurgical publications, including changes in worldwide productivity, study methodology, subspecialty topic, and funding.

METHODS

This was a retrospective bibliometric study using MEDLINE to record all publications between 1996 and 2009 by first authors affiliated with neurosurgical departments. Country of origin, MEDLINE-defined methodology, study topic, and funding sources (for US articles) were recorded. Linear regression was used to derive growth rates.

RESULTS

Total articles numbered 53,425 during the study period, with leading global contributors including the US with 16,943 articles (31.7%) and Japan with 10,802 articles (20.2%). Countries demonstrating rapid growth in productivity included China (121.9 ± 9.98%/year, p < 0.001), South Korea (50.5 ± 4.7%/year, p < 0.001), India (19.4 ± 1.8%/year, p < 0.001), and Turkey (25.3 ± 2.8%/year, p < 0.001). While general research articles, case reports, and review articles have shown steady growth since 1996, clinical trials and randomized controlled trials have declined to 2004 levels. The greatest overall subspecialty growth was seen in spine surgery. Regarding funding, relative contribution of National Institutes of Health (NIH)-funded publications decreased from 30.2% (290 of 959) to 22.5% (356 of 1229) between 1996 and 2009.

CONCLUSIONS

Neurosurgical publications demonstrate continued increases in productivity as well as in global expansion, although US contributions remain dominant. Two challenges that the neurosurgical community is facing include the preponderance of case reports and review articles and the relative decline in NIH funding for US neurosurgical publications, as productivity has outpaced government financial support.

Beneficial and harmful effects of shoulder arthroplasty in patients with rheumatoid arthritis: results from a Cochrane review

OBJECTIVE

To assess beneficial and harmful effects of arthroplasty in the shoulder joint in patients with RA.

METHODS

A systematic review within the framework of the Cochrane Collaboration identified randomized controlled trials (RCTs), controlled clinical trials and case series (included for assessment of complications) published between 1995 and 2008. Articles considered potentially relevant were retrieved in full text and assessed independently by two authors. Risk of bias and level of evidence were assessed according to the established criteria.

RESULTS

One RCT (26 shoulders) compared cemented and uncemented humeral stem fixation during arthroplasty, reporting no significant differences between groups at 2-year follow-up (low-quality evidence). Nineteen case series (1155 shoulders) reported component loosening requiring revision at 5%, infections at 2% and minor complications at 7% (very low-quality evidence). The retrospective case series had several limitations related to methodological quality and standards of reporting.

CONCLUSION

At present, there is very little research evidence supporting decisions about shoulder joint arthroplasty in patients with RA.

Standards for reporting randomized controlled trials in neurosurgery

OBJECT

The Consolidated Standards for Reporting of Trials (CONSORT) criteria were published in 1996 to standardize the reporting and improve the quality of clinical trials. Despite having been endorsed by major medical journals and shown to improve the quality of reported trials, neurosurgical journals have yet to formally adopt these reporting criteria. The purpose of this study is to evaluate the quality and reporting of randomized controlled trials (RCTs) in neurosurgery and the factors that may affect the quality of reported trials.

METHODS

The authors evaluated all neurosurgical RCTs published in 2006 and 2007 in the principal neurosurgical journals (Journal of Neurosurgery; Neurosurgery; Surgical Neurology; Journal of Neurology, Neurosurgery, and Psychiatry; and Acta Neurochirurgica) and in 3 leading general medical journals (Journal of the American Medical Association, Lancet, and the New England Journal of Medicine). Randomized controlled trials that addressed operative decision making or the treatment of neurosurgical patients were included in this analysis. The RCT quality was evaluated using the Jadad score and the CONSORT checklist.

RESULTS

In 2006 and 2007, 27 RCTs relevant to intracranial neurosurgery were reported. Of these trials, only 59% had a Jadad score ≥ 3. The 3 major medical journals all endorsed the CONSORT guidelines, while none of the neurosurgical journals have adopted these guidelines. Randomized controlled trials published in the 3 major medical journals had a significantly higher mean CONSORT score (mean 41, range 39-44) compared with those published in neurosurgical journals (mean 26.4, range 17-38; p < 0.0001). Jadad scores were also significantly higher for the major medical journals (mean 3.42, range 2-5) than neurosurgical journals (mean 2.45, range 1-5; p = 0.05).

CONCLUSIONS

Despite the growing volume of RCTs in neurosurgery, the quality of reporting of these trials remains suboptimal, especially in the neurosurgical journals. Improved awareness of the CONSORT guidelines by journal editors, reviewers, and authors of these papers could improve the methodology and reporting of RCTs in neurosurgery.

Surgical interventions for the rheumatoid shoulder

BACKGROUND

Involvment of the shoulder joint in patients with rheumatoid arthritis (RA) leads to severe destruction of the glenohumeral joint. When conservative treatment does not result in sufficient improvement, surgical procedures may be considered as the only beneficial treatment option.

OBJECTIVES

To assess beneficial and harmful effects of all forms of surgical treatment in the management of the shoulder in people with rheumatoid arthritis.

SEARCH STRATEGY

Articles were identified by searches in The Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, SCISEARCH and reference lists of relevant articles (January 1995 to May 2008).

SELECTION CRITERIA

Randomised Controlled Trials, and Controlled Clinical Trials reporting on effects of shoulder surgery. In addition case-series were included for the assessment of complications.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected trials for inclusion, assessed trial quality and extracted the data.

MAIN RESULTS

One RCT, one CCT and 21 case-series were included. The RCT compared cemented versus uncemented humeral stem fixation in arthroplasty and found no significant differences between the two groups after two years (low quality evidence). The CCT compared rotator cuff repair with augmented subscapularis transposition versus subscapularis transposition alone and reported significant differences in favour of the augmented subscapularis transposition after 2 years in function, mean difference (MD) 4.00 on a 0 to 30 scale (95% CI 1.11 to 6.89) and pain, MD 4.00 on a 0 to 20 scale (95% CI 0.84 to 7.16) (low quality evidence). Based on 11 case series (mean follow up 4.5 to 12 years) complications were reported in 11% (95% CI: 9.9% to 12.1%) of the total shoulder arthroplasties, while 10 case-series (mean follow-up 2.7 to 11.3 years) reported complications in 9.9% (95% CI: 8.4% to 11.4%) of the hemiarthroplasties (very low quality evidence).

AUTHORS' CONCLUSIONS

The effects of surgical treatment in the management of the shoulder in people with rheumatoid arthritis are largely unknown due to the paucity of randomised controlled trials.

Pasteur's Quadrant: preparing training programs for "use-inspired" surgical research

Ensuring that scientific research is an integral element of surgical residency training is critical to the future viability of the field. The ability to nurture surgeon-scientists, invoke them to ask pertinent questions, design experiments, and translate these findings into clinical applications will set this specialty apart from competing fields. Involving residents and younger faculty in this process of translational research is crucial to develop academic leaders and improve patient care. It is as critical as it is complex. Here, we propose that this objective can be attained only if academic departments of surgery recognize its value, create a solid framework of support, encourage partnerships, and above all provide the patient and essential mentorship that residents and young faculty need to pursue meaningful surgical research. To provide usable frameworks, a unique 2-dimensional quadrant termed "Pasteur's Quadrant" is generated based on the original work of Stokes. Briefly, it creates 4 quadrants that separate pure basic science or discovery (X-axis) from applied research or innovation (Y-axis). In doing so, it also defines a median-research that satisfies both goals: scientific advancement AND clinical improvement. This novel use-inspired method of categorizing research provides guidelines to select research programs prudently. Using the Pasteur's Quadrant approach to the conduct of resident-performed surgical research offers several advantages: It is clinically applicable; it advances goals of fundamental scientific research; it is provocative, productive, and retains high visibility; and it makes it attractive to funding agencies and industry alike. Lastly, it charts a vibrant course for their main beneficiaries, residents and academic surgical programs.