Tutorials in clinical research: part IV: recognizing and controlling bias

The Oral Health Statistics Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: Explanation and Elaboration

Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the Oral Health Statistics (OHStat) Guidelines. Drafts were circulated to the editors of 85 oral health journals and to task force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the task force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in Journal of Dental Research Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.

The OHStat Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: explanation and elaboration

Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the OHstat Guidelines. Drafts were circulated to the editors of 85 oral health journals and to Task Force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the Task Force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in JDR Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.

The OHStat Guidelines for Reporting Observational Studies and Clinical Trials in Oral Health Research: Explanation and Elaboration

Adequate and transparent reporting is necessary for critically appraising research. Yet, evidence suggests that the design, conduct, analysis, interpretation, and reporting of oral health research could be greatly improved. Accordingly, the Task Force on Design and Analysis in Oral Health Research-statisticians and trialists from academia and industry-empaneled a group of authors to develop methodological and statistical reporting guidelines identifying the minimum information needed to document and evaluate observational studies and clinical trials in oral health: the OHstat Guidelines. Drafts were circulated to the editors of 85 oral health journals and to Task Force members and sponsors and discussed at a December 2020 workshop attended by 49 researchers. The final version was subsequently approved by the Task Force in September 2021, submitted for journal review in 2022, and revised in 2023. The checklist consists of 48 guidelines: 5 for introductory information, 17 for methods, 13 for statistical analysis, 6 for results, and 7 for interpretation; 7 are specific to clinical trials. Each of these guidelines identifies relevant information, explains its importance, and often describes best practices. The checklist was published in multiple journals. The article was published simultaneously in JDR Clinical and Translational Research, the Journal of the American Dental Association, and the Journal of Oral and Maxillofacial Surgery. Completed checklists should accompany manuscripts submitted for publication to these and other oral health journals to help authors, journal editors, and reviewers verify that the manuscript provides the information necessary to adequately document and evaluate the research.

A randomized controlled trial of effects of sleep hygiene training and progressive muscle relaxation training in children with ADHD

OBJECT

Sleep problems often accompany ADHD and negatively affect ADHD symptoms, however, there are not enough intervention studies on sleep interventions in children with ADHD. The present study investigated the effects of sleep hygiene training (SH) and progressive muscle relaxation exercises (PMR) in children with ADHD.

METHOD

57 children aged 6-12 years with ADHD were randomly assigned to the SH and SH + PMR groups and completed the intervention consisting of group training and eight weeks of telephone interviews. The effects of both intervenitons were evaluated via parent, child and clinician report scales and neuropsychological tests.

RESULTS

Both interventions resulted in significant positive changes in child sleep, ADHD symptoms, functioning, neuropsychological tests and parental sleep quality. Significant differences were found between the interventions in selective attention, peer problems and anxiety scores in favor of the SH + PMR group.

CONCLUSION

SH may have positive effects on various clinical parameters as well as sleep problems in children with ADHD. Addition of PMR to SH may lead to further improvements in anxiety, peer problems and selective attention. SH and PMR may be a useful tool in the clinical management of children with ADHD with sleep problems.

Potential types of bias when estimating causal effects in environmental research and how to interpret them

To inform environmental policy and practice, researchers estimate effects of interventions/exposures by conducting primary research (e.g., impact evaluations) or secondary research (e.g., evidence reviews). If these estimates are derived from poorly conducted/reported research, then they could misinform policy and practice by providing biased estimates. Many types of bias have been described, especially in health and medical sciences. We aimed to map all types of bias from the literature that are relevant to estimating causal effects in the environmental sector. All the types of bias were initially identified by using the Catalogue of Bias (catalogofbias.org) and reviewing key publications (n = 11) that previously collated and described biases. We identified 121 (out of 206) types of bias that were relevant to estimating causal effects in the environmental sector. We provide a general interpretation of every relevant type of bias covered by seven risk-of-bias domains for primary research: risk of confounding biases; risk of post-intervention/exposure selection biases; risk of misclassified/mismeasured comparison biases; risk of performance biases; risk of detection biases; risk of outcome reporting biases; risk of outcome assessment biases, and four domains for secondary research: risk of searching biases; risk of screening biases; risk of study appraisal and data coding/extraction biases; risk of data synthesis biases. Our collation should help scientists and decision makers in the environmental sector be better aware of the nature of bias in estimation of causal effects. Future research is needed to formalise the definitions of the collated types of bias such as through decomposition using mathematical formulae.

Reliability and Validity of the Self-Report Version of the Yale-Brown Obsessive-Compulsive Scale Modified for Body Dysmorphic Disorder

Despite its frequent use in research studies, the self-report version of the Yale-Brown Obsessive-Compulsive Scale modified for Body Dysmorphic Disorder (BDD-YBOCS-SR) is yet to be formally validated. The present investigation sought to examine the psychometric properties of the BDD-YBOCS-SR across three different samples. In Study 1 (N = 847), we sought to explore the factor structure of the BDD-YBOCS-SR. In addition, we evaluated the convergent and divergent validity with similar self-report measures. In Study 2 (N = 187), the convergence of the BDD-YBOCS-SR with reactivity to an in vivo appearance-related task was observed. In Study 3, we compared scores on the BDD-YBOCS-SR between a clinical sample of individuals with BDD (n = 50) and a "healthy" control sample (n = 51). We further observed the BDD-YBOCS-SR's sensitivity to treatment and convergence with the rater-administered version in the clinical sample. The BDD-YBOCS-SR demonstrated strong psychometric properties across all three studies. Scores on the BDD-YBOCS-SR were found to be strongly associated with appearance anxiety, reactivity to the appearance task, and the rater-administered BDD-YBOCS. The present investigation provides support for the BDD-YBOCS-SR's utility in measuring body dysmorphic symptom severity for use in research and clinical settings.

Survival analysis of zirconia implant-supported, fixed complete dentures: A 5-year retrospective cohort study

STATEMENT OF PROBLEM

Existing data on the mid-term to long-term survival rates of zirconia implant-supported, fixed complete dentures (Zir-IFCDs) are lacking.

PURPOSE

The purpose of this retrospective clinical study was to assess the prosthetic survival rate in patients treated with Zir-IFCDs.

MATERIAL AND METHODS

The patient record system at the Dental College of Georgia (DCG), Augusta University was searched to identify all patients treated with Zir-IFCDs from 2015 through 2022 by the DCG graduate prosthodontic, general practice residency, and Advanced Education in General Dentistry (AEGD) programs. Reasons for replacement were grouped as failure of veneering porcelain, framework fracture, implant loss, patient-driven concerns, excessive occlusal wear, and other.

RESULTS

A total of 67 arches were found that met the inclusion criteria, 46 maxillary and 21 mandibular. The median follow-up time was 8.5 months (interquartile range, 2.7 to 30.9 months). A total of 9 of the 67 arches were identified as having failed (4 maxillary, 5 mandibular), requiring replacement. Reasons for failure were as follows: 3 framework fractures, 2 implant losses, 2 patient-related concerns, 1 fracture of veneering porcelain, and 1 unknown. The combined survival rate (Kaplan-Meier, log-normal modeling) for Zir-IFCDs was 88.8% at 1 year and 72.5% at 5 years CONCLUSIONS: Based on the findings, the Zir-IFCDs investigated had a survival rate lower than that reported in similar studies, though higher than published results for metal-acrylic resin-IFCDs. The most common source of failure was fracture of the zirconia framework. Thickness of the zirconia framework, interocclusal space, cantilever length, occlusal force, and status of the opposing dentition may have been associated with framework failures and should be investigated further.

An Evaluation of the Body Dysmorphic Disorder Symptom Scale as a Measure of Treatment Response and Remission in Psychotherapy and Medication Trials

The Body Dysmorphic Disorder Symptom Scale (BDD-SS) is a self-report tool that captures an array of representative behavioral and cognitive symptoms commonly displayed by individuals with BDD. The BDD-SS is regularly used among experts in the field, though its utility as a measure of treatment response has not yet been formally evaluated. Results from two clinical trials of BDD treatment were pooled from an archived database to create a sample of 220 BDD participants who received either psychosocial or medication-based interventions for BDD. We used baseline BDD-SS scores to describe psychometric properties, baseline correlations with other scales to examine the content validity of the BDD-SS, and longitudinal symptom data to evaluate capacity to detect clinically relevant change. Results indicated that the BDD-SS has good psychometric properties and is able to detect symptom change over time, although it showed lower rates of reliable change with treatment relative to the gold standard rater-administered Yale-Brown Obsessive-Compulsive Scale Modified for BDD (BDD-YBOCS). The BDD-SS offers meaningful information about treatment response in a self-report format and may be particularly useful to employ in clinical practice settings as a means of gathering symptom and treatment response data via self-report when rater-administered interviews are not feasible, although it may underestimate the extent of improvement with treatment.

Bias in Clinical Research

Clinical epidemiological research entails assessing the burden and etiology of disease, the diagnosis and prognosis of disease, the efficacy of preventive measures or treatments, the analysis of the risks and benefits of diagnostic and therapeutic maneuvers, and the evaluation of health care services. In all areas, the main focus is to describe the relationship between exposure and outcome and to determine one of the following: prevalence, incidence, cause, prognosis, or effect of treatment. The accuracy of these conclusions is determined by the validity of the study. Validity is determined by addressing potential biases and possible confounders that may be responsible for the observed association. Therefore, it is important to understand the types of bias that exist and also to be able to assess their impact on the magnitude and direction of the observed effect. The following chapter reviews the epidemiological concepts of selection bias, information bias, intervention bias, and confounding and discusses ways in which these sources of bias can be minimized.

What Types of Treatment Are Provided for Patients With Carpal Tunnel Syndrome? A Retrospective Analysis of Commercial Insurance

BACKGROUND

Treatment of carpal tunnel syndrome (CTS) in commercially insured patients across the spectrum of provider types rarely has been described.

OBJECTIVE

To describe patterns of types of treatment for patients with CTS using a large commercial insurance database.

DESIGN

Retrospective cohort descriptive study.

SETTING

Administrative health data from the Clinformatics Data Mart (OptumInsight, Eden Prairie, MN).

PATIENTS

Adults with a primary diagnosis of CTS seen from between January 2010 to December 2012 who had a total of 48 months of continuous data (12 months before diagnosis and 36 months after diagnosis) (n = 24,931).

OUTCOMES

Frequency of types of treatment (heat, manual therapy, positioning, steroids, stretching, surgery) by number of treatments, number of visits, provider type, and characteristics.

RESULTS

Fifty-four percent of patients received no reported treatment, and 50.4% had no additional visits. Surgery (42.5%) and positioning (39.8%) were the most frequent single treatments. Patients who were seen by orthopedist for their first visit more frequently received some treatment (75.1%) and at least 1 additional visit (74.1%) compared with those seen by general practitioners (59.5%, 57.5%, respectively) or other providers (65.4%, 68.4, respectively). Orthopedists more frequently prescribed positioning devices (26.8%) and surgery (36.8%) than general practitioners (18.8%, 14.1%, respectively) or other providers (15.7%, 19.7%, respectively). Older adults more frequently had CTS surgery, as did people who lived in the Midwest. Overall, only 24% of patients with CTS had surgery.

CONCLUSIONS

For more than one-half of patients with CTS no treatment was provided after an initial visit. Surgery rates were much lower than what has previously been reported in the literature. Generally, patients with CTS receive treatments that are supported by current treatment guidelines.

LEVEL OF EVIDENCE

NA.

Does external fixation result in superior ankle function than open reduction internal fixation in the management of adult distal tibial plafond fractures?

BACKGROUND

Traditionally distal tibial plafond fractures were managed with open reduction internal fixation however, high complication rates have prompted the use of external fixation as an alternative. No definitive review has been conducted and the issue of superior treatment method remains contentious. This review assesses the comparative effectiveness of both with regards ankle function.

METHOD

A search strategy was formulated with keywords ensuring full use of Medical Subject Headings terms for maximum sensitivity with Boolean combinations. Multiple databases were used.

RESULTS

All papers had limitations, hence results and conclusions must be considered conservatively. Paper-1 demonstrated an association between ORIF and superior ankle function (P<0.05). Papers-2 and -3 demonstrated no significant difference (P>0.05) between treatment techniques.

CONCLUSIONS

Neither method can yet be widely advocated as superior with the treatment method chosen remaining primarily on surgeon preference and experience. This review highlights the requirement for further, high-quality research in this area.

Challenges in developing drugs for pediatric CNS disorders: A focus on psychopharmacology

Many psychiatric and behavioral disorders manifest in childhood (attention deficit hyperactivity disorder, obsessive compulsive disorder, anxiety, depression, schizophrenia, autism spectrum disorder, etc.) and the opportunity for intervening early may attenuate full development of the disorder and lessen long term disability. Yet, pediatric drug approvals for CNS indications are limited, and pediatric testing generally occurs only after establishing adult efficacy, more as an afterthought rather than with the initial goal of developing the medication for a pediatric CNS indication. With pharmaceutical companies decreasing funding of their neuroscience research divisions overall, the prospects for moving promising investigational drugs forward into pediatrics will only decline. The goal of this review is to highlight important challenges around pediatric drug development for psychiatric disorders, specifically during clinical development, and to present opportunities for filling these gaps, using new strategies for de-risking investigational drugs in new clinical trial designs/models. We will first present the current trends in pediatric drug efficacy testing in academic research and in industry trials, we will then discuss the regulatory landscape of pediatric drug testing, including policies intended to support and encourage more testing. Obstacles that remain will then be presented, followed by new designs, funding opportunities and considerations for testing investigational drugs safely.

A comparison of formalin and GEWF in fixation of colorectal carcinoma specimens: rates of lymph node retrieval and effect on TNM staging

AIMS

The Royal College of Pathologists recommend that a median of at least 12 lymph nodes should be harvested during pathological staging of colorectal cancer. It is not always easy to harvest the required number, especially in patients with rectal cancer receiving neoadjuvant therapy. Lymph node revealing solutions, for example, GEWF, may improve nodal yield. GEWF is safe, cheap and easy to use.

METHODS

In a controlled trial, lymph node yields were compared after secondary specimen dissection following either 24 h of further fixation in formalin (n=101) or GEWF immersion (n=99). The number, size and tumour status of additional lymph nodes identified were compared between groups. Twenty-seven cases that received long-course neoadjuvant therapy were also assessed.

RESULTS

Median lymph node yield at primary dissection met national standards overall (19) but also in the long-course neoadjuvant therapy group (13). Lymph nodes were smaller in neoadjuvant cases compared with non-neoadjuvant cases (mean size range 1.3-5.6 mm vs 1.5-8.9 mm). The use of further fixation and GEWF detected more nodes at secondary dissection. The mean number of additional nodes harvested was greater with formalin (8.3) than GEWF (7.3). There was no significant difference in the mean size of the additional lymph nodes detected between groups (point estimate 1.02; 95% CI -0.58 to 2.63; p=0.211). Upstaging triggering adjunct chemotherapy occurred in 1% (2/200) of cases.

CONCLUSIONS

The routine use of adjunct techniques to identify additional lymph nodes is unnecessary with underlying high-quality dissection practice. Emphasis should be placed upon education and training, spending appropriate time dissecting and ensuring specimens are sufficiently fixed beforehand.

Vulnerability in elderly patients with gastrointestinal cancer--translation, cultural adaptation and validation of the European Portuguese version of the Vulnerable Elders Survey (VES-13)

BACKGROUND

"Vulnerable Elders Survey" (VES-13) is a questionnaire accurate in predicting functional decline and highly correlated with comprehensive geriatric assessment in identifying vulnerable elderly. The purpose of this study was to translate, cultural adapt and validate the first Portuguese cross-cultural version of VES-13 and to estimate the prevalence of vulnerability in Portuguese elderly gastrointestinal (GI) cancer patients.

METHODS

VES-13 European Portuguese translation and cultural adaptation was developed according to internationally accepted guidelines. Test-retest reliability and internal consistency were assessed by calculating the Kappa statistic and by analyzing the inter-item and item-total correlation matrices and calculation of Cronbach's alpha coefficients, respectively. Construct and criterion validity was assessed by Spearman's correlation coefficient between VES-13 and each EQ-5D-5 L dimension, clinical judgment and performance status.

RESULTS

The translated and culturally adapted version of VES-13 revealed high test-retest reliability (test-retest Kappa ≥ 0.612; p < 0.001) in the pilot study (n = 22). For the validation phase 206 patients with GI cancer were recruited (median age: 73 years; colo-rectal cancer: 63 %). Criterion validity was confirmed by adequate correlations between VES-13 and clinical judgment of vulnerability, ECOG and KPS scores. Construct validity was confirmed by moderate correlations with most of EQ-5D-5 L dimensions. Cronbach's alpha of the questionnaire was 0.848. The estimated prevalence of vulnerability is 50 % (CI95% 0.43-0.56).

CONCLUSIONS

The European Portuguese version of VES-13 is a valid and reliable approach to screening elderly cancer patients for geriatric needs. In our setting, one in two elderly patients was likely to be vulnerable or frail which stresses the importance of their correct identification to better inform cancer management.

Psychosocial interventions in Alzheimer's disease and amnestic mild cognitive impairment: evidence for gender bias in clinical trials

BACKGROUND

Alzheimer's disease (AD) affects twice as many women as men. Gender differences in symptom profile, living conditions, coping style and response might affect the outcome of psychosocial interventions (PSIs).

OBJECTIVES

Our aim was to review gender differences in the available high-quality phase III trials on PSI in AD and amnestic mild cognitive impairment (aMCI) by considering the gender ratio in the investigated samples.

DESIGN

Randomized controlled trials published in 2000-2012 were stepwise analyzed by statistically testing the representativeness of the gender ratio and examining reported gender differences.

RESULTS

Forty-five studies (62% of 73 studies) reported gender ratios for each subsample and were included. In these studies, females were underrepresented in the control groups. In the 14 studies (19%) reporting analyses of gender differences, women were underrepresented in both intervention and control groups. However, in the six studies (8%) reporting significant gender differences in outcome, gender distribution was in accordance with prevalence rates.

CONCLUSION

Current evidence is insufficient for reliable conclusions on gender differences in PSI outcome in AD and aMCI, as 81% of the available clinical trials either not reported the gender ratio of their samples, or underrepresent females. Further research is needed addressing gender differences, and clinical trials should routinely control for gender bias.

Clinical genetic research 1: Bias

Clinical epidemiological research in genetic diseases entails assessment of phenotypes, the burden and etiology of disease, and the efficacy of preventive measures or treatments in populations. In all areas, the main focus is to describe the relationship between exposure and outcome and to determine one of the following: prevalence, incidence, cause, prognosis, or effect of treatment. The accuracy of these conclusions is determined by the validity of the study. Validity is determined by addressing potential biases and possible confounders that may be responsible for the observed association. Therefore, it is important to understand the types of bias that exist and also to be able to assess their impact on the magnitude and direction of the observed effect. The following chapter reviews the epidemiological concepts of selection bias, information bias, and confounding and discusses ways in which these sources of bias can be minimized.

Is intramedullary nailing more effective than non-operative treatment in adults with displaced middle-third clavicle fractures?

BACKGROUND

Clavicle fractures are common, accounting for 5-12 % of all fractures. Traditionally, displaced middle-third clavicle fractures have been managed non-operatively but the associated displacement often leads to mal-union with shortening, cosmetic deformity and occasionally non-union, with clinicians looking towards alternative operative methods such as intramedullary nailing (IMN). However, such methods have their own complications. In order to ascertain the effectiveness of IMN in the management of middle-third clavicle fractures compared with non-operative treatment, analysis of recent evidence is required and this review aims to achieve that, focusing on relevant, contemporary randomised-control trials.

MATERIALS AND METHODS

Essential search-terms identified from the research question were used to formulate a search strategy. A systematic search of multiple databases was then performed from 1966 until present and appropriate papers for appraisal identified.

RESULTS

Thirteen papers were identified, with 10 excluded using appropriate eligibility criteria. The remaining papers were then critically appraised. With regards shoulder function, all papers demonstrated an association between IMN and a significantly (P < 0.05) superior shoulder function score, but no consensus with regards to complication rates. However, all have identified limitations; therefore, their overall findings must be considered conservatively.

CONCLUSIONS

Further, high-quality research, ideally in the form of well-designed, multi-centre RCTs is required to allow acceptable implementation of IMN of middle-third clavicle fractures into widespread practice. However, early results demonstrate that in young patients with displaced middle-third clavicle fractures, who are motivated to return to work, IMN provides superior functional results and should be considered. However, the importance of considering each patient individually as to their suitability for each management option, before coming to an informed decision with the patient rather than having a blanket approach to MTCF is essential.

LEVEL OF EVIDENCE

Level 1.

Validation of the Screening Test for Auditory Processing (STAP) on school-aged children

OBJECTIVES

The present study focussed on validating the Screening Test for Auditory Processing (STAP) that contains four subsections: speech-in-noise, dichotic consonant vowel, gap detection and auditory memory. The sensitivity and specificity were ascertained by comparing the results of the screening test with that of diagnostic tests for auditory processing.

METHODS

The STAP was administered on 500 school going children in the age range of 8-13 years. These consisted of 141 children who were found at-risk on the Screening Checklist for Auditory Processing (SCAP). Diagnostic APD tests (speech-in-noise, dichotic CV, gap detection and auditory memory) were administered on 152 of the children referred and/or passed on the screening procedures.

RESULTS

The results from the STAP indicated that the auditory memory subsection of the STAP was the most affected followed by dichotic CV and speech-in-noise. Gap detection was the least affected among the four subsections. A high and significant correlation was noted between the subsections of the STAP and the APD diagnostic tests. The sensitivity and specificity of the STAP on comparison with the diagnostic tests was found to be 76.6% and 72%, respectively. It was found that when a combination of SCAP and STAP was used for screening, the sensitivity and specificity were higher.

CONCLUSION

Based on the findings of the study, it is recommended that both SCAP and STAP be administered. Further, there was also a good test-retest reliability of the SCAP, STAP and the APD diagnostic tests.

Barriers to the diagnosis of somatoform disorders in primary care: protocol for a systematic review of the current status

BACKGROUND

Somatoform-type disorders and functional medically unexplained symptoms are extremely common in primary care settings. These disorders, however, are consistently underdiagnosed and under-recognised which precludes effective treatment. Given that somatoform symptoms are associated with high impairment, healthcare costs and both physician and patient frustration, it is critical to improve early detection. The first step in improving patient care is to identify the current barriers which obstruct successful diagnosis to enable the design of targeted interventions. We aim to conduct a systematic review to identify the possible physician-, patient- and society-related factors and other practical constraints which may impede successful diagnosis. In the process, we will also be able to recognise the differences in methodological techniques, recommend potential avenues for future research and comment on the literature in this field as a whole.

METHODS/DESIGN

We aim to conduct a systematic review of the relevant peer-reviewed literature published in English or German in the past 10 years in MEDLINE, EMBASE, PsycINFO and the Cochrane Database of Systematic Reviews. Additional studies may be identified from the reference lists of included studies. Title and abstract screening and data extraction from full text manuscripts will be conducted by two independent reviewers. Because we are including a combination of qualitative and quantitative studies, the review will provide a broad understanding of the current situation. Wherever possible, the method and reporting of the review will adhere to the guidelines outlined in the PRISMA statement and bias will be assessed using the Cochrane collaboration's recommendations. We envisage that data will be synthesised using a multilevel (qualitative and quantitative) approach which combines textual narrative and thematic analysis. Barriers will be categorised as modifiable or non-modifiable according to a conceptual framework. The review has been registered in an international registry of systematic reviews PROSPERO (CRD42013002540).

DISCUSSION

We hope that this study will provide an insight into the barriers to diagnosis of somatoform-type disorders and the results can be used to target appropriate interventions to improve care for these patients.

Comparing the novel GlideScope Groove videolaryngoscope with conventional videolaryngoscopy: a randomized mannequin study of novice providers

STUDY OBJECTIVE

To compare the GlideScope Groove (GG) with conventional GlideScope videolaryngoscopy (GVL) and direct laryngoscopy (DL) on intubation times, intubation attempts, and glottic visualization of an airway mannequin by medical students.

DESIGN

Randomized crossover trial.

SETTING

Intensive care unit of an academic tertiary-care hospital.

PARTICIPANTS

34 medical students with no airway management experience.

MEASUREMENTS

Each participant received standardized video instruction on all three laryngoscopes and was given 10 minutes to practice with each device. The participants had two attempts using DL, and then had two attempts each with either the GG or GVL in random order.

MEASUREMENTS

Time-to-intubate the mannequin in seconds was recorded. Secondary outcomes were Cormack-Lehane grade and number of intubation attempts, also recorded.

MAIN RESULTS

The median number of seconds required to successfully intubate the mannequin with DL, GVL, and GG were 17.4 seconds [interquartile range (IQR) 13.2 - 22.1)], 17.7 seconds (IQR 14.9 - 21.0), and 21.7 seconds (IQR 15.4 - 37.0), respectively. No differences in time-to-intubate was noted among the three devices (P = 0.45). A Cormack-Lehane grade 1 view was obtained for 25 of 34 participants (74%) with DL, 32 of 34 participants (94%) with GVL, and 34 of 34 participants (100%) with GG. First-attempt intubation success was 30 of 34 participants (88%) with DL, 34 of 34 participants (100%) with GVL, and 11 of 34 participants (32%) with GG. Using the GG, 6 of 24 participants (18%) required three attempts. More attempts were required for the GG than for DL (P < 0.001) or GVL (P < 0.001).

CONCLUSIONS

GG was not superior to DL or GVL in time-to-intubate an airway mannequin.

An evaluation framework for defining the contributions of telestration in surgical telementoring

BACKGROUND

An increasing quantity of research in the domain of telemedicine show a growing popularity and acceptance of care over distance systems among both clinicians and patients. We focus on telementoring solutions, developed for providing remote guidance to less experienced surgeons. Telestration is often regarded as an extra functionality of some telementoring systems. However, we advocate that telestration must be viewed as a core feature of telementoring due to its advantages.

OBJECTIVE

To analyze and define concepts, parameters, and measurement procedures to evaluate the impact of using telestration while telementoring.

METHODS

A systematic review of research dealing with telestration during remote guidance sessions was performed by querying three major online research databases (MEDLINE, Association of Computing Machinery, and Institute of Electrical and Electronics Engineers) using a predefined set of keywords ("laparoscopy", "annotate", "telestrate", "telestration", "annotation", "minimally invasive", and "MIS").

RESULTS

The keyword-based search identified 117 papers. Following the guidelines for performing a systematic review, only 8 publications were considered relevant for the final study. Moreover, a gap in research defining the impacts of telestration during telementoring was identified. To fill this niche, a framework for analyzing, reporting, and measuring the impacts of telestration was proposed.

CONCLUSIONS

The presented framework lays the basics for the structured analysis and reporting of telestration applied to telementoring systems. It is the first step toward building an evidence knowledge base documenting the advantages of live video content annotation and supporting the presented connections between the concepts.

Is yoga an effective treatment in the management of patients with chronic low back pain compared with other care modalities - a systematic review

OBJECTIVE

The aim of the study was to assess randomized-control trials (RCTs) to ascertain whether yoga is an effective treatment in the management of patients with chronic low back pain (cLBP) compared with other care modalities.

METHODS

A search strategy was formulated with key concepts identified using the PICO process. Four databases were searched in June 2012. Appropriate eligibility criteria were set and implemented.

RESULTS

Four randomized control trials met the inclusion criteria. All four papers found that yoga lead to a significant improvement in back function, and three demonstrated a significant improvement in back pain when compared with certain care modalities. All papers had significant limitations identified, however.

CONCLUSIONS

Given the limitations identified within the studies, the conclusions drawn must be considered conservatively. Although early results appear promising, but further well-designed RCTs are warranted, with multiple, specified comparator care modalities before firm conclusions can be gained.

Drilling juvenile osteochondritis dissecans: retro- or transarticular?

BACKGROUND

Early diagnosis and successful treatment of juvenile osteochondritis dissecans (JOCD) is essential in preventing articular degeneration at a young age. Surgical treatment of stable JOCD lesions failing nonoperative treatment involves retroarticular or transarticular drilling to induce revascularization and healing. Multiple case series report high healing rates and infrequent complications for both retroarticular and transarticular drilling modalities; however, it is unclear from these individual reports whether one mode of drilling provides higher healing rates.

QUESTIONS/PURPOSES

We asked whether transarticular or retroarticular drilling of stable JOCD lesions results in differing patient-oriented outcomes, rates of radiographic healing, time to radiographic healing, and complication rates.

METHODS

We systematically reviewed the short-term clinical outcomes of retroarticular and transarticular drilling of stable OCD lesions. PubMed and additional sources identified 65 studies; 12 studies met inclusion criteria.

RESULTS

Heterogeneity and quality of studies limited review to qualitative analysis. No clear differences were seen in patient-oriented outcomes after treatment with either drilling modality. Radiographic healing for JOCD lesions drilled retroarticularly occurred in 96 of 111 (86%) lesions in an average of 5.6 months. Transarticular drilling of JOCD lesions resulted in 86 of 94 (91%) lesions healing by radiography in an average of 4.5 months. No complications were reported for either drilling modality.

CONCLUSIONS

Retroarticular and transarticular drilling of stable lesions results in comparable short-term patient-oriented outcomes and radiographic healing. Further high-quality comparative studies are required to adequately compare drilling modalities, clearly define radiographic healing, and patient-oriented outcomes after nonoperative treatment.

Sources of systematic errors in the epidemiology of vancomycin-resistant enterococci

PURPOSE

The rates of vancomycin resistance among enterococci (VRE) have been increasing worldwide. However, reports on vancomycin-resistant enterococci (VRE) are easily biased and meta-data reporting is insufficient. Additionally, no standardised protocol for VRE testing currently exists. The aim of our study was to investigate, for the first time, the impact of introduced bias in VRE reports. We also analysed the sensitivity of our in-house screening test for VRE, namely, a broth-enriched PCR assay.

METHODS

Retrospective review of microbial and clinical data on all patients tested for VRE who had been admitted to a large university hospital over a 5-year period and an analysis of the possible impact of introduced bias. Our screening test was also evaluated using clinical isolates.

RESULTS

A total of 27,636 screening tests were carried out over the 5-year study period, of which 2,459 were VRE-positive. The number of screening tests increased dramatically over the study period, with 1,053 tests carried out on 435 patients in 2006 and 9,444 tests carried out on 5,104 patients in 2010. VRE prevalence was 8.1 % over the 5-year period. The introduction of measurement bias caused a clear overestimation of absolute VRE numbers. The sensitivity of our screening test was 95.5 % with a positive predictive value of 39 %.

CONCLUSION

Biased reports lead to the implementation of high-cost containment measures that may be both unnecessary and detrimental to the patient. Our data show that systematic errors in VRE reports caused a clear overestimation of absolute VRE numbers, thereby indicating an outbreak situation even though the actual prevalence of VRE was decreasing. We suggest that reports of VRE must take measurement and analysis biases into account, otherwise any conclusion drawn is unreliable and inconclusive.

Treatment of rotator cuff tears in older individuals: a systematic review

BACKGROUND

Rotator cuff disease is common in older adults and may compromise health status and functional independence. However, little evidence exists to guide the treatment of rotator cuff tears (RCTs) in the older patient. This study evaluated the evidence regarding treatment of RCTs in patients with a mean age of 60 years or older.

METHODS

PubMed, SCOPUS, Science Citation Index (Web of Knowledge), Sport Discus, CINAHL, The Cochrane Controlled Trials registry, podium and poster presentations, proceedings, and abstracts from American Academy of Orthopaedic Surgeons, American Orthopaedic Society for Sports Medicine, and American Shoulder and Elbow Surgeons were searched for published and unpublished studies from 1966 to 2009. Inclusion criteria were English language, level of evidence I to III or greater, a full-thickness RCT, and treatment (surgery, physical therapy, injections, medications, or observation). Exclusion criteria included purely retrospective studies, isolated tears of the subscapularis, partial RCTs, revision surgery, and grafting or tendon transfer procedures. The blinded studies were independently evaluated using principles in the CONSORT (Consolidated Standards of Reporting Trials, 2001) statement and then collated by level of evidence and treatment strategy.

RESULTS

Eight studies (1 level I, 4 level II, and 3 level III) evaluated treatment outcomes in patients aged older than 60 years. Review of the included operative studies suggests possible efficacy with operative intervention. However, heterogeneity of these studies and bias did not allow for a valid consensus on the best treatment approach.

CONCLUSIONS

There is insufficient evidence to suggest efficacy in operative or nonoperative treatment of RCTs in older patients. The results presented here suggest possible favorable outcomes with operative management of RCTs.

Are optimal cerebral perfusion pressure and cerebrovascular autoregulation related to long-term outcome in patients with aneurysmal subarachnoid hemorrhage?

BACKGROUND AND OBJECTIVES

Continuous assessment of the cerebrovascular autoregulation (CVA) through use of the pressure reactivity index (PRx), a moving linear correlation coefficient between mean arterial blood pressure and intracranial pressure, has been effective in optimizing cerebral perfusion pressure (CPPopt) in traumatic brain injured (TBI) patients. This study investigates the feasibility of measuring CPPopt in patients with aneurysmal subarachnoid hemorrhage (aSAH) by continuously assessing the CVA.

METHODS

Twenty-nine aSAH patients were enrolled, and data from CVA status, CPPopt, and periods when CPP was below, within, or above CPPopt were computed daily. Outcome was assessed at 6 months with the Glasgow Outcome Scale. Mann-Whitney U test was used to analyze differences in the duration of impaired CVA and duration of CPP below CPPopt in patients with good and poor outcomes. Multivariable logistic regression analysis was used to identify independent predictors of outcome.

RESULTS

CVA monitoring data were available for all 29 patients with a total monitoring time of 2757 h. The duration of impaired CVA was 36.5% (interquartile range: 24.6 to 49.8) of the total monitoring time in 15 patients with good outcome and 71.6% of the total monitoring time (51.2 to 80.0) in 14 patients with poor outcome (Mann-Whitney U test 3.295, P=0.0010). PRx-based CPPopt could be identified in 26 patients (89.6%) with a total monitoring time of 2691 h. The duration of CPP below the CPPopt range was 28.0% (interquartile range: 18.0 to 47.0) of the total monitoring time in patients with good outcome and 76.0% (48.5 to 82.5) in patients with poor outcome (Mann-Whitney U test 2.779, P=0.0054). Glasgow Coma Scale score and duration of impaired CVA were independently associated with 6-month outcome (Glasgow Coma Scale score odds ratio: 1.95, 95% confidence interval: 1.01-3.75; duration of impaired CVA odds ratio: 0.88, 95% confidence interval: 0.78-0.99).

CONCLUSIONS

The assessment of CVA and CPPopt is feasible in aSAH patients and may provide important information regarding long-term outcome. A PRx above the 0.2 threshold and a CPP below the CPPopt range are associated with worse outcome.

Dynamic splinting for the stiff hand after trauma: predictors of contracture resolution

STUDY DESIGN

Prospective cohort.

INTRODUCTION

Many variables are believed to influence the success of dynamic splinting, yet their relationship with contracture resolution is unclear.

PURPOSE OF THE STUDY

To identify the predictors of outcome with dynamic splinting of the stiff hand after trauma.

METHODS

Forty-six participants (56 joints) completed eight weeks of dynamic splinting, and the relationship between 13 clinical variables and outcome was explored.

RESULTS

Improvement in passive range of motion, active range of motion (AROM), and torque range of motion averaged 21.8°, 20.0°, and 13.0°, respectively (average daily total end range time, 7.96 hours). Significant predictors included joint stiffness (modified Weeks Test), time since injury, diagnosis, and deficit (flexion/extension). For every degree change in ROM on the modified Weeks Test, AROM improved 1.09° (standard error, 0.2). Test-retest reliability of the modified Weeks Test was high (intraclass correlation coefficient [2, 1]=0.78).

CONCLUSIONS

Better progress with dynamic splinting may be expected in joints with less pretreatment stiffness, shorter time since injury (<12 weeks), and in flexion rather than extension deficits. Further research is needed to determine the accuracy with which the modified Weeks Test may predict contracture resolution.

LEVEL OF EVIDENCE

2b.

Clinimetrics corner: the many faces of selection bias

Selection bias, also known as susceptibility bias in an intervention study or spectrum bias in a diagnostic accuracy study, is present throughout clinically applicable evidence in various forms. Selection bias implies that the intervention or diagnostic test has been studied in a less representative sample population, which can lead to inflated overall effect sizes and/or inaccurate findings. Within the literature, there are over 40 forms of selection bias that can influence the external validity of results. Recognition of selection bias is essential in the translation of evidence into effective clinical practice. This clinimetrics corner outlines the major biases that readers encounter and discusses key examples regarding pertinent orthopedic and manual therapy literature.

Electrodiagnostic consultation and identification of neuromuscular conditions in persons with diabetes

INTRODUCTION

Although the American Association of Neuromuscular and Electrodiagnostic Medicine recommends that electrodiagnostic procedures should be performed by physicians with specialty training, these procedures are increasingly being performed by non-specialists.

METHODS

We used a nationally representative sample of Medicare beneficiaries with diabetes who used electrodiagnostic services in 2006 to examine whether specialists and non-specialists were different in the rates of identifying common neuromuscular conditions.

RESULTS

Specialists (neurologists and physiatrists) performed 62% of electrodiagnostic consultations; non-specialist physicians and non-physicians performed 31% and 5%, respectively. After adjusting for age, race/ethnicity, diabetes severity, and comorbidities, specialists were 1.26-9 times more likely than non-physicians to diagnose polyneuropathy, lumbosacral radiculopathy, cervical radiculopathy, carpal tunnel syndrome, and ulnar neuropathy. Almost 80% of electrodiagnostic studies performed by specialists included electromyography testing; fewer than 13% by non-specialists did.

CONCLUSIONS

Inadequate use of electromyography and fewer specific diagnoses suggest that many non-specialists perform insufficiently comprehensive electrodiagnostic studies.

Attitudes of US physician assistants toward persons with HIV/AIDS

BACKGROUND

Early in the HIV/AIDS epidemic, a large number of health care workers had negative attitudes toward persons infected with HIV, but a more positive shift has occurred in these attitudes over the past decade. However, recent information about attitudes of physician assistants (PAs) is missing.

METHODOLOGY

A nationwide randomized sample of 1,500 PAs was surveyed through the US mail. The AIDS Attitudes Scale (AAS) developed by Froman, Owen, and Daisy in 1992 was used for this purpose. The results were analyzed using descriptive, t test, and analysis of variance (ANOVA) statistics.

RESULTS

A majority of respondents had high empathy, low avoidance, and positive general attitude scores. Respondents living in the South had the highest avoidance and lowest general attitude scores compared with those living in other regions (ANOVA, P < .05).

CONCLUSION

The results were consistent with similar current studies of health care workers, which demonstrated supportive attitudes towards persons with HIV/AIDS.

Heat or cold packs for neck and back strain: a randomized controlled trial of efficacy

OBJECTIVES

Acute back and neck strains are very common. In addition to administering analgesics, these strains are often treated with either heat or cold packs. The objective of this study was to compare the analgesic efficacy of heat and cold in relieving pain from back and neck strains. The authors hypothesized that pain relief would not differ between hot and cold packs.

METHODS

This was a randomized, controlled trial conducted at a university-based emergency department (ED) with an annual census of 90,000 visits. ED patients >18 years old with acute back or neck strains were eligible for inclusion. All patients received 400 mg of ibuprofen orally and then were randomized to 30 minutes of heating pad or cold pack applied to the strained area. Outcomes of interest were pain severity before and after pack application on a validated 100-mm visual analog scale (VAS) from 0 (no pain) to 100 (worst pain), percentage of patients requiring rescue analgesia, subjective report of pain relief on a verbal rating scale (VRS), and future desire for similar packs. Outcomes were compared with t-tests and chi-square tests. A sample of 60 patients had 80% power to detect a 15-mm difference in pain scores.

RESULTS

Sixty patients were randomized to heat (n = 31) or cold (n = 29) therapy. Mean (+/-standard deviation [SD]) age was 37.8 (+/-14.7) years, 51.6% were female, and 66.7% were white. Groups were similar in baseline patient and pain characteristics. There were no differences between the heat and cold groups in the severity of pain before (75 mm [95% CI = 66 to 83] vs. 72 mm [95% CI = 65 to 78]; p = 0.56) or after (66 mm [95% CI = 57 to 75] vs. 64 mm [95% CI = 56 to 73]; p = 0.75) therapy. Pain was rated better or much better in 16/31 (51.6%) and 18/29 (62.1%) patients in the heat and cold groups, respectively (p = 0.27). There were no between-group differences in the desire for and administration of additional analgesia. Twenty-five of 31 (80.6%) patients in the heat group and 22 of 29 (75.9%) patients in the cold group would use the same therapy if injured in the future (p = 0.65).

CONCLUSIONS

The addition of a 30-minute topical application of a heating pad or cold pack to ibuprofen therapy for the treatment of acute neck or back strain results in a mild yet similar improvement in the pain severity. However, it is possible that pain relief is mainly the result of ibuprofen therapy. Choice of heat or cold therapy should be based on patient and practitioner preferences and availability.

Revisiting the level of evidence in randomized controlled clinical trials: A simulation approach

BACKGROUND

The Evidence Based Medicine (EBM) paradigm requires that results from Randomized Controlled Trials (RCTs) must be assessed for validity before being assimilated. However, evaluating available evidence is often still based on intuitive processes rather than on rigorous scientific analysis.

OBJECTIVE

To establish a hierarchy among the different factors influencing the level of evidence of RCT results, using a Monte Carlo simulation.

METHODS

The complete RCT model involved three submodels: i) the input-output submodel for the prediction of events (using the sigmoid dose-response relationship as the basic model), ii) the execution submodel for deviations from a randomized, controlled two-arm parallel trial related to either patient-specific or investigator-specific elements or both: placebo or nocebo effect, errors of measurement, effect of concomitant therapy, regression to the mean phenomenon, blinding process, loss to follow-up and randomization process, iii) the covariate distribution submodel.

RESULTS

The most important factors influencing discrepancies in the true-to-observed odds ratio were the blinding process, the measurement errors (affecting either the therapeutic or the adverse effects), the placebo effect, the effect of concomitant therapies and to a less extent the randomization process. Whereas the randomization process remained the only relevant factor in double-blinded trials, the hierarchy of other factors was modified according to the type of blinding.

CONCLUSION

In RCTs, the hierarchy of confounding factors differs according to the type of blinding and the current short list of components of the strength of evidence (poorly concealed randomization and lack of blinding) appears to be incomplete.

Practical guide to efficient analysis and diagramming articles

OBJECTIVE

In a busy practice, time is a commodity in rare supply, and keeping abreast of the relevant medical literature is a daunting task. Even after reading an article carefully, important information may be lost because of undue attention to the methodological minutia.

METHOD

Fundamental to reducing a complex article into a well-organized and consistent format is the technique of quantitatively diagramming the principal components in the design and findings of the study. This approach allows a coherent brief summary statement of the article, and a platform for a focused scientific discussion and analysis of the clinical applicability of the findings.

CONCLUSIONS

The technique of diagramming an article is a tool that the senior author has used for years and has found it valuable in capturing the scientific fundamentals of a manuscript. Once prepared, the diagram has proven to be useful in clarifying presentations during journal club, preparing the background and significance sections of grant applications, reviewing articles as a journal editor and as a journal reviewer, and easily retrieving documents to support evidence-based practice efforts.

Bias in clinical studies of genetic diseases

Clinical epidemiological research in genetic diseases entails the assessment of phenotypes, the burden and etiology of disease, and the efficacy of preventive measures or treatments in populations. In all areas, the main focus is to describe the relationship between exposure and outcome and determine one of the following: prevalence, incidence, cause, prognosis, or effect of treatment. The accuracy of these conclusions is determined by the validity of the study. Validity is determined by addressing potential biases and possible confounders that may be responsible for the observed association. Therefore, it is important to understand the types of bias that exist and be able to assess their impact on the magnitude and direction of the observed effect. This chapter reviews the epidemiological concepts of selection bias, information bias, and confounding and discusses ways in which these sources of bias can be minimized.

A clinician-educator's roadmap to choosing and interpreting statistical tests

As educators seek confirmation of successful trainee achievement, medical education must move toward a more evidence-based approach to teaching and evaluation. Although medical training often provides physicians with a general background in biostatistics, many are not prepared to apply these skills. This can hinder clinician educators as they wish to develop, analyze and disseminate their scholarly work. This paper is intended to be a concise educational tool and guide for choosing and interpreting statistical tests aimed toward medical education assessment. It includes guidelines and examples that clinician-educators can use when analyzing and interpreting studies and when writing methods and results sections of reports.

Ophthalmology and vision science research

Understanding the key elements that increase the likelihood of project success is fundamental for those embarking on research. The first article in this series placed scientific journals in perspective in relation to Journal Impact Factors and citation indices. This second article in a series primarily aimed at those commencing research, particularly in the area of ophthalmology and vision science, delineates the interrelated components that are required to complete a research project. Successful research projects seldom emerge from serendipitous observation, and most evolve through a combination of inspiration, careful planning, and a great deal of industry. Beginning researchers must first be clear about their reason(s) for pursuing research and should identify potential mentors and collaborators at the outset. This article discusses methods of identifying suitable projects and mentors. Ten component areas necessary to complete a research project are addressed, with reference to relevant published literature, under the following topic areas: mentors and collaborators; finding a research topic; confirming suitability of the topic; defining the research question; developing the hypothesis; key considerations in study design; threats to study validity; study sample size; benefits and limitations of clinical science; completing to publication. This guide is intended to be applicable to all embarking on research, but particularly to those with an interest in the visual system. The final 3 articles in this series will deal with writing a research paper to publication standard, working successfully with the journal review process, and refining electronic literature searches.