Challenges to evidence-based medicine: a comparison of patients and treatments in randomized controlled trials with patients and treatments in a practice research network

A novel approach to assessing disparity in representativeness of clinical trial participants within a large midwestern healthcare system

Background

Representativeness in clinical trials (CT) serves as a metric of access to healthcare and reflects differences that may determine differential efficacy of medical interventions; thus, quantifying representativeness in CT participation is critical.

Methods

This retrospective, descriptive study utilized patient demographic data extracted from the largest Midwestern non-profit healthcare system. Using data between January 1, 2019 and December 31, 2021, a CT Participant Sample of 4,537 system patients who were active CT participants was compared to a CT Patient Population of 195,726 system patients receiving care by the PI of active CTs, which represented the target population. Chi-square goodness-of-fit tests were used to test differences in distributions of demographic variables between groups, indicating disparity in CT participation. Two metrics adapted from literature - participation incidence disparity (PID) and participation incidence ratio (PIR) - were calculated to quantify absolute and relative disparity in representativeness proportions, respectively. Descriptive approaches to assessing representativeness are also provided.

Results

Results showed significant differences by race/ethnicity (χ2 = 50.64; p < 0.0001), age categories (χ2 = 56.64; p < 0.0001), and insurance (χ2 = 41.29; p < 0.0001). PID and PIR metrics revealed reduced CT participation among non-White racial/ethnic groups and increased CT participation among White Non-Hispanic patients. Further, CT participants ≥80 or Worker's Compensation were underrepresented while those with Self-Pay insurance were overrepresented as CT participants.

Conclusions

Despite progress, continued efforts to not only enroll participants into CTs that are representative of the healthcare system and region, but also to better assess representativeness quantitatively are still needed.

Clinical Trials Studying Suicide Risk Reduction: Who is Excluded From Participation

OBJECTIVE

The use of exclusion criteria in clinical trials can cause research participants to differ markedly from clinical populations, which negatively impacts generalizability of results. This study identifies and quantifies common and recurring exclusion criteria in clinical trials studying suicide risk reduction, and estimates their impact on eligibility among a clinical sample of adults in an emergency department with high suicide risk.

METHOD

Recent trials were identified by searching PubMed (terms suicide, efficacy, effectiveness, limited to clinical trials in prior 5 years). Common exclusion criteria were identified using Qualitative Content Analysis. A retrospective chart review examined a one-month sample of all adults receiving psychiatric evaluation in a large urban academic emergency department.

RESULTS

The search yielded 27 unique clinical trials studying suicide risk reduction as a primary or secondary outcome. After research fundamentals (e.g. informed consent, language fluency), the most common exclusion criteria involved psychosis (77.8%), cognitive problems (66.7%), and substance use (63.0%). In the clinical sample of adults with high suicide risk (N = 232), psychosis exclusions would exclude 53.0% of patients and substance use exclusions would exclude 67.2% of patients. Overall, 5.6% of emergency psychiatry patients would be eligible for clinical trials that use common exclusion criteria.

CONCLUSIONS

Recent clinical trials studying suicide risk reduction have low generalizability to emergency psychiatry patients with high suicide risk. Trials enrolling persons with psychosis and substance use in particular are needed to improve generalizability to this clinical population.

Significant Differences and Experimental Designs Do Not Necessarily Imply Clinical Relevance: Effect Sizes and Causality Claims in Antidepressant Treatments

Clinical trials are the backbone of medical scientific research. However, this experimental strategy has some drawbacks. We focused on two issues: (a) The internal validity ensured by clinical trial procedures does not necessarily allow for generalization of efficacy results to causal claims about effectiveness in the population. (b) Statistical significance does not imply clinical or practical significance; p-values should be supplemented with effect size (ES) estimators and an interpretation of the magnitude of the effects found. We conducted a systematic review (from 2000 to 2020) on Scopus, PubMed, and four ProQuest databases, including PsycINFO. We searched for experimental studies with significant effects of pharmacological treatments on depressive symptoms, measured with a specific scale for depression. We assessed the claims of effectiveness, and reporting and interpreting of effect sizes in a small, unbiased sample of clinical trials (n = 10). Only 30% of the studies acknowledged that efficacy does not necessarily translate to effectiveness. Only 20% reported ES indices, and only 40% interpreted the magnitude of their findings. We encourage reflection on the applicability of results derived from clinical trials about the efficacy of antidepressant treatments, which often influence daily clinical decision-making. Comparing experimental results of antidepressants with supplementary observational studies can provide clinicians with greater flexibility in prescribing medication based on patient characteristics. Furthermore, the ES of a treatment should be considered, as treatments with a small effect may be worthwhile in certain circumstances, while treatments with a large effect may be justified despite additional costs or complications. Therefore, researchers are encouraged to report and interpret ES and explicitly discuss the suitability of their sample for the clinical population to which the antidepressant treatment will be applied.

Identification of tools used to assess the external validity of randomized controlled trials in reviews: a systematic review of measurement properties

Background

Internal and external validity are the most relevant components when critically appraising randomized controlled trials (RCTs) for systematic reviews. However, there is no gold standard to assess external validity. This might be related to the heterogeneity of the terminology as well as to unclear evidence of the measurement properties of available tools. The aim of this review was to identify tools to assess the external validity of RCTs. It was further, to evaluate the quality of identified tools and to recommend the use of individual tools to assess the external validity of RCTs in future systematic reviews.

Methods

A two-phase systematic literature search was performed in four databases: PubMed, Scopus, PsycINFO via OVID, and CINAHL via EBSCO. First, tools to assess the external validity of RCTs were identified. Second, studies investigating the measurement properties of these tools were selected. The measurement properties of each included tool were appraised using an adapted version of the COnsensus based Standards for the selection of health Measurement INstruments (COSMIN) guidelines.

Results

38 publications reporting on the development or validation of 28 included tools were included. For 61% (17/28) of the included tools, there was no evidence for measurement properties. For the remaining tools, reliability was the most frequently assessed property. Reliability was judged as “sufficient” for three tools (very low certainty of evidence). Content validity was rated as “sufficient” for one tool (moderate certainty of evidence).

Conclusions

Based on these results, no available tool can be fully recommended to assess the external validity of RCTs in systematic reviews. Several steps are required to overcome the identified difficulties to either adapt and validate available tools or to develop a better suitable tool.

Trial registration

Prospective registration at Open Science Framework (OSF): 10.17605/OSF.IO/PTG4D.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01561-5.

Healthcare Funding Decisions and Real-World Benefits: Reducing Bias by Matching Untreated Patients

Governments and health insurers often make funding decisions based on health gains from randomised controlled trials. These decisions are inherently uncertain because health gains in trials may not translate to practice owing to differences in the population, treatment use and setting. Post-market analysis of real-world data can provide additional evidence but estimates from standard matching methods may be biased when unobserved characteristics explain whether a patient is treated and their outcomes. We propose a new untreated matching approach that can reduce this bias. Our approach utilises the outcomes of contemporaneous untreated patients to improve the matching of treated and historical control patients. We assess the performance of this new approach compared to standard matching using a simulation study and demonstrate the steps required using a funding decision for prostate cancer treatments in Australia. Our simulation study shows that our new matching approach eliminates nearly all bias when unobserved treatment selection is related to outcomes, and outperforms standard matching in most scenarios. In our empirical example, standard matching overestimated survival by 15% (95% confidence interval 2-34) compared to our untreated matching approach. The health gains estimated using our approach were slightly lower than expected based on the trial evidence, but we also found evidence that in practice prescribers ceased prior therapies earlier, treated a more vulnerable population and continued treatment for longer. Our untreated matching approach offers researchers a new tool for reducing uncertainty in healthcare funding decisions using real-world data.

The trends and associated adverse maternal and perinatal outcomes of labour neuraxial analgesia among vaginal deliveries in China between 2012 and 2019: a real-world observational evidence

BACKGROUND

There is a lack of national report of the labour neuraxial analgesia (NA) rates in China in recent years, especially after the national promotion policy. The adverse maternal and perinatal outcomes associated with NA in China are also unknown. The aim of this study is to estimate the trends of NA rates from 2012 to 2019, to evaluate the effect of national policy on promoting NA and to identify the association between NA and adverse outcomes in China.

METHODS

We used the individual data from China's National Maternal Near Miss Surveillance System (NMNMSS) between 2012 and 2019, covering 438 hospitals from 326 urban districts or rural counties in 30 provinces across China. The analysis was restricted to singleton pregnant women who underwent vaginal delivery at or after 28 completed weeks of gestation. We estimate the trends of NA rates between 2012 and 2019, both at the national and provincial levels using Bayesian multilevel model. We also estimated the effect of the national pilot policy launched in 2018 using interrupted time-series analysis and identified the association between NA and adverse outcomes using modified Poisson regression combined with propensity score analysis.

RESULTS

Over the study period, 620,851 of 6,023,046 women underwent vaginal delivery with NA. The estimated national NA rates increased from 8.4% in 2012 to 16.7% in 2019. Most provinces experienced the same rapid rise during this period. The national pilot policy accelerated the rise of the rates. No differences were observed between women with NA and without any analgesia in the incidence of uterine atony, placental retention, intrapartum stillbirths and 1- and 5-min Apgar scores lower than 7. However, women with NA had higher incidences of genital tract trauma (adjusted relative risk (aRR) 1.53, 95% confidence interval (CI) 1.04-2.26) and maternal near miss (aRR 1.35, 95% CI 1.08-1.69), only in hospitals which were not covered by the national pilot policy and usually lack of sufficient equipment and personnel.

CONCLUSIONS

The national policy can effectively increase the NA rate. However, as genital tract trauma and maternal near miss may increase in low-resource hospitals, but not in high-resource hospitals, further study is required to identify the reasons.

[Real-life data and Covid-19: The third avenue of reseach]

L’analyse des données de vie réelle à partir des systèmes d’information hospitaliers pourrait permettre de trancher sur l’efficacité et la sécurité des traitements prescrits dans le Covid-19 en évitant les écueils des études préliminaires et des essais cliniques randomisés. Les différentes thérapeutiques testées dans les essais cliniques en cours sont déjà largement prescrites aux patients par les médecins dans les hôpitaux, et peuvent donc faire l’objet d’analyses immédiates selon des standards méthodologiques validés.

Evaluation of the representativeness and generalizability of Japanese clinical trials for localized rectal/colon cancer: Comparing participants in the Japan Clinical Oncology Group study with patients in Japanese registries

INTRODUCTION

It is unclear if clinical trial results including patients who meet trial eligibility criteria, are applicable to actual patients in daily practice (generalizability). Moreover, the extent to which are trial participants different from patients seen in daily practice (representativeness) is also unclear. The aim of this study was to evaluate the representativeness of the patients registered in randomized clinical trials to patients in daily practice and examine the generalizability of trial results to daily practice.

METHODS

We compared the results of surgical trials conducted by the Japan Clinical Oncology Group with data from two Japanese cancer registries, representing patients seen in daily practice. We compared overall survival (OS) between trial participants and registry patients to evaluate representativeness of trial participants. We then compared the OS of registry patients who received open surgery (OP) and laparoscopic surgery (LAP) to evaluate the generalizability of trial results.

RESULTS

We analyzed 3051 patients (701 in JCOG0212, 2350 registry patients) with rectal cancer and 3116 patients (1057 in JCOG0404, 2059 registry patients) with colon cancer. Trial participants tended to possess lower clinical stages. Multivariable analyses revealed registry patients with significantly worse survival compared with trial participants. The hazard ratio of LAP to OP among registry patients was 0.305 (95% CI; 0.048-2.188), which did not meet the prespecified generalizability criteria of 0.9.

CONCLUSIONS

Our results failed to ensure either the representativeness or generalizability of clinical trial results, compared to daily practice. Careful considerations are required when applying trial results to patients in daily practice.

A Web-Based Clinical System for Cohort Surveillance of Specific Clinical Effectiveness and Safety Outcomes: A Cohort Study of Non-Vitamin K Antagonist Oral Anticoagulants and Warfarin

Background

Conventional systems of drug surveillance lack a seamless workflow, which makes it crucial to have an active drug surveillance system that proactively assesses adverse drug events.

Objective

The aim of this study was to develop a seamless, Web-based workflow for comparing the safety and effectiveness of drugs in a database of electronic medical records.

Methods

We proposed a comprehensive integration process for cohort surveillance using the National Taiwan University Hospital Clinical Surveillance System (NCSS). We studied a practical application of the NCSS that evaluates the drug safety and effectiveness of novel oral anticoagulants (NOACs) and warfarin by cohort tree analysis in an efficient and interoperable platform.

Results

We demonstrated a practical example of investigating the differences in effectiveness and safety between NOACs and warfarin in patients with nonvalvular atrial fibrillation (AF) using the NCSS. We efficiently identified 2357 patients with nonvalvular AF with newly prescribed oral anticoagulants between 2010 and 2015 and further developed 1 main cohort and 2 subcohorts for separately measuring ischemic stroke as the clinical effectiveness outcome and intracranial hemorrhage (ICH) as the safety outcome. In the subcohort of ischemic stroke, NOAC users exhibited a significantly lower risk of ischemic stroke than warfarin users after adjusting for age, sex, comorbidity, and comedication in an intention-to-treat (ITT) analysis (P=.01) but did not exhibit a significantly distinct risk in an as-treated (AT) analysis (P=.12) after the 2-year follow-up. In the subcohort of ICH, NOAC users did not exhibit a different risk of ICH both in ITT (P=.68) and AT analyses (P=.15).

Conclusions

With a seamless and Web-based workflow, the NCSS can serve the critical role of forming associations between evidence and the real world at a medical center in Taiwan.

Monitoring of patients treated with lithium for bipolar disorder: an international survey

Background

Adequate monitoring of patients using lithium is needed for optimal dosing and for early identification of patients with (potential) ADEs. The objective was to internationally assess how health care professionals monitor patients treated with lithium for bipolar disorder.

Methods

Using networks of various professional organizations, an anonymous online survey was conducted among health care professionals prescribing lithium. Target lithium serum levels and frequency of monitoring was assessed together with monitoring of physical and laboratory parameters. Reasons to and not to monitor and use of guidelines and institutional protocols, and local monitoring systems were investigated.

Results

The survey was completed by 117 health care professionals incorporating responses from twenty-four countries. All prescribers reported to monitor lithium serum levels on a regular basis, with varying target ranges. Almost all (> 97%) monitored thyroid and renal function before start and during maintenance treatment. Reported monitoring of other laboratory and physical parameters was variable. The majority of respondents (74%) used guidelines or institutional protocols for monitoring. In general, the prescriber was responsible for monitoring, had to request every monitoring parameter separately and only a minority of patients was automatically invited.

Conclusions

Lithium serum levels, renal and thyroid function were monitored by (almost) all physicians. However, there was considerable variation in other monitoring parameters. Our results help to understand why prescribers of lithium monitor patients and what their main reasons are not to monitor patients using lithium.

Electronic supplementary material

The online version of this article (10.1186/s40345-018-0120-1) contains supplementary material, which is available to authorized users.

Exclusion criteria and generalizability in bipolar disorder treatment trials

Objective

The current paper reviews the English-language research on exclusion criteria in bipolar disorder treatment trials and discusses how study samples compare to the general bipolar patient population.

Methods

& Results: Across 8 identified studies of exclusion criteria and their impact, between 55% and 96% of people with bipolar disorder would be excluded from treatment research. The number of exclusion criteria varies across bipolar disorder treatment research, with one study estimate of a median of 7 criteria used across studies. The criteria that excluded the greatest number of potential participants were comorbid substance use disorder, suicidal risk, and comorbid medical conditions. Both studies that compared treatment responses among participants who met and did not meet exclusion criteria found no statistically significant differences.

Conclusions

Most potential participants are excluded from outcome research, which creates challenges for recruitment and limits generalizability of study findings. Common exclusionary practices lead to unrepresentative samples that limit generalizability and reduce the confidence of clinicians that findings can be translated to front-line practice with bipolar disorder patients.

Comparative effectiveness and safety of antipsychotic drugs in schizophrenia treatment: a real-world observational study

OBJECTIVE

The objective was to compare, in a real-world setting, the risk of mental and physical health events associated with different antipsychotic drugs (clozapine, olanzapine, risperidone, quetiapine and first-generation antipsychotics) in patients with SZ.

METHODS

This is a retrospective cohort study using administrative data. Outcome measures included any mental health event (suicide, hospitalization or emergency visit for mental disorders) and physical health event (death other than suicide, hospitalization or emergency visit for physical disorders). Cox proportional hazard models were used to estimate the hazard ratios of the events associated with the use of the different antipsychotic drugs.

RESULTS

The cohort included 18 869 adult patients living in the province of Quebec (Canada) with SZ and starting antipsychotic drugs between January 1998 and December 2005. Results show that quetiapine and not using any antipsychotics were associated with an increased risk of mental and physical health events as compared to other drugs. The second finding is the confirmation of better performance of clozapine. The results were robust across sensitivity analyses.

CONCLUSION

Both findings call for an international public health and drug agencies surveillance of 'real-world' antipsychotic medication to ensure the optimal choices in treatment guidelines for SZ.

CONSORT extension for reporting N-of-1 trials (CENT) 2015: explanation and elaboration

N-of-1 trials are a useful tool for clinicians who want to determine the effectiveness of a treatment in a particular individual. The reporting of N-of-1 trials has been variable and incomplete, hindering their usefulness in clinical decision making and by future researchers. This document presents the CONSORT (Consolidated Standards of Reporting Trials) extension for N-of-1 trials (CENT 2015). CENT 2015 extends the CONSORT 2010 guidance to facilitate the preparation and appraisal of reports of an individual N-of-1 trial or a series of prospectively planned, multiple, crossover N-of-1 trials. CENT 2015 elaborates on 14 items of the CONSORT 2010 checklist, totalling 25 checklist items (44 sub-items), and recommends diagrams to help authors document the progress of one participant through a trial or more than one participant through a trial or series of trials, as applicable. Examples of good reporting and evidence based rationale for CENT 2015 checklist items are provided.

LAI versus oral: A case-control study on subjective experience of antipsychotic maintenance treatment

BACKGROUND

To present real-world evidence on the differences between long-acting injectable (LAI) and oral antipsychotic maintenance treatment (AMT) in terms of subjective well-being, attitudes towards drug and quality of life in a sample of remitted schizophrenic subjects.

METHODS

Twenty outpatients with remitted schizophrenia treated with either olanzapine or paliperidone and switching from the oral to the LAI formulation of their maintenance treatment were recruited before the switch (LAI-AMT group). A group of 20 remitted schizophrenic subjects with oral AMT and matching main sociodemographic, clinical and treatment variables made up the control group (oral-AMT group). All participants were assessed in terms of objective (PANSS, YMRS, MADRS) and subjective (SWN-K, DAI-10, SF-36) treatment outcomes at baseline (T0) and after 6 months (T1).

RESULTS

Between T0 and T1, general psychopathology of the PANSS, DAI-10, and all but one of the SWN-K dimensions (except for social integration), showed significantly higher percentages of improvement in the LAI-AMT group compared to the oral-AMT group. A generalized expansion of health-related quality of life, with better functioning in almost all areas of daily living, was reported by the LAI-AMT group after the 6-month period. In contrast, the oral-AMT group reported a significant worsening of health-related quality of life in the areas of emotional role and social functioning in the same period.

CONCLUSIONS

Our study indicates possible advantages of LAI over oral antipsychotic formulation in terms of subjective experience of maintenance treatment in remitted schizophrenic patients. Size and duration of this study need to be expanded in order to produce more solid and generalizable results.

Antipsychotic Adherence and Rehospitalization in Schizophrenia Patients Receiving Oral Versus Long-Acting Injectable Antipsychotics Following Hospital Discharge

BACKGROUND

Antipsychotic medications are a central component of effective treatment for schizophrenia, but nonadherence is a significant problem for the majority of patients. Long-acting injectable (LAI) antipsychotic medications are a recommended treatment option for nonadherent patients, but evidence regarding their potential advantages has been mixed. Observational data on newer, second-generation LAI antipsychotic medications have been limited given their more recent regulatory approval and availability.

OBJECTIVE

To examine antipsychotic medication nonadherence, discontinuation, and rehospitalization outcomes in Medicaid patients receiving oral versus LAI antipsychotic medications in the 6 months after a schizophrenia-related hospitalization.

METHODS

The 2010-2013 Truven Health Analytics MarketScan Medicaid research claims database was used to identify adult patients with a recent history of nonadherence (prior 6 months) who received an oral or LAI antipsychotic medication within 30 days after an index schizophrenia-related hospitalization. Primary outcome measures were nonadherence (proportion of days covered less than  0.80), discontinuation (continuous medication gap ≥ 60 days), and schizophrenia-related rehospitalization, all in the 6 months after discharge. Descriptive analyses compared users of oral versus LAI antipsychotic medication on sociodemographic, clinical, and treatment characteristics. Logistic regressions were used to examine associations between use of oral versus LAI antipsychotics and each study outcome while controlling for observed differences in sample characteristics. All outcomes were compared at 3 levels of analysis: overall LAI class, LAI antipsychotic generation (first-generation [FGA] or second-generation [SGA] antipsychotics), and individual LAI agent (fluphenazine decanoate, haloperidol decanoate, risperidone LAI, and paliperidone palmitate).

RESULTS

Of the final sample, 91% (n = 3,428) received oral antipsychotics, and 9.0% (n = 340) received LAI antipsychotics after discharge. Slightly over half (n =183, 53.8%) of LAI users used an SGA LAI. A smaller percentage of patients receiving LAIs were nonadherent (51.8% vs. 67.7%, P  less than  0.001); had a 60-day continuous gap in medication (23.8% vs. 39.4%, P  less than  0.001); and were rehospitalized for schizophrenia (19.1% vs. 25.3%, P = 0.01) compared with patients receiving oral medications. The size of these differences was magnified when comparing SGA LAI users with users of oral antipsychotics for nonadherence. After controlling for all differences in measured covariates, LAI initiators had lower odds of being nonadherent (adjusted odds ratio [AOR] = 0.35, 95% CI = 0.27-0.46, P  less than  0.001) and of having continuous 60-day gaps (AOR = 0.45, 95% CI = 0.34-0.60, P  less than  0.001) when compared with patients receiving oral medications. Both FGA and SGA LAI users had lower odds of nonadherence compared with patients receiving oral antipsychotics. Similarly, FGA LAI users (AOR = 0.58, 95% CI = 0.40-0.85, P = 0.005) and SGA LAI initiators (AOR = 0.34, 95% CI =0.23-0.51, P  less than  0.001) had lower odds of a 60-day continuous gap compared with patients receiving oral antipsychotics. Compared with those receiving oral antipsychotics, LAI initiators also had lower odds of rehospitalization (AOR = 0.73, 95% CI = 0.54-0.99, P = 0.041); however, when examined separately, only patients receiving SGA LAIs (AOR = 0.59, 95% CI = 0.38-0.90, P = 0.015) and not FGA LAIs (AOR = 0.90, 95% CI = 0.60-1.34, P = 0.599) had a statistically significant reduction in odds of rehospitalization. Among individual LAIs, odds of rehospitalization only among initiators of paliperidone palmitate were statistically different from those among users of oral antipsychotics (AOR = 0.53, 95% CI = 0.30-0.94, P = 0.031). While odds of rehospitalization were 33% lower among patients receiving risperidone LAI compared with those receiving oral antipsychotics, the estimate did not reach statistical significance (AOR = 0.67, 95% CI = 0.37-1.22, P = 0.194). 

CONCLUSIONS

This claims-based analysis of posthospitalization adherence and rehospitalization outcomes in Medicaid patients with schizophrenia adds to the growing real-world evidence base of the benefits of LAI antipsychotic medications in routine clinical practice, particularly with regard to second-generation LAIs. As new SGA formulations become available for long-acting use, real-world studies with larger sample sizes will be needed to further delineate their potential advantages in terms of clinical outcomes and costs.

Big data are coming to psychiatry: a general introduction

Big data are coming to the study of bipolar disorder and all of psychiatry. Data are coming from providers and payers (including EMR, imaging, insurance claims and pharmacy data), from omics (genomic, proteomic, and metabolomic data), and from patients and non-providers (data from smart phone and Internet activities, sensors and monitoring tools). Analysis of the big data will provide unprecedented opportunities for exploration, descriptive observation, hypothesis generation, and prediction, and the results of big data studies will be incorporated into clinical practice. Technical challenges remain in the quality, analysis and management of big data. This paper discusses some of the fundamental opportunities and challenges of big data for psychiatry.

A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results

Randomized controlled trials (RCTs) are conducted under idealized and rigorously controlled conditions that may compromise their external validity. A literature review was conducted of published English language articles that reported the findings of studies assessing external validity by a comparison of the patient sample included in RCTs reporting on pharmaceutical interventions with patients from everyday clinical practice. The review focused on publications in the fields of cardiology, mental health, and oncology. A range of databases were interrogated (MEDLINE; EMBASE; Science Citation Index; Cochrane Methodology Register). Double-abstract review and data extraction were performed as per protocol specifications. Out of 5,456 de-duplicated abstracts, 52 studies met the inclusion criteria (cardiology, n = 20; mental health, n = 17; oncology, n = 15). Studies either performed an analysis of the baseline characteristics (demographic, socioeconomic, and clinical parameters) of RCT-enrolled patients compared with a real-world population, or assessed the proportion of real-world patients who would have been eligible for RCT inclusion following the application of RCT inclusion/exclusion criteria. Many of the included studies concluded that RCT samples are highly selected and have a lower risk profile than real-world populations, with the frequent exclusion of elderly patients and patients with co-morbidities. Calculation of ineligibility rates in individual studies showed that a high proportion of the general disease population was often excluded from trials. The majority of studies (n = 37 [71.2 %]) explicitly concluded that RCT samples were not broadly representative of real-world patients and that this may limit the external validity of the RCT. Authors made a number of recommendations to improve external validity. Findings from this review indicate that there is a need to improve the external validity of RCTs such that physicians treating patients in real-world settings have the appropriate evidence on which to base their clinical decisions. This goal could be achieved by trial design modification to include a more representative patient sample and by supplementing RCT evidence with data generated from observational studies. In general, a thoughtful approach to clinical evidence generation is required in which the trade-offs between internal and external validity are considered in a holistic and balanced manner.

Practical pharmacotherapy for acute schizophrenia patients

Well-organized clinical guidelines of pharmacotherapy for schizophrenia are not necessarily applicable to emergency and acute-phase situations. Thus, practical pharmacotherapy for acute schizophrenia patients should be based on data from real clinical practice and be independent of pharmaceutical companies. This study investigated the current guidelines being used to determine the initially preferred antipsychotics, durations required before an antipsychotic is viewed as being ineffective, and the strategies utilized for early non-responders that include switching, high dose, and augmentation. In patients who develop side-effects to the preferred antipsychotic drug, continued use may depend on the specific characteristics of the side-effects. For acute-phase patients, antipsychotics with high efficacy and effectiveness may be chosen based on meta-analysis findings for not only double-blinded but also rater-blinded randomized controlled trials. Many previous studies have reported being able to make an early prediction at 2 weeks regarding the later response. These predictions were supported by the findings of a recent meta-analysis of 34 studies that examined 9975 participants. In early non-responders to the initial antipsychotic, the effectiveness of the switching strategy appears to depend on the initial antipsychotic administered and the antipsychotic the patient is subsequently switched to. Furthermore, the effectiveness of the strategy between switching and augmentation might also depend on the initial antipsychotic administered. The current findings might serve as the basis for the use of dosing above the licensed range versus continuing the use of conventional dosing in non-responders, provided there is close monitoring of the side-effects. Further research is required before any modifications of routine practices are undertaken regarding the direction of new potential treatments.

Identifying and Developing Effective Interventions in Rehabilitation Settings: Recognising the Limits of the Evidence-Based Practice Approach

The evidence-based practice movement has led to higher quality intervention studies being reported in the health sciences literature (see, for example, Mosely et al., 2002), and consequently being available for uptake by practising health professionals. Yet interventions in applied settings need to satisfy more than the methodologically-based criteria associated with being categorised as a ‘well-established treatment’ (Chambless et al., 1996). Some of these additional criteria were recently described by King and Ollendick (2007). The current article extends these criteria so as to include attributes of interventions that (ideally) are required when designing or delivering services within rehabilitation settings.

Concurrent Oral Antipsychotic Drug Use Among Schizophrenia Patients Initiated on Long-Acting Injectable Antipsychotics Post-Hospital Discharge

Pharmacological treatment is central to effective management of schizophrenia. Prescribing clinicians have an increasing array of options from which to choose, and oral antipsychotic polypharmacy is common in routine clinical practice. Practice guidelines recommend long-acting injectable (LAI) formulations, typically viewed as monotherapeutic alternatives, for patients with established nonadherence. Yet there are limited data on the prevalence and nature of concurrent oral antipsychotic prescriptions in patients receiving LAIs. Our observational, claims-based study examined the frequency and duration of concurrent oral prescriptions in 340 Medicaid patients receiving LAI therapy. Specifically, we examined patients with a recent history of nonadherence and hospitalization for schizophrenia and included both first-generation antipsychotic depot medications (fluphenazine decanoate, haloperidol decanoate) and more recently available second-generation injectables (LAI risperidone, paliperidone palmitate). Of all patients initiated on LAIs, 75.9% had a concurrent oral antipsychotic prescription in the 6 months post-hospital discharge. Patients receiving concurrent prescriptions were frequently prescribed an oral formulation of their LAI agent, but many first-generation LAI users received a concurrent second-generation oral medication. The lowest rate of concurrent prescribing (58.8%) was found with paliperidone palmitate, whereas the highest rate was with LAI risperidone (88.9%). Overlap in oral and LAI prescriptions typically occurred for a substantial period of time (ie, >30 days) and for a notable percentage of the days covered by LAIs (often 50% or more). Our findings highlight the need to further examine such prescribing patterns, to probe the reasons for them, and to clarify the optimal roles of different antipsychotic treatments in clinical practice.

Strategies for Early Non-response to Antipsychotic Drugs in the Treatment of Acute-phase Schizophrenia

As a strategy for antipsychotic treatment of schizophrenia, monotherapy is clearly optimal when both effective and tolerated. When a patient fails to respond to an adequate dose of an antipsychotic, alternatives include switching, administering a higher dose (above the licensed dose), polypharmacy or clozapine. Clozapine is the only option with established efficacy, but is less manageable than other antipsychotics. We therefore reviewed other options, focusing on the treatment of acute-phase schizophrenia. According to recent evidence, an antipsychotic may be viewed as ineffective within 1-4 weeks in acute-phase practice, although some differences may exist among antipsychotics. Whether a switching strategy is effective might depend on the initial antipsychotic and which antipsychotic is switched to. As weak evidence points toward augmentation being superior to continuation of the initial antipsychotic, inclusion of augmentation arms in larger studies comparing strategies for early non-responders in the acute-phase is justified. With respect to high-doses, little evidence is available regarding acute-phase treatment, and the issue remains controversial. Although evidence for antipsychotic switching, augmentation, and high-doses has gradually been accumulating, more studies performed in real clinical practice with minimal bias are required to establish strategies for early non-response to an antipsychotic drug in the treatment of acute-phase schizophrenia.

Using principles of practice-based research to teach evidence-based practice in social work

Social work educators are in a good position to encourage the uptake of evidence-based practice more widely throughout the profession. Despite increasing attention being paid to it within professional literature, it seems to be making inroads to practice only very slowly. This article interprets that slow uptake as a function of confusion about the definition and scope of evidence-based practice, and also as an expression of the distance between the practice and research communities within the profession. Practice-based research is introduced as a framework that responds to both of these concerns. Finally the importance of social work education as a catalyst of evidence-based practice is articulated and the five-step evidence-based practice process is explicated with considerations from practice-based research incorporated along with pedagogical implications.

Length of mechanical restraint following haloperidol injections versus oral atypical antipsychotics for the initial treatment of acute schizophrenia: a propensity-matched analysis from the Japanese diagnosis procedure combination database

Differences in effectiveness between haloperidol injection and oral atypical antipsychotics in the acute-phase treatment of schizophrenia are not well examined. We retrospectively investigated whether these treatment options affected the length of mechanical restraint. We used the Japanese Diagnosis Procedure Combination Database to identify schizophrenia patients who were involuntarily hospitalized and receiving mechanical restraint between July and December, 2006-2009. Data included patient demographics, use of antipsychotics, and number of days on which patients underwent mechanical restraint. Propensity score matching was performed to compare the number of days of mechanical restraint between the haloperidol injection group and the oral atypical antipsychotics group. We used survival analysis to examine whether the initial difference in treatment affected the number of days of mechanical restraint. Cox regression was performed to compare the concurrent effects of various factors. Among 1731 eligible patients, 574 were treated with haloperidol injections and 420 with atypical antipsychotics. Matching produced 274 patients in each group. Cox regression analysis showed that the initial therapeutic agents did not significantly affect the number of days of mechanical restraint. The results indicate that atypical antipsychotics were as effective as haloperidol injections in the acute-phase treatment of schizophrenia.

Drug treatments for schizophrenia: pragmatism in trial design shows lack of progress in drug design

Aims. The introduction of second generation antipsychotic (SGA) medication over a decade ago led to changes in prescribing practices; these drugs have eclipsed their predecessors as treatments for schizophrenia. However, the metabolic side effects of these newer antipsychotics have been marked and there are increasing concerns as to whether these novel drugs really are superior to their predecessors in terms of the balance between risks and benefits. In this article, we review the literature regarding comparisons between first generation antipsychotic (FGA) and SGA in terms of clinical effectiveness. Methods. Large (n > 150) randomized-controlled trials (RCTs) comparing the effectiveness (efficacy and side effects) of FGA and SGA medications other than clozapine were reviewed, as were meta-analyses that included smaller studies. Results. The superiority in efficacy and reduced extrapyramidal side effects (EPSE) of SGAs is modest, especially when compared with low-dose FGAs. However, the high risk of weight gain and other metabolic disturbances associated with certain SGAs such as olanzapine is markedly higher than the risk with FGAs at the doses used in the trials. Conclusions. The efficacy profiles of various FGAs and SGAs are relatively similar, but their side effects vary between and within classes. Overall, large pragmatic trials of clinical effectiveness indicate that the care used in prescribing and managing drug treatments to ensure tolerability may be more important than the class of drug used.

Postmarketing safety surveillance : where does signal detection using electronic healthcare records fit into the big picture?

The safety profile of a drug evolves over its lifetime on the market; there are bound to be changes in the circumstances of a drug's clinical use which may give rise to previously unobserved adverse effects, hence necessitating surveillance postmarketing. Postmarketing surveillance has traditionally been carried out by systematic manual review of spontaneous reports of adverse drug reactions. Vast improvements in computing capabilities have provided opportunities to automate signal detection, and several worldwide initiatives are exploring new approaches to facilitate earlier detection, primarily through mining of routinely-collected data from electronic healthcare records (EHR). This paper provides an overview of ongoing initiatives exploring data from EHR for signal detection vis-à-vis established spontaneous reporting systems (SRS). We describe the role SRS has played in regulatory decision making with respect to safety issues, and evaluate the potential added value of EHR-based signal detection systems to the current practice of drug surveillance. Safety signal detection is both an iterative and dynamic process. It is in the best interest of public health to integrate and understand evidence from all possibly relevant information sources on drug safety. Proper evaluation and communication of potential signals identified remains an imperative and should accompany any signal detection activity.

The adequacy of pharmaceutical treatment of schizophrenia in Quebec varies with age, but is not influenced by sex or neighbourhood deprivation

OBJECTIVE

Though high discontinuation rates for antipsychotics (APs) by patients with schizophrenia are frequently reported, the percentage of patients receiving pharmaceutical treatment for schizophrenia in routine practice in accordance with international clinical guidelines is unknown. Further, it is unknown if these rates are influenced by levels of neighbourhood deprivation or by a patient's age or sex. Our study aims to investigate if inequalities in AP treatment could be observed between patients living in neighbourhoods with the highest levels of material and social deprivation and those with the lowest deprivation levels, between patients from different age groups, or between men and women.

METHODS

We conducted a secondary analysis of medical-administrative data of a cohort of adult patients in the province of Quebec with a medical contact for schizophrenia in a 2-year period (2004-2005). We assessed the proportion of patients that filled at least 1 prescription for an AP and received adequate pharmaceutical treatment, defined as being in possession of APs at least 80% of the time as outpatients during a 2-year follow-up period.

RESULTS

Among the 30 544 study patients, 88.5% filled at least 1 prescription for an AP, and 67.5% of the treated patients received adequate treatment. Though no clinically significant differences were observed by deprivation or sex, younger age was associated with lower proportions of patients receiving adequate treatment (46% of treated patients aged between 18 and 29 years, compared with 72% aged between 30 and 64 years, and 77% aged 65 years and over).

CONCLUSIONS

In Quebec's routine practice, over 70% of treated patients aged 30 and over received adequate pharmacological treatment, regardless of sex or neighbourhood socioeconomic status. In contrast, in patients aged between 18 and 29 years this percentage was 47%. This is a discouraging finding, especially because optimal treatment in the early phase of disease is reported to result in the best long-term outcomes.

Volunteer bias in recruitment, retention, and blood sample donation in a randomised controlled trial involving mothers and their children at six months and two years: a longitudinal analysis

BACKGROUND

The vulnerability of clinical trials to volunteer bias is under-reported. Volunteer bias is systematic error due to differences between those who choose to participate in studies and those who do not.

METHODS AND RESULTS

This paper extends the applications of the concept of volunteer bias by using data from a trial of probiotic supplementation for childhood atopy in healthy dyads to explore 1) differences between a) trial participants and aggregated data from publicly available databases b) participants and non-participants as the trial progressed 2) impact on trial findings of weighting data according to deprivation (Townsend) fifths in the sample and target populations. 1) a) Recruits (n = 454) were less deprived than the target population, matched for area of residence and delivery dates (n = 6,893) (mean [SD] deprivation scores 0.09[4.21] and 0.79[4.08], t = 3.44, df = 511, p<0.001). b) i) As the trial progressed, representation of the most deprived decreased. These participants and smokers were less likely to be retained at 6 months (n = 430[95%]) (OR 0.29,0.13-0.67 and 0.20,0.09-0.46), and 2 years (n = 380[84%]) (aOR 0.68,0.50-0.93 and 0.55,0.28-1.09), and consent to infant blood sample donation (n = 220[48%]) (aOR 0.72,0.57-0.92 and 0.43,0.22-0.83). ii) Mothers interested in probiotics or research or reporting infants' adverse events or rashes were more likely to attend research clinics and consent to skin-prick testing. Mothers participating to help children were more likely to consent to infant blood sample donation. 2) In one trial outcome, atopic eczema, the intervention had a positive effect only in the over-represented, least deprived group. Here, data weighting attenuated risk reduction from 6.9%(0.9-13.1%) to 4.6%(-1.4-+10.5%), and OR from 0.40(0.18-0.91) to 0.56(0.26-1.21). Other findings were unchanged.

CONCLUSIONS

Potential for volunteer bias intensified during the trial, due to non-participation of the most deprived and smokers. However, these were not the only predictors of non-participation. Data weighting quantified volunteer bias and modified one important trial outcome.

TRIAL REGISTRATION

This randomised, double blind, parallel group, placebo controlled trial is registered with the International Standard Randomised Controlled Trials Register, Number (ISRCTN) 26287422. Registered title: Probiotics in the prevention of atopy in infants and children.

Time to all-cause treatment discontinuation of olanzapine compared to other antipsychotics in the treatment of schizophrenia: a systematic review and meta-analysis

OBJECTIVE

This comprehensive review and meta-analysis compared the effectiveness of olanzapine and other antipsychotics in schizophrenia treatment, defining effectiveness as time to all-cause medication discontinuation (primary) and as all-cause treatment discontinuation rates. This study examined randomized clinical trials (RCTs) and observational non-interventional studies.

EXPERIMENTAL PROCEDURES

Schizophrenia studies that compared olanzapine with individual first- (FGAs) and/or second-generation antipsychotics (SGAs) were included in the meta-analyses. Hazard ratios (HR), risk ratios (RR), and their associated 95% confidence intervals were extracted for RCTs and observational studies. Sensitivity analyses assessed the impact of sources of funding, dose of olanzapine, and allocation concealment method on final results.

RESULTS

There were 60 RCTs (N=33,360) and 27 observational studies (N=202,591) included. On time to all-cause medication discontinuation, olanzapine was significantly better than aripiprazole, quetiapine, risperidone, ziprasidone and perphenazine for RCTs and better than amisulpride, risperidone, haloperidol, and perphenazine for observational studies. There were no significant differences between olanzapine and clozapine in RCTs or observational studies. All-cause discontinuation rates in RCTs were significantly lower for olanzapine compared to all comparators except amisulpride and clozapine. In observational studies, olanzapine was less effective than clozapine. Industry-sponsored studies favored olanzapine when compared to haloperidol and perphenazine; higher dose of olanzapine favored quetiapine and perphenazine when compared to olanzapine; method of allocation concealment did not generally affect the results.

CONCLUSION

Using a global measure of medication effectiveness (time to all-cause medication discontinuation), olanzapine appears to be more effective - in both RCTs and observational studies - than most SGAs and FGAs, except for clozapine.

SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials

High quality protocols facilitate proper conduct, reporting, and external review of clinical trials. However, the completeness of trial protocols is often inadequate. To help improve the content and quality of protocols, an international group of stakeholders developed the SPIRIT 2013 Statement (Standard Protocol Items: Recommendations for Interventional Trials). The SPIRIT Statement provides guidance in the form of a checklist of recommended items to include in a clinical trial protocol. This SPIRIT 2013 Explanation and Elaboration paper provides important information to promote full understanding of the checklist recommendations. For each checklist item, we provide a rationale and detailed description; a model example from an actual protocol; and relevant references supporting its importance. We strongly recommend that this explanatory paper be used in conjunction with the SPIRIT Statement. A website of resources is also available (www.spirit-statement.org). The SPIRIT 2013 Explanation and Elaboration paper, together with the Statement, should help with the drafting of trial protocols. Complete documentation of key trial elements can facilitate transparency and protocol review for the benefit of all stakeholders.

Reassessing the evidence hierarchy in asthma: evaluating comparative effectiveness

Classical randomized controlled trials are the gold standard in medical evidence because of their high internal validity. However, their necessarily strict design can limit their external validity and the ability to extrapolate these data to real world patients. Therefore, alternatively designed studies may play a complementary role in evaluating the comparative effectiveness of therapies in nonidealized patients in more naturalistic, real world settings. Observational studies have high external validity and can evaluate real world outcomes. Their strength lies in hypothesis generation and testing and in identifying areas in which further clinical trials may be required. Pragmatic trials are designed to maximize applicability of trial results to usual care settings by relying on clinically important outcomes and enrolling a wide range of participants. A combination of these approaches is preferable and necessary.

Representation of people with intellectual disabilities in randomised controlled trials on antipsychotic treatment for behavioural problems

BACKGROUND

Behavioural problems are common in people with intellectual disability (ID) and are often treated with antipsychotics.

AIM

To establish the frequency and characteristics of people with ID included in randomised controlled trials (RCTs) on antipsychotic treatment for behavioural problems, and to investigate the quality of these RCTs.

METHODS

A literature search in EMBASE, PubMed and Cochrane was performed and reviewed.

RESULTS

People with ID participated in 27 of the 100 included RCTs. The RCTs were of good quality but smaller compared with trials in patients with dementia or schizophrenia (average sample sizes = 55, 124 and 374). In 13/27 trials no clear definition of ID was given. Over 25 different outcome measures were used to assess behavioural problems.

CONCLUSIONS

Studies in which people with ID are included are of a sufficient quality, but of a small size. The heterogeneity in the characteristics of the ID population included as well as in the applied assessment instruments makes performing meta-analyses unfeasible.

A critical appraisal of standard guidelines for grading levels of evidence

Over the past 30 years, a general consensus has emerged within the medical community regarding the essential role served by grading guidelines in evaluating the quality of evidence produced by a medical research study. Specifically, consensus exists regarding the hierarchy of evidence, where randomized controlled trials (RCTs) are considered the ''gold standard'' followed by nonrandomized controlled trials (non-RCTs) and uncontrolled trials. As guidelines have become more sophisticated, processes have been developed for downgrading poorly conducted studies and upgrading strong studies. Lists of threats to internal validity have been disseminated, thereby assisting reviewers in grading studies. However, despite these many accomplishments, considerable issues remain unresolved with respect to how to evaluate the strength of evidence produced by flawed RCTs versus well-conducted non-RCTs. The purpose of this article is to evaluate existing evidence-based grading guidelines and to offer suggestions for how such guidelines may be improved.

Treatment outcomes and predictors of drop out for problem gamblers in South Australia: a cohort study

OBJECTIVES

Recent prevalence studies in Australia, the USA and Canada have estimated 1-2% of the adult population meet the diagnostic criteria for problem or pathological gambling. The Statewide Gambling Therapy Service (SGTS) provides treatment for problem gamblers in key metropolitan and rural regions in South Australia. The aims of this study were two-fold: to analyse the short and mid-term outcomes following treatment provided by SGTS and to identify factors associated with treatment drop-out.

METHOD

A cohort of treatment seeking problem gamblers was recruited through SGTS in 2008. Repeated outcome measures included problem gambling screening, gambling related cognitions and urge. Treatment drop-out was defined as participants attending three or less treatment sessions, whilst potential predictors of drop-out included perceived social support , anxiety and sensation-seeking traits.

RESULTS

Of 127 problem gamblers who participated in the study, 69 (54%) were males with a mean age of 43.09 years (SD = 12.65 years) and with 65 (52%) reporting a duration of problem gambling greater than 5 years. Follow up time for 50% of participants was greater than 8.9 months and, overall, 41 (32%) participants were classified as treatment drop-outs. Results indicated significant improvement over time on all outcome measures except alcohol use for both treatment completers and drop-outs, although to a lesser extent for the treatment drop-out group. A significant predictor of treatment drop-out was sensation-seeking traits.

CONCLUSION

These results will inform future treatment planning and service delivery, and guide research into problem gambling including aspects of treatment drop-out.

Beyond the RCT - understanding the relationship between interventions, individuals and outcome - the example of neurological rehabilitation

BACKGROUND

Rehabilitation is highly complex, involving multiple processes, outcomes and stakeholders. The way we deliver our services and work with our clients and their families should be informed by research approaches that produce the wide range of knowledge needed. This article aims to explore the degree to which the dominant approach to 'evidence' (the randomised clinical trial or RCT) meets those needs and discuss alternate/additional ways of gaining evidence.

METHODS

A critical review of the literature allowing exploration of problems encountered in rehabilitation RCTs and alterative approaches.

FINDINGS

We discuss some problematic issues related to using RCTs in rehabilitation research (for example the large number of people excluded from trials, and the small numbers of people with some neurological conditions making RCTs non-viable). Alternative approaches are discussed including clinical practice improvement studies (sometimes called practice-based evidence or PBE), which provide data on patients treated in routine practice; qualitative research, which can provide an understanding of the users of health care services to ensure they are meeting their needs; and metasynthesis, which can be used to summarise several qualitative studies to enhance our understanding of the principles underlying service delivery. Finally, we explore how clinicians and commissioners often use evidence generated by forms of research other than the RCT.

CONCLUSION

The best answers about how to enhance rehabilitation outcomes are likely to come from a combination and integration of the most appropriate methods. In conclusion, we urge for more joined up thinking, for learning from different fields so that we can develop more effective and appropriate health care and rehabilitation.

The science of primary health-care improvement: potential and use of community-based participatory research by practice-based research networks for translation of research into practice

There is a need for new approaches to supplement the existing methods of taking research from bench to bedside and from bedside to practice. Community-based participatory research (CBPR) is an emerging model of research that enhances ongoing clinical research by involving key stakeholders, including community members and patients. A practice-based research network (PBRN) is a group of primary care practices devoted principally not only to the primary care of patients, but also with a mission to investigate questions related to community-based practice and to improve the quality of primary care. Traditionally, PBRN research has not included patients or community members, while CBPR has excluded health providers as key stakeholders. Typical overlap topics of PBRN and CBPR research are health-care disparities, prevention, chronic disease management and mental health. The inclusion of CBPR within a PBRN has been identified as an important next step with the potential to significantly enhance the research process. This review focuses on bringing together the ideals of CBPR and PBRNs in order to tackle intractable problems such as disparities in health-care access and outcomes and translate these results into practice. Specifically, the CBPR PBRN approach can: (1) guide the research process so that studies more closely match the needs of all stakeholders (including providers, patients and community members); (2) assist in the development of the research protocol and identification of research methodologies so that the study is more amenable to participants; (3) facilitate recruitment of research participants; (4) enrich the data collection and analysis; and (5) allow rapid translation of results from the study back into clinical practice and the community. Once these mechanisms have been clearly elucidated, their widespread adoption will positively impact overall health at both a local and national level.

Worldwide-Schizophrenia Outpatient Health Outcomes (W-SOHO): baseline characteristics of pan-regional observational data from more than 17,000 patients

OBJECTIVE

To describe the Worldwide-Schizophrenia Outpatient Health Outcomes (W-SOHO) patient population at study entry, focusing on illness burden and prescribing practices across regions.

METHODS

The SOHO study was a 3-year, prospective, observational study designed to assess costs and outcomes associated with antipsychotic use in outpatients initiating or changing antipsychotic (with an emphasis on olanzapine compared with other antipsychotics). SOHO was conducted in 10 European countries and 27 other countries as Intercontinental SOHO (IC-SOHO). Data from all countries have been pooled to produce the W-SOHO dataset.

MAIN OUTCOMES MEASURES

Clinical Global Impression-Schizophrenia (CGI-SCH) severity scores, psychotropic medication use, adverse events, social interaction, housing and employment status, self-perceived health state (EuroQoL EQ-5D scale and Visual Analogue Scale, EQ-VAS), and reasons for initiation/change of antipsychotic.

RESULTS

The W-SOHO database comprises 17,384 patients from six regions; East Asia (n = 1223), Central and Eastern Europe (n = 2175), Northern Europe (n = 4291), Southern Europe (n = 5788), Latin America (n = 2566), North Africa and the Middle East (n = 1341). Overall, patients were 38 +/- 13 years old (mean +/- SD), moderately ill (mean CGI-SCH overall score of 4.4 +/- 1.0) with a median duration of illness of 7 years (interquartile range 1-16 years); 43% were female, 10% were receiving antipsychotic medication for the first time. Adverse events were prevalent across all regions; on average, 50% (range 41-59%) of patients taking antipsychotics exhibited extrapyramidal symptoms at baseline, and 62% (34-67%) of patients reported sexual dysfunction in the previous month. On average, only 19% (16-23%) of patients were in paid employment and as many as 69% were living in dependent housing.

CONCLUSIONS

Despite inherent diversity in these patients and the health care systems supporting them, there are striking cross-regional similarities in baseline characteristics for most measures. Not all countries are represented; regional comparisons may not be valid outside of the countries studied.

Revisiting practice-based research networks as a platform for mental health services research

Practice-based research networks (PBRNs)-collaborations of practice settings that work together to generate research knowledge-are underused in mental health services research. This article proposes an agenda for mental health services research that uses a variety of PBRN structures and that focuses on what really happens in practice, the effectiveness of practice innovations in real world care, the challenges of implementing evidence supported interventions, modification of clinician behavior, and assessment of the effect of mental health policy changes on practice. The challenges of conducting research within PBRNs are substantial, including difficulties in maintaining positive member relations, securing ongoing funding, sustaining productivity, overcoming IRB entanglements and achieving both scientific excellence in recruitment and measurement validity and utility for practitioner members. However, the awareness of these challenges allows researchers and practitioners to build networks that creatively overcome them and that infuse mental health services research with heavy doses of the realities of everyday clinical practice.

Characteristics of individuals with insomnia who seek treatment in a clinical setting versus those who volunteer for a randomized controlled trial

The generalizability of outcome data derived from insomnia clinical trials is based largely on the extent to which research volunteers resemble clinical patients. This study compared sociodemographic, sleep, psychological, and medical characteristics of individuals who volunteered for an insomnia treatment study (n = 120) to patients who sought treatment in a clinical setting (n = 106). The samples did not differ on most sleep and medical variables, but clinical patients had a higher prevalence of mood disorders, greater anxiety and depression symptoms, and higher perceived insomnia severity. Differences on psychological variables were accentuated by the research selection process. It is suggested to minimize exclusion based on psychological comorbidity in order to enhance ecological validity of randomized controlled trials of insomnia treatments.

Improving the reporting of pragmatic trials: an extension of the CONSORT statement

BACKGROUND

The CONSORT statement is intended to improve reporting of randomised controlled trials and focuses on minimising the risk of bias (internal validity). The applicability of a trial's results (generalisability or external validity) is also important, particularly for pragmatic trials. A pragmatic trial (a term first used in 1967 by Schwartz and Lellouch) can be broadly defined as a randomised controlled trial whose purpose is to inform decisions about practice. This extension of the CONSORT statement is intended to improve the reporting of such trials and focuses on applicability. Methods At two, two-day meetings held in Toronto in 2005 and 2008, we reviewed the CONSORT statement and its extensions, the literature on pragmatic trials and applicability, and our experiences in conducting pragmatic trials. Recommendations We recommend extending eight CONSORT checklist items for reporting of pragmatic trials: the background, participants, interventions, outcomes, sample size, blinding, participant flow, and generalisability of the findings. These extensions are presented, along with illustrative examples of reporting, and an explanation of each extension. Adherence to these reporting criteria will make it easier for decision makers to judge how applicable the results of randomised controlled trials are to their own conditions. Empirical studies are needed to ascertain the usefulness and comprehensiveness of these CONSORT checklist item extensions. In the meantime we recommend that those who support, conduct, and report pragmatic trials should use this extension of the CONSORT statement to facilitate the use of trial results in decisions about health care.

Is the volume-outcome relationship sustained in psychiatric care?

BACKGROUND

Although much prior research has found a consistently positive volume-outcome relationship, there is scanty documentation on this issue in mental healthcare. This study examines the association between a hospitals' psychiatric inpatient volume and 30-day readmission rates.

METHODS

Using administrative data from Taiwan's National Health Insurance Research Database for 2003, the likelihood of 30-day readmission is examined relative to the hospital's volume of voluntary psychiatric admissions and total bed-days.

RESULTS

As hospital volume increases, so too does the 30-day readmission rates for patients with schizophrenia, bipolar disorder and major depressive disorders.

CONCLUSIONS

The positive volume-outcome relationship in patients suffering from psychiatric disorders suggests a different scenario from the 'practice makes perfect' phenomenon that may underlie the inverse volume-outcome relationship found among most physical disorders, both surgical and medical.