Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research

Enhancing quality of life in epilepsy with a digital intervention (emyna): Results of the ELAINE randomized controlled trial

OBJECTIVE

Despite the availability of pharmacological treatment for seizures, people with epilepsy (PwE) commonly experience impairments in quality of life (QoL). Given the limited access to psychosocial treatments for PwE, digital interventions could bridge treatment gaps and help improve QoL. The objective of this study was to examine the effectiveness of emyna, a fully automated digital intervention based on cognitive behavioral therapy (CBT) techniques, in improving health-related QoL among PwE who reported impairments in QoL. A previous trial showed that emyna was effective in improving depressive symptoms among PwE with a comorbid depressive disorder, but its effects on QoL among PwE without comorbid depression remain unknown.

METHODS

A pragmatic randomized controlled trial was conducted with N = 438 PwE (mean age = 37.5, 70.3% women, physician-verified diagnoses) who were assigned to the intervention group (n = 216), which used emyna alongside treatment as usual (TAU), or the control group (n = 222), which received TAU only. QoL and secondary outcomes such as general self-efficacy, medication adherence, general distress, and epilepsy-related work and social adjustment were assessed at baseline, 3 months, and 6 months. The primary outcome was QoL assessed with the Quality of Life in Epilepsy [QOLIE-31] total score at 3 months post-randomization.

RESULTS

Findings from the intent-to-treat analyses showed that after 3 months, participants in the intervention group experienced significant and clinically relevant improvements in health-related QoL compared to the control group (baseline-adjusted group difference = 4.5; 95% CI = [2.0, 6.9], p < 0.001; Cohen's d = 0.32). Effects on secondary outcomes did not reach statistical significance.

SIGNIFICANCE

This study extends previous research by demonstrating that emyna facilitates improvements in QoL in a diverse group of PwE treated in routine care settings. This CBT-based digital intervention therefore presents a convenient and cost-effective addition to healthcare providers' treatment repertoire.

PLAIN LANGUAGE SUMMARY

In our study, we tested a digital program called emyna, which conveys cognitive behavioral therapy (CBT) techniques to help improve the quality of life for people living with epilepsy. We found that those who used emyna alongside their usual treatments felt better about their quality of life compared to those who did not use the program. Emyna offers a new, convenient way for people with epilepsy to manage their condition, which can be used alongside currently available treatments.

Heterogeneity of Treatment Effects in Internet- and Mobile-Based Interventions for Depression: A Systematic Review and Meta-Analysis

Importance

While the effects of internet- and mobile-based interventions (IMIs) for depression have been extensively studied, no systematic evidence is available regarding the heterogeneity of treatment effects (HTEs), indicating to what extent patient-by-treatment interactions exist and personalized treatment models might be necessary.

Objective

To investigate the HTEs in IMIs for depression as well as their efficacy and effectiveness.

Data Sources

A systematic search in Embase, MEDLINE, Central, and PsycINFO for randomized clinical trials and supplementary reference searches was conducted on October 13, 2019, and updated March 25, 2022. The search string included various terms related to digital psychotherapy, depression, and randomized clinical trials.

Study Selection

Titles, abstracts, and full texts were reviewed by 2 independent researchers. Studies of all populations with at least 1 intervention group receiving an IMI for depression and at least 1 control group were eligible, if they assessed depression severity as a primary outcome and followed a randomized clinical trial (RCT) design.

Data Extraction and Synthesis

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines. Risk of bias was evaluated using the Cochrane Risk of Bias Tool. HTE was investigated using logarithmic variance ratios (lnVR) and effect sizes using Hedges g. Three-level bayesian meta-regressions were conducted.

Main Outcomes and Measures

Heterogeneity of treatment effects was the primary outcome of this study; magnitudes of treatment effect sizes were the secondary outcome. Depression severity was measured by different self-report and clinician-rated scales in the included RCTs.

Results

The systematic review of 102 trials included 19 758 participants (mean [SD] age, 39.9 [10.58] years) with moderate depression severity (mean [SD] in Patient Health Questionnaire-9 score, 12.81 [2.93]). No evidence for HTE in IMIs was found (lnVR = -0.02; 95% credible interval [CrI], -0.07 to 0.03). However, HTE was higher in more severe depression levels (β̂ = 0.04; 95% CrI, 0.01 to 0.07). The effect size of IMI was medium (g = -0.56; 95% CrI, -0.46 to -0.66). An interaction effect between guidance and baseline severity was found (β̂ = -0.24, 95% CrI, -0.03 to -0.46).

Conclusions and Relevance

In this systematic review and meta-analysis of RCTs, no evidence for increased patient-by-treatment interaction in IMIs among patients with subthreshold to mild depression was found. Guidance did not increase effect sizes in this subgroup. However, the association of baseline severity with HTE and its interaction with guidance indicates a more sensitive, guided, digital precision approach would benefit individuals with more severe symptoms. Future research in this population is needed to explore personalization strategies and fully exploit the potential of IMI.

Transference interpretation and psychotherapy outcome: a systematic review of a no-consensus relationship

Despite its well-established importance in psychoanalytic theory, there is a scarcity of empirical evidence on the relationship between a therapist's transference interpretation (TI) and therapeutic outcome. The current scientific literature shows no consensus on the existence and nature of such an association. Therefore, the present study aimed to systematically review the literature on the link between TI and outcomes in psychodynamic psychotherapies. The American Psychological Association PsycInfo, MEDLINE, and the Web of Science Core Collection were selected as the primary databases for the literature search. Studies were included if they measured the frequency/ concentration of TI in psychodynamic psychotherapy [e.g., transference focused psychotherapy (TFP), supportive-expressive therapy] or compared a treatment group (e.g., high in TI and TFP) with a control group (e.g., low in TI supportive therapy) in an adult population with psychiatric symptoms. Out of 825 retrieved abstracts, 25 articles (21 studies) were included in the final synthesis. 13 out of 21 (62%) studies showed a significant improvement in at least one therapy outcome measure following the use of TI. The present systematic review also revealed high heterogeneity across studies in terms of TI measurement, outcome assessment (e.g., psychiatric symptoms, dynamic change, interpersonal functioning, therapeutic alliance), study design (e.g., experimental, quasi-experimental, naturalistic), patient population (e.g., anxiety disorders, personality disorders), and types of treatment (e.g., TFP, supportive-expressive therapy), preventing researchers from asserting solid conclusions. The results strongly highlight the urgent need for highquality research to understand which types of patients, how, and when TIs could be effective throughout the therapy process.

CBT Meets Process: Assimilative Integration with Reference to Group Psychotherapy

This paper offers a brief overview of the historically predominant form of psychotherapy research both for individual and group psychotherapies, the randomized control trial (RCT), and its surrounding controversies and critiques as the backdrop from which new directions in both clinical theory building and research are being pursued, including efforts at building integrative models of treatment. The paper explores one promising integrative model, namely the incorporation of process and dynamic orientations into the province of group cognitive behavioral therapy (CBT) and identifies challenges in implementing this model.

Agreements and differences between psychoanalysts with regard to changes observed during a treatment. A quantitative exploration using the Three-Level Model (3-LM)

The aim of this paper is to report the partial results of an exploratory investigation into how twelve psychoanalysts of different theoretical-clinical orientations perceive and use hypotheses about the phenomena of change in connection with selected material from a psychoanalytic treatment. The Three-Level Model (3-LM) was used for the observation of patient transformations and for the collection of data. This was followed by the statistical analysis of the behaviour and relationship of a set of variables relating to the type and degree of change perceived in the patient's mental functioning during the course of her treatment. The results reported here show that there was significant agreement among the participants, irrespective of their theoretical-clinical orientation, as regards the following: 1) the positive impact of the application of psychoanalytic treatment in diverse areas of the patient's mental functioning; 2) the explanatory hypotheses of the changes observed in the patient under consideration; 3) the usefulness of the experience of group exchange using the 3-LM in observing and understanding the changes in the patient.

Statistical power in clinical trials of interventions for mood, anxiety, and psychotic disorders

BACKGROUND

Previous research has suggested that statistical power is suboptimal in many biomedical disciplines, but it is unclear whether power is better in trials for particular interventions, disorders, or outcome types. We therefore performed a detailed examination of power in trials of psychotherapy, pharmacotherapy, and complementary and alternative medicine (CAM) for mood, anxiety, and psychotic disorders.

METHODS

We extracted data from the Cochrane Database of Systematic Reviews (Mental Health). We focused on continuous efficacy outcomes and estimated power to detect predetermined effect sizes (standardized mean difference [SMD] = 0.20-0.80, primary SMD = 0.40) and meta-analytic effect sizes (ESMA). We performed meta-regression to estimate the influence of including underpowered studies in meta-analyses.

RESULTS

We included 256 reviews with 10 686 meta-analyses and 47 384 studies. Statistical power for continuous efficacy outcomes was very low across intervention and disorder types (overall median [IQR] power for SMD = 0.40: 0.32 [0.19-0.54]; for ESMA: 0.23 [0.09-0.58]), only reaching conventionally acceptable levels (80%) for SMD = 0.80. Median power to detect the ESMA was higher in treatment-as-usual (TAU)/waitlist-controlled (0.49-0.63) or placebo-controlled (0.12-0.38) trials than in trials comparing active treatments (0.07-0.13). Adequately-powered studies produced smaller effect sizes than underpowered studies (B = -0.06, p ⩽ 0.001).

CONCLUSIONS

Power to detect both predetermined and meta-analytic effect sizes in psychiatric trials was low across all interventions and disorders examined. Consistent with the presence of reporting bias, underpowered studies produced larger effect sizes than adequately-powered studies. These results emphasize the need to increase sample sizes and to reduce reporting bias against studies reporting null results to improve the reliability of the published literature.

The RIPI-f (Reporting Integrity of Psychological Interventions delivered face-to-face) checklist was developed to guide reporting of treatment integrity in face-to-face psychological interventions

OBJECTIVES

Intervention integrity is the degree to which the study intervention is delivered as intended. This article presents the RIPI-f checklist (Reporting Integrity of Psychological Interventions delivered face-to-face) and summarizes its development methods. RIPI-f proposes guidance for reporting intervention integrity in evaluative studies of face-to-face psychological interventions.

STUDY DESIGN AND SETTING

We followed established procedures for developing reporting guidelines. We examined 56 documents (reporting guidelines, bias tools, and methodological guidance) for relevant aspects of face-to-face psychological intervention integrity. Eighty four items were identified and grouped as per the template for intervention description and replication (TIDieR) domains. Twenty nine experts from psychology and medicine and other scholars rated the relevance of each item in a single-round Delphi survey. A multidisciplinary panel of 11 experts discussed the survey results in three online consensus meetings and drafted the final version of the checklist.

RESULTS

We propose RIPI-f, a checklist with 50 items. Our checklist enhances TIDieR with important extensions, such as therapeutic alliance, provider's allegiance, and the adherence of providers and participants.

CONCLUSION

RIPI-f can improve the reporting of face-to-face psychological interventions. The tool can help authors, researchers, systematic reviewers, and guideline developers. We suggest using RIPI-f alongside other reporting guidelines.

The efficacy of psychotherapies and pharmacotherapies for mental disorders in adults: an umbrella review and meta-analytic evaluation of recent meta-analyses

Mental disorders represent a worldwide public health concern. Psychotherapies and pharmacotherapies are recommended as first line treatments. However, evidence has emerged that their efficacy may be overestimated, due to a variety of shortcomings in clinical trials (e.g., publication bias, weak control conditions such as waiting list). We performed an umbrella review of recent meta-analyses of randomized controlled trials (RCTs) of psychotherapies and pharmacotherapies for the main mental disorders in adults. We selected meta-analyses that formally assessed risk of bias or quality of studies, excluded weak comparators, and used effect sizes for target symptoms as primary outcome. We searched PubMed and PsycINFO and individual records of the Cochrane Library for meta-analyses published between January 2014 and March 2021 comparing psychotherapies or pharmacotherapies with placebo or treatment-as-usual (TAU), or psychotherapies vs. pharmacotherapies head-to-head, or the combination of psychotherapy with pharmacotherapy to either monotherapy. One hundred and two meta-analyses, encompassing 3,782 RCTs and 650,514 patients, were included, covering depressive disorders, anxiety disorders, post-traumatic stress disorder, obsessive-compulsive disorder, somatoform disorders, eating disorders, attention-deficit/hyperactivity disorder, substance use disorders, insomnia, schizophrenia spectrum disorders, and bipolar disorder. Across disorders and treatments, the majority of effect sizes for target symptoms were small. A random effect meta-analytic evaluation of the effect sizes reported by the largest meta-analyses per disorder yielded a standardized mean difference (SMD) of 0.34 (95% CI: 0.26-0.42) for psychotherapies and 0.36 (95% CI: 0.32-0.41) for pharmacotherapies compared with placebo or TAU. The SMD for head-to-head comparisons of psychotherapies vs. pharmacotherapies was 0.11 (95% CI: -0.05 to 0.26). The SMD for the combined treatment compared with either monotherapy was 0.31 (95% CI: 0.19-0.44). Risk of bias was often high. After more than half a century of research, thousands of RCTs and millions of invested funds, the effect sizes of psychotherapies and pharmacotherapies for mental disorders are limited, suggesting a ceiling effect for treatment research as presently conducted. A paradigm shift in research seems to be required to achieve further progress.

Age of First Exposure to Contact and Collision Sports and Later in Life Brain Health: A Narrative Review

A controversial theory proposes that playing tackle football before the age of 12 causes later in life brain health problems. This theory arose from a small study of 42 retired National Football League (NFL) players, which reported that those who started playing tackle football at a younger age performed worse on selected neuropsychological tests and a word reading test. The authors concluded that these differences were likely due to greater exposure to repetitive neurotrauma during a developmentally sensitive maturational period in their lives. Several subsequent studies of current high school and collegiate contact/collision sports athletes, and former high school, collegiate, and professional tackle football players have not replicated these findings. This narrative review aims to (i) discuss the fundamental concepts, issues, and controversies surrounding existing research on age of first exposure (AFE) to contact/collision sport, and (ii) provide a balanced interpretation, including risk of bias assessment findings, of this body of evidence. Among 21 studies, 11 studies examined former athletes, 8 studies examined current athletes, and 2 studies examined both former and current athletes. Although the literature on whether younger AFE to tackle football is associated with later in life cognitive, neurobehavioral, or mental health problems in former NFL players is mixed, the largest study of retired NFL players (N = 3,506) suggested there was not a significant association between earlier AFE to organized tackle football and worse subjectively experienced cognitive functioning, depression, or anxiety. Furthermore, no published studies of current athletes show a significant association between playing tackle football (or other contact/collision sports) before the age of 12 and cognitive, neurobehavioral, or mental health problems. It is important to note that all studies were judged to be at high overall risk of bias, indicating that more methodologically rigorous research is needed to understand whether there is an association between AFE to contact/collision sports and later in life brain health. The accumulated research to date suggests that earlier AFE to contact/collision sports is not associated with worse cognitive functioning or mental health in (i) current high school athletes, (ii) current collegiate athletes, or (iii) middle-aged men who played high school football. The literature on former NFL players is mixed and does not, at present, clearly support the theory that exposure to tackle football before age 12 is associated with later in life cognitive impairment or mental health problems.

Embracing Scientific Humility and Complexity: Learning "What Works for Whom" in Youth Psychotherapy Research

Clinical psychological scientists have spent decades attempting to understand "what works for whom" in the context of youth psychotherapy, toward the longstanding goal of personalizing psychosocial interventions to fit individual needs and characteristics. However, as the articles in this Special Issue jointly underscore, more than 50 years of psychotherapy research has yet to help us realize this goal. In this introduction to the special issue, we outline how and why "aspiration-method mismatches" have hampered progress toward identifying moderators of youth psychotherapy; emphasize the need to embrace etiological complexity and scientific humility in pursuing new methodological solutions and propose individual and structural strategies for better-aligning clinical research methods with the goal of personalizing mental health care for youth with diverse identities and treatment needs.

The Research-Practice Psychotherapy Wars: The Case of Group Psychotherapy in the Treatment of PTSD

In light of two recent meta-analyses of the efficacy of group psychotherapy in treating posttraumatic stress disorder (PTSD), this article critically reviews the randomized control trial (RCT) generated findings as well as two of its outgrowths-the production of a variety of clinical practice guidelines for treating PTSD and the dissemination efforts to transfer laboratory findings to clinical practice. All three of these activities have received considerable pushback from experienced clinicians and Boulder-identified scientist practitioners, creating an ongoing and entrenched gap or split between researcher and clinician. The article also reviews the various suggestions that have been offered to heal this gap and ending the hegemony of RCT outcome research as the only game in town for declaring what constitutes evidence. Specifically, the literature suggests two primary strategies for helping to realize the scientist-practitioner model and thus advancing the cause of psychotherapy, in general, and group psychotherapy, in particular: (a) leveling the playing field so that both researcher and practitioner have real authority and voices for shaping the field; and (b) shifting the research priority away from a purely outcome focus, asking only does it work, and moving to a more sophisticated, theoretically guided empirical study of process-outcome, examining the how, why, when, and for whom it works.

Validation of the Multidimensional Assessment of Interoceptive Awareness (MAIA-2) questionnaire in hospitalized patients with major depressive disorder

OBJECTIVES

Interoception refers to the sensation, interpretation, and integration of internal somatic signals. Abnormalities in self-reported interoception are prevalent features of major depressive disorder (MDD) and may affect treatment outcomes. In the present study, we investigated the psychometric properties of the revised eight-dimensional and 37-item Multidimensional Assessment of Interoceptive Awareness questionnaire (the MAIA-2) in a severely depressed sample, after translating two updated scales (Not-Distracting, Not-Worrying) into German. Specifically, we examined the measure's internal consistency reliability, sensitivity to change, and minimal important differences (MID) with a focus on patient's antidepressive responses to treatment.

METHODS

The study enrolled 110 participants (age: M = 46.85, SD = 11.23; female: 55.45%) undergoing hospital treatment, of whom 87 were included in the pre-post analysis. Participants completed a German translation of MAIA-2 and the Beck Depression Inventory-II (pre-/post-treatment). Internal consistency reliability was determined by Cronbach's α/McDonalds's ω, sensitivity to change was determined by effect sizes, and MIDs were determined by distribution- (0.5*SD) and anchor-based approaches (mean change method; ROC curve cut-points).

RESULTS

Depression severity reduced over the course of treatment (Median = -65.22%), and 34.48% of patients achieved remission. Reliability was appropriate for post-treatment (range of ω: .70-.90), but questionable for two pre-treatment scales (Noticing: ω = .64; Not-Distracting: ω = .66). The eight dimensions of MAIA-2 were sensitive to change (standardized response mean: .32-.81; Cohen's effect size: .30-.92). Distribution-based MIDs (.38-.61) and anchor-based mean change MIDs (remission vs. partial response: .00-.85; partial response vs. nonresponse: .08-.88) were established on the group level. For six scales, ROC cut-points (remission: .00-1.33; response: -.20-1.00) demonstrated accurate classification to treatment response groups on the individual level.

CONCLUSIONS

This study demonstrated the applicability of the MAIA-2 questionnaire in MDD. The updated version may have led to reliability improvements regarding the revised scales, but subthreshold reliability was evident prior to treatment. The measure's dimensions were sensitive to change. MIDs were established that corresponded with antidepressive treatment outcomes. Our findings are consistent with a growing area of research which considers somatic feelings as key contributors to mental health.

Methodological standards for conducting and reporting meta-analyses: Ensuring the replicability of meta-analyses of pharmacist-led medication review

BACKGROUND

Meta-analyses of clinical pharmacy services are frequently criticized for restricted data transparency and reproducibility.

OBJECTIVES

To describe the methodological characteristics of meta-analyses of pharmacist-led medication reviews, to identify the elements that limit their replicability and robustness, and to propose recommendations for an appropriate conduction and reporting.

METHODS

A meta-research study was conducted. Systematic searches of the PubMed, Scopus, and Web of Science databases were performed to identify meta-analyses of pharmacist services. Meta-analyses assessing the effect of pharmacist-led medication reviews were selected for data extraction, analysis and replication. Two replication exercises were performed for the two most common outcomes: (i) considering the data provided by authors to construct the meta-analysis and (ii) considering the raw data available in the primary studies included. Prediction intervals (PI), fragility index (FI), and number needed to treat (NNT) were also calculated for each replicated meta-analysis.

RESULTS

Nine studies reporting meta-analyses about pharmacist-led medication review were found comprising 30 different outcomes. Eleven meta-analyses, including six for hospital admission and five for mortality, were replicated. In five meta-analyses, the pooled effect sizes of the replicated meta-analyses differed from the original ones. Only four meta-analyses mentioned the statistical method used. Other meta-analytic parameters (e.g., q-value, tau2) were omitted in all studies. In nine meta-analyses, the data from primary studies had been incorrectly extracted for at least one variable. The PI demonstrated that the uncertainty intervals of the effect sizes were always underestimated by the authors. NNTs showed wide intervals, ranging from benefit to harm, in almost all meta-analyses. Nine recommendations to facilitate the replication of a meta-analysis were proposed: providing all original data needed to build the analysis; informing about the imputed data or data obtained from different sources; performing sensitivity analyses for imputed or unpublished data; inform about all the statistical methods used; providing all statistical results; and reporting the PI, FI and NNT.

CONCLUSION

Errors in data extraction and poor reporting of meta-analytic parameters are common in the pharmacy literature. We proposed nine recommendations to enhance data reproducibility and interpretability. Journal editors and peer reviewers should ensure that authors strictly comply with minimum standards for conduction and reporting of meta-analyses.

Cognitive behavioural therapy with exposure and response prevention in the treatment of obsessive-compulsive disorder: A systematic review and meta-analysis of randomised controlled trials

BACKGROUND

Cognitive behavioural therapy (CBT), incorporating exposure and response prevention (ERP) is widely recognised as the psychological treatment of choice for obsessive-compulsive disorder (OCD). Uncertainty remains however about the magnitude of the effect of CBT with ERP and the impact of moderating factors in patients with OCD.

METHOD

This systematic review and meta-analysis assessed randomised-controlled trials of CBT with ERP in patients of all ages with OCD. The study was preregistered in PROSPERO (CRD42019122311). The primary outcome was end-of-trial OCD symptom scores. The moderating effects of patient-related and study-related factors including type of control intervention and risk of bias were examined. Additional exploratory analyses assessed the effects of treatment fidelity and impact of researcher allegiance.

RESULTS

Thirty-six studies were included, involving 2020 patients (537 children/adolescents and 1483 adults) with 1005 assigned to CBT with ERP and 1015 to control conditions. When compared against all control conditions, a large pooled effect size (ES) emerged in favour of CBT with ERP (g = 0.74: 95% CI = 0.51 to 0.97 k = 36), which appeared to diminish with increasing age. While CBT with ERP was more effective than psychological placebo (g = 1.13 95% CI 0.71 to 1.55, k = 10), it was no more effective than other active forms of psychological therapy (g = -0.05: 95% CI -0.27 to 0.16, k = 8). Similarly, whereas CBT with ERP was significantly superior when compared to all forms of pharmacological treatment (g = 0.36: 95% CI 0.7 to 0.64, k = 7), the effect became marginal when compared with adequate dosages of pharmacotherapy for OCD (g = 0.32: 95% CI -0.00 to 0.64, k = 6).A minority of studies (k = 8) were deemed to be at low risk of bias. Moreover, three quarters of studies (k = 28) demonstrated suspected researcher allegiance and these studies reported a large ES (g = 0.95: 95% CI 0.69 to 1.2), while those without suspected researcher allegiance (k = 8) indicated that CBT with ERP was not efficacious (g = 0.02: 95% CI -0.29 to 0.33).

CONCLUSIONS

A large effect size was found for CBT with ERP in reducing the symptoms of OCD, but depends upon the choice of comparator control. This meta-analysis also highlights concerns about the methodological rigor and reporting of published studies of CBT with ERP in OCD. In particular, efficacy was strongly linked to researcher allegiance and this requires further future investigation.

A randomised trial of dialectical behaviour therapy and the conversational model for the treatment of borderline personality disorder with recent suicidal and/or non-suicidal self-injury: An effectiveness study in an Australian public mental health service

OBJECTIVES

Borderline personality disorder is a complex mental disorder that is associated with a high degree of suffering for the individual. Dialectical behaviour therapy has been studied in the largest number of controlled trials for treatment of individuals with borderline personality disorder. The conversational model is a psychodynamic treatment also developed specifically for treatment of borderline personality disorder. We report on the outcomes of a randomised trial comparing dialectical behaviour therapy and conversational model for treatment of borderline personality disorder in a routine clinical setting.

METHOD

Participants had a diagnosis of borderline personality disorder and a minimum of three suicidal and/or non-suicidal self-injurious episodes in the previous 12 months. Consenting individuals were randomised to either dialectical behaviour therapy or conversational model and contracted for 14 months of treatment (n = 162 commenced therapy). Dialectical behaviour therapy involved participants attending weekly individual therapy, weekly group skills training and having access to after-hours phone coaching. Conversational model involved twice weekly individual therapy. Assessments occurred at baseline, mid-treatment (7 months) and post-treatment (14 months). Assessments were conducted by a research assistant blind to treatment condition. Primary outcomes were change in suicidal and non-suicidal self-injurious episodes and severity of depression. We hypothesised that dialectical behaviour therapy would be more effective in reducing suicidal and non-suicidal self-injurious behaviour and that conversational model would be more effective in reducing depression.

RESULTS

Both treatments showed significant improvement over time across the 14 months duration of therapy in suicidal and non-suicidal self-injury and depression scores. There were no significant differences between treatment models in reduction of suicidal and non-suicidal self-injury. However, dialectical behaviour therapy was associated with significantly greater reductions in depression scores compared to conversational model.

CONCLUSION

This research adds to the accumulating body of knowledge of psychotherapeutic treatment of borderline personality disorder and supports the use of both dialectical behaviour therapy and conversational model as effective treatments in routine clinical settings, with some additional benefits for dialectical behaviour therapy for persons with co-morbid depression.

Measuring an individual researcher's impact: new directions and challenges

Metrics which quantify the impact of a scientist are increasingly incorporated into decisions about how to rate and fund individuals and institutions. Several commonly used metrics, based on journal impact factors and citation counts, have been criticised as they do not reliably predict real-world impact, are highly variable between fields and are vulnerable to gaming. Bibliometrics have been incorporated into systems of research assessment but these may create flawed incentives, failing to reward research that is validated, reproducible and with wider impacts. A recent proposal for a new standardised citation metric based on a composite indicator of 6 measures has led to an online database of 100 000 of the most highly cited scientists in all fields. In this perspective article, we provide an overview and evaluation of this new citation metric as it applies to mental health research. We provide a summary of its findings for psychiatry and psychology, including clustering in certain countries and institutions, and outline some implications for mental health research. We discuss strengths and limitations of this new metric, and how further refinements could align impact metrics more closely with wider goals of scientific research.

Let’s Distinguish Relative and Absolute Efficacy to Move Psychotherapy Research Forward

Objective: Background regarding a recent debate between Cuijpers et al. (2019a, b) and the authors (Munder et al. 2019) about the efficacy of psychotherapy for depression is given. Method: A main reason for the discrepancy in Cuijpers et al.'s and our conclusions is discussed. Results: In our view the discrepancy is due, among other things, to a blurred distinction between questions of relative and absolute efficacy of psychotherapy. Although the efficacy of psychotherapy vis-à-vis alternative treatments may be ambiguous, there can be little doubt about the benefits of psychotherapy relative to no treatment. Conclusion: We do not think that raising fundamental concerns about the value of psychotherapy is a service to the field. We argue that moving the field forward requires a focus on how psychotherapy works and how the access to psychotherapy can be increased.

Growth mindsets and psychological distress: A meta-analysis

We investigated if growth mindsets-the belief in the malleable nature of human attributes-are negatively related to psychological distress and if they are positively related to treatment value and active coping. In the meta-analysis, we included articles published between 1988 and 2019, written in English, that reported on mindsets as well as a qualifying dependent variable and included information required to calculate an effect size. With a random effects approach, meta-analytic results (k = 72 samples, N = 17,692) demonstrated that mindsets relate, albeit with minimal effects, to distress, treatment and coping. Specifically, there is a negative relation between growth mindsets and psychological distress (r = -0.220), a positive relation between growth mindsets and treatment value (r = 0.137) and a positive relation between growth mindsets and active coping (r = 0.207). Differences in mindset domain, assessment method of mindsets and timing of assessments moderated effects. There were not differences based on operationalization of psychological distress outcome or sample characteristics (i.e., developmental stage, diagnostic status, ethnicity). We discuss theoretical and practical applications of the findings.

It can't hurt, right? Adverse effects of psychotherapy in patients with depression

Despite growing awareness of occasional adverse effects of psychological treatments, only a few instruments cover side effects and other unwanted effects of psychotherapy. For the present study, the Positive and Negative Effects of Psychotherapy Scale (PANEPS) was evaluated in a population of individuals with depression who had completed at least one course of face-to-face psychotherapy. A total of 135 individuals with a current or previous depressive episode as verified by a diagnostic interview filled out the online version of the PANEPS, which is designed to capture both positive and adverse events. Factor analysis yielded four dimensions: positive effects, side effects, malpractice, and unethical conduct. Internal consistency of the individual subscales was satisfactory to excellent (Cronbach's α: 0.72 and 0.92). Positive effects were reported by virtually all patients (95.6%). At the same time, approximately half of the sample noted at least one adverse event (52.6%). Among these, side effects (38.5%) and malpractice (26.7%) were significantly more prevalent than unethical conduct (8.1%). As expected, positive effects were negatively correlated with adverse events. Our results challenge the common clinical assumption that some degree of destabilization is necessary for symptom improvement. The survey was conducted anonymously, and the sample underwent diagnostic verification. The results indicate a need for improved treatment guidelines and mechanisms to monitor treatment.

Vom Sinn des Verfahrenskonzepts und der Verfahrensvielfalt – und warum das Baukasten-System in der Psychotherapie nicht funktioniert

Why the concept of distinct psychotherapeutic approaches is indispensable - and why the tool box concept of psychotherapy cannot work Background: In Germany, the official psychotherapy guidelines are oriented towards the model of distinct psychotherapeutic approaches. Within the German health care system this also applies to the training in psychotherapy. Some critics, however, are presently pleading in favour of abolishing the model of distinct psychotherapeutic approaches, which also implies to abolish the concept of the so called "Richtlinienverfahren" in Germany - approaches of psychotherapy which proved to be efficacious and whose costs are reimbursed by the insurance companies. Objective: The arguments put forward such as the heterogeneity of the approaches as well as the proposed alternatives, for example, an "integrative" model of both mental disorders and psychotherapeutic treatment are critically discussed. Results: Both the arguments and proposed alternatives are found to be not convincing, neither from a scientific nor from a psychotherapeutic perspective. From a scientific perspective, there is no evidence for efficacy of a "general" or "integrative" model of psychotherapy - which is in contrast to the Richtlinienverfahren for which evidence for efficacy exists. From a psychotherapeutic perspective psychotherapy cannot be taught, learnt and applied by use of tools or modules without a theoretical orientation. Conclusions: The concept of distinct psychotherapeutic approaches proves to be an in dispensable principal for orientation in psychotherapy, for both therapists and patients.

Effectiveness of Dance Movement Therapy in the Treatment of Adults With Depression: A Systematic Review With Meta-Analyses

Background: Depression is the largest cause of mental ill health worldwide. Although interventions such as Dance Movement Therapy (DMT) may offer interesting and acceptable treatment options, current clinical guidelines do not include these interventions in their recommendations mainly because of what is perceived as insufficient research evidence. The 2015 Cochrane review on DMT for depression includes only three studies leading to inconclusive results. In a small and underfunded field such as DMT, expensive multi-centered Randomized Controlled Trials (RCTs) are as yet rare. It is therefore, necessary to not only capture evidence from RCTs, but to also look beyond such designs in order to identify and assess the range of current evidence. Methods: We therefore conducted a systematic review of studies that aimed to explore the effectiveness in the use of DMT with people with depression. This led to a qualitative narrative synthesis. We also performed meta-analyses that calculated the effect size for all included studies, studies with RCT designs only, followed by a subgroup analysis and a sensitivity analysis. In all meta-analyses a random effects model was used with Standardized Mean Differences (SMD) to accommodate for the heterogeneity of studies and outcome measures. Results: From the 817 studies reviewed, eight studies were identified as meeting our inclusion criteria. Three hundred and fifty one people with depression (mild to severe) participated, 192 of whom attended DMT groups while receiving treatment as usual (TAU) and 159 received TAU only. Qualitative findings suggest there was a decrease in depression scores in favor of DMT groups in all studies. Subgroup analysis performed on depression scores before and 3 months after the completion of DMT groups suggested changes in favor of the DMT groups. When sensitivity analysis was performed, RCTs at high risk of bias were excluded, leaving only studies with adult clients up to the age of 65. In these studies, the highest effect size was found favoring DMT plus TAU for adults with depression, when compared to TAU only. Conclusions: Based on studies with moderate to high quality, we concluded that DMT is an effective intervention in the treatment of adults with depression. Furthermore, by drawing on a wide range of designs with diverse quality, we were able to compile a comprehensive picture of relevant trends relating to the use of DMT in the treatment of depression. Despite the fact that there remains a paucity of high-quality studies, the results have relevance to both policy-making and clinical practice, and become a platform for further research.

The evidence-based group-level symptom-reduction model as the organizing principle for mental health care: time for change?

The content and organization of mental health care have been heavily influenced by the view that mental difficulties come as diagnosable disorders that can be treated by specialist practitioners who apply evidence-based practice (EBP) guidelines of symptom reduction at the group level. However, the EBP symptom-reduction model is under pressure, as it may be disconnected from what patients need, ignores evidence of the trans-syndromal nature of mental difficulties, overestimates the contribution of the technical aspects of treatment compared to the relational and ritual components of care, and underestimates the lack of EBP group-to-individual generalizability. A growing body of knowledge indicates that mental illnesses are seldom "cured" and are better framed as vulnerabilities. Important gains in well-being can be achieved when individuals learn to live with mental vulnerabilities through a slow process of strengthening resilience in the social and existential domains. In this paper, we examine what a mental health service would look like if the above factors were taken into account. The mental health service of the 21st century may be best conceived of as a small-scale healing community fostering connectedness and strengthening resilience in learning to live with mental vulnerability, complemented by a limited number of regional facilities. Peer support, organized at the level of a recovery college, may form the backbone of the community. Treatments should be aimed at trans-syndromal symptom reduction, tailored to serve the higher-order process of existential recovery and social participation, and applied by professionals who have been trained to collaborate, embrace idiography and maximize effects mediated by therapeutic relationship and the healing effects of ritualized care interactions. Finally, integration with a public mental health system of e-communities providing information, peer and citizen support and a range of user-rated self-management tools may help bridge the gap between the high prevalence of common mental disorder and the relatively low capacity of any mental health service.

Psychology's Replication Crisis and Clinical Psychological Science

Despite psychological scientists' increasing interest in replicability, open science, research transparency, and the improvement of methods and practices, the clinical psychology community has been slow to engage. This has been shifting more recently, and with this review, we hope to facilitate this emerging dialogue. We begin by examining some potential areas of weakness in clinical psychology in terms of methods, practices, and evidentiary base. We then discuss a select overview of solutions, tools, and current concerns of the reform movement from a clinical psychological science perspective. We examine areas of clinical science expertise (e.g., implementation science) that should be leveraged to inform open science and reform efforts. Finally, we reiterate the call to clinical psychologists to increase their efforts toward reform that can further improve the credibility of clinical psychological science.

"Gold Standards," Plurality and Monocultures: The Need for Diversity in Psychotherapy

For psychotherapy of mental disorders, presently several approaches are available, such as interpersonal, humanistic, systemic, psychodynamic or cognitive behavior therapy (CBT). Pointing to the available evidence, proponents of CBT claim that CBT is the gold standard. Some authors even argue for an integrated CBT-based form of psychotherapy as the only form of psychotherapy. CBT undoubtedly has its strengths and CBT researchers have to be credited for developing and testing treatments for many mental disorders. A critical review, however, shows that the available evidence for the theoretical foundations of CBT, assumed mechanisms of change, quality of studies, and efficacy is not as robust as some researchers claim. Most important, there is no consistent evidence that CBT is more efficacious than other evidence-based approaches. These findings do not justify regarding CBT as the gold standard psychotherapy. They even provide less justification for the idea that the future of psychotherapy lies in one integrated CBT-based form of psychotherapy as the only type of psychotherapy. For the different psychotherapeutic approaches a growing body of evidence is available. These approaches have their strengths because of differences in their respective focus on interpersonal relationships, affects, cognitions, systemic perspectives, experiential, or unconscious processes. Different approaches may be suitable to different patients and therapists. As generally assumed, progress in research results from openness to new ideas and learning from diverse perspectives. Thus, different forms of evidence-based psychotherapy are required. Plurality is the future of psychotherapy, not a uniform "one fits all" approach.

Bias Toward Psychodynamic Therapy: Framing the Problem and Working Toward a Solution

Although psychodynamic therapy (PDT) is an evidence-based intervention for a broad spectrum of psychiatric conditions, there is often notable bias in the way PDT is depicted both in the popular media and in the scientific literature. This has contributed to a negative view of PDT, which hampers both patient access to this treatment and researcher access to funding for further research on PDT. The adverse effects of these distortions and biases are detrimental not only to PDT but also to the overall field of psychotherapy, raising questions about its credibility. Here we summarize current evidence for PDT, describe existing biases, and formulate a set of recommendations to foster a more balanced perspective on PDT.