Comparative clinical trials in psychotherapy: Have large effects been replicated?

Does Researcher Allegiance Bias Outcomes in Psychotherapy Research? A Quasi-Experimental Secondary Analysis

Researchers who conduct studies comparing the efficacy of two treatments often find that their preferred treatment outperforms the comparison treatment. This finding has been labelled the allegiance association. Although this association is robust, it is unclear whether it reflects an allegiance bias on the part of the researchers or whether it is noncausal, with researchers being allied to the more effective treatments. This study applied a quasi-experimental method proposed by a previous study to 19 pairs of treatment comparison studies. Each member of a pair had used the same two psychotherapies to treat clients with the same disorder, but the researchers in each of the two studies had opposing allegiances. If the authors of one study in the pair concluded that their preferred treatment was superior and the authors of the other study concluded that their preferred treatment was superior or that the two treatments were equivalent, these patterns would suggest allegiance bias. In 10 of the 19 pairs, the patterns were consistent with the operation of an allegiance bias, indicating that although allegiance biases are not inevitable, they are ubiquitous. Practitioners and other psychotherapy research consumers should use caution when interpreting the findings from treatment comparison studies.

Negative effects in randomized controlled trials of psychotherapies and psychological interventions: A systematic review

Background: Psychotherapy is a key evidence-based method for the treatment of mental disorders. However, little research has been published on the negative effects of psychotherapies. Aims: We examined this issue through a systematic literature review of previous systematic reviews on randomized controlled trials (RCTs). Methods: We focused on previous reviews and meta-analyses on 1) RCTs examining the effectiveness of psychotherapies and 2) previous reviews and meta-analyses specifically focusing on the negative effects of psychotherapy. We included publications published in PubMed and the Cochrane Databases from the year 2000 or later. Results: Of the 1,430 relevant publications, only a small proportion (30%) mentioned negative outcomes, mostly withdrawal. Only 57 of the extracted original studies monitored potential negative effects, and only three small-scale studies indicated negative effects. Conclusions: The systematic monitoring of negative effects in psychotherapy has not been given the same attention as has been given to the benefits of therapy.

A Pluralistic Perspective on Research in Psychotherapy: Harnessing Passion, Difference and Dialogue to Promote Justice and Relevance

The adoption of a pluralistic perspective on research design, processes of data collection and analysis and dissemination of findings, has the potential to enable psychotherapy research to make a more effective contribution to building a just society. A review of the key features of the concept of pluralism is followed by a historical analysis of the ways in which research in counselling, psychotherapy and related disciplines has moved in the direction of a pluralistic position around knowledge creation. Core principles of a pluralistic approach to research are identified and explored in the context of a critical case study of contemporary research into psychotherapy for depression, examples of pluralistically oriented research practices, and analysis of a pluralistic conceptualisation of the nature of evidence. Implications of a pluralistic perspective for research training and practice are discussed. Pluralistic inquiry that emphasises dialogue, collaboration, epistemic justice and the co-existence of multiple truths, creates opportunities for individuals, families and communities from a wide range of backgrounds to co-produce knowledge in ways that support their capacities for active citizenship and involvement in open democratic decision-making. To fulfil these possibilities, it is necessary for psychotherapy research to be oriented towards social goals that are sufficiently relevant to both researchers and co-participants to harness their passion and work together for a common good.