Clinical Trials to authors: Please pre-register your studies!

Establishing open science research priorities in health psychology: a research prioritisation Delphi exercise

OBJECTIVE

Research on Open Science practices in Health Psychology is lacking. This meta-research study aimed to identify research question priorities and obtain consensus on the Top 5 prioritised research questions for Open Science in Health Psychology.

METHODS AND MEASURES

An international Delphi consensus study was conducted. Twenty-three experts in Open Science and Health Psychology within the European Health Psychology Society (EHPS) suggested research question priorities to create a 'long-list' of items (Phase 1). Forty-three EHPS members rated the importance of these items, ranked their top five and suggested their own additional items (Phase 2). Twenty-four EHPS members received feedback on Phase 2 responses and then re-rated and re-ranked their top five research questions (Phase 3).

RESULTS

The top five ranked research question priorities were: 1. 'To what extent are Open Science behaviours currently practised in Health Psychology?', 2. 'How can we maximise the usefulness of Open Data and Open Code resources?', 3. 'How can Open Data be increased within Health Psychology?', 4. 'What interventions are effective for increasing the adoption of Open Science in Health Psychology?' and 5. 'How can we increase free Open Access publishing in Health Psychology?'.

CONCLUSION

Funding and resources should prioritise the research questions identified here.

Increasing Value and Reducing Waste of Research on Neurofeedback Effects in Post-traumatic Stress Disorder: A State-of-the-Art-Review

Post-Traumatic Stress Disorder (PTSD) is often considered challenging to treat due to factors that contribute to its complexity. In the last decade, more attention has been paid to non-pharmacological or non-psychological therapies for PTSD, including neurofeedback (NFB). NFB is a promising non-invasive technique targeting specific brainwave patterns associated with psychiatric symptomatology. By learning to regulate brain activity in a closed-loop paradigm, individuals can improve their functionality while reducing symptom severity. However, owing to its lax regulation and heterogeneous legal status across different countries, the degree to which it has scientific support as a psychiatric treatment remains controversial. In this state-of-the-art review, we searched PubMed, Cochrane Central, Web of Science, Scopus, and MEDLINE and identified meta-analyses and systematic reviews exploring the efficacy of NFB for PTSD. We included seven systematic reviews, out of which three included meta-analyses (32 studies and 669 participants) that targeted NFB as an intervention while addressing a single condition-PTSD. We used the MeaSurement Tool to Assess systematic Reviews (AMSTAR) 2 and the criteria described by Cristea and Naudet (Behav Res Therapy 123:103479, 2019, https://doi.org/10.1016/j.brat.2019.103479 ) to identify sources of research waste and increasing value in biomedical research. The seven assessed reviews had an overall extremely poor quality score (5 critically low, one low, one moderate, and none high) and multiple sources of waste while opening opportunities for increasing value in the NFB literature. Our research shows that it remains unclear whether NFB training is significantly beneficial in treating PTSD. The quality of the investigated literature is low and maintains a persistent uncertainty over numerous points, which are highly important for deciding whether an intervention has clinical efficacy. Just as importantly, none of the reviews we appraised explored the statistical power, referred to open data of the included studies, or adjusted their pooled effect sizes for publication bias and risk of bias. Based on the obtained results, we identified some recurrent sources of waste (such as a lack of research decisions based on sound questions or using an appropriate methodology in a fully transparent, unbiased, and useable manner) and proposed some directions for increasing value (homogeneity and consensus) in designing and reporting research on NFB interventions in PTSD.

Best (but oft forgotten) statistical practices: Measuring real-world intervention effectiveness using electronic health data

The evidence base supporting the use of most interventions consists primarily of data from randomized controlled trials (RCTs), but how and to whom interventions are delivered in clinical practice may differ substantially from these foundational RCTs. With the increasing availability of electronic health data, it is now feasible to study the "real-world" effectiveness of a wide range of interventions. However, real-world intervention effectiveness studies using electronic health data face many challenges including data quality, selection bias, confounding by indication, and lack of generalizability. In this article, we describe the key barriers to generating high-quality evidence from real-world intervention effectiveness studies and suggest statistical best practices for addressing them.