Responding to COVID-19 threats to trial conduct: lessons learned from a feasibility trial of a psychological intervention for South African adolescents

Project ASPIRE: A feasibility randomized controlled trial of a brief intervention for reducing risk of depression and alcohol-related harms among South African adolescents

OBJECTIVE

Brief interventions could reduce adolescents' risk of depression and alcohol-related harms, but evidence of their feasibility and acceptability for low-and middle-income countries is lacking. To address this gap, we conducted a feasibility trial of the ASPIRE intervention, a four-session multi-component counselling intervention for South African adolescents.

METHOD

We recruited 117 adolescents who met our inclusion criteria. Participants were randomly assigned to the ASPIRE intervention or a comparison condition. Outcomes were assessed at baseline, six-week, and three-month post-randomization time points. Primary outcomes were based on feasibility of study procedures and intervention delivery (assessed on seven predetermined progression criteria). Clinical outcomes (risk of depression and alcohol harms) were secondary.

RESULTS

Despite modifications to all study procedures arising from Covid-19 restrictions, five of the seven key progression criteria were fully met, including: feasibility of data collection and outcome measures, counsellor competencies, randomization and blinding, adverse advents, and acceptability of the intervention. The progression criterion for recruitment and intervention retention were not fully met.

CONCLUSION

Findings suggest that the ASPIRE intervention was generally feasible to deliver and acceptable to adolescents. However, modifications to the trial design and intervention delivery are needed to optimize the validity of a definitive randomized controlled trial of the ASPIRE intervention.

Patient Reported Outcome and Experience Measures (PROMs and PREMs) in substance use disorder treatment services: A scoping review

BACKGROUND

Substance use disorders (SUD) pose significant challenges for healthcare systems, and there is a need to monitor the provision of effective, individualized care to persons accessing treatment. Patient-Reported Outcome Measures (PROMs) and Patient-Reported Experience Measures (PREMs) are increasingly used in healthcare services to measure treatment outcomes and quality of care as perceived by patients, and to guide service improvement.

OBJECTIVES

This review aims to identify and characterize international developments regarding the use and systematic implementation of PROMs and PREMs in SUD treatment services.

METHODS

A scoping review was conducted searching multiple databases to identify studies on the use and routine implementation of PROMs and PREMs in SUD treatment services.

RESULTS

23 articles were selected, all dating from 2016 onwards. There was large variation in the patient-reported measures that were used, how they were developed and how and when patient-reported data were collected. Treatment providers identified leadership support, the presence of an integrated electronic patient record, and regular feedback to be the most important facilitators of successful implementation of patient-reported measures into clinical practice, whilst treatment dropout and burden to staff and patients were the most important barriers to consider.

CONCLUSIONS

PROMs and PREMs are increasingly used in SUD treatment services, but guidance is needed to support researchers and clinicians in selecting and implementing valid, meaningful, and comparable measures if we want to understand the effects of PROM and PREM data collection and feedback on treatment quality and results.

Can learnings from the COVID-19 pandemic improve trial conduct post-pandemic? A case study of strategies used by the DISC trial

Background

RCTs often face issues such as slow recruitment, poor intervention adherence and high attrition, however the 2020/2021 COVID-19 pandemic intensified these challenges. Strategies employed by the DISC trial to overcome pandemic-related barriers to recruitment, treatment delivery and retention may be useful to help overcome routine problems.

Methods

A structured survey and teleconference with sites was undertaken. Key performance indicators in relation to recruitment, treatment delivery and retention were compared descriptively before and after the pandemic started. This was situated also in relation to qualitative opinions of research staff.

Results

Prior to the pandemic, retention was 93.6%. Increased support from the central trial management team and remote data collection methods kept retention rates high at 81.2% in the first 6 months of the pandemic, rising to 89.8% in the subsequent 6 months. Advertising the study to patients resulted in 12.8 patients/month enquiring about participation, however only six were referred to recruiting sites. Sites reported increased support from junior doctors resolved research nurse capacity issues. One site avoided long delays by using theatre space in a private hospital.

Conclusions

Recruitment post-pandemic could be improved by identification of barriers, increased support from junior doctors through the NIHR associate PI scheme and advertising. Remote back-up options for data collection can keep retention high while reducing patient and site burden. To future proof studies against similar disruptions and provide more flexibility for participants, we recommend that RCTs have a back-up option of remote recruitment, a back-up location for surgeries and flexible approaches to collecting data.

Conducting CNS trials during a public health emergency – Lessons learned from the COVID-19 pandemic: A joint ISCTM/ECNP working group consensus paper

A joint working group between the International Society of CNS Clinical Trials and Methodology (ISCTM) and the European College of Neuropsychopharmacology (ECNP) was formed in the latter part of 2020 to explore possible ways to mitigate the impact of Coronavirus disease-19 (COVID-19) in clinical trials while attempting to advance approaches and capabilities to bring new therapeutics to patients. The working group was tasked with developing guidelines for trial design modifications to assist sponsor companies in minimizing risks to data integrity, with a focus on regulatory, technological, operational, and methodological issues related to COVID-19.

To facilitate focused and transferable recommendations, three disease categories were selected as examples to demonstrate the breadth of solutions implemented across CNS clinical trials, as well as ongoing challenges. The categories studied reflected the interests and expertise of the working group, and included neurodegenerative diseases and dementia, mental health disorders, and rare/pediatric diseases. Herein, we describe interim recommendations from the working group as well as priorities for future public health emergencies, to inform permanent adoption in CNS clinical trial development and conduct.

COVID 19—impact on substance use treatment utilization and provision in South Africa

Background

The coronavirus disease 2019 (COVID-19) pandemic has impacted people with substance use disorders (SUDs) worldwide. The aim of this study was to explore, changes in the number of SUD treatment episodes provided during the height of the pandemic and, SUD treatment providers’ perceptions of the impact of COVID-19-related restrictions on people with SUDs and the delivery of SUD treatment services in South Africa.

Methods

We used administrative data collected as part of the South African Community Epidemiology Network on Drug Use (SACENDU) project to assess whether the number of treatment episodes changed during the height of COVID-19 restrictions. We used data from an online survey of SUD treatment providers to assess providers’ perceptions of the impact of COVID-19 on SUD treatment delivery. Eight seven SUD facilities were recruited to participate in the online survey.

Results

Sixty-three organisations (out of a total of 86) participated in the survey, yielding a 73.2% response rate. About half (n = 30; 47.6%) of the sample thought the need for SUD treatment had remained the same or had increased during the COVID-19 lockdown. Half the sample (n = 32; 50.7%) reported decreased availability of SUD services during COVID-19 lockdowns. Participants believed that the lack of services during COVID-19 lockdown impacted negatively on patients that were enrolled in their programmes and on individuals who wished to access the service. Furthermore, changes in service provision seemed to increase patients’ anxiety, exacerbate pre-existing mental health problems and in some cases were thought to precipitate relapse. In addition, patient disengagement and attrition from treatment were thought to have increased during this period. Whilst 47.6% (n = 30) of providers agreed with the value of the alcohol ban, 23.8% (n = 15) of providers thought it had unintended negative consequences.

Conclusion

Based on the findings it is evident that SUD treatment services in South Africa have been significantly affected during the COVID-19 pandemic and more severely during the onset of the pandemic. Together with service providers, more effective ways should be sought on how to feasibly expand access to SUD treatment for all South Africans and enhance the country’s preparedness for future health emergencies.

Transition from an In-Person to Virtual Randomized Controlled Trial for Weight and Fitness Concerns in Active-Duty Service Members: Lessons Learned (Preprint)

BACKGROUND

This paper describes and discusses the transition of and modifications to a weight management randomized controlled trial among active-duty military personnel from an in-person to a virtual format as a result of the COVID-19 pandemic. The original pragmatic cohort-randomized controlled trial was designed to compare the effectiveness of an 8-week group weight management program, ShipShape, to a version of ShipShape enhanced with acceptance and commitment therapy.

OBJECTIVE

The objective of our study was to assess potential differences between in-person and virtual participation in participants' demographics, motivation, confidence, credibility, expectations, and satisfaction with the interventions; we also examined the pragmatics of the technology and participants' experiences in virtual-format intervention groups.

METHODS

A total of 178 active-duty personnel who had failed or were at risk of failing their physical fitness assessment or were overweight or obese were enrolled in the study. In-person (n=149) and virtual (n=29) participants reported demographics, motivation, confidence, credibility, expectations, and satisfaction. Interventionists recorded attendance and participation in the group sessions. Independent-sample 2-tailed t tests and chi-square tests were used to compare the characteristics of the in-person and virtual participants. Pragmatics of the technology and participants' experiences in the virtual format were assessed through surveys and open-ended questions.

RESULTS

Participants were 29.7 (SD 6.9) years old on average, 61.8% (110/178) female, and 59.6% (106/178) White and had an average BMI of 33.1 (SD 3.9) kg/m². Participants were highly motivated to participate and confident in their ability to complete a weight management program. A total of 82.6% (147/178) of all participants attended 5 of the 8 sessions, and participation was rated as "excellent" by interventionists in both formats. The interventions were found to be credible and to have adequate expectations for effectiveness and high satisfaction in both formats. There were no differences between in-person and virtual participants in any of these metrics, other than interventionist-rated participation, for which virtual participants had significantly higher ratings (P<.001). Technical satisfaction with the virtual sessions was rated as "good" to "very good," and participants were satisfied with the content of the virtual sessions. A word cloud of responses identified "mindfulness," "helpful," "different," "food," "binder," and "class" as concepts the virtual participants found most useful about the program.

CONCLUSIONS

Modifications made in response to the COVID-19 pandemic were successful, given the recruitment of active-duty personnel with similar demographic characteristics, attendance levels, and indicators of credibility, expectancy, and satisfaction in the virtual format and the in-person format. This successful transition provides support for the use of virtual or digital weight management interventions to increase accessibility and reach among highly mobile active-duty personnel.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03029507; https://clinicaltrials.gov/ct2/show/NCT03029507.

Virtual World Café Method for Identifying Mental Health Research Priorities: Methodological Case Study

People with lived experience of mental health problems as both consumers and carers can bring significant expertise to the research process. However, the methods used to gather this information and their subsequent results can vary markedly. This paper describes the methods for two virtual World Cafés held to gather data on consumer and carer priorities for mental health research. Several methodological processes and challenges arose during data collection, including the achieved recruitment for each group (n = 4, n = 7) falling significantly short of the target number of 20 participants per group. This led to departures from planned methods (i.e., the use of a single ‘room’, rather than multiple breakout rooms). Despite this, the participants in the virtual World Cafés were able to generate over 200 ideas for research priorities, but not identify agreed-upon priorities. Virtual World Cafés can quickly generate a significant volume of data; however, they may not be as effective at generating consensus.