Are pilot trials useful for predicting randomisation and attrition rates in definitive studies: A review of publicly funded trials

Cerina: cognitive-behavioural therapy-based mobile application for managing GAD symptoms among Ulster University Students in Northern Ireland - a protocol for a pilot feasibility randomised controlled trial

INTRODUCTION

University students are one of the most vulnerable populations for anxiety disorders worldwide. In Northern Ireland, anxiety disorders appear to be more common among the university student population due to the population demographics across the region. Despite the need, these students show less inclination to access the widely available on-campus well-being services and other external professional services. Digital cognitive-behavioural therapy (CBT) aims to bridge this gap between the need for psychological help and access to it. However, challenges such as limited reach, low adoption, implementation barriers and poor long-term maintenance are mainstay issues resulting in reduced uptake of digital CBT. As a result, the potential impact of digital CBT is currently restricted. The proposed intervention 'Cerina' is a scalable CBT-based mobile app with an interactive user interface that can be implemented in university settings if found to be feasible and effective.

METHODS AND ANALYSIS

The study is a single-blind pilot feasibility randomised controlled trial aiming to test the feasibility and preliminary effects of Cerina in reducing Generalised Anxiety Disorder (GAD) symptoms. Participants are 90 Ulster University students aged 18 and above with self-reported GAD symptoms. They will be allocated to two conditions: treatment (ie, access to Cerina for 6 weeks) and a wait-list control group (ie, optional on-campus well-being services for 6 weeks). Participants in the wait-list will access Cerina 6 weeks after their randomisation and participants in both conditions will be assessed at baseline, at 3 (mid-assessment) and 6 weeks (postassessment). The primary outcome is the feasibility of Cerina (ie, adherence to the intervention, its usability and the potential to deliver a full trial in the future). The secondary outcomes include generalised anxiety, depression, worry and quality of life. Additionally, participants in both conditions will be invited to semistructured interviews for process evaluation.

ETHICS AND DISSEMINATION

Ethical approval for the study has been granted by the Ulster University Research Ethics Committee (ID: FCPSY-22-084). The results of the study will be disseminated through publications in scientific articles and presentations at relevant conferences and/or public events.

TRIAL REGISTRATION NUMBER

NCT06146530.

Innovative continuum of care to promote exclusive breast feeding in Pakistan: protocol of a pilot randomised controlled trial

BACKGROUND

Breastmilk being the ideal nutrition from birth to 2 years and beyond has many health benefits for both newborn and mothers. This study will assess the feasibility and acceptability of a continuum of care programme, which is a health facility and community based till 6 months post partum to encourage ideal breastfeeding practices.

METHODS AND ANALYSIS

A pilot randomised control trial having two-parallel arms of intervention and control groups was conducted in gynaecology and obstetrics department of Aziz Bhatti Shaheed Teaching Hospital with a community outreach component of 6 months. 50 women between 28 and 32 weeks of gestation fulfilling inclusion criteria will be allocated in 1:1 randomly into intervention and control groups through computer-generated random number generator software. 25 participants in intervention group will receive counselling and training on breast feeding during antenatal visits along with a family member of support by a trained female doctor within the hospital, at birth by a trained nurse and at home for 6 months by a trained lady health worker. It will be supported by reading materials and videos through a mobile phone WhatsApp application. The 25 participants in control group will receive the support already provided within the hospital and at home. The primary outcomes feasibility and acceptability will be determined at 6 months post partum from participants and providers by a semistructured questionnaire. The secondary outcomes are rates of infant early initiation and exclusive breast feeding at 2 weeks, 1, 3 and 6 months, Infant Feeding Attitude at 1 month and Breastfeeding Self-Efficacy at 3 months. Quantitative and qualitative data will be analysed via SPSS software V.20 and thematic analysis, respectively.

CONCLUSION

This pilot randomised controlled trial (RCT) will guide the interventions for the definite RCT.

ETHICS AND DISSEMINATION

Approved by institutional ethical committee, informed consent from all participants and results will be disseminated in peer-reviewed journal.

TRIAL REGISTRATION NUMBER

NCT05951868.

A review of sample sizes for UK pilot and feasibility studies on the ISRCTN registry from 2013 to 2020

BACKGROUND

Pilot and feasibility studies provide information to be used when planning a full trial. A sufficient sample size within the pilot/feasibility study is required so this information can be extracted with suitable precision. This work builds upon previous reviews of pilot and feasibility studies to evaluate whether the target sample size aligns with recent recommendations and whether these targets are being reached.

METHODS

A review of the ISRCTN registry was completed using the keywords "pilot" and "feasibility". The inclusion criteria were UK-based randomised interventional trials that started between 2013 (end of the previous review) and 2020. Target sample size, actual sample size and key design characteristics were extracted. Descriptive statistics were used to present sample sizes overall and by key characteristics.

RESULTS

In total, 761 studies were included in the review of which 448 (59%) were labelled feasibility studies, 244 (32%) pilot studies and 69 (9%) described as both pilot and feasibility studies. Over all included pilot and feasibility studies (n = 761), the median target sample size was 30 (IQR 20-50). This was consistent when split by those labelled as a pilot or feasibility study. Slightly larger sample sizes (median = 33, IQR 20-50) were shown for those labelled both pilot and feasibility (n = 69). Studies with a continuous outcome (n = 592) had a median target sample size of 30 (IQR 20-43) whereas, in line with recommendations, this was larger for those with binary outcomes (median = 50, IQR 25-81, n = 97). There was no descriptive difference in the target sample size based on funder type. In studies where the achieved sample size was available (n = 301), 173 (57%) did not reach their sample size target; however, the median difference between the target and actual sample sizes was small at just minus four participants (IQR -25-0).

CONCLUSIONS

Target sample sizes for pilot and feasibility studies have remained constant since the last review in 2013. Most studies in the review satisfy the earlier and more lenient recommendations however do not satisfy the most recent largest recommendation. Additionally, most studies did not reach their target sample size meaning the information collected may not be sufficient to estimate the required parameters for future definitive randomised controlled trials.

Pilot Trial Characteristics, Postpilot Design Modifications, and Feasibility of Full-Scale Trials

Importance

Pilot trials often lead to study design changes in subsequent full-scale trials. Yet, it remains unclear whether these modifications improve the feasibility of the larger trial.

Objective

To compare feasibility estimates between pilot and full-scale trials and identify pilot trial characteristics and modifications associated with equivalent or improved feasibility in the full-scale trial.

Design, Setting, and Participants

This cohort study used pilot trials published between January 2005 and December 2018 and their corresponding full-scale trials. PubMed was searched for trials on February 19, 2022.

Exposures

Pilot trial characteristics and postpilot trial design modifications.

Main Outcomes and Measures

The outcome of interest was difference in 3 feasibility parameters: successful screening probability, enrollment rate, and retention probability. These metrics were defined as equivalent or improved if the full-scale trial's estimate was within or exceeding 10% of the pilot trial's estimate.

Results

A total of 249 pairs of pilot and full-scale trials were analyzed, with 43%, 77%, and 82% of full-scale trials having equivalent or improved successful screening probabilities, enrollment rates, and retention probabilities, respectively. When pilot trials used feasibility progression criteria (relative risk [RR], 1.94; 95% CI, 1.02-5.97) and maintained masking for participants (RR, 1.82; 95% CI, 1.04-4.33) or health care practitioners (RR, 1.81; 95% CI, 1.03-3.97) consistent with the full-scale trial, the likelihood of achieving equivalent or improved screening success in full-scale trials increased. Increasing study sites after the pilot was associated with higher likelihood of equivalent or improved enrollment rates (RR, 1.03; 95% CI, 1.01-1.08). Adding extra content to the intervention (RR, 0.82; 95% CI, 0.66-0.98), changing to active control (RR, 0.74; 95% CI, 0.48-0.99), administrating the control treatment more frequently (RR, 0.60; 95% CI, 0.29-0.93), different follow-up lengths (RR, 0.85; 95% CI, 0.73-0.97), and more follow-up visits (RR, 0.86; 95% CI, 0.75-0.98) were associated with lower likelihood of equivalent or improved retention probability in the full-scale trial.

Conclusions and relevance

In this cohort study of pilot and full-scale trial pairs, pilot trial characteristics and postpilot modifications had varying associations with full-scale trial's feasibility. If full-scale trials planned for masking, it was desirable to use it in the pilot. Modifications increasing participant burden might decrease full-scale trial feasibility. Trialists and funders should consider both pilot trial data and proposed design changes when assessing full-scale trials.

Pilot trials may improve the quality of full-scale trials: a meta-research study

OBJECTIVES

Evidence on the value of pilot trials for subsequent trial's quality is scarce. This study aims to determine if a pilot trial improves the quality of the full-scale trial.

STUDY DESIGN AND SETTING

We searched PubMed for pilot trials and their subsequent full-scale trials. The meta-analysis of the full-scale trials was used to identify other full-scale trials on the same research topic but without a pilot trial. Markers of trial quality included publication outcomes and Cochrane Risk of Bias (RoB) assessment.

RESULTS

Fifty-eight full-scale trials with a pilot trial and 151 full-scale trials without were identified from 47 meta-analyses. Trials with a pilot trial were published 0.9 years sooner (mean ± standard deviation: 1.7 ± 1.0 vs. 2.6 ± 2.0, P = 0.005) and in peer-reviewed journals with higher impact factors (60.9 ± 75.0 vs. 24.8 ± 50.3, P < 0.001). A pilot trial's presence was associated with lower risk of bias in full-scale trial random sequence generation (OR [95% CI]: 4.05 [1.27-12.91]), allocation concealment (2.89 [1.07-7.83]), and participants/researchers masking (4.31 [1.37-13.50]), but not outcome assessment masking (1.03 [0.49-2.18]), incomplete outcome data (1.27 [0.47-3.42]), and selective reporting (1.23 [0.44-3.46]).

CONCLUSION

Conducting a pilot trial may enhance the quality of the subsequent full-scale trial.

Results from a randomised controlled pilot study of the Better Conversations with Primary Progressive Aphasia (BCPPA) communication partner training program for people with PPA and their communication partners

BACKGROUND

There has been a growing focus on functional communication interventions for primary progressive aphasia (PPA). These interventions aim to support individuals to participate in life situations. One such intervention, communication partner training (CPT) aims to change conversation behaviours in both the person with PPA and their communication partner (CP). CPT has a growing evidence base in stroke aphasia; however, these programmes are not designed to meet the needs of people with progressive communication difficulties. To address this, the authors developed a CPT program entitled Better Conversations with PPA (BCPPA) and undertook a pilot trial to establish for a future full trial; predicted recruitment rates, acceptability, an assessment of treatment fidelity and an appropriate primary outcome measure.

METHODOLOGY

This was a single-blind, randomised controlled pilot study comparing BCPPA to no treatment, delivered across 11 National Health Service Trusts in the UK. A random sample of eight recordings of local collaborators delivering the intervention were analysed to examine fidelity. Participants completed feedback forms reporting on acceptability. Pre- and post-intervention measures targeted conversation behaviours, communication goals and quality of life.

RESULTS

Eighteen people with PPA and their CPs (9 randomised to BCPPA, 9 randomised to no treatment) completed the study. Participants in the intervention group rated BCPPA positively. Treatment fidelity was 87.2%. Twenty-nine of 30 intervention goals were achieved or over-achieved and 16 of 30 coded conversation behaviours demonstrated change in the intended direction. The Aphasia Impact Questionnaire was identified as the preferred outcome measure.

CONCLUSION

The first randomised controlled UK pilot study of a CPT program for people with PPA and their families demonstrates BCPPA is a promising intervention. The intervention was acceptable, treatment fidelity high and an appropriate measure identified. Results of this study indicate a future RCT of BCPPA is feasible.

TRIAL REGISTRATION

Registered 28/02/2018 ISRCTN10148247 .

Pilot and feasibility studies: extending the conceptual framework

In 2016, we published a conceptual framework outlining the conclusions of our work in defining pilot and feasibility studies. Since then, the CONSORT extension to randomised pilot and feasibility trials has been published and there have been further developments in the pilot study landscape. In this paper, we revisit and extend our framework to incorporate the various feasibility pathways open to researchers, which include internal pilot studies. We consider, with examples, when different approaches to feasibility and pilot studies are more effective and efficient, taking into account the pragmatic decisions that may need to be made. The ethical issues involved in pilot studies are discussed. We end with a consideration of the funders' perspective in making difficult resource decisions to include feasibility work and the policy implications of these; throughout, we provide examples of the uncertainties and compromises that researchers have to navigate to make progress in the most efficient way.

Dropout Rate in Digital Health Interventions for the Prevention of Skin Cancer: Systematic Review, Meta-analysis, and Metaregression

BACKGROUND

Digital strategies are innovative approaches to the prevention of skin cancer, but the attrition following this kind of intervention needs to be analyzed.

OBJECTIVE

The aim of this paper is to assess the dropouts from studies focused on digital strategies for the prevention of skin cancer.

METHODS

We conducted this systematic review with meta-analyses and metaregression according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statements. Search terms for skin cancer, digital strategies, and prevention were combined to search PubMed, Scopus, Web of Science, CINAHL, and Cochrane Library from inception until July 2022. Randomized clinical trials that reported dropouts of participants and compared digital strategies with other interventions to prevent skin cancer in healthy or disease-free participants were included. Two independent reviewers extracted data for analysis. The Revised Cochrane Collaboration Bias tool was employed. We calculated the pooled dropout rate of participants through a meta-analysis of proportions and examined whether dropout was more or less frequent in digital interventions against comparators via an odds ratio (OR) meta-analysis. Data were pooled using a random-effects model. Subgroup meta-analyses were conducted in a meta-analysis of proportions and OR meta-analysis to assess the dropout events when data were sorted by digital interventions or control comparator. A univariate metaregression based on a random-effects model assessed possible moderators of dropout. Participants' dropout rates as pooled proportions were calculated for all groups combined, and the digital and comparator groups separately. OR>1 indicated higher dropouts for digital-based interventions. Metaregressions were performed for age, sex, length of intervention, and sample size.

RESULTS

A total of 17 studies were included. The overall pooled dropout rate was 9.5% (95% CI 5.0-17.5). The subgroup meta-analysis of proportions revealed a dropout rate of 11.6% for digital strategies (95% CI 6.8-19.0) and 10.0% for comparators (95% CI 5.5-17.7). A trend of higher dropout rates for digital strategies was observed in the overall (OR 1.16, 95% CI 0.98-1.36) and subgroup OR meta-analysis, but no significant differences were found between the groups. None of the covariates moderated the effect size in the univariate metaregression.

CONCLUSIONS

Digital strategies had a higher dropout rate compared to other prevention interventions, but the difference was not significant. Standardization is needed regarding reporting the number of and reasons for dropouts.

TRIAL REGISTRATION

International Prospective Register of Systematic Reviews (PROSPERO) CRD42022329669; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=329669.

Dropout rate in randomised controlled trials of balance and gait rehabilitation in multiple sclerosis: is it expected to be different for virtual reality-based interventions? A systematic review with meta-analysis and meta-regression

To assess and meta-analyse the pooled dropout rate from the randomised control trilas that use virtual reality for balance or gait rehabilitation in people with multiple sclerosis. A systematic review of randomised control trials with meta-analysis and meta-regressions was performed. A search was conducted in PubMed, Scopus, Web of Science, the Physiotherapy Evidence Database, the Cochrane Database, CINHAL, LILACS, ScienceDirect, and ProQuest. It was last updated in July 2022. After the selection of studies, a quality appraisal was carried out using the PEDro Scale and the Revised Cochrane risk-of-bias tool for randomised trials. A descriptive analysis of main characteristics and dropout information was performed. An overall proportion meta-analysis calculated the pooled dropout rate. Odds ratio meta-analysis compared the dropout likelihood between interventions. The meta-regression evaluated the influence of moderators related to dropout. Sixteen studies with 656 participants were included. The overall pooled dropout rate was 6.6% and 5.7% for virtual reality and 9.7% in control groups. The odds ratio (0.89, p = 0.46) indicated no differences in the probability of dropouts between the interventions. The number, duration, frequency, and weeks of sessions, intervention, sex, multiple sclerosis phenotype, Expanded Disability Status Scale score, and PEDro score were not moderators (p > 0.05). Adverse events were not reported and could not be analysed as moderators. Dropouts across the virtual reality and control comparators were similar without significant differences. Nonetheless, there is a slight trend that could favour virtual reality. Standardisation in reporting dropouts and adverse events is recommended for future trials. PROSPERO database, registration number ID CRD42021284989.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10055-022-00733-4.

The feasibility of patient-reported outcomes, physical function, and mobilization in the care pathway for head and neck cancer surgical patients

BACKGROUND

Head and neck cancer (HNC) patients are an understudied population whose treatment often includes surgery, causing a wide range of side effects. Exercise prehabilitation is a promising tool to optimize patient outcomes and may confer additional benefits as a prehabilitation tool. The primary objective of this study was to assess the feasibility of measuring patient-reported outcomes (PROs), physical function, and in-hospital mobilization across the HNC surgical timeline in advance of a future prehabilitation trial. The secondary objective was to examine potential changes in these outcomes across the surgical timeline.

METHODS

HNC patients scheduled to undergo oncologic resection with free-flap reconstruction completed assessments of PROs and physical function at three timepoints across the surgical timeline (baseline, in-hospital, and postsurgical/outpatient). Mobilization was measured during the in-hospital period. The feasibility of recruitment and measurement completion was tracked, as were changes in both PROs and physical function.

RESULTS

Of 48 eligible patients, 16 enrolled (recruitment rate of 33%). The baseline and in-hospital PROs were completed by 88% of participants, while the outpatient assessments were completed by 81% of participants. The baseline and in-hospital assessment of physical function were completed by 56% of participants, and 38% completed the outpatient assessment. Measuring in-hospital mobilization was completed for 63% of participants.

CONCLUSION

Measuring PROs and in-hospital mobilization is feasible across the surgical timeline in HNC; however, the in-person assessment of physical function prior to surgery was not feasible. A multidisciplinary collaboration between exercise specialists and clinicians supported the development of new clinical workflows in HNC surgical care that will aid in the implementation of a future prehabilitation trial for this patient population.

Preliminary Effectiveness of mHealth App-Based Pelvic Floor Muscle Training among Pregnant Women to Improve Their Exercise Adherence: A Pilot Randomised Control Trial

This pilot randomised control trial (RCT) aimed to evaluate the feasibility and preliminary effectiveness of conducting a full-powered trial for a newly developed pelvic floor muscle training (PFMT) app among pregnant women with urinary incontinence (UI) in Malaysia. This was a prospective, single-centre, single-blind, parallel, randomised controlled, pilot feasibility study—the Kegel Exercise Pregnancy Training app (KEPT app) trial. In total, 26 pregnant women with urinary incontinence from an urban healthcare clinic were recruited and randomly assigned to either intervention or waitlist control group. The intervention group received the KEPT app, while the control group received usual antenatal care (waitlist control). Of the 26 pregnant women, 16 (61.5%) completed the two-month follow-up. The recruitment rate was 54.2%, and the retention rate was 62.5% in the intervention group and 60% in the control group. There was a significant difference between intervention and control groups’ baseline measurement in the severity of UI (p = 0.031). The app improved their knowledge (p = 0.011) and self-efficacy (p = 0.038) after the first month and attitude (p = 0.034) after two months of intervention, compared with the control group. This study supports the feasibility of our future cluster RCT. The KEPT app demonstrates a promising effect in improving PFMT attitude and self-efficacy and potentially enhancing exercise adherence among pregnant women with UI. Trial registration: This study was prospectively registered on ClinicalTrials.gov on 19 February 2021 (NCT04762433).

Successful Strategies and Areas of Improvement-Lessons Learned from Design and Conduction of a Randomized Placebo-Controlled Trial in Palliative Care, 'Palliative-D'

Clinical trials in palliative care are challenging to design and conduct. Burden on patients should be minimized, while gatekeeping by professionals and next-of kin needs to be avoided. Clinical deterioration due to disease progression affects attrition unrelated to intervention, and different care settings complicate comparisons and reduce the generalizability of the results. The aim of this review is to provide advice for colleagues planning to perform clinical trials in palliative care based on our own experiences from performing the Palliative-D study and by a thorough literature review on this topic. The Palliative-D study was a double-blind trial with 244 randomized patients comparing the effect of vitamin D₃ to placebo in patients with advanced or metastatic cancer in the palliative phase of their disease trajectory who were enrolled in specialized palliative home care teams. Endpoints were opioid and antibiotic use, fatigue, and QoL. Recruitment was successful, but attrition rates were higher than expected, and we did not reach targeted power. For the 150 patients who completed the study, the completeness of the data was exceptionally high. Rather than patient reported pain, we choose the difference in the mean change in opioid dose between groups after twelve weeks compared to baseline as the primary endpoint. In this paper we discuss challenges in palliative care research based on lessons learned from the "Palliative-D" trial regarding successful strategies as well as areas for improvement.

Long-Term Weight Outcomes after Bariatric Surgery: A Single Center Saudi Arabian Cohort Experience

BACKGROUND

Obesity is considered a global chronic disease requiring weight management through lifestyle modification, pharmacotherapy, or weight loss surgery. The dramatic increase in patients with severe obesity in Saudi Arabia is paralleled with those undergoing bariatric surgery. Although known to be beneficial in the short term, the long-term impacts of surgery within this group and the sustainability of weight loss after surgery remains unclear.

OBJECTIVES

We aimed to assess the long-term weight outcomes after bariatric surgery.

SETTING

The study was conducted at King Khalid University Hospital (KKUH), King Saud University Medical City (KSUMC) in Riyadh, Saudi Arabia.

METHODS

An observational prospective cohort study on adult patients with severe obesity undergoing bariatric surgery (sleeve gastrectomy (SG) or Roux-en Y gastric bypass (RYGB)) during the period between 2009 and 2015 was conducted. Weight loss patterns were evaluated pre- and post-surgery through clinical and anthropometric assessments. Absolute weight loss was determined, and outcome variables: percent excess weight loss (%EWL), percent total weight loss (%TWL), and percent weight regain (%WR), were calculated. Statistical analysis using univariate and multivariate general linear modelling was carried out.

RESULTS

A total of 91 (46 males and 45 females) patients were included in the study, with the majority belonging to the SG group. Significant weight reductions were observed at 1 and 3 years of follow-up (p < 0.001) from baseline. The %EWL and %TWL were at their maximum at 3 years (72.4% and 75.8%) and were comparable between the SG and RYGB. Decrements in %EWL and %TWL and increases in %WR were seen from 3 years onwards from bariatric surgery until the study period ended. The yearly follow-up attrition rate was 20.8% at 1 year post-surgery, 26.4% at year 2, 31.8% at year 3, 47.3% at year 4, 62.6% at year 5, and 79.1% at end of study period (at year 6).

CONCLUSION

The major challenge to the successful outcome of bariatric surgery is in maintaining weight loss in the long-term and minimizing weight regain. Factors such as the type of surgery and gender need to be considered before and after surgery, with an emphasis on the need for long-term follow-up to enssure the optimal benefits from this intervention.

Culturally adapted family intervention for schizophrenia in Pakistan: a feasibility study

OBJECTIVES

To establish feasibility and acceptability of a Culturally adapted Family Intervention (CulFI) that was developed using an empirically derived conceptual framework in Pakistan.

METHODS

A rater-blind, randomised trial to evaluate the feasibility and acceptability of delivering CulFI compared to treatment as usual in Karachi, Pakistan. Indicators of feasibility included evaluation of recruitment rates, retention and randomisation. We also evaluated the acceptability of the intervention and trial procedures.

RESULTS

Excellent recruitment and retention rates informed the feasibility of the intervention. CulFI had more than a 90% participant attendance of 8-10 sessions and retained more than 90% who commenced in the intervention. Eighty percent of those who initially provided consent were willing to be randomised and the quality of CulFI was rated as good to excellent by 85.7% of participants.

CONCLUSIONS

Importantly, this study determines that pathways into a psychosocial intervention can be established in Pakistan. A combination of factors contribute to low levels of access to psychiatric care including different explanatory models of illness, small numbers of trained staff, limited resources and reliance on traditional healers. These results support the feasibility, acceptability and merit of conducting a full-scale trial of CulFI in comparison with standard care.ClinicalTrials.gov Identifier: NCT02167347KEY POINTSThe significant treatment gap in LMICs leaves families providing much of the care for people with schizophrenia.There is limited evidence from LMICs supporting the effectiveness and feasibility of psychosocial interventions more broadly, and family interventions specifically.This study adds to the scarce literature and demonstrates that pathways into delivering psychosocial interventions can be established in Pakistan.The results of this trial support the feasibility and acceptability of a Culturally adapted Family Intervention (CulFI) for schizophrenia patients and their families in PakistanA full-scale trial of CulFI in comparison with standard care is warranted to determine clinical and cost-effectiveness.

A Brief Psychological Intervention for Chronic Pain in Primary Care: A Pilot Randomized Controlled Trial

OBJECTIVE

Although evidence-based psychological interventions improve chronic pain, many patients do not engage in behavioral health services. Offering a brief intervention in a medical setting may provide benefits to patients with chronic pain. The purpose of this study was to examine preliminary outcomes of a brief psychological intervention for chronic pain delivered in primary care.

DESIGN

Pilot randomized controlled trial.

SETTING

Primary care clinic.

SUBJECTS

Sixty participants with chronic pain were randomized to a 5-session psychological intervention or treatment-as-usual control group.

METHODS

Participants completed pre- and post-intervention measures assessing pain severity, pain interference, pain catastrophizing, depression, and anxiety.

RESULTS

Most participants (76.7%) randomized to the intervention completed all sessions. Compared to the control group, those in the intervention had decreases in pain severity (P = .048), pain catastrophizing (P = .04), and depression (P = .01) from pre- to post-intervention. Within the intervention group, there was a significant improvement in pain interference scores (P = 0.02). Within the intervention group, effect sizes were medium to large for changes in pain severity, pain interference, pain catastrophizing, and depression scores. There were no significant changes in anxiety scores.

CONCLUSION

Results suggest that delivery of a brief psychological intervention for chronic pain in primary care appears to offer improvements in pain severity, pain interference, pain catastrophizing, and depression. Findings suggest that shorter-term psychological interventions may offer similar benefits as longer-term ones. Furthermore, offering a brief intervention in primary care may increase access and engagement in behavioral pain management services. Future research should examine this through a fully-powered trial with longer-term outcomes.

Healthy Parent Carers: feasibility randomised controlled trial of a peer-led group-based health promotion intervention for parent carers of disabled children

Background

Parent carers of children with special educational needs or disability are at higher risk of poor mental and physical health. The need for a tailored, peer-led group programme was raised by parent carers, who co-developed the Healthy Parent Carers programme with researchers. This study aimed to test the feasibility of programme delivery in community settings, and the feasibility and acceptability of a randomised controlled trial design.

Methods

Participants were individually randomised with concealed allocation to a structured group programme and access to online resources (intervention), or access to the online resources only (control). Measures of wellbeing and secondary and economic outcomes were collected before randomisation, immediately post-intervention, and 6 months post-intervention. Descriptive statistics on recruitment and attrition, demographics, attendance, and fidelity of intervention delivery were analysed with feedback on the acceptability of the trial design.

Results

One hundred and ninety-three parent carers expressed an interest in taking part. Ninety-two participants recruited from across six sites were randomised (47 intervention, 45 control). Lead and assistant facilitators were trained and delivered the group sessions. Sixteen (34%) participants in the intervention arm did not attend any sessions, and attendance varied across sites and sessions. One participant withdrew post-randomisation, and 83 (90%) participants completed outcome measures at the six-month follow-up.

Conclusions

The study demonstrated that it was feasible to deliver the programme in community settings. The number of parent carers who expressed interest signifies the need for such a programme and the feasibility of recruiting to a definitive trial. Loss to follow-up was low. Further research is needed to explore ways to reduce barriers to participation in person and assess the feasibility and acceptability of programme content and delivery for more ethnically diverse groups, and potentially using interpreters. Given the Covid-19 pandemic and delivery format feedback, there is also a need to investigate remote or blended delivery strategies. Although the results indicate that a definitive trial is feasible, programme impact would be strengthened through exploration of these uncertainties.

Trial registration

ISRCTN, ISRCTN15144652, registered on 25 October 2018, ClinicalTrials.gov, NCT03705221, registered on 15 October 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-021-00881-5.

A hypothesis test of feasibility for external pilot trials assessing recruitment, follow-up, and adherence rates

The power of a large clinical trial can be adversely affected by low recruitment, follow-up, and adherence rates. External pilot trials estimate these rates and use them, via prespecified decision rules, to determine if the definitive trial is feasible and should go ahead. There is little methodological research underpinning how these decision rules, or the sample size of the pilot, should be chosen. In this article we propose a hypothesis test of the feasibility of a definitive trial, to be applied to the external pilot data and used to make progression decisions. We quantify feasibility by the power of the planned trial, as a function of recruitment, follow-up, and adherence rates. We use this measure to define hypotheses to test in the pilot, propose a test statistic, and show how the error rates of this test can be calculated for the common scenario of a two-arm parallel group definitive trial with a single normally distributed primary endpoint. We use our method to redesign TIGA-CUB, an external pilot trial comparing a psychotherapy with treatment as usual for children with conduct disorders. We then extend our formulation to include using the pilot data to estimate the standard deviation of the primary endpoint and incorporate this into the progression decision.

Bayesian design and analysis of external pilot trials for complex interventions

External pilot trials of complex interventions are used to help determine if and how a confirmatory trial should be undertaken, providing estimates of parameters such as recruitment, retention, and adherence rates. The decision to progress to the confirmatory trial is typically made by comparing these estimates to pre-specified thresholds known as progression criteria, although the statistical properties of such decision rules are rarely assessed. Such assessment is complicated by several methodological challenges, including the simultaneous evaluation of multiple endpoints, complex multi-level models, small sample sizes, and uncertainty in nuisance parameters. In response to these challenges, we describe a Bayesian approach to the design and analysis of external pilot trials. We show how progression decisions can be made by minimizing the expected value of a loss function, defined over the whole parameter space to allow for preferences and trade-offs between multiple parameters to be articulated and used in the decision-making process. The assessment of preferences is kept feasible by using a piecewise constant parametrization of the loss function, the parameters of which are chosen at the design stage to lead to desirable operating characteristics. We describe a flexible, yet computationally intensive, nested Monte Carlo algorithm for estimating operating characteristics. The method is used to revisit the design of an external pilot trial of a complex intervention designed to increase the physical activity of care home residents.

Coaching While Waiting for Autism Spectrum Disorder Assessment: Protocol of a Pilot Feasibility Study for a Randomized Controlled Trial on Occupational Performance Coaching and Service Navigation Support

BACKGROUND

In Australia, the average time between a first concern of autism spectrum disorder (ASD) and diagnosis is over 2 years. After referral for assessment, families often wait 6-12 months before their appointment. This can be a time of uncertainty and stress for families. For some families, other forms of assistance are not accessible and thus timely intervention opportunities are missed. There is little evidence about how to provide the best support for children or caregivers while on assessment waiting lists.

OBJECTIVE

The aim of this study is to determine whether use of a coaching intervention called Occupational Performance Coaching (OPC) combined with service navigation support is feasible for families waiting for ASD assessment, as a crucial first step in planning a randomized controlled trial.

METHODS

A pilot and feasibility study will be conducted using recommended constructs and associated measures, which will be reported using CONSORT (Consolidated Standards or Reporting Trials) guidance. Participants will be child and caregiver dyads or triads, recruited within 4 months of their child (aged 1-7 years) being referred to one of two services for an ASD assessment in Victoria, Australia. A blinded randomization procedure will be used to allocate participants to one of three trial arms: (1) coaching and support intervention delivered face to face, (2) coaching and support intervention via videoconference, and (3) usual care. Descriptive statistics will be used to describe the sample characteristics of parents and children, inclusive of service access at baseline and follow up. Recruitment rates will be reported, and retention rates will be evaluated against a predicted rate of 70%-80% in each intervention arm. Goal attainment, using the Canadian Occupational Performance Measure, will indicate preliminary evidence for efficacy within the intervention arms, with an increase of 2 or more points on a 10-point performance and satisfaction scale considered clinically significant.

RESULTS

The study was approved by The Royal Children's Hospital Research Ethics and Governance Department in September 2018. As of October 2020, 16 families have been recruited to the study. Data analysis is ongoing and results are expected to be published in 2021.

CONCLUSIONS

Study findings will support planning for a future randomized controlled trial to assess the efficacy of OPC and service navigation support for caregivers of children awaiting ASD assessment.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12620000164998; www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378793&isReview=true.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/20011.

Feasibility study for supporting medication adherence for adults with cystic fibrosis: mixed-methods process evaluation

OBJECTIVES

To undertake a process evaluation of an adherence support intervention for people with cystic fibrosis (PWCF), to assess its feasibility and acceptability.

SETTING

Two UK cystic fibrosis (CF) units.

PARTICIPANTS

Fourteen adult PWCF; three professionals delivering adherence support ('interventionists'); five multi-disciplinary CF team members.

INTERVENTIONS

Nebuliser with data recording and transfer capability, linked to a software platform, and strategies to support adherence to nebulised treatments facilitated by interventionists over 5 months (± 1 month).

PRIMARY AND SECONDARY MEASURES

Feasibility and acceptability of the intervention, assessed through semistructured interviews, questionnaires, fidelity assessments and click analytics.

RESULTS

Interventionists were complimentary about the intervention and training. Key barriers to intervention feasibility and acceptability were identified. Interventionists had difficulty finding clinic space and time in normal working hours to conduct review visits. As a result, fewer than expected intervention visits were conducted and interviews indicated this may explain low adherence in some intervention arm participants. Adherence levels appeared to be >100% for some patients, due to inaccurate prescription data, particularly in patients with complex treatment regimens. Flatlines in adherence data at the start of the study were linked to device connectivity problems. Content and delivery quality fidelity were 100% and 60%-92%, respectively, indicating that interventionists needed to focus more on intervention 'active ingredients' during sessions.

CONCLUSIONS

The process evaluation led to 14 key changes to intervention procedures to overcome barriers to intervention success. With the identified changes, it is feasible and acceptable to support medication adherence with this intervention.

TRIAL REGISTRATION NUMBER

ISRCTN13076797; Results.

Use of a modified mandibular splint to reduce nocturnal symptoms in persons with post-traumatic stress disorder

OBJECTIVE

Based on a series of clinical observations that a thicker mandibular splint than that commonly used to treat bruxism and related craniomandibular myofascial pain reduced post-traumatic stress disorder (PTSD) nocturnal symptomatology (sleep disruptions, headaches, and nightmares), this study of 100 PTSD participants was undertaken to systematically establish 'proof of concept' of the therapeutic effectiveness of this modified splinting procedure.

METHODS

Following the fabrication of splints thicker than those conventionally used, the effectiveness of this new procedure used by dentists was determined by comparing the self-reported frequency and intensity/severity of PTSD symptomatology during a seven-night pretreatment baseline period without the splint with a second seven-night period in which the modified splint was inserted. The scoring for the three dependent measures (sleep disruptions, headaches, and nightmares) was based on the frequencies on a scale from 0-7 multiplied by the intensity/severity on a scale of 1-10.

RESULTS

Compared with the pre-splint baseline period, the insertion of the thickened splint resulted in a highly significant reduction of sleep disruption, nocturnal headaches, and nightmares. A second seven-night control period without the splint was followed by a second seven-night period with the splint, reproducing the effectiveness of the first splinting period.

CONCLUSION

The results of this study provide the first systematic, documented proof of concept of the effectiveness of a modified splinting procedure in reducing key nocturnal symptoms in PTSD patients.

HALT (Hernia Active Living Trial): protocol for a feasibility study of a randomised controlled trial of a physical activity intervention to improve quality of life in people with bowel stoma with a bulge/parastomal hernia

BACKGROUND

Parastomal hernia (PSH) can be repaired surgically, but results to date have been disappointing, with reported recurrence rates of 30 to 76%. Other types of intervention are therefore needed to improve the quality of life of people with PSH. One potential intervention is physical activity. We hypothesise that the intervention will increase core activation and control across the abdominal wall at a site of potential weakness and thus reduce the risk of PSH progression. Increases in physical activity will improve body image and quality of life (QoL).

METHODS

Subjects and sampleThere were approximately 20 adults with a bowel stoma and PSH. People with previous PSH repair will be excluded as well as people who already do core training.Study designThis is a feasibility study of a randomised controlled trial with 2 months follow-up, in 2 sites using mixed methods. Stage 1 involves intervention development and in stage 2, intervention and trial parameters will be assessed.InterventionA theoretically informed physical activity intervention was done, targeting people with PSH.Main outcome of feasibility studyThe main outcome is the decision by an independent Study Steering Committee whether to proceed to a full randomised controlled trial of the intervention.Other outcomesWe will evaluate 4 intervention parameters-fidelity, adherence, acceptability and safety and 3 trial parameters (eligible patients' consent rate, acceptability of study design and data availability rates for following endpoints): I.Diagnosis and classification of PSHII.Muscle activationIII.Body composition (BMI, waist circumference)IV.Patient reported outcomes: QoL, body image and physical functioningV.Physical activity;VI.Psychological determinants of physical activityOther dataIncluded are other data such as interviews with all participants about the intervention and trial procedures.Data analysis and statistical powerAs this is a feasibility study, the quantitative data will be analysed using descriptive statistics. Audio-recorded qualitative data from interviews will be transcribed verbatim and analysed thematically.

DISCUSSION

The feasibility and acceptability of key intervention and trial parameters will be used to decide whether to proceed to a full trial of the intervention, which aims to improve body image, quality of life and PSH progression.

TRIAL REGISTRATION

ISRCTN15207595.

Lifestyle Matters Randomized Controlled Trial of a Preventive Health Intervention for Older People: Qualitative Sub Study with Participants and Intervention Facilitators

OBJECTIVE

This qualitative study embedded within a randomized controlled trial was conducted to explore the acceptability, experiences of, and short-term impact of a preventive health intervention (Lifestyle Matters) from the perspectives of those who took part, and to uncover any evidence for the theorised mechanisms of action (improved participation and self efficacy) underpinning the intervention. It was also conducted to help explain the quantitative trial results.

METHODS

A purposive sample of 13 trial participants who had been randomized to receive the Lifestyle Matters intervention (approximately 10%) were individually qualitatively interviewed immediately following their involvement. All four intervention facilitators were also individually interviewed.

RESULTS

Evidence of the hypothesized behavioural changes could be identified within the interview data, demonstrating the potential of this intervention. However, lack of adherence to the overall intervention eroded receipt of benefit. This finding complements the quantitative trial results which found that the study had failed to recruit those who considered themselves to be at risk of age-related decline.

CONCLUSION

This form of preventive health intervention requires proactive identification of those who recognise the need to make lifestyle changes. This is difficult if reactive health and social care systems are the main referral routes. The methodological approaches taken towards the study of complex interventions requires reconsideration if potential benefits are to be accurately assessed.

CLINICAL TRIAL REGISTRATION

ISRCTN67209155.

The association of working alliance, outcome expectation, adherence and self-efficacy with clinical outcomes for Achilles tendinopathy: A feasibility cohort study (the MAP study)

INTRODUCTION

This study evaluated the feasibility of a large longitudinal cohort study utilizing an online platform to investigate the association and predictive relationship of working alliance, outcome expectations, adherence and self-efficacy with outcome in Achilles tendinopathy. The objectives were: (1) to determine the recruitment and retention rate and (2) to carry out preliminary data analysis of the selected variables and clinical outcomes.

METHODS

A multi-centred, longitudinal feasibility cohort study was used. Eligible participants were directed to a bespoke online platform hosting study information and the outcome measures in the form of an online questionnaire. Responses from the online questionnaire were collected on three occasions: at baseline, at 6 and at 12 weeks following completion of the first questionnaire. Feasibility outcomes (recruitment and retention rates) were described using descriptive statistics.

RESULTS

The website recorded a total 55 views. These 55 views resulted in 24 participants consenting to join the study. The questionnaire at baseline was started 63 times and completed on 60 separate occasions resulting in a 95% conversion rate. Retainment for completion of the questionnaire for a second time was 83.3% and for the third time was 66.6%. All questionnaires were completed fully yielding a missing data indicator of 0%.

CONCLUSIONS

Feasibility studies ask the question 'can this be done'? Based on the data from recruitment and rates and exploratory correlation analysis a future study can be done; this previously untested online platform appears feasible, but changes could be useful before proceeding to a much larger study.

Pilot study to inform young adults about the risks of electronic cigarettes through text messaging

INTRODUCTION

Young adults are rapidly adopting electronic cigarette (e-cigarette) use. The popularity of e-cigarettes among young people can be attributed to heavy industry advertising and misleading health claims. Data indicate that young e-cigarette users who have never used conventional cigarettes may transition toward smoking combustible cigarettes. Communicating e-cigarette risks via text messaging is limited. This pilot study assessed the impact of exposure to 16 text messages on e-cigarette knowledge and risk perception. The short text messages delivered to participants conveyed e-cigarette use may lead to addiction to nicotine and explained the latest health-related findings.

METHODS

A two-group randomized pretest and posttest study was conducted among 95 racially, ethnically diverse young adults recruited from vocational training programs. Fifty percent of participants were randomized to receive either gain- or loss-framed messages. Knowledge and risk perceptions about e-cigarettes and tobacco use were assessed pre- and post-message exposure.

RESULTS

Participants had a mean age of 20.8 years, SD = 1.7. Current use of e-cigarettes was reported by 10.5% (10/95) and 27.4% (26/95) used a variety of other tobacco products. Findings revealed significant increases in knowledge about e-cigarettes after exposure to the messages (range for ps: p < 04 to p < 0.0001). A statistically significant increase in perceived e-cigarette risk was found post-exposure (p = 0.002). Participants randomized to gain-framed messages reported a significantly higher perceived risk of using e-cigarettes post-exposure than did those who received loss-framed messages (p = 0.02).

CONCLUSIONS

This was a small-scale pilot requiring additional evidence to support the effectiveness of text messaging for increasing e-cigarette knowledge and risk perception. Future research may apply text messages to test new ways to educate young populations about tobacco use and consider addressing these messages to specific subgroups at high risk of use such as non-college bound young adults.

The use of brain functional magnetic resonance imaging to determine the mechanism of action of gabapentin in managing chronic pelvic pain in women: a pilot study

OBJECTIVE

To inform feasibility and design of a future randomised controlled trial (RCT) using brain functional MRI (fMRI) to determine the mechanism of action of gabapentin in managing chronic pelvic pain (CPP) in women.

DESIGN

Mechanistic study embedded in pilot RCT.

SETTING

University Hospital.

PARTICIPANTS

Twelve women (18-50 years) with CPP and no pelvic pathology (follow-up completed March 2014).

INTERVENTION

Oral gabapentin (300-2700 mg) or matched placebo.

OUTCOME MEASURES

After 12 weeks of treatment, participants underwent fMRI of the brain (Verio Siemens 3T MRI) during which noxious heat and punctate stimuli were delivered to the pelvis and arm. Outcome measures included pain (visual analogue scale), blood oxygen level dependent signal change and a semi-structured acceptability questionnaire at study completion prior to unblinding.

RESULTS

Full datasets were obtained for 11 participants. Following noxious heat to the abdomen, the gabapentin group (GG) had lower pain scores (Mean: 3.8 [SD 2.2]) than the placebo group (PG) (Mean: 5.8 [SD 0.9]). This was also the case for noxious heat to the arm with the GG having lower pain scores (Mean: 2.6 [SD 2.5]) than the PG (Mean: 6.2 [SD 1.1]). Seven out of 12 participants completed the acceptability questionnaire. 71% (five out of seven) described their participation in the fMRI study as positive; the remaining two rated it as a negative experience.

CONCLUSIONS

Incorporating brain fMRI in a future RCT to determine the mechanism of action of gabapentin in managing CPP in women was feasible and acceptable to most women.

TRIAL REGISTRATION NUMBER

ISRCTN70960777.

A novel cognitive behavioural intervention with Theory of Mind (ToM) training for children with epilepsy: protocol for a case series feasibility study

BACKGROUND

Children with epilepsy have significant social impairments, yet evidence-based interventions to address these social difficulties are lacking. Emerging research has shown that social difficulties in children with epilepsy relate to underlying impairments in Theory of Mind (ToM). This paper outlines the protocol for a pilot study that will evaluate the feasibility, acceptability, and efficacy of a novel cognitive behavioural intervention with ToM training for children with epilepsy.

METHODS

The intervention will be evaluated in a single-arm case series feasibility study. Ten to 12 children with common forms of epilepsy (8 to 12 years old) will be recruited to participate in 4 small group workshops, held over 4 consecutive weeks. Parents will attend a brief review at the end of each session with their child. Children will complete 4 one-to-one assessments with an investigator assessing ToM and social competence: twice at baseline (4 weeks and 1 day before the intervention), at post-intervention (last day of the intervention) and at follow-up (4 weeks post intervention). Parents will complete online questionnaires at these same 4 time points assessing ToM and social competence of their child. Parents and children will both complete a weekly measure of social competence from baseline 1 to follow-up. Following completion of the intervention, parents will complete two standardised questionnaires assessing treatment acceptability and barriers and facilitators to attendance; children will complete a single questionnaire on treatment acceptability. Information about feasibility outcomes (i.e. recruitment and retention, processing time, suitability of tasks) will be gathered by investigators during the trial. Together, outcomes will be used to refine research methods and make a decision about whether the intervention should be evaluated in a larger scale trial.

DISCUSSION

To our knowledge, this is the first psychosocial intervention to address social competence problems in children with epilepsy. Findings will provide information about a potentially effective treatment that could improve longer term social outcomes for this group.

TRIAL REGISTRATION

Australia and New Zealand Clinical Trials Register (ANZCTR): ACTRN12618000974202, registered June 8 2018.

Role of feasibility and pilot studies in randomised controlled trials: a cross-sectional study

OBJECTIVES

To assess the value of pilot and feasibility studies to randomised controlled trials (RCTs) funded by the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme. To explore the methodological components of pilot/feasibility studies and how they inform full RCTs.

STUDY DESIGN

Cross-sectional study.

SETTING

Both groups included NIHR HTA programme funded studies in the period 1 January 2010-31 December 2014 (decision date). Group 1: stand-alone pilot/feasibility studies published in the HTA Journal or accepted for publication. Group 2: all funded RCT applications funded by the HTA programme, including reference to an internal and/or external pilot/feasibility study. The methodological components were assessed using an adapted framework from a previous study.

MAIN OUTCOME MEASURES

The proportion of stand-alone pilot and feasibility studies which recommended proceeding to full trial and what study elements were assessed. The proportion of 'HTA funded' trials which used internal and external pilot and feasibility studies to inform the design of the trial.

RESULTS

Group 1 identified 15 stand-alone pilot/feasibility studies. Study elements most commonly assessed were testing recruitment (100% in both groups), feasibility (83%, 100%) and suggestions for further study/investigation (83%, 100%). Group 2 identified 161 'HTA funded' applications: 59 cited an external pilot/feasibility study where testing recruitment (50%, 73%) and feasibility (42%, 73%) were the most commonly reported study elements: 92 reported an internal pilot/feasibility study where testing recruitment (93%, 100%) and feasibility (44%, 92%) were the most common study elements reported.

CONCLUSIONS

'HTA funded' research which includes pilot and feasibility studies assesses a variety of study elements. Pilot and feasibility studies serve an important role when determining the most appropriate trial design. However, how they are reported and in what context requires caution when interpreting the findings and delivering a definitive trial.