Where have all the pilot studies gone? A follow-up on 30 years of pilot studies in Clinical Rehabilitation

Associations between oral health impacts attributed to malocclusion and normative and self-perceived orthodontic treatment need in Turkish adolescent patients

BACKGROUND

In the socio-dental approach, the integration of normative oral health-related quality of life (OHRQoL) and behavioral propensity measures should be considered when assessing treatment needs and planning oral services. Therefore, this study aimed to evaluate the relationship between oral health impacts attributed to malocclusion and normative and self-perceived orthodontic treatment needs in adolescent patients and to determine the clinical, sociodemographic, and behavioral factors affecting their OHRQoL.

METHODS

This cross-sectional study was conducted using a convenience sample size of 105 adolescent patients aged 11-14 years who were referred to the Orthodontics Clinic in the Faculty of Dentistry, Istanbul. Data were collected using clinical examinations and a self-reported questionnaire, including the condition-specific Child Oral Impact on Daily Performances (CS-COIDP) attributed to malocclusion and sociodemographic, clinical, and behavioral factors. The index of complexity, outcome, and need (ICON), gingival index, and Decayed, Missing, Filled Teeth index was used to assess oral health status. Descriptive statistics and bivariate and multivariate regression analyses were used for the data analyses.

RESULTS

A total of 70 patients (66.7%) reported at least one impact. Furthermore, 47% of the adolescents had very difficult and difficult complexity grades. The most affected performances were "emotional (52.4%) and smiling (40%)". No significant differences were found in the total CS-COIDP scores according to caries experience; however, the gingival status was associated with the total OHRQoL. Lower tooth brushing frequency, increased malocclusion complexity, and subjective treatment need were the most important predictors of worse OHRQoL, accounting for 39.3% of the variance in the scores. ( R2 = 0.422; p < 0.001) CONCLUSIONS: Oral health professionals should consider oral behaviors, malocclusion complexity, and subjective treatment need when planning orthodontic treatment plans. Integrating ICON, CS-COIDP, and behavioral assessment will help identify adolescents who should be prioritized for treatment.

Quality and completeness of, and spin in reporting of, pilot and feasibility studies in hip and knee arthroplasty: a protocol for a methodological survey

INTRODUCTION

Pilot or feasibility trials examine the feasibility, viability and recruitment potential of larger, main trials. Specifically, a pilot trial can be instrumental in identifying methodological issues essential to the development of an effective research protocol. However, numerous studies published as pilot or feasibility studies have demonstrated notable inconsistencies in the nature of information reported, resulting in poor-quality and incomplete reporting. It is unclear whether such low quality or incompleteness of reporting is also prevalent in arthroplasty pilot trials.

METHODS AND ANALYSIS

This protocol outlines a methodological survey examining the completeness of reporting among hip and knee arthroplasty pilot trials in accordance with the Consolidated Standards of Reporting Trials (CONSORT) 2010 extension to pilot trials. Secondary objectives include: (1) determining the prevalence of 'spin' practices, defined as: (a) placing a focus on statistical significance rather than feasibility, (b) presenting results that show the trial to be non-feasible as feasible or (c) emphasising the effectiveness or potential intervention benefits rather than feasibility; (2) determining factors associated with incomplete reporting, and 'spin'. A search of PubMed will be conducted for pilot trials in hip or knee arthroplasty published between 01 January 2017 and 31 December 2023. Following screening, appropriate data will be extracted from eligible publications and reported as descriptive statistics, encompassing elements of the CONSORT checklist associated with completeness of reporting. Logistic regression analysis and Poisson regression will be used to analyse factors associated with completeness of reporting and spin.

ETHICS AND DISSEMINATION

This methodological review does not require formal ethical approval, as it will solely involve the use of published and publicly reported literature. The results of this study will be disseminated through submission to peer-reviewed journals and academic conference presentations. Study details will be sent to McMaster University's media coordinators to be shared through the institution's research-focused platforms.

What happens post-pilot testing? A model for revising a disability awareness and competency training program

Disability awareness and competency trainings are an important component of addressing ableism and health equity in the health promotion context. This commentary describes our process of developing, implementing, and refining a disability competency training, the Inclusive Community Exercise Training, for community-based group exercise instructors. The training originated from a partnership between academic researchers, community organizations, and individuals with disabilities. After initial pilot testing, we used feedback from participants to enhance the training. To optimize successful dissemination of this training, we utilized the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework, which is widely used in public health. The revision process focused on generalizing content to suit a wider audience, utilizing an eLearning platform for dissemination, and optimizing interactivity to improve learning effectiveness. The commentary emphasizes the lessons learned and the significance of systematic program revision, considering diverse expertise, content tailoring, and the benefits of accessible eLearning platforms.

A review of sample sizes for UK pilot and feasibility studies on the ISRCTN registry from 2013 to 2020

BACKGROUND

Pilot and feasibility studies provide information to be used when planning a full trial. A sufficient sample size within the pilot/feasibility study is required so this information can be extracted with suitable precision. This work builds upon previous reviews of pilot and feasibility studies to evaluate whether the target sample size aligns with recent recommendations and whether these targets are being reached.

METHODS

A review of the ISRCTN registry was completed using the keywords "pilot" and "feasibility". The inclusion criteria were UK-based randomised interventional trials that started between 2013 (end of the previous review) and 2020. Target sample size, actual sample size and key design characteristics were extracted. Descriptive statistics were used to present sample sizes overall and by key characteristics.

RESULTS

In total, 761 studies were included in the review of which 448 (59%) were labelled feasibility studies, 244 (32%) pilot studies and 69 (9%) described as both pilot and feasibility studies. Over all included pilot and feasibility studies (n = 761), the median target sample size was 30 (IQR 20-50). This was consistent when split by those labelled as a pilot or feasibility study. Slightly larger sample sizes (median = 33, IQR 20-50) were shown for those labelled both pilot and feasibility (n = 69). Studies with a continuous outcome (n = 592) had a median target sample size of 30 (IQR 20-43) whereas, in line with recommendations, this was larger for those with binary outcomes (median = 50, IQR 25-81, n = 97). There was no descriptive difference in the target sample size based on funder type. In studies where the achieved sample size was available (n = 301), 173 (57%) did not reach their sample size target; however, the median difference between the target and actual sample sizes was small at just minus four participants (IQR -25-0).

CONCLUSIONS

Target sample sizes for pilot and feasibility studies have remained constant since the last review in 2013. Most studies in the review satisfy the earlier and more lenient recommendations however do not satisfy the most recent largest recommendation. Additionally, most studies did not reach their target sample size meaning the information collected may not be sufficient to estimate the required parameters for future definitive randomised controlled trials.

From Protocol to Definitive Study-The State of Randomized Controlled Trial Evidence in Sports Medicine Research: A Systematic Review and Survey Study

OBJECTIVE

To evaluate the progression, quality, and challenges associated with conducting and publishing randomized controlled trials (RCTs) in sports medicine.

DESIGN

Systematic review and survey.

SETTING

MEDLINE and Embase were searched for all publications before September 17, 2021. A targeted search of clinicaltrials.gov , BMC Musculoskeletal Disorders, PubMed, and Google Scholar were also conducted. The survey was administered to authors using REDCap.

PARTICIPANTS

Where the systematic search revealed no corresponding published definitive trial, authors of the published pilots were surveyed.

INTERVENTIONS

Survey assessing limitations to definitive trials.

MAIN OUTCOME MEASURES

Protocol/method articles, pilot articles, and relevant clinical trial registry records with corresponding definitive trials were pooled.

RESULTS

Our literature search yielded 27 006 studies; of which, we included 208 studies (60 (28.8%) pilot RCTs, 84 (40.4%) protocol/method articles, and 64 (30.8%) trial registry records). From these, 44 corresponding definitive RCTs were identified. Pilot study and definitive RCT methodological quality increased on average most significantly during the duration of this review (30.6% and 8.2%). Of the 176 authors surveyed, 59 (33.5%) responded; 24.6% (14/57) stated that they completed an unpublished definitive trial, while 52.6% (30/57) reported having one underway.

CONCLUSIONS

The quality and number of RCT publications within the field of sports medicine has been increasing since 1999. The number of sports medicine-related protocol and pilot articles preceding a definitive trial publication showed a sharp increase over the past 10 years, although only 5 pilot studies have progressed to a definitive RCT.

Efficacy potential of Goal Management Training to improve cognitive function in older people living with HIV

Goal Management Training® (GMT) teaches strategies to reduce cognitive load and improve focus in everyday tasks. The aim of this study was to ascertain feasibility, acceptability, and efficacy potential of GMT for people (≥50 years) with stable HIV infection scoring low on tests of cognitive ability. A two-sample, parallel, controlled trial was carried out. Feasibility was demonstrated, as 21/30 participants in the GMT group attended ≥8 of the 9 sessions and completed at least half of the homework. There was no change on the primary performance-based cognitive outcomes in the GMT group or in the control group (n = 23). There was a meaningful improvement in self-reported cognition in those adherent to the intervention. GMT is a promising intervention for people aging with HIV who are dealing with cognitive difficulties affecting their everyday life and should be further investigated.

Acupuncture for the Treatment of Diarrhea-Predominant Irritable Bowel Syndrome: A Pilot Randomized Clinical Trial

IMPORTANCE

Acupuncture is a promising therapy for irritable bowel syndrome (IBS), but the use of subjective scales as an assessment is accompanied by high placebo response rates.

OBJECTIVES

To preliminarily test the feasibility of using US Food and Drug Administration (FDA)-recommended end points to evaluate the efficacy of acupuncture in the treatment of IBS.

DESIGN, SETTING, AND PARTICIPANTS

This pilot, multicenter randomized clinical trial was conducted in 4 tertiary hospitals in China from July 1, 2020, to March 31, 2021, and 14-week data collection was completed in March 2021. Individuals with a diagnosis of IBS with diarrhea (IBS-D) were randomized to 1 of 3 groups, including 2 acupuncture groups (specific acupoints [SA] and nonspecific acupoints [NSA]) and a sham acupuncture group (non-acupoints [NA]) with a 1:1:1 ratio.

INTERVENTIONS

Patients in all groups received twelve 30-minute sessions over 4 consecutive weeks at 3 sessions per week (ideally every other day).

MAIN OUTCOMES AND MEASURES

The primary outcome was the response rate at week 4, which was defined as the proportion of patients whose worst abdominal pain score (score range, 0-10, with 0 indicating no pain and 10 indicating unbearable severe pain) decreased by at least 30% and the number of type 6 or 7 stool days decreased by 50% or greater.

RESULTS

Ninety patients (54 male [60.0%]; mean [SD] age, 34.5 [11.3] years) were enrolled, with 30 patients in each group. There were substantial improvements in the primary outcomes for all groups (composite response rates of 46.7% [95% CI, 28.8%-65.4%] in the SA group, 46.7% [95% CI, 28.8%-65.4%] in the NSA group, and 26.7% [95% CI, 13.0%-46.2%] in the NA group), although the difference between them was not statistically significant (P = .18). The response rates of adequate relief at week 4 were 64.3% (95% CI, 44.1%-80.7%) in the SA group, 62.1% (95% CI, 42.4%-78.7%) in the NSA group, and 55.2% (95% CI, 36.0%-73.0%) in the NA group (P = .76). Adverse events were reported in 2 patients (6.7%) in the SA group and 3 patients (10%) in NSA or NA group.

CONCLUSIONS AND RELEVANCE

In this pilot randomized clinical trial, acupuncture in both the SA and NSA groups showed clinically meaningful improvement in IBS-D symptoms, although there were no significant differences among the 3 groups. These findings suggest that acupuncture is feasible and safe; a larger, sufficiently powered trial is needed to accurately assess efficacy.

TRIAL REGISTRATION

Chinese Clinical Trial Registry: ChiCTR2000030670.

The Impact of Artificial Intelligence on Health Equity in Oncology: Scoping Review

BACKGROUND

The field of oncology is at the forefront of advances in artificial intelligence (AI) in health care, providing an opportunity to examine the early integration of these technologies in clinical research and patient care. Hope that AI will revolutionize health care delivery and improve clinical outcomes has been accompanied by concerns about the impact of these technologies on health equity.

OBJECTIVE

We aimed to conduct a scoping review of the literature to address the question, "What are the current and potential impacts of AI technologies on health equity in oncology?"

METHODS

Following PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines for scoping reviews, we systematically searched MEDLINE and Embase electronic databases from January 2000 to August 2021 for records engaging with key concepts of AI, health equity, and oncology. We included all English-language articles that engaged with the 3 key concepts. Articles were analyzed qualitatively for themes pertaining to the influence of AI on health equity in oncology.

RESULTS

Of the 14,011 records, 133 (0.95%) identified from our review were included. We identified 3 general themes in the literature: the use of AI to reduce health care disparities (58/133, 43.6%), concerns surrounding AI technologies and bias (16/133, 12.1%), and the use of AI to examine biological and social determinants of health (55/133, 41.4%). A total of 3% (4/133) of articles focused on many of these themes.

CONCLUSIONS

Our scoping review revealed 3 main themes on the impact of AI on health equity in oncology, which relate to AI's ability to help address health disparities, its potential to mitigate or exacerbate bias, and its capability to help elucidate determinants of health. Gaps in the literature included a lack of discussion of ethical challenges with the application of AI technologies in low- and middle-income countries, lack of discussion of problems of bias in AI algorithms, and a lack of justification for the use of AI technologies over traditional statistical methods to address specific research questions in oncology. Our review highlights a need to address these gaps to ensure a more equitable integration of AI in cancer research and clinical practice. The limitations of our study include its exploratory nature, its focus on oncology as opposed to all health care sectors, and its analysis of solely English-language articles.

The reporting of pilot and feasibility studies in the top dental specialty journals is suboptimal

Background

Pilot and feasibility studies (PAFS) are smaller investigations seeking to assess the feasibility of conducting a larger more definitive study. In late 2016, the CONSORT statement was extended to disseminate good practices for reporting of randomized pilot and feasibility trials. In this quality assurance review, we assessed whether PAFS in the top dental speciality journals adhere to good practices of conduct and reporting, by prioritizing assessment of feasibility and stating pre-defined progression criteria to inform the decision to pursue funding for a larger trial.

Methods

With the help of a librarian, we searched MEDLINE and EMBASE from 2017 to 2020, inclusive, for PAFS in the top 3 journals from each of the 10 dental specialties. We collected data on methodological and general characteristics of the studies, their objectives, and reporting of items recommended in the CONSORT extension.

Results

Of the 111 trials included, 51.4% (95% CI 41.7–61.0%) stated some indication of intent to assess feasibility while zero reported progression criteria; 74.8% (95% CI 65.6–82.5%) of trials used the terms “pilot” or “feasibility” in their titles and 82.9% (95% CI 74.6–89.4%) of studies stated there is a need for a future trial, but only 9.0% (95% CI 4.4–15.9%) stated intent to proceed to one. Most of the studies, 53.2% (95% CI 43.4–62.7%), reported hypothesis testing without cautioning readers on the generalizability of the results. Studies that used the terms “pilot” or “feasibility” in their title were less likely to have feasibility objectives, compared to trials that did not, with an odds ratio (OR) of 0.310 (95% CI 0.103–0.930; p = 0.037). Compared to trials that did not conduct hypothesis testing, trials that conducted hypothesis testing were significantly less likely to assess feasibility, among them, trials that cautioned readers on the generalizability of their results had an OR of 0.038 (95% CI 0.005–0.264; p < 0.001) and trials that did not caution readers on the generalizability of their results had an OR of 0.043 (95% CI 0.008–0.238; p = 0.001).

Conclusion

Many PAFS in dentistry are not conducted with the intent of assessing feasibility, nor do they state progression criteria, and few report intent to proceed to a future trial. Misconceptions about PAFS can lead to them being poorly conducted and reported, which has economic and ethical implications. Research ethics boards, funding agencies, and journals need to raise their standards for the conduct and reporting of PAFS, and resources should be developed to address misconceptions and help guide researchers on the best practices for their conduct and reporting.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01182-1.

Blood flow restriction added to usual care exercise in patients with early weight bearing restrictions after cartilage or meniscus repair in the knee joint: a feasibility study

PURPOSE

Blood flow restriction - low load strength training (BFR-LLST) is theoretically superior to traditional heavy strength training when rehabilitating patients who cannot heavily load tissues following surgery. The main purpose of this study was to examine the feasibility of BFR-LLST added to usual care exercise early after cartilage or meniscus repair in the knee joint.

METHODS

We included 42 patients with cartilage (n = 21) or meniscus repair (n = 21) of the knee joint. They attended 9 weeks of BFR-LLST added to a usual care exercise program at an outpatient rehabilitation center. Outcome measures were assessed at different time points from four (baseline) to 26 weeks postoperatively and included adherence, harms, knee joint and thigh pain, perceived exertion, thigh circumference (muscle size proxy), isometric knee-extension strength, self-reported disability and quality of life.

RESULTS

On average, patients with cartilage or meniscus repair completed > 84% of the total BFR-LLST supervised sessions. Thirty-eight patients reported 146 adverse events of which none were considered serious. No decrease in thigh circumference or exacerbation of knee joint or quadriceps muscle pain of the operated leg was found in either group during the intervention period.

CONCLUSIONS

BFR-LLST added to usual care exercise initiated early after cartilage or meniscus repair seems feasible and may prevent disuse thigh muscle atrophy during a period of weight bearing restrictions. Harms were reported, but no serious adverse events were found. Our findings are promising but need replication using a RCT-design.

TRIAL REGISTRATION

NCT03371901 , preprint (open access):  https://www.medrxiv.org/content/10.1101/2022.03.31.22272398v1.

Applying mixed methods to pilot feasibility studies to inform intervention trials

BACKGROUND

Pilot feasibility studies serve a uniquely important role in preparing for larger scale intervention trials by examining the feasibility and acceptability of interventions and the methods used to test them. Mixed methods (collecting, analyzing, and integrating quantitative and qualitative data and results) can optimize what can be learned from pilot feasibility studies to prepare rigorous intervention trials. Despite increasing use of mixed method designs in intervention trials, there is limited guidance on how to apply these approaches to address pilot feasibility study goals. The purpose of this article is to offer methodological guidance for how investigators can plan to integrate quantitative and qualitative methods within pilot feasibility studies to comprehensively address key research questions.

METHODS

We used an informal consensus-based process informed by key methodological resources and our team's complementary expertise as intervention researchers and mixed methodologists to develop guidance for applying mixed methods to optimize what can be learned from pilot feasibility studies. We developed this methodological guidance as faculty in the Mixed Methods Research Training Program (MMRTP) for the Health Sciences (R25MH104660) funded by the National Institutes of Health through the Office of Behavioral and Social Science Research.

RESULTS

We provide the following guidance for applying mixed methods to optimize pilot feasibility studies: (1) identify feasibility domain(s) that will be examined using mixed methods, (2) align quantitative and qualitative data sources for the domain(s) selected for mixing methods, (3) determine the timing of the quantitative and qualitative data collection within the flow of the pilot study, (4) plan integrative analyses using joint displays to understand feasibility, and (5) prepare to draw meta-inferences about feasibility and implications for the future trial from the integrated data.

CONCLUSIONS

By effectively integrating quantitative and qualitative data within pilot feasibility studies, investigators can harness the potential of mixed methods for developing comprehensive and nuanced understandings about feasibility. Our guidance can help researchers to consider the range of key decisions needed during intervention pilot feasibility testing to achieve a rigorous mixed methods approach generating enhanced insights to inform future intervention trials.

Pilot and Feasibility Studies in Rehabilitation Research: A Review and Educational Primer for the Physiatrist Researcher

ABSTRACT

Pilot and feasibility studies are conducted early in the clinical research pathway to evaluate whether a future, definitive study can or should be done and, if so, how. Poor planning and reporting of pilot and feasibility studies can compromise subsequent research efforts. Inappropriate labeling of studies as pilots also compromises education. In this review, first, a systematic survey of the current state of pilot and feasibility studies in rehabilitation research was performed, and second, recommendations were made for improvements to their design and reporting. In a random sample of 100 studies, half (49.5%) were randomized trials. Thirty (30.0%) and three (3.0%) studies used "pilot" and "feasibility" in the study title, respectively. Only one third (34.0%) of studies provided a primary objective related to feasibility. Most studies (92.0%) stated an intent for hypothesis testing. Although many studies (70.0%) mentioned outcomes related to feasibility in the methods, a third (30.0%) reported additional outcomes in the results and discussion only or commented on feasibility anecdotally. The reporting of progression plans to a main study (21.0%) and progression criteria (4.0%) was infrequent. Based on these findings, it is recommended that researchers correctly label studies as a pilot or feasibility design based on accepted definitions, explicitly state feasibility objectives, outcomes, and criteria for determining success of feasibility, justify the sample size, and appropriately interpret and report the implications of feasibility findings for the main future study.

Optimizing red blood cell transfusion practices in the intensive care unit: a multi-phased health technology reassessment

Background

Health technology reassessment (HTR) is a process to manage existing health technologies to ensure ongoing optimal use. A model to guide HTR was developed; however, there is limited practical experience. This paper addresses this knowledge gap through the completion of a multi-phase HTR of red blood cell (RBC) transfusion practices in the intensive care unit (ICU).

Objective

The HTR consisted of three phases and here we report on the final phase: the development, implementation, and evaluation of behavior change interventions aimed at addressing inappropriate RBC transfusions in an ICU.

Methods

The interventions, comprised of group education and audit and feedback, were co-designed and implemented with clinical leaders. The intervention was evaluated through a controlled before-and-after pilot feasibility study. The primary outcome was the proportion of potentially inappropriate RBC transfusions (i.e., with a pre-transfusion hemoglobin of 70 g/L or more).

Results

There was marked variability in the monthly proportion of potentially inappropriate RBC transfusions. Relative to the pre-intervention phase, there was no significant difference in the proportion of potentially inappropriate RBC transfusions post-intervention. Lessons from this work include the importance of early and meaningful engagement of clinical leaders; tailoring the intervention modalities; and, efficient access to data through an electronic clinical information system.

Conclusions

It was feasible to design, implement, and evaluate a tailored, multi-modal behavior change intervention in this small-scale pilot study. However, early evaluation of the intervention revealed no change in technology use leading to reflection on the important question of how the HTR model needs to be improved.

Status, reporting completeness and methodological quality of pilot randomised controlled trials in acupuncture: protocol for a systematic review

INTRODUCTION

To date, there has been a lack of knowledge about the status, reporting completeness and methodological quality of pilot trials in the acupuncture field. Thus, this systematic review protocol aims to: (1) investigate publication trends and aspects of feasibility evaluated in acupuncture pilot trials; (2) identify the proportion of acupuncture pilot trials that lead to definitive trials and (3) assess the reporting completeness and methodological quality of pilot trials in acupuncture.

METHODS AND ANALYSIS

Studies of acupuncture pilot randomised controlled trials published from 2011 to 2021 will be retrieved in seven databases in January 2022, including PubMed, Web of Science, EMBASE, Cochrane Library, Chinese National Knowledge Infrastructure, Wanfang Database and Chinese Biomedical Literature Database. The methodological quality and reporting completeness of all included studies will be assessed using the risk of bias 2.0 tool (RoB 2) and the Consolidated Standards of Reporting Trials (CONSORT) extension to randomised pilot and feasibility trials, respectively. For the primary analysis, publication trends, aspects of feasibility and the proportion of pilot trials that lead to definitive trials will be analysed. A quantitative analysis of the methodological quality and reporting completeness of the included trials will be implemented by calculating the percentage of items reported in each domain of RoB 2 and CONSORT. The secondary analysis will adopt a regression analysis to identify factors associated with the reporting completeness.

ETHICS AND DISSEMINATION

Ethical approval is not required for this study. This study is planned to be submitted to a peer-reviewed academic journal.

Design, analysis, and reporting of pilot studies in HIV: a systematic review and methodological study

Background

Pilot studies are essential in determining if a larger study is feasible. This is especially true when targeting populations that experience stigma and may be difficult to include in research, such as people with HIV. We sought to describe how pilot studies have been used to inform HIV clinical trials.

Methods

We conducted a methodological study of pilot studies of interventions in people living with HIV published until November 25, 2020, using Medline, Embase, and Cochrane Controlled Register of Trials (CENTRAL). We extracted data on their nomenclature, primary objective, use of progression criteria, sample size, use of qualitative methods, and other contextual information (region, income, level, type of intervention, study design).

Results

Our search retrieved 10,597 studies, of which 248 were eligible. The number of pilot studies increased steadily over time. We found that 179 studies (72.2%) used the terms “pilot” or “feasibility” in their title, 65.3% tested feasibility as a primary objective, only 2% used progression criteria, 23.9% provided a sample size estimation and only 30.2% used qualitative methods.

Conclusions

Pilot studies are increasingly being used to inform HIV research. However, the titles and objectives are not always consistent with piloting. The design and reporting of pilot studies in HIV could be improved.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-021-00934-9.

Feasibility of a smartphone app to enhance physical activity in progressive MS: a pilot randomized controlled pilot trial over three months

BACKGROUND

People with chronic progressive multiple sclerosis (CPMS) have limited options in medical treatment. Enhancing physical activity (PA) might promote neuroregeneration in multiple sclerosis (MS) and positively influence disability, thus providing an alternative to medical treatment. Previous studies indicate that evidence-based patient information (EBPI) is essential for inducing behavioral change, e.g. enhancing PA.

OBJECTIVE

To investigate feasibility of a smartphone app providing EBPI about the benefit of PA and a simple activity feedback to enhance PA in people with CPMS in a pilot randomized controlled trial over 3 months.

METHODS

Thirty-eight people with CPMS (mean age 51 years, median Expanded Disability Status Scale 4.0) were 1:1 randomized into either a control group (n = 20) or an intervention group (n = 18). The intervention group received access to a multimedia EBPI app including activity feedback, texts, figures and videos. In the control group, participants received a leaflet with unspecific information about exercising in general. The EPBI itself was designed based on a systematic review. At baseline and after 3 months, all participants underwent clinical performance tests, filled in questionnaires and received an activity monitor (Actigraph®) for 7 days. The primary endpoint was the rate of responders defined as participants with a 20% increase of physical acitivity (time of moderate or vigiorous PA-MVPA) or 20% increase of the number of steps, both assessed with the activity monitor. As secondary endpoints, we compared accelerometry, performance and questionnaires adjusted for baseline measurments between the groups (ANCOVA). Moreover, we used questionnaires to compare knowledge about exercise (activity requiring physical effort, carried out to improve or improve health and fitness) in MS, usability of the app in general and motivation towards a more active lifestyle after 3 months in both groups.

RESULTS

The groups showed significant differences in disease duration and PA according to the Godin-Leisure Time Exercise Questionnaire at baseline. After 3 months, we detected no difference in the rate of responders, which was an overall 22%. However, MVPA significantly increased in both groups (p < 0.001) and the intervention group tended to have a higher motivation towards a more active lifestyle (Cohens D = 0.7, p = 0.09) as measured by the questionnaire. Reponses also showed, that participants appreciated the app but claimed a lack of interactivity as a short-coming.

CONCLUSION

Just providing information in a multimedia smartphone app did not enhance physical activitiy more than a simple leaflet in this small pilot trial in CPMS. However, the group of app users tended to have a higher motivation towards a more active lifestyle. Overall, the concept of a smartphone app to support an active lifestyle in MS is highly appreciated by participants.

Preliminary effect and feasibility of physiotherapy with strength training and protein-rich nutritional supplement in combination with anabolic steroids in cross-continuum rehabilitation of patients with hip fracture: protocol for a blinded randomized controlled pilot trial (HIP-SAP1 trial)

BACKGROUND

A 2014 Cochrane review evaluating the effect of anabolic steroids after hip fracture concluded that the quality of the studies was insufficient to draw conclusions on the effects and recommended further high-quality trials in the field. Therefore, the aim of this pilot trial is to determine the preliminary effect and feasibility of a 12-week multimodal intervention consisting of physiotherapy (with strength training), protein-rich nutritional supplement and anabolic steroid on knee-extension muscle strength and function 14 weeks after hip fracture surgery.

METHODS

We plan to conduct a randomized, placebo-controlled pilot trial with 48 patients operated for acute hip fracture. The patients are randomized (1:1) to either (1) physiotherapy with protein-rich nutritional supplement plus anabolic steroid or (2) physiotherapy with protein-rich nutritional supplement plus placebo. Outcome assessments will be carried out blinded at baseline (3-10 days after surgery) and at 14 weeks after entering the trial. Primary outcome is the change from baseline to follow-up in maximal isometric knee-extension muscle strength in the fractured limb. Secondary outcomes are physical performance test, patient-reported outcomes, and measures of body composition.

DISCUSSION

If the trial is found feasible and the results show an indication of anabolic steroid being a relevant addition to further enhance the recovery of muscle strength and function in an enhanced recovery after surgery program, this trial will constitute the basis of a larger confirmatory trial.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03545347. Preregistered on 4 June 2018.

Do radiological research articles apply the term "pilot study" correctly? Systematic review

AIM

To determine what proportion of radiological studies used the term "pilot" correctly.

MATERIAL AND METHODS

Indexed studies describing themselves as a "pilot" in their title were identified from four indexed radiological journals. The aim was to identify 20 consecutive, eligible studies from each journal, as this sample size was deemed sufficient to be representative as to how this methodological description was employed by authors of radiological articles. Data were extracted relating to study design and data presented. The review was reported according to PRISMA guidelines.

RESULTS

The search string used identified 658 records across the four targeted journals. Ultimately, 78 reviews describing 5,572 patients were selected for systematic review. Median sample size was just 20 patients. No individual study qualified as a genuine pilot study when assessed against the a priori criteria. In reality, the large majority (66 studies, 84.6%) were framed as studies of diagnostic test accuracy. A significant proportion (21 studies, 26.9%) was retrospective, and the overwhelming majority were conducted in single centres (76 centres, 94.7%). Most (55 studies, 70.5%) stated no rationale for their sample size, and no study presented a formal power calculation.

CONCLUSION

Radiological "pilot" studies are mostly underpowered studies of diagnostic test accuracy. In order to have scientific credibility, authors, reviewers, and editors of radiological journals are encouraged to familiarise themselves with different methodological study designs and their precise implications.

Work-directed rehabilitation or physical activity to support work ability and mental health in common mental disorders: a pilot randomized controlled trial

Objective:

To evaluate feasibility and potential effectiveness of work-directed rehabilitation in people with common mental disorders.

Design:

Pilot randomized controlled trial.

Setting:

Primary healthcare, Sweden.

Subjects:

Working adults ( n = 42) of mean age 46.2 ± 11.1 years with depression or anxiety disorder.

Interventions:

Eight weeks of work-directed rehabilitation ( n = 21) or physical activity ( n = 21). Work-directed rehabilitation included sessions with a physiotherapist and/or an occupational therapist, to develop strategies to cope better at work. Physical activity included a planning session and access to a local gym.

Main measures:

Feasibility: attendance, discontinuation and adverse events. Measurements were the Work Ability Index, the Global Assessment of Functioning, the Montgomery–Asberg Depression Rating Scale, the Beck Anxiety Inventory and the World Health Organization—Five Well-Being Index.

Results:

Attendance to rehabilitation sessions was 88% ( n = 147/167) and discontinuation rate was 14% ( n = 3/21). No serious adverse events were reported. Within both groups, there was a significant improvement in Work Ability Index score (mean change: 3.6 (95% confidence interval (CI): 0.45, 6.7) in work-directed rehabilitation and 3.9 (95% CI: 0.9, 7.0) in physical activity) with no significant difference between groups. For the other outcomes, significant improvements were found within but not between groups. Per-protocol analysis showed a trend toward the antidepressant effect of work-directed rehabilitation compared to physical activity (mean difference in depression score −3.1 (95% CI: −6.8, 0.4), P = 0.075).

Conclusion:

Work-directed rehabilitation was feasible to persons with common mental disorders and improved their work ability and mental health. Comparable improvements were seen in the physical activity group. Suggested modifications for a larger trial include adding a treatment-as-usual control.

Should treatment effects be estimated in pilot and feasibility studies?

Background

Feasibility studies and external pilot studies are used increasingly to inform planning decisions related to a definitive randomized controlled trial. These studies can provide information on process measures, such as consent rates, treatment fidelity and compliance, and methods of outcome measurement. Additionally, they can provide initial parameter estimates for a sample size calculation, such as a standard deviation or the ‘success’ rate for a binary outcome in the control group. However, the issue of estimating treatment effects in pilot or feasibility studies is controversial.

Methodological discussion

Between-group estimates of treatment effect from pilot studies are sometimes used to calculate the sample size for a main trial, alongside estimated standard deviations. However, whilst estimating a standard deviation is an empirical matter, a targeted treatment effect should be established in terms of clinical judgement, as a minimum important difference (MID), not through analysis of pilot data. Secondly, between-group effects measured in pilot studies are sometimes used to indicate the magnitude of an effect that might be obtained in a main trial, and a decision on progression made with reference to the associated confidence interval. Such estimates will be imprecise in typically small pilot studies and therefore do not allow a robust decision on a main trial; both a decision to proceed and a decision not to proceed may be made too readily. Thirdly, a within-group change might be estimated from a pilot or a feasibility study in a desire to assess the potential efficacy of a novel intervention prior to testing it in a main trial, but again such estimates are liable to be imprecise and do not allow sound causal inferences.

Conclusion

Treatment effects calculated from pilot or feasibility studies should not be the basis of a sample size calculation for a main trial, as the MID to be detected should be based primarily on clinical judgement rather than statistics. Deciding on progression to a main trial based on these treatment effects is also misguided, as they will normally be imprecise, and may be biased if the pilot or feasibility study is unrepresentative of the main trial.

A methodological survey on reporting of pilot and feasibility trials for physiotherapy interventions: a study protocol

INTRODUCTION

Pilot and feasibility trials aim to test whether a full trial can be conducted or if any procedures must be changed for the full trial. Pilot trials must be reported in a transparent, accurate and complete way. In this report, we present a protocol for a methodological survey with the following aims: (1) to determine the percentage of physiotherapy trial reports which claim to be pilot or feasibility trials that evaluate feasibility, (2) to determine the aspect of feasibility evaluated in the primary objectives of the pilot or feasibility trials, (3) to describe the completeness of reporting of abstracts and full articles of pilot or feasibility trials using the Consolidated Standards of Reporting Trials (CONSORT) extension to randomised pilot and feasibility trials and (4) to investigate factors associated with completeness of reporting of pilot or feasibility trials.

METHODS AND ANALYSIS

Reports of randomised controlled trials indexed in the Physiotherapy Evidence Database (PEDro) that claim to be pilot or feasibility trials and published in 2011-2017 will be included. Two independent reviewers will confirm eligibility and classify the aspect of feasibility being evaluated in the objectives of the included pilot or feasibility trials. Completeness of reporting of both the abstract and the full article will be evaluated using the CONSORT extension to randomised pilot and feasibility trials. The primary analysis will be a descriptive analysis about the reporting quality of abstracts and full texts of pilot and feasibility trials. We will use generalised estimating equation analysis to explore factors associated with completeness of reporting.

ETHICS AND DISSEMINATION

The results of this study will be disseminated by presentation at conferences and will be submitted for publication in a peer-reviewed journal. Ethical approval is not necessary for this study.

Pilot randomized controlled trials in the orthopaedic surgery literature: a systematic review

BACKGROUND

The primary objective of this systematic review is to examine the characteristics of pilot randomized controlled trials (RCTs) in the orthopaedic surgery literature, including the proportion framed as feasibility trials and those that lead to definitive RCTs. This review aim to answer the question of whether pilot RCTs lead to definitive RCTs, whilst investigating the quality, feasibility and overall publication trends of orthopaedic pilot trials.

METHODS

Pilot RCTs in the orthopaedic literature were identified from three electronic databases (EMBASE, MEDLINE, and Pubmed) searched from database inception to January 2018. Search criteria included the evaluation of at least one orthopaedic surgical intervention, research on humans, and publication in English. Two reviewers independently screened the pool of pilot trials, and conducted a search for corresponding definitive trials. Screened pilot RCTs were assessed for feasibility outcomes related to efficiency, cost, and/or timeliness of a large-scale clinical trial involving a surgical intervention. The quality of the pilot and definitive trials were assessed using the Checklist to Evaluate a Report of a Non-Pharmacological Trial (CLEAR NPT).

RESULTS

The initial search for pilot RCTs yielded 3857 titles, of which 49 articles were relevant for this review. 73.5% (36/49) of the orthopaedic pilot RCTs were framed as feasibility trials. Of these, 5 corresponding definitive trials (10.2%) were found, of which four were published and one ongoing. Based on author responses, the lack of a definitive RCT following the pilot trial was attributed to a lack of funding, inadequacies in recruitment, and belief that the pilot RCT sufficiently answered the research question.

CONCLUSIONS

Based on this systematic review, most pilot RCTs were characterized as feasibility trials. However, the majority of published pilot RCTs did not lead to definitive trials. This discrepancy was mainly attributed to poor feasibility (e.g. poor recruitment) and lack of funding for an orthopaedic surgical definitive trial. In recent years this discrepancy may be due to researchers saving on time and cost by rolling their pilot patients into the definitive RCT rather than publish a separate pilot trial.

Modulating Emotional Experience Using Electrical Stimulation of the Medial-Prefrontal Cortex: A Preliminary tDCS-fMRI Study

OBJECTIVES

Implicit regulation of emotions involves medial-prefrontal cortex (mPFC) regions exerting regulatory control over limbic structures. Diminished regulation relates to aberrant mPFC functionality and psychopathology. Establishing means of modulating mPFC functionality could benefit research on emotion and its dysregulation. Here, we tested the capacity of transcranial direct current stimulation (tDCS) targeting mPFC to modulate subjective emotional states by facilitating implicit emotion regulation.

MATERIALS AND METHODS

Stimulation was applied concurrently with functional magnetic resonance imaging to validate its neurobehavioral effect. Sixteen participants were each scanned twice, counterbalancing active and sham tDCS application, while undergoing negative mood induction (clips featuring negative vs. neutral contents). Effects of stimulation on emotional experience were assessed using subjective and neural measures.

RESULTS

Subjectively, active stimulation led to significant reduction in reported intensity of experienced emotions to negatively valenced (p = 0.005) clips but not to neutral clips (p > 0.99). Active stimulation further mitigated a rise in stress levels from pre- to post-induction (sham: p = 0.004; active: p = 0.15). Neurally, stimulation increased activation in mPFC regions associated with implicit emotion regulation (ventromedial-prefrontal cortex; subgenual anterior-cingulate cortex, sgACC), and in ventral striatum, a core limbic structure (all ps < 0.05). Stimulation also altered functional connectivity (assessed using whole-brain psycho-physiological interaction) between these regions, and with additional limbic regions. Stimulation-induced sgACC activation correlated with reported emotion intensity and depressive symptoms (rs > 0.64, ps < 0.018), suggesting individual differences in stimulation responsivity.

CONCLUSIONS

Results of this study indicate the potential capacity of tDCS to facilitate brain activation in mPFC regions underlying implicit regulation of emotion and accordingly modulate subjective emotional experiences.