Recruitment and inclusion procedures as "pain killers" in clinical trials?

Defining and evaluating the Hawthorne effect in primary care, a systematic review and meta-analysis

In 2015, we conducted a randomized controlled trial (RCT) in primary care to evaluate if posters and pamphlets dispensed in general practice waiting rooms enhanced vaccination uptake for seasonal influenza. Unexpectedly, vaccination uptake rose in both arms of the RCT whereas public health data indicated a decrease. We wondered if the design of the trial had led to a Hawthorne effect (HE). Searching the literature, we noticed that the definition of the HE was unclear if stated. Our objectives were to refine a definition of the HE for primary care, to evaluate its size, and to draw consequences for primary care research. We designed a Preferred Reporting Items for Systematic reviews and Meta-Analyses review and meta-analysis between January 2012 and March 2022. We included original reports defining the HE and reports measuring it without setting limitations. Definitions of the HE were collected and summarized. Main published outcomes were extracted and measures were analyzed to evaluate odds ratios (ORs) in primary care. The search led to 180 records, reduced on review to 74 for definition and 15 for quantification. Our definition of HE is "an aware or unconscious complex behavior change in a study environment, related to the complex interaction of four biases affecting the study subjects and investigators: selection bias, commitment and congruence bias, conformity and social desirability bias and observation and measurement bias." Its size varies in time and depends on the education and professional position of the investigators and subjects, the study environment, and the outcome. There are overlap areas between the HE, placebo effect, and regression to the mean. In binary outcomes, the overall OR of the HE computed in primary care was 1.41 (95% CI: [1.13; 1.75]; I 2 = 97%), but the significance of the HE disappears in well-designed studies. We conclude that the HE results from a complex system of interacting phenomena and appears to some degree in all experimental research, but its size can considerably be reduced by refining study designs.

Recruitment and retention for chronic pain clinical trials: a narrative review

Opioid misuse is at a crisis level. In response to this epidemic, the National Institutes of Health has funded $945 million in research through the Helping to End Addiction Long-term (HEAL) Pain Management Initiative, including funding to the Vanderbilt Recruitment Innovation Center (RIC) to strategize methods to catalyze participant recruitment. The RIC, recognizing the challenges presented to clinical researchers in recruiting individuals experiencing pain, conducted a review of evidence in the literature on successful participant recruitment methods for chronic pain trials, in preparation for supporting the HEAL Pain trials. Study design as it affects recruitment was reviewed, with issues such as sufficient sample size, impact of placebo, pain symptom instability, and cohort characterization being identified as problems. Potential solutions found in the literature include targeted electronic health record phenotyping, use of alternative study designs, and greater clinician education and involvement. For retention, the literature reports successful strategies that include maintaining a supportive staff, allowing virtual study visits, and providing treatment flexibility within the trial. Community input on study design to identify potential obstacles to recruitment and retention was found to help investigators avoid pitfalls and enhance trust, especially when recruiting underrepresented minority populations. Our report concludes with a description of generalizable resources the RIC has developed or adapted to enhance recruitment and retention in the HEAL Pain studies. These resources include, among others, a Recruitment and Retention Plan Template, a Competing Trials Tool, and MyCap, a mobile research application that interfaces with Research Electronic Data Capture (REDCap).