Considerations and methods for placebo controls in surgical trials (ASPIRE guidelines)

Patient information leaflets for placebo-controlled surgical trials: a review of current practice and recommendations for developers

INTRODUCTION

Informed consent for participation in an RCT is an important ethical and legal requirement. In placebo surgical trials, further issues are raised, and to date, this has not been explored. Patient information leaflets (PILs) are a core component of the informed consent process. This study aimed to investigate the key content of PILs for recently completed placebo-controlled trials of invasive procedures, including surgery, to highlight areas of good practice, identify gaps in information provision for trials of this type and provide recommendations for practice.

METHODS

PILs were sought from trials included in a recent systematic review of placebo-controlled trials of invasive procedures, including surgery. Trial characteristics and data on surgical and placebo interventions under evaluation were extracted. Directed content analysis was applied, informed by published regulatory and good practice guidance on PIL content and existing research on placebo-controlled surgical trials. Results were analysed using descriptive statistics and presented as a narrative summary.

RESULTS

Of the 62 eligible RCTs, authors of 59 trials were contactable and 14 PILs were received for analysis. At least 50% of all PILs included content on general trial design. Explanations of how the placebo differs or is similar to the surgical intervention (i.e. fidelity) were reported in 6 (43%) of the included PILs. Over half (57%) of the PILs included information on the potential therapeutic benefits of the surgical intervention. One (7%) included information on potential indirect therapeutic benefits from invasive components of the placebo. Five (36%) presented the known risks of the placebo intervention, whilst 8 (57%) presented information on the known risks of the surgical intervention. A range of terms was used across the PILs to describe the placebo component, including 'control', 'mock' and 'sham'.

CONCLUSION

Developers of PILs for placebo-controlled surgical trials should carefully consider the use of language (e.g. sham, mock), be explicit about how the placebo differs (or is similar) to the surgical intervention and provide balanced presentations of potential benefits and risks of the surgical intervention separately from the placebo. Further research is required to determine optimal approaches to design and deliver this information for these trials.

Participant recruitment and attrition in surgical randomised trials with placebo controls versus non-operative controls: a meta-epidemiological study and meta-analysis

OBJECTIVE

To compare differences in recruitment and attrition between placebo control randomised trials of surgery, and trials of the same surgical interventions and conditions that used non-operative (non-placebo) controls.

DESIGN

Meta-epidemiological study.

DATA SOURCES

Randomised controlled trials were identified from an electronic search of MEDLINE, EMBASE and Cochrane Central Register of Controlled Trials from their inception date to 21 November 2018.

STUDY SELECTION

Placebo control trials evaluating efficacy of any surgical intervention and non-operative control trials of the same surgical intervention were included in this study. 25 730 records were retrieved from our systemic search, identifying 61 placebo control and 38 non-operative control trials for inclusion in analysis.

OUTCOME MEASURES

Primary outcome measures were recruitment and attrition. These were assessed in terms of recruitment rate (number of participants enrolled, as a proportion of those eligible) and overall attrition rate (composite of dropout, loss to follow-up and cross-overs, expressed as proportion of total sample size). Secondary outcome measures included participant cross-over rate, dropout and loss to follow-up.

RESULTS

Unadjusted pooled recruitment and attrition rates were similar between placebo and non-operative control trials. Study characteristics were not significantly different apart from time to primary timepoint which was shorter in studies with placebo controls (365 vs 274 days, p=0.006). After adjusting for covariates (follow-up duration and number of timepoints), the attrition rate of placebo control trials was almost twice as high compared with non-operative controlled-trials (incident rate ratio (IRR) (95% CI) 1.8 (1.1 to 3.0), p=0.032). The incorporation of one additional follow-up timepoint (regardless of follow-up duration) was associated with reduced attrition in placebo control surgical trials (IRR (95% CI) 0.64 (0.52 to 0.79), p<0.001).

CONCLUSIONS

Placebo control trials of surgery have similar recruitment issues but higher attrition compared with non-operative (non-placebo) control trials. Study design should incorporate strategies such as increased timepoints for given follow-up duration to mitigate losses to follow-up and dropout.

PROSPERO REGISTRATION NUMBER

CRD42019117364.

Placebo Control and Blinding in Randomized Trials of Procedural Interventions: A Systematic Review and Meta-Regression

Importance

Unlike medications, procedural interventions are rarely trialed against placebo prior to becoming accepted in clinical practice. When placebo-controlled trials are eventually conducted, procedural interventions may be less effective than previously believed.

Objective

To investigate the importance of including a placebo arm in trials of surgical and interventional procedures by comparing effect sizes from trials of the same procedure that do and do not include a placebo arm.

Data Sources

Searches of MEDLINE and Embase identified all placebo-controlled trials for procedural interventions in any specialty of medicine and surgery from inception to March 31, 2019. A secondary search identified randomized clinical trials assessing the same intervention, condition, and end point but without a placebo arm for paired comparison.

Study Selection

Placebo-controlled trials of anatomically site-specific procedures requiring skin incision or endoscopic techniques were eligible for inclusion; these were then matched to trials without placebo control that fell within prespecified limits of heterogeneity.

Data Extraction and Synthesis

Random-effects meta-regression, with placebo and blinding as a fixed effect and intervention and end point grouping as random effects, was used to calculate the impact of placebo control for each end point. Data were analyzed from March 2019 to March 2020.

Main Outcomes and Measures

End points were examined in prespecified subgroups: patient-reported or health care professional-assessed outcomes, quality of life, pain, blood pressure, exercise-related outcomes, recurrent bleeding, and all-cause mortality.

Results

Ninety-seven end points were matched from 72 blinded, placebo-controlled trials (hereafter, blinded) and 55 unblinded trials without placebo control (hereafter, unblinded), including 111 500 individual patient end points. Unblinded trials had larger standardized effect sizes than blinded trials for exercise-related outcomes (standardized mean difference [SMD], 0.59; 95% CI, 0.29 to 0.89; P < .001) and quality-of-life (SMD, 0.32; 95% CI, 0.11 to 0.53; P = .003) and health care professional-assessed end points (SMD, 0.40; 95% CI, 0.18 to 0.61; P < .001). The placebo effect accounted for 88.1%, 55.2%, and 61.3% of the observed unblinded effect size for these end points, respectively. There was no significant difference between unblinded and blinded trials for patient-reported end points (SMD, 0.31; 95% CI, -0.02 to 0.64; P = .07), blood pressure (SMD, 0.26; 95% CI, -0.10 to 0.62; P = .15), all-cause mortality (odds ratio [OR], 0.23; 95% CI, -0.26 to 0.72; P = .36), pain (SMD, 0.03; 95% CI, -0.52 to 0.57; P = .91), or recurrent bleeding events (OR, -0.12; 95% CI, -1.11 to 0.88; P = .88).

Conclusions and Relevance

The magnitude of the placebo effect found in this systematic review and meta-regression was dependent on the end point. Placebo control in trials of procedural interventions had the greatest impact on exercise-related, quality-of-life, and health care professional-assessed end points. Randomized clinical trials of procedural interventions may consider placebo control accordingly.

A double-blind, randomised, placebo-controlled trial of the coronary sinus Reducer in refractory angina: design and rationale of the ORBITA-COSMIC trial

The coronary sinus Reducer (CSR) is an hourglass-shaped device which creates an artificial stenosis in the coronary sinus. Whilst placebo-controlled data show an improvement in angina, these results are unreplicated and are the subject of further confirmatory research. The mechanism of action of this unintuitive therapy is unknown. The Coronary Sinus Reducer Objective Impact on Symptoms, MRI Ischaemia, and Microvascular Resistance (ORBITA-COSMIC) trial is a randomised, placebo-controlled, double-blind trial investigating the efficacy of the CSR. Patients with (i) established epicardial coronary artery disease, (ii) angina on maximally tolerated antianginal medication, (iii) evidence of myocardial ischaemia and (iv) no further options for percutaneous coronary intervention or coronary artery bypass grafting will be enrolled. Upon enrolment, angina and quality-of-life questionnaires, treadmill exercise testing and quantitative stress perfusion cardiac magnetic resonance (CMR) imaging will be performed. Participants will record their symptoms daily on a smartphone application throughout the trial. After a 2-week symptom assessment phase, participants will be randomised in the cardiac catheterisation laboratory to CSR or a placebo procedure. After 6 months of blinded follow-up, all prerandomisation tests will be repeated. A prespecified subgroup will undergo invasive coronary physiology assessment at prerandomisation and follow-up. The primary outcome is stress myocardial blood flow on CMR. Secondary outcomes include angina frequency, quality of life and treadmill exercise time. (ClinicalTrials.gov: NCT04892537).

A Placebo-Controlled Trial of Percutaneous Coronary Intervention for Stable Angina

BACKGROUND

Percutaneous coronary intervention (PCI) is frequently performed to reduce the symptoms of stable angina. Whether PCI relieves angina more than a placebo procedure in patients who are not receiving antianginal medication remains unknown.

METHODS

We conducted a double-blind, randomized, placebo-controlled trial of PCI in patients with stable angina. Patients stopped all antianginal medications and underwent a 2-week symptom assessment phase before randomization. Patients were then randomly assigned in a 1:1 ratio to undergo PCI or a placebo procedure and were followed for 12 weeks. The primary end point was the angina symptom score, which was calculated daily on the basis of the number of angina episodes that occurred on a given day, the number of antianginal medications prescribed on that day, and clinical events, including the occurrence of unblinding owing to unacceptable angina or acute coronary syndrome or death. Scores range from 0 to 79, with higher scores indicating worse health status with respect to angina.

RESULTS

A total of 301 patients underwent randomization: 151 to the PCI group and 150 to the placebo group. The mean (±SD) age was 64±9 years, and 79% were men. Ischemia was present in one cardiac territory in 242 patients (80%), in two territories in 52 patients (17%), and in three territories in 7 patients (2%). In the target vessels, the median fractional flow reserve was 0.63 (interquartile range, 0.49 to 0.75), and the median instantaneous wave-free ratio was 0.78 (interquartile range, 0.55 to 0.87). At the 12-week follow-up, the mean angina symptom score was 2.9 in the PCI group and 5.6 in the placebo group (odds ratio, 2.21; 95% confidence interval, 1.41 to 3.47; P<0.001). One patient in the placebo group had unacceptable angina leading to unblinding. Acute coronary syndromes occurred in 4 patients in the PCI group and in 6 patients in the placebo group.

CONCLUSIONS

Among patients with stable angina who were receiving little or no antianginal medication and had objective evidence of ischemia, PCI resulted in a lower angina symptom score than a placebo procedure, indicating a better health status with respect to angina. (Funded by the National Institute for Health and Care Research Imperial Biomedical Research Centre and others; ORBITA-2 ClinicalTrials.gov number, NCT03742050.).

Challenges of conducting a randomised placebo-controlled trial of spinal surgery: the SUcceSS trial of lumbar spine decompression

Although placebo-controlled trials are considered the gold standard for evaluating the efficacy of healthcare interventions, they can be perceived to be controversial and challenging to conduct for surgical treatments. The SUcceSS trial is the first placebo-controlled trial of lumbar decompression surgery for symptomatic lumbar canal stenosis. The SUcceSS trial has experienced common issues affecting the implementation of randomised placebo-controlled surgery trials, accentuated by the COVID-19 pandemic. Using the SUcceSS trial as an example, we discuss key challenges and mitigation strategies specific to the conduct of a randomised placebo-controlled surgical trial. Overall, the key lessons learned were (i) involving key stakeholders early and throughout the trial design phase may increase clinician and patient willingness to participate in a placebo-controlled trial of surgical interventions, (ii) additional resources (e.g. budget, staff time) are likely required to successfully operationalise trials of this nature, (iii) the level of placebo fidelity, timing of randomisation relative to intervention delivery, and nuances of the surgical procedure under investigation should be considered carefully. Findings are based on one example of a placebo-controlled surgical trial; however, researchers may benefit from employing or building from the strategies described and lessons learned when designing or implementing future trials of this nature.

How do pilot and feasibility studies inform randomised placebo-controlled trials in surgery? A systematic review

INTRODUCTION

Randomised controlled trials (RCTs) with a placebo comparator are considered the gold standard study design when evaluating healthcare interventions. These are challenging to design and deliver in surgery. Guidance recommends pilot and feasibility work to optimise main trial design and conduct; however, the extent to which this occurs in surgery is unknown.

METHOD

A systematic review identified randomised placebo-controlled surgical trials. Articles published from database inception to 31 December 2020 were retrieved from Ovid-MEDLINE, Ovid-EMBASE and CENTRAL electronic databases, hand-searching and expert knowledge. Pilot/feasibility work conducted prior to the RCTs was then identified from examining citations and reference lists. Where studies explicitly stated their intent to inform the design and/or conduct of the future main placebo-controlled surgical trial, they were included. Publication type, clinical area, treatment intervention, number of centres, sample size, comparators, aims and text about the invasive placebo intervention were extracted.

RESULTS

From 131 placebo surgical RCTs included in the systematic review, 47 potentially eligible pilot/feasibility studies were identified. Of these, four were included as true pilot/feasibility work. Three were original articles, one a conference abstract; three were conducted in orthopaedic surgery and one in oral and maxillofacial surgery. All four included pilot RCTs, with an invasive surgical placebo intervention, randomising 9-49 participants in 1 or 2 centres. They explored the acceptability of recruitment and the invasive placebo intervention to patients and trial personnel, and whether blinding was possible. One study examined the characteristics of the proposed invasive placebo intervention using in-depth interviews.

CONCLUSION

Published studies reporting feasibility/pilot work undertaken to inform main placebo surgical trials are scarce. In view of the difficulties of undertaking placebo surgical trials, it is recommended that pilot/feasibility studies are conducted, and more are reported to share key findings and optimise the design of main RCTs.

PROSPERO REGISTRATION NUMBER

CRD42021287371.

Understanding crossovers and potential ways to mitigate the problem: Lessons from influential trials on lumbar microdiscectomy

BACKGROUND

Lumbar microdiscectomy is the most frequent surgical intervention used in the treatment of sciatica from herniated lumbar discs. Many discectomy trials have been plagued with an excessive number of crossovers that have rendered results inconclusive.

METHODS

We review the design and results of influential lumbar microdiscectomy trials. We also discuss the various strategies that have been used to decrease the number of crossovers or to mitigate the effects of crossovers on analyses.

RESULTS

Randomized trials on lumbar discectomy were affected by crossover rates of 8% to 42%. Various strategies that have been used to decrease that number or to mitigate the effects on results include: patient selection, blinding (placebo-controlled trials), an immediate access to surgery for the surgical group (but limited access to surgery for the conservative group), shortening the follow-up period necessary to reach the primary outcome measure, postponing crossovers to surgery after determination of the primary outcome, and modifying the primary outcome measure to include treatment failures. Crossovers should be anticipated and compensated for by increasing the number of participants.

CONCLUSION

Non-adherence to randomly allocated management options can deprive trials of the statistical power needed to inform clinical care. Crossovers and ways to mitigate related problems should be anticipated at the time of trial design.

Research objectives and general considerations for pragmatic clinical trials of pain treatments: IMMPACT statement

ABSTRACT

Many questions regarding the clinical management of people experiencing pain and related health policy decision-making may best be answered by pragmatic controlled trials. To generate clinically relevant and widely applicable findings, such trials aim to reproduce elements of routine clinical care or are embedded within clinical workflows. In contrast with traditional efficacy trials, pragmatic trials are intended to address a broader set of external validity questions critical for stakeholders (clinicians, healthcare leaders, policymakers, insurers, and patients) in considering the adoption and use of evidence-based treatments in daily clinical care. This article summarizes methodological considerations for pragmatic trials, mainly concerning methods of fundamental importance to the internal validity of trials. The relationship between these methods and common pragmatic trials methods and goals is considered, recognizing that the resulting trial designs are highly dependent on the specific research question under investigation. The basis of this statement was an Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) systematic review of methods and a consensus meeting. The meeting was organized by the Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks (ACTTION) public-private partnership. The consensus process was informed by expert presentations, panel and consensus discussions, and a preparatory systematic review. In the context of pragmatic trials of pain treatments, we present fundamental considerations for the planning phase of pragmatic trials, including the specification of trial objectives, the selection of adequate designs, and methods to enhance internal validity while maintaining the ability to answer pragmatic research questions.

Further considerations for placebo controls in surgical trials

The use of invasive placebo controls in surgical trials can be challenging. The ASPIRE guidance, published in the Lancet in 2020, provided advice for the design and conduct of surgical trials with an invasive placebo control. Based on a more recent international expert workshop in June 2022, we now provide further insights into this topic. These include the purpose and design of invasive placebo controls, patient information provision and how findings from these trials may be used to inform decision-making.

Surgical versus non-surgical treatment for sciatica: systematic review and meta-analysis of randomised controlled trials

OBJECTIVE

To investigate the effectiveness and safety of surgery compared with non-surgical treatment for sciatica.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

Medline, Embase, CINAHL, Cochrane Central Register of Controlled Trials, ClinicalTrials.gov, and the World Health Organisation International Clinical Trials Registry Platform from database inception to June 2022.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Randomised controlled trials comparing any surgical treatment with non-surgical treatment, epidural steroid injections, or placebo or sham surgery, in people with sciatica of any duration due to lumbar disc herniation (diagnosed by radiological imaging).

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers extracted data. Leg pain and disability were the primary outcomes. Adverse events, back pain, quality of life, and satisfaction with treatment were the secondary outcomes. Pain and disability scores were converted to a scale of 0 (no pain or disability) to 100 (worst pain or disability). Data were pooled using a random effects model. Risk of bias was assessed with the Cochrane Collaboration's tool and certainty of evidence with the grading of recommendations assessment, development, and evaluation (GRADE) framework. Follow-up times were into immediate term (≤six weeks), short term (>six weeks and ≤three months), medium term (>three and <12 months), and long term (at 12 months).

RESULTS

24 trials were included, half of these investigated the effectiveness of discectomy compared with non-surgical treatment or epidural steroid injections (1711 participants). Very low to low certainty evidence showed that discectomy, compared with non-surgical treatment, reduced leg pain: the effect size was moderate at immediate term (mean difference -12.1 (95% confidence interval -23.6 to -0.5)) and short term (-11.7 (-18.6 to -4.7)), and small at medium term (-6.5 (-11.0 to -2.1)). Negligible effects were noted at long term (-2.3 (-4.5 to -0.2)). For disability, small, negligible, or no effects were found. A similar effect on leg pain was found when comparing discectomy with epidural steroid injections. For disability, a moderate effect was found at short term, but no effect was observed at medium and long term. The risk of any adverse events was similar between discectomy and non-surgical treatment (risk ratio 1.34 (95% confidence interval 0.91 to 1.98)).

CONCLUSION

Very low to low certainty evidence suggests that discectomy was superior to non-surgical treatment or epidural steroid injections in reducing leg pain and disability in people with sciatica with a surgical indication, but the benefits declined over time. Discectomy might be an option for people with sciatica who feel that the rapid relief offered by discectomy outweighs the risks and costs associated with surgery.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42021269997.

Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article II): a meta-analysis relating methods to trial results

ABSTRACT

Sham interventions in randomized clinical trials (RCTs) of physical, psychological, and self-management (PPS) therapies for pain are highly variable in design and believed to contribute to poor internal validity. However, it has not been formally tested whether the extent to which sham controls resemble the treatment under investigation consistently affects trial outcomes, such as effect sizes, differential attrition, participant expectancy, and blinding effectiveness. Placebo- or sham-controlled RCTs of PPS interventions of clinical pain populations were searched in 12 databases. The similarity of control interventions to the experimental treatment was rated across 25 features. Meta-regression analyses assessed putative links between employed control interventions, observed effect sizes in pain-related outcomes, attrition, and blinding success. The sample included 198 unique control interventions, dominated by manual therapy and chronic musculoskeletal pain research. Meta-analyses indicated small-to-moderate benefits of active treatments over control interventions, across subgroups of manual therapies, exercise, and rehabilitation, and psychological intervention trials. Multiple meta-regression modelling demonstrated that similarity between sham control and tested interventions predicted variability in pain-related outcomes, attrition, and blinding effectiveness. Influential variables were differences relating to the extent of intervention exposure, participant experience, and treatment environments. The results support the supposed link between blinding methods and effect sizes, based on a large and systematically sourced overview of methods. However, challenges to effective blinding are complex and often difficult to discern from trial reports. Nonetheless, these insights have the potential to change trial design, conduct, and reporting and will inform guideline development.

Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article I): a systematic review and description of methods

ABSTRACT

Blinding is challenging in randomised controlled trials of physical, psychological, and self-management therapies for pain, mainly because of their complex and participatory nature. To develop standards for the design, implementation, and reporting of control interventions in efficacy and mechanistic trials, a systematic overview of currently used sham interventions and other blinding methods was required. Twelve databases were searched for placebo or sham-controlled randomised clinical trials of physical, psychological, and self-management treatments in a clinical pain population. Screening and data extraction were performed in duplicate, and trial features, description of control methods, and their similarity to the active intervention under investigation were extracted (protocol registration ID: CRD42020206590). The review included 198 unique control interventions, published between 2008 and December 2021. Most trials studied people with chronic pain, and more than half were manual therapy trials. The described control interventions ranged from clearly modelled based on the active treatment to largely dissimilar control interventions. Similarity between control and active interventions was more frequent for certain aspects (eg, duration and frequency of treatments) than others (eg, physical treatment procedures and patient sensory experiences). We also provide an overview of additional, potentially useful methods to enhance blinding, as well as the reporting of processes involved in developing control interventions. A comprehensive picture of prevalent blinding methods is provided, including a detailed assessment of the resemblance between active and control interventions. These findings can inform future developments of control interventions in efficacy and mechanistic trials and best-practice recommendations.

Surgical interventions for Ménière's disease

BACKGROUND

Ménière's disease is a condition that causes recurrent episodes of vertigo, associated with hearing loss and tinnitus. First-line treatments often involve dietary or lifestyle changes, medication or local (intratympanic) treatments. However, surgery may also be considered for people with persistent or severe symptoms. The efficacy of different surgical interventions at preventing vertigo attacks, and their associated symptoms, is currently unclear.

OBJECTIVES

To evaluate the benefits and harms of surgical interventions versus placebo or no treatment in people with Ménière's disease.

SEARCH METHODS

The Cochrane ENT Information Specialist searched the Cochrane ENT Register; Central Register of Controlled Trials (CENTRAL); Ovid MEDLINE; Ovid Embase; Web of Science; ClinicalTrials.gov; ICTRP and additional sources for published and unpublished trials. The date of the search was 14 September 2022.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and quasi-RCTs in adults with definite or probable Ménière's disease comparing ventilation tubes, endolymphatic sac surgery, semi-circular canal plugging/obliteration, vestibular nerve section or labyrinthectomy with either placebo (sham surgery) or no treatment. We excluded studies with follow-up of less than three months, or with a cross-over design (unless data from the first phase of the study could be identified).  DATA COLLECTION AND ANALYSIS: We used standard Cochrane methods. Our primary outcomes were: 1) improvement in vertigo (assessed as a dichotomous outcome - improved or not improved), 2) change in vertigo (assessed as a continuous outcome, with a score on a numerical scale) and 3) serious adverse events. Our secondary outcomes were: 4) disease-specific health-related quality of life, 5) change in hearing, 6) change in tinnitus and 7) other adverse effects. We considered outcomes reported at three time points: 3 to < 6 months, 6 to ≤ 12 months and > 12 months. We used GRADE to assess the certainty of evidence for each outcome.  MAIN RESULTS: We included two studies with a total of 178 participants. One evaluated ventilation tubes compared to no treatment, the other evaluated endolymphatic sac decompression compared to sham surgery.  Ventilation tubes We included a single RCT of 148 participants with definite Ménière's disease. It was conducted in a single centre in Japan from 2010 to 2013. Participants either received ventilation tubes with standard medical treatment, or standard medical treatment alone, and were followed up for two years. Some data were reported on the number of participants in whom vertigo resolved, and the effect of the intervention on hearing. Our other primary and secondary outcomes were not reported in this study. This is a single, small study and for all outcomes the certainty of evidence was low or very low. We are unable to draw meaningful conclusions from the numerical results. Endolymphatic sac decompression We also included one RCT of 30 participants that compared endolymphatic sac decompression with sham surgery. This was a single-centre study conducted in Denmark during the 1980s. Follow-up was predominantly conducted at one year, but additional follow-up continued for up to nine years in some participants. Some data were reported on hearing and vertigo (both improvement in vertigo and change in vertigo), but our other outcomes of interest were not reported. Again, this is a single, very small study and we rated the certainty of the evidence as very low for all outcomes. We are therefore unable to draw meaningful conclusions from the numerical results.  AUTHORS' CONCLUSIONS: We are unable to draw clear conclusions about the efficacy of these surgical interventions for Ménière's disease. We identified evidence for only two of our five proposed comparisons, and we assessed all the evidence as low- or very low-certainty. This means that we have very low confidence that the effects reported are accurate estimates of the true effect of these interventions. Many of the outcomes that we planned to assess were not reported by the studies, such as the impact on quality of life, and adverse effects of the interventions. Consensus on the appropriate outcomes to measure in studies of Ménière's disease is needed (i.e. a core outcome set) in order to guide future studies in this area and enable meta-analyses of the results. This must include appropriate consideration of the potential harms of treatment, as well as the benefits.

The challenges of a randomised placebo-controlled trial of CTO PCI vs. placebo with optimal medical therapy: The ORBITA-CTO pilot study design and protocol

Background

Percutaneous coronary intervention (PCI) for coronary chronic total occlusion (CTO) has been performed for the improvement of symptoms and quality of life in patients with stable angina. The ORBITA study demonstrated the role of the placebo effect in contemporary PCI in non-CTO chronic coronary syndromes. However, the benefit of CTO PCI beyond that of a placebo has not been demonstrated.

Aims

The ORBITA-CTO pilot study will be a double-blind, placebo-controlled study of CTO PCI randomising patients who have: (1) been accepted by a CTO operator for PCI; (2) experienced symptoms due to a CTO; (3) evidence of ischaemia; (4) evidence of viability within the CTO territory; and (5) a J-CTO score ≤3.

Methods

Patients will undergo medication optimisation that will ensure they are on at least a minimum amount of anti-anginals and complete questionnaires. Patients will record their symptoms on an app daily throughout the study. Patients will undergo randomisation procedures, including an overnight stay, and be discharged the following day. All anti-anginals will be stopped after randomisation and re-initiated on a patient-led basis during the 6-month follow-up period. At follow-up, patients will undergo repeat questionnaires and unblinding, with a further 2-week unblinded follow-up.

Results

The co-primary outcomes are feasibility (blinding) in this cohort and angina symptom score using an ordinal clinical outcome scale for angina. Secondary outcomes include changes in quality-of-life measures, Seattle Angina Questionnaire (SAQ), peak VO2, and anaerobic threshold on the cardiopulmonary exercise test.

Conclusion

The feasibility of a placebo-controlled CTO PCI study will lead to future studies assessing efficacy. The impact of CTO PCI on angina measured using a novel daily symptom app may provide improved fidelity in assessing symptoms in patients with CTO's.

Is laparoscopic excision for superficial peritoneal endometriosis helpful or harmful? Protocol for a double-blinded, randomised, placebo-controlled, three-armed surgical trial

INTRODUCTION

Placebo-controlled surgical designs are recommended to ascertain treatment effects for elective surgeries when there is genuine doubt about the effectiveness of the surgery. Some elective surgeries for pain have been unable to show an effect beyond sham surgery, suggesting contributions from contextual factors. However, the nature of contextual factors in elective surgery is largely unexplored. Further, methodological difficulties in placebo-controlled surgical trials impact the ability to estimate the effectiveness of a surgical procedure. These include an overall lack of testing the success of blinding, absence of comparison to a no-surgery control group and dearth of test for neuropathic pain.For women with peritoneal endometriosis, there is uncertainty regarding the pain-relieving effect of surgery. Surgery may put patients at risk of complications such as postsurgical neuropathic pain, without guarantees of sufficient pelvic pain relief. The planned placebo-controlled trial aims to examine the effect of surgery on pelvic pain, widespread pain and neuropathic pain symptoms in women with peritoneal endometriosis, and to test the contribution of contextual factors to pain relief.

METHODS AND ANALYSIS

One hundred women with peritoneal endometriosis will be randomised to either diagnostic laparoscopy with excision of endometrial tissue (active surgery), purely diagnostic laparoscopy (sham surgery) or delayed surgery (no-surgery control group). Outcomes include pelvic pain relief, widespread pain, neuropathic pain symptoms and quality of life. Contextual factors are also assessed. Assessments will be obtained at baseline and 1, 3 and 6 months postrandomisation. Mixed linear models will be used to compare groups over time on all outcome variables.

ETHICS AND DISSEMINATION

The trial is approved by the Regional Ethics Committee in the Central Denmark Region (1-10-72-152-20). The trial is funded by a PhD scholarship from Aarhus University, and supported by a grant from 'Helsefonden' (20-B-0448). Findings will be published in international peer-reviewed journals and disseminated at international conferences.

TRIAL REGISTRATION NUMBER

NCT05162794.

Are Outcomes of Acute Meniscus Root Tear Repair Better Than Debridement or Nonoperative Management? A Systematic Review

BACKGROUND

Meniscus root tears (MRTs) are defined as radial tears within 1 cm of the meniscus root insertion or an avulsion of the meniscus root itself. They lead to altered joint loading because of the failure to convert axial (compressive) loads into hoop stresses. Untreated MRTs can result in altered joint biomechanics and accelerated articular cartilage degeneration and the development of osteoarthritis (OA), yet optimal management remains unclear.

PURPOSE

To review treatment outcomes after acute MRTs by surgical repair, debridement, meniscectomy, or nonoperative treatment.

DESIGN

Systematic review; Level of evidence, 4.

METHODS

A systematic review of the evidence from human clinical studies was conducted with electronic searches of the PUBMED, Medline, EMBASE, and the Cochrane Library databases. One reviewer extracted the data and 2 reviewers assessed the risk of bias and performed synthesis of the evidence.

RESULTS

Eleven studies of low to moderate methodological quality were identified. All treatment options improved functional scores after >12 months. Arthroscopic repair may be associated with better functional outcomes when compared with partial meniscectomy and nonoperative management at 12-month follow-up. Radiographic progression of OA occurred in all treatment groups; there was some evidence that this was delayed after repair when compared with other treatments. Baseline severity of meniscal extrusion, varus malalignment, and pretreatment degeneration were predictors of poor functional outcomes. Age was not found to be an independent predictor of functional outcome.

CONCLUSION

The current level 3 and 4 evidence suggests that arthroscopic repair may result in slower progression of radiological deterioration compared with meniscectomy and nonoperative management. The current literature does not support the exclusion of patients from MRT repair on the basis of age. Patients undergoing acute MRT treatments (repair, debridement, or nonoperative) can be expected to experience improvement in functional outcomes after >12 months. The strength of conclusions are limited because of the paucity of high-quality studies on this subject. Further studies, preferably randomized sham controlled trials with function-oriented rehabilitation programs, are needed to compare treatment strategies and stratification of care based on the risk of meniscal extrusion.

REGISTRATION

CRD42018085092 (PROSPERO).

Nature-Derived Okra Gel as Strong Hemostatic Bioadhesive in Human Blood, Liver, and Heart Trauma of Rabbits and Dogs

Bioadhesive performance can be compromised due to bleeding. Bleeding increases mortality. Adhesives with hemostatic function are of great significance. A sustainable and robust hemostatic bioadhesive from okra is reported. The adhesive strength reaches around three and six-fold higher than commercial fibrin on pigskin and glass, respectively. The okra gel presents high-pressure resistance and great underwater adhesive strength. In human blood experiments, the okra gel can activate platelets, enhance the adhesion of activated platelets, and release coagulation factors XI and XII. By forming a fast gel layer and closely adhering to the wound, it can quickly stop bleeding in the liver and heart of rabbits and dogs. Meanwhile, okra gel can cause platelet activation at the wound site and further strengthen its hemostatic performance. It is biocompatible, biodegradable, and can promote wound healing and shows potential as a sustainable bioadhesive, especially in the scenario of significant hemorrhage.

Use of Placebo and Nonoperative Control Groups in Surgical Trials: A Systematic Review and Meta-analysis

IMPORTANCE

Nonspecific effects, particularly placebo effects, are thought to contribute significantly to the observed effect in surgical trials.

OBJECTIVE

To estimate the proportion of the observed effect of surgical treatment that is due to nonspecific effects (including the placebo effect).

DATA SOURCES

Published Cochrane reviews and updated, extended search of MEDLINE, Embase, and CENTRAL until March 2019.

STUDY SELECTION

Published randomized placebo-controlled surgical trials and trials comparing the effect of the same surgical interventions with nonoperative controls (ie, no treatment, usual care, or exercise program).

DATA EXTRACTION AND SYNTHESIS

Pairs of authors independently screened the search results, assessed full texts to identify eligible studies and the risk of bias of included studies, and extracted data. The proportion of all nonspecific effects was calculated as the change in the placebo control divided by the change in the active surgery and pooled in a random-effect meta-analysis. To estimate the magnitude of the placebo effect, we pooled the difference in outcome between placebo and nonoperative controls and used metaregression to estimate the association between the type of control group and the treatment effect (difference between the groups), adjusting for risk of bias, sample size, and type of outcome.

MAIN OUTCOMES AND MEASURES

Between- and within-group effect sizes expressed as Hedges g.

RESULTS

In this review, 100 trials were included comprising data from 62 trials with placebo controls (3 also included nonoperative controls), and 38 trials with nonoperative controls (32 interventions; 10 699 participants). Risk of bias across trials was comparable except for performance and detection bias, which was high in trials with nonoperative controls. The mean nonspecific effects accounted for 67% (95% CI, 61% to 73%) of the observed change after surgery; however, this varied widely between different procedures. The estimated surgical placebo effect had a standardized mean difference (SMD) of 0.13 (95% CI, -0.26 to 0.51). Trials with placebo and nonoperative controls found comparable treatment effects (SMD, -0.09 [95% CI, -0.35 to 0.18]; 15 interventions; 73 between-group effects; adjusted analysis: SMD, -0.11 [95% CI, -0.37 to 0.15]).

CONCLUSIONS AND RELEVANCE

In this review, the change in health state after surgery was composed largely of nonspecific effects, but no evidence supported a large placebo effect. Placebo-controlled surgical trials may be redundant when trials with nonoperative controls consistently report no substantial association from surgery compared with nonoperative treatment.

Bias in Hand Surgical Randomized Controlled Trials: Systematic Review and Meta-Epidemiological Study

PURPOSE

Inappropriately reported or conducted studies may decrease the quality of care due to under- or overestimation of the benefits or harms of interventions. Our aim was to evaluate how often hand surgical randomized controlled trials (RCTs) use and report adequate methods to ensure internal validity, and whether inadequate reporting or methods are associated with the magnitude of treatment effect estimates.

METHODS

Data Sources were the Cochrane Central Register of Controlled Trials, MEDLINE, and Embase databases until November 2020. We included published RCTs investigating the effects of any surgical intervention in the hand and wrist region. We assessed internal validity using the Cochrane Risk of Bias (RoB) tool for 6 domains: selection, performance, detection, attrition, selective reporting, and "other" bias. We extracted the primary outcome and calculated the effect size for each study. We used mixed-effect meta-regression to assess whether the RoB modified the magnitude of the effects.

RESULTS

For 207 assessed trials, the RoB was unclear or high for 72% in selection, 93% in performance, 88% in detection, 25% in attrition, 22% in selective reporting, and 34% in the "other" bias domain. Trials with a high or unclear risk of selection bias yielded 0.28 standardized mean difference (95% confidence interval, 0.02-0.55) larger effect sizes compared to studies with a low risk. Risks of bias for other domains did not modify the intervention effects. The risk for selection bias declined over time: the odds ratio for a high or unclear RoB was 0.90 (95% confidence interval, 0.85-0.95) per additional year of publication CONCLUSIONS: The internal validity and credibility of hand surgical RCTs can be improved by using established methods to achieve true randomization, blinding of the participants and study personnel, publishing the trial protocol and avoiding selective reporting of the outcomes, and reporting the trial as recommended in the Consolidated Standards of Reporting Trials statement.

CLINICAL RELEVANCE

Clinicians should be aware that RCTs that do not use or report proper randomization and allocation concealment may overestimate the treatment effects.

What is the evidence for efficacy, effectiveness and safety of surgical interventions for plantar fasciopathy? A systematic review

Aims

To systematically review randomised control trials (RCT’s) assessing the effectiveness and safety of surgical interventions in adults with plantar fasciopathy (PF).

Materials and methods

We searched MEDLINE, EMBASE, Web of Science, Google Scholar, the Cochrane Central Register of Controlled Trials, trial registries and references lists. RCT’s comparing surgical interventions with non-surgical or surgical comparisons in adults with PF were included. Primary outcomes were changes in first step pain severity/intensity, and incidence/nature of adverse events. Secondary outcomes included foot and ankle related disability/function, health related quality of life, cost effectiveness, changes in other reported measures of pain and medication use. Data were extracted at short-term (≤3 months post-intervention), medium-term (>3months—≤6 months post-intervention) or long-term (>6 months—≤2 years post-treatment). Certainty of evidence was evaluated using the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE).

Results

From 3620 screened records, we included 8 studies comprising 345 patients. Substantial variation across trials precluded meta-analysis, hence a narrative synthesis was conducted. We judged all studies to have high risk of bias. For all outcome comparisons our GRADE judgement for the certainty of the evidence was very low. Three studies compared one type of surgery with another largely showing little to no difference in outcomes for pain, function or quality of life. Five studies compared surgery with non-surgical interventions—three providing very low certainty evidence that surgery may improve pain and function at long-term follow-up compared to non-surgical comparisons, whereas two studies provided no long-term between-group differences. Reporting of adverse events were inadequate, inconsistent or absent across all studies.

Conclusion

There is a paucity of high certainty evidence to support or refute the effectiveness and safety of surgical interventions in the management of PF. We make recommendations for improving the evidence base in this field.

Patient and clinician characteristics and preferences for increasing participation in placebo surgery trials: a scoping review of attributes to inform a discrete choice experiment

Background

Orthopaedic surgeries include some of the highest volume surgical interventions globally; however, studies have shown that a significant proportion of patients report no clinically meaningful improvement in pain or function after certain procedures. As a result, there is increasing interest in conducting randomised placebo-controlled trials in orthopaedic surgery. However, these frequently fail to reach recruitment targets suggesting a need to improve trial design to encourage participation. The objective of this study was to systematically scope the available evidence on patient and clinician values and preferences which may influence the decision to participate in placebo surgery trial.

Methods

A systematic review was conducted via a literature search in the MEDLINE, Embase, PsycInfo, CINAHL, and EconLit databases as of 19 July 2021, for studies of any design (except commentaries or opinion pieces) based on two key concepts: patient and clinician characteristics, values and preferences, and placebo surgery trials.

Results

Of 3424 initial articles, we retained 18 eligible studies. Characteristics, preferences, values, and attitudes of patients (including levels of pain/function, risk/benefit perception, and altruism) and of clinicians (including concerns regarding patient deception associated with placebo, and experience/training in research) influenced their decisions to participate in placebo-controlled trials. Furthermore, some aspects of trial design, including randomisation procedures, availability of the procedure outside of the trial, and the information and consent procedures used, also influenced decisions to participate.

Conclusion

Participant recruitment is a significant challenge in placebo surgery trials, and individual decisions to participate appear to be sensitive to preferences around treatment. Understanding and quantifying the role patient and clinician preferences may play in surgical trials may contribute to the optimisation of the design and implementation of clinical trials in surgery.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-022-06277-x.

Music-Induced Analgesia in Healthy Participants Is Associated With Expected Pain Levels but Not Opioid or Dopamine-Dependent Mechanisms

Music interventions accommodate the profound need for non-pharmacological pain treatment. The analgesic effect of listening to music has been widely demonstrated across studies. Yet, the specific mechanisms of action have still to be elucidated. Although the endogenous opioid and dopamine systems have been suggested to play an important role, a direct link has not been established. In addition, the involvement of placebo mechanisms is likely while largely unexplored. We examined the analgesic effect of music in healthy participants (n = 48) using a 3 × 3 within-subjects design with pharmacological manipulations and a matched, auditory control for music. Participants were exposed to thermal pain stimuli while listening to three auditory excerpts: music (active condition), nature sound (matched, auditory contextual condition), and noise (neutral control condition). The participants rated their expected and perceived pain levels in relation to each of the auditory excerpts. To investigate the involvement of the endogenous opioid and dopamine systems, the test session was performed three times on separate days featuring a double-blind randomized oral administration of naltrexone (opioid antagonist), haloperidol (dopamine antagonist), and an inactive agent (control). Our results support an analgesic effect of music. Contrary to current hypotheses, neither of the antagonists attenuated the effect of music. Yet, the participants' expectations for pain relief predicted their perceived pain levels during the auditory excerpts—even when controlling for a gradual learning effect. In conclusion, we demonstrate that the analgesic effect of music is at least partially mediated by expectations of an analgesic effect—a core mechanism in placebo effects—but not by opioid and dopamine-dependent mechanisms.

Evaluation of placebo fidelity and trial design methodology in placebo-controlled surgical trials of musculoskeletal conditions: a systematic review

ABSTRACT

The number of placebo surgical trials on musculoskeletal conditions is increasing, but little is known about the quality of their design and methods. This review aimed to (1) assess the level of placebo fidelity (ie, degree to which the placebo control mimicked the index procedure) in placebo trials of musculoskeletal surgery, (2) describe the trials' methodological features using the adapted Applying Surgical Placebo in Randomised Evaluations (ASPIRE) checklist, and (3) describe each trial's characteristics. We searched 4 electronic databases from inception until February 18, 2021, for randomised trials of surgery that included a placebo control for any musculoskeletal condition. Protocols and full text were used to assess placebo fidelity (categorised as minimal, low, or high fidelity). The adapted 26-item ASPIRE checklist was also completed on each trial. PROSPERO registration number: CRD42021202131. A total of 30,697 studies were identified in the search, and 22 placebo-controlled surgical trials of 2045 patients included. Thirteen trials (59%) included a high-fidelity placebo control, 7 (32%) used low fidelity, and 2 (9%) minimal fidelity. According to the ASPIRE checklist, included trials had good reporting of the "rationale and ethics" (68% overall) and "design" sections (42%), but few provided enough information on the "conduct" (13%) and "interpretation and translation" (11%) of the placebo trials. Most trials sufficiently reported their rationale and ethics, but interpretation and translation are areas for improvement, including greater stakeholder involvement. Most trials used a high-fidelity placebo procedure suggesting an emphasis on blinding and controlling for nonspecific effects.

Beyond the RCT: When are Randomized Trials Unnecessary for New Therapeutic Devices, and What Should We Do Instead?

OBJECTIVE

The aim of this study was to develop an evidence-based framework for evaluation of therapeutic devices, based on ethical principles and clinical evidence considerations.

SUMMARY BACKGROUND DATA

Nearly all medical products which do not work solely through chemical action are regulated as medical devices. Their huge range of purposes, mechanisms of action and risks pose challenges for regulation. High-profile implantable device failures have fuelled concerns about the level of clinical evidence needed for market approval. Calls for more rigorous evaluation lack clarity about what kind of evaluation is appropriate, and are commonly interpreted as meaning more randomized controlled trials (RCTs). These are valuable where devices are genuinely new and claim to offer measurable therapeutic benefits. Where this is not the case, RCTs may be inappropriate and wasteful.

METHODS

Starting with a set of ethical principles and basic precepts of clinical epidemiology, we developed a sequential decision-making algorithm for identifying when an RCT should be performed to evaluate new therapeutic devices, and when other methods, such as observational study designs and registry-based approaches, are acceptable.

RESULTS

The algorithm clearly defines a group of devices where an RCT is deemed necessary, and the associated framework indicates that an IDEAL 2b study should be the default clinical evaluation method where it is not.

CONCLUSIONS

The algorithm and recommendations are based on the principles of the IDEAL-D framework for medical device evaluation and appear eminently practicable. Their use would create a safer system for monitoring innovation, and facilitate more rapid detection of potential hazards to patients and the public.

Considerations for clinical trial design and conduct in the evaluation of novel advanced therapeutics in neurodegenerative disease

The recent advances in the development of potentially disease modifying cell and gene therapies for neurodegenerative disease has resulted in the production of a number of promising novel therapies which are now moving forward to clinical evaluation. The robust evaluation of these therapies pose a significant number of challenges when compared to more traditional evaluations of pharmacotherapy, which is the current mainstay of neurodegenerative disease symptom management. Indeed, there is an inherent complexity in the design and conduct of these trials at multiple levels. Here we discuss specific aspects requiring consideration in the context of investigating novel cell and gene therapies for neurodegenerative disease. This extends to overarching trial designs that could be employed and the factors that underpin design choices such outcome assessments, participant selection and methods for delivery of cell and gene therapies. We explore methods of data collection that may improve efficiency in trials of cell and gene therapy to maximize data sharing and collaboration. Lastly, we explore some of the additional context beyond efficacy evaluations that should be considered to ensure implementation across relevant healthcare settings.

Factors Underlying Patient and Surgeon Willingness to Participate in a Placebo Surgery Controlled trial: A Qualitative Investigation

Objective

To investigate the factors underlying willingness to participate in a hypothetical trial among patients and surgeons, to inform the design of future placebo surgery controlled trials.

Background

Placebo surgery controlled trials are the gold standard for testing the efficacy of surgical procedures. However, these trials commonly fail to meet the target sample size and terminate underpowered.

Methods

From October 2019 to July 2020, eligible patients were identified from the orthopedic waiting list at a single tertiary hospital and surgeons were identified from orthopedic clinics at three tertiary hospitals in Australia. Qualitative interviews explored factors underlying willingness to participate in a hypothetical trial, including understanding of trial concepts; attitudes; and trial design preferences. Data collection and analysis were conducted in parallel. Recruitment ceased when no new concepts emerged. Interview data were analyzed using reflexive thematic analysis.

Results

The majority of surgeons and only a few patients indicated a willingness to participate in a placebo surgery controlled trial. Factors underlying willingness were captured in four themes: (1) Understanding and attitudes toward placebo; (2) Attitudes towards randomization/perception of equipoise; (3) Perception of risk; and (4) Ethical concerns.

Conclusions

To optimize recruitment in the future, trialists may consider embedding strategies into the recruitment process that validate patients' symptoms, encourage an altruistic mindset, address surgeon biases, and involve surgeons in explaining trial concepts to patients. Trialists may also consider designing three arm trials that meet surgeons' preferences for a "low" and "high" fidelity placebo.

Placebo Effect of Sham Spine Procedures in Chronic Low Back Pain: A Systematic Review

Background

The literature lacks information about the characteristics of the placebo effect following sham spine procedures for chronic low back pain. We aim to evaluate the effect using pain score data from the sham arms of published trials.

Methods

Relevant trials were selected and reviewed. Baseline and post-procedure pain scores were collected. Each follow up pain score was considered an episode and compared to its baseline for significance. Patients and episodes were pooled and analyzed using three parameters: patient reported outcome measures (PROMs) (Oswestry Disability Index [ODI], Visual Analog Scale [VAS], Numerical Rating Scale [NRS] and Short Form-36 [SF]), anatomical targets (disc, facet, sacroiliac joint [SIJ], ramus communicans nerve [RCN], basivertebral nerve [BVN], and caudal) and follow up periods (early: 0–2, intermediate: >2–4 and late: >4–6) in months. The percentage of pooled patients in the episodes that had significant reduction in pain scores was termed placebo effect. The outcome was defining the magnitude of the placebo effect and determining if it was influenced by the three parameters.

Results

Seventeen studies that reported 535 patients and 55 pain scoring episodes were considered eligible. Significant reduction in pain scores was reported in 21 episodes. The overall placebo effect among the patients during the studied period was 53.2%. The rate ranged according to PROMs from 42.4% to 72.1%, anatomical targets from 11.1% to 100% and follow up periods from 47.9% to 59%. The placebo effect differed significantly between the various domains in the three parameters.

Conclusion

Placebo effect was observed in nearly half of the patients during the first 6 months following a sham spine procedure. The effect was influenced by utilized PROMs, anatomical target and follow up period. The findings should be considered in the design of new sham spine procedure trials. Further research is required to delineate the effect of bias on the findings.

Early-stage symptomatic osteoarthritis of the knee - time for action

Osteoarthritis (OA) remains the most challenging arthritic disorder, with a high burden of disease and no available disease-modifying treatments. Symptomatic early-stage OA of the knee (the focus of this Review) urgently needs to be identified and defined, as efficient early-stage case finding and diagnosis in primary care would enable health-care providers to proactively and substantially reduce the burden of disease through proper management including structured education, exercise and weight management (when needed) and addressing lifestyle-related risk factors for disease progression. Efforts to define patient populations with symptomatic early-stage knee OA on the basis of validated classification criteria are ongoing. Such criteria, as well as the identification of molecular and imaging biomarkers of disease risk and/or progression, would enable well-designed clinical studies, facilitate interventional trials, and aid the discovery and validation of cellular and molecular targets for novel therapies. Treatment strategies, relevant outcomes and ethical issues also need to be considered in the context of the cost-effective management of symptomatic early-stage knee OA. To move forwards, a multidisciplinary and sustained international effort involving all major stakeholders is required.

Placebo comparator group selection and use in surgical trials: the ASPIRE project including expert workshop

BACKGROUND

The use of placebo comparisons for randomised trials assessing the efficacy of surgical interventions is increasingly being considered. However, a placebo control is a complex type of comparison group in the surgical setting and, although powerful, presents many challenges.

OBJECTIVES

To provide a summary of knowledge on placebo controls in surgical trials and to summarise any recommendations for designers, evaluators and funders of placebo-controlled surgical trials.

DESIGN

To carry out a state-of-the-art workshop and produce a corresponding report involving key stakeholders throughout.

SETTING

A workshop to discuss and summarise the existing knowledge and to develop the new guidelines.

RESULTS

To assess what a placebo control entails and to assess the understanding of this tool in the context of surgery is considered, along with when placebo controls in surgery are acceptable (and when they are desirable). We have considered ethics arguments and regulatory requirements, how a placebo control should be designed, how to identify and mitigate risk for participants in these trials, and how such trials should be carried out and interpreted. The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Surgical placebos might be most appropriate when there is poor evidence for the efficacy of the procedure and a justified concern that results of a trial would be associated with a high risk of bias, particularly because of the placebo effect.

CONCLUSIONS

The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Feasibility work is recommended to optimise the design and implementation of randomised controlled trials. An outline for best practice was produced in the form of the Applying Surgical Placebo in Randomised Evaluations (ASPIRE) guidelines for those considering the use of a placebo control in a surgical randomised controlled trial.

LIMITATIONS

Although the workshop participants involved international members, the majority of participants were from the UK. Therefore, although every attempt was made to make the recommendations applicable to all health systems, the guidelines may, unconsciously, be particularly applicable to clinical practice in the UK NHS.

FUTURE WORK

Future work should evaluate the use of the ASPIRE guidelines in making decisions about the use of a placebo-controlled surgical trial. In addition, further work is required on the appropriate nomenclature to adopt in this space.

FUNDING

Funded by the Medical Research Council UK and the National Institute for Health Research as part of the Medical Research Council-National Institute for Health Research Methodology Research programme.

Treatment of hallux rigidus (HARD trial): study protocol of a prospective, randomised, controlled trial of arthrodesis versus watchful waiting in the treatment of a painful osteoarthritic first metatarsophalangeal joint

INTRODUCTION

Hallux rigidus is a common problem of pain and stiffness of the first metatarsophalangeal joint (MTPJ) caused mainly by degenerative osteoarthritis. Several operative techniques have been introduced for the treatment of this condition without high-quality evidence comparing surgical to non-surgical care. In this trial, the most common surgical procedure, arthrodesis, will be compared with watchful waiting in the management of hallux rigidus.

METHODS AND ANALYSIS

Ninety patients (40 years or older) with symptomatic first MTPJ osteoarthritis will be randomised to arthrodesis or watchful waiting in a ratio of 1:1. The primary outcome will be pain during walking, assessed using the 0-10 Numerical Rating Scale (NRS) at 1 year after randomisation. The secondary outcomes will be pain at rest (NRS), physical function (Manchester-Oxford Foot Questionnaire), patient satisfaction in terms of the patient-acceptable symptom state, health-related quality of life (EQ-5D-5L), activity level (The Foot and Ankle Ability Measure Sports subscale), use of analgesics or orthoses and the rate of complications. Our null hypothesis is that there will be no difference equal to or greater than the minimal important difference of the primary outcome measure between arthrodesis and watchful waiting. Our primary analysis follows an intention-to-treat principle.

ETHICS AND DISSEMINATION

The study protocol has been approved by the Ethics Committee of Helsinki and Uusimaa Hospital District, Finland. Written informed consent will be obtained from all the participants. We will disseminate the findings of this study through peer-reviewed publications and conference presentations.

PROTOCOL VERSION

21 June 2021 V.2.0.

TRIAL REGISTRATION NUMBER

NCT04590313.

Placebo Surgery Controlled Trials: Do They Achieve What They Set Out To Do? A Systematic Review

OBJECTIVE

To explore whether placebo surgery controlled trials achieve what they set out to do by investigating discrepancy between projected and actual design aspects of trials identified through systematic review methods.

SUMMARY BACKGROUND

Interest in placebo surgery controlled trials is growing in response to concerns regarding unnecessary surgery and the societal cost of low-value healthcare. As questions about the justifiability of using placebo controls in surgery have been addressed, attention is now being paid to more practical concerns.

METHODS

Six databases were searched from inception - May 2020 (MEDLINE, Embase, Emcare, APA PsycInfo, CINAHL, Cochrane Library). Placebo surgery controlled trials with a published protocol were included. Three authors extracted "projected" design aspects from protocols and "actual" design aspects from main findings papers. Absolute and relative difference between projected and actual design aspects were presented for each trial. Trials were grouped according to whether they met their target sample size ("completed") and were concluded in a timely fashion. Pairs of authors assessed risk of bias.

RESULTS

Of 24 trials with data available to analyse; 3 were completed and concluded within target timeframe; 10 were completed and concluded outside the target timeline; 4 were completed without clear target timeframes; 2 were incomplete and concluded within the target framework; 5 were incomplete and concluded outside the target timeline. Trials which reached the recruitment target underestimated trial duration by 88% and number of recruitment sites by 87%.

CONCLUSIONS

Trialists need to factor additional time and sites into future placebo surgery controlled trials. A robust reporting framework of projected and actual trial design is imperative for trialists to learn from their predecessors.

REVIEW REGISTRATION

PROSPERO (CRD42019133296).

Systematic reviews in surgery-recommendations from the Study Center of the German Society of Surgery

Background

Systematic reviews are an important tool of evidence-based surgery. Surgical systematic reviews and trials, however, require a special methodological approach.

Purpose

This article provides recommendations for conducting state-of-the-art systematic reviews in surgery with or without meta-analysis.

Conclusions

For systematic reviews in surgery, MEDLINE (via PubMed), Web of Science, and Cochrane Central Register of Controlled Trials (CENTRAL) should be searched. Critical appraisal is at the core of every surgical systematic review, with information on blinding, industry involvement, surgical experience, and standardisation of surgical technique holding special importance. Due to clinical heterogeneity among surgical trials, the random-effects model should be used as a default. In the experience of the Study Center of the German Society of Surgery, adherence to these recommendations yields high-quality surgical systematic reviews.

Recombinant human FGF-2 for the treatment of early-stage osteonecrosis of the femoral head: TRION, a single-arm, multicenter, Phase II trial

Aim: This study aimed to evaluate the 2-year outcomes from a clinical trial of recombinant human FGF-2 (rhFGF-2) for osteonecrosis of the femoral head (ONFH). Patients & methods: Sixty-four patients with nontraumatic, precollapse and large ONFHs were percutaneously administered with 800 μg rhFGF-2 contained in gelatin hydrogel. Setting the end point of radiological collapse, we analyzed the joint preservation period of the historical control. Changes in two validated clinical scores, bone regeneration and safety were evaluated. Results: Radiological joint preservation time was significantly higher in the rhFGF-2 group than in the control group. The ONFHs tended to improve to smaller ONFHs. The postoperative clinical scores significantly improved. Thirteen serious adverse events showed recovery. Conclusion: rhFGF-2 treatment increases joint preservation time with clinical efficacy, radiological bone regeneration and safety.

The effect of animated consent material on participants' willingness to enrol in a placebo-controlled surgical trial: a protocol for a randomised feasibility study

Background

Placebo-controlled surgical trials are recognised as the gold standard way to test the efficacy of a surgical procedure. Despite a rise in arthroscopic subacromial decompression (ASD) surgeries for the treatment of shoulder pain, only two placebo-controlled surgical trials have been conducted. These trials encountered significant recruitment challenges, threatening the external validity of findings. Difficulties with recruitment are common in clinical trials and likely to be amplified in placebo-controlled surgical trials. This mixed method feasibility trial aims to address the following questions: (i) Feasibility: What proportion of patients who have consented to undergo ASD report that they would be willing to enrol in a placebo-controlled trial for this procedure? (ii) Optimisation: Can patients’ willingness to enrol in, or understanding of, such a trial be improved by supplementing written consent materials with a brief visual animation that outlines the details of the trial? And (iii) exploration: What factors influence patients stated willingness to enrol in such a trial, and how do they believe the recruitment process could be improved?

Methods

This study aims to recruit 80 patients on the waiting list for ASD. Participants will be randomised (1:1) to either view a brief video animation explaining the hypothetical placebo-controlled trial in addition to written information or to written information only. Participants in both groups will be required to state if they would be willing to opt-in to the hypothetical ASD trial after immediately being presented with the consent material and again 1 week after completion of the consent process. Patients in both groups will also be required to complete a measure of trial literacy. Twenty participants will be purposively sampled to take part in an embedded qualitative study exploring understanding of trial concepts and factors contributing to willingness to opt-in.

Discussion

This feasibility study will provide evidence for optimising participant recruitment into a placebo-controlled trial of ASD by consenting patients using animated trial information in addition to written information. This pilot and feasibility data may also be relevant to placebo-controlled surgical trials more broadly, which are characterised by recruitment challenges.

Trial registration

ANZCTR, ACTRN12620001132932, date October 30, 2020

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-021-00782-7.

Laparoscopic treatment of isolated superficial peritoneal endometriosis for managing chronic pelvic pain in women: study protocol for a randomised controlled feasibility trial (ESPriT1)

BACKGROUND

Endometriosis (where endometrial-like tissue is found outside the uterus) affects ~ 176 million women worldwide and can lead to debilitating pelvic pain. Three subtypes of endometriosis exist, with ~ 80% of women having superficial peritoneal endometriosis (SPE). Endometriosis is diagnosed by laparoscopy and, if SPE is found, gynaecologists usually remove it surgically. However, many women get limited pain relief from surgical removal of SPE. We plan to undertake a future large trial where women who have only SPE found at initial laparoscopy are randomly allocated to have surgical removal (excision or ablation) of SPE, or not. Ultimately, we want to determine whether surgical removal improves overall symptoms and quality of life, or whether surgery is of no benefit, exacerbates symptoms, or even causes harm. The primary objective of this feasibility study is to determine what proportion of women with suspected SPE undergoing diagnostic laparoscopy will agree to randomisation. The secondary objectives are to determine if there are differences in key prognostic parameters between eligible women that agree to be randomised and those that decline; how many women having laparoscopy for investigation of chronic pelvic pain are eligible for the trial; the range of treatment effects and variability in outcomes and the most acceptable methods of recruitment, randomisation and assessment tools.

METHODS

We will recruit up to 90 women with suspected SPE undergoing diagnostic laparoscopy over a 9-month recruitment period in four Scottish hospitals and randomise them 1:1 to either diagnostic laparoscopy alone (with a sham port to achieve blinding of the allocation) or surgical removal of endometriosis. Baseline characteristics, e.g. age, index of social deprivation, ethnicity, and intensity/duration of pain will be collected. Participants will be followed up by online questionnaires assessing pain, physical and emotional function at baseline, 3 months, 6 months and 12 months.

DISCUSSION

Recruitment to a randomised controlled trial to assess the effectiveness of surgery for endometriosis may be challenging because of preconceived ideas about treatment success amongst patients and clinicians. We have designed this study to assess feasibility of recruitment and to inform the design of our future definitive trial.

TRIAL REGISTRATION

ClincicalTrials.gov, NCT04081532 STATUS: Recruiting.

Fake news and fake research: Why meta-research matters more than ever

Research is in a crisis of credibility, and this is to the peril of all paediatricians. Billions of dollars are being wasted each year because research is not planned, badly conducted or poorly reported, and this is on a background of rapidly reducing research budgets. How can paediatricians, families and patients make informed treatment choices if the evidence base is absent or not trustworthy? This article discusses why meta-research now matters more than ever, how it can help solve this crisis of credibility and how this should lead to more efficient and effective clinical care. The field of meta-research or research-on-research is the ultimate big picture approach to identifying and solving issues of bias, error, misconduct and waste in research. Meta-researchers value authenticity over aesthetics and quality over quantity. The utility of meta-research does not rely on accusations or critical assessments of individual research, but through highlighting where and how the scientific method and research standards across all fields can be improved. Meta-researchers study, analyse and critique the research pathway, focusing on elements such as methods (how to conduct), evaluation (how to test), reporting (how to communicate), reproducibility (how to verify) and incentives (how to reward). In the current climate it is now more critical than ever that we make use of meta-research and prioritise high-quality high-impact research, ultimately leading to improved patient outcomes.

TIDieR-Placebo: A guide and checklist for reporting placebo and sham controls

BACKGROUND

Placebo or sham controls are the standard against which the benefits and harms of many active interventions are measured. Whilst the components and the method of their delivery have been shown to affect study outcomes, placebo and sham controls are rarely reported and often not matched to those of the active comparator. This can influence how beneficial or harmful the active intervention appears to be. Without adequate descriptions of placebo or sham controls, it is difficult to interpret results about the benefits and harms of active interventions within placebo-controlled trials. To overcome this problem, we developed a checklist and guide for reporting placebo or sham interventions.

METHODS AND FINDINGS

We developed an initial list of items for the checklist by surveying experts in placebo research (n = 14). Because of the diverse contexts in which placebo or sham treatments are used in clinical research, we consulted experts in trials of drugs, surgery, physiotherapy, acupuncture, and psychological interventions. We then used a multistage online Delphi process with 53 participants to determine which items were deemed to be essential. We next convened a group of experts and stakeholders (n = 16). Our main output was a modification of the existing Template for Intervention Description and Replication (TIDieR) checklist; this allows the key features of both active interventions and placebo or sham controls to be concisely summarised by researchers. The main differences between TIDieR-Placebo and the original TIDieR are the explicit requirement to describe the setting (i.e., features of the physical environment that go beyond geographic location), the need to report whether blinding was successful (when this was measured), and the need to present the description of placebo components alongside those of the active comparator.

CONCLUSIONS

We encourage TIDieR-Placebo to be used alongside TIDieR to assist the reporting of placebo or sham components and the trials in which they are used.