Recruitment in Clinical Trials: The Use of Zelen's Prerandomization in Recent Neurovascular Studies

Ethical Problems of Observational Studies and Big Data Compared to Randomized Trials

The temptation to use prospective observational studies (POS) instead of conducting difficult trials (RCTs) has always existed, but with the advent of powerful computers and large databases, it can become almost irresistible. We examine the potential consequences, were this to occur, by comparing two hypothetical studies of a new treatment: one RCT, and one POS. The POS inevitably submits more patients to inferior research methodology. In RCTs, patients are clearly informed of the research context, and 1:1 randomized allocation between experimental and validated treatment balances risks for each patient. In POS, for each patient, the risks of receiving inferior treatment are impossible to estimate. The research context and the uncertainty are down-played, and patients and clinicians are at risk of becoming passive research subjects in studies performed from an outsider's view, which potentially has extraneous objectives, and is conducted without their explicit, autonomous, and voluntary involvement and consent.

A Pragmatic Randomized Trial Comparing Surgical Clipping and Endovascular Treatment of Unruptured Intracranial Aneurysms

BACKGROUND AND PURPOSE

Surgical clipping and endovascular treatment are commonly used in patients with unruptured intracranial aneurysms. We compared the safety and efficacy of the 2 treatments in a randomized trial.

MATERIALS AND METHODS

Clipping or endovascular treatments were randomly allocated to patients with one or more 3- to 25-mm unruptured intracranial aneurysms judged treatable both ways by participating physicians. The study hypothesized that clipping would decrease the incidence of treatment failure from 13% to 4%, a composite primary outcome defined as failure of aneurysm occlusion, intracranial hemorrhage during follow-up, or residual aneurysms at 1 year, as adjudicated by a core lab. Safety outcomes included new neurologic deficits following treatment, hospitalization of >5 days, and overall morbidity and mortality (mRS > 2) at 1 year. There was no blinding.

RESULTS

Two hundred ninety-one patients were enrolled from 2010 to 2020 in 7 centers. The 1-year primary outcome, ascertainable in 290/291 (99%) patients, was reached in 13/142 (9%; 95% CI, 5%-15%) patients allocated to surgery and in 28/148 (19%; 95% CI, 13%-26%) patients allocated to endovascular treatments (relative risk: 2.07; 95% CI, 1.12-3.83; P = .021). Morbidity and mortality (mRS >2) at 1 year occurred in 3/143 and 3/148 (2%; 95% CI, 1%-6%) patients allocated to surgery and endovascular treatments, respectively. Neurologic deficits (32/143, 22%; 95% CI, 16%-30% versus 19/148, 12%; 95% CI, 8%-19%; relative risk: 1.74; 95% CI, 1.04-2.92; P = .04) and hospitalizations beyond 5 days (69/143, 48%; 95% CI, 40%-56% versus 12/148, 8%; 95% CI, 5%-14%; relative risk: 0.18; 95% CI, 0.11-0.31; P < .001) were more frequent after surgery.

CONCLUSIONS

Surgical clipping is more effective than endovascular treatment of unruptured intracranial aneurysms in terms of the frequency of the primary outcome of treatment failure. Results were mainly driven by angiographic results at 1 year.

Patient Selection in a Pragmatic Study on the Management of Patients with Brain Arteriovenous Malformations

BACKGROUND

The Treatment of Brain Arteriovenous Malformations Study (TOBAS) is an all-inclusive pragmatic study comprising 2 randomized clinical trials (RCTs). Patients excluded from the RCTs are followed in parallel treatment and observation registries, allowing a comparison between RCT and registry patients.

METHODS

The first randomized clinical trial (RCT-1) offers 1:1 randomized allocation of intervention versus conservative management for patients with arteriovenous malformation (AVM). The second randomized clinical trial (RCT-2) allocates 1:1 pre-embolization or no pre-embolization to surgery or radiosurgery patients judged treatable with or without embolization. Characteristics of RCT patients are reported and compared to registry patients.

RESULTS

From June 2014 to May 2021, 1010 patients with AVM were recruited; 498 patients were observed and 373 were included in the treatment registries. Randomized allocation in RCT-1 was applied to 139 (26%) of the 512 patients (including 127 of 222 [57%] with unruptured AVMs) considered for curative treatment. RCT-1 AVM patients differed (in rupture status, Spetzler-Martin grade and baseline modified Rankin Score) from those in the observation or treatment registries (P < 0.001). Most patients had small (<3 cm; 71%) low-grade (Spetzler-Martin I-II; 64%) unruptured (91%) AVMs. The allocated management was conservative (n = 71) or curative (n = 68), using surgery (n = 39), embolization (n = 16), or stereotactic radiosurgery (n = 13). Pre-embolization was considered for 179/309 (58%) patients allocated/assigned to surgery or stereotactic radiosurgery; 87/179 (49%) were included in RCT-2. RCT-2 patient AVMs differed in size, eloquence and grade from patients of the pre-embolization registry (P < 0.01). Most had small (<3 cm in 82%) low-grade (83%) AVMs in non-eloquent brain (64%).

CONCLUSIONS

Patients included in the RCTs differ significantly from registry patients. Meaningful results can be obtained if multiple centers actively participate in the TOBAS RCTs.

Endovascular treatment of brain arteriovenous malformations: clinical outcomes of patients included in the registry of a pragmatic randomized trial

OBJECTIVE

The role of endovascular treatment in the management of patients with brain arteriovenous malformations (AVMs) remains uncertain. AVM embolization can be offered as stand-alone curative therapy or prior to surgery or stereotactic radiosurgery (SRS) (pre-embolization). The Treatment of Brain AVMs Study (TOBAS) is an all-inclusive pragmatic study that comprises two randomized trials and multiple registries.

METHODS

Results from the TOBAS curative and pre-embolization registries are reported. The primary outcome for this report is death or dependency (modified Rankin Scale [mRS] score > 2) at last follow-up. Secondary outcomes include angiographic results, perioperative serious adverse events (SAEs), and permanent treatment-related complications leading to an mRS score > 2.

RESULTS

From June 2014 to May 2021, 1010 patients were recruited in TOBAS. Embolization was chosen as the primary curative treatment for 116 patients and pre-embolization prior to surgery or SRS for 92 patients. Clinical and angiographic outcomes were available in 106 (91%) of 116 and 77 (84%) of 92 patients, respectively. In the curative embolization registry, 70% of AVMs were ruptured, and 62% were low-grade AVMs (Spetzler-Martin grade I or II), while the pre-embolization registry had 70% ruptured AVMs and 58% low-grade AVMs. The primary outcome of death or disability (mRS score > 2) occurred in 15 (14%, 95% CI 8%–22%) of the 106 patients in the curative embolization registry (4 [12%, 95% CI 5%–28%] of 32 unruptured AVMs and 11 [15%, 95% CI 8%–25%] of 74 ruptured AVMs) and 9 (12%, 95% CI 6%–21%) of the 77 patients in the pre-embolization registry (4 [17%, 95% CI 7%–37%] of 23 unruptured AVMs and 5 [9%, 95% CI 4%–20%] of 54 ruptured AVMs) at 2 years. Embolization alone was confirmed to occlude the AVM in 32 (30%, 95% CI 21%–40%) of the 106 curative attempts and in 9 (12%, 95% CI 6%–21%) of 77 patients in the pre-embolization registry. SAEs occurred in 28 of the 106 attempted curative patients (26%, 95% CI 18%–35%, including 21 new symptomatic hemorrhages [20%, 95% CI 13%–29%]). Five of the new hemorrhages were in previously unruptured AVMs (n = 32; 16%, 95% CI 5%–33%). Of the 77 pre-embolization patients, 18 had SAEs (23%, 95% CI 15%–34%), including 12 new symptomatic hemorrhages [16%, 95% CI 9%–26%]). Three of the hemorrhages were in previously unruptured AVMs (3/23; 13%, 95% CI 3%–34%).

CONCLUSIONS

Embolization as a curative treatment for brain AVMs was often incomplete. Hemorrhagic complications were frequent, even when the specified intent was pre-embolization before surgery or SRS. Because the role of endovascular treatment remains uncertain, it should preferably, when possible, be offered in the context of a randomized trial.

Surgical treatment of brain arteriovenous malformations: clinical outcomes of patients included in the registry of a pragmatic randomized trial

OBJECTIVE

The Treatment of Brain Arteriovenous Malformations Study (TOBAS) is a pragmatic study that includes 2 randomized trials and registries of treated or conservatively managed patients. The authors report the results of the surgical registry.

METHODS

TOBAS patients are managed according to an algorithm that combines clinical judgment and randomized allocation. For patients considered for curative treatment, clinicians selected from surgery, endovascular therapy, or radiation therapy as the primary curative method, and whether observation was a reasonable alternative. When surgery was selected and observation was deemed unreasonable, the patient was not included in the randomized controlled trial but placed in the surgical registry. The primary outcome of the trial was mRS score > 2 at 10 years (at last follow-up for the current report). Secondary outcomes include angiographic results, perioperative serious adverse events, and permanent treatment-related complications leading to mRS score > 2.

RESULTS

From June 2014 to May 2021, 1010 patients were recruited at 30 TOBAS centers. Surgery was selected for 229/512 patients (44%) considered for curative treatment; 77 (34%) were included in the surgery versus observation randomized trial and 152 (66%) were placed in the surgical registry. Surgical registry patients had 124/152 (82%) ruptured and 28/152 (18%) unruptured arteriovenous malformations (AVMs), with the majority categorized as low-grade Spetzler-Martin grade I-II AVM (118/152 [78%]). Thirteen patients were excluded, leaving 139 patients for analysis. Embolization was performed prior to surgery in 78/139 (56%) patients. Surgical angiographic cure was obtained in 123/139 all-grade (89%, 95% CI 82%-93%) and 105/110 low-grade (95%, 95% CI 90%-98%) AVM patients. At the mean follow-up of 18.1 months, 16 patients (12%, 95% CI 7%-18%) had reached the primary safety outcome of mRS score > 2, including 11/16 who had a baseline mRS score ≥ 3 due to previous AVM rupture. Serious adverse events occurred in 29 patients (21%, 95% CI 15%-28%). Permanent treatment-related complications leading to mRS score > 2 occurred in 6/139 patients (4%, 95% CI 2%-9%), 5 (83%) of whom had complications due to preoperative embolization.

CONCLUSIONS

The surgical treatment of brain AVMs in the TOBAS registry was curative in 88% of patients. The participation of more patients, surgeons, and centers in randomized trials is needed to definitively establish the role of surgery in the treatment of unruptured brain AVMs. Clinical trial registration no.: NCT02098252 (ClinicalTrials.gov).

Flow Diversion in the Treatment of Intracranial Aneurysms: A Pragmatic Randomized Care Trial

BACKGROUND AND PURPOSE

Flow diversion is a recent endovascular treatment for intracranial aneurysms. We compared the safety and efficacy of flow diversion with the alternative standard management options.

MATERIALS AND METHODS

A parallel group, prerandomized, controlled, open-label pragmatic trial was conducted in 3 Canadian centers. The trial included all patients considered for flow diversion. A Web-based platform 1:1 randomly allocated patients to flow diversion or 1 of 4 alternative standard management options (coiling with/without stent placement, parent vessel occlusion, surgical clipping, or observation) as prespecified by clinical judgment. Patients ineligible for alternative standard management options were treated with flow diversion in a registry. The primary safety outcome was death or dependency (mRS > 2) at 3 months. The composite primary efficacy outcome included the core lab-determined angiographic presence of a residual aneurysm, aneurysm rupture, progressive mass effect during follow-up, or death or dependency (mRS > 2) at 3-12 months.

RESULTS

Between May 2011 and November 2020, three hundred twenty-three patients were recruited: Two hundred seventy-eight patients (86%) had treatment randomly allocated (139 to flow diversion and 139 to alternative standard management options), and 45 (14%) received flow diversion in the registry. Patients in the randomized trial frequently had unruptured (83%), large (52% ≥10 mm) carotid (64%) aneurysms. Death or dependency at 3 months occurred in 16/138 patients who underwent flow diversion and 12/137 patients receiving alternative standard management options (relative risk, 1.33; 95% CI, 0.65-2.69; P = .439). A poor primary efficacy outcome was found in 30.9% (43/139) with flow diversion and 45.6% (62/136) of patients receiving alternative standard management options, with an absolute risk difference of 14.7% (95% CI, 3.3%-26.0%; relative risk, 0.68; 95% CI, 0.50-0.92; P = .014).

CONCLUSIONS

For patients with mostly unruptured, large, anterior circulation (carotid) aneurysms, flow diversion was more effective than the alternative standard management option in terms of angiographic outcome.

Understanding the problems with recruitment in surgical randomized trials: A lesson from landmark trials on temporal lobe epilepsy

BACKGROUND

Surgical randomized trials are difficult to accomplish. One major problem is recruitment of a sufficient number of patients to address the clinical problem.

METHODS

We review the various ways patient recruitment in surgical RCTs can be promoted. We examine two landmark trials on the surgical treatment of temporal lobe epilepsy (TLE), one that was successful, and one which did not attain the target number of participants.

DISCUSSION

Both designs of the Canadian and American trials of surgery for TLE included a benefit to participants: the Canadian trial gave a chance to have immediate access to investigation and treatment, as compared to a 1 year delay (considered 'standard care' in that center), while the American trial offered free surgical management to both arms. Patients were recruited and treatments randomly allocated prior to knowing for certain whether they were surgical candidates or not. This design choice may have helped circumvent the 'equipoise problem'. The Canadian trial offered participation to drug-resistant patients that were already routinely referred to surgical centers, while the success of the American trial which limited recruitment to the early period of drug resistance was dependent on a change of practice of referring clinicians which did not materialize.

CONCLUSION

The surgical treatment of drug-resistant temporal lobe epilepsy has been validated using RCT methods. Ways to promote participation in surgical trials should be further investigated.

Recruitment in a pragmatic randomized trial on the management of unruptured intracranial aneurysms

OBJECTIVES

The Comprehensive Aneurysm Management (CAM) study is a pragmatic trial designed to manage UIA patients within a care research framework.

METHOD

CAM is an all-inclusive study. Management options are allocated according to an algorithm combining pre-randomization and clinical judgment. Eligible patients are offered 1:1 randomized allocation of intervention versus conservative management and 1:1 randomization allocation of surgical versus endovascular treatment. Ineligible patients are registered. The primary outcome is survival without dependency (mRS<3) at 10 years. All UIA patients at one center are reported.

RESULTS

Between February 2020 and July 2021, 403 UIA patients were recruited: 179 (44%) in one of the RCTs and 224 (56%) in one of the registries. Conservative management was recommended for 205/403 patients (51%); of 198 (49%) patients considered for curative treatment, 159 (80%) were randomly allocated conservative (n=81) or curative treatment (n=78). These patients were younger and had larger aneurysms than those in the observation registry (P = .004). In 39/198 patients (20%), conservative management was not considered reasonable (17 patients were recommended endovascular, 2 surgery, and 20 the RCT comparing endovascular with surgical treatment). In total, 70 patients were recruited in the RCT comparing surgery and endovascular treatment. After informed discussion at time of consent, 141/159 patients (89%) agreed with the randomly allocated management plan, while 11% crossed-over to the alternative management option.

CONCLUSION

CAM was successfully integrated into routine practice. Meaningful conclusions can be obtained if multiple centers actively participate in the trial.

Middle Cerebral Artery Aneurysm Trial (MCAAT): A randomized care trial comparing surgical and endovascular management of MCA aneurysm patients

BACKGROUND

Whether the best management of middle cerebral artery (MCA) aneurysm patients is surgical or endovascular remains uncertain, with little evidence to guide decision-making. A randomized care trial offering MCA aneurysm patients a 50% chance of surgical and a 50% chance of endovascular management may optimize outcomes in the presence of uncertainty.

METHODS

The Middle Cerebral Artery Aneurysm Trial (MCAAT) is an investigator-initiated, multi-center, parallel group, prospective, 1:1 randomized controlled clinical trial. All adult patients with MCA aneurysms, ruptured or unruptured, amenable to surgical and endovascular treatment can be included. The composite primary outcome is 'Treatment Success': i) occlusion or exclusion of the aneurysm using the allocated treatment modality; ii) no intracranial hemorrhage during follow-up; iii) no retreatment of the target aneurysm during follow-up, iv) no residual aneurysm on angiographic follow-up and v) independence (mRS <3) at 1 year. The trial tests two versions of the same hypothesis (one for ruptured and one for unruptured MCA aneurysm patients): Surgical management will lead to a 15% absolute increase in the proportion of patients reaching Treatment Success from 55% to 70% (ruptured) or from 75% to 90% (unruptured aneurysm patients) compared to endovascular treatment (any method). In this pragmatic trial, outcome evaluations are by treating physicians, except for 1 year angiographic results which will be core lab assessed. The trial will be monitored by an independent data safety monitoring committee to assure safety of participants. MCAAT is registered at clinicaltrials.gov: NCT05161377.

CONCLUSION

Patients with MCA aneurysms can be optimally managed within a care trial protocol.

Surgical or Endovascular Management of Middle Cerebral Artery Aneurysms: A Randomized Comparison

OBJECTIVE

There are few randomized data comparing clipping and coiling for middle cerebral artery (MCA) aneurysms. We analyzed results from patients with MCA aneurysms enrolled in the CURES (Collaborative UnRuptured Endovascular vs. Surgery) and ISAT-2 (International Subarachnoid Aneurysm Trial II) randomized trials.

METHODS

Both trials are investigator-led parallel-group 1:1 randomized studies. CURES includes patients with 3-mm to 25-mm unruptured intracranial aneurysms (UIAs), and ISAT-2 includes patients with ruptured aneurysms (RA) for whom uncertainty remains after ISAT. The primary outcome measure of CURES is treatment failure: 1) failure to treat the aneurysm, 2) intracranial hemorrhage during follow-up, or 3) residual aneurysm at 1 year. The primary outcome of ISAT-2 is death or dependency (modified Rankin Scale score >2) at 1 year. One-year angiographic outcomes are systematically recorded.

RESULTS

There were 100 unruptured and 71 ruptured MCA aneurysms. In CURES, 90 patients with UIA have been treated and 10 await treatment. Surgical and endovascular management of unruptured MCA aneurysms led to treatment failure in 3/42 (7%; 95% confidence interval [CI], 0.02-0.19) for clipping and 13/48 (27%; 95% CI, 0.17-0.41) for coiling (P = 0.025). All 71 patients with RA have been treated. In ISAT-2, patients with ruptured MCA aneurysms managed surgically had died or were dependent (modified Rankin Scale score >2) in 7/38 (18%; 95% CI, 0.09-0.33) cases, and 8/33 (24%; 95% CI, 0.13-0.41) for endovascular. One-year imaging results were available in 80 patients with UIA and 62 with RA. Complete aneurysm occlusion was found in 30/40 (75%; 95% CI, 0.60-0.86) patients with UIA allocated clipping, and 14/40 (35%; 95% CI, 0.22-0.50) patients with UIA allocated coiling. Complete aneurysm occlusion was found in 24/34 (71%; 95% CI, 0.54-0.83) patients with RA allocated clipping, and 15/28 (54%; 95% CI, 0.36-0.70) patients with RA allocated coiling.

CONCLUSIONS

Randomized data from 2 trials show that better efficacy may be obtained with surgical management of patients with MCA aneurysms.

Practicing outcome-based medical care using pragmatic care trials

The current separation between medical research and care is an obstacle to essential aspects of good medical practice: the verification that care interventions actually deliver the good outcomes they promise, and the use of scientific methods to optimize care under uncertainty. Pragmatic care trials have been designed to address these problems. Care trials are all-inclusive randomized trials integrated into care. Every item of trial design is selected in the best medical interest of participating patients. Care trials can eventually show what constitutes good medical practice based on patient outcomes. In the meantime, care trials give clinicians and patients the scientific methods necessary for optimization of medical care when no one really knows what to do.We report the progress of 9 randomized care trials that were used to guide the endovascular or surgical management of 1212 patients with acute stroke, intracranial aneurysms, and arteriovenous malformations in a single center in an elective or acute care context. Care trials were used to address long-standing dilemmas regarding rival medical, surgical, or endovascular management options or to offer innovative instead of standard treatments. The trial methodology, by replacing unrepeatable treatment decisions by 1:1 randomized allocation whenever reliable knowledge was not available, had an immediate impact, transforming unverifiable dogmatic medical practice into verifiable outcome-based medical care. We believe the approach is applicable to all medical or surgical domains, but widespread adoption may require the revision of many currently prevalent views regarding the role of research in clinical practice.

Comprehensive Aneurysm Management (CAM): An All-Inclusive Care Trial for Unruptured Intracranial Aneurysms

BACKGROUND

In the absence of randomized evidence, the optimal management of patients with unruptured intracranial aneurysms (UIA) remains uncertain.

METHODS

Comprehensive Aneurysm Management (CAM) is an all-inclusive care trial combined with a registry. Any patient with a UIA (no history of intracranial hemorrhage within the previous 30 days) can be recruited, and treatment allocation will follow an algorithm combining clinical judgment and randomization. Patients eligible for at least 2 management options will be randomly allocated 1:1 to conservative or curative treatment. Minimization will be used to balance risk factors, using aneurysm size (≥7 mm), location (anterior or posterior circulation), and age <60 years.

RESULTS

The CAM primary outcome is survival without neurologic dependency (modified Rankin Scale [mRS] score <3) at 10 years. Secondary outcome measures include the incidence of subarachnoid hemorrhage during follow-up and related morbidity and mortality; morbidity and mortality related to endovascular treatment or surgical treatment of the UIA at 1 year; overall morbidity and mortality at 1, 5, and 10 years; when relevant, duration of hospitalization; and, when relevant, discharge to a location other than home. The primary hypothesis for patients randomly allocated to at least 2 options, 1 of which is conservative management, is that active UIA treatment will reduce the 10-year combined neurologic morbidity and mortality (mRS score >2) from 24% to 16%. At least 961 patients recruited from at least 20 centers over 4 years will be needed for the randomized portion of the study.

CONCLUSIONS

Patients with unruptured intracranial aneurysms can be comprehensively managed within the context of an all-inclusive care trial.

The RISE trial: A Randomized Trial on Intra-Saccular Endobridge devices

BACKGROUND

Wide-necked bifurcation aneurysms (WNBA) are a difficult subset of aneurysms to successfully repair endovascularly, and a number of treatment adjuncts have been designed to improve on the results of coiling, including stenting and flow diversion of the parent vessel. Surgical clipping is commonly performed for certain WNBAs, such as middle cerebral aneurysms, in some centres. Intra-saccular flow diversion (ISFD) using the Woven Endo-Bridge (WEB) or similar devices, has been developed as a new endovascular alternative to coiling for WNBAs. Meta-analyses of case series suggest satisfactory results, both in terms of safety and efficacy, but in the absence of randomized evidence, whether ISFD leads to better outcomes for patients with WNBA remains unknown. There is a need to offer ISFD within the context of a randomized care trial.

METHODS

The proposed trial is a multicentre, randomized controlled care trial comparing ISFD and best conventional management option (surgical or endovascular), as determined by the treating physician prior to randomized allocation. At least 250 patients will be recruited in at least 10 centres over a four-year period, and followed for one year, to show that ISFD can increase the incidence of successful therapy from 75 to 90% of patients, defined as complete or near-complete occlusion of the aneurysm AND a good clinical outcome (mRS ≤ 2) at one year. The trial will be followed by an independent data safety monitoring committee to assure the safety of participants.

CONCLUSION

Introduction of intra-saccular flow diversion can be accomplished within a care trial context.