1
|
Zwart K, van Nassau SCMW, van der Baan FH, Koopman M, Snaebjornsson P, van Gestel AJ, Vink GR, Roodhart JML. Efficacy-effectiveness analysis on survival in a population-based real-world study of BRAF-mutated metastatic colorectal cancer patients treated with encorafenib-cetuximab. Br J Cancer 2024; 131:110-116. [PMID: 38769450 PMCID: PMC11231318 DOI: 10.1038/s41416-024-02711-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 04/30/2024] [Accepted: 05/01/2024] [Indexed: 05/22/2024] Open
Abstract
BACKGROUND Encorafenib-cetuximab has been approved for pretreated BRAFV600E-mutated metastatic colorectal cancer (mCRC) patients based on efficacy demonstrated in the randomized phase III BEACON trial. The aim of this real-world effectiveness study is to improve knowledge on the generalizability of trial results. METHODS This population-based real-world study includes all mCRC patients in the Netherlands treated with encorafenib-cetuximab since approval. Individual patient data and pathology reports were collected. Overall survival (OS) was compared to BEACON and subgroup analyses were conducted for patients who would have been eligible and ineligible for BEACON. RESULTS 166 patients were included with a median follow-up time of 14.5 months. Median OS was 6.7 months (95% CI:6.0-8.3) and differed from BEACON (9.3 months; 95% CI:8.0-11.3, p-value 0.002). Thirty-six percent of real-world patients would have been ineligible for the BEACON trial. Trial ineligible subgroups with symptomatic brain metastases and WHO performance status ≥2 had the poorest median OS of 5.0 months (95% CI:4.0-NR) and 3.9 months (95% CI:2.4-NR). CONCLUSION This real-world cohort of mCRC patients treated with encorafenib-cetuximab showed a clinically relevant efficacy-effectiveness gap for OS. The chance of survival benefit from encorafenib-cetuximab in patients with brain metastases and/or WHO performance status ≥2 is negligible as neither efficacy nor effectiveness has been demonstrated.
Collapse
Affiliation(s)
- Koen Zwart
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Sietske C M W van Nassau
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Frederieke H van der Baan
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Department of Epidemiology, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Miriam Koopman
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Petur Snaebjornsson
- Department of Pathology, Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Anna J van Gestel
- Department of Research and Development, Netherlands Comprehensive Cancer Organisation (IKNL), Utrecht, The Netherlands
| | - Geraldine R Vink
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Department of Research and Development, Netherlands Comprehensive Cancer Organisation (IKNL), Utrecht, The Netherlands
| | - Jeanine M L Roodhart
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands.
| |
Collapse
|
2
|
Vieujean S, Lindsay JO, D'Amico F, Ahuja V, Silverberg MS, Sood A, Yamamoto-Furusho JK, Nagahori M, Watanabe M, Koutroubakis IE, Foteinogiannopoulou K, Avni Biron I, Walsh A, Outtier A, Nordestgaard RLM, Abreu MT, Dubinsky M, Siegel C, Louis E, Dotan I, Reinisch W, Danese S, Rubin DT, Peyrin-Biroulet L. Analysis of Clinical Trial Screen Failures in Inflammatory Bowel Diseases [IBD]: Real World Results from the International Organization for the study of IBD. J Crohns Colitis 2024; 18:548-559. [PMID: 37864829 DOI: 10.1093/ecco-jcc/jjad180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Indexed: 10/23/2023]
Abstract
BACKGROUND Recruitment for randomized controlled trials [RCTs] in inflammatory bowel diseases [IBD] has substantially dropped over time. This study aimed to assess reasons why IBD patients are not included in sponsored multicentre phase IIb-III RCTs. METHODS All IOIBD members [n = 58] were invited to participate. We divided barriers to participation as follows: [1] reasons patients with active IBD were not deemed appropriate for an RCT; [2] reasons qualified patients did not wish to participate; and [3] reasons for screen failure [SF] in patients agreeing to participate. We assess these in a 4-week prospective study including, consecutively, all patients with symptomatic disease for whom a treatment change was required. In addition, we performed a 6-month retrospective study to further evaluate reasons for SF. RESULTS A total of 106 patients (60 male [56.6%], 63 Crohn's disease [CD] [59.4%]), from ten centres across the world, were included in the prospective study. An RCT has not been proposed to 65 of them [mainly due to eligibility criteria]. Of the 41 patients to whom an RCT was offered, eight refused [mainly due to reluctance to receive placebo] and 28 agreed to participate. Among these 28 patients, five failed their screening and 23 were finally included in an RCT. A total of 107 patients (61 male [57%], 67 CD [62.6%]), from 13 centres worldwide, were included in our retrospective study of SFs. The main reason was insufficient disease activity. CONCLUSION This first multicentre study analysing reasons for non-enrolment in IBD RCTs shows that we lose patients at each step. Eligibility criteria, the risk of placebo assignment, and insufficient disease activity were part of the main barriers.
Collapse
Affiliation(s)
- Sophie Vieujean
- Hepato-Gastroenterology and Digestive Oncology, University Hospital CHU of Liège, Liège, Belgium
| | - James O Lindsay
- Blizard Institute, Barts and the London School of Medicine and Dentistry, London, UK; Department of Gastroenterology, The Royal London Hospital, Barts Health NHS Trust, London, UK
| | - Ferdinando D'Amico
- Department of Gastroenterology and Endoscopy, IRCCS San Raffaele Hospital and Vita-Salute San Raffaele University, Milan, Italy
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Milan, Italy
| | - Vineet Ahuja
- Department of Gastroenterology, All India Institute of Medical Sciences, New Delhi, India
| | | | - Ajit Sood
- Department of Gastroenterology, Dayanand Medical College and Hospital, Ludhiāna, Punjab, India
| | - Jesus K Yamamoto-Furusho
- Inflammatory Bowel Disease Clinic, Department of Gastroenterology, Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán, Tlalpa, Mexico
| | - Masakazu Nagahori
- Department of Gastroenterology and Hepatology, Tokyo Medical and Dental University, Tokyo, Japan
| | - Mamoru Watanabe
- Advanced Research Institute, Tokyo Medical and Dental University, Tokyo, Japan
| | - Ioannis E Koutroubakis
- Department of Gastroenterology, University Hospital of Heraklion, Heraklion, Crete, Greece
| | | | - Irit Avni Biron
- Division of Gastroenterology, Rabin Medical Center, Petah Tikva, Israel, and Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Alissa Walsh
- Translational Gastroenterology Unit, John Radcliffe Hospital, Oxford University Hospitals NHS Foundation Trust and NIHR Biomedical Research Centre, Oxford, UK
| | - An Outtier
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, KU Leuven, Leuven, Belgium
| | | | - Maria T Abreu
- Division of Gastroenterology, Department of Medicine, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Marla Dubinsky
- Division of Pediatric Gastroenterology and Nutrition, Icahn School of Medicine, Mount Sinai, New York, NY, USA
| | - Corey Siegel
- Inflammatory Bowel Disease Center, Section of Gastroenterology and Hepatology, Dartmouth-Hitchcock Medical Center, Lebanon, NH, USA
| | - Edouard Louis
- Hepato-Gastroenterology and Digestive Oncology, University Hospital CHU of Liège, Liège, Belgium
| | - Iris Dotan
- Division of Gastroenterology, Rabin Medical Center, Petah Tikva, Israel, and Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Walter Reinisch
- Department of Internal Medicine III, Medical University of Vienna, Vienna, Austria
| | - Silvio Danese
- Department of Gastroenterology and Endoscopy, IRCCS San Raffaele Hospital and Vita-Salute San Raffaele University, Milan, Italy
| | - David T Rubin
- University of Chicago Medicine Inflammatory Bowel Disease Center, Chicago, IL, USA
| | - Laurent Peyrin-Biroulet
- Department of Gastroenterology, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- INSERM, NGERE, University of Lorraine, F-54000 Nancy, France
- INFINY Institute, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- FHU-CURE, Nancy University Hospital, F-54500 Vandœuvre-lès-Nancy, France
- Groupe Hospitalier privé Ambroise Paré - Hartmann, Paris IBD center, 92200 Neuilly sur Seine, France
- Division of Gastroenterology and Hepatology, McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
3
|
Nadler MB, Wilson BE, Desnoyers A, Valiente CM, Saleh RR, Amir E. Magnitude of effect and sample size justification in trials supporting anti-cancer drug approval by the US Food and Drug Administration. Sci Rep 2024; 14:459. [PMID: 38172190 PMCID: PMC10764749 DOI: 10.1038/s41598-023-50694-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 12/22/2023] [Indexed: 01/05/2024] Open
Abstract
Approval of drugs is based on randomized trials observing statistically significant superiority of an experimental agent over a standard. Statistical significance results from a combination of effect size and sampling, with larger effect size more likely to translate to population effectiveness. We assess sample size justification in trials supporting cancer drug approvals. We identified US FDA anti-cancer drug approvals for solid tumors from 2015 to 2019. We extracted data on study characteristics, statistical plan, accrual, and outcomes. Observed power (Pobs) was calculated based on completed study characteristics and observed hazard ratio (HRobs). Studies were considered over-sampled if Pobs > expected with HRobs similar or worse than expected or if Pobs was similar to expected with HRobs worse than expected. We explored associations with over-sampling using logistic regression. Of 75 drug approvals (reporting 94 endpoints), 21% (20/94) were over-sampled. Over-sampling was associated with immunotherapy (OR: 5.5; p = 0.04) and associated quantitatively but not statistically with targeted therapy (OR: 3.0), open-label trials (OR: 2.5), and melanoma (OR: 4.6) and lung cancer (OR: 2.17) relative to breast cancer. Most cancer drug approvals are supported by trials with justified sample sizes. Approximately 1 in 5 endpoints are over-sampled; benefit observed may not translate to clinically meaningful real-world outcomes.
Collapse
Affiliation(s)
- Michelle B Nadler
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and Department of Medicine, The University of Toronto, Toronto, ON, Canada.
| | - Brooke E Wilson
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and Department of Medicine, The University of Toronto, Toronto, ON, Canada
- Kingston Health Sciences Centre, Kingston, ON, Canada
| | - Alexandra Desnoyers
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and Department of Medicine, The University of Toronto, Toronto, ON, Canada
- Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Consolacion Molto Valiente
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and Department of Medicine, The University of Toronto, Toronto, ON, Canada
| | - Ramy R Saleh
- Division of Medical Division of Medical Oncology, McGill University Health Centre, Montreal, QC, Canada
| | - Eitan Amir
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and Department of Medicine, The University of Toronto, Toronto, ON, Canada
| |
Collapse
|
4
|
Orvain C, Othus M, Johal G, Hunault-Berger M, Appelbaum FR, Walter RB. Evolution of eligibility criteria for non-transplant randomized controlled trials in adults with acute myeloid leukemia. Leukemia 2022; 36:2002-2008. [PMID: 35660798 DOI: 10.1038/s41375-022-01624-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 05/25/2022] [Accepted: 05/27/2022] [Indexed: 11/09/2022]
Abstract
Eligibility criteria for clinical trials are intended to select suitable study subjects but can limit trial participation and generalization of results. While reported for other cancers, non-enrollment rates and evolution of eligibility criteria over time have so far not been studied for randomized controlled trials (RCTs) involving adults with acute myeloid leukemia (AML). Among 3698 studies published between 2010 and 2020, including 447 involving prospective clinical trials, we identified 75 phase three RCTs testing non-transplant therapies for adults with AML. Only 31 studies (41%) provided information on non-enrollment; in these studies, the median non-enrollment rate was 23%, primarily attributed to restrictive eligibility criteria. In 95% of trials, eligibility criteria were reported with the total number per trial increasing over time (P < 0.001), particularly in industry-funded trials. A total of 27 eligibility criteria were used across trials, mostly concerning comorbidities or performance status, with eight of them becoming more common over time. The concordance with recent ASCO - Friends of Cancer Research eligibility criteria recommendations greatly varied, from 35% to 99%. Together, our analyses suggest that the ability to generalize results from non-transplant RCTs may be increasingly limited because of high non-enrollment rates and increasingly restrictive eligibility criteria.
Collapse
Affiliation(s)
- Corentin Orvain
- Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, WA, USA.,Department of Medicine, Division of Hematology, University of Washington, Seattle, WA, USA.,Maladies du Sang, CHU d'Angers, Angers, France.,Fédération Hospitalo-Universitaire Grand-Ouest Acute Leukemia, FHU-GOAL, Angers, France.,Université d'Angers, Inserm UMR 1307, CNRS UMR 6075, Nantes Université, CRCI2NA, F-49000, Angers, France
| | - Megan Othus
- Public Health Sciences Division, Fred Hutchinson Cancer Center, Seattle, WA, USA
| | - Gurleen Johal
- Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, WA, USA.,Department of Medicine, Division of Hematology, University of Washington, Seattle, WA, USA
| | - Mathilde Hunault-Berger
- Maladies du Sang, CHU d'Angers, Angers, France.,Fédération Hospitalo-Universitaire Grand-Ouest Acute Leukemia, FHU-GOAL, Angers, France.,Université d'Angers, Inserm UMR 1307, CNRS UMR 6075, Nantes Université, CRCI2NA, F-49000, Angers, France
| | - Frederick R Appelbaum
- Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, WA, USA.,Department of Medicine, Division of Medical Oncology, University of Washington, Seattle, WA, USA
| | - Roland B Walter
- Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, WA, USA. .,Department of Medicine, Division of Hematology, University of Washington, Seattle, WA, USA. .,Department of Laboratory Medicine & Pathology, University of Washington, Seattle, WA, USA. .,Department of Epidemiology, University of Washington, Seattle, WA, USA.
| |
Collapse
|
5
|
Wilson BE, Desnoyers A, Al-Showbaki L, Nadler MB, Amir E. A retrospective analysis of changes in distant and breast cancer related disease-free survival events in adjuvant breast cancer trials over time. Sci Rep 2022; 12:6352. [PMID: 35428842 PMCID: PMC9012825 DOI: 10.1038/s41598-022-09949-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 03/14/2022] [Indexed: 11/09/2022] Open
Abstract
Disease-free survival (DFS) comprises both breast cancer and non-breast cancer events. DFS has not been validated as a surrogate endpoint for overall survival (OS) in most breast cancer subtypes. We assessed changes to the type of events contributing to DFS over time. We identified adjuvant studies in breast cancer (BC) from 2000 to 2020 where the endpoint was DFS. We examined change in distant DFS events and the BC-related DFS using univariable and multivariable linear regression. Data were reported quantitatively using the Burnand criteria irrespective of statistical significance. We included 84 studies (88 cohorts), comprising 212,191 participants, 41,604 DFS events and 23,205 distant DFS events. The DFS event rate/100 participants/year has declined modestly over time (ß - 0.34, p = 0.001). Start year was negatively associated with distant DFS events (ß - 0.58, p < 0.0001); however, the effect was lost after adjusting for follow-up time (ß - 0.18, p = 0.096). The average number of BC-related events/100 participants/year also declined over time (ß - 0.28, p = 0.009). In multivariable analysis, start year and ER expression were quantitatively associated with distant DFS events and BC-related DFS events. DFS events have declined over time driven by a reduction in BC related events. As DFS events are increasingly defined by non-BC events, there will be limited surrogacy between DFS and OS.
Collapse
Affiliation(s)
- Brooke E Wilson
- Division of Medical Oncology and Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 700 University Ave, 700U, 7W305, Toronto, ON, M5G 2M9, Canada. .,University of New South Wales, Kensington, NSW, Australia.
| | - Alexandra Desnoyers
- Division of Medical Oncology and Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 700 University Ave, 700U, 7W305, Toronto, ON, M5G 2M9, Canada
| | - Laith Al-Showbaki
- Division of Medical Oncology and Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 700 University Ave, 700U, 7W305, Toronto, ON, M5G 2M9, Canada
| | - Michelle B Nadler
- Division of Medical Oncology and Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 700 University Ave, 700U, 7W305, Toronto, ON, M5G 2M9, Canada
| | - Eitan Amir
- Division of Medical Oncology and Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 700 University Ave, 700U, 7W305, Toronto, ON, M5G 2M9, Canada
| |
Collapse
|
6
|
Pitfalls and Successes in Trials in Older Transplant Patients with Hematologic Malignancies. Curr Oncol Rep 2022; 24:125-133. [DOI: 10.1007/s11912-022-01194-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/07/2021] [Indexed: 11/03/2022]
|
7
|
George M, Smith A, Sabesan S, Ranmuthugala G. Physical Comorbidities and Their Relationship with Cancer Treatment and Its Outcomes in Older Adult Populations: Systematic Review. JMIR Cancer 2021; 7:e26425. [PMID: 34643534 PMCID: PMC8552093 DOI: 10.2196/26425] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 05/14/2021] [Accepted: 07/28/2021] [Indexed: 12/27/2022] Open
Abstract
Background Cancer is one of the predominant causes of morbidity and mortality in older adult populations worldwide. Among a range of barriers, comorbidity particularly poses a clinical challenge in cancer diagnosis, prognosis, and treatment owing to its heterogeneous nature. While accurate comorbidity assessments and appropriate treatment administration can result in better patient outcomes, evidence related to older adult cancer populations is limited as these individuals are often excluded from regular clinical trials due to age and comorbid conditions. Objective To determine the prevalence of physical comorbidity and the impact of physical comorbidities and rurality on treatment and its outcomes in older adult cancer populations. Methods Scientific databases Embase and PubMed were searched for published scientific literature on physical comorbidity and older adult cancer patients. Google Scholar was searched for scholarly literature published in nonindexed journals. Snowballing was utilized to identify research papers missed in the above searches. Included studies : (1) reported on original research involving cancer patients; (2) included patients aged 65 years or older; (3) had patients receiving cancer-related treatment and (4) cancer survivors; (5) reported on physical comorbidity as a variable; (6) were published in English; and (7) conducted from any geographical location. Results In total, 29 studies were selected for data extraction, evidence synthesis, and quality assessment. In these, comorbidities ranged from 37.9%-74.3% in colorectal cancer, 74%-81% in head and neck cancer, and 12.6%-49% in breast cancer. Moderate comorbidities ranged from 13%-72.9%, and severe comorbidities from 2.5%-68.2%. Comorbidity increased with age, with comorbidity affecting both treatment choice and process. Physical comorbidities significantly affected treatment initiation, causing delay, toxicity, and discontinuation. Older adult cancer patients were given less vigorous and nonstandard treatments and were also less likely to be offered treatment. Where patients are given more vigorous treatment, several studies showed better survival outcomes. Appropriate treatment in older adult cancer patients increased both overall and disease-related survival rates. None of the studies noted rurality as a distinct variable. Conclusions This systematic review concludes that there is evidence to substantiate the adverse effect of comorbidity on treatment and survival outcomes. However, the mechanism by which comorbidity impedes or impacts treatment is unknown in many cases. Some low-quality evidence is available for considering the functional status and biological age in treatment decisions. Future studies that substantiate the value of comprehensive older adult assessments before treatment initiation in cancer patients, including assessing the nature and severity of comorbidities, and additional consideration of rurality as a factor, could lessen the effect of comorbidities on the treatment process.
Collapse
Affiliation(s)
- Mathew George
- North West Cancer Centre, Tamworth Hospital, Hunter New England Local Health District, Tamworth, Australia.,School of Rural Medicine, University of New England, Armidale, Australia
| | - Alexandra Smith
- North West Cancer Centre, Tamworth Hospital, Hunter New England Local Health District, Tamworth, Australia
| | - Sabe Sabesan
- Townsville Cancer Centre, Townsville University Hospital, Townsville, Australia
| | | |
Collapse
|
8
|
Percival MEM, Othus M, Mirahsani S, Gardner KM, Shaw C, Halpern AB, Becker PS, Hendrie PC, Sorror ML, Walter RB, Estey EH. Survival of patients with newly diagnosed high-grade myeloid neoplasms who do not meet standard trial eligibility. Haematologica 2021; 106:2114-2120. [PMID: 32646891 PMCID: PMC8327712 DOI: 10.3324/haematol.2020.254938] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Indexed: 12/11/2022] Open
Abstract
Few patients with cancer, including those with acute myeloid leukemia and high-grade myeloid neoplasms, participate in clinical trials. Broadening standard eligibility criteria may increase clinical trial participation. In this retrospective single-center analysis, we identified 442 consecutive newly diagnosed patients from 2014 to 2016. Patients were considered “eligible” if they had a performance status 0-2, normal renal and hepatic function, no recent solid tumor, left ventricular ejection fraction (EF) ≥50%, and no history of congestive heart failure (CHF) or myocardial infarction (MI); “ineligible” patients failed to meet one or more of these criteria. We included 372 patients who received chemotherapy. Ineligible patients represented 40% of the population and had a 1.79-fold greater risk of death (95% Confidence Interval [CI]: 1.37-2.33) than eligible patients. Very few patients had cardiac comorbidities, including 2% with low EF, 4% with prior CHF, and 5% with prior MI. In multivariable analysis, ineligibility was associated with decreased survival (Hazard ratio [HR] 1.44; 95% CI: 1.07-1.93). Allogeneic transplantation, performed in 150 patients (40%), was associated with improved survival (HR 0.66, 95% CI: 0.48-0.91). Therefore, standard eligibility characteristics identify a patient population with improved survival. Further treatment options are needed for patients considered ineligible for clinical trials.
Collapse
|
9
|
Loh Z, Salvaris R, Chong G, Churilov L, Manos K, Barraclough A, Hawkes EA. Evolution of eligibility criteria for diffuse large B-cell lymphoma randomised controlled trials over 30 years. Br J Haematol 2021; 193:741-749. [PMID: 33851428 DOI: 10.1111/bjh.17436] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 02/01/2021] [Indexed: 11/27/2022]
Abstract
Eligibility criteria for randomised control trials (RCT) in diffuse large B-cell lymphoma (DLBCL) may be becoming increasingly strict. In this analysis, 42 first-line phase III RCTs enrolling DLBCL patients since 1990 were identified from PubMed and clinicaltrials.gov. Changes in 31 individual eligibility criteria were assessed using three pre-defined eras [(1) 1993-2005; (2) 2006-2013; and (3) 2014-2020]. The presence of 15/31 criteria increased significantly over time, and the total number of criteria per study also increased over time [median Era 1: 14·5, interquartile range (IQR) 12·6-16·4; Era 2: 21, 18·8-23·3; Era 3: 23, 21-25; P < 0·001]. When each trial's eligibility criteria were applied to 215 consecutive patients from an institutional database treated between 2010 and 2020, a median of 57% (IQR 47-70) of patients were hypothetically eligible for trial enrolment. The median percentage of patients eligible was 68% (56-91), 54% (37-81) and 47% (38-82) for Era 1, 2 and 3 respectively (P = 0·004). Phase III front-line DLBCL trial criteria have become increasingly restrictive over the last three decades, resulting in a diminishing proportion of trial-eligible patients, with less than 50% of our patients eligible for modern-era studies. This potentially impacts generalisability of recent trial results and will likely limit recruitment to ongoing studies.
Collapse
Affiliation(s)
- Zoe Loh
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia
| | - Ross Salvaris
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia.,Department of Haematology, Monash Health, Clayton, Vic., Australia
| | - Geoffrey Chong
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia.,Melbourne Medical School, University of Melbourne, Melbourne, Vic., Australia
| | - Leonid Churilov
- Melbourne Medical School, University of Melbourne, Melbourne, Vic., Australia
| | - Kate Manos
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia
| | - Allison Barraclough
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia
| | - Eliza A Hawkes
- Department of Medical Oncology and Clinical Haematology, Olivia Newton John Cancer Research and Wellness Centre at Austin Health, Heidelberg, Vic., Australia.,Melbourne Medical School, University of Melbourne, Melbourne, Vic., Australia.,Department of Haematology, Eastern Health, Melbourne, Vic., Australia
| |
Collapse
|
10
|
Cohen SP, Bhaskar A, Bhatia A, Buvanendran A, Deer T, Garg S, Hooten WM, Hurley RW, Kennedy DJ, McLean BC, Moon JY, Narouze S, Pangarkar S, Provenzano DA, Rauck R, Sitzman BT, Smuck M, van Zundert J, Vorenkamp K, Wallace MS, Zhao Z. Consensus practice guidelines on interventions for lumbar facet joint pain from a multispecialty, international working group. Reg Anesth Pain Med 2020; 45:424-467. [PMID: 32245841 PMCID: PMC7362874 DOI: 10.1136/rapm-2019-101243] [Citation(s) in RCA: 113] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2019] [Revised: 02/07/2020] [Accepted: 02/11/2020] [Indexed: 02/07/2023]
Abstract
BACKGROUND The past two decades have witnessed a surge in the use of lumbar facet blocks and radiofrequency ablation (RFA) to treat low back pain (LBP), yet nearly all aspects of the procedures remain controversial. METHODS After approval by the Board of Directors of the American Society of Regional Anesthesia and Pain Medicine, letters were sent to a dozen pain societies, as well as representatives from the US Departments of Veterans Affairs and Defense. A steering committee was convened to select preliminary questions, which were revised by the full committee. Questions were assigned to 4-5 person modules, who worked with the Subcommittee Lead and Committee Chair on preliminary versions, which were sent to the full committee. We used a modified Delphi method, whereby the questions were sent to the committee en bloc and comments were returned in a non-blinded fashion to the Chair, who incorporated the comments and sent out revised versions until consensus was reached. RESULTS 17 questions were selected for guideline development, with 100% consensus achieved by committee members on all topics. All societies except for one approved every recommendation, with one society dissenting on two questions (number of blocks and cut-off for a positive block before RFA), but approving the document. Specific questions that were addressed included the value of history and physical examination in selecting patients for blocks, the value of imaging in patient selection, whether conservative treatment should be used before injections, whether imaging is necessary for block performance, the diagnostic and prognostic value of medial branch blocks (MBB) and intra-articular (IA) injections, the effects of sedation and injectate volume on validity, whether facet blocks have therapeutic value, what the ideal cut-off value is for a prognostic block, how many blocks should be performed before RFA, how electrodes should be oriented, the evidence for larger lesions, whether stimulation should be used before RFA, ways to mitigate complications, if different standards should be applied to clinical practice and clinical trials and the evidence for repeating RFA (see table 12 for summary). CONCLUSIONS Lumbar medial branch RFA may provide benefit to well-selected individuals, with MBB being more predictive than IA injections. More stringent selection criteria are likely to improve denervation outcomes, but at the expense of more false-negatives. Clinical trials should be tailored based on objectives, and selection criteria for some may be more stringent than what is ideal in clinical practice.
Collapse
Affiliation(s)
- Steven P Cohen
- Anesthesiology, Pain Medicine Division, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Arun Bhaskar
- Anesthesiology, Imperial College Healthcare NHS Trust Haemodialysis Clinic Hayes Satellite Unit, Hayes, UK
| | - Anuj Bhatia
- Anesthesia and Pain Management, University of Toronto and University Health Network-Toronto Western Hospital, Toronto, Ontario, Canada
| | | | - Tim Deer
- Spine & Nerve Centers, Charleston, West Virginia, USA
| | - Shuchita Garg
- Anesthesiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | | | - Robert W Hurley
- Anesthesiology, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
| | - David J Kennedy
- Physical Medicine & Rehabilitation, Vanderbilt University School of Medicine, Nashville, Tennessee, USA
| | - Brian C McLean
- Anesthesiology, Tripler Army Medical Center, Tripler Army Medical Center, Hawaii, USA
| | - Jee Youn Moon
- Dept of Anesthesiology, Seoul National University College of Medicine, Seoul, The Republic of Korea
| | - Samer Narouze
- Center for Pain Medicine, Summa Western Reserve Hospital, Cuyahoga Falls, Ohio, USA
| | - Sanjog Pangarkar
- Dept of Physical Medicine and Rehabilitation, VA Greater Los Angeles Healthcare System, Los Angeles, California, USA
| | | | - Richard Rauck
- Carolinas Pain Institute, Winston Salem, North Carolina, USA
| | | | - Matthew Smuck
- Dept.of Orthopaedic Surgery, Division of Physical Medicine & Rehabilitation, Stanford Medicine, Stanford, California, USA
| | - Jan van Zundert
- Anesthesiology, Critical Care and Multidisciplinary Pain Center, Ziekenhuis Oost-Limburg, Lanaken, Belgium
- Anesthesiology and Pain Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
| | | | - Mark S Wallace
- Anesthesiology, UCSD Medical Center-Thornton Hospital, San Diego, California, USA
| | - Zirong Zhao
- Neurology, VA Healthcare Center District of Columbia, Washington, District of Columbia, USA
| |
Collapse
|
11
|
Templeton AJ, Booth CM, Tannock IF. Informing Patients About Expected Outcomes: The Efficacy-Effectiveness Gap. J Clin Oncol 2020; 38:1651-1654. [DOI: 10.1200/jco.19.02035] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Arnoud J. Templeton
- Department of Medical Oncology, St Claraspital Basel, and Faculty of Medicine, University of Basel, Basel, Switzerland
| | - Christopher M. Booth
- Division of Cancer Care and Epidemiology, Queen’s University Cancer Research Institute, Kingston, Ontario, Canada
| | - Ian F. Tannock
- Division of Medical Oncology & Hematology, Princess Margaret Cancer Centre, Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
12
|
Older adults in hematologic malignancy trials: Representation, barriers to participation and strategies for addressing underrepresentation. Blood Rev 2020; 43:100670. [PMID: 32241586 DOI: 10.1016/j.blre.2020.100670] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Revised: 01/22/2020] [Accepted: 01/30/2020] [Indexed: 12/15/2022]
Abstract
Despite a high incidence of hematologic malignancies in older adults, available data indicate that there is disproportionately low representation of adults ≥65 years with hematologic malignancies (greater in patients ≥75 years) in clinical trials. Biological and clinical differences between older and younger adults and diversity within older patients necessitate adequate representation of the older subpopulation in hematologic malignancy trials. This would allow trial results to be generalizable and inform treatment decisions in the older patient population. Restrictive eligibility criteria may be barriers to adequate representation, as older adults do not typically meet these criteria. Efforts to broaden eligibility criteria in clinical trials have been proposed and may promote enrollment of a representative older population with hematologic malignancies. Collaboration among a diverse group of stakeholders will be needed to implement current proposals and evaluate their impact on increasing representation of older adults in trials evaluating therapies for hematologic malignancies.
Collapse
|
13
|
Phillips CM, Parmar A, Guo H, Schwartz D, Isaranuwatchai W, Beca J, Dai W, Arias J, Gavura S, Chan KKW. Assessing the efficacy-effectiveness gap for cancer therapies: A comparison of overall survival and toxicity between clinical trial and population-based, real-world data for contemporary parenteral cancer therapeutics. Cancer 2020; 126:1717-1726. [PMID: 31913522 DOI: 10.1002/cncr.32697] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2019] [Revised: 11/29/2019] [Accepted: 12/09/2019] [Indexed: 12/16/2022]
Abstract
BACKGROUND Although increasing evidence has suggested that an efficacy-effectiveness gap exists between clinical trial (CT) and real-world evidence (RWE), to the authors' knowledge, the magnitude of this difference remains undercharacterized. The objective of the current study was to quantify the magnitude of survival and toxicity differences between CT and RWE for contemporary cancer systemic therapies. METHODS Patients receiving cancer therapies funded under Cancer Care Ontario's New Drug Funding Program (NDFP) were identified. Landmark CTs with data regarding survival and adverse events (AEs) for each drug indication were identified. RWE for survival and hospitalization rates during treatment were ascertained through Canadian population-based databases. The efficacy-effectiveness gap for each drug indication was calculated as the difference between RWE and CT data for median overall survival (OS), 1-year OS, and generated hazard ratios (HRs) with 95% CIs from Kaplan-Meier OS curves. Toxicity differences were calculated as the difference between RWE of hospitalization rates and CT serious AE rates. RESULTS Twenty-nine indications from 20 systemic therapies were included. Twenty-eight of 29 indications (97%) demonstrated worse survival in RWE, with a median OS difference of 5.2 months (interquartile range, 3.0-12.1 months). Lower effectiveness in RWE also was demonstrated through a meta-analysis of an OS hazard ratio of 1.58 (95% CI, 1.39-1.80). The median difference between RWE for hospitalization rates and CT serious AEs was 14% (95% CI, 9%-22%). CONCLUSIONS An efficacy-effectiveness gap exists for contemporary cancer systemic therapies, with a 5.2-month lower median OS observed in RWE compared with CT data. These data supports the use of RWE to better inform real-world decision making regarding the use of cancer systemic therapies.
Collapse
Affiliation(s)
- Cameron M Phillips
- Division of Medical Oncology and Hematology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Ambica Parmar
- Division of Medical Oncology and Hematology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada.,Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - Helen Guo
- Cancer Care Ontario, Toronto, Ontario, Canada
| | | | - Wanrudee Isaranuwatchai
- Division of Medical Oncology and Hematology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada.,Canadian Centre for Applied Research in Cancer Control, Toronto, Ontario, Canada
| | - Jaclyn Beca
- Cancer Care Ontario, Toronto, Ontario, Canada.,Canadian Centre for Applied Research in Cancer Control, Toronto, Ontario, Canada
| | - Wei Dai
- Cancer Care Ontario, Toronto, Ontario, Canada.,Canadian Centre for Applied Research in Cancer Control, Toronto, Ontario, Canada
| | | | | | - Kelvin K W Chan
- Division of Medical Oncology and Hematology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada.,Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.,Cancer Care Ontario, Toronto, Ontario, Canada.,Canadian Centre for Applied Research in Cancer Control, Toronto, Ontario, Canada
| |
Collapse
|
14
|
Pestine E, Stokes A, Trinquart L. Representation of obese participants in obesity-related cancer randomized trials. Ann Oncol 2019; 29:1582-1587. [PMID: 29897392 DOI: 10.1093/annonc/mdy138] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Background Obesity is a risk factor for numerous cancer types, and may influence cancer treatment outcomes. Underrepresentation of obese patients in obesity-related cancer randomized controlled trials (RCTs) may affect generalizability of results. We aimed to assess the reporting of information about eligibility and enrollment of obese participants in obesity-related cancer RCTs. Methods We conducted a systematic review of RCTs of 10 obesity-related cancer types (esophagus, colon/rectum, liver, gallbladder, pancreas, postmenopausal breast, endometrium, ovary, kidney, and thyroid cancer). We selected RCTs published between 2013 and 2016 in five major journals. For each trial, we examined the article, the protocol, and the registration record. We assessed if eligibility criteria limiting the enrollment of obese participants were reported, the proportion of obese participants that were enrolled, and if a subgroup analysis according to obesity status was reported. We systematically contacted corresponding authors and asked for information about eligibility of obese participants and the proportion of obese participants. Results We included 76 RCTs. Colon/rectum (n = 20), postmenopausal breast (n = 11), and kidney (n = 11) cancers were the most frequent types. Based on publicly available sources, information on the eligibility of obese participants was available in 5 (7%) trials. The proportion of obese participants could be estimated in 9 (12%) trials only. We found a subgroup analysis in only one RCT. When considering unpublished information, the eligibility of obese participants was explicitly stated in 31 (41%) trials but it was unclear if the remaining 59% trials considered obese participants as eligible and what proportion of obese participants was included. Across 22 trials, the median proportion of obese participants included was 18% (Q1-Q3 11-23). Conclusion Information on the eligibility and enrollment of obese participants in cancer RCTs is dramatically underreported. More transparency is needed to understand the applicability of obesity-related cancer RCT results to obese patients with cancer.
Collapse
Affiliation(s)
- E Pestine
- Department of Biostatistics, Boston University School of Public Health, Boston, USA
| | - A Stokes
- Department of Global Health, Boston University School of Public Health, Boston, USA
| | - L Trinquart
- Department of Biostatistics, Boston University School of Public Health, Boston, USA.
| |
Collapse
|
15
|
Tiu C, Loh Z, Gan CL, Gan H, John T, Hawkes E. Effect of Reasons for Screen Failure on Subsequent Treatment Outcomes in Cancer Patients Assessed for Clinical Trials. Oncology 2019; 97:270-276. [PMID: 31266008 DOI: 10.1159/000501211] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2019] [Accepted: 05/25/2019] [Indexed: 11/19/2022]
Abstract
INTRODUCTION The cancer research community increasingly question the rigidity of eligibility criteria in clinical trials. Common reasons for "screen failure" (RFSF) are well documented; however, their effect on subsequent standard therapy (SST) and outcomes is unclear. METHODS This retrospective study evaluated patients aged ≥18 years with solid malignancy who were listed as ineligible on a screening log between February 2011 and March 2018. Patients screen-failed for biomarker results or incorrect cancer stage/prior treatment profile were excluded. Data were collected from electronic hospital records, including demographics, cancer history, RFSF, subsequent therapy, and outcomes. RESULTS Overall, 217 patients were eligible. The most common histologies were lung (28%), melanoma, colon, and pancreatic (all 11%); 90% were metastatic. The most common RFSF were rapid disease progression (PD; 16%), performance status (PS) ≥2 (12%), and abnormal liver function tests (aLFT; 12%). After screen failure, 129/217 (59%) had SST; 9 were dose-reduced. Treatment-naïve or phase III trial-ineligible patients were more likely to receive SST than those pre-treated or phase I trial-ineligible (72/104 vs. 52/113, p = 0.0006; 71/109 vs. 15/42, p = 0.00013), respectively. RFSF stabilised/improved in 104/217 (48%); the main RFSF was co-morbidity (19/104). The most common RFSF to deteriorate were rapid PD (27/72), PS ≥2 (20/72), and aLFT with liver metastases (LM; 13/72). CONCLUSIONS RFSF related to organ function rarely deteriorate unless directly involved with underlying malignancy. Most RFSF do not prevent patients from having SST, nor increase dose reductions, especially in treatment-naïve/phase III trial-ineligible patients. Those with RFSF of poor PS, rapid PD, and aLFT from LM are less suitable for SST. Careful broadening of trial eligibility is warranted.
Collapse
Affiliation(s)
- Crescens Tiu
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia,
| | - Zoe Loh
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia
| | - Chun Loo Gan
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia
| | - Hui Gan
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia
| | - Thomas John
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia
| | - Eliza Hawkes
- Olivia Newton-John Cancer Research Institute, Austin Health, Melbourne, Victoria, Australia
| |
Collapse
|
16
|
Karim S, Xu Y, Kong S, Abdel-Rahman O, Quan ML, Cheung WY. Generalisability of Common Oncology Clinical Trial Eligibility Criteria in the Real World. Clin Oncol (R Coll Radiol) 2019; 31:e160-e166. [PMID: 31133363 DOI: 10.1016/j.clon.2019.05.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Revised: 03/13/2019] [Accepted: 04/03/2019] [Indexed: 01/06/2023]
Abstract
AIMS Strict oncology clinical trial eligibility criteria can contribute to low accrual and result in poorly generalisable study findings. Using common eligibility criteria, we sought to (i) determine how many patients would be eligible versus ineligible and (ii) describe real-world patterns of treatments and outcomes between those considered trial eligible and ineligible. MATERIALS AND METHODS The Alberta Cancer Registry was used to assemble a population-based cohort of patients diagnosed with 11 common malignancies between 2004 and 2015. We considered age >75 years, anaemia, comorbid conditions (heart disease, uncontrolled diabetes, kidney disease, liver disease) and history of a prior malignancy or immunosuppression to be exclusion criteria. Logistic regression was used to characterise the likelihood of receiving treatment. Cox regression models were constructed to determine cancer-specific and overall survival. RESULTS We identified 125 316 cancer patients, of whom 53% were men; the median age was 66 (interquartile range 48-84) years. Approximately 38% of patients were considered trial ineligible. The most common reasons for ineligibility were advanced age (24%) and heart disease (16%). In this ineligible group, 12, 47 and 19% still underwent chemotherapy, surgery and radiotherapy, respectively. Compared with ineligible patients, eligible patients were more likely to undergo chemotherapy (odds ratio 1.98, 95% confidence interval 1.89-2.07, P < 0.0001), surgery (odds ratio 1.39, 95% confidence interval 1.32-1.46, P < 0.0001) and radiotherapy (odds ratio 1.46, 95% confidence interval 1.4-1.52, P < 0.0001). Compared with ineligible patients who did not receive treatment, those considered ineligible but who still received treatment experienced improved cancer-specific survival (hazard ratio 0.75, 95% confidence interval 0.74-0.77, P < 0.0001) and overall survival (hazard ratio 0.89, 95% confidence interval 0.87-0.90, P < 0.0001). CONCLUSIONS A significant proportion of real-world patients are unable to participate in clinical trials due to stringent exclusion criteria, but many still receive treatment in routine practice. The eligibility criteria of oncology clinical trials should be broadened.
Collapse
Affiliation(s)
- S Karim
- Department of Oncology, University of Calgary, Calgary, Alberta, Canada.
| | - Y Xu
- Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
| | - S Kong
- Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
| | - O Abdel-Rahman
- Department of Oncology, University of Calgary, Calgary, Alberta, Canada; Clinical Oncology Department, Faculty of Medicine, Ain Shams University, Cairo, Egypt
| | - M L Quan
- Department of Oncology, University of Calgary, Calgary, Alberta, Canada; Department of Surgery, University of Calgary, Calgary, Alberta, Canada
| | - W Y Cheung
- Department of Oncology, University of Calgary, Calgary, Alberta, Canada
| |
Collapse
|
17
|
Kronish IM, Fenn K, Cohen L, Hershman DL, Green P, Jenny Lee SA, Suls J. Extent of Exclusions for Chronic Conditions in Breast Cancer Trials. JNCI Cancer Spectr 2018; 2:pky059. [PMID: 31825011 DOI: 10.1093/jncics/pky059] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2018] [Revised: 11/15/2018] [Accepted: 10/05/2018] [Indexed: 01/05/2023] Open
Abstract
Experts have expressed concerns that patients with chronic conditions are being excessively excluded from cancer randomized clinical trials (RCTs), limiting generalizability. Accordingly, we queried clinicaltrials.gov to determine the extent to which patients with chronic conditions were excluded from phase III cancer trials, using National Cancer Institute-sponsored breast cancer RCTs as a test case. Two physicians independently coded for the presence of 19 prevalent chronic conditions within eligibility criteria. They also coded for exclusions based on performance status and vague criteria that could have broadly excluded patients with chronic conditions. The search identified 58 RCTs, initiated from 1993 to 2012. Overall, 88% of trials had at least one exclusion for a chronic condition, performance status, or vague criterion. The three most commonly excluded conditions were chronic kidney disease, heart failure, and ischemic heart disease. Our study demonstrated that patients with prevalent chronic conditions were commonly excluded from National Cancer Institute-sponsored RCTs.
Collapse
Affiliation(s)
- Ian M Kronish
- Department of Medicine, Columbia University Medical Center, New York, NY
| | - Kathleen Fenn
- Department of Medicine, Columbia University Medical Center, New York, NY
| | - Laura Cohen
- Department of Medicine, Columbia University Medical Center, New York, NY
| | - Dawn L Hershman
- Department of Medicine, Columbia University Medical Center, New York, NY
| | - Paige Green
- Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, MD
| | - Sung A Jenny Lee
- Department of Medicine, Columbia University Medical Center, New York, NY
| | - Jerry Suls
- Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, MD
| |
Collapse
|
18
|
Riechelmann RP, Péron J, Seruga B, Saad ED. Meta-Research on Oncology Trials: A Toolkit for Researchers with Limited Resources. Oncologist 2018; 23:1467-1473. [PMID: 29769384 DOI: 10.1634/theoncologist.2018-0043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Accepted: 03/23/2018] [Indexed: 11/17/2022] Open
Abstract
"Meta-research" is a discipline that investigates research practices. Meta-research on clinical trials is an attempt to summarize descriptive and methodological features of published or ongoing clinical trials, including aspects of their implementation, design, analysis, reporting, and interpretation. In this type of investigation, the unit of analysis is a primary source of information about a clinical trial (e.g., published reports, study protocols, or abstracts), with meta-research being a second layer of information that summarizes what is known from various primary sources. After the formulation of the primary research question, the methodology of meta-research resembles that of other research projects, with predefined eligibility criteria, exposure variables, primary and secondary outcomes of interest, and an analysis plan. This type of study usually provides a high-level picture of the literature on a specific topic, always accompanied by a critical evaluation of the methodology and/or the quality of reporting of the studies included. Because relatively few resources are consumed to produce meta-research, these studies offer a great opportunity for clinical scientists working in settings with limited resources. In this article, we present the principles of designing and conducting meta-research and use our experience to suggest recommendations on how to perform and how to report this type of potentially very creative study. IMPLICATIONS FOR PRACTICE: The term meta-research pertains to a type of study in which the unit of analysis is, in most cases, the publication of a clinical trial. This type of study usually provides a high-level picture of the literature on a specific topic, always accompanied by a critical evaluation of the methodology, design, and/or the quality of reporting of the studies included. Because relatively few resources are consumed to produce meta-research, these studies offer a great opportunity for clinical scientists who work in low-income countries. This article presents the principles of designing and conducting meta-research and proposes practical recommendations on how to perform and report this type of potentially very creative study.
Collapse
Affiliation(s)
| | - Julien Péron
- Department of Medical Oncology, Hospices Civils de Lyon, Pierre-Benite, France
- CNRS UMR 5558, Laboratoire de Biométrie et Biologie Evolutive, Equipe Biostatistique-Santé, Université de Lyon, Lyon, France
| | - Bostjan Seruga
- Division of Medical Oncology, Institute of Oncology, Ljubljana, Slovenia
| | - Everardo D Saad
- Dendrix Research, Sao Paulo, Brazil
- IDDI, Louvain-la-Neuve, Belgium
| |
Collapse
|
19
|
Masters JC, Wiernik PH. Are We Ready to Include Organ-Impaired Patients in Oncology Trials? A Clinical Pharmacology Perspective on Recent Recommendations. J Clin Pharmacol 2018; 58:701-703. [DOI: 10.1002/jcph.1127] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 03/01/2018] [Indexed: 12/13/2022]
Affiliation(s)
- Joanna C. Masters
- Public Policy Committee of the American College of Clinical Pharmacology; Ashburn VA USA
- Oncology Clinical Pharmacology; Pfizer Inc.; La Jolla CA USA
| | - Peter H. Wiernik
- Public Policy Committee of the American College of Clinical Pharmacology; Ashburn VA USA
- The Cancer Research Foundation of New York; Chappaqua NY USA
| |
Collapse
|
20
|
Cook ED, Yeager KA, Cecchini RS, Boparai J, Brown CL, Duncan M, Cronin WM, Paskett ED. Recruitment practices for U.S. minority and underserved populations in NRG oncology: Results of an online survey. Contemp Clin Trials Commun 2018; 10:100-104. [PMID: 30023443 PMCID: PMC6046466 DOI: 10.1016/j.conctc.2018.03.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Revised: 03/04/2018] [Accepted: 03/08/2018] [Indexed: 11/30/2022] Open
Abstract
Introduction Cancer clinical trials (CCT) provide much of the evidence for clinical guidelines and standards of care. But low levels of CCT participation are well documented, especially for minorities. Methods and materials We conducted an online survey of 556 recruitment practices across the NRG Oncology network. Survey aims were 1) to learn how sites recruit minority/underserved populations; 2) to better understand the catchment areas of the NRG institutions; and 3) to aid in planning education programs for accrual of minority/underserved populations. Results The survey response rate was 34.9%. The most effective methods reported for recruiting minority/underserved participants were patient navigators (44.4%) and translators (38.9%). All institutions reported using a mechanism for eligibility screening and 71% of institutions reported using a screening/enrollment tracking system. CCT training was required at 78.1% and cultural competency training was required at 47.5% of responding institutions. Only 19.9% of sites used community partners to assist with minority recruitment and just 37.1% of respondents reported a defined catchment area. Sites reported very little race and ethnicity data. Conclusion This NRG Oncology online survey provides useful data for improvements in trial enrollment and training to recruit minority/underserved populations to CCT. Areas for further investigation include web-based methods for recruitment and tracking, cultural competency training, definition of catchment areas, use of patient navigators, and community partnerships. The survey results will guide recruitment training programs.
Collapse
Affiliation(s)
- Elise D Cook
- Department of Clinical Cancer Prevention, Unit 1360, UT M. D. Anderson Cancer Center, P. O. Box 301439, Houston, TX 77230-1439, USA
| | - Katherine A Yeager
- Nell Hodgson Woodruff School of Nursing, Emory University, Winship Cancer Institute, USA
| | - Reena S Cecchini
- NRG Oncology Statistics and Data Management Center, USA.,Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh, USA
| | | | - Carol L Brown
- Office of Diversity Programs, Memorial Sloan Kettering Cancer Center, USA
| | - Martha Duncan
- Clinical Coordinating Department (CCD), NRG Oncology, Pittsburgh Office, USA
| | - Walter M Cronin
- NRG Oncology, Statistics and Data Management Center, University of Pittsburgh, USA
| | - Electra D Paskett
- Division of Cancer Prevention and Control, Department of Internal Medicine, College of Medicine, Ohio State University, USA.,Population Sciences, Comprehensive Cancer Center, Ohio State University, USA
| |
Collapse
|
21
|
|
22
|
Goldvaser H, Barnes TA, Šeruga B, Cescon DW, Ocaña A, Ribnikar D, Amir E. Toxicity of Extended Adjuvant Therapy With Aromatase Inhibitors in Early Breast Cancer: A Systematic Review and Meta-analysis. J Natl Cancer Inst 2018; 110:4065461. [PMID: 28922781 DOI: 10.1093/jnci/djx141] [Citation(s) in RCA: 113] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2017] [Accepted: 06/13/2017] [Indexed: 09/19/2023] Open
Abstract
Background A number of randomized controlled trials (RCTs) have reported improvement in breast cancer outcomes from extending treatment with aromatase inhibitors (AIs) beyond the initial five years after diagnosis. However, the toxicity profile of extended AIs is uncertain. Methods We identified RCTs that compared extended AIs to placebo or no treatment using MEDLINE and a review of abstracts from key conferences between 2013 and 2016. Odds ratios (ORs), 95% confidence intervals (CIs), absolute risks, and the number needed to harm (NNH) were computed for prespecified safety and tolerability outcomes including cardiovascular events, bone fractures, second cancers (excluding new breast cancer), treatment discontinuation for adverse events, and death without recurrence. All statistical tests were two-sided. Results Seven trials comprising 16 349 patients met the inclusion criteria. Longer treatment with AIs was associated with increased odds of cardiovascular events (OR = 1.18, 95% CI = 1.00 to 1.40, P = .05, NNH = 122), bone fractures (OR = 1.34, 95% CI = 1.16 to 1.55, P < .001, NNH = 72), and treatment discontinuation for adverse events (OR = 1.45, 95% CI = 1.25 to 1.68, P < .001, NNH = 21). Longer treatment with AIs did not influence the odds of either second malignancy (OR = 0.93, 95% CI = 0.73 to 1.18, P = .56) or deaths without breast cancer recurrence (OR = 1.11, 95% CI = 0.90 to 1.36, P = .34). Conclusions Extended treatment with AIs is associated with an increased risk of cardiovascular events and bone fractures. There is no statistically significant increase in deaths without breast cancer recurrence among patients receiving longer treatment with AIs. These data should be taken into account when considering extended adjuvant AIs.
Collapse
Affiliation(s)
- Hadar Goldvaser
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - Tristan A Barnes
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - Boštjan Šeruga
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - David W Cescon
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - Alberto Ocaña
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - Domen Ribnikar
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| | - Eitan Amir
- Division of Medical Oncology, University of Toronto and Princess Margaret Cancer Centre, Toronto, Canada; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Department of Medical Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia; Research Unit, Albacete University Hospital, Albacete, Spain; Translational Oncology Laboratory, Regional Center for Biomedical Research, Castilla La Mancha University, Albacete, Spain
| |
Collapse
|
23
|
Garcia S, Bisen A, Yan J, Xie XJ, Ramalingam S, Schiller JH, Johnson DH, Gerber DE. Thoracic Oncology Clinical Trial Eligibility Criteria and Requirements Continue to Increase in Number and Complexity. J Thorac Oncol 2017; 12:1489-1495. [PMID: 28802905 PMCID: PMC5610621 DOI: 10.1016/j.jtho.2017.07.020] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2017] [Revised: 07/12/2017] [Accepted: 07/17/2017] [Indexed: 11/28/2022]
Abstract
INTRODUCTION Eligibility criteria and screening procedures are designed to optimize the scientific yield and maximize the safety of clinical trials. However, they may also heighten trial complexity, hinder enrollment, decrease generalizability, and increase costs. We analyzed the types and number of eligibility criteria and screening procedures among thoracic oncology clinical trials sponsored or endorsed by the Eastern Cooperative Oncology Group. METHODS We identified trials and obtained protocols from the Eastern Cooperative Oncology Group website. Eligibility criteria were grouped and categorized as comorbidity (classified by organ system), administrative requirements, prior treatment, and measurable disease requirements. Associations between trial characteristics and eligibility criteria were analyzed by using the Kruskal-Wallis and Wilcoxon tests. RESULTS A total of 74 lung cancer trials activated in 1986-2016 were identified. The total number of eligibility criteria was associated with trial principal therapy (a median of nine for surgical, 18 for radiation, and 20 for medical therapy [p = 0.02]), trial primary end point (a median of 20 for overall survival, 28 for progression-free survival, and 17 for other [p = 0.001]), number of therapies (p = 0.05), and year of activation (a median of 16 for 1986-1995, 19 for 1996-2005, and 27 for 2006-2016 [P < 0.001]). The increase in trial eligibility requirements over time was limited to medical therapy trials. Over time, there was also an increase in blood test screening procedures (p = 0.05) but not in imaging, cardiac assessment, or pulmonary function screening procedures. CONCLUSIONS The number of eligibility criteria and screening procedures in medical therapy lung cancer clinical trials continues to rise. Continued efforts to simplify protocol eligibility and procedures are warranted to promote trial adherence, enrollment, completion, and generalizability.
Collapse
Affiliation(s)
- Sandra Garcia
- School of Medicine, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Ajit Bisen
- Department of Internal Medicine, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Jingsheng Yan
- Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Xian-Jin Xie
- Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, Texas; Department of Clinical Sciences, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Suresh Ramalingam
- Department of Oncology, Winship Cancer Institute, Emory University, Atlanta, Georgia
| | - Joan H Schiller
- Inova Schar Cancer Institute, Inova Health System, Falls Church, Virginia
| | - David H Johnson
- Department of Internal Medicine, University of Texas Southwestern Medical Center, Dallas, Texas; Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, Texas
| | - David E Gerber
- Department of Internal Medicine, University of Texas Southwestern Medical Center, Dallas, Texas; Harold C. Simmons Comprehensive Cancer Center, University of Texas Southwestern Medical Center, Dallas, Texas; Department of Clinical Sciences, University of Texas Southwestern Medical Center, Dallas, Texas.
| |
Collapse
|
24
|
Shepshelovich D, Goldvaser H, Wang L, Abdul Razak AR, Bedard PL. Comparison of reporting phase I trial results in ClinicalTrials.gov and matched publications. Invest New Drugs 2017; 35:827-833. [DOI: 10.1007/s10637-017-0510-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2017] [Accepted: 09/07/2017] [Indexed: 10/18/2022]
|
25
|
Wong SE, North SA, Sweeney CJ, Stockler MR, Sridhar SS. Screen Failure Rates in Contemporary Randomized Clinical Phase II/III Therapeutic Trials in Genitourinary Malignancies. Clin Genitourin Cancer 2017; 16:S1558-7673(17)30274-4. [PMID: 28993132 DOI: 10.1016/j.clgc.2017.08.019] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2017] [Revised: 08/28/2017] [Accepted: 08/31/2017] [Indexed: 10/18/2022]
Abstract
BACKGROUND Screen failures, defined as individuals who undergo screening but are not enrolled in a clinical trial, incur significant costs without contributing valuable data to the study. Despite these costs, there are few published data about the rate or reasons for screen failures in advanced genitourinary cancer clinical trials. MATERIALS AND METHODS We reviewed 50 phase II and III trials in advanced genitourinary cancers conducted between 1999 and 2016. RESULTS Of the 50 trials, only 48% (24 of 50) published screen failure rates: 68% (13 of 19) of those in prostate cancer, 33% (6 of 18) in kidney cancer, and 58% (5 of 13) in bladder cancer. Among the phase III trials in prostate cancer, the mean screen failure rate was 26% (range, 12%-45%). The main reason for screen failure was reported as ineligibility. Among the phase III trials in kidney cancer, the mean screen failure rate was 25% (range, 21%-29%), with the most frequent reasons being ineligibility and patient refusal. Among the phase II/III trials in bladder cancer, the mean screen failure rate was 19% (range, 4%-28%), with the main reasons being ineligibility and patient refusal. CONCLUSION Contemporary trials in genitourinary cancer reported screen failure rates of approximately 20% to 30%. Many trials did not report on the numbers of, and reasons for, screen failures. Greater standardization of definitions, methods, and reporting are needed to better understand and decrease screen failure rates in genitourinary cancer clinical trials.
Collapse
Affiliation(s)
- Sarah E Wong
- Princess Margaret Cancer Centre, Toronto, Ontario, Canada
| | | | | | - Martin R Stockler
- National Health and Medical Research Council (NHMRC) Clinical Trials Centre, The University of Sydney, Sydney, Australia
| | | |
Collapse
|
26
|
Tannock IF, Amir E, Booth CM, Niraula S, Ocana A, Seruga B, Templeton AJ, Vera-Badillo F. Relevance of randomised controlled trials in oncology. Lancet Oncol 2017; 17:e560-e567. [PMID: 27924754 DOI: 10.1016/s1470-2045(16)30572-1] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2016] [Revised: 08/16/2016] [Accepted: 08/18/2016] [Indexed: 11/28/2022]
Abstract
Well-designed randomised controlled trials (RCTs) can prevent bias in the comparison of treatments and provide a sound basis for changes in clinical practice. However, the design and reporting of many RCTs can render their results of little relevance to clinical practice. In this Personal View, we discuss the limitations of RCT data and suggest some ways to improve the clinical relevance of RCTs in the everyday management of patients with cancer. RCTs should ask questions of clinical rather than commercial interest, avoid non-validated surrogate endpoints in registration trials, and have entry criteria that allow inclusion of all patients who are fit to receive treatment. Furthermore, RCTs should be reported with complete accounting of frequency and management of toxicities, and with strict guidelines to ensure freedom from bias. Premature reporting of results should be avoided. The bar for clinical benefit should be raised for drug registration, which should require publication and review of mature data from RCTs, post-marketing health outcome studies, and value-based pricing.
Collapse
Affiliation(s)
- Ian F Tannock
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and University of Toronto, Toronto, ON, Canada.
| | - Eitan Amir
- Division of Medical Oncology and Hematology, Princess Margaret Cancer Centre and University of Toronto, Toronto, ON, Canada
| | - Christopher M Booth
- Departments of Oncology and Public Health Sciences, Queen's University, Kingston, ON, Canada
| | - Saroj Niraula
- Departments of Medical Oncology and Haematology, University of Manitoba and CancerCare Manitoba, Winnipeg, MB, Canada
| | - Alberto Ocana
- Translational Research Unit, Albacete University Hospital, Albacete, Spain
| | - Bostjan Seruga
- Department of Medical Oncology, Institute of Oncology Ljubljana and University of Ljubljana, Slovenia
| | - Arnoud J Templeton
- Department of Medical Oncology, St Claraspital and Faculty of Medicine, University of Basel, Basel, Switzerland
| | - Francisco Vera-Badillo
- Canadian Cancer Trials Group and Department of Oncology, Queen's University, Kingston, ON, Canada; Tecnológico de Monterrey School of Medicine, Monterrey, Nuevo León, Mexico
| |
Collapse
|
27
|
Gómez García S, Clemons M, Amir E. Rethinking end-points for bone-targeted therapy in advanced cancer. Eur J Cancer 2016; 63:105-9. [DOI: 10.1016/j.ejca.2016.05.014] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2016] [Accepted: 05/13/2016] [Indexed: 10/21/2022]
|