1
|
MacKinnon N, Lane D, Scheuermeyer F, Kaczorowski J, Dong K, Orkin AM, Daoust R, Moe J, Andolfatto G, Klaiman M, Yan J, Koh JJ, Crowder K, Atkinson P, Savage D, Stempien J, Besserer F, Wale J, Kestler A. Factors associated with frequent buprenorphine / naloxone initiation in a national survey of Canadian emergency physicians. PLoS One 2024; 19:e0297084. [PMID: 38315732 PMCID: PMC10843078 DOI: 10.1371/journal.pone.0297084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 12/27/2023] [Indexed: 02/07/2024] Open
Abstract
OBJECTIVE To identify individual and site-related factors associated with frequent emergency department (ED) buprenorphine/naloxone (BUP) initiation. BUP initiation, an effective opioid use disorder (OUD) intervention, varies widely across Canadian EDs. METHODS We surveyed emergency physicians in 6 Canadian provinces from 2018 to 2019 using bilingual paper and web-based questionnaires. Survey domains included BUP-related practice, demographics, attitudes toward BUP, and site characteristics. We defined frequent BUP initiation (the primary outcome) as at least once per month, high OUD prevalence as at least one OUD patient per shift, and high OUD resources as at least 3 out of the following 5 resources: BUP initiation pathways, BUP in ED, peer navigators, accessible addiction specialists, and accessible follow-up clinics. We excluded responses from sites with <50% participation (to minimize non-responder bias) and those missing the primary outcome. We used univariate analysis to identify associations between frequent BUP initiation and factors of interest, stratifying by OUD prevalence. RESULTS We excluded 3 responses for missing BUP initiation frequency and 9 for low response rate at one ED. Of the remaining 649 respondents from 34 EDs, 374 (58%) practiced in metropolitan areas, 384 (59%) reported high OUD prevalence, 312 (48%) had high OUD resources, and 161 (25%) initiated BUP frequently. Age, gender, board certification and years in practice were not associated with frequent BUP initiation. Site-specific factors were associated with frequent BUP initiation (high OUD resources [OR 6.91], high OUD prevalence [OR 4.45], and metropolitan location [OR 2.39],) as were individual attitudinal factors (willingness, confidence, and responsibility to initiate BUP.) Similar associations persisted in the high OUD prevalence subgroup. CONCLUSIONS Individual attitudinal and site-specific factors were associated with frequent BUP initiation. Training to increase physician confidence and increasing OUD resources could increase BUP initiation and benefit ED patients with OUD.
Collapse
Affiliation(s)
- Nathalie MacKinnon
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Emergency Medicine, St. Paul’s Hospital, Vancouver, British Columbia, Canada
| | - Daniel Lane
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Frank Scheuermeyer
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Emergency Medicine, St. Paul’s Hospital, Vancouver, British Columbia, Canada
- Center for Health Evaluation and Outcome Sciences, Vancouver, British Columbia, Canada
| | | | - Kathryn Dong
- Department of Emergency Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Aaron M. Orkin
- Department of Family & Community Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Raoul Daoust
- Université de Montréal, Montreal, Quebec, Canada
- Centre de Recherche de l’Hôpital Sacré-Coeur de Montréal, Montreal, Quebec, Canada
| | - Jessica Moe
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
- British Columbia Centre for Disease Control, Vancouver, British Columbia, Canada
| | - Gary Andolfatto
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Michelle Klaiman
- Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Justin Yan
- Division of Emergency Medicine, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada
| | - Justin J. Koh
- Department of Emergency Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada
| | - Kathryn Crowder
- Department of Emergency Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Paul Atkinson
- Department of Emergency Medicine, Dalhousie University, St. John, New Brunswick, Canada
| | - David Savage
- Division of Clinical Sciences, Northern Ontario School of Medicine, Thunder Bay, Ontario, Canada
| | - James Stempien
- Department of Emergency Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada
| | - Floyd Besserer
- Department of Emergency Medicine, University of British Columbia, Prince George, British Columbia, Canada
| | - Jason Wale
- Department of Emergency Medicine, University of British Columbia, Victoria, British Columbia, Canada
| | - Andrew Kestler
- Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada
- Department of Emergency Medicine, St. Paul’s Hospital, Vancouver, British Columbia, Canada
- Center for Health Evaluation and Outcome Sciences, Vancouver, British Columbia, Canada
- British Columbia Centre on Substance Use, Vancouver, British Columbia, Canada
| |
Collapse
|
2
|
Nadkarni A, Garber A, Costa S, Wood S, Kumar S, MacKinnon N, Ibrahim M, Velleman R, Bhatia U, Fernandes G, Weobong B, Rane A. Auditing the AUDIT: A systematic review of cut-off scores for the Alcohol Use Disorders Identification Test (AUDIT) in low- and middle-income countries. Drug Alcohol Depend 2019; 202:123-133. [PMID: 31349205 DOI: 10.1016/j.drugalcdep.2019.04.031] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/10/2018] [Revised: 04/27/2019] [Accepted: 04/30/2019] [Indexed: 12/21/2022]
Abstract
INTRODUCTION The World Health Organization's (WHO) Alcohol Use Disorders Identification Test (AUDIT) is used extensively across the world, with cut-off scores recommended by the WHO. We reviewed the use and validity of AUDIT cut-off scores in low- and middle-income countries as cultural contexts are expected to influence the detection of alcohol use disorders. MATERIALS AND METHODS The systematic review was guided by an a priori defined protocol consistent with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement. We searched Cochrane library, Medline, EMBASE, PsycINFO, CINAHL, Indmed, LILACS, and AJOL databases using appropriate search terms. We conducted a narrative synthesis of the data. RESULTS We identified 54 distinct studies that used AUDIT cut-off scores which were not in alignment with those recommended by the WHO. India (n = 10), Nigeria (n = 9), and Brazil (n = 9) produced most of these included studies. Most of the studies (n = 42) did not conduct psychometric evaluations of AUDIT cut-off scores. Of the twelve studies which did report psychometric results, a wide range of cut-off scores performed well. In these studies the cut-off scores to detect hazardous drinking ranged from >3 to >5, for harmful drinking from >5 to >16, and for dependent drinking from >7 to >24. DISCUSSION AUDIT is being widely used in LMICs and non-recommended cut-off scores are considered to be appropriate in these countries. It is important to systematically evaluate the psychometric properties of those cut-off scores to ensure the internal validity of the studies in which they are used.
Collapse
Affiliation(s)
- Abhijit Nadkarni
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India; Department of Population Health, London School of Hygiene and Tropical Medicine, Keppel Street, London, UK; Health Services and Population Research Department, Institute of Psychiatry, Psychology, and Neuroscience, London, UK; South London and Maudsley NHS Foundation Trust, London, UK.
| | - Alison Garber
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India; Harvard University, Cambridge, Massachusetts, Boston, USA
| | - Sheina Costa
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India
| | - Sheena Wood
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India; Harvard University, Cambridge, Massachusetts, Boston, USA
| | - Sonali Kumar
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India
| | - Nathalie MacKinnon
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India; Faculty of Medicine, McGill University, Montreal, Canada
| | - Mariam Ibrahim
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India
| | - Richard Velleman
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India; Department of Psychology, University of Bath, Bath, UK
| | - Urvita Bhatia
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India
| | - Godwin Fernandes
- Addictions Research Group, Sangath, H No 451 (168), Bhatkar Waddo, Socorro, Porvorim, Bardez, Goa, 403501, India
| | | | - Anil Rane
- Institute of Psychiatry and Human Behaviour, Bambolim, Goa, India
| |
Collapse
|
3
|
MacKinnon N, St-Louis E, Yousef Y, Situma M, Poenaru D. Out-of-Pocket and Catastrophic Expenses Incurred by Seeking Pediatric and Adult Surgical Care at a Public, Tertiary Care Centre in Uganda. World J Surg 2018; 42:3520-3527. [PMID: 29858920 DOI: 10.1007/s00268-018-4691-x] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
BACKGROUND Surgical care is critical to establish effective healthcare systems in low- and middle-income countries, yet the unmet need for surgical conditions is as high as 65% in Ugandan children. Financial burden and geographical distance are common barriers to help-seeking in adult populations and are unmeasured in the pediatric population. We thus measured out-of-pocket (OOP) expenses and distance traveled for pediatric surgical care in a tertiary hospital in Mbarara, Uganda, as compared to adult surgical and pediatric medical patients. METHODS Patients admitted to pediatric surgical (n = 20), pediatric medical (n = 18) and adult surgical (n = 18) wards were interviewed upon discharge over a period of 3 weeks. Patient and caregiver-reported expenses incurred for the present illness included prior/future care needed, and travel distance/cost. The prevalence of catastrophic expenses (≥10% of annual income) was calculated and spending patterns compared between wards. RESULTS Thirty-five percent of pediatric medical patients, 45% of pediatric surgical patients and 55% of adult surgical patients incurred catastrophic expenses. Pediatric surgical patients paid more for their current treatment (p < 0.01)-specifically medications (p < 0.01) and tests (p < 0.01)-than pediatric medical patients, and comparable costs to adults. Adult patients paid more for treatment prior to the hospital (p = 0.04) and miscellaneous expenses (e.g., food while admitted) (p = 0.02). Patients in all wards traveled comparable distances. CONCLUSIONS Seeking healthcare at a publicly funded hospital is financially catastrophic for almost half of patients. Out-of-stock supplies and broken equipment make surgical care particularly vulnerable to OOP expenses because analgesics, anaesthesia and preoperative imaging are prerequisites to care.
Collapse
Affiliation(s)
| | - Etienne St-Louis
- Center for Global Surgery, McGill University Health Centre, Montreal, Canada
| | - Yasmine Yousef
- Center for Global Surgery, McGill University Health Centre, Montreal, Canada
| | | | - Dan Poenaru
- Center for Global Surgery, McGill University Health Centre, Montreal, Canada.
- Montreal Children's Hospital, Rm. B- 04.2022, 1001 Boulevard Décarie, Montreal, QC, H4A 3J1, Canada.
| |
Collapse
|
4
|
MacKinnon N, Kingsbury M, Mahedy L, Evans J, Colman I. The Association Between Prenatal Stress and Externalizing Symptoms in Childhood: Evidence From the Avon Longitudinal Study of Parents and Children. Biol Psychiatry 2018; 83:100-108. [PMID: 28893381 DOI: 10.1016/j.biopsych.2017.07.010] [Citation(s) in RCA: 74] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2016] [Revised: 07/12/2017] [Accepted: 07/13/2017] [Indexed: 12/13/2022]
Abstract
BACKGROUND It has been suggested that prenatal maternal stress may increase the risk of childhood externalizing disorders, yet no large cohort study has investigated this association across a large range of acute stressors. Our objective was to estimate the association between prenatal stressful events and risk of offspring conduct disorder and hyperactivity. METHODS We used data from 10,184 mother-offspring pairs from the United Kingdom-based Avon Longitudinal Study of Parents and Children. Mothers self-reported 42 prenatal stressful life events at 18 weeks' gestation. Symptoms of conduct disorder and hyperactivity in their offspring were measured at 6, 9, 11, 13, and 16 years of age using the Strengths and Difficulties Questionnaire. The primary outcome was membership in high-symptom trajectories of 1) conduct disorder and 2) hyperactivity throughout childhood, identified using latent class growth modeling. Multinomial logistic regression models estimated the association between prenatal stress and both conduct disorder and hyperactivity, after adjusting for sex, parental education, low birth weight, preterm birth, parental social class, maternal smoking and drinking, maternal mental health, offspring stressful life events, and offspring depressive and anxious symptoms. RESULTS Those exposed to the highest quartile of prenatal stress were more likely to belong to the high symptom trajectory for hyperactivity (B = 0.46, p < .05) and conduct disorder (B = 0.88, p < .01), respectively. Prenatal stress further demonstrated a positive, dose-response relationship with symptoms of externalizing disorders at independent time points. CONCLUSIONS The findings suggest that prenatal stressful events may be an independent risk factor for offspring externalizing symptoms, regardless of maternal mental health and offspring internalizing.
Collapse
Affiliation(s)
- Nathalie MacKinnon
- School of Epidemiology, Public Health, and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Mila Kingsbury
- School of Epidemiology, Public Health, and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Liam Mahedy
- School of Social and Community Medicine, University of Bristol, Bristol, United Kingdom
| | - Jonathan Evans
- School of Social and Community Medicine, University of Bristol, Bristol, United Kingdom
| | - Ian Colman
- School of Epidemiology, Public Health, and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada.
| |
Collapse
|
5
|
Abstract
OBJECTIVE Suicide is a leading cause of death for transition-aged youth (TAY), and yet few studies examine correlates of suicidal ideation specifically in this age demographic (age 18-24 years). The transition to adulthood is a unique context, marked by novel stressors (e.g., joining the workforce) and increased independence, which may influence risk factors for suicidal ideation. This study examined correlates of suicidal ideation in TAY and adults and contrasted profiles across age. METHODS We used 4 biannual cycles (2005, 2007, 2009, 2011) of the Canadian Community Health Survey, a population-based cross-sectional survey on health. We used logistic regression to assess the association between suicidal ideation and depression, distress, alcohol use, smoking, exercise, sedentary behaviour, chronic illness, restrictions to daily living, perceived physical and mental health, and perceived social support independently in both TAY ( n = 4427) and adults ( n = 14,452). We subsequently assessed possible interactions with age (18-24 v. 25-44 years) and sex and differences in help-seeking behaviour in a combined model. RESULT TAY exhibited higher rates of suicidal ideation than adults did ( P < 0.001). Numerous factors were associated with suicidal ideation in TAY. Notably, alcohol abstinence was associated with decreased suicidal ideation in TAY but not for adults. Moreover, when depressed, TAY were significantly less likely to have received professional mental health help than adults (odds ratio = 0.64, 95% CI, 0.43 to 0.94). CONCLUSIONS Suicidal ideation is more prevalent in TAY than adults, and its consequences may be aggravated by poor treatment-seeking behaviour in at-risk (i.e. depressed) individuals. These different risk profiles substantiate the recent shift toward clinical interventions focusing on transition-aged youth, rather than traditional child (<18 years) and adult (>18 years) services.
Collapse
Affiliation(s)
- Nathalie MacKinnon
- School of Epidemiology, Public Health & Preventive Medicine, University of Ottawa, Ottawa, Ontario
| | - Ian Colman
- School of Epidemiology, Public Health & Preventive Medicine, University of Ottawa, Ottawa, Ontario
| |
Collapse
|
6
|
Kiss SZ, Rostas AM, Heidinger L, Spengler N, Meissner MV, MacKinnon N, Schleicher E, Weber S, Korvink JG. A microwave resonator integrated on a polymer microfluidic chip. J Magn Reson 2016; 270:169-175. [PMID: 27497077 DOI: 10.1016/j.jmr.2016.07.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2016] [Revised: 07/16/2016] [Accepted: 07/18/2016] [Indexed: 06/06/2023]
Abstract
We describe a novel stacked split-ring type microwave (MW) resonator that is integrated into a 10mm by 10mm sized microfluidic chip. A straightforward and scalable batch fabrication process renders the chip suitable for single-use applications. The resonator volume can be conveniently loaded with liquid sample via microfluidic channels patterned into the mid layer of the chip. The proposed MW resonator offers an alternative solution for compact in-field measurements, such as low-field magnetic resonance (MR) experiments requiring convenient sample exchange. A microstrip line was used to inductively couple MWs into the resonator. We characterised the proposed resonator topology by electromagnetic (EM) field simulations, a field perturbation method, as well as by return loss measurements. Electron paramagnetic resonance (EPR) spectra at X-band frequencies were recorded, revealing an electron-spin sensitivity of 3.7·10(11)spins·Hz(-1/2)G(-1) for a single EPR transition. Preliminary time-resolved EPR experiments on light-induced triplet states in pentacene were performed to estimate the MW conversion efficiency of the resonator.
Collapse
Affiliation(s)
- S Z Kiss
- Institute of Microstructure Technology (IMT), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany.
| | - A M Rostas
- Institute of Physical Chemistry (IPC), University of Freiburg, Albertstr. 21, 79104 Freiburg, Germany
| | - L Heidinger
- Institute of Physical Chemistry (IPC), University of Freiburg, Albertstr. 21, 79104 Freiburg, Germany
| | - N Spengler
- Institute of Microstructure Technology (IMT), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| | - M V Meissner
- Institute of Microstructure Technology (IMT), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| | - N MacKinnon
- Institute of Microstructure Technology (IMT), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| | - E Schleicher
- Institute of Physical Chemistry (IPC), University of Freiburg, Albertstr. 21, 79104 Freiburg, Germany
| | - S Weber
- Institute of Physical Chemistry (IPC), University of Freiburg, Albertstr. 21, 79104 Freiburg, Germany
| | - J G Korvink
- Institute of Microstructure Technology (IMT), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| |
Collapse
|
7
|
Kingsbury M, Weeks M, MacKinnon N, Evans J, Mahedy L, Dykxhoorn J, Colman I. Stressful Life Events During Pregnancy and Offspring Depression: Evidence From a Prospective Cohort Study. J Am Acad Child Adolesc Psychiatry 2016; 55:709-716.e2. [PMID: 27453085 DOI: 10.1016/j.jaac.2016.05.014] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2016] [Revised: 04/14/2016] [Accepted: 05/26/2016] [Indexed: 02/03/2023]
Abstract
OBJECTIVE The fetal programming hypothesis posits that in utero exposure to stress can alter prenatal brain development and lifelong stress response. However, human studies linking objective prenatal stressors to offspring mental illness, especially depression, are rare. The purpose of this study was to examine the association between mothers' exposure to prenatal stressful life events (SLEs) and offspring depression. METHOD The sample comprised 10,569 members of a prospective population-based cohort, the Avon Longitudinal Study of Parents and Children (ALSPAC). Mothers reported on the occurrence and impact of 42 prenatal SLEs. Offspring depressive symptoms were assessed using a computerized version of the Clinical Interview Schedule-Revised (CIS-R) at age 17 to 18, as well as 13 self-report statements from the Short Mood and Feelings Questionnaire (SMFQ) at 6 time points from ages 10 to 11 to 18 to 19. Latent class growth analysis (LCGA) was used to identify trajectories of depressive symptoms across adolescence. RESULTS After adjusting for potential confounders, a 1-unit increase in maternal SLE scores (range, 0-168) during gestation was associated with increased offspring depressive symptoms (β = 0.07, p < .01) and major depression (odds ratio [OR] = 1.03, 95% CI 1.01, 1.06) at age 17 to 18. LCGA revealed 4 trajectories of depressive symptoms. High maternal SLEs (fourth quartile) were associated with membership in the trajectory characterized by stable, high levels of depression from age 10 to 11 to 18 to 19 years (OR = 1.72, 95% CI = 1.09, 2.71). CONCLUSION These results provide support for the fetal programming hypothesis, demonstrating that prenatal exposure to acute stress is associated with offspring depression in adolescence. Stress management may be of benefit for expectant mothers.
Collapse
Affiliation(s)
- Mila Kingsbury
- School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada
| | - Murray Weeks
- School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada
| | - Nathalie MacKinnon
- School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada
| | - Jonathan Evans
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - Liam Mahedy
- Institute of Psychological Medicine and Clinical Neuroscience, Cardiff University, Cardiff, UK
| | | | - Ian Colman
- School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada.
| |
Collapse
|
8
|
Mattina J, MacKinnon N, Henderson VC, Fergusson D, Kimmelman J. Design and Reporting of Targeted Anticancer Preclinical Studies: A Meta-Analysis of Animal Studies Investigating Sorafenib Antitumor Efficacy. Cancer Res 2016; 76:4627-36. [PMID: 27261504 DOI: 10.1158/0008-5472.can-15-3455] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2016] [Accepted: 04/21/2016] [Indexed: 12/17/2022]
Abstract
The validity of preclinical studies of candidate therapeutic agents has been questioned given their limited ability to predict their fate in clinical development, including due to design flaws and reporting bias. In this study, we examined this issue in depth by conducting a meta-analysis of animal studies investigating the efficacy of the clinically approved kinase inhibitor, sorafenib. MEDLINE, Embase, and BIOSIS databases were searched for all animal experiments testing tumor volume response to sorafenib monotherapy in any cancer published until April 20, 2012. We estimated effect sizes from experiments assessing changes in tumor volume and conducted subgroup analyses based on prespecified experimental design elements associated with internal, construct, and external validity. The meta-analysis included 97 experiments involving 1,761 animals. We excluded 94 experiments due to inadequate reporting of data. Design elements aimed at reducing internal validity threats were implemented only sporadically, with 66% reporting animal attrition and none reporting blinded outcome assessment or concealed allocation. Anticancer activity against various malignancies was typically tested in only a small number of model systems. Effect sizes were significantly smaller when sorafenib was tested against either a different active agent or combination arm. Trim and fill suggested a 37% overestimation of effect sizes across all malignancies due to publication bias. We detected a moderate dose-response in one clinically approved indication, hepatocellular carcinoma, but not in another approved malignancy, renal cell carcinoma, or when data were pooled across all malignancies tested. In support of other reports, we found that few preclinical cancer studies addressed important internal, construct, and external validity threats, limiting their clinical generalizability. Our findings reinforce the need to improve guidelines for the design and reporting of preclinical cancer studies. Cancer Res; 76(16); 4627-36. ©2016 AACR.
Collapse
Affiliation(s)
- James Mattina
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada
| | - Nathalie MacKinnon
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada
| | - Valerie C Henderson
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada
| | - Dean Fergusson
- Department of Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Jonathan Kimmelman
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, Québec, Canada.
| |
Collapse
|
9
|
Carlisle B, Demko N, Freeman G, Hakala A, MacKinnon N, Ramsay T, Hey S, London AJ, Kimmelman J. Benefit, Risk, and Outcomes in Drug Development: A Systematic Review of Sunitinib. J Natl Cancer Inst 2016; 108:djv292. [PMID: 26547927 PMCID: PMC5943825 DOI: 10.1093/jnci/djv292] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2014] [Revised: 05/19/2015] [Accepted: 09/22/2015] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Little is known about the total patient burden associated with clinical development and where burdens fall most heavily during a drug development program. Our goal was to quantify the total patient burden/benefit in developing a new drug. METHODS We measured risk using drug-related adverse events that were grade 3 or higher, benefit by objective response rate, and trial outcomes by whether studies met their primary endpoint with acceptable safety. The differences in risk (death rate) and benefit (overall response rate) between industry and nonindustry trials were analyzed with an inverse-variance weighted fixed effects meta-analysis implemented as a weighted regression analysis. All statistical tests were two-sided. RESULTS We identified 103 primary publications of sunitinib monotherapy, representing 9092 patients and 3991 patient-years of involvement over 10 years and 32 different malignancies. In total, 1052 patients receiving sunitinib monotherapy experienced objective tumor response (15.7% of intent-to-treat population, 95% confidence interval [CI] = 15.3% to 16.0%), 98 died from drug-related toxicities (1.08%, 95% CI = 1.02% to 1.14%), and at least 1245 experienced grade 3-4 drug-related toxicities (13.7%, 95% CI = 13.3% to 14.1%). Risk/benefit worsened as the development program matured, with several instances of replicated negative studies and almost no positive trials after the first responding malignancies were discovered. CONCLUSIONS Even for a successful drug, the risk/benefit balance of trials was similar to phase I cancer trials in general. Sunitinib monotherapy development showed worsening risk/benefit, and the testing of new indications responded slowly to evidence that sunitinib monotherapy would not extend to new malignancies. Research decision-making should draw on evidence from whole research programs rather than a narrow band of studies in the same indication.
Collapse
Affiliation(s)
- Benjamin Carlisle
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Nadine Demko
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Georgina Freeman
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Amanda Hakala
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Nathalie MacKinnon
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Tim Ramsay
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Spencer Hey
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Alex John London
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL)
| | - Jonathan Kimmelman
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada (BC, ND, GF, AH, NM, SH, JK); University of Ottawa, Ottawa Hospital Research Institute, Ottawa, Canada (TR); Program On Regulation, Therapeutics, And Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA (SH); Department of Philosophy and Center for Ethics and Policy, Carnegie Mellon University, Pittsburgh, PA (AJL).
| |
Collapse
|
10
|
Henderson VC, Demko N, Hakala A, MacKinnon N, Federico CA, Fergusson D, Kimmelman J. A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib. eLife 2015; 4:e08351. [PMID: 26460544 PMCID: PMC4600817 DOI: 10.7554/elife.08351] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2015] [Accepted: 09/05/2015] [Indexed: 01/01/2023] Open
Abstract
Poor study methodology leads to biased measurement of treatment effects in preclinical research. We used available sunitinib preclinical studies to evaluate relationships between study design and experimental tumor volume effect sizes. We identified published animal efficacy experiments where sunitinib monotherapy was tested for effects on tumor volume. Effect sizes were extracted alongside experimental design elements addressing threats to valid clinical inference. Reported use of practices to address internal validity threats was limited, with no experiments using blinded outcome assessment. Most malignancies were tested in one model only, raising concerns about external validity. We calculate a 45% overestimate of effect size across all malignancies due to potential publication bias. Pooled effect sizes for specific malignancies did not show apparent relationships with effect sizes in clinical trials, and we were unable to detect dose–response relationships. Design and reporting standards represent an opportunity for improving clinical inference. DOI:http://dx.doi.org/10.7554/eLife.08351.001 Developing a new drug can take years, partly because preclinical research on non-human animals is required before any clinical trials with humans can take place. Nevertheless, only a fraction of cancer drugs that are put into clinical trials after showing promising results in preclinical animal studies end up proving safe and effective in human beings. Many researchers and commentators have suggested that this high failure rate reflects flaws in the way preclinical studies in cancer are designed and reported. Now, Henderson et al. have looked at all the published animal studies of a cancer drug called sunitinib and asked how well the design of these studies attempted to limit bias and match the clinical scenarios they were intended to represent. This systematic review and meta-analysis revealed that many common practices, like randomization, were rarely implemented. None of the published studies used ‘blinding’, whereby information about which animals are receiving the drug and which animals are receiving the control is kept from the experimenter, until after the test; this technique can help prevent any expectations or personal preferences from biasing the results. Furthermore, most tumors were tested in only one model system, namely, mice that had been injected with specific human cancer cells. This makes it difficult to rule out that any anti-cancer activity was in fact unique to that single model. Henderson et al. went on to find evidence that suggests that the anti-cancer effects of sunitinib might have been overestimated by as much as 45% because those studies that found no or little anti-cancer effect were simply not published. Though it is known that the anti-cancer activity of the drug increases with the dose given in both human beings and animals, an evaluation of the effects of all the published studies combined did not detect such a dose-dependent response. The poor design and reporting issues identified provide further grounds for concern about the value of many preclinical experiments in cancer. These findings also suggest that there are many opportunities for improving the design and reliability of study reports. Researchers studying certain medical conditions (such as strokes) have already developed, and now routinely implement, a set of standards for the design and reporting of preclinical research. It now appears that the cancer research community should do the same. DOI:http://dx.doi.org/10.7554/eLife.08351.002
Collapse
Affiliation(s)
- Valerie C Henderson
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| | - Nadine Demko
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| | - Amanda Hakala
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| | - Nathalie MacKinnon
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| | - Carole A Federico
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| | - Dean Fergusson
- Department of Clinical Epidemiology, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Jonathan Kimmelman
- Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montréal, Canada
| |
Collapse
|
11
|
Abstract
BACKGROUND Ethical evaluation of risk-benefit in clinical trials is premised on the achievability of resolving research questions motivating an investigation. OBJECTIVE To determine the fraction and number of patients enrolled in trials that were at risk of not meaningfully addressing their primary research objective due to unsuccessful patient accrual. METHODS We used the National Library of Medicine clinical trial registry to capture all initiated phases 2 and 3 intervention clinical trials that were registered as closed in 2011. We then determined the number that had been terminated due to unsuccessful accrual and the number that had closed after less than 85% of the target number of human subjects had been enrolled. Five factors were tested for association with unsuccessful accrual. RESULTS Of 2579 eligible trials, 481 (19%) either terminated for failed accrual or completed with less than 85% expected enrolment, seriously compromising their statistical power. Factors associated with unsuccessful accrual included greater number of eligibility criteria (p = 0.013), non-industry funding (25% vs 16%, p < 0.0001), earlier trial phase (23% vs 16%, p < 0.0001), fewer number of research sites at trial completion (p < 0.0001) and at registration (p < 0.0001), and an active (non-placebo) comparator (23% vs 16%, p < 0.001). CONCLUSION A total of 48,027 patients had enrolled in trials closed in 2011 who were unable to answer the primary research question meaningfully. Ethics bodies, investigators, and data monitoring committees should carefully scrutinize trial design, recruitment plans, and feasibility of achieving accrual targets when designing and reviewing trials, monitor accrual once initiated, and take corrective action when accrual is lagging.
Collapse
Affiliation(s)
- Benjamin Carlisle
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada
| | - Jonathan Kimmelman
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada
| | - Tim Ramsay
- Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Nathalie MacKinnon
- Studies of Translation, Ethics and Medicine (STREAM), Biomedical Ethics Unit, McGill University, Montréal, QC, Canada
| |
Collapse
|
12
|
MacKinnon N. Performance measures in ambulatory pharmacy. Pharm Pract Manag Q 1997; 17:52-62. [PMID: 10166244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
Affiliation(s)
- N MacKinnon
- DuBow Family Center for Research in Pharmaceutical Care, University of Florida, USA
| |
Collapse
|