1
|
Elsman EBM, Baba A, Offringa M. PRISMA-COSMIN 2024: New guidance aimed to enhance the reporting quality of systematic reviews of outcome measurement instruments. Int J Nurs Stud 2024; 160:104880. [PMID: 39276710 DOI: 10.1016/j.ijnurstu.2024.104880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2024] [Accepted: 08/19/2024] [Indexed: 09/17/2024]
Affiliation(s)
- Ellen B M Elsman
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada; Amsterdam UMC, Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam, Netherlands.
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| |
Collapse
|
2
|
Howie AH, Tingley K, Inbar-Feigenberg M, Mitchell JJ, Angel K, Gentle J, Smith M, Offringa M, Butcher NJ, Campeau PM, Chakraborty P, Chan A, Fergusson D, Mamak E, McClelland P, Mercimek-Andrews S, Mhanni A, Moazin Z, Rockman-Greenberg C, Rupar CA, Skidmore B, Stockler S, Thavorn K, Wyatt A, Potter BK. Review of clinical trials and guidelines for children and youth with mucopolysaccharidosis: outcome selection and measurement. Orphanet J Rare Dis 2024; 19:393. [PMID: 39443985 PMCID: PMC11520150 DOI: 10.1186/s13023-024-03364-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Accepted: 09/17/2024] [Indexed: 10/25/2024] Open
Abstract
BACKGROUND To inform the development of a core outcome set (COS) for children and youth with mucopolysaccharidoses (MPS), we aimed to identify all outcomes and associated outcome measurement instruments that are reported in recent clinical trials and recommended as measurements in clinical management guidelines. METHODS To identify English-language clinical trials and guidelines pertaining to MPS published between 2011 and mid-2021, we applied a comprehensive peer-reviewed search strategy to relevant databases and registers on May 16, 2021. Two reviewers independently screened retrieved citations and then full-text articles to determine eligibility for inclusion. From articles meeting inclusion criteria, we extracted details of the study design, population, intervention, and comparator, along with verbatim outcomes and associated outcome measurement instruments. Outcomes were organized into domains within five a priori core areas: life impact, pathophysiological manifestations, growth and development, resource use, and death. We conducted descriptive analyses at the study level, grouping articles arising from the same study. RESULTS From 2593 unique citations, 73 articles from 61 unique studies were included in the review, pertaining to all MPS subtypes except for exceptionally rare subtypes. Eighty-four unique outcomes were reported across the studies, 33 (39%) of which were reported by three or fewer studies. Most outcomes (55; 65%) were in the pathophysiological manifestations core area, followed by life impact (17; 20%) and growth and development (10; 12%); one outcome each pertained to resource use and death. The most frequently reported outcomes were general adverse events (45; 74%), immune-related adverse events (39; 64%), and urinary glycosaminoglycans (38; 62%). Substantial variability existed in the reporting of outcome measurement instruments. Some differences in outcome reporting were observed by MPS subtype and publication year. DISCUSSION Outcomes reported in clinical trials and guidelines for MPS in children and youth vary considerably and largely focus on pathophysiological manifestations. A COS is needed to standardize the selection and measurement of meaningful outcomes across future studies. We will present the outcomes identified in this review to knowledge users as part of a consensus process to select the most critical outcomes for inclusion in the COS. Trial Registration The protocol for this study was registered in PROSPERO (CRD42021267531) and in the COMET Database.
Collapse
Affiliation(s)
- Alison H Howie
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Kylie Tingley
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | | | | | - Kim Angel
- The Canadian MPS Society, Vancouver, Canada
| | | | - Maureen Smith
- Patient Partner, Canadian Organization for Rare Disorders, Ottawa, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Canada
| | | | | | | | - Alicia Chan
- Department of Medical Genetics, University of Alberta, Edmonton, Canada
| | | | - Eva Mamak
- Department of Psychology, Hospital for Sick Children, Toronto, Canada
| | | | | | - Aizeddin Mhanni
- Max Rady College of Medicine, Winnipeg, Canada
- Department of Pediatrics and Child Health, University of Manitoba, Winnipeg, Canada
| | - Zeinab Moazin
- Children's Hospital of Eastern Ontario, Ottawa, Canada
| | | | - C Anthony Rupar
- Department of Pathology and Laboratory Medicine, Western University, London, Canada
| | | | | | - Kednapa Thavorn
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Ottawa Hospital Research Institute, Ottawa, Canada
| | | | - Beth K Potter
- School of Epidemiology and Public Health, University of Ottawa, 600 Peter Morand Crescent, Ottawa, ON, K1G 5Z3, Canada.
| |
Collapse
|
3
|
Monga S, Andrei S, Quinn RC, Khudiakova V, Desai R, Srirangan A, Patel S, Szatmari P, Butcher NJ, Krause KR, Courtney DB, Offringa M, Elsman EBM. Systematic Review: Measurement Properties of Patient-Reported Outcome Measures Used to Measure Depression Symptom Severity in Adolescents With Depression. J Am Acad Child Adolesc Psychiatry 2024:S0890-8567(24)01318-2. [PMID: 39151790 DOI: 10.1016/j.jaac.2024.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 06/21/2024] [Accepted: 08/07/2024] [Indexed: 08/19/2024]
Abstract
OBJECTIVE To systematically evaluate the measurement properties of 12 patient-reported outcome measures (PROMs) used to measure depression symptom severity in adolescents with depression. Depression symptom severity was chosen as the outcome of focus given its importance as an outcome to measure in adolescents with depression across clinical trials and/or care. METHOD MEDLINE, PsycInfo, Embase, Scopus, CINAHL, and Cochrane were searched from year of inception up to December 7, 2023. Study appraisal (ie, risk of bias), evaluation of measurement properties, and evidence synthesis followed the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. Included studies evaluated at least 1 of 9 measurement properties as detailed in the COSMIN taxonomy within a reported sample or subgroup of youth ages 12 to 24 years, with at least 40% meeting criteria for any depressive disorder. RESULTS Of the 15,560 records identified, 31 studies for 7 PROMs were included in the COSMIN appraisal. Although several PROMs have the potential to accurately measure depression symptom severity in adolescents with depression, at this time none of the PROMs can be recommended for use without further evaluative work. High-quality evidence was generally lacking, largely due to few or inconsistent findings, small sample sizes, and other methodological concerns. CONCLUSION This systematic review of the measurement properties of 12 PROMs used to measure depression symptom severity in adolescents with depression found that none of the PROMs can be recommended for use until further evaluative work is conducted. Clinicians and researchers should proceed with caution when using these PROMs. DIVERSITY AND INCLUSION STATEMENT One or more of the authors of this paper self-identifies as a member of one or more historically underrepresented racial and/or ethnic groups in science. One or more of the authors of this paper self-identifies as a member of one or more historically underrepresented sexual and/or gender groups in science. We actively worked to promote sex and gender balance in our author group. We actively worked to promote inclusion of historically underrepresented racial and/or ethnic groups in science in our author group. The author list of this paper includes contributors from the location and/or community where the research was conducted who participated in the data collection, design, analysis, and/or interpretation of the work.
Collapse
Affiliation(s)
- Suneeta Monga
- Hospital for Sick Children, Toronto, Ontario, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
| | - Sorina Andrei
- Hospital for Sick Children, Toronto, Ontario, Canada
| | | | | | - Riddhi Desai
- Hospital for Sick Children, Toronto, Ontario, Canada
| | | | - Sneha Patel
- Hospital for Sick Children, Toronto, Ontario, Canada
| | - Peter Szatmari
- Hospital for Sick Children, Toronto, Ontario, Canada; Centre for Addiction and Mental Health, Toronto, Ontario, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Nancy J Butcher
- Hospital for Sick Children, Toronto, Ontario, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Karolin R Krause
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - Darren B Courtney
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Martin Offringa
- Hospital for Sick Children, Toronto, Ontario, Canada; Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Ellen B M Elsman
- Hospital for Sick Children, Toronto, Ontario, Canada; Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
4
|
Veal C, Tomlinson A, Cipriani A, Bulteau S, Henry C, Müh C, Touboul S, De Waal N, Levy-Soussan H, Furukawa TA, Fried EI, Tran VT, Chevance A. Heterogeneity of outcome measures in depression trials and the relevance of the content of outcome measures to patients: a systematic review. Lancet Psychiatry 2024; 11:285-294. [PMID: 38490761 DOI: 10.1016/s2215-0366(23)00438-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 12/22/2023] [Accepted: 12/28/2023] [Indexed: 03/17/2024]
Abstract
Research waste occurs when randomised controlled trial (RCT) outcomes are heterogeneous or overlook domains that matter to patients (eg, relating to symptoms or functions). In this systematic review, we reviewed the outcome measures used in 450 RCTs of adult unipolar and bipolar depression registered between 2018 and 2022 and identified 388 different measures. 40% of the RCTs used the same measure (Hamilton Depression Rating Scale [HAMD]). Patients and clinicians matched each item within the 25 most frequently used measures with 80 previously identified domains of depression that matter to patients. Seven (9%) domains were not covered by the 25 most frequently used outcome measures (eg, mental pain and irritability). The HAMD covered a maximum of 47 (59%) of the 80 domains that matter to patients. An interim solution to facilitate evidence synthesis before a core outcome set is developed would be to use the most common measures and choose complementary scales to optimise domain coverage. TRANSLATIONS: For the French and Dutch translations of the abstract see Supplementary Materials section.
Collapse
Affiliation(s)
- Christopher Veal
- Université Paris Cité and Université Sorbonne Paris Nord, INSERM INRAE, Centre for Research in Epidemiology and Statistics, Paris, France; Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, Paris, France
| | | | - Andrea Cipriani
- Department of Psychiatry, University of Oxford, Oxford, UK; Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK; Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| | - Samuel Bulteau
- UMR INSERM 1246, SPHERE, University of Nantes and University of Tours, Nantes, France; CHU Nantes, Department of Addictology, Psychiatry and Old Age Psychiatry, Nantes, France
| | - Chantal Henry
- Université Paris Cité, Paris, France; Department of Psychiatry, Service Hospitalo-Universitaire, GHU Paris Psychiatrie and Neurosciences, Paris, France
| | - Chlöé Müh
- Perception and Memory Unit, Institut Pasteur, UMR3571, CNRS, Paris, France; Université Paris Cité, Collège Doctoral, Paris, France
| | | | | | | | - Toshi A Furukawa
- Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
| | - Eiko I Fried
- Clinical Psychology Unit, Psychology Department, Leiden University, Leiden, Netherlands
| | - Viet-Thi Tran
- Université Paris Cité and Université Sorbonne Paris Nord, INSERM INRAE, Centre for Research in Epidemiology and Statistics, Paris, France; Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, Paris, France
| | - Astrid Chevance
- Université Paris Cité and Université Sorbonne Paris Nord, INSERM INRAE, Centre for Research in Epidemiology and Statistics, Paris, France; Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, Paris, France.
| |
Collapse
|
5
|
Bjornstad G, Sonthalia S, Rouse B, Freeman L, Hessami N, Dunne JH, Axford N. A comparison of the effectiveness of cognitive behavioural interventions based on delivery features for elevated symptoms of depression in adolescents: A systematic review. CAMPBELL SYSTEMATIC REVIEWS 2024; 20:e1376. [PMID: 38188230 PMCID: PMC10771715 DOI: 10.1002/cl2.1376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 11/03/2023] [Indexed: 01/09/2024]
Abstract
Background Depression is a public health problem and common amongst adolescents. Cognitive behavioural therapy (CBT) is widely used to treat adolescent depression but existing research does not provide clear conclusions regarding the relative effectiveness of different delivery modalities. Objectives The primary aim is to estimate the relative efficacy of different modes of CBT delivery compared with each other and control conditions for reducing depressive symptoms in adolescents. The secondary aim is to compare the different modes of delivery with regard to intervention completion/attrition (a proxy for intervention acceptability). Search Methods The Cochrane Depression, Anxiety and Neurosis Clinical Trials Register was searched in April 2020. MEDLINE, PsycInfo, EMBASE, four other electronic databases, the CENTRAL trial registry, Google Scholar and Google were searched in November 2020, together with reference checking, citation searching and hand-searching of two databases. Selection Criteria Randomised controlled trials (RCTs) of CBT interventions (irrespective of delivery mode) to reduce symptoms of depression in young people aged 10-19 years with clinically relevant symptoms or diagnosis of depression were included. Data Collection and Analysis Screening and data extraction were completed by two authors independently, with discrepancies addressed by a third author. CBT interventions were categorised as follows: group CBT, individual CBT, remote CBT, guided self-help, and unguided self-help. Effect on depressive symptom score was estimated across validated self-report measures using Hedges' g standardised mean difference. Acceptability was estimated based on loss to follow-up as an odds ratio. Treatment rankings were developed using the surface under the cumulative ranking curve (SUCRA). Pairwise meta-analyses were conducted using random effects models where there were two or more head-to-head trials. Network analyses were conducted using random effects models. Main Results Sixty-eight studies were included in the review. The mean age of participants ranged from 10 to 19.5 years, and on average 60% of participants were female. The majority of studies were conducted in schools (28) or universities (6); other settings included primary care, clinical settings and the home. The number of CBT sessions ranged from 1 to 16, the frequency of delivery from once every 2 weeks to twice a week and the duration of each session from 20 min to 2 h. The risk of bias was low across all domains for 23 studies, 24 studies had some concerns and the remaining 21 were assessed to be at high risk of bias. Sixty-two RCTs (representing 6435 participants) were included in the pairwise and network meta-analyses for post-intervention depressive symptom score at post-intervention. All pre-specified treatment and control categories were represented by at least one RCT. Although most CBT approaches, except remote CBT, demonstrated superiority over no intervention, no approaches performed clearly better than or equivalent to another. The highest and lowest ranking interventions were guided self-help (SUCRA 83%) and unguided self-help (SUCRA 51%), respectively (very low certainty in treatment ranking). Nineteen RCTs (3260 participants) were included in the pairwise and network meta-analyses for 6 to 12 month follow-up depressive symptom score. Neither guided self-help nor remote CBT were evaluated in the RCTs for this time point. Effects were generally attenuated for 6- to 12-month outcomes compared to posttest. No interventions demonstrated superiority to no intervention, although unguided self-help and group CBT both demonstrated superiority compared to TAU. No CBT approach demonstrated clear superiority over another. The highest and lowest ranking approaches were unguided self-help and individual CBT, respectively. Sixty-two RCTs (7347 participants) were included in the pairwise and network meta-analyses for intervention acceptability. All pre-specified treatment and control categories were represented by at least one RCT. Although point estimates tended to favour no intervention, no active treatments were clearly inferior. No CBT approach demonstrated clear superiority over another. The highest and lowest ranking active interventions were individual CBT and group CBT respectively. Pairwise meta-analytic findings were similar to those of the network meta-analysis for all analyses. There may be age-based subgroup effects on post-intervention depressive symptoms. Using the no intervention control group as the reference, the magnitudes of effects appear to be larger for the oldest age categories compared to the other subgroups for each given comparison. However, they were generally less precise and formal testing only indicated a significant difference for group CBT. Findings were robust to pre-specified sensitivity analyses separating out the type of placebo and excluding cluster-RCTs, as well as an additional analysis excluding studies where we had imputed standard deviations. Authors' Conclusions At posttreatment, all active treatments (group CBT, individual CBT, guided self-help, and unguided self-help) except for remote CBT were more effective than no treatment. Guided self-help was the most highly ranked intervention but only evaluated in trials with the oldest adolescents (16-19 years). Moreover, the studies of guided self-help vary in the type and amount of therapist support provided and longer-term results are needed to determine whether effects persist. The magnitude of effects was generally attenuated for 6- to 12-month outcomes. Although unguided self-help was the lowest-ranked active intervention at post-intervention, it was the highest ranked at follow-up. This suggests the need for further research into whether interventions with self-directed elements enable young people to maintain effects by continuing or revisiting the intervention independently, and whether therapist support would improve long-term outcomes. There was no clear evidence that any active treatments were more acceptable to participants than any others. The relative effectiveness of intervention delivery modes must be taken into account in the context of the needs and preferences of individual young people, particularly as the differences between effect sizes were relatively small. Further research into the type and amount of therapist support that is most acceptable to young people and most cost-effective would be particularly useful.
Collapse
Affiliation(s)
- Gretchen Bjornstad
- NIHR Applied Research Collaboration South West Peninsula (PenARC)University of Exeter Medical SchoolExeterUK
- Dartington Service Design LabBuckfastleighUK
| | - Shreya Sonthalia
- Dartington Service Design LabBuckfastleighUK
- MRC/CSO Social and Public Health Sciences UnitUniversity of GlasgowGlasgowUK
| | - Benjamin Rouse
- Center for Clinical Evidence and Guidelines, ECRI InstitutePlymouth MeetingPennsylvaniaUSA
| | | | | | - Jo Hickman Dunne
- The Centre for Youth ImpactLondonUK
- University of ManchesterManchesterUK
| | - Nick Axford
- NIHR Applied Research Collaboration South West Peninsula (PenARC)University of PlymouthPlymouthUK
| |
Collapse
|
6
|
Krause KR, Calderón A, Pino VG, Edbrooke-Childs J, Moltrecht B, Wolpert M. What treatment outcomes matter in adolescent depression? A Q-study of priority profiles among mental health practitioners in the UK and Chile. Eur Child Adolesc Psychiatry 2024; 33:151-166. [PMID: 36719524 PMCID: PMC10806045 DOI: 10.1007/s00787-023-02140-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 01/05/2023] [Indexed: 02/01/2023]
Abstract
Evidence-based and person-centred care requires the measurement of treatment outcomes that matter to youth and mental health practitioners. Priorities, however, may vary not just between but also within stakeholder groups. This study used Q-methodology to explore differences in outcome priorities among mental health practitioners from two countries in relation to youth depression. Practitioners from the United Kingdom (UK) (n = 27) and Chile (n = 15) sorted 35 outcome descriptions by importance and completed brief semi-structured interviews about their sorting rationale. By-person principal component analysis (PCA) served to identify distinct priority profiles within each country sample; second-order PCA examined whether these profiles could be further reduced into cross-cultural "super profiles". We identified three UK outcome priority profiles (Reduced symptoms and enhanced well-being; improved individual coping and self-management; improved family coping and support), and two Chilean profiles (Strengthened identity and enhanced insight; symptom reduction and self-management). These could be further reduced into two cross-cultural super profiles: one prioritized outcomes related to reduced depressive symptoms and enhanced well-being; the other prioritized outcomes related to improved resilience resources within youth and families. A practitioner focus on symptom reduction aligns with a long-standing focus on symptomatic change in youth depression treatment studies, and with recent measurement recommendations. Less data and guidance are available to those practitioners who prioritize resilience outcomes. To raise the chances that such practitioners will engage in evidence-based practice and measurement-based care, measurement guidance for a broader set of outcomes may be needed.
Collapse
Affiliation(s)
- Karolin Rose Krause
- Research Department for Clinical, Educational and Health Psychology, University College London, Gower Street, Bloomsbury, London, WC1E 6BT, UK.
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health (CAMH), Toronto, Canada.
| | - Ana Calderón
- Facultad de Psicología y Humanidades, Universidad San Sebastián, Sede Santiago, Chile
| | - Victor Gomez Pino
- Facultad de Medicina, Departamento de Psiquiatría Norte, Hospital Clínico, Clínica Psiquiátrica Universitaria, Universidad de Chile, Avenida La Paz 1003, Recoleta, Chile
| | - Julian Edbrooke-Childs
- Research Department for Clinical, Educational and Health Psychology, University College London, Gower Street, Bloomsbury, London, WC1E 6BT, UK
- Evidence-Based Practice Unit, Anna Freud National Centre for Children and Families, 4-8 Rodney Street, London, N1 9JH, UK
| | - Bettina Moltrecht
- Evidence-Based Practice Unit, Anna Freud National Centre for Children and Families, 4-8 Rodney Street, London, N1 9JH, UK
- Centre for Longitudinal Studies, University College London, 55-59 Gordon Square, London, WC1H 0NU, UK
| | - Miranda Wolpert
- Research Department for Clinical, Educational and Health Psychology, University College London, Gower Street, Bloomsbury, London, WC1E 6BT, UK
- Wellcome Trust, 215 Euston Rd, Bloomsbury, London, NW1 2BE, UK
| |
Collapse
|
7
|
Hankin BL, Griffith JM. What Do We Know About Depression Among Youth and How Can We Make Progress Toward Improved Understanding and Reducing Distress? A New Hope. Clin Child Fam Psychol Rev 2023; 26:919-942. [PMID: 37285011 PMCID: PMC10245370 DOI: 10.1007/s10567-023-00437-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/08/2023] [Indexed: 06/08/2023]
Abstract
This paper summarizes many findings about depression among children and adolescents. Depression is prevalent, highly distressing, and exerts considerable burden worldwide. Rates surge from childhood through young adulthood and have increased over the last decade. Many risk factors have been identified, and evidence-based interventions exist targeting mostly individual-level changes via psychological or pharmacological means. At the same time, the field appears stuck and has not achieved considerable progress in advancing scientific understanding of depression's features or delivering interventions to meet the challenge of youth depression's high and growing prevalence. This paper adopts several positions to address these challenges and move the field forward. First, we emphasize reinvigoration of construct validation approaches that may better characterize youth depression's phenomenological features and inform more valid and reliable assessments that can enhance scientific understanding and improve interventions for youth depression. To this end, history and philosophical principles affecting depression's conceptualization and measurement are considered. Second, we suggest expanding the range and targets of treatments and prevention efforts beyond current practice guidelines for evidence-based interventions. This broader suite of interventions includes structural- and system-level change focused at community and societal levels (e.g., evidence-based economic anti-poverty interventions) and personalized interventions with sufficient evidence base. We propose that by focusing on the FORCE (Fundamentals, Openness, Relationships, Constructs, Evidence), youth depression research can provide new hope.
Collapse
Affiliation(s)
- Benjamin L Hankin
- Department of Psychology, University of Illinois Urbana Champaign, 603 E. Daniel Street, Champaign, IL, 61820, USA.
| | - Julianne M Griffith
- Department of Psychology, University of Illinois Urbana Champaign, 603 E. Daniel Street, Champaign, IL, 61820, USA
| |
Collapse
|
8
|
Patton MC, Desai R, Noureddine Y, Prebeg MJ, Krause KR, Vohra S, Butcher NJ, Monga S. Outcomes and outcome measurement instruments reported in randomised controlled trials of anxiety disorder treatments in children and adolescents: a scoping review protocol. BMJ Open 2022; 12:e063404. [PMID: 36207041 PMCID: PMC9558797 DOI: 10.1136/bmjopen-2022-063404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
INTRODUCTION Paediatric anxiety disorders (AD) are prevalent and persistent mental health conditions worldwide affecting between 10% and 20% of children and adolescents. Despite the high prevalence of paediatric AD, there is limited understanding of which treatments work best. Outcome heterogeneity across paediatric mental health trials has been a significant factor in hindering the ability to compare results and assess the efficacy of such trials. This scoping review will help to identify and synthesise the outcomes reported in paediatric AD trials to date. METHODS AND ANALYSIS Following the Joanna Briggs Institute scoping review methodology, a comprehensive electronic bibliographic database search (MEDLINE, APA PsycINFO, Embase, CINAHL) strategy will be applied to identify articles examining interventions for children diagnosed with an AD. Articles will be eligible for inclusion if they assess at least one AD intervention (eg, psychological), in children 4-18 years of age inclusive. Initial title and abstract screening will be completed by two trained reviewers independently and in duplicate. Full-text screening of each included article will be completed independently and in duplicate by two of three trained reviewers. Identified outcomes will be mapped to a standard outcome taxonomy developed for core outcome sets. Trial and outcome characteristics will be synthesised using quantitative metrics (counts and frequencies). ETHICS AND DISSEMINATION As this is a scoping review of the literature and patient information or records were not accessed, institutional ethics approval was not required. Results of this scoping review will be disseminated to clinicians, researchers inclusive of trialists and other stakeholders invested in outcome selection, measurement and reporting in paediatric AD trials. In addition, scoping review results will inform the development of a Core Outcome Set for paediatric AD trials-a minimum set of outcomes that should be measured across trials in an area of health, without precluding the inclusion of other outcomes.
Collapse
Affiliation(s)
- Megan C Patton
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Riddhi Desai
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Yasmine Noureddine
- Neurosciences and Mental Health, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Matthew J Prebeg
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
- Margaret and Wallace McCain Centre for Child, Youth & Family Mental Health, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
| | - Karolin Rose Krause
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Educational and Health Psychology, University College London, London, UK
| | - Sunita Vohra
- Pediatrics, University of Alberta, Edmonton, Alberta, Canada
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Suneeta Monga
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
- Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
9
|
Elsman EBM, Butcher NJ, Mokkink LB, Terwee CB, Tricco A, Gagnier JJ, Aiyegbusi OL, Barnett C, Smith M, Moher D, Offringa M. Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments. Syst Rev 2022; 11:121. [PMID: 35698213 PMCID: PMC9195229 DOI: 10.1186/s13643-022-01994-5] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 05/28/2022] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Systematic reviews of outcome measurement instruments are important tools in the evidence-based selection of these instruments. COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) has developed a comprehensive and widespread guideline to conduct systematic reviews of outcome measurement instruments, but key information is often missing in published reviews. This hinders the appraisal of the quality of outcome measurement instruments, impacts the decisions of knowledge users regarding their appropriateness, and compromises reproducibility and interpretability of the reviews' findings. To facilitate sufficient, transparent, and consistent reporting of systematic reviews of outcome measurement instruments, an extension of the PRISMA (Preferred Reporting of Items for Systematic reviews and Meta-Analyses) 2020 guideline will be developed: the PRISMA-COSMIN guideline. METHODS The PRISMA-COSMIN guideline will be developed in accordance with recommendations for reporting guideline development from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. First, a candidate reporting item list will be created through an environmental literature scan and expert consultations. Second, an international Delphi study will be conducted with systematic review authors, biostatisticians, epidemiologists, psychometricians/clinimetricians, reporting guideline developers, journal editors as well as patients, caregivers, and members of the public. Delphi panelists will rate candidate items for inclusion on a 5-point scale, suggest additional candidate items, and give feedback on item wording and comprehensibility. Third, the draft PRISMA-COSMIN guideline and user manual will be iteratively piloted by applying it to systematic reviews in several disease areas to assess its relevance, comprehensiveness, and comprehensibility, along with usability and user satisfaction. Fourth, a consensus meeting will be held to finalize the PRISMA-COSMIN guideline through roundtable discussions and voting. Last, a user manual will be developed and the final PRISMA-COSMIN guideline will be disseminated through publications, conferences, newsletters, and relevant websites. Additionally, relevant journals and organizations will be invited to endorse and implement PRISMA-COSMIN. Throughout the project, evaluations will take place to identify barriers and facilitators of involving patient/public partners and employing a virtual process. DISCUSSION The PRISMA-COSMIN guideline will ensure that the reports of systematic reviews of outcome measurement instruments are complete and informative, enhancing their reproducibility, ease of use, and uptake.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands.
- Quality of Care, Amsterdam Public Health, Amsterdam, The Netherlands.
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Lidwine B Mokkink
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Andrea Tricco
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada
- Epidemiology Division and Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
- Queen's Collaboration for Health Care Quality Joanna Briggs Institute Centre of Excellence, Queen's University, Kingston, Canada
| | - Joel J Gagnier
- Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, London, Ontario, Canada
- Department of Surgery, Schulich School of Medicine and Dentistry, London, Ontario, Canada
- Department of Orthopaedic Surgery, University of Michigan, Ann Arbor, Michigan, USA
- Department of Epidemiology, School of Public Health, University of Michigan, Ann Arbor, Michigan, USA
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Carolina Barnett
- Division of Neurology, Department of Medicine, University Health Network and University of Toronto, Toronto, Ontario, Canada
| | | | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Management and Evaluation, Institute of Health Policy, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
10
|
Fried EI, Flake JK, Robinaugh DJ. Revisiting the theoretical and methodological foundations of depression measurement. NATURE REVIEWS PSYCHOLOGY 2022; 1:358-368. [PMID: 38107751 PMCID: PMC10723193 DOI: 10.1038/s44159-022-00050-2] [Citation(s) in RCA: 110] [Impact Index Per Article: 36.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/22/2022] [Indexed: 12/19/2023]
Abstract
Depressive disorders are among the leading causes of global disease burden, but there has been limited progress in understanding the causes and treatments for these disorders. In this Perspective, we suggest that such progress crucially depends on our ability to measure depression. We review the many problems with depression measurement, including limited evidence of validity and reliability. These issues raise grave concerns about common uses of depression measures, such as diagnosis or tracking treatment progress. We argue that shortcomings arise because depression measurement rests on shaky methodological and theoretical foundations. Moving forward, we need to break with the field's tradition that has, for decades, divorced theories about depression from how we measure it. Instead, we suggest that epistemic iteration, an iterative exchange between theory and measurement, provides a crucial avenue for depression measurement to progress.
Collapse
Affiliation(s)
- Eiko I. Fried
- Department of Clinical Psychology, Leiden University, Leiden, The Netherlands
| | - Jessica K. Flake
- Department of Psychology, McGill University, Montreal, Quebec, Canada
| | - Donald J. Robinaugh
- Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts, US
- Department of Applied Psychology, Northeastern University, Boston, Massachusetts, US
| |
Collapse
|
11
|
Smailes D, Alderson-Day B, Hazell C, Wright A, Moseley P. Measurement practices in hallucinations research. Cogn Neuropsychiatry 2022; 27:183-198. [PMID: 34743653 PMCID: PMC9006980 DOI: 10.1080/13546805.2021.1999224] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 10/22/2021] [Indexed: 11/23/2022]
Abstract
Introduction: In several sub-fields of psychology, there has been a renewed focus on measurement practices. As far as we are aware, this has been absent in hallucinations research. Thus, we investigated (a) cross-study variation in how hallucinatory experiences are measured and (b) the reliability of measurements obtained using two tasks that are widely employed in hallucinations research.Method: In Study 1, we investigated to what extent there was variation in how the Launay-Slade Hallucination Scale (LSHS) has been used across 100 studies. In Study 2, we investigated the reliability of the measurements obtained through source monitoring and signal detection tasks, using data from four recent publications. Materials/data are available at doi: 10.17605/osf.io/d3gnk/.Results: In Study 1, we found substantial variation in how hallucinatory experiences were assessed using the LSHS and that descriptions of the LSHS were often incomplete in important ways. In Study 2, we reported a range of reliability estimates for the measurements obtained using source monitoring and signal discrimination tasks. Some measurements obtained using source monitoring tasks had unacceptably low levels of reliability.Conclusions: Our findings suggest that suboptimal measurement practices are common in hallucinations research and we suggest steps researchers could take to improve measurement practices.
Collapse
Affiliation(s)
- David Smailes
- Department of Psychology, Northumbria University, Newcastle upon Tyne, UK
| | - Ben Alderson-Day
- Department of Psychology, Science Laboratories, Durham University, Durham, UK
| | - Cassie Hazell
- School of Social Sciences, University of Westminster, London, UK
| | - Abigail Wright
- Center of Excellence for Psychosocial and Systemic Research, Department of Psychiatry, Massachusetts General Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Peter Moseley
- Department of Psychology, Northumbria University, Newcastle upon Tyne, UK
| |
Collapse
|
12
|
Manfro PH, Pereira RB, Rosa M, Cogo-Moreira H, Fisher HL, Kohrt BA, Mondelli V, Kieling C. Adolescent depression beyond DSM definition: a network analysis. Eur Child Adolesc Psychiatry 2021; 32:881-892. [PMID: 34854985 PMCID: PMC10147766 DOI: 10.1007/s00787-021-01908-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 09/23/2021] [Indexed: 01/22/2023]
Abstract
Calls for refining the understanding of depression beyond diagnostic criteria have been growing in recent years. We examined the prevalence and relevance of DSM and non-DSM depressive symptoms in two Brazilian school-based adolescent samples with two commonly used scales, the Patient Health Questionnaire (PHQ-A) and the Mood and Feelings Questionnaire (MFQ). We analyzed cross-sectional data from two similarly recruited samples of adolescents aged 14-16 years, as part of the Identifying Depression Early in Adolescence (IDEA) study in Brazil. We assessed dimensional depressive symptomatology using the PHQ-A in the first sample (n = 7720) and the MFQ in the second sample (n = 1070). We conducted network analyses to study symptom structure and centrality estimates of the two scales. Additionally, we compared centrality of items included (e.g., low mood, anhedonia) and not included in the DSM (e.g., low self-esteem, loneliness) in the MFQ. Sad mood and worthlessness items were the most central items in the network structure of the PHQ-A. In the MFQ sample, self-hatred and loneliness, two non-DSM features, were the most central items and DSM and non-DSM items in this scale formed a highly interconnected network of symptoms. Furthermore, analysis of the MFQ sample revealed DSM items not to be more frequent, severe or interconnected than non-DSM items, but rather part of a larger network of symptoms. A focus on symptoms might advance research on adolescent depression by enhancing our understanding of the disorder.
Collapse
Affiliation(s)
- Pedro H. Manfro
- Department of Psychiatry, School of Medicine, Universidade Federal do Rio Grande do Sul (UFRGS), Rua Ramiro Barcelos, 2350, 400N, Porto Alegre, RS 90035-903 Brazil
| | - Rivka B. Pereira
- Department of Psychiatry, School of Medicine, Universidade Federal do Rio Grande do Sul (UFRGS), Rua Ramiro Barcelos, 2350, 400N, Porto Alegre, RS 90035-903 Brazil
| | - Martha Rosa
- Department of Psychiatry, School of Medicine, Universidade Federal do Rio Grande do Sul (UFRGS), Rua Ramiro Barcelos, 2350, 400N, Porto Alegre, RS 90035-903 Brazil
| | - Hugo Cogo-Moreira
- Faculty of Teacher Education and Languages, Department of Education, ICT and Learning, Østfold University College, Halden, Norway
| | - Helen L. Fisher
- Social, Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
- ESRC Centre for Society and Mental Health, King’s College London, London, UK
| | - Brandon A. Kohrt
- Division of Global Mental Health, Department of Psychiatry, School of Medicine and Health Sciences, The George Washington University, Washington, DC USA
| | - Valeria Mondelli
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
- National Institute for Health Research Mental Health Biomedical Research Centre, South London and Maudsley NHS Foundation Trust and King’s College London, London, UK
| | - Christian Kieling
- Department of Psychiatry, School of Medicine, Universidade Federal do Rio Grande do Sul (UFRGS), Rua Ramiro Barcelos, 2350, 400N, Porto Alegre, RS 90035-903 Brazil
- Child and Adolescent Psychiatry Division, Hospital de Clínicas de Porto Alegre (HCPA), Porto Alegre, RS Brazil
| |
Collapse
|
13
|
Krause KR, Chung S, Sousa Fialho MDL, Szatmari P, Wolpert M. The challenge of ensuring affordability, sustainability, consistency, and adaptability in the common metrics agenda. Lancet Psychiatry 2021; 8:1094-1102. [PMID: 34656284 DOI: 10.1016/s2215-0366(21)00122-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Revised: 03/05/2021] [Accepted: 03/18/2021] [Indexed: 12/11/2022]
Abstract
Mental health research grapples with research waste and stunted field progression caused by inconsistent outcome measurement across studies and clinical settings, which means there is no common language for considering findings. Although recognising that no gold standard measures exist and that all existing measures are flawed in one way or another, anxiety and depression research is spearheading a common metrics movement to harmonise measurement, with several initiatives over the past 5 years recommending the consistent use of specific scales to allow read-across of measurements between studies. For this approach to flourish, however, common metrics must be acceptable and adaptable to a range of contexts and populations, and global access should be as easy and affordable as possible, including in low-income countries. Within a measurement landscape dominated by fixed proprietary measures and with competing views of what should be measured, achieving this goal poses a range of challenges. In this Personal View, we consider tensions between affordability, sustainability, consistency, and adaptability that, if not addressed, risk undermining the common metrics agenda. We outline a three-pronged way forward that involves funders taking more direct responsibility for measure development and dissemination; a move towards managing measure dissemination and adaptation via open-access measure hubs; and transitioning from fixed questionnaires to item banks. We argue that now is the time to start thinking of mental health metrics as 21st century tools to be co-owned and co-created by the mental health community, with support from dedicated infrastructure, coordinating bodies, and funders.
Collapse
Affiliation(s)
- Karolin Rose Krause
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Research Department for Clinical, Educational and Health Psychology, University College London, London, UK.
| | | | | | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Department of Psychiatry, University of Toronto, ON, Canada; Hospital for Sick Children, Toronto, ON, Canada
| | - Miranda Wolpert
- Research Department for Clinical, Educational and Health Psychology, University College London, London, UK; Wellcome Trust, London, UK
| |
Collapse
|
14
|
Igarashi M, Yamaguchi S, Kawaguchi T, Ogawa M, Sato S, Fujii C. Outcomes frequently specified in Cochrane reviews of community-based psychosocial interventions for adults with severe mental illness: A systematic search and narrative synthesis. Neuropsychopharmacol Rep 2021; 41:459-463. [PMID: 34725970 PMCID: PMC8698675 DOI: 10.1002/npr2.12216] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 09/21/2021] [Accepted: 10/10/2021] [Indexed: 11/14/2022] Open
Abstract
Background Outcome selection in intervention studies is a critical issue for synthesizing evidence. This study is aimed to investigate outcomes used in Cochrane reviews assessing community‐based psychosocial interventions for adults with severe mental illness. Methods Cochrane reviews that evaluated a community‐based psychosocial intervention for adults with severe mental illness were searched electronically and manually. We extracted all outcomes specified in the Methods section in each Cochrane review. Outcomes that represent the same concept and context were synthesized into an outcome term. Outcome terms were categorized according to the existing taxonomy. Results We included 33 Cochrane reviews. Of the 216 outcome terms identified, 13 were used in more than half of the reviews: quality of life, mental state, admission to hospital, economic outcome, leaving the study early, social functioning, satisfaction, global state, relapse, adverse events/effects, carer satisfaction, employment, and duration of admission. Most outcome terms were categorized into the life impact core area (55%), followed by the resource use area (21%). Conclusions Our study provides a candidate outcome list for developing a core outcome set for severe mental illness and offers a basis for comparison for future outcome investigation on mental health research. Two hundred and sixteen outcome terms were found by investigating all the outcomes used in 33 Cochrane reviews assessing community‐based psychosocial interventions for adults with severe mental illness. Thirteen outcome terms were used in more than half of the reviews: quality of life, mental state, admission to hospital, economic outcome, leaving the study early, social functioning, satisfaction, global state, relapse, adverse events/effects, carer satisfaction, employment, and duration of admission.
![]()
Collapse
Affiliation(s)
- Momoka Igarashi
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| | - Sosei Yamaguchi
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| | - Takayuki Kawaguchi
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| | - Makoto Ogawa
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| | - Sayaka Sato
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| | - Chiyo Fujii
- Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, Japan
| |
Collapse
|
15
|
Courtney DB, Watson P, Chan BW, Bennett K, Krause KR, Offringa M, Butcher NJ, Monga S, Neprily K, Zentner T, Rodak T, Szatmari P. Forks in the road: Definitions of response, remission, recovery, and other dichotomized outcomes in randomized controlled trials for adolescent depression. A scoping review. Depress Anxiety 2021; 38:1152-1168. [PMID: 34312952 DOI: 10.1002/da.23200] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 06/18/2021] [Accepted: 06/24/2021] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Definitions of dichotomous outcome terms, such as "response," "remission," and "recovery" are central to the design, interpretation, and clinical application of randomized controlled trials of adolescent depression interventions. Accordingly, this scoping review was conducted to document how these terms have been defined and justified in clinical trials. METHOD Bibliographic databases MEDLINE, Embase, APA PsycInfo, and CINAHL were searched from inception to February 2020 for randomized controlled trials evaluating treatments for adolescent depression. Ninety-eight trials were included for data extraction and analysis. RESULTS Assessment of outcome measurement instruments, metric strategies, methods of aggregation, and measurement timing, yielded 53 unique outcome definitions of "response" across 45 trials that assessed response, 47 unique definitions of "remission" in 29 trials that assessed remission, and 19 unique definitions of "recovery" across 11 trials that assessed recovery. A minority of trials (N = 35) provided a rationale for dichotomous outcomes definitions, often by citing other studies that used a similar definition (N = 11). No rationale included input from youth or families with lived experience. CONCLUSION Our review revealed that definitions of "response," "remission," "recovery," and related terms are highly variable, lack clear rationales, and are not informed by key stakeholder input. These limitations impair pooling of trial results and the incorporation of trial findings into pragmatic treatment decisions in clinical practice. Systematic approaches to establishing outcome definitions are needed to enhance the impact of trials examining adolescent depression treatment.
Collapse
Affiliation(s)
- Darren B Courtney
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Priya Watson
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | | | - Kathryn Bennett
- Department of Health Research Methods, Evidence and Impact (formerly Clinical Epidemiology and Biostatistics), McMaster Univeristy, Toronto, Ontario
| | | | - Martin Offringa
- Department of Pediatrics, Neonatology, University of Toronto, Toronto, Ontario
| | - Nancy J Butcher
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Suneeta Monga
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Kirsten Neprily
- Department of Psychology, School and Applied Child Psychology, University of Calgary, Calgary, Alberta
| | - Tabitha Zentner
- Margaret and Wallace McCain Centre for Child, Youth and Family Mental Health, Centre for Addiction and Mental Health, Toronto, Ontario
| | - Terri Rodak
- Centre for Addiction and Mental Health, Toronto, Ontario
| | - Peter Szatmari
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| |
Collapse
|
16
|
Rodrigues M, Sanger N, Dufort A, Sanger S, Panesar B, D'Elia A, Parpia S, Samaan Z, Thabane L. Outcomes reported in randomised controlled trials of major depressive disorder in older adults: protocol for a methodological review. BMJ Open 2021; 11:e054777. [PMID: 34725082 PMCID: PMC8562520 DOI: 10.1136/bmjopen-2021-054777] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
INTRODUCTION Major depressive disorder (MDD or depression) is prevalent among adults aged 65 years and older. The effectiveness and safety of interventions used to treat depression is often assessed through randomised controlled trials (RCTs). However, heterogeneity in the selection, measurement and reporting of outcomes in RCTs renders comparisons between trial results, interpretability and generalisability of findings challenging. There is presently no core outcome set (COS) for use in RCTs that assess interventions for older adults with MDD. We will conduct a methodological review of the literature for outcomes reported in trials for adults 65 years and older with depression to assess the heterogeneity of outcome measures. METHODS AND ANALYSIS RCTs evaluating pharmacotherapy, psychotherapy, or any other treatment intervention for older adults with MDD published in the last 10 years will be located using electronic database searches (MEDLINE, Embase, PsycINFO and the Cochrane Central Register of Controlled Trials). Reviewers will conduct title and abstract screening, full-text screening and data extraction of trials eligible for inclusion independently and in duplicate. Outcomes will be synthesised and mapped to core outcome-domain frameworks. We will summarise characteristics associated with trials and outcomes. ETHICS AND DISSEMINATION We hope that findings from our methodological review will reduce variability in outcome selection, measurement and reporting and facilitate the development of a COS for older adults with MDD. Our review will also inform evidence synthesis efforts in identifying the best treatment practices for this clinical population. Ethics approval is not required, as this study is a literature review. PROSPERO REGISTRATION NUMBER CRD42021244753.
Collapse
Affiliation(s)
- Myanca Rodrigues
- Health Research Methodology Graduate Program, Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Nitika Sanger
- Department of Psychiatry and Behavioral Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Alexander Dufort
- Department of Psychiatry and Behavioral Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Stephanie Sanger
- Health Sciences Library, McMaster University, Hamilton, Ontario, Canada
| | - Balpreet Panesar
- Neuroscience Graduate Program, McMaster University, Hamilton, Ontario, Canada
| | - Alessia D'Elia
- Neuroscience Graduate Program, McMaster University, Hamilton, Ontario, Canada
| | - Sameer Parpia
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Oncology, McMaster University, Hamilton, Ontario, Canada
| | - Zainab Samaan
- Department of Psychiatry and Behavioral Neurosciences, McMaster University, Hamilton, Ontario, Canada
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
- Mood Disorders Program, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Lehana Thabane
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton, Ontario, Canada
| |
Collapse
|
17
|
Patalay P, Fried EI. Editorial Perspective: Prescribing measures: unintended negative consequences of mandating standardized mental health measurement. J Child Psychol Psychiatry 2021; 62:1032-1036. [PMID: 32986859 DOI: 10.1111/jcpp.13333] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 08/14/2020] [Accepted: 08/21/2020] [Indexed: 01/10/2023]
Abstract
In July 2020, two of the largest funders of mental health research worldwide - the National Institute of Mental Health (NIMH) and the Wellcome Trust - announced plans to standardize mental health measurement. Specifically, obtaining funding for research related to depression and anxiety will be conditional on using four specific measures. While we agree that there are obvious benefits to standardizing mental health measurement, some of which are discussed in the announcement by NIMH and Wellcome, here we focus on potential unintended negative consequences of this initiative: Lacking transferability across settings: scales were developed for specific settings (e.g. community, clinic) and purposes (e.g. intervention studies), and their properties might not be easily transferable between settings. Narrowing the scope of inquiry: individuals experience mental health difficulties in wide-ranging ways, and the narrow scope of the proposed scales risks limiting important insights for research and treatments. Lowering the threshold for robust evidence: empirical findings limited to a specific imperfect measure are less robust than if such evidence is (re)produced across multiple scales. Creating a two-tiered mental health science: arbitrarily conferring gold standard status on some imperfect measures over others will create an artificial two-tiered system leading to an impoverishment of mental health research. Recommendations for mitigating these negative consequences include the following: mandating a wider set of measures that have been validated for specific populations and research purposes, funding research assessing the measurement properties of scales across settings and purposes, stressing the limitations of mandated measures to avoid en masse application and replacement of measures across studies and health systems and creating speed bumps to ensure that any widespread adoption of mandated measures does not result in impoverishment of mental health science.
Collapse
Affiliation(s)
- Praveetha Patalay
- Centre for Longitudinal Studies and MRC Unit for Lifelong Health and Ageing, University College London, London, UK
| | - Eiko I Fried
- Clinical Psychology Unit, Leiden University, Leiden, The Netherlands
| |
Collapse
|
18
|
Qin K, Lei D, Yang J, Li W, Tallman MJ, Duran LRP, Blom TJ, Bruns KM, Cotton S, Sweeney JA, Gong Q, DelBello MP. Network-level functional topological changes after mindfulness-based cognitive therapy in mood dysregulated adolescents at familial risk for bipolar disorder: a pilot study. BMC Psychiatry 2021; 21:213. [PMID: 33910549 PMCID: PMC8080341 DOI: 10.1186/s12888-021-03211-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 04/09/2021] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND Given that psychopharmacological approaches routinely used to treat mood-related problems may result in adverse outcomes in mood dysregulated adolescents at familial risk for bipolar disorder (BD), Mindfulness-Based Cognitive Therapy for Children (MBCT-C) provides an alternative effective and safe option. However, little is known about the brain mechanisms of beneficial outcomes from this intervention. Herein, we aimed to investigate the network-level neurofunctional effects of MBCT-C in mood dysregulated adolescents. METHODS Ten mood dysregulated adolescents at familial risk for BD underwent a 12-week MBCT-C intervention. Resting-state functional magnetic resonance imaging (fMRI) was performed prior to and following MBCT-C. Topological metrics of three intrinsic functional networks (default mode network (DMN), fronto-parietal network (FPN) and cingulo-opercular network (CON)) were investigated respectively using graph theory analysis. RESULTS Following MBCT-C, mood dysregulated adolescents showed increased global efficiency and decreased characteristic path length within both CON and FPN. Enhanced functional connectivity strength of frontal and limbic areas were identified within the DMN and CON. Moreover, change in characteristic path length within the CON was suggested to be significantly related to change in the Emotion Regulation Checklist score. CONCLUSIONS 12-week MBCT-C treatment in mood dysregulated adolescents at familial risk for BD yield network-level neurofunctional effects within the FPN and CON, suggesting enhanced functional integration of the dual-network. Decreased characteristic path length of the CON may be associated with the improvement of emotion regulation following mindfulness training. However, current findings derived from small sample size should be interpreted with caution. Future randomized controlled trials including larger samples are critical to validate our findings.
Collapse
Affiliation(s)
- Kun Qin
- grid.412901.f0000 0004 1770 1022Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Du Lei
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Jing Yang
- grid.412901.f0000 0004 1770 1022Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Wenbin Li
- grid.412901.f0000 0004 1770 1022Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, China ,grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Maxwell J. Tallman
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Luis Rodrigo Patino Duran
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Thomas J. Blom
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Kaitlyn M. Bruns
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Sian Cotton
- grid.24827.3b0000 0001 2179 9593Department of Family and Community Medicine, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - John A. Sweeney
- grid.412901.f0000 0004 1770 1022Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, China ,grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Qiyong Gong
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital of Sichuan University, Chengdu, China. .,Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China. .,Functional and Molecular Imaging Key Laboratory of Sichuan Province, Chengdu, China.
| | - Melissa P. DelBello
- grid.24827.3b0000 0001 2179 9593Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati College of Medicine, Cincinnati, OH USA
| |
Collapse
|
19
|
Affiliation(s)
- Eiko I. Fried
- Department of Clinical Psychology, Leiden University, Leiden, The Netherlands
| |
Collapse
|
20
|
Stallwood E, Monsour A, Rodrigues C, Monga S, Terwee C, Offringa M, Butcher NJ. Systematic Review: The Measurement Properties of the Children's Depression Rating Scale-Revised in Adolescents With Major Depressive Disorder. J Am Acad Child Adolesc Psychiatry 2021; 60:119-133. [PMID: 33130251 DOI: 10.1016/j.jaac.2020.10.009] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/23/2019] [Revised: 09/30/2020] [Accepted: 10/23/2020] [Indexed: 01/22/2023]
Abstract
OBJECTIVE To systematically appraise existing evidence of the measurement properties of the Children's Depression Rating Scale-Revised (CDRS-R) in adolescents with major depressive disorder (MDD). The CDRS-R is the most commonly used scale in adolescent depression research, yet was originally designed for use in children 6 to 12 years old. METHOD Seven databases were searched for studies that evaluated the measurement properties of the CDRS-R in adolescents (ages 12-18 years). Of 65 studies screened by full-text, 6 were included. Measurement properties were appraised using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. The COSMIN minimum requirements for recommending the use of an outcome measurement instrument are (1) evidence for sufficient content validity (any level of evidence), and (2) at least low-quality evidence for sufficient internal consistency. RESULTS Four studies assessed an English-language version of the CDRS-R; the other 2 assessed German and Korean versions, respectively. No study assessed content validity, cross-cultural validity/measurement invariance, or measurement error of the CDRS-R in adolescents with MDD. Low-quality evidence was found for sufficient construct validity (n = 4 studies) and responsiveness (n = 2 studies) assessed via comparator instruments. Very-low-quality evidence was found for sufficient interrater reliability (n = 2 studies). The results for structural validity (n = 3 studies) and internal consistency (n = 5 studies) were inconclusive. CONCLUSION It remains unclear whether the CDRS-R appropriately measures depressive symptom severity in adolescent MDD. Before use of the CDRS-R in adolescent MDD research can be recommended, evidence of sufficient psychometric properties in adolescents with MDD is needed.
Collapse
Affiliation(s)
- Emma Stallwood
- Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Andrea Monsour
- Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Craig Rodrigues
- Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Suneeta Monga
- Hospital for Sick Children, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Ontario, Canada
| | - Caroline Terwee
- Amsterdam UMC, Vrije Universiteit Amsterdam, and the Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Martin Offringa
- Hospital for Sick Children Research Institute, Toronto, Ontario, Canada; Hospital for Sick Children, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Ontario, Canada
| | - Nancy J Butcher
- Hospital for Sick Children Research Institute, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Ontario, Canada.
| |
Collapse
|
21
|
Core Outcome Set Development for Adolescent Major Depressive Disorder Clinical Trials: A Registered Report. J Am Acad Child Adolesc Psychiatry 2020; 59:1297-1298. [PMID: 33126995 DOI: 10.1016/j.jaac.2020.07.905] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/17/2020] [Revised: 07/03/2020] [Accepted: 07/17/2020] [Indexed: 12/16/2022]
|
22
|
Response to "Trials for depressive disorder in adolescents: the emperor's new clothes," a letter to the editor by Alain Braillon, MD, PhD. J Clin Epidemiol 2020; 128:159-161. [PMID: 32860976 PMCID: PMC7449977 DOI: 10.1016/j.jclinepi.2020.08.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 08/17/2020] [Indexed: 11/20/2022]
|
23
|
Braillon A. Trials for depressive disorder in adolescents: the emperor's new clothes. J Clin Epidemiol 2020; 128:159. [PMID: 32827629 DOI: 10.1016/j.jclinepi.2020.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Revised: 07/07/2020] [Accepted: 08/17/2020] [Indexed: 10/23/2022]
|
24
|
Monsour A, Mew EJ, Patel S, Chee-A-Tow A, Saeed L, Santos L, Courtney DB, Watson PN, Monga S, Szatmari P, Offringa M, Butcher NJ. Primary outcome reporting in adolescent depression clinical trials needs standardization. BMC Med Res Methodol 2020; 20:129. [PMID: 32450810 PMCID: PMC7247139 DOI: 10.1186/s12874-020-01019-6] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 05/18/2020] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes measured in adolescent major depressive disorder (MDD) RCTs has been described, the comprehensiveness of outcome reporting is unknown. This study aimed to assess the reporting of primary outcomes in RCTs evaluating treatments for adolescent MDD. METHODS RCTs evaluating treatment interventions in adolescents with a diagnosis of MDD published between 2008 and 2017 specifying a single primary outcome were eligible for outcome reporting assessment. Outcome reporting assessment was done independently in duplicate using a comprehensive checklist of 58 reporting items. Primary outcome information provided in each RCT publication was scored as "fully reported", "partially reported", or "not reported" for each checklist item, as applicable. RESULTS Eighteen of 42 identified articles were found to have a discernable single primary outcome and were included for outcome reporting assessment. Most trials (72%) did not fully report on over half of the 58 checklist items. Items describing masking of outcome assessors, timing and frequency of outcome assessment, and outcome analyses were fully reported in over 70% of trials. Items less frequently reported included outcome measurement instrument properties (ranging from 6 to 17%), justification of timing and frequency of outcome assessment (6%), and justification of criteria used for clinically significant differences (17%). The overall comprehensiveness of reporting appeared stable over time. CONCLUSIONS Heterogeneous reporting exists in published adolescent MDD RCTs, with frequent omissions of key details about their primary outcomes. These omissions may impair interpretability, replicability, and synthesis of RCTs that inform clinical guidelines and decision-making in this field. Consensus on the minimal criteria for outcome reporting in adolescent MDD RCTs is needed.
Collapse
Affiliation(s)
- Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Sagar Patel
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Lucia Santos
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Darren B Courtney
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Priya N Watson
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Canada
| | - Peter Szatmari
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada.
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
- Division of Neonatology, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada.
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| |
Collapse
|