Protocol for the development of SPIRIT and CONSORT extensions for randomised controlled trials with surrogate primary endpoints: SPIRIT-SURROGATE and CONSORT-SURROGATE

INTRODUCTION

Randomised controlled trials (RCTs) may use surrogate endpoints as substitutes and predictors of patient-relevant/participant-relevant final outcomes (eg, survival, health-related quality of life). Translation of effects measured on a surrogate endpoint into health benefits for patients/participants is dependent on the validity of the surrogate; hence, more accurate and transparent reporting on surrogate endpoints is needed to limit misleading interpretation of trial findings. However, there is currently no explicit guidance for the reporting of such trials. Therefore, we aim to develop extensions to the SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) and CONSORT (Consolidated Standards of Reporting Trials) reporting guidelines to improve the design and completeness of reporting of RCTs and their protocols using a surrogate endpoint as a primary outcome.

METHODS AND ANALYSIS

The project will have four phases: phase 1 (literature reviews) to identify candidate reporting items to be rated in a Delphi study; phase 2 (Delphi study) to rate the importance of items identified in phase 1 and receive suggestions for additional items; phase 3 (consensus meeting) to agree on final set of items for inclusion in the extensions and phase 4 (knowledge translation) to engage stakeholders and disseminate the project outputs through various strategies including peer-reviewed publications. Patient and public involvement will be embedded into all project phases.

ETHICS AND DISSEMINATION

The study has received ethical approval from the University of Glasgow College of Medical, Veterinary and Life Sciences Ethics Committee (project no: 200210051). The findings will be published in open-access peer-reviewed publications and presented in conferences, meetings and relevant forums.

Outcomes and outcome measurement instruments reported in randomised controlled trials of anxiety disorder treatments in children and adolescents: a scoping review protocol

INTRODUCTION

Paediatric anxiety disorders (AD) are prevalent and persistent mental health conditions worldwide affecting between 10% and 20% of children and adolescents. Despite the high prevalence of paediatric AD, there is limited understanding of which treatments work best. Outcome heterogeneity across paediatric mental health trials has been a significant factor in hindering the ability to compare results and assess the efficacy of such trials. This scoping review will help to identify and synthesise the outcomes reported in paediatric AD trials to date.

METHODS AND ANALYSIS

Following the Joanna Briggs Institute scoping review methodology, a comprehensive electronic bibliographic database search (MEDLINE, APA PsycINFO, Embase, CINAHL) strategy will be applied to identify articles examining interventions for children diagnosed with an AD. Articles will be eligible for inclusion if they assess at least one AD intervention (eg, psychological), in children 4-18 years of age inclusive. Initial title and abstract screening will be completed by two trained reviewers independently and in duplicate. Full-text screening of each included article will be completed independently and in duplicate by two of three trained reviewers. Identified outcomes will be mapped to a standard outcome taxonomy developed for core outcome sets. Trial and outcome characteristics will be synthesised using quantitative metrics (counts and frequencies).

ETHICS AND DISSEMINATION

As this is a scoping review of the literature and patient information or records were not accessed, institutional ethics approval was not required. Results of this scoping review will be disseminated to clinicians, researchers inclusive of trialists and other stakeholders invested in outcome selection, measurement and reporting in paediatric AD trials. In addition, scoping review results will inform the development of a Core Outcome Set for paediatric AD trials-a minimum set of outcomes that should be measured across trials in an area of health, without precluding the inclusion of other outcomes.

Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments

BACKGROUND

Systematic reviews of outcome measurement instruments are important tools in the evidence-based selection of these instruments. COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) has developed a comprehensive and widespread guideline to conduct systematic reviews of outcome measurement instruments, but key information is often missing in published reviews. This hinders the appraisal of the quality of outcome measurement instruments, impacts the decisions of knowledge users regarding their appropriateness, and compromises reproducibility and interpretability of the reviews' findings. To facilitate sufficient, transparent, and consistent reporting of systematic reviews of outcome measurement instruments, an extension of the PRISMA (Preferred Reporting of Items for Systematic reviews and Meta-Analyses) 2020 guideline will be developed: the PRISMA-COSMIN guideline.

METHODS

The PRISMA-COSMIN guideline will be developed in accordance with recommendations for reporting guideline development from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. First, a candidate reporting item list will be created through an environmental literature scan and expert consultations. Second, an international Delphi study will be conducted with systematic review authors, biostatisticians, epidemiologists, psychometricians/clinimetricians, reporting guideline developers, journal editors as well as patients, caregivers, and members of the public. Delphi panelists will rate candidate items for inclusion on a 5-point scale, suggest additional candidate items, and give feedback on item wording and comprehensibility. Third, the draft PRISMA-COSMIN guideline and user manual will be iteratively piloted by applying it to systematic reviews in several disease areas to assess its relevance, comprehensiveness, and comprehensibility, along with usability and user satisfaction. Fourth, a consensus meeting will be held to finalize the PRISMA-COSMIN guideline through roundtable discussions and voting. Last, a user manual will be developed and the final PRISMA-COSMIN guideline will be disseminated through publications, conferences, newsletters, and relevant websites. Additionally, relevant journals and organizations will be invited to endorse and implement PRISMA-COSMIN. Throughout the project, evaluations will take place to identify barriers and facilitators of involving patient/public partners and employing a virtual process.

DISCUSSION

The PRISMA-COSMIN guideline will ensure that the reports of systematic reviews of outcome measurement instruments are complete and informative, enhancing their reproducibility, ease of use, and uptake.

Assessing the impact of mental health difficulties on young people's daily lives: protocol for a scoping umbrella review of measurement instruments

INTRODUCTION

An important consideration for determining the severity of mental health symptoms is their impact on youth's daily lives. Those wishing to assess 'life impact' face several challenges: First, various measurement instruments are available, including of global functioning, health-related quality of life and well-being. Existing reviews have tended to focus on one of these domains; consequently, a comprehensive overview is lacking. Second, the extent to which such instruments truly capture distinct concepts is unclear. Third, many available scales conflate symptoms and their impact, thus undermining much needed analyses of associations between the two.

METHODS AND ANALYSIS

A scoping umbrella review will examine existing reviews of life impact measures for use with children and youth aged 6-24 years in the context of mental health and well-being research. We will systematically search six bibliographic databases (MEDLINE, Embase, APA PsycINFO, CINAHL, Web of Science, and the COSMIN database of systematic reviews of outcome measurement instruments), and conduct systematic record screening, data extraction and charting based on methodological guidance by the Joanna Briggs Institute. Data synthesis will involve the tabulation of scale characteristics, feasibility and measurement properties, and the use of summary statistics to synthesise how these instruments operationalise life impact. The protocol was registered prospectively with the Open Science Framework (osf.io/ers48).

ETHICS AND DISSEMINATION

This study will provide a comprehensive road map for researchers and clinicians seeking to assess life impact in youth mental health, providing guidance in navigating available measurement options. We will seek to publish the findings in a leading peer-reviewed journal in the field. Formal research ethics approval will not be required.

Effects of copy number variations on brain structure and risk for psychiatric illness: Large-scale studies from the ENIGMA working groups on CNVs

The Enhancing NeuroImaging Genetics through Meta-Analysis copy number variant (ENIGMA-CNV) and 22q11.2 Deletion Syndrome Working Groups (22q-ENIGMA WGs) were created to gain insight into the involvement of genetic factors in human brain development and related cognitive, psychiatric and behavioral manifestations. To that end, the ENIGMA-CNV WG has collated CNV and magnetic resonance imaging (MRI) data from ~49,000 individuals across 38 global research sites, yielding one of the largest studies to date on the effects of CNVs on brain structures in the general population. The 22q-ENIGMA WG includes 12 international research centers that assessed over 533 individuals with a confirmed 22q11.2 deletion syndrome, 40 with 22q11.2 duplications, and 333 typically developing controls, creating the largest-ever 22q11.2 CNV neuroimaging data set. In this review, we outline the ENIGMA infrastructure and procedures for multi-site analysis of CNVs and MRI data. So far, ENIGMA has identified effects of the 22q11.2, 16p11.2 distal, 15q11.2, and 1q21.1 distal CNVs on subcortical and cortical brain structures. Each CNV is associated with differences in cognitive, neurodevelopmental and neuropsychiatric traits, with characteristic patterns of brain structural abnormalities. Evidence of gene-dosage effects on distinct brain regions also emerged, providing further insight into genotype-phenotype relationships. Taken together, these results offer a more comprehensive picture of molecular mechanisms involved in typical and atypical brain development. This "genotype-first" approach also contributes to our understanding of the etiopathogenesis of brain disorders. Finally, we outline future directions to better understand effects of CNVs on brain structure and behavior.

Establishing a core outcome set for mucopolysaccharidoses (MPS) in children: study protocol for a rapid literature review, candidate outcomes survey, and Delphi surveys

Background

Mucopolysaccharidoses (MPS) are a group of inherited metabolic diseases characterized by chronic, progressive multi-system manifestations with varying degrees of severity. Disease-modifying therapies exist to treat some types of MPS; however, they are not curative, underscoring the need to identify and evaluate co-interventions that optimize functioning, participation in preferred activities, and quality of life. A Canadian pediatric MPS registry is under development and may serve as a platform to launch randomized controlled trials to evaluate such interventions. To promote the standardized collection of patient/family-reported and clinical outcomes considered important to patients/families, health care providers (HCPs), and policymakers, the choice of outcomes to include in the registry will be informed by a core outcome set (COS). We aim to establish a patient-oriented COS for pediatric MPS using a multi-stakeholder approach.

Methods

In step 1 of the six-step process to develop the COS, we will identify relevant outcomes through a rapid literature review and candidate outcomes survey. A two-phase screening approach will be implemented to identify eligible publications, followed by extraction of outcomes and other pre-specified data elements. Simultaneously, we will conduct a candidate outcomes survey with children with MPS and their families to identify outcomes most important to them. In step 2, HCPs experienced in treating patients with MPS will be invited to review the list of outcomes generated in step 1 and identify additional clinically relevant outcomes. We will then ask patients/families, HCPs, and policymakers to rate the outcomes in a set of Delphi Surveys (step 3), and to participate in a subsequent consensus meeting to finalize the COS (step 4). Step 5 involves establishing a set of outcome measurement instruments for the COS. Finally, we will disseminate the COS to knowledge users (step 6).

Discussion

The proposed COS will inform the choice of outcomes to include in the MPS registry and, more broadly, promote the standardized collection of patient-oriented outcomes for pediatric MPS research. By involving patients/families from the earliest stage of the research, we will ensure that the COS will be relevant to those who will ultimately benefit from the research.

Trial registration

PROSPERO CRD42021267531, COMET

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05791-8.

Forks in the road: Definitions of response, remission, recovery, and other dichotomized outcomes in randomized controlled trials for adolescent depression. A scoping review

BACKGROUND

Definitions of dichotomous outcome terms, such as "response," "remission," and "recovery" are central to the design, interpretation, and clinical application of randomized controlled trials of adolescent depression interventions. Accordingly, this scoping review was conducted to document how these terms have been defined and justified in clinical trials.

METHOD

Bibliographic databases MEDLINE, Embase, APA PsycInfo, and CINAHL were searched from inception to February 2020 for randomized controlled trials evaluating treatments for adolescent depression. Ninety-eight trials were included for data extraction and analysis.

RESULTS

Assessment of outcome measurement instruments, metric strategies, methods of aggregation, and measurement timing, yielded 53 unique outcome definitions of "response" across 45 trials that assessed response, 47 unique definitions of "remission" in 29 trials that assessed remission, and 19 unique definitions of "recovery" across 11 trials that assessed recovery. A minority of trials (N = 35) provided a rationale for dichotomous outcomes definitions, often by citing other studies that used a similar definition (N = 11). No rationale included input from youth or families with lived experience.

CONCLUSION

Our review revealed that definitions of "response," "remission," "recovery," and related terms are highly variable, lack clear rationales, and are not informed by key stakeholder input. These limitations impair pooling of trial results and the incorporation of trial findings into pragmatic treatment decisions in clinical practice. Systematic approaches to establishing outcome definitions are needed to enhance the impact of trials examining adolescent depression treatment.

Development of an international standard set of patient-centred outcome measures for overall paediatric health: a consensus process

OBJECTIVE

To develop an Overall Pediatric Health Standard Set (OPH-SS) of outcome measures that captures what matters to young people and their families and recognising the biopsychosocial aspects of health for all children and adolescents regardless of health condition.

DESIGN

A modified Delphi process.

SETTING

The International Consortium for Health Outcomes Measurement convened an international Working Group (WG) comprised of 23 international experts from 12 countries in the field of paediatrics, family medicine, psychometrics as well as patient advisors. The WG participated in 11 video-conferences, through a modified Delphi process and 9 surveys between March 2018 and January 2020 consensus was reached on a final recommended health outcome standard set. By a literature review conducted in March 2018, 1136 articles were screened for clinician and patient-reported or proxy-reported outcomes. Further, 4315 clinical trials and 12 paediatric health surveys were scanned. Between November 2019 and January 2020, the final standard set was endorsed by a patient validation (n=270) and a health professional (n=51) survey.

RESULTS

From a total of 63 identified outcomes, consensus was formed on a standard set of outcome measures that comprises 10 patient-reported outcomes, 5 clinician-reported measures, and 6 case-mix variables. The four developmental age-specific packages (ie, 0-5, 6-12, 13-17, 18-24 years) include either five or six measures with an average time for completion of 20 min.

CONCLUSIONS

The OPH-SS is a starting point to drive value-based paediatric healthcare delivery from a global perspective for enhancing child and adolescent physical health and psychosocial well-being.

Core Outcome Sets for Medium-Chain Acyl-CoA Dehydrogenase Deficiency and Phenylketonuria

BACKGROUND

Evidence to guide treatment of pediatric medium-chain acyl-coenzyme A dehydrogenase (MCAD) deficiency and phenylketonuria (PKU) is fragmented because of large variability in outcome selection and measurement. Our goal was to develop core outcome sets (COSs) for these diseases to facilitate meaningful future evidence generation and enhance the capacity to compare and synthesize findings across studies.

METHODS

Parents and/or caregivers, health professionals, and health policy advisors completed a Delphi survey and participated in a consensus workshop to select core outcomes from candidate lists of outcomes for MCAD deficiency and PKU. Delphi participants rated the importance of outcomes on a nine-point scale (1-3: not important, 4-6: important but not critical, 7-9: critical). Candidate outcomes were progressively narrowed down over 3 survey rounds. At the workshop, participants evaluated the remaining candidate outcomes using an adapted nominal technique, open discussion, and voting. After the workshop, we finalized the COSs and recommended measurement instruments for each outcome.

RESULTS

There were 85, 61, and 53 participants across 3 Delphi rounds, respectively. The candidate core outcome lists were narrowed down to 20 outcomes per disease to be discussed at the consensus workshop. Voting by 18 workshop participants led to COSs composed of 8 and 9 outcomes for MCAD deficiency and PKU, respectively, with measurement recommendations.

CONCLUSIONS

These are the first known pediatric COSs for MCAD deficiency and PKU. Adoption in future studies will help to ensure best use of limited research resources to ultimately improve care for children with these rare diseases.

Genetic contributors to risk of schizophrenia in the presence of a 22q11.2 deletion

Schizophrenia occurs in about one in four individuals with 22q11.2 deletion syndrome (22q11.2DS). The aim of this International Brain and Behavior 22q11.2DS Consortium (IBBC) study was to identify genetic factors that contribute to schizophrenia, in addition to the ~20-fold increased risk conveyed by the 22q11.2 deletion. Using whole-genome sequencing data from 519 unrelated individuals with 22q11.2DS, we conducted genome-wide comparisons of common and rare variants between those with schizophrenia and those with no psychotic disorder at age ≥25 years. Available microarray data enabled direct comparison of polygenic risk for schizophrenia between 22q11.2DS and independent population samples with no 22q11.2 deletion, with and without schizophrenia (total n = 35,182). Polygenic risk for schizophrenia within 22q11.2DS was significantly greater for those with schizophrenia (padj = 6.73 × 10-6). Novel reciprocal case-control comparisons between the 22q11.2DS and population-based cohorts showed that polygenic risk score was significantly greater in individuals with psychotic illness, regardless of the presence of the 22q11.2 deletion. Within the 22q11.2DS cohort, results of gene-set analyses showed some support for rare variants affecting synaptic genes. No common or rare variants within the 22q11.2 deletion region were significantly associated with schizophrenia. These findings suggest that in addition to the deletion conferring a greatly increased risk to schizophrenia, the risk is higher when the 22q11.2 deletion and common polygenic risk factors that contribute to schizophrenia in the general population are both present.

Systematic Review: The Measurement Properties of the Children's Depression Rating Scale-Revised in Adolescents With Major Depressive Disorder

OBJECTIVE

To systematically appraise existing evidence of the measurement properties of the Children's Depression Rating Scale-Revised (CDRS-R) in adolescents with major depressive disorder (MDD). The CDRS-R is the most commonly used scale in adolescent depression research, yet was originally designed for use in children 6 to 12 years old.

METHOD

Seven databases were searched for studies that evaluated the measurement properties of the CDRS-R in adolescents (ages 12-18 years). Of 65 studies screened by full-text, 6 were included. Measurement properties were appraised using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines. The COSMIN minimum requirements for recommending the use of an outcome measurement instrument are (1) evidence for sufficient content validity (any level of evidence), and (2) at least low-quality evidence for sufficient internal consistency.

RESULTS

Four studies assessed an English-language version of the CDRS-R; the other 2 assessed German and Korean versions, respectively. No study assessed content validity, cross-cultural validity/measurement invariance, or measurement error of the CDRS-R in adolescents with MDD. Low-quality evidence was found for sufficient construct validity (n = 4 studies) and responsiveness (n = 2 studies) assessed via comparator instruments. Very-low-quality evidence was found for sufficient interrater reliability (n = 2 studies). The results for structural validity (n = 3 studies) and internal consistency (n = 5 studies) were inconclusive.

CONCLUSION

It remains unclear whether the CDRS-R appropriately measures depressive symptom severity in adolescent MDD. Before use of the CDRS-R in adolescent MDD research can be recommended, evidence of sufficient psychometric properties in adolescents with MDD is needed.

International Core Outcome Set for Acute Simple Appendicitis in Children: Results of A Systematic Review, Delphi Study, and Focus Groups with Young People

OBJECTIVE:

To develop an international Core Outcome Set (COS), a minimal collection of outcomes that should be measured and reported in all future clinical trials evaluating treatments of acute simple appendicitis in children.

SUMMARY BACKGROUND DATA

A previous systematic review identified 115 outcomes in 60 trials and systematic reviews evaluating treatments for children with appendicitis, suggesting the need for a COS.

METHODS

The development process consisted of four phases: (1) an updated systematic review identifying all previously reported outcomes, (2) a two-stage international Delphi study in which parents with their children and surgeons rated these outcomes for inclusion in the COS, (3) focus groups with young people to identify missing outcomes, and (4) international expert meetings to ratify the final COS.

RESULTS

The systematic review identified 129 outcomes which were mapped to 43 unique outcome terms for the Delphi survey. The first-round included 137 parents (eight countries) and 245 surgeons (10 countries), the second-round response rates were 61% and 85% respectively, with ten outcomes emerging with consensus. After two young peoples' focus groups, two additional outcomes were added to the final COS (12): mortality, bowel obstruction, intra-abdominal abscess, recurrent appendicitis, complicated appendicitis, return to baseline health, readmission, reoperation, unplanned appendectomy, adverse events related to treatment, major and minor complications.

CONCLUSION

An evidence-informed COS based on international consensus, including patients and parents has been developed. This COS is recommended for all future studies evaluating treatment of simple appendicitis in children, to reduce heterogeneity between studies and facilitate data synthesis and evidence-based decision-making.

Neurodevelopmental outcome descriptions in cohorts of extremely preterm children

BACKGROUND AND OBJECTIVES

Caregivers and clinicians of extremely preterm infants (born before 26 weeks' gestation) depend on long-term follow-up research to inform clinical decision-making. The completeness of outcome reporting in this area is unknown. The objective of this study was to evaluate the reporting of outcome definitions, selection, measurement and analysis in existing cohort studies that report on neurodevelopmental outcomes of children born extremely preterm.

METHODS

We evaluated the completeness of reporting of 'cognitive function' and 'cerebral palsy' in prospective cohort studies summarised in a meta-analysis that assessed the effect of preterm birth on school-age neurodevelopment. Outcome reporting was evaluated using a checklist of 55 items addressing outcome selection, definition, measurement, analysis, presentation and interpretation. Reporting frequencies were calculated to identify strengths and deficiencies in outcome descriptions.

RESULTS

All 14 included studies reported 'cognitive function' as an outcome; nine reported both 'cognitive function' and 'cerebral palsy' as outcomes. Studies reported between 26% and 46% of the 55 outcome reporting items assessed; results were similar for 'cognitive function' and 'cerebral palsy' (on average 34% and 33% of items reported, respectively). Key methodological concepts often omitted included the reporting of masking of outcome assessors, methods used to handle missing data and stakeholder involvement in outcome selection.

CONCLUSIONS

The reporting of neurodevelopmental outcomes in cohort studies of infants born extremely preterm is variable and often incomplete. This may affect stakeholders' interpretation of study results, impair knowledge synthesis efforts and limit evidence-based decision-making for this population.

Large-scale mapping of cortical alterations in 22q11.2 deletion syndrome: Convergence with idiopathic psychosis and effects of deletion size

The 22q11.2 deletion (22q11DS) is a common chromosomal microdeletion and a potent risk factor for psychotic illness. Prior studies reported widespread cortical changes in 22q11DS, but were generally underpowered to characterize neuroanatomic abnormalities associated with psychosis in 22q11DS, and/or neuroanatomic effects of variability in deletion size. To address these issues, we developed the ENIGMA (Enhancing Neuro Imaging Genetics Through Meta-Analysis) 22q11.2 Working Group, representing the largest analysis of brain structural alterations in 22q11DS to date. The imaging data were collected from 10 centers worldwide, including 474 subjects with 22q11DS (age = 18.2 ± 8.6; 46.9% female) and 315 typically developing, matched controls (age = 18.0 ± 9.2; 45.9% female). Compared to controls, 22q11DS individuals showed thicker cortical gray matter overall (left/right hemispheres: Cohen's d = 0.61/0.65), but focal thickness reduction in temporal and cingulate cortex. Cortical surface area (SA), however, showed pervasive reductions in 22q11DS (left/right hemispheres: d = -1.01/-1.02). 22q11DS cases vs. controls were classified with 93.8% accuracy based on these neuroanatomic patterns. Comparison of 22q11DS-psychosis to idiopathic schizophrenia (ENIGMA-Schizophrenia Working Group) revealed significant convergence of affected brain regions, particularly in fronto-temporal cortex. Finally, cortical SA was significantly greater in 22q11DS cases with smaller 1.5 Mb deletions, relative to those with typical 3 Mb deletions. We found a robust neuroanatomic signature of 22q11DS, and the first evidence that deletion size impacts brain structure. Psychotic illness in this highly penetrant deletion was associated with similar neuroanatomic abnormalities to idiopathic schizophrenia. These consistent cross-site findings highlight the homogeneity of this single genetic etiology, and support the suitability of 22q11DS as a biological model of schizophrenia.

Outcome reporting recommendations for clinical trial protocols and reports: a scoping review

BACKGROUND

Clinicians, patients, and policy-makers rely on published evidence from clinical trials to help inform decision-making. A lack of complete and transparent reporting of the investigated trial outcomes limits reproducibility of results and knowledge synthesis efforts, and contributes to outcome switching and other reporting biases. Outcome-specific extensions for the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT-Outcomes) and Consolidated Standards of Reporting Trials (CONSORT-Outcomes) reporting guidelines are under development to facilitate harmonized reporting of outcomes in trial protocols and reports. The aim of this review was to identify and synthesize existing guidance for trial outcome reporting to inform extension development.

METHODS

We searched for documents published in the last 10 years that provided guidance on trial outcome reporting using: an electronic bibliographic database search (MEDLINE and the Cochrane Methodology Register); a grey literature search; and solicitation of colleagues using a snowballing approach. Two reviewers completed title and abstract screening, full-text screening, and data charting after training. Extracted trial outcome reporting guidance was compared with candidate reporting items to support, refute, or refine the items and to assess the need for the development of additional items.

RESULTS

In total, 1758 trial outcome reporting recommendations were identified within 244 eligible documents. The majority of documents were published by academic journals (72%). Comparison of each recommendation with the initial list of 70 candidate items led to the development of an additional 62 items, producing 132 candidate items. The items encompassed outcome selection, definition, measurement, analysis, interpretation, and reporting of modifications between trial documents. The total number of documents supporting each candidate item ranged widely (median 5, range 0-84 documents per item), illustrating heterogeneity in the recommendations currently available for outcome reporting across a large and diverse sample of sources.

CONCLUSIONS

Outcome reporting guidance for clinical trial protocols and reports lacks consistency and is spread across a large number of sources that may be challenging to access and implement in practice. Evidence and consensus-based guidance, currently in development (SPIRIT-Outcomes and CONSORT-Outcomes), may help authors adequately describe trial outcomes in protocols and reports transparently and completely to help reduce avoidable research waste.

Mapping Subcortical Brain Alterations in 22q11.2 Deletion Syndrome: Effects of Deletion Size and Convergence With Idiopathic Neuropsychiatric Illness

OBJECTIVE

22q11.2 deletion syndrome (22q11DS) is among the strongest known genetic risk factors for schizophrenia. Previous studies have reported variable alterations in subcortical brain structures in 22q11DS. To better characterize subcortical alterations in 22q11DS, including modulating effects of clinical and genetic heterogeneity, the authors studied a large multicenter neuroimaging cohort from the ENIGMA 22q11.2 Deletion Syndrome Working Group.

METHODS

Subcortical structures were measured using harmonized protocols for gross volume and subcortical shape morphometry in 533 individuals with 22q11DS and 330 matched healthy control subjects (age range, 6-56 years; 49% female).

RESULTS

Compared with the control group, the 22q11DS group showed lower intracranial volume (ICV) and thalamus, putamen, hippocampus, and amygdala volumes and greater lateral ventricle, caudate, and accumbens volumes (Cohen's d values, -0.90 to 0.93). Shape analysis revealed complex differences in the 22q11DS group across all structures. The larger A-D deletion was associated with more extensive shape alterations compared with the smaller A-B deletion. Participants with 22q11DS with psychosis showed lower ICV and hippocampus, amygdala, and thalamus volumes (Cohen's d values, -0.91 to 0.53) compared with participants with 22q11DS without psychosis. Shape analysis revealed lower thickness and surface area across subregions of these structures. Compared with subcortical findings from other neuropsychiatric disorders studied by the ENIGMA consortium, significant convergence was observed between participants with 22q11DS with psychosis and participants with schizophrenia, bipolar disorder, major depressive disorder, and obsessive-compulsive disorder.

CONCLUSIONS

In the largest neuroimaging study of 22q11DS to date, the authors found widespread alterations to subcortical brain structures, which were affected by deletion size and psychotic illness. Findings indicate significant overlap between 22q11DS-associated psychosis, idiopathic schizophrenia, and other severe neuropsychiatric illnesses.

Primary outcome reporting in adolescent depression clinical trials needs standardization

BACKGROUND

Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes measured in adolescent major depressive disorder (MDD) RCTs has been described, the comprehensiveness of outcome reporting is unknown. This study aimed to assess the reporting of primary outcomes in RCTs evaluating treatments for adolescent MDD.

METHODS

RCTs evaluating treatment interventions in adolescents with a diagnosis of MDD published between 2008 and 2017 specifying a single primary outcome were eligible for outcome reporting assessment. Outcome reporting assessment was done independently in duplicate using a comprehensive checklist of 58 reporting items. Primary outcome information provided in each RCT publication was scored as "fully reported", "partially reported", or "not reported" for each checklist item, as applicable.

RESULTS

Eighteen of 42 identified articles were found to have a discernable single primary outcome and were included for outcome reporting assessment. Most trials (72%) did not fully report on over half of the 58 checklist items. Items describing masking of outcome assessors, timing and frequency of outcome assessment, and outcome analyses were fully reported in over 70% of trials. Items less frequently reported included outcome measurement instrument properties (ranging from 6 to 17%), justification of timing and frequency of outcome assessment (6%), and justification of criteria used for clinically significant differences (17%). The overall comprehensiveness of reporting appeared stable over time.

CONCLUSIONS

Heterogeneous reporting exists in published adolescent MDD RCTs, with frequent omissions of key details about their primary outcomes. These omissions may impair interpretability, replicability, and synthesis of RCTs that inform clinical guidelines and decision-making in this field. Consensus on the minimal criteria for outcome reporting in adolescent MDD RCTs is needed.

From Research to Practice: The Importance of Appropriate Outcome Selection, Measurement, and Reporting in Pediatric Mental Health Research

Results of randomized controlled trials (RCTs) and, ideally, the synthesis of RCT results into meta-analyses, drive both clinical and policy decision making about health care interventions and inform new avenues for research. Selection of the right health outcomes to measure, analyze, and report on when designing a trial therefore is key in ensuring that the research will be useful and will have maximum impact.^1-3 As in many areas of medicine, wide variability exists in pediatric mental health research as to which outcomes are selected, how they are measured, and how they are reported. Variability in outcome selection and measurement may stem from various factors, including a tendency to select what is feasible or historical to measure rather than a focus on what is important to measure and how best to measure it. The resulting variability limits comparing and combining the results from different trials addressing a similar question in meta-analyses, hindering the translation of research to practice.^1,2 The objective of this article is to highlight the importance of outcome selection, measurement, and reporting in the translation of research to clinical practice.

Core outcome set for children with neurological impairment and tube feeding

AIM

To develop a core outcome set (COS) for evaluating gastrostomy/gastrojejunostomy tube impact in children with neurological impairment.

METHOD

Healthcare providers/researchers and caregivers rated the importance of candidate outcomes on a 5-point Likert scale. Outcomes rated 'somewhat important' or 'very important' by most (≥85%) respondents were voted on during a consensus meeting. Outcomes that reached consensus for inclusion were ratified and assigned to Outcome Measures in Rheumatology filter core areas. The COS was validated in a separate group of caregivers.

RESULTS

Twelve outcomes were selected from 120 candidate outcomes to form the COS. These included five 'Life Impact' outcomes, three 'Pathophysiological Manifestations' outcomes, two 'Resource Use' outcomes, one 'Growth and Development' outcome, and one 'Death' outcome.

INTERPRETATION

We developed an evidence-informed and consensus-based COS for use in studies of gastrostomy/gastrojejunostomy tube feeding in children with neurological impairment. Implementation of this COS will help reduce heterogeneity between studies and facilitate evidence-based decision-making.

WHAT THE PAPER ADDS

Caregivers, healthcare providers, and researchers ranked the importance of 120 outcomes. Twelve core outcomes were identified as essential to measure in future clinical research studies.

Outcomes in pediatric studies of medium-chain acyl-coA dehydrogenase (MCAD) deficiency and phenylketonuria (PKU): a review

BACKGROUND

Inherited metabolic diseases (IMDs) are a group of individually rare single-gene diseases. For many IMDs, there is a paucity of high-quality evidence that evaluates the effectiveness of clinical interventions. Clinical effectiveness trials of IMD interventions could be supported through the development of core outcome sets (COSs), a recommended minimum set of standardized, high-quality outcomes and associated outcome measurement instruments to be incorporated by all trials in an area of study. We began the process of establishing pediatric COSs for two IMDs, medium-chain acyl-CoA dehydrogenase (MCAD) deficiency and phenylketonuria (PKU), by reviewing published literature to describe outcomes reported by authors, identify heterogeneity in outcomes across studies, and assemble a candidate list of outcomes.

METHODS

We used a comprehensive search strategy to identify primary studies and guidelines relevant to children with MCAD deficiency and PKU, extracting study characteristics and outcome information from eligible studies including outcome measurement instruments for select outcomes. Informed by an established framework and a previously published pediatric COS, outcomes were grouped into five, mutually-exclusive, a priori core areas: growth and development, life impact, pathophysiological manifestations, resource use, and death.

RESULTS

For MCAD deficiency, we identified 83 outcomes from 52 articles. The most frequently represented core area was pathophysiological manifestations, with 33 outcomes reported in 29/52 articles (56%). Death was the most frequently reported outcome. One-third of outcomes were reported by a single study. The most diversely measured outcome was cognition and intelligence/IQ for which eight unique measurement instruments were reported among 14 articles. For PKU, we identified 97 outcomes from 343 articles. The most frequently represented core area was pathophysiological manifestations with 31 outcomes reported in 281/343 articles (82%). Phenylalanine concentration was the most frequently reported outcome. Sixteen percent of outcomes were reported by a single study. Similar to MCAD deficiency, the most diversely measured PKU outcome was cognition and intelligence/IQ with 39 different instruments reported among 82 articles.

CONCLUSIONS

Heterogeneity of reported outcomes and outcome measurement instruments across published studies for both MCAD deficiency and PKU highlights the need for COSs for these diseases, to promote the use of meaningful outcomes and facilitate comparisons across studies.

Neurobiological perspective of 22q11.2 deletion syndrome

22q11.2 deletion syndrome is characterised by a well defined microdeletion that is associated with a high risk of neuropsychiatric disorders, including intellectual disability, schizophrenia, attention-deficit hyperactivity disorder, autism spectrum disorder, anxiety disorders, seizures and epilepsy, and early-onset Parkinson's disease. Preclinical and clinical data reveal substantial variability of the neuropsychiatric phenotype despite the shared underlying deletion in this genetic model. Factors that might explain this variability include genetic background effects, additional rare pathogenic variants, and potential regulatory functions of some genes in the 22q11.2 deletion region. These factors might also be relevant to the pathophysiology of these neuropsychiatric disorders in the general population. We review studies that might provide insight into pathophysiological mechanisms underlying the expression of neuropsychiatric disorders in 22q11.2 deletion syndrome, and potential implications for these common disorders in the general (non-deleted) population. The recurrent hemizygous 22q11.2 deletion, associated with 22q11.2 deletion syndrome, has attracted attention as a genetic model for common neuropsychiatric disorders because of its association with substantially increased risk of such disorders.¹ Studying such a model has many advantages. First, 22q11.2 deletion has been genetically well characterised.² Second, most genes present in the region typically deleted at the 22q11.2 locus are expressed in the brain.^3-5 Third, genetic diagnosis might be made early in life, long before recognisable neuropsychiatric disorders have emerged. Thus, this genetic condition offers a unique opportunity for early intervention, and monitoring individuals with 22q11.2 deletion syndrome throughout life could provide important information on factors contributing to disease risk and protection. Despite the commonly deleted region being shared by about 90% of individuals with 22q11.2 deletion syndrome, neuropsychiatric outcomes are highly variable between individuals and across the lifespan. A clear link remains to be established between genotype and phenotype.^3,5 In this Review, we summarise preclinical and clinical studies investigating biological mechanisms in 22q11.2 deletion syndrome, with a focus on those that might provide insight into mechanisms underlying neuropsychiatric disorders in 22q11.2 deletion syndrome and in the general population.

Counting What Counts: The Case for Harmonized Outcomes in Child and Youth Mental Health Research

Evidence-based mental health care for children and youth critically depends on properly conducted randomized controlled trials (RCTs) and prospective studies that investigate change in mental health outcomes over time. As evidence accumulates, it can be synthesized through systematic reviews and meta-analyses that combine the results of many studies into a single estimate of effect. Clinical practice guidelines incorporate this information along with input from stakeholders and content experts, who fill in evidence gaps to formulate recommendations for best practice. Collectively, this evidence generation and synthesis process, once implemented, supports better long-term outcomes for the population by highlighting the "best available evidence" and reducing variability in clinical care. In addition, this process identifies knowledge gaps that might inform the field's research agenda. The objective of this commentary is to examine the potential of developing and implementing "Core Outcome Sets" (COS) as a means of reducing variability in the measurement and reporting of outcomes across RCTs and cohort studies, and thereby promoting the translation of evidence to practice.