Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline

In systematic reviews that lack data amenable to meta-analysis, alternative synthesis methods are commonly used, but these methods are rarely reported. This lack of transparency in the methods can cast doubt on the validity of the review findings. The Synthesis Without Meta-analysis (SWiM) guideline has been developed to guide clear reporting in reviews of interventions in which alternative synthesis methods to meta-analysis of effect estimates are used. This article describes the development of the SWiM guideline for the synthesis of quantitative data of intervention effects and presents the nine SWiM reporting items with accompanying explanations and examples.

School-based interventions to prevent anxiety and depression in children and young people: a systematic review and network meta-analysis

BACKGROUND

Rates of anxiety and depression are increasing among children and young people. Recent policies have focused on primary prevention of mental disorders in children and young people, with schools at the forefront of implementation. There is limited information for the comparative effectiveness of the multiple interventions available.

METHODS

We did a systematic review and network meta-analysis, searching MEDLINE, Embase, PsycINFO, and Cochrane Central Register of Controlled trials for published and unpublished, passive and active-controlled randomised and quasi-randomised trials. We included educational setting-based, universal, or targeted interventions in which the primary aim was the prevention of anxiety and depression in children and young people aged 4-18 years. Primary outcomes were post-intervention self-report anxiety and depression, wellbeing, suicidal ideation, or self-harm. We assessed risk of bias following the Cochrane Handbook for Systematic Reviews of Interventions. We estimated standardised mean differences (SMD) using random effects network meta-analysis in a Bayesian framework. The study is registered with PROPSERO, number CRD42016048184.

FINDINGS

1512 full-text articles were independently screened for inclusion by two reviewers, from which 137 studies of 56 620 participants were included. 20 studies were assessed as being at low risk of bias for both random sequence generation and allocation concealment. There was weak evidence to suggest that cognitive behavioural interventions might reduce anxiety in primary and secondary settings. In universal secondary settings, mindfulness and relaxation-based interventions showed a reduction in anxiety symptoms relative to usual curriculum (SMD -0·65, 95% credible interval -1·14 to -0·19). There was a lack of evidence to support any one type of intervention being effective to prevent depression in universal or targeted primary or secondary settings. Comparison-adjusted funnel plots suggest the presence of small-study effects for the universal secondary anxiety analysis. Network meta-analysis was not feasible for wellbeing or suicidal ideation or self-harm outcomes, and results are reported narratively.

INTERPRETATION

Considering unclear risk of bias and probable small study effects for anxiety, we conclude there is little evidence that educational setting-based interventions focused solely on the prevention of depression or anxiety are effective. Future research could consider multilevel, systems-based interventions as an alternative to the downstream interventions considered here.

FUNDING

UK National Institute for Health Research.

Exploring the importance of evidence in local health and wellbeing strategies

As evidence generators, we need to respond to the changes in the health delivery landscape if we are to continue to support public health decision-makers to make informed and judicious evidence-based choices. This study employs documentary analysis to (i) explore the extent of research evidence use in public health decision-making; (ii) to analyse occurrences of research evidence use in decision-making and (iii) to ascertain whether patterns of evidence use overlap with other area characteristics. Health and Wellbeing Strategies constitute the main source of documentary evidence. Initial results highlight that local areas are undertaking their own programmes of research that are used to inform specific questions, although the methodological robustness of these studies is unknown. There are also commonalities with previous findings, particularly with regard to the underutilization of qualitative research evidence and evidence on the effectiveness of interventions. Using Qualitative Comparative Analysis, this paper also highlights that underutilization of more academic research evidence appears disproportionally weighted towards areas with some of the most complex needs but that are not receiving the highest level of spending to meet these challenges. These areas in particular may be those where knowledge brokerage activities may have the greatest impacts.

Protocol for a systematic review of the use of qualitative comparative analysis for evaluative questions in public health research

BACKGROUND

There is an increasing recognition that health intervention research requires methods and approaches that can engage with the complexity of systems, interventions, and the relations between systems and interventions. One approach which shows promise to this end is qualitative comparative analysis (QCA), which examines casual complexity across a medium to large number of cases (between 10 and 60+), whilst also being able to generalise across those cases. Increasingly, QCA is being adopted in public health intervention research. However, there is a limited understanding of how it is being adopted. This systematic review will address this gap, examining how it is being used to understand complex causation; for what settings, populations and interventions; and with which datasets to describe cases.

METHODS

We will include published and peer-reviewed studies of any public health intervention where the effects on population health, health equity, or intervention uptake are being evaluated. Electronic searches of PubMed, Scopus, Web of Science (incorporating Social Sciences Citation Index and Arts & Humanities Citation Index), Microsoft Academic, and Google Scholar will be performed. This will be supplemented with reference citation tracking and personal contact with experts to identify any additional published studies. Search results will be single screened, with machine learning used to check these results, acting as a 'second screener'. Any disagreement will be resolved through discussion. Data will be extracted from full texts of eligible studies, which will be assessed against inclusion criteria, and synthesised narratively, using thematic synthesis methods.

DISCUSSION

This systematic review will provide an important map of the increasing use of QCA in public health intervention literature. This review will identify the current scope of research in this area, as well as assessing claims about the utility of the method for addressing complex causation in public health research. We will identify implications for better reporting of QCA methods in public health research and for reporting of case studies such that they can be used in future QCA studies.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO, CRD42019131910.

First measurement of neutrino oscillation parameters using neutrinos and antineutrinos by NOvA

The NOvA experiment has seen a 4.4σ signal of ν[over ¯]_{e} appearance in a 2 GeV ν[over ¯]_{μ} beam at a distance of 810 km. Using 12.33×10^{20} protons on target delivered to the Fermilab NuMI neutrino beamline, the experiment recorded 27 ν[over ¯]_{μ}→ν[over ¯]_{e} candidates with a background of 10.3 and 102 ν[over ¯]_{μ}→ν[over ¯]_{μ} candidates. This new antineutrino data are combined with neutrino data to measure the parameters |Δm_{32}^{2}|=2.48_{-0.06}^{+0.11}×10^{-3}  eV^{2}/c^{4} and sin^{2}θ_{23} in the ranges from (0.53-0.60) and (0.45-0.48) in the normal neutrino mass hierarchy. The data exclude most values near δ_{CP}=π/2 for the inverted mass hierarchy by more than 3σ and favor the normal neutrino mass hierarchy by 1.9σ and θ_{23} values in the upper octant by 1.6σ.

Molecular and Genetic Markers in Appendiceal Mucinous Tumors: A Systematic Review

INTRODUCTION

The role of somatic mutation profiling in the management of appendiceal mucinous tumors (AMTs) is evolving. Using a systematic review, we identified somatic alterations (SAs) that comprise histopathologic types of AMTs and those associated with aggressive clinical phenotypes.

METHODS

MEDLINE/PubMed was searched for studies on AMTs including molecular markers or genomic alterations, published between 1990 and 2018. Studies were grouped under low- and high-grade histological type for primary and metastatic tumors.

RESULTS

Twenty-one studies involving 1099 tumors (primary/metastatic) were identified. Seven studies involving 101 primary low-grade AMTs identified KRAS (76.5%) as the predominant SA. Four studies noted GNAS in 45.2% of 42 low-grade appendiceal mucinous neoplasms, and KRAS was identified in 74.4% of 14 studies with 238 low-grade pseudomyxoma peritonei (PMP). GNAS was noted in 56% of 101 tumors and TP53 was noted in only 9.7% of 31 tumors. Primary high-grade tumors demonstrated lower SAs in KRAS (50.4% of 369 tumors) and GNAS (27.8% of 97 tumors), and higher SAs in TP53 (26.0% of 123 tumors). In high-grade PMP, SAs were noted in KRAS (55.0% of 200 tumors), GNAS (35.0% of 60 tumors), and TP53 (26.3% of 19 tumors). No clear association was noted between SAs and survival.

CONCLUSIONS

KRAS and GNAS are frequently altered in low-grade AMTs, while TP53 is frequently altered in high-grade AMTs, with no apparent change in expression between primary and metastatic tumors. Although SAs may provide valuable insights into variability in tumor biology, larger studies utilizing clinically annotated genomic databases from multi-institutional consortiums are needed to improve their identification and clinical applicability.

Conducting sexualities research: an outline of emergent issues and case studies from ten Wellcome-funded projects

This letter seeks to synthesise methodological challenges encountered in a cohort of Wellcome Trust-funded research projects focusing on sexualities and health. The ten Wellcome Trust projects span a diversity of gender and sexual orientations and identities, settings; institutional and non-institutional contexts, lifecourse stages, and explore a range of health-related interventions.  As researchers, we originate from a breadth of disciplinary traditions, use a variety of research methods and data sources. Despite this breadth, four common themes are found across the projects: (i) inclusivity, representations and representativeness, (ii) lumping together of diverse groups, (iii) institutions and closed settings (iv) ethical and governance barriers.

Interventions integrating health and academic education in schools to prevent substance misuse and violence: a systematic review

Background

Schools struggle to timetable health education. Interventions integrating academic and health education to reduce substance use and violence offer promise. No current systematic reviews examine such interventions.

Objectives

To review evidence to explore the following questions: (1) what types of interventions integrating health and academic education in schools serving those aged 4–18 years have been evaluated? (2) What theories of change inform these interventions? (3) What factors facilitate or limit the successful implementation and receipt of such interventions, and what are the implications for the delivery of such implementations in the UK? (4) How effective are such interventions in reducing smoking and violence and the use of alcohol and drugs, and at increasing attainment? Does this vary by students’ sociodemographic characteristics? (5) What factors appear to influence the effectiveness of such interventions?

Data sources

In total, 19 databases were searched from 18 November to 22 December 2015, updating searches for outcome evaluations for violence on 28 February 2018 and for substance use on 14 May 2018. References were extracted from included studies and authors contacted.

Review methods

Included studies reported on theories of change, and process or outcome evaluations of interventions that integrated academic and health education to reduce substance use and/or violence. References were screened on the title/abstract and then on the full report. Data extraction and appraisal used Cochrane, Evidence for Policy and Practice Information Centre and other established tools. Theories of change and process data were qualitatively synthesised. Outcome evaluations were synthesised narratively and meta-analytically.

Results

In total, 78,451 unique references were originally identified and 62 reports included. Search updates on 28 February and 14 May 2018 retrieved a further 2355 and 1945 references, respectively, resulting in the inclusion of six additional reports. Thirty-nine reports described theories, 16 reports (15 studies) evaluated process and 41 reports (16 studies) evaluated outcomes. Multicomponent interventions are theorised to erode ‘boundaries’ (strengthen relationships) between academic and health education, teachers and students, behaviour in classrooms and in the wider school, and schools and families. Teachers, pro-social peers and parents are theorised to act as role models and reinforcers of healthy behaviours learnt in lessons. There was clear evidence that interventions are facilitated by supportive senior management and alignment with the schools’ ethos, collaborative and supportive teaching environments, and positive pre-existing student, teacher and parent attitudes towards interventions. The barriers were overburdened teachers who had little time to both learn and implement integrated curricula. The strongest evidence for effectiveness was found for the reduction of substance use in school key stages (KSs) 2 and 3. For example, a meta-analysis for substance use at KS3 reported a mean difference of –0.09 (95% confidence interval –0.17 to –0.01). A meta-analysis for effectiveness in reducing violence victimisation in KS2 found no effect. There was mixed evidence for effects on academic outcomes, with meta-analysis precluded by methodological heterogeneity.

Limitations

Study quality was variable. Integration was sometimes not emphasised in theories of change.

Conclusions

These interventions are undertheorised but involve multiple forms of boundary erosion. There is clear evidence of characteristics affecting implementation. Interventions are likely to have the greatest impact on substance use. These programmes may be effective in reducing substance use but do not appear to reduce violence and findings on educational impacts are mixed.

Future work

Future evaluations should assess interventions with clearer theories of change and examine academic outcomes alongside violence and substance use outcomes.

Study registration

This study is registered as PROSPERO CRD42015026464.

Funding

The National Institute for Health Research Public Health Research programme.

Characterization of skin blebs from intradermal jet injection: Ex-vivo studies

This paper presents results from an ex-vivo study of intradermal jet injections, which is an attractive method to achieve both needle-free and fractional dose delivery of vaccines. Due to the fact that fluid properties of many novel therapeutics and vaccines can vary significantly, a key parameter for our study is the fluid viscosity, whilst the main focus is on determining the best correlation between the delivered volume and geometrical dimensions of the fluid deposit. For this we use a combination of top-view (skin wheal), underside (below the dermis), and cross-section (true skin bleb) perspectives and find that the top-view alone, as done in clinical practice, is insufficient to estimate the volume deposited in the dermis. Overall, the best correlation is found between the injection volume and cross-sectional diameter, however there is significant variation amongst the different fluids. For mean injection volumes of 60 μL the mean bleb diameter is ≈8 mm, with mean aspect ratio h¯/d=0.38, indicating the blebs are mostly oblate. However, the shape varies with viscosity and the higher viscosity does not spread laterally to the same degree as lower viscosity fluids. In addition, our high-speed video observations of the injection process, reveal some interesting dynamics of the jet injection method, and we modeled the bleb growth with an exponential saturation.

Are community health workers effective in retaining women in the maternity care continuum? Evidence from India

Objectives

Despite the recognised importance of adopting a continuum of care perspective in addressing the care of mothers and newborns, evidence on specific interventions to enhance engagement of women along the maternity care continuum has been limited. We use the example of the Accredited Social Health Activist (ASHA) programme in India, to understand the role of community health workers in retaining women in the maternity care continuum.

Methods

Using the Indian Human Development Survey data from 2011 to 2012, we assess the association between individual and cluster-level exposure to ASHA and four key components along the continuum of care—at least one antenatal care (ANC) visit, four or more ANC visits, presence of a skilled birth attendance (SBA) at the time of birth and postnatal care for the mother or child within 48 hours of birth, for 13 705 women with a live birth since 2005. To understand which of these services experience maximum dropout along the continuum, we use a linear probability model to calculate the weighted percentages of using each service. We assess the association between exposure to ASHA and number of services utilised using a multinomial logistic regression model adjusted for a range of confounding variables and survey weights.

Results

Our study indicates that exposure to the ASHA is associated with an increased probability of women receiving at least one ANC and SBA. In terms of numbers of services, exposure to ASHA accounts for a 12% (95% CI: 9.1 to 15.1) increase in women receiving at least some of the services, and an 8.8% (95% CI: −10.2 to −7.4) decrease in women receiving no services. However, exposure to ASHA does not increase the likelihood of women utilising all the services along the continuum.

Conclusions

While ASHA is effective in supporting women to initiate and continue care along the continuum, it does not significantly affect the completion of all services along the continuum.

Clarifying differences between reviews within evidence ecosystems

This paper builds on a 2012 paper by the same authors which argued that the types and brands of systematic review do not sufficiently differentiate between the many dimensions of different review questions and review methods (Gough et al., Syst Rev 1:28, 2012). The current paper extends this argument by considering the dynamic contexts, or 'evidence ecosystems', within which reviews are undertaken; the fact that these ecosystems are constantly changing; and the relevance of this broader context for understanding 'dimensions of difference' in the unfolding development and refinement of review methods.The concept of an evidence ecosystem is used to consider particular issues within the three key dimensions of difference outlined in the 2012 paper of (1) review aims and approach, (2) structure and components of reviews, and (3) breadth, depth, and 'work done' by reviews.

Semiautomated text analytics for qualitative data synthesis

Approaches to synthesizing qualitative data have, to date, largely focused on integrating the findings from published reports. However, developments in text mining software offer the potential for efficient analysis of large pooled primary qualitative datasets. This case study aimed to (a) provide a step‐by‐step guide to using one software application, Leximancer, and (b) interrogate opportunities and limitations of the software for qualitative data synthesis. We applied Leximancer v4.5 to a pool of five qualitative, UK‐based studies on transportation such as walking, cycling, and driving, and displayed the findings of the automated content analysis as intertopic distance maps. Leximancer enabled us to “zoom out” to familiarize ourselves with, and gain a broad perspective of, the pooled data. It indicated which studies clustered around dominant topics such as “people.” The software also enabled us to “zoom in” to narrow the perspective to specific subgroups and lines of enquiry. For example, “people” featured in men's and women's narratives but were talked about differently, with men mentioning “kids” and “old,” whereas women mentioned “things” and “stuff.” The approach provided us with a fresh lens for the initial inductive step in the analysis process and could guide further exploration. The limitations of using Leximancer were the substantial data preparation time involved and the contextual knowledge required from the researcher to turn lines of inquiry into meaningful insights. In summary, Leximancer is a useful tool for contributing to qualitative data synthesis, facilitating comprehensive and transparent data coding but can only inform, not replace, researcher‐led interpretive work.

Obstacles and opportunities to using research evidence in local public health decision-making in England

BACKGROUND

Local public health service delivery and policy-setting in England was overhauled in 2013, with local government now responsible for the complex tasks involved in protecting and improving population health and addressing health inequalities. Since 2013, public health funding per person has declined, adding to the challenge of public health decision-making. In a climate of austerity, research evidence could help to guide the more effective use of resources, although there are concerns that the reorganisation of public health decision-making structures has disrupted traditional evidence use patterns. This study aimed to explore local public health evidence use and needs in this new decision-making climate.

METHODS

Semi-structured interviews with Public Health Practitioners across three Local Authorities were conducted, with sites purposefully selected to represent urban, suburban and county Local Authorities, and to reflect a range of public health issues that might be encountered. A topic guide was developed that allowed participants to reflect on their experience and involvement in providing evidence for, or making a decision around, commissioning a public health service. Data were transcribed and template analysis was employed to understand the findings, which involved developing a coding template based on an initial transcript and applying this to subsequent transcripts.

RESULTS

Increased political involvement in local public health decision-making, while welcomed by some participants as a form of democratising public health, has influenced evidence preferences in a number of ways. Political and individual ideologies of locally elected officials meant that certain forms of evidence could be overlooked in favour of evidence that corresponded to decision-makers' preferences. Political involvement at the local level has increased the appetite for local knowledge and evidence. Research evidence needs to demonstrate its local salience if it is to contribute to decision-making alongside competing sources, particularly anecdotal information.

CONCLUSION

To better meet decision-making needs of politicians and practitioners, a shift in the scope of public health evidence is required. At a systematic review level, this could involve moving away from producing evidence that reflects broad global generalisations about narrow and simple questions, and instead towards producing forms of evidence that have local applicability and can support complex policy-focussed decisions.

Using the theoretical domains framework and the behavioural change wheel in an overarching synthesis of systematic reviews

OBJECTIVE

Synthesis that can filter the evidence from multiple sources to inform the choice of intervention components is highly desirable yet, at present, there are few examples of systematic reviews that explicitly define this type of synthesis using behaviour change frameworks. Here, we demonstrate how using the Theoretical Domains Framework (TDF) and the Behaviour Change Wheel (BCW) made it possible to bring together the findings from a series of three interconnected systematic reviews on the self-care of minor ailments (MAs) to inform the choice of intervention components.

METHOD

The TDF and the capability, opportunity, motivation model of behaviour at the hub of the BCW were used to synthesise the findings from the three reviews, including syntheses of service-user views in interviews (review 1, 20 studies) and surveys (review 2, 13 studies), and evaluations of a range of interventions and services (review 3, 21 studies).

RESULTS

The TDF and BCW approach provided a systematic, structured and replicable methodology for retrospectively integrating different types of evidence within a series of systematic reviews. Several intervention strategies, grounded in theory and discussed with key stakeholders, were suggested, which can be implemented and tested.

CONCLUSIONS

This novel application of the TDF/BCW approach illustrates how it can be used to bring together quantitative and qualitative evidence to better understand self-care behaviour for MAs within a systematic review context. The TDF/BCW approach facilitated exploration of the contradictions and gaps between the separate review syntheses, and supported the identification of possible intervention strategies, grounded in theory. The ongoing development and refinement of this method is supported.

PROSPERO REGISTRATION NUMBER

CRD42017071515.

A question of trust: can we build an evidence base to gain trust in systematic review automation technologies?

BACKGROUND

Although many aspects of systematic reviews use computational tools, systematic reviewers have been reluctant to adopt machine learning tools.

DISCUSSION

We discuss that the potential reason for the slow adoption of machine learning tools into systematic reviews is multifactorial. We focus on the current absence of trust in automation and set-up challenges as major barriers to adoption. It is important that reviews produced using automation tools are considered non-inferior or superior to current practice. However, this standard will likely not be sufficient to lead to widespread adoption. As with many technologies, it is important that reviewers see "others" in the review community using automation tools. Adoption will also be slow if the automation tools are not compatible with workflows and tasks currently used to produce reviews. Many automation tools being developed for systematic reviews mimic classification problems. Therefore, the evidence that these automation tools are non-inferior or superior can be presented using methods similar to diagnostic test evaluations, i.e., precision and recall compared to a human reviewer. However, the assessment of automation tools does present unique challenges for investigators and systematic reviewers, including the need to clarify which metrics are of interest to the systematic review community and the unique documentation challenges for reproducible software experiments.

CONCLUSION

We discuss adoption barriers with the goal of providing tool developers with guidance as to how to design and report such evaluations and for end users to assess their validity. Further, we discuss approaches to formatting and announcing publicly available datasets suitable for assessment of automation technologies and tools. Making these resources available will increase trust that tools are non-inferior or superior to current practice. Finally, we identify that, even with evidence that automation tools are non-inferior or superior to current practice, substantial set-up challenges remain for main stream integration of automation into the systematic review process.

Development of methods for the preparation of radiopure 82Se sources for the SuperNEMO neutrinoless double-beta decay experiment

A radiochemical method for producing 82Se sources with an ultra-low level of contamination of natural radionuclides (40K, decay products of 232Th and 238U) has been developed based on cation-exchange chromatographic purification with reverse removal of impurities. It includes chromatographic separation (purification), reduction, conditioning (which includes decantation, centrifugation, washing, grinding, and drying), and 82Se foil production. The conditioning stage, during which highly dispersed elemental selenium is obtained by the reduction of purified selenious acid (H2SeO3) with sulfur dioxide (SO2) represents the crucial step in the preparation of radiopure 82Se samples. The natural selenium (600 g) was first produced in this procedure in order to refine the method. The technique developed was then used to produce 2.5 kg of radiopure enriched selenium (82Se). The produced 82Se samples were wrapped in polyethylene (12 μm thick) and radionuclides present in the sample were analyzed with the BiPo-3 detector. The radiopurity of the plastic materials (chromatographic column material and polypropylene chemical vessels), which were used at all stages, was determined by instrumental neutron activation analysis. The radiopurity of the 82Se foils was checked by measurements with the BiPo-3 spectrometer, which confirmed the high purity of the final product. The measured contamination level for 208Tl was 8–54 μBq/kg, and for 214Bi the detection limit of 600 μBq/kg has been reached.

Relationship of Functional Reach Test scores and falls in Special Olympics athletes

BACKGROUND

The Functional Reach Test is used to assess balance of Special Olympic athletes as part of the FUNfitness screens held at Special Olympics games. However, it is unknown if the Functional Reach Test is an accurate assessment of balance in this population. The objective of this study was to explore the relationship between Functional Reach Test scores and falls in Special Olympic athletes.

METHODS

Data were collected as a part of the FUNfitness screens during Arizona Special Olympics games. The Functional Reach Test scores of 272 Special Olympic athletes were recorded. Athletes were asked to report the number of falls they experienced in the last 12 months.

RESULTS

A two-tailed Kendall tau test revealed little to no relationship between number of falls and Functional Reach Test scores of either the left upper extremity (n = 263, τ = -0.063, P = 0.202) or the right upper extremity (n = 263, τ = -0.107, P = 0.030). Sensitivity of the Functional Reach Test to identify fallers was 28.8%, and specificity was 83.5%.

CONCLUSIONS

Scores of the Functional Reach Test did not correlate with actual falls. The relatively high specificity indicates the assessment is good at identifying non-fallers, while the low sensitivity results in a high number of fallers not being recognised as such. Therefore, the cut-off scores used for the Functional Reach Test in FUNfitness screenings may need to be altered to more accurately identify balance deficits in this population. FUNfitness screens need to be quick, efficient and accurate. As such, selection of the most appropriate assessment tools is essential. Consideration should be given on how to make the Functional Reach Test the most beneficial as a FUNfitness screen.

Individual exposure level following indoor and outdoor air pollution exposure in Dakar (Senegal)

The consequences of indoor and outdoor air pollution on human health are of great concern nowadays. In this study, we firstly evaluated indoor and outdoor air pollution levels (CO, CO₂, NO, NO₂, PM₁₀) at an urban site in Dakar city center and at a rural site. Then, the individual exposure levels to selected pollutants and the variations in the levels of biomarkers of exposure were investigated in different groups of persons (bus drivers, traders working along the main roads and housemaids). Benzene exposure levels were higher for housemaids than for bus drivers and traders. High indoor exposure to benzene is probably due to cooking habits (cooking with charcoal), local practices (burning of incense), the use of cleaning products or solvent products which are important emitters of this compound. These results are confirmed by the values of S-PMA, which were higher in housemaids group compared to the others. Urinary 1-HOP levels were significantly higher for urban site housemaids compared to semirural district ones. Moreover, urinary levels of DNA oxidative stress damage (8-OHdG) and inflammatory (interleukin-6 and -8) biomarkers were higher in urban subjects in comparison to rural ones. The air quality measurement campaign showed that the bus interior was more polluted with PM₁₀, CO, CO₂ and NO than the market and urban or rural households. However, the interior of households showed higher concentration of VOCs than outdoor sites confirming previous observations of higher indoor individual exposure level to specific classes of pollutants.

Animal models of chemotherapy-induced peripheral neuropathy: A machine-assisted systematic review and meta-analysis

We report a systematic review and meta-analysis of research using animal models of chemotherapy-induced peripheral neuropathy (CIPN). We systematically searched 5 online databases in September 2012 and updated the search in November 2015 using machine learning and text mining to reduce the screening for inclusion workload and improve accuracy. For each comparison, we calculated a standardised mean difference (SMD) effect size, and then combined effects in a random-effects meta-analysis. We assessed the impact of study design factors and reporting of measures to reduce risks of bias. We present power analyses for the most frequently reported behavioural tests; 337 publications were included. Most studies (84%) used male animals only. The most frequently reported outcome measure was evoked limb withdrawal in response to mechanical monofilaments. There was modest reporting of measures to reduce risks of bias. The number of animals required to obtain 80% power with a significance level of 0.05 varied substantially across behavioural tests. In this comprehensive summary of the use of animal models of CIPN, we have identified areas in which the value of preclinical CIPN studies might be increased. Using both sexes of animals in the modelling of CIPN, ensuring that outcome measures align with those most relevant in the clinic, and the animal's pain contextualised ethology will likely improve external validity. Measures to reduce risk of bias should be employed to increase the internal validity of studies. Different outcome measures have different statistical power, and this can refine our approaches in the modelling of CIPN.

Rapid reviews may produce different results to systematic reviews: a meta-epidemiological study

OBJECTIVE

To simulate possible changes in systematic review results if rapid review methods were used.

STUDY DESIGN AND SETTING

We recalculated meta-analyses for binary primary outcomes in Cochrane systematic reviews, simulating rapid review methods. We simulated searching only PubMed, excluding older articles (5, 7, 10, 15, and 20 years before the search date), excluding smaller trials (<50, <100, and <200 participants), and using the largest trial only. We examined percentage changes in pooled odds ratios (ORs) (classed as no important change [<5%], small [<20%], moderate [<30%], or large [≥30%]), statistical significance, and biases observed using rapid methods.

RESULTS

Two thousand five hundred and twelve systematic reviews (16,088 studies) were included. Rapid methods resulted in the loss of all data in 3.7-44.7% of meta-analyses. Searching only PubMed had the smallest risk of changed ORs (19% [477/2,512] were small changes or greater; 10% [260/2,512] were moderate or greater). Changes in ORs varied substantially with each rapid review method; 8.4-21.3% were small, 1.9-8.8% were moderate, and 4.7-34.1% were large. Changes in statistical significance occurred in 6.5-38.6% of meta-analyses. Changes from significant to nonsignificant were most common (2.1-13.7% meta-analyses). We found no evidence of bias with any rapid review method.

CONCLUSION

Searching PubMed only might be considered where a ∼10% risk of the primary outcome OR changing by >20% could be tolerated. This could be the case in scoping reviews, resource limitation, or where syntheses are needed urgently. Other situations, such as clinical guidelines and regulatory decisions, favor more comprehensive systematic review methods.

Improving reporting of meta-ethnography: The eMERGe reporting guidance

AIMS

The aim of this study was to provide guidance to improve the completeness and clarity of meta-ethnography reporting.

BACKGROUND

Evidence-based policy and practice require robust evidence syntheses which can further understanding of people's experiences and associated social processes. Meta-ethnography is a rigorous seven-phase qualitative evidence synthesis methodology, developed by Noblit and Hare. Meta-ethnography is used widely in health research, but reporting is often poor quality and this discourages trust in and use of its findings. Meta-ethnography reporting guidance is needed to improve reporting quality.

DESIGN

The eMERGe study used a rigorous mixed-methods design and evidence-based methods to develop the novel reporting guidance and explanatory notes.

METHODS

The study, conducted from 2015 - 2017, comprised of: (1) a methodological systematic review of guidance for meta-ethnography conduct and reporting; (2) a review and audit of published meta-ethnographies to identify good practice principles; (3) international, multidisciplinary consensus-building processes to agree guidance content; (4) innovative development of the guidance and explanatory notes.

FINDINGS

Recommendations and good practice for all seven phases of meta-ethnography conduct and reporting were newly identified leading to 19 reporting criteria and accompanying detailed guidance.

CONCLUSION

The bespoke eMERGe Reporting Guidance, which incorporates new methodological developments and advances the methodology, can help researchers to report the important aspects of meta-ethnography. Use of the guidance should raise reporting quality. Better reporting could make assessments of confidence in the findings more robust and increase use of meta-ethnography outputs to improve practice, policy, and service user outcomes in health and other fields. This is the first tailored reporting guideline for meta-ethnography. This article is being simultaneously published in the following journals: Journal of Advanced Nursing, Psycho-oncology, Review of Education, and BMC Medical Research Methodology.

Mass media to communicate public health messages in six health topic areas: a systematic review and other reviews of the evidence

Background

Mass media campaigns can be used to communicate public health messages at the population level. Although previous research has shown that they can influence health behaviours in some contexts, there have been few attempts to synthesise evidence across multiple health behaviours.

Objectives

To (1) review evidence on the effective use of mass media in six health topic areas (alcohol, diet, illicit drugs, physical activity, sexual and reproductive health and tobacco), (2) examine whether or not effectiveness varies with different target populations, (3) identify characteristics of mass media campaigns associated with effectiveness and (4) identify key research gaps.

Design

The study comprised (1) a systematic review of reviews, (2) a review of primary studies examining alcohol mass media campaigns, (3) a review of cost-effectiveness evidence and (4) a review of recent primary studies of mass media campaigns conducted in the UK. A logic model was developed to inform the reviews. Public engagement activities were conducted with policy, practitioner and academic stakeholders and with young people.

Results

The amount and strength of evidence varies across the six topics, and there was little evidence regarding diet campaigns. There was moderate evidence that mass media campaigns can reduce sedentary behaviour and influence sexual health-related behaviours and treatment-seeking behaviours (e.g. use of smoking quitlines and sexual health services). The impact on tobacco use and physical activity was mixed, there was limited evidence of impact on alcohol use and there was no impact on illicit drug behaviours. Mass media campaigns were found to increase knowledge and awareness across several topics, and to influence intentions regarding physical activity and smoking. Tobacco and illicit drug campaigns appeared to be more effective for young people and children but there was no or inconsistent evidence regarding effectiveness by sex, ethnicity or socioeconomic status. There was moderate evidence that tobacco mass media campaigns are cost-effective, but there was weak or limited evidence in other topic areas. Although there was limited evidence on characteristics associated with effectiveness, longer or greater intensity campaigns were found to be more effective, and messages were important, with positive and negative messages and social norms messages affecting smoking behaviour. The evidence suggested that targeting messages to target audiences can be effective. There was little evidence regarding the role that theory or media channels may play in campaign effectiveness, and also limited evidence on new media.

Limitations

Statistical synthesis was not possible owing to considerable heterogeneity across reviews and studies. The focus on review-level evidence limited our ability to examine intervention characteristics in detail.

Conclusions

Overall, the evidence is mixed but suggests that (1) campaigns can reduce sedentary behaviour, improve sexual health and contribute to smoking cessation, (2) tobacco control campaigns can be cost-effective, (3) longer and more intensive campaigns are likely to be more effective and (4) message design and targeting campaigns to particular population groups can be effective.

Future work

Future work could fill evidence gaps regarding diet mass media campaigns and new-media campaigns, examine cost-effectiveness in areas other than tobacco and explore the specific contribution of mass media campaigns to multicomponent interventions and how local, regional and national campaigns can work together.

Study registration

This study is registered as PROSPERO CRD42015029205 and PROSPERO CRD42017054999.

Funding

The National Institute for Health Research Public Health Research programme.

Search for Sterile Neutrinos in MINOS and MINOS+ Using a Two-Detector Fit

A search for mixing between active neutrinos and light sterile neutrinos has been performed by looking for muon neutrino disappearance in two detectors at baselines of 1.04 and 735 km, using a combined MINOS and MINOS+ exposure of 16.36×10^{20} protons on target. A simultaneous fit to the charged-current muon neutrino and neutral-current neutrino energy spectra in the two detectors yields no evidence for sterile neutrino mixing using a 3+1 model. The most stringent limit to date is set on the mixing parameter sin^{2}θ_{24} for most values of the sterile neutrino mass splitting Δm_{41}^{2}>10^{-4}  eV^{2}.

The development and evaluation of an online application to assist in the extraction of data from graphs for use in systematic reviews

Background: The extraction of data from the reports of primary studies, on which the results of systematic reviews depend, needs to be carried out accurately. To aid reliability, it is recommended that two researchers carry out data extraction independently. The extraction of statistical data from graphs in PDF files is particularly challenging, as the process is usually completely manual, and reviewers need sometimes to revert to holding a ruler against the page to read off values: an inherently time-consuming and error-prone process. Methods: To mitigate some of the above problems we integrated and customised two existing JavaScript libraries to create a new web-based graphical data extraction tool to assist reviewers in extracting data from graphs. This tool aims to facilitate more accurate and timely data extraction through a user interface which can be used to extract data through mouse clicks. We carried out a non-inferiority evaluation to examine its performance in comparison to standard practice. Results: We found that the customised graphical data extraction tool is not inferior to users' prior preferred current approaches. Our study was not designed to show superiority, but suggests that there may be a saving in time of around 6 minutes per graph, accompanied by a substantial increase in accuracy. Conclusions: Our study suggests that the incorporation of this type of tool in online systematic review software would be beneficial in facilitating the production of accurate and timely evidence synthesis to improve decision-making.

The development and evaluation of an online application to assist in the extraction of data from graphs for use in systematic reviews

Background: The extraction of data from the reports of primary studies, on which the results of systematic reviews depend, needs to be carried out accurately. To aid reliability, it is recommended that two researchers carry out data extraction independently. The extraction of statistical data from graphs in PDF files is particularly challenging, as the process is usually completely manual, and reviewers need sometimes to revert to holding a ruler against the page to read off values: an inherently time-consuming and error-prone process. Methods: To mitigate some of the above problems we integrated and customised two existing JavaScript libraries to create a new web-based graphical data extraction tool to assist reviewers in extracting data from graphs. This tool aims to facilitate more accurate and timely data extraction through a user interface which can be used to extract data through mouse clicks. We carried out a non-inferiority evaluation to examine its performance in comparison with participants' standard practice for extracting data from graphs in PDF documents. Results: We found that the customised graphical data extraction tool is not inferior to users' (N=10) prior standard practice. Our study was not designed to show superiority, but suggests that, on average, participants saved around 6 minutes per graph using the new tool, accompanied by a substantial increase in accuracy. Conclusions: Our study suggests that the incorporation of this type of tool in online systematic review software would be beneficial in facilitating the production of accurate and timely evidence synthesis to improve decision-making.

The development and evaluation of an online application to assist in the extraction of data from graphs for use in systematic reviews

Background: The extraction of data from the reports of primary studies, on which the results of systematic reviews depend, needs to be carried out accurately. To aid reliability, it is recommended that two researchers carry out data extraction independently. The extraction of statistical data from graphs in PDF files is particularly challenging, as the process is usually completely manual, and reviewers need sometimes to revert to holding a ruler against the page to read off values: an inherently time-consuming and error-prone process. Methods: To mitigate some of the above problems we developed a new web-based graphical data extraction tool to assist reviewers in extracting data from graphs. This tool aims to facilitate more accurate and timely data extraction through a user interface which can be used to extract data through mouse clicks. We carried out a non-inferiority evaluation to examine its performance in comparison to standard practice. Results: We found that our new graphical data extraction tool is not inferior to users' prior preferred current approaches. Our study was not designed to show superiority, but suggests that there may be a saving in time of around 6 minutes per graph, accompanied by a substantial increase in accuracy. Conclusions: Our study suggests that the incorporation of this type of tool in online systematic review software would be beneficial in facilitating the production of accurate and timely evidence synthesis to improve decision-making.

P55 The neurosurgical physician: a new role in the UK

Objectives

With reduction in numbers of junior doctors and strict deanery requirements for training opportunities, the provision of ward cover and continuity has consistently fallen. Various methods of addressing this have been implemented in the UK, including increased nurse practitioners and physician associates. We introduced a new position of GP with a specialist neuroscience interest in line with the North American model of hospitalist and review the impact on patients and trainees.

Design

Qualitative descriptive study.

Subjects

14 core and speciality trainees.

Methods

Retrospective review of the impact of a permanent neurosurgical physician on ward care and provision of training with a qualitative study of trainee experience. Saturation was reached at 14 interviews.

Results

A neurosurgical physician role was instituted in 2013, enabling a formal training rota to fulfil deanery requirements for core training and provide continuity of care at senior medical level, reducing medical ward consults to zero, improved communication with relatives and reduced the need for ST ward rounds. Qualitative assessment revealed a senior medical presence aided trainees own knowledge, resulted in better rapport and communication with patients and improved patient care through knowledge of best medical practice guidelines.

Conclusions

The addition of the neurosurgical physician role has positively impacted on the quality of patient care and junior doctor training. Senior medical care is provided with continuity, in contrast to other models.

Still moving toward automation of the systematic review process: a summary of discussions at the third meeting of the International Collaboration for Automation of Systematic Reviews (ICASR)

The third meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 17-18 October 2017 in London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient systematic reviews of scientific evidence. The group seeks to facilitate the development and widespread acceptance of automated techniques for systematic reviews. The meeting's conclusion was that the most pressing needs at present are to develop approaches for validating currently available tools and to provide increased access to curated corpora that can be used for validation. To that end, ICASR's short-term goals in 2018-2019 are to propose and publish protocols for key tasks in systematic reviews and to develop an approach for sharing curated corpora for validating the automation of the key tasks.

Developing and testing intervention theory by incorporating a views synthesis into a qualitative comparative analysis of intervention effectiveness

Qualitative comparative analysis (QCA) was originally developed as a tool for cross-national comparisons in macrosociology, but its use in evaluation and evidence synthesis of complex interventions is rapidly developing. QCA is theory-driven and relies on Boolean logic to identify pathways to an outcome (eg, is the intervention effective or not?). We use the example of two linked systematic reviews on weight management programs (WMPs) for adults-one focusing on user views (a "views synthesis") and one focusing on the effectiveness of WMPs incorporating dietary and physical activity-to demonstrate how a synthesis of user views can supply a working theory to structure a QCA. We discuss how a views synthesis is especially apt to supply this working theory because user views can (a) represent a "middle-range theory" of the intervention; (b) bring a participatory, democratic perspective; and (c) provide an idiographic understanding of how the intervention works that external taxonomies may not be able to furnish. We then discuss the practical role that the views synthesis played in our QCA examining pathways to effectiveness: (a) by suggesting specific intervention features and sharpening the focus on the most salient features to be examined, (b) by supporting interpretation of findings, and (c) by bounding data analysis to prevent data dredging.

Abstract OT1-05-02: OPTIMA: A prospective randomized trial to validate the clinical utility and cost-effectiveness of gene expression test-directed chemotherapy decisions in high clinical risk early breast cancer

Background:Multi-parameter tumour gene expression assays (MPAs) are widely used to estimate individual patient residual risk and to guide chemotherapy use in hormone-sensitive, HER2-negative early breast cancer. The TAILORx trial supports MPA use in a node-negative population. Evidence for MPA use in node-positive breast cancer is limited. OPTIMA (Optimal Personalised Treatment of early breast cancer usIng Multi-parameter Analysis) (ISRCTN42400492) aims to validate MPAs as predictors of chemotherapy sensitivity in a largely node-positive breast cancer population where prospective RCT (Randomised Controlled Trial) evidence is lacking.

Methods: OPTIMA is a partially blinded multi-center RCT with an adaptive two-stage design. The main eligibility criteria are women and men age 40 or older with resected ER-positive, HER2-negative invasive breast cancer and up to 9 involved axillary lymph nodes. Randomisation is to standard management (chemotherapy and endocrine therapy) or to MPA-directed treatment using the Prosigna (PAM50) test. Those with a Prosigna tumour score (ROR_PT) &gt;60 receive standard management whilst those with a low score (≤60) are treated with endocrine therapy alone. Endocrine therapy for pre-menopausal women includes ovarian suppression. The co-primary outcomes are (1) Invasive Disease Free Survival (IDFS) and (2) cost-effectiveness of test-directed treatment. Secondary outcomes include IDFS in patients with low-score tumours and quality of life. An integrated qualitative recruitment study addresses challenges to consent and recruitment and will build on experience from the feasibility study that a multidisciplinary approach at sites is important for recruitment success. Tumour blocks will be banked to allow evaluation of additional MPA technologies. Recruitment of 4500 patients over 5 years will permit demonstration of 3% non-inferiority of test-directed treatment, assuming 5-year IDFS of 85% with standard management, equivalent to a HR of 1.22. Inclusion of patients from the feasibility study will increase the power to test for non-inferiority.

Results: The OPTIMA main trial opened in January 2017. Overall recruitment (including the feasibility study) will reach 1000 in August 2018. Recruitment in Norway will commence in July 2018. Characteristics of the OPTIMA main participants recruited to 31st May 2018 are shown in the table.

Main study patient characteristicsCharacteristic %Median age in years (range)57 (40-80) Menopause statusPre34 Post66 Male1Tumour size&lt;30mm58 &gt;=30mm42Node statuspN04 pN1mi(sn)7 pN1(sn)20 pN155 pN214Historic grade16 258 336

Conclusion: OPTIMA is one of two large scale prospective trials validating the use of test-guided chemotherapy decisions in node-positive early breast cancer. It is expected to have a global impact on breast cancer treatment. Experience from the preliminary study and close engagement with centres will aid trial success.

Funding: OPTIMA is funded by the UK NIHR HTA Programme (10/34/501). Views expressed are those of the authors and not those of the HTA Programme, NIHR, NHS or the DoH.

Citation Format: Stein RC, Hughes-Davies L, Makris A, Macpherson IR, Conefrey C, Rooshenas L, Pinder SE, Thomas J, Hall PS, Cameron DA, Earl HM, Naume B, Poole CJ, Rea DW, MacIntosh SA, Harmer V, Morgan A, Hulme C, McCabe C, Stallard N, Higgins H, Donovan JL, Bartlett JM, Marshall A, Dunn JA. OPTIMA: A prospective randomized trial to validate the clinical utility and cost-effectiveness of gene expression test-directed chemotherapy decisions in high clinical risk early breast cancer [abstract]. In: Proceedings of the 2018 San Antonio Breast Cancer Symposium; 2018 Dec 4-8; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2019;79(4 Suppl):Abstract nr OT1-05-02.

Marie M, Stickney K, VanBuecken D, Vellek B, Webber C, Allen L, Bollyk J, Hilderman N, Ismail H, Lamola S, Sanda S, Vendettuoli H, Tridgell D, Monzavi R, Bock M, Fisher L, Halvorson M, Jeandron D, Kim M, Wood J, Geffner M, Kaufman F, Parkman R, Salazar C, Goland R, Clynes R, Cook S, Freeby M, Pat Gallagher M, Gandica R, Greenberg E, Kurland A, Pollak S, Wolk A, Chan M, Koplimae L, Levine E, Smith K, Trast J, DiMeglio L, Blum J, Evans-Molina C, Hufferd R, Jagielo B, Kruse C, Patrick V, Rigby M, Spall M, Swinney K, Terrell J, Christner L, Ford L, Lynch S, Menendez M, Merrill P, Pescovitz M, Rodriguez H, Alleyn C, Baidal D, Fay S, Gaglia J, Resnick B, Szubowicz S, Weir G, Benjamin R, Conboy D, deManbey A, Jackson R, Jalahej H, Orban T, Ricker A, Wolfsdorf J, Zhang HH, Wilson D, Aye T, Baker B, Barahona K, Buckingham B, Esrey K, Esrey T, Fathman G, Snyder R, Aneja B, Chatav M, Espinoza O, Frank E, Liu J, Perry J, Pyle R, Rigby A, Riley K, Soto A, Gitelman S, Adi S, Anderson M, Berhel A, Breen K, Fraser K, Gerard-Gonzalez A, Jossan P, Lustig R, Moassesfar S, Mugg A, Ng D, Prahalod P, Rangel-Lugo M, Sanda S, Tarkoff J, Torok C, Wesch R, Aslan I, Buchanan J, Cordier J, Hamilton C, Hawkins L, Ho T, Jain A, Ko K, Lee T, Phelps S, Rosenthal S, Sahakitrungruang T, Stehl L, Taylor L, Wertz M, Wong J, Philipson L, Briars R, Devine N, Littlejohn E, Grant T, Gottlieb P, Klingensmith G, Steck A, Alkanani A, Bautista K, Bedoy R, Blau A, Burke B, Cory L, Dang M, Fitzgerald-Miller L, Fouts A, Gage V, Garg S, Gesauldo P, Gutin R, Hayes C, Hoffman M, Ketchum K, Logsden-Sackett N, Maahs D, Messer L, Meyers L, Michels A, Peacock S, Rewers M, Rodriguez P, Sepulbeda F, Sippl R, Steck A, Taki I, Tran BK, Tran T, Wadwa RP, Zeitler P, Barker J, Barry S, Birks L, Bomsburger L, Bookert T, Briggs L, Burdick P, Cabrera R, Chase P, Cobry E, Conley A, Cook G, Daniels J, DiDomenico D, Eckert J, Ehler A, Eisenbarth G, Fain P, Fiallo-Scharer R, Frank N, Goettle H, Haarhues M, Harris S, Horton L, Hutton J, Jeffrrey J, Jenison R, Jones K, Kastelic W, King MA, Lehr D, Lungaro J, Mason K, Maurer H, Nguyen L, Proto A, Realsen J, Schmitt K, Schwartz M, Skovgaard S, Smith J, Vanderwel B, Voelmle M, Wagner R, Wallace A, Walravens P, Weiner L, Westerhoff B, Westfall E, Widmer K, Wright H, Schatz D, Abraham A, Atkinson M, Cintron M, Clare-Salzler M, Ferguson J, Haller M, Hosford J, Mancini D, Rohrs H, Silverstein J, Thomas J, Winter W, Cole G, Cook R, Coy R, Hicks E, Lewis N, Marks J, Pugliese A, Blaschke C, Matheson D, Pugliese A, Sanders-Branca N, Ray Arce LA, Cisneros M, Sabbag S, Moran A, Gibson C, Fife B, Hering B, Kwong C, Leschyshyn J, Nathan B, Pappenfus B, Street A, Boes MA, Peterson Eck S, Finney L, Albright Fischer T, Martin A, Jacqueline Muzamhindo C, Rhodes M, Smith J, Wagner J, Wood B, Becker D, Delallo K, Diaz A, Elnyczky B, Libman I, Pasek B, Riley K, Trucco M, Copemen B, Gwynn D, Toledo F, Rodriguez H, Bollepalli S, Diamond F, Eyth E, Henson D, Lenz A, Shulman D, Raskin P, Adhikari S, Dickson B, Dunnigan E, Lingvay I, Pruneda L, Ramos-Roman M, Raskin P, Rhee C, Richard J, Siegelman M, Sturges D, Sumpter K, White P, Alford M, Arthur J, Aviles-Santa ML, Cordova E, Davis R, Fernandez S, Fordan S, Hardin T, Jacobs A, Kaloyanova P, Lukacova-Zib I, Mirfakhraee S, Mohan A, Noto H, Smith O, Torres N, Wherrett D, Balmer D, Eisel L, Kovalakovska R, Mehan M, Sultan F, Ahenkorah B, Cevallos J, Razack N, Jo Ricci M, Rhode A, Srikandarajah M, Steger R, Russell WE, Black M, Brendle F, Brown A, Moore D, Pittel E, Robertson A, Shannon A, Thomas JW, Herold K, Feldman L, Sherwin R, Tamborlane W, Weinzimer S, Toppari J, Kallio T, Kärkkäinen M, Mäntymäki E, Niininen T, Nurmi B, Rajala P, Romo M, Suomenrinne S, Näntö-Salonen K, Simell O, Simell T, Bosi E, Battaglia M, Bianconi E, Bonfanti R, Grogan P, Laurenzi A, Martinenghi S, Meschi F, Pastore M, Falqui L, Teresa Muscato M, Viscardi M, Bingley P, Castleden H, Farthing N, Loud S, Matthews C, McGhee J, Morgan A, Pollitt J, Elliot-Jones R, Wheaton C, Knip M, Siljander H, Suomalainen H, Colman P, Healy F, Mesfin S, Redl L, Wentworth J, Willis J, Farley M, Harrison L, Perry C, Williams F, Mayo A, Paxton J, Thompson V, Volin L, Fenton C, Carr L, Lemon E, Swank M, Luidens M, Salgam M, Sharma V, Schade D, King C, Carano R, Heiden J, Means N, Holman L, Thomas I, Madrigal D, Muth T, Martin C, Plunkett C, Ramm C, Auchus R, Lane W, Avots E, Buford M, Hale C, Hoyle J, Lane B, Muir A, Shuler S, Raviele N, Ivie E, Jenkins M, Lindsley K, Hansen I, Fadoju D, Felner E, Bode B, Hosey R, Sax J, Jefferies C, Mannering S, Prentis R, She J, Stachura M, Hopkins D, Williams J, Steed L, Asatapova E, Nunez S, Knight S, Dixon P, Ching J, Donner T, Longnecker S, Abel K, Arcara K, Blackman S, Clark L, Cooke D, Plotnick L, Levin P, Bromberger L, Klein K, Sadurska K, Allen C, Michaud D, Snodgrass H, Burghen G, Chatha S, Clark C, Silverberg J, Wittmer C, Gardner J, LeBoeuf C, Bell P, McGlore O, Tennet H, Alba N, Carroll M, Baert L, Beaton H, Cordell E, Haynes A, Reed C, Lichter K, McCarthy P, McCarthy S, Monchamp T, Roach J, Manies S, Gunville F, Marosok L, Nelson T, Ackerman K, Rudolph J, Stewart M, McCormick K, May S, Falls T, Barrett T, Dale K, Makusha L, McTernana C, Penny-Thomas K, Sullivan K, Narendran P, Robbie J, Smith D, Christensen R, Koehler B, Royal C, Arthur T, Houser H, Renaldi J, Watsen S, Wu P, Lyons L, House B, Yu J, Holt H, Nation M, Vickers C, Watling R, Heptulla R, Trast J, Agarwal C, Newell D, Katikaneni R, Gardner C, Del A, Rio A, Logan H, Collier C, Rishton G, Whalley A, Ali S, Ramtoola T, Quattrin L, Mastrandea A, House M, Ecker C, Huang C, Gougeon J, Ho D, Pacuad D, Dunger J, May C, O’Brien C, Acerini B, Salgin A, Thankamony R, Williams J, Buse G, Fuller M, Duclos J, Tricome H, Brown D, Pittard D, Bowlby A, Blue T, Headley S, Bendre K, Lewis K, Sutphin C, Soloranzo J, Puskaric H, Madison M, Rincon M, Carlucci R, Shridharani B, Rusk E, Tessman D, Huffman H, Abrams B, Biederman M, Jones V, Leathers W, Brickman P, Petrie D, Zimmerman J, Howard L, Miller R, Alemzadeh D, Mihailescu R, Melgozza-Walker N, Abdulla C, Boucher-Berry D, Ize-Ludlow R, Levy C, Swenson, Brousell N, Crimmins D, Edler T, Weis C, Schultz D, Rogers D, Latham C, Mawhorter C, Switzer W, Spencer P, Konstantnopoulus S, Broder J, Klein L, Knight L, Szadek G, Welnick B, Thompson R, Hoffman A, Revell J, Cherko K, Carter E, Gilson J, Haines G, Arthur B, Bowen W, Zipf P, Graves R, Lozano D, Seiple K, Spicer A, Chang J, Fregosi J, Harbinson C, Paulson S, Stalters P, Wright D, Zlock A, Freeth J, Victory H, Maheshwari A, Maheshwari T, Holmstrom J, Bueno R, Arguello J, Ahern L, Noreika V, Watson S, Hourse P, Breyer C, Kissel Y, Nicholson M, Pfeifer S, Almazan J, Bajaj M, Quinn K, Funk J, McCance E, Moreno R, Veintimilla A, Wells J, Cook S, Trunnel J, Henske S, Desai K, Frizelis F, Khan R, Sjoberg K, Allen P, Manning G, Hendry B, Taylor S, Jones W, Strader M, Bencomo T, Bailey L, Bedolla C, Roldan C, Moudiotis B, Vaidya C, Anning S, Bunce S, Estcourt E, Folland E, Gordon C, Harrill J, Ireland J, Piper L, Scaife K, Sutton S, Wilkins M, Costelloe J, Palmer L, Casas C, Miller M, Burgard C, Erickson J, Hallanger-Johnson P, Clark W, Taylor A, Lafferty S, Gillett C, Nolan M, Pathak L, Sondrol T, Hjelle S, Hafner J, Kotrba R, Hendrickson A, Cemeroglu T, Symington M, Daniel Y, Appiagyei-Dankah D, Postellon M, Racine L, Kleis K, Barnes S, Godwin H, McCullough K, Shaheen G, Buck L, Noel M, Warren S, Weber S, Parker I, Gillespie B, Nelson C, Frost J, Amrhein E, Moreland A, Hayes J, Peggram J, Aisenberg M, Riordan J, Zasa E, Cummings K, Scott T, Pinto A, Mokashi K, McAssey E, Helden P, Hammond L, Dinning S, Rahman S, Ray C, Dimicri S, Guppy H, Nielsen C, Vogel C, Ariza L, Morales Y, Chang R, Gabbay L, Ambrocio L, Manley R, Nemery W, Charlton P, Smith L, Kerr B, Steindel-Kopp M, Alamaguer D, Liljenquist G, Browning T, Coughenour M, Sulk E, Tsalikan M, Tansey J, Cabbage N. Identical and Nonidentical Twins: Risk and Factors Involved in Development of Islet Autoimmunity and Type 1 Diabetes

OBJECTIVE

There are variable reports of risk of concordance for progression to islet autoantibodies and type 1 diabetes in identical twins after one twin is diagnosed. We examined development of positive autoantibodies and type 1 diabetes and the effects of genetic factors and common environment on autoantibody positivity in identical twins, nonidentical twins, and full siblings.

RESEARCH DESIGN AND METHODS

Subjects from the TrialNet Pathway to Prevention Study (N = 48,026) were screened from 2004 to 2015 for islet autoantibodies (GAD antibody [GADA], insulinoma-associated antigen 2 [IA-2A], and autoantibodies against insulin [IAA]). Of these subjects, 17,226 (157 identical twins, 283 nonidentical twins, and 16,786 full siblings) were followed for autoantibody positivity or type 1 diabetes for a median of 2.1 years.

RESULTS

At screening, identical twins were more likely to have positive GADA, IA-2A, and IAA than nonidentical twins or full siblings (all P < 0.0001). Younger age, male sex, and genetic factors were significant factors for expression of IA-2A, IAA, one or more positive autoantibodies, and two or more positive autoantibodies (all P ≤ 0.03). Initially autoantibody-positive identical twins had a 69% risk of diabetes by 3 years compared with 1.5% for initially autoantibody-negative identical twins. In nonidentical twins, type 1 diabetes risk by 3 years was 72% for initially multiple autoantibody-positive, 13% for single autoantibody-positive, and 0% for initially autoantibody-negative nonidentical twins. Full siblings had a 3-year type 1 diabetes risk of 47% for multiple autoantibody-positive, 12% for single autoantibody-positive, and 0.5% for initially autoantibody-negative subjects.

CONCLUSIONS

Risk of type 1 diabetes at 3 years is high for initially multiple and single autoantibody-positive identical twins and multiple autoantibody-positive nonidentical twins. Genetic predisposition, age, and male sex are significant risk factors for development of positive autoantibodies in twins.

Improving reporting of meta-ethnography: the eMERGe reporting guidance

AIMS

The aim of this study was to provide guidance to improve the completeness and clarity of meta-ethnography reporting.

BACKGROUND

Evidence-based policy and practice require robust evidence syntheses which can further understanding of people's experiences and associated social processes. Meta-ethnography is a rigorous seven-phase qualitative evidence synthesis methodology, developed by Noblit and Hare. Meta-ethnography is used widely in health research, but reporting is often poor quality and this discourages trust in and use of its findings. Meta-ethnography reporting guidance is needed to improve reporting quality.

DESIGN

The eMERGe study used a rigorous mixed-methods design and evidence-based methods to develop the novel reporting guidance and explanatory notes.

METHODS

The study, conducted from 2015 to 2017, comprised of: (1) a methodological systematic review of guidance for meta-ethnography conduct and reporting; (2) a review and audit of published meta-ethnographies to identify good practice principles; (3) international, multidisciplinary consensus-building processes to agree guidance content; (4) innovative development of the guidance and explanatory notes.

FINDINGS

Recommendations and good practice for all seven phases of meta-ethnography conduct and reporting were newly identified leading to 19 reporting criteria and accompanying detailed guidance.

CONCLUSION

The bespoke eMERGe Reporting Guidance, which incorporates new methodological developments and advances the methodology, can help researchers to report the important aspects of meta-ethnography. Use of the guidance should raise reporting quality. Better reporting could make assessments of confidence in the findings more robust and increase use of meta-ethnography outputs to improve practice, policy, and service user outcomes in health and other fields. This is the first tailored reporting guideline for meta-ethnography. This article is being simultaneously published in the following journals: Journal of Advanced Nursing, Psycho-oncology, Review of Education, and BMC Medical Research Methodology.

School-based self-management interventions for asthma in children and adolescents: a mixed methods systematic review

BACKGROUND

Asthma is a common respiratory condition in children that is characterised by symptoms including wheeze, shortness of breath, chest tightness, and cough. Children with asthma may be able to manage their condition more effectively by improving inhaler technique, and by recognising and responding to symptoms. Schools offer a potentially supportive environment for delivering interventions aimed at improving self-management skills among children. The educational ethos aligns with skill and knowledge acquisition and makes it easier to reach children with asthma who do not regularly engage with primary care. Given the multi-faceted nature of self-management interventions, there is a need to understand the combination of intervention features that are associated with successful delivery of asthma self-management programmes.

OBJECTIVES

This review has two primary objectives.• To identify the intervention features that are aligned with successful intervention implementation.• To assess effectiveness of school-based interventions provided to improve asthma self-management among children.We addressed the first objective by performing qualitative comparative analysis (QCA), a synthesis method described in depth later, of process evaluation studies to identify the combination of intervention components and processes that are aligned with successful intervention implementation.We pursued the second objective by undertaking meta-analyses of outcomes reported by outcome evaluation studies. We explored the link between how well an intervention is implemented and its effectiveness by using separate models, as well as by undertaking additional subgroup analyses.

SEARCH METHODS

We searched the Cochrane Airways Trials Register for randomised studies. To identify eligible process evaluation studies, we searched MEDLINE, Embase, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, the Cochrane Database of Systematic Reviews (CDSR), Web of Knowledge, the Database of Promoting Health Effectiveness Reviews (DoPHER), the Database of Abstracts of Reviews of Effects (DARE), the International Biography of Social Science (IBSS), Bibliomap, Health Technology Assessment (HTA), Applied Social Sciences Index and Abstracts (ASSIA), and Sociological Abstracts (SocAbs). We conducted the latest search on 28 August 2017.

SELECTION CRITERIA

Participants were school-aged children with asthma who received the intervention in school. Interventions were eligible if their purpose was to help children improve management of their asthma by increasing knowledge, enhancing skills, or changing behaviour. Studies relevant to our first objective could be based on an experimental or quasi-experimental design and could use qualitative or quantitative methods of data collection. For the second objective we included randomised controlled trials (RCTs) where children were allocated individually or in clusters (e.g. classrooms or schools) to self-management interventions or no intervention control.

DATA COLLECTION AND ANALYSIS

We used qualitative comparative analysis (QCA) to identify intervention features that lead to successful implementation of asthma self-management interventions. We measured implementation success by reviewing reports of attrition, intervention dosage, and treatment adherence, irrespective of effects of the interventions.To measure the effects of interventions, we combined data from eligible studies for our primary outcomes: admission to hospital, emergency department (ED) visits, absence from school, and days of restricted activity due to asthma symptoms. Secondary outcomes included unplanned visits to healthcare providers, daytime and night-time symptoms, use of reliever therapies, and health-related quality of life as measured by the Asthma Quality of Life Questionnaire (AQLQ).

MAIN RESULTS

We included 55 studies in the review. Thirty-three studies in 14,174 children provided information for the QCA, and 33 RCTs in 12,623 children measured the effects of interventions. Eleven studies contributed to both the QCA and the analysis of effectiveness. Most studies were conducted in North America in socially disadvantaged populations. High school students were better represented among studies contributing to the QCA than in studies contributing to effectiveness evaluations, which more commonly included younger elementary and junior high school students. The interventions all attempted to improve knowledge of asthma, its triggers, and stressed the importance of regular practitioner review, although there was variation in how they were delivered.QCA results highlighted the importance of an intervention being theory driven, along with the importance of factors such as parent involvement, child satisfaction, and running the intervention outside the child's own time as drivers of successful implementation.Compared with no intervention, school-based self-management interventions probably reduce mean hospitalisations by an average of about 0.16 admissions per child over 12 months (SMD -0.19, 95% CI -0.35 to -0.04; 1873 participants; 6 studies, moderate certainty evidence). They may reduce the number of children who visit EDs from 7.5% to 5.4% over 12 months (OR 0.70, 95% CI 0.53 to 0.92; 3883 participants; 13 studies, low certainty evidence), and probably reduce unplanned visits to hospitals or primary care from 26% to 21% at 6 to 9 months (OR 0.74, 95% CI 0.60 to 0.90; 3490 participants; 5 studies, moderate certainty evidence). Self-management interventions probably reduce the number of days of restricted activity by just under half a day over a two-week period (MD 0.38 days 95% CI -0.41 to -0.18; 1852 participants; 3 studies, moderate certainty evidence). Effects of interventions on school absence are uncertain due to the variation between the results of the studies (MD 0.4 fewer school days missed per year with self-management (-1.25 to 0.45; 4609 participants; 10 studies, low certainty evidence). Evidence is insufficient to show whether the requirement for reliever medications is affected by these interventions (OR 0.52, 95% CI 0.15 to 1.81; 437 participants; 2 studies; very low-certainty evidence). Self-management interventions probably improve children's asthma-related quality of life by a small amount (MD 0.36 units higher on the Paediatric AQLQ(95% CI 0.06 to 0.64; 2587 participants; 7 studies, moderate certainty evidence).

AUTHORS' CONCLUSIONS

School-based asthma self-management interventions probably reduce hospital admission and may slightly reduce ED attendance, although their impact on school attendance could not be measured reliably. They may also reduce the number of days where children experience asthma symptoms, and probably lead to small improvements in asthma-related quality of life. Many of the studies tested the intervention in younger children from socially disadvantaged populations. Interventions that had a theoretical framework, engaged parents and were run outside of children's free time were associated with successful implementation.

Effectiveness of school-based self-management interventions for asthma among children and adolescents: findings from a Cochrane systematic review and meta-analysis

INTRODUCTION

The evidence that teaching self-management techniques to children and young people with asthma in schools is effective has not, to date, been the subject of systematic review.

METHODS

We conducted a systematic review of intervention studies. Studies were eligible if they employed a randomised parallel-group design and were published in English from 1995 onwards. Participants included children with asthma aged 5-18 years who participated within their own school environment. Searches were conducted on the Cochrane Airways Group Specialised Register. Quantitative data were combined using random-effects meta-analyses.

RESULTS

Thirty-three outcome evaluation studies were included. School-based interventions were effective in reducing the frequency of emergency department visits (OR 0.70, 95% CI 0.53 to 0.92; studies=13), and moderately effective in reducing levels of hospitalisations (standardised mean differences [SMD] -0.19, 95% CI -0.35 to -0.04; studies=6). A meta-analysis of three studies suggest that the intervention approach could reduce the number of days of restricted activity (SMD -0.30, 95% CI -0.41 to -0.18; studies=3). However, there was uncertainty as to whether school-based self-management interventions impacted on reducing absences from school.

CONCLUSIONS

Self-management interventions for children with asthma delivered in schools reduce the number of acute episodes of healthcare usage. We conclude that the school environment is an important space for delivering interventions to improve children's health.

Implications of a complexity perspective for systematic reviews and guideline development in health decision making

There is growing interest in the potential for complex systems perspectives in evaluation. This reflects a move away from interest in linear chains of cause-and-effect, towards considering health as an outcome of interlinked elements within a connected whole. Although systems-based approaches have a long history, their concrete implications for health decisions are still being assessed. Similarly, the implications of systems perspectives for the conduct of systematic reviews require further consideration. Such reviews underpin decisions about the implementation of effective interventions, and are a crucial part of the development of guidelines. Although they are tried and tested as a means of synthesising evidence on the effectiveness of interventions, their applicability to the synthesis of evidence about complex interventions and complex systems requires further investigation. This paper, one of a series of papers commissioned by the WHO, sets out the concrete methodological implications of a complexity perspective for the conduct of systematic reviews. It focuses on how review questions can be framed within a complexity perspective, and on the implications for the evidence that is reviewed. It proposes criteria which can be used to determine whether or not a complexity perspective will add value to a review or an evidence-based guideline, and describes how to operationalise key aspects of complexity as concrete research questions. Finally, it shows how these questions map onto specific types of evidence, with a focus on the role of qualitative and quantitative evidence, and other types of information.

Synthesising quantitative evidence in systematic reviews of complex health interventions

Public health and health service interventions are typically complex: they are multifaceted, with impacts at multiple levels and on multiple stakeholders. Systematic reviews evaluating the effects of complex health interventions can be challenging to conduct. This paper is part of a special series of papers considering these challenges particularly in the context of WHO guideline development. We outline established and innovative methods for synthesising quantitative evidence within a systematic review of a complex intervention, including considerations of the complexity of the system into which the intervention is introduced. We describe methods in three broad areas: non-quantitative approaches, including tabulation, narrative and graphical approaches; standard meta-analysis methods, including meta-regression to investigate study-level moderators of effect; and advanced synthesis methods, in which models allow exploration of intervention components, investigation of both moderators and mediators, examination of mechanisms, and exploration of complexities of the system. We offer guidance on the choice of approach that might be taken by people collating evidence in support of guideline development, and emphasise that the appropriate methods will depend on the purpose of the synthesis, the similarity of the studies included in the review, the level of detail available from the studies, the nature of the results reported in the studies, the expertise of the synthesis team and the resources available.