Clarifying differences between review designs and methods

Conceptualising, evaluating and communicating uncertainty in forensic science: Identifying commonly used tools through an interdisciplinary configurative review

This study provides a set of tools for conceptualising, evaluating and communicating uncertainty in forensic science. Given that the concept of uncertainty is one that transcends disciplinary boundaries, an interdisciplinary configurative review was carried out incorporating the disciplines of medicine, environmental science and economics, in order to identify common themes which could have valuable applications to the discipline of forensic science. Critical Interpretive Synthesis was used to develop sub-synthetic and synthetic constructs which interpreted and synthesised the underlying evidence and codes. This study provides three toolkits, one each for conceptualisation, evaluation and communication. The study identified an underlying theme concerning the obstacles that would need to be overcome for the effective application of these toolkits and achieving effective conceptualisation, evaluation and communication of uncertainty in forensic science to lay-stakeholders. These toolkits offer a starting point for developing the conversation for achieving greater transparency in the communication of uncertainty. They also have the potential to offer stakeholders enhanced understanding of the nuances and limitations of forensic science evidence and enable more transparent evaluation and scrutiny of the reliability, relevance and probative value of forensic materials in a crime reconstruction.

A case study applying pathway-oriented thinking to problem formulation for planning a systematic review

The use of evidence-based methods in chemical risk assessment (CRA) is still in its infancy. Novel approaches exploring how to implement Systematic Review (SR) principles and methods for evaluating human health risks from environmental chemical exposures are needed. This paper reports and comments on a conceptual model that was developed as part of a mapping exercise for planning a SR, using aluminium-containing antiperspirants (Al-AP) and female breast cancer risk as a case study. The work explores how knowledge-assembly tools and pathway-oriented thinking developed in systems toxicology can be applied to support problem formulation (PF) in the context of SR. A conceptual model was developed to map out key research questions, working hypotheses, routes of exposure, toxicity pathways and endpoints, and related health outcomes. The model draws on the analytic framework for screening topics of the U.S. Preventive Services Task Force and builds on the concept of a "source-to-outcome continuum", integrating knowledge gained from exposure pathway concepts such as the Aggregate Exposure Pathway and Adverse Outcome Pathways. The model can be used as a central decision and prioritization tool for scoping and framing Population, Exposure, Control, Outcome (PECO) questions in a transparent and iterative manner; as a supporting tool to guide the whole SR process; and to lay down the methodological foundation of a SR on the Al-AP breast cancer topic. Logic modelling can be easily combined with systems or pathway-oriented thinking, and allows for a more structured, objective and transparent approach to PF when applying SR methods to the CRA context.

Young People Who Display Harmful Sexual Behaviors and Their Families: A Qualitative Systematic Review of Their Experiences of Professional Interventions

It is estimated that 30-50% of all childhood sexual abuse involves other young people as perpetrators. The treatment of harmful sexual behavior (HSB) in young people has evolved from interventions developed for use with adult perpetrators of sexual offenses. Increasingly, these approaches were not seen as appropriate for use with young people. The purpose of this qualitative systematic review was to establish what intervention components are viewed as acceptable or useful by young people and their families in order to inform the development of interventions for young people with HSB. We conducted searches across 14 electronic databases as well as contacting experts to identify relevant studies. Thirteen qualitative studies were included in the analysis, reporting findings from intervention studies from the United Kingdom, United States, New Zealand, Australia, and Ireland. Thematic analysis was used to combine findings from the studies of young people and parent/carers views. Five key themes were identified as critical components of successful interventions for young people with HSB. These included the key role of the relationship between the young person and practitioner, the significance of the role of parents and carers, the importance of considering the wider context in which the abuse has occurred, the role of disclosure in interventions, and the need to equip young people with skills as well as knowledge. The evidence was limited by the small number of studies that were mainly from the perspectives of adolescent males.

A BEME systematic review of teaching interventions to equip medical students and residents in early recognition and prompt escalation of acute clinical deteriorations: BEME Guide No. 62

Background: Current educational interventions and teaching for acute deteriorations seem to address acute care learning in discreet segments. Technology enhanced and team training methodologies are in vogue though well studied in the nursing profession, teaching avenues for junior 'doctors in training' seem to be a lacuna.Aims: The BEME systematic review was designed to (1) appraise the existing published evidence on educational interventions that are intended for 'doctors in training' to teach early recognition and prompt escalation in acute clinical deteriorations (2) to synthesise evidence & to evaluate educational effectiveness.Methodology: The method applied was a descriptive, justification & clarification review. Databases searched included PubMed, PsycINFO, Science Direct and Scopus for original research and grey literature with no restrictions to year or language. Abstract review, full text decisions and data extraction were completed by two primary coders with final consensus by a third reviewer.Results: 5592 titles and abstracts were chosen after removal of 905 duplications. After exclusion of 5555 studies, 37 full text articles were chosen for coding. 22 studies met final criteria of educational effectiveness, relevance to acute care. Educational platforms varied from didactics to blended learning approaches, small group teaching sessions, simulations, live & cadaveric tissue training, virtual environments and insitu team-based training. Translational outcomes with reduction in long term (up to 3-6 years) morbidity & mortality with financial savings were reported by 18% (4/22) studies. Interprofessional training were reported in 41% (9/22) of studies. Recent evidence demonstrated effectiveness of virtual environment and mobile game-based learning.Conclusions: There were significant improvements in teaching initiatives with focus on observable behaviours and translational real patient outcomes. Serious game-based learning and virtual multi-user collaborative environments might enhance individual learners' cognitive deliberate practice. Acute care learning continuum with programmatic acute care portfolios could be a promise of the future.

Defining Coordinated Care for People with Rare Conditions: A Scoping Review

Introduction:

To coordinate care effectively for rare conditions, we need to understand what coordinated care means. This review aimed to define coordinated care and identify components of coordinated care within the context of rare diseases; by drawing on evidence from chronic conditions.

Methods:

A systematic scoping review. We included reviews that reported or defined and outlined components of coordinated care for chronic or rare conditions. Thematic analysis was used to develop a definition and identify components or care coordination. Stakeholder consultations (three focus groups with patients, carers and healthcare professionals with experience of rare conditions) were held to further explore the relevance of review findings for rare conditions.

Results:

We included 154 reviews (n = 139 specific to common chronic conditions, n = 3 specific to rare conditions, n = 12 both common/rare conditions). A definition of coordination was developed. Components were identified and categorised by those that: may need to be coordinated, inform how to coordinate care, have multiple roles, or that contextualise coordination.

Conclusions:

Coordinated care is multi-faceted and has both generic and context-specific components. Findings outline many ways in which care may be coordinated for both rare and common chronic conditions. Findings can help to develop and eventually test different ways of coordinating care for people with rare and common chronic conditions.

"It has no meaning to me." How do researchers understand the effectiveness of literature searches? A qualitative analysis and preliminary typology of understandings

This study aimed to address the question: what does "effectiveness" mean to researchers in the context of literature searching for systematic reviews? We conducted a thematic analysis of responses to an e-mail survey. Eighty-nine study authors, whose studies met inclusion in a recent review (2018), were contacted via e-mail and asked three questions; one directly asking the question: in literature searching, what does effective (or effectiveness in) literature searching mean to you? Thirty-eight (46%) responses were received from diverse professional groups, including: literature searchers, systematic reviewers, clinicians and researchers. A shared understanding of what effectiveness means was not identified. Instead, five themes were developed from data: (a) effectiveness is described as a metric; (b) effectiveness is a balance between metrics; (c) effectiveness can be categorized by search purpose; (d) effectiveness is an outcome; and, (e) effectiveness is an experimental concept. We propose that these themes constitute a preliminary typology of understandings. No single definition of effectiveness was identified. The proposed typology suggests that different researchers have differing understandings of effectiveness. This could lead to uncertainty as to the aim and the purpose of literature searches and confusion about the outcomes. The typology offers a potential route for further exploration.

Using natural experiments to improve public health evidence: a review of context and utility for obesity prevention

Background

Natural experiments are increasingly valued as a way to assess the health impact of health and non-health interventions when planned controlled experimental research designs may be infeasible or inappropriate to implement. This study sought to investigate the value of natural experiments by exploring how they have been used in practice. The study focused on obesity prevention research as one complex programme area for applying natural experiment studies.

Methods

A literature search sought obesity prevention research from January 1997 to December 2017 and identified 46 population health studies that self-described as a natural experiment.

Results

The majority of studies identified were published in the last 5 years, illustrating a more recent adoption of such opportunities. The majority of studies were evaluations of the impact of policies (n = 19), such as assessing changes to food labelling, food advertising or taxation on diet and obesity outcomes, or were built environment interventions (n = 17), such as the impact of built infrastructure on physical activity or access to healthy food. Research designs included quasi-experimental, pre-experimental and non-experimental methods. Few studies applied rigorous research designs to establish stronger causal inference, such as multiple pre/post measures, time series designs or comparison of change against an unexposed group. In general, researchers employed techniques to enhance the study utility but often were limited in the use of more rigorous study designs by ethical considerations and/or the particular context of the intervention.

Conclusion

Greater recognition of the utility and versatility of natural experiments in generating evidence for complex health issues like obesity prevention is needed. This review suggests that natural experiments may be underutilised as an approach for providing evidence of the effects of interventions, particularly for evaluating health outcomes of interventions when unexpected opportunities to gather evidence arise.

Innovations in framework synthesis as a systematic review method

Framework synthesis is one systematic review method employed to address health care practice and policy. Adapted from framework analysis methods, it has been used increasingly, using both qualitative and mixed-method systematic review methods. This article demonstrates a spectrum of approaches to framework synthesis that are dependent on the extent to which theory is tentative, emergent, refined, or established; and that stakeholder involvement may help to understand the topic's complexity where theory is more nascent. The choice of approach depends on the degree of match with existing theories and, in the absence of existing theory, the scale and heterogeneity of the literature to be managed.

Barriers and Facilitators in Timely Detection of Chronic Kidney Disease: Evidences for Decision-Makers

Chronic Kidney Disease (CKD) is classified, according to the glomerular filtratation rate. Timely diagnosis during the first three stages represents a lower expenditure for health systems in the treatment of this disease. Thus, this study intends to identify barriers and facilitators in timely detection of CKD, from the perspective of healthcare providers. This is an exploratory study of the qualitative type. A mapping of the literature was carried out in order to develop the following topics: perceptions of the implications of CKD for the health system at an international level and in Mexico, as well as experience related to barriers and facilitators in timely CKD detection in Mexico. Based on the identified topics, semi-structured interviews were carried out with decision-makers, operational personnel, civil and academic associations representatives in Mexico City and Cuernavaca, Morelos. The main identified barriers were: system fragmentation; overload of services at first and second levels of care; insufficient human resources; lack of updating of the clinical practice guide and scarce training. With respect to facilitators, we found there are civil society actions. Finally, requirements for timely detection of CKD are consistent with what is described in the international guides. The identification of barriers and facilitators in timely CKD detection gives us an outlook of the problem in Mexico and leads to proposals for action. The development of a national program with a strategy for timely detection of CKD may help unify inter-institutional criteria considering the protocols for clinical practice that take into account each institution's organization and resources.

A Qualitative Evidence Synthesis Review of Longitudinal Qualitative Research in Gerontology

BACKGROUND AND OBJECTIVES

Gerontologists have long been interested in longitudinal qualitative research (LQR), yet ambiguity remains about best practices. The purpose of this review was to conduct a qualitative evidence synthesis to identify strengths and limitations in existing gerontological LQR.

RESEARCH DESIGN AND METHODS

We searched for studies published in English before September 2017, using longitudinal qualitative methods and focusing on gerontology. We searched the following databases: PubMed and ProQuest. This was followed up by a snowball search to identify additional LQR articles that were not gerontologically focused but provided conceptual or methodological information to enhance gerontological LQR. Article titles and abstracts were reviewed, and selected articles were independently evaluated by all authors and summarized in a descriptive matrix based on design, analysis, and strengths and limitations.

RESULTS

Our literature search resulted in 225 articles, which was then narrowed to 71 articles from 47 different journals based on our inclusion/exclusion criteria. LQR in gerontology varies considerably by study design and analysis approach. LQR design considerations involve number of time points and duration; rapport and retention; and consistent or different sampling, data collection, and measures. LQR analysis considerations involve synchronic and diachronic approaches, consistent or evolving coding, and individual- or group-level analysis. Gerontological LQR articles vary in the extent to which they address special aging considerations.

DISCUSSION AND IMPLICATIONS

This review indicates that there are areas where gerontological LQR can be strengthened going forward. We provide researchers with strategies to improve LQR rigor in our field and beyond.

Research Trends and Recommendations for Physical Activity Interventions Among Children and Youth With Disabilities: A Review of Reviews

This scoping review synthesized reviews of physical activity (PA) interventions for children and youth with disabilities to highlight promising elements of effective interventions, research methodological limitations, and research priorities. Twenty studies were eligible and underwent three rounds of review by an expert panel. Rich and diverse PA programs derived potential short-term benefits toward health, function, and PA. Strategies to increase sample sizes included embedding programs in the community and using information communication technology to deliver exercise programs. Methodological limitations of interventions included a lack of generalizability, transferability, and scientific rigor. Three research priorities were identified: develop and report precision-based intervention strategies, identify strategies that promote both long-term and sustainable PA participation and outcomes, and develop scalable interventions and recruitment strategies. If addressed, these areas could enhance the impact of PA interventions for children and youth with disabilities.

A scoping review of knowledge syntheses in the field of evaluation across four decades of practice

This scoping review of 62 knowledge syntheses published in evaluation-focused journals between 1979 and May 2018 provides a portrait of synthesis practices and their evolution in the mainstream of the field of evaluation. Concerns surrounding the production of knowledge syntheses to answer policy questions are not new in the field of evaluation. However, during this last decade, knowledge synthesis methods have expanded as a means to go beyond the limits and constraints of singular evaluations. This scoping review reveals and discusses two key issues with regards to the expansion of knowledge synthesis practices within the field of evaluation: the diversity-and muddling- of methodological practices and synthesis designs, and the frequent omission of quality appraisals.

Barriers and enablers to conducting cluster randomized control trials in hospitals: A theory-informed scoping review

BACKGROUND

Cluster randomized control trials (cRCTs) have unique challenges compared to single site trials with regards to conduct of the trial, and it is important to understand these barriers. The aim of this scoping review was to describe the current literature surrounding the implementation of the cRCTs in hospitals.

METHODS

The search strategy was designed to identify literature relevant to conduct of cRCTs, with hospitals as the unit of randomization. Data was extracted and was mapped using the Consolidated Framework for Implementation Research (CFIR) as a codebook, which contains 39 constructs organized into five domains.

RESULTS

Twenty-two articles met inclusion criteria and were included. 18 of 39 constructs of the CFIR were identified in coding, spanning four of the five domains. Barriers to the conduct of the trial were rarely reported as the main outcome of the study, and few details were included in the identified literature.

CONCLUSIONS

The review can provide guidance to future researchers planning cRCTs in hospitals. It also identified a large gap in reporting of conduct of these trials, demonstrating the need for a research agenda that further explores the barriers and facilitators, with the aim of garnering knowledge for improved guidance in the implementation.

Title analysis of (systematic) scoping review studies: Chaos or consistency?

The scoping review is one of the alternatives of producing a literature review. However, this approach still lacks a clearly accepted definition, and the scoping terminology is also somewhat fuzzy. Although the methodology of scoping review processing is relatively uniform, terminological chaos appears in the titles of studies with scoping review methodology. This paper presents an analysis of selected published studies with a focus on the content of their titles. A total of 13 thematic dimensions were identified covering the content of titles that show a degree of inconsistency and frequent terminological and methodological "chaos." This study includes a broad scope of themes and areas for which scoping reviews were produced. We would like to recommend to authors (especially scoping review beginners) to - if not necessary or desirable - avoid introducing new concepts and specifications of titles of produced and published scoping review studies. In the case of literature reviews and knowledge synthesis it is necessary to search according to specific keywords and search phrases - more fragmented scoping review terminology makes literature search more difficult or even impossible.

Factors influencing the implementation of evidence-based guidelines for osteoarthritis in primary care: A systematic review and thematic synthesis

INTRODUCTION

Implementation of evidence-based health guidelines in primary care is challenging. This systematic review aimed to synthesize qualitative evidence that investigates the factors influencing the implementation of evidence-based guidelines for osteoarthritis in primary care.

METHODS

A systematic review of qualitative studies. MEDLINE, EMBASE, CINAHL, HMIC, PsychINFO, Web of Science and Assia were searched (from 2000 to March 2019). The methodological quality of the included studies was assessed by two independent reviewers. Data were analyzed and synthesized using thematic synthesis.

RESULTS

1612 articles were screened and four articles with a total of 87 participants (46 patients, 28 GPs, 13 practice nurses) were included. Three of the studies were conducted in England within the context of an implementation trial and one was conducted in the Netherlands. The thematic synthesis revealed three overarching themes. Best practice was not enough to achieve 'buy-in' to implementation but a range of tacit motivators to implementation were identified. Healthcare professionals used patient reasons to justify engaging or not engaging with implementation. Engaging with the whole practice was important in achieving implementation. A disconnect between research and 'real-world' primary care practice influenced long-term implementation.

CONCLUSIONS

Despite the relative paucity of current evidence, this systematic review has identified a series of possible disconnects may impact uptake of interventions to improve osteoarthritis care, existing between clinicians and patients, researchers and clinicians, clinicians and guidelines and within general practice itself. There remains a need to further explore the experiences of key stakeholders, including patients involved in implementation for osteoarthritis in primary care.

Assessment of publication bias and outcome reporting bias in systematic reviews of health services and delivery research: A meta-epidemiological study

Strategies to identify and mitigate publication bias and outcome reporting bias are frequently adopted in systematic reviews of clinical interventions but it is not clear how often these are applied in systematic reviews relating to quantitative health services and delivery research (HSDR). We examined whether these biases are mentioned and/or otherwise assessed in HSDR systematic reviews, and evaluated associating factors to inform future practice. We randomly selected 200 quantitative HSDR systematic reviews published in the English language from 2007-2017 from the Health Systems Evidence database (www.healthsystemsevidence.org). We extracted data on factors that may influence whether or not authors mention and/or assess publication bias or outcome reporting bias. We found that 43% (n = 85) of the reviews mentioned publication bias and 10% (n = 19) formally assessed it. Outcome reporting bias was mentioned and assessed in 17% (n = 34) of all the systematic reviews. Insufficient number of studies, heterogeneity and lack of pre-registered protocols were the most commonly reported impediments to assessing the biases. In multivariable logistic regression models, both mentioning and formal assessment of publication bias were associated with: inclusion of a meta-analysis; being a review of intervention rather than association studies; higher journal impact factor, and; reporting the use of systematic review guidelines. Assessment of outcome reporting bias was associated with: being an intervention review; authors reporting the use of Grading of Recommendations, Assessment, Development and Evaluations (GRADE), and; inclusion of only controlled trials. Publication bias and outcome reporting bias are infrequently assessed in HSDR systematic reviews. This may reflect the inherent heterogeneity of HSDR evidence and different methodological approaches to synthesising the evidence, lack of awareness of such biases, limits of current tools and lack of pre-registered study protocols for assessing such biases. Strategies to help raise awareness of the biases, and methods to minimise their occurrence and mitigate their impacts on HSDR systematic reviews, are needed.

Comprehensive 5P framework for active aging using the ecological approach: an iterative systematic review

BACKGROUND

"Active aging" is an inclusive term and has been defined from a variety of aspects in different domains throughout the literature. The aim of this review was to identify those aspects that play significant roles in building this concept using an ecological approach.

METHODS

In this study, seven online databases, including JSTOR, Pub-Med, Web of Science, Google Scholar, ProQuest, EBSCO, and Scopus, were searched from 2002 to 2018 for both qualitative and quantitative articles published in English. Two reviewers independently found the related articles using the search terms "active aging" and "built environment" and included both "ageing" and "aging".

RESULTS

Of 1500 records which passed the screening stage, 92 were eligible for inclusion in the review. A total of 15 subthemes were derived: (1) personal characteristics, (2) behavioral attitude, (3) land use, (4) access, (5) physical form, (6) cityscape/city image, (7) public open spaces, (8) housing, (9) social environment, (10) cultural Environment, (11) economic environment, (12) good governance, (13) physical health, (14) mental health, and (15) social health. Ecological themes of active aging can be defined as the 5P model: person, processes, place, prime, and policymaking.

CONCLUSIONS

The results of this study can shed light on different aspects of active aging. Also, the results emphasized the significance of the multidimensional nature of active aging, micro (person), meso (process), and macro systems (place and policymaking), based on health (prime) environments. Moreover, the results were based on the relationships between the person and the environment at the individual, interpersonal, and environmental levels, which can be used to conduct future studies and develop policies on aging populations.

Climate Change Adaptation Options for Coastal Communities and Local Governments

Extreme weather events and failure to adapt to the likely impacts of climate change are two of the most significant threats to humanity. Therefore, many local communities are preparing adaptation plans. Even so, much of what was done has not been published in the peer-reviewed literature. This means that consideration of adaptation options for local communities is limited. With the objective of assisting in the development of adaptation plans, we present 80 adaptation options suitable for coastal communities that can be applied by local governments. They are a catena of options from defend to co-exist and finally, retreat that progresses as impacts become less manageable. Options are organized according to their capacity to protect local properties and infrastructure, natural systems, food production, availability of fresh and drinking water and well-being of the local population, as these are likely to be affected by climate change. To respond to multiple threats, ‘soft’ options, such as awareness raising, planning, political articulation and financial incentives, insurance and professional skills enhancement, can be encouraged immediately at relatively low cost and are reversible. For specific threats, options emphasize change in management practices as pre-emptive measures. Key audiences for this work are communities and local governments starting to consider priority actions to respond to climate change impacts.

Definitions of Physician Certification Used in the North American Literature: A Scoping Review

INTRODUCTION

The authors sought to identify how physician specialty certification is defined in the North American literature.

METHODS

A rigorous, established six-stage scoping review framework was used to identify the North American certification literature published between January 2006 and May 2016 relating to physician specialty certification. Data were abstracted using a charting form developed by the study team. Quantitative summary data and qualitative thematic analysis of the purpose of certification were derived from the extracted data.

RESULTS

A two stage screening process identified 88 articles that met predefined criteria. Only 14 of the 88 articles (16%) contained a referenced purpose of certification. Eighteen definitions were identified from these articles. Definitional concepts included lifelong learning and continuous professional development, assessment of competence and performance, performance improvement, public accountability, and professional standing.

DISCUSSION

Most articles identified in this scoping review did not define certification or describe its purpose or intent. Future studies should provide a definition of certification to further scholarly examination of its intent and effects and inform its further evolution.

The neural chronometry of threat-related attentional bias: Event-related potential (ERP) evidence for early and late stages of selective attentional processing

Rapid and accurate detection of threat is adaptive. Yet, threat-related attentional biases, including hypervigilance, avoidance, and attentional disengagement delays, may contribute to the etiology and maintenance of anxiety disorders. Behavioral measures of attentional bias generally indicate that threat demands more attentional resources; however, indices exploring differential allocation of attention using reaction time fail to clarify the time course by which attention is deployed under threatening circumstances in healthy and anxious populations. In this review, we conduct an interpretive synthesis of 28 attentional bias studies focusing on event-related potentials (ERPs) as a primary outcome to inform an ERP model of the neural chronometry of attentional bias in healthy and anxious populations. The model posits that both healthy and anxious populations display modulations of early ERP components, including the P1, N170, P2, and N2pc, in response to threatening and emotional stimuli, suggesting that both typical and abnormal patterns of attentional bias are characterized by enhanced allocation of attention to threat and emotion at earlier stages of processing. Compared to anxious populations, healthy populations more clearly demonstrate modulations of later components, such as the P3, indexing conscious and evaluative processing of threat and emotion and disengagement difficulties at later stages of processing. Findings from the interpretive synthesis, existing bias models, and extant neural literature on attentional systems are then integrated to inform a conceptual model of the processes and substrates underlying threat appraisal and resource allocation in healthy and anxious populations. To conclude, we discuss therapeutic interventions for attentional bias and future directions.

Factors influencing the relationship between fluoride in drinking water and dental fluorosis: a ten-year systematic review and meta-analysis

The relationship between naturally fluoridated groundwater and dental fluorosis has received large attention from researchers around the world. Despite recognition that several factors influence this relationship, there is a lack of systematic studies analyzing the heterogeneity of these results. To fill such a gap, this study performs a systematic review and meta-analysis to understand which factors influence this relationship and how. Selected studies were sampled between 2007 and 2017 from Web of Science, PubMed, Google Scholar and Scopus using keywords and Boolean operators. Results of the systematic review show that dental fluorosis affects individuals of all ages, with the highest prevalence below 11, while the impact of other factors (gender, environmental conditions, diet and dental caries) was inconclusive. Meta-regression analysis, based on information collected through systematic review, indicates that both fluoride in drinking water and temperature influence dental fluorosis significantly and that these studies might be affected by publication bias. Findings show that fluoride negatively affects people's health in less developed countries. The conclusions discuss policy tools and technological innovations that could reduce fluoride levels below that of the World Health Organization (WHO) (<1.5 mg/L).

A typology of systematic reviews for synthesising evidence on health care

OBJECTIVES

The objectives of this paper are to (a) Review published references to systematic reviews; (b) offer a typology of systematic reviews for synthesising evidence on health care; and (c) summarise the guides for designing, reporting and appraising the reviews.

BACKGROUND

Systematic reviews play a role in finding, synthesising, transferring and implementing evidence for healthcare policy, practice guidelines and allocation of health resources. They have been particularly successful in confirming or synthesising evidence for health care by meta-analysing aggregated data from multiple randomised controlled trials. However, concerns about the limitations of evidence from controlled trials have prompted interest in other review methods capable of locating and appraising evidence from more diverse, and possibly more realistic, healthcare situations.

METHODS

An iterative citation-tracking process with Google Search and grey literature identified 204 papers on previous typologies and methods of systematic reviews.

RESULTS AND CONCLUSIONS

There are six types of systematic reviews: narrative; meta-analysis; scoping; qualitative; umbrella; and realist. Each type has distinct objectives, characteristics and attributes, but with much overlapping of methods and guides. Sensitivity to the need for qualitative evidence on complex human responses to ill-health and health care has broadened the objectives and methods of health-related systematic reviews to find, appraise and synthesis useful evidence for practice guidelines, healthcare policy and allocation of health resources.

Observational Studies in Male Elite Football: A Systematic Mixed Study Review

Objective: This systematic mixed study review, focuses on the use of observation methodology in elite men's football matches, which constitutes an innovative approach, that opens up a new panorama of useful and productive research.

Method: The methods used in this study follow the recommendations for systematic reviews and meta-analysis guidelines (PRISMA). The search was carried out in five databases. Ninety-four articles out of 3,195 were selected and analyzed. In order to achieve a quality assessment, the guide was used to inform evaluations based on observation methodology (GREOM) (Portell et al., 2015), recognized by the EQUATOR network.

Results: From the methodological review analysis, information obtained indicates that 97% of the researches used direct observation and 3% indirect observation. On the other hand, 56.5% of the articles explain the instrument used and 77% justify the applied observational design. A quantitative comparison of the proportions was made in several methodological aspects, which resulted in only 15.21% reviewing the quality of the data, and that 67.3% of the articles contributed to the mixed methods approach. The methodological review allowed us to establish procedural profiles. The results indicate that 67% of the articles have been published in English, and of these, 77% were published in journals that have an impact factor. The majority of the researchers, 53.26%, belong to Spanish entities. The most studied substantive aspects were goal (34%), possession of the ball (28%), and corner (27%). The most observed events were Leagues, World Cups, individual players and other events.

Conclusions: The results obtained refer to both substantive and methodological aspects and allow us to configure a systematic review of mixed studies, in which we emphasize the aspects of a “systematic review” and a “mixed study,” within an integrated perspective.

Qualitative Evidence Synthesis (QES) for Guidelines: Paper 2 - Using qualitative evidence synthesis findings to inform evidence-to-decision frameworks and recommendations

BACKGROUND

WHO has recognised the need to improve its guideline methodology to ensure that guideline decision-making processes are transparent and evidence based, and that the resulting recommendations are relevant and applicable. To help achieve this, WHO guidelines now typically enhance intervention effectiveness data with evidence on a wider range of decision-making criteria, including how stakeholders value different outcomes, equity, gender and human rights impacts, and the acceptability and feasibility of interventions. Qualitative evidence syntheses (QES) are increasingly used to provide evidence on this wider range of issues. In this paper, we describe and discuss how to use the findings from QES to populate decision-making criteria in evidence-to-decision (EtD) frameworks. This is the second in a series of three papers that examines the use of QES in developing clinical and health system guidelines.

METHODS

WHO convened a writing group drawn from the technical teams involved in its recent (2010-2018) guidelines employing QES. Using a pragmatic and iterative approach that included feedback from WHO staff and other stakeholders, the group reflected on, discussed and identified key methods and research implications from designing QES and using the resulting findings in guideline development.

RESULTS

We describe a step-wise approach to populating EtD frameworks with QES findings. This involves allocating findings to the different EtD criteria (how stakeholders value different outcomes, equity, acceptability and feasibility, etc.), weaving the findings into a short narrative relevant to each criterion, and inserting this summary narrative into the corresponding 'research evidence' sections of the EtD. We also identify areas for further methodological research, including how best to summarise and present qualitative data to groups developing guidelines, how these groups draw on different types of evidence in their decisions, and the extent to which our experiences are relevant to decision-making processes in fields other than health.

CONCLUSIONS

This paper shows the value of incorporating QES within a guideline development process, and the roles that qualitative evidence can play in integrating the views and experiences of relevant stakeholders, including groups who may not be otherwise represented in the decision-making process.

Identifying and resolving the frustrations of reviewing the improvement literature: The experiences of two improvement researchers

Background and aims

Summarising quality improvement (QI) research through systematic literature review has great potential to improve patient care. However, heterogeneous terminology, poor definition of QI concepts and overlap with other scientific fields can make it hard to identify and extract data from relevant literature. This report examines the compromises and pragmatic decisions that undertaking literature review in the field of QI requires and the authors propose recommendations for literature review authors in similar fields.

Methods

Two authors (EJ and JF) provide a reflective account of their experiences of conducting a systematic literature review in the field of QI. They draw on wider literature to justify the decisions they made and propose recommendations to improve the literature review process. A third collaborator, (WC) co-created the paper challenging author’s EJ and JF views and perceptions of the problems and solutions of conducting a review of literature in QI.

Results

Two main challenges were identified when conducting a review in QI. These were defining QI and selecting QI studies. Strategies to overcome these problems include: select a multi-disciplinary authorship team; review the literature to identify published QI search strategies, QI definitions and QI taxonomies; Contact experts in related fields to clarify whether a paper meets inclusion criteria; keep a reflective account of decision making; submit the protocol to a peer reviewed journal for publication.

Conclusions

The QI community should work together as a whole to create a scientific field with a shared vision of QI to enable accurate identification of QI literature. Our recommendations could be helpful for systematic reviewers wishing to evaluate complex interventions in both QI and related fields.

Clarifying differences between reviews within evidence ecosystems

This paper builds on a 2012 paper by the same authors which argued that the types and brands of systematic review do not sufficiently differentiate between the many dimensions of different review questions and review methods (Gough et al., Syst Rev 1:28, 2012). The current paper extends this argument by considering the dynamic contexts, or 'evidence ecosystems', within which reviews are undertaken; the fact that these ecosystems are constantly changing; and the relevance of this broader context for understanding 'dimensions of difference' in the unfolding development and refinement of review methods.The concept of an evidence ecosystem is used to consider particular issues within the three key dimensions of difference outlined in the 2012 paper of (1) review aims and approach, (2) structure and components of reviews, and (3) breadth, depth, and 'work done' by reviews.

To screen or not to screen? Exploring the value of parent mental health screening in children's rehabilitation services

PURPOSE

Parents of children with disabilities are at increased risk of mental health challenges, yet it is unclear whether parent mental health screening should be considered in the context of children's rehabilitation.

METHODS

A nonsystematic narrative review was conducted guided by a framework for assessing the effectiveness of proposed health screening programs. Screening for the purpose of recommending further assessments and/or psychosocial supports and services was considered. The potential harms and benefits of mental health screening for parents of children with disability were examined considering relevant contextual factors.

RESULTS AND CONCLUSIONS

While best evidence in the form of a randomized controlled trial in this population does not yet exist, there was evidence to suggest that parent mental health is an important factor in promoting child and family health and well-being and deserves consideration in the practice of family-centered care. If appropriate referral pathways and resources are developed, children's rehabilitation service providers may be in an advantageous position to provide parent mental health screening.IMPLICATIONS FOR REHABILITATIONParents of children with disabilities are at increased risk for depression, stress, and anxiety.Service providers may be well placed to identify mental health concerns through screening.Contextual factors to consider before initiating screening include level of evidence for screening, whether screening would reach target clients, and whether additional supports are available.Children's rehabilitation service providers can be family-centered by attending to parent mental health needs, with the potential to improve the health, development, and well-being of the whole family.

Magnitude and modifiers of the weekend effect in hospital admissions: a systematic review and meta-analysis

OBJECTIVE

To examine the magnitude of the weekend effect, defined as differences in patient outcomes between weekend and weekday hospital admissions, and factors influencing it.

DESIGN

A systematic review incorporating Bayesian meta-analyses and meta-regression.

DATA SOURCES

We searched seven databases including MEDLINE and EMBASE from January 2000 to April 2015, and updated the MEDLINE search up to November 2017. Eligibility criteria: primary research studies published in peer-reviewed journals of unselected admissions (not focusing on specific conditions) investigating the weekend effect on mortality, adverse events, length of hospital stay (LoS) or patient satisfaction.

RESULTS

For the systematic review, we included 68 studies (70 articles) covering over 640 million admissions. Of these, two-thirds were conducted in the UK (n=24) or USA (n=22). The pooled odds ratio (OR) for weekend mortality effect across admission types was 1.16 (95% credible interval 1.10 to 1.23). The weekend effect appeared greater for elective (1.70, 1.08 to 2.52) than emergency (1.11, 1.06 to 1.16) or maternity (1.06, 0.89 to 1.29) admissions. Further examination of the literature shows that these estimates are influenced by methodological, clinical and service factors: at weekends, fewer patients are admitted to hospital, those who are admitted are more severely ill and there are differences in care pathways before and after admission. Evidence regarding the weekend effect on adverse events and LoS is weak and inconsistent, and that on patient satisfaction is sparse. The overall quality of evidence for inferring weekend/weekday difference in hospital care quality from the observed weekend effect was rated as 'very low' based on the Grading of Recommendations, Assessment, Development and Evaluations framework.

CONCLUSIONS

The weekend effect is unlikely to have a single cause, or to be a reliable indicator of care quality at weekends. Further work should focus on underlying mechanisms and examine care processes in both hospital and community.

PROSPERO REGISTRATION NUMBER

CRD42016036487.

Systematic mapping of existing tools to appraise methodological strengths and limitations of qualitative research: first stage in the development of the CAMELOT tool

BACKGROUND

Qualitative evidence synthesis is increasingly used alongside reviews of effectiveness to inform guidelines and other decisions. To support this use, the GRADE-CERQual approach was developed to assess and communicate the confidence we have in findings from reviews of qualitative research. One component of this approach requires an appraisal of the methodological limitations of studies contributing data to a review finding. Diverse critical appraisal tools for qualitative research are currently being used. However, it is unclear which tool is most appropriate for informing a GRADE-CERQual assessment of confidence.

METHODOLOGY

We searched for tools that were explicitly intended for critically appraising the methodological quality of qualitative research. We searched the reference lists of existing methodological reviews for critical appraisal tools, and also conducted a systematic search in June 2016 for tools published in health science and social science databases. Two reviewers screened identified titles and abstracts, and then screened the full text of potentially relevant articles. One reviewer extracted data from each article and a second reviewer checked the extraction. We used a best-fit framework synthesis approach to code checklist criteria from each identified tool and to organise these into themes.

RESULTS

We identified 102 critical appraisal tools: 71 tools had previously been included in methodological reviews, and 31 tools were identified from our systematic search. Almost half of the tools were published after 2010. Few authors described how their tool was developed, or why a new tool was needed. After coding all criteria, we developed a framework that included 22 themes. None of the tools included all 22 themes. Some themes were included in up to 95 of the tools.

CONCLUSION

It is problematic that researchers continue to develop new tools without adequately examining the many tools that already exist. Furthermore, the plethora of tools, old and new, indicates a lack of consensus regarding the best tool to use, and an absence of empirical evidence about the most important criteria for assessing the methodological limitations of qualitative research, including in the context of use with GRADE-CERQual.

Interventions targeting working memory in 4-11 year olds within their everyday contexts: A systematic review

It has been suggested that diverse interventions applied within children's everyday contexts have the potential to improve working memory (WM) and produce transfer to real-world skills but little is known about the effectiveness of these approaches. This review aims to examine systematically the effectiveness of non-computerised interventions with 4-11 year olds to identify: (i) their effects on WM; (ii) whether benefits extend to near- and far-transfer measures; (iii) if gains are sustained over time; (iv) the active ingredients; and (v) the optimum dosage. Searches were conducted across 12 electronic databases using consistent keywords. Papers were screened by title and abstract (n = 6212) and judged against pre-defined eligibility criteria (n = 63). Eighteen papers were included in the review. They used a range of non-computerised WM intervention approaches that included: (i) adapting the environment to reduce WM loads; (ii) direct WM training with and without strategy instruction; and (iii) training skills which may indirectly impact on WM (physical activity, phonological awareness, fantastical play and inhibition). Both direct training on WM tasks and practicing certain skills that may impact indirectly on WM (physical activity, fantastical play and inhibition) produced improvements on WM tasks, with some benefits for near-transfer activities. The common ingredient across effective interventions was the executive-loaded nature of the trained task i.e., training on a task that taps into attentional and processing resources under executive control and not just the storage of information. Few studies reported dosage effects, measured far-transfer effects (n = 4), or tested the durability of gains over time (n = 4). The lack of a clear theoretical framework in many of the included studies resulted in ambiguous predictions about training and transfer effects, and inadequate use of outcome measures. Methodological issues also constrain the strength of the evidence, including: small samples sizes; an absence of blinding of participant and outcome assessors; and lack of active control groups. Further well-designed and controlled studies with clear theoretical underpinnings are required to expand and enhance the evidence base. The heterogeneity of the interventions and of the study designs (randomised and non-randomised) in the included papers limited the synthesis of evidence across studies. However, this diversity enabled the identification of key ingredients, notably the training of executive-loaded WM tasks, which can help inform novel approaches to WM intervention in everyday contexts.

Application of quality improvement approaches in health-care settings to reduce missed opportunities for childhood vaccination: a scoping review

Missed opportunities for vaccination (MOV) is a poor reflection of the quality of care for children attending health facilities. It also contributes to a reduction in overall immunization coverage. Although there is a growing interest in the use of quality improvement (QI) in complex health systems to improve health outcomes, the degree to which this approach has been used to address MOV is poorly understood. We conducted a scoping review using Arksey and O'Malley's framework to investigate the extent to which QI has been used in health facilities to reduce MOV. The review followed five stages as follows: (1) identifying the research question; (2) identifying the relevant studies; (3) selecting the studies; (4) charting data; and (5) collating, summarizing, and reporting results. The search strategy included electronic databases and gray literature. A total of 12 literatures on QI projects focused on addressing MOV were identified. Eleven were published manuscripts, and one was a conference presentation. All the QI projects published were conducted in the United States and majority were between 2014 and 2018. In these projects, 45 change ideas targeting providers, clients, and health system were used. This study generated important evidence on the use of QI in health facilities to reduce MOV. In addition, the result suggests that there is a growing interest in the use of this approach to address MOV in recent years. However, no literature was found in low- and middle-income countries especially sub-Saharan Africa.

Health Literacy Studies Conducted in Australia: A Scoping Review

Health literacy (HL) is an essential component of various literacies mentioned in the field of health and education, including cultural, technological, media and scientific literacies. It is important for motivating higher consumer engagement. We aimed to review previous studies of HL in Australia to inform future studies, extend current knowledge and further enhance HL. Using search strings, a systematic search of four databases (i.e., MEDLINE; Embase; CINAHL and Eric) was carried out. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) based search strategy led to identification of a total of N = 9696 records, that were further screened for inclusion in the review. The review findings were categorized into three major themes: (1) HL and health numeracy; (2) contrast of: knowledge deficiency, knowledge gained, problems of current health care system and (3) HL measurement methods and its domains. The findings from this scoping review show a dearth of measurement tools with sound psychometric properties for assessing HL. The findings also reveal low levels of HL in consumers which is in turn affecting health-related behaviors, utilization of health services and navigation of the health system. More recent developments have tried to integrate vital aspects, including introduction of applications to increase HL and exploring HL in Aboriginal communities.

Taking stock of 10 years of published research on the ASHA programme: examining India's national community health worker programme from a health systems perspective

BACKGROUND

As India's accredited social health activist (ASHA) community health worker (CHW) programme enters its second decade, we take stock of the research undertaken and whether it examines the health systems interfaces required to sustain the programme at scale.

METHODS

We systematically searched three databases for articles on ASHAs published between 2005 and 2016. Articles that met the inclusion criteria underwent analysis using an inductive CHW-health systems interface framework.

RESULTS

A total of 122 academic articles were identified (56 quantitative, 29 mixed methods, 28 qualitative, and 9 commentary or synthesis); 44 articles reported on special interventions and 78 on the routine ASHA program. Findings on special interventions were overwhelmingly positive, with few negative or mixed results. In contrast, 55% of articles on the routine ASHA programme showed mixed findings and 23% negative, with few indicating overall positive findings, reflecting broader system constraints. Over half the articles had a health system perspective, including almost all those on general ASHA work, but only a third of those with a health condition focus. The most extensively researched health systems topics were ASHA performance, training and capacity-building, with very little research done on programme financing and reporting, ASHA grievance redressal or peer communication. Research tended to be descriptive, with fewer influence, explanatory or exploratory articles, and no predictive or emancipatory studies. Indian institutions and authors led and partnered on most of the research, wrote all the critical commentaries, and published more studies with negative results.

CONCLUSION

Published work on ASHAs highlights a range of small-scale innovations, but also showcases the challenges faced by a programme at massive scale, situated in the broader health system. As the programme continues to evolve, critical comparative research that constructively feeds back into programme reforms is needed, particularly related to governance, intersectoral linkages, ASHA solidarity, and community capacity to provide support and oversight.

A review of attitudes towards the reuse of health data among people in the European Union: The primacy of purpose and the common good

•

Studies of attitudes towards reuse of health data mainly from the UK.

•

Studies show lack of awareness of current usages of health data among people living in the EU.

•

Studies report positive attitudes towards the sharing of health data.

•

Concerns about commercial use of health data is expressed in the studies.

•

Attitudes towards informed consent are inconsistent.

Health data are used for still more purposes, and policies are enacted to facilitate data reuse within the European Union. This literature synthesis explores attitudes among people living in the European Union towards the use of health data for purposes other than treatment. Our findings indicate that while a majority hold positive attitudes towards the use of health data for multiple purposes, the positive attitudes are typically conditional on the expectation that data will be used to further the common good. Concerns evolve around the commercialisation of data, data security and the use of data against the interests of the people providing the data. Studies of these issues are limited geographically as well as in scope. We therefore identify a need for cross-national exploration of attitudes among people living in the European Union to inform future policies in health data governance.

Search strategies to identify observational studies in MEDLINE and Embase

BACKGROUND

Systematic reviews are essential for decision-making. Systematic reviews on observational studies help answer research questions on aetiology, risk, prognosis, and frequency of rare outcomes or complications. However, identifying observational studies as part of systematic reviews efficiently is challenging due to poor and inconsistent indexing in literature databases. Search strategies that include a methodological filter focusing on study design of observational studies might be useful for improving the precision of the search performance.

OBJECTIVES

To assess the sensitivity and precision of a search strategy with a methodological filter to identify observational studies in MEDLINE and Embase.

SEARCH METHODS

We searched MEDLINE (1946 to April 2018), Embase (1974 to April 2018), CINAHL (1937 to April 2018), the Cochrane Library (1992 to April 2018), Google Scholar and Open Grey in April 2018, and scanned reference lists of articles.

SELECTION CRITERIA

Studies using a relative recall approach, i.e. comparing sensitivity or precision of a search strategy containing a methodological filter to identify observational studies in MEDLINE and Embase against a reference standard, or studies that compared two or more methodological filters.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened articles, extracted relevant information and assessed the quality of the search strategies using the InterTASC Information Specialists' Sub-Group (ISSG) Search Filter Appraisal Checklist.

MAIN RESULTS

We identified two eligible studies reporting 18 methodological filters. All methodological filters in these two studies were developed using terms from the reference standard records.The first study evaluated six filters for retrieving observational studies of surgical interventions. The study reported on six filters: one Precision Terms Filter (comprising terms with higher precision while maximum sensitivity was maintained) and one Specificity Terms Filter (comprising terms with higher specificity while maximum sensitivity was maintained), both of which were adapted for MEDLINE, for Embase, and for combined MEDLINE/Embase searches. The study reported one reference standard consisting of 217 articles from one systematic review of which 83.9% of the included studies were case seriesThe second study reported on 12 filters for retrieving comparative non-randomised studies (cNRSs) including cohort, case-control, and cross-sectional studies. This study reported on 12 filters using four different approaches: Fixed method A (comprising of a fixed set of controlled vocabulary (CV) words), Fixed method B (comprising a fixed set of CV words and text words (TW)), Progressive method (CV) (a random choice of study design-related CV terms), and Progressive method (CV or TW) (a random choice of study design-related CV terms, and title and abstracts-based TWs). The study reported four reference standards consisting of 89 cNRSs from four systematic reviews.The six methodological filters developed from the first study reported sensitivity of 99.5% to 100% and precision of 16.7% to 21.1%. The Specificity Terms Filter for combined MEDLINE/Embase was preferred because it had higher precision and equal sensitivity to the Precision Terms Filter. The 12 filters from the second study reported lower sensitivity (48% to 100%) and much lower precision (0.09% to 4.47%). The Progressive method (CV or TW) had the highest sensitivity.There were methodological limitations in both included studies. The first study used one surgical intervention-focused systematic review thus limiting the generalizability of findings. The second study used four systematic reviews but with less than 100 studies. The external validation was performed only on Specificity Terms Filter from the first study Both studies were published 10 years ago and labelling and indexing of observational studies has changed since then.

AUTHORS' CONCLUSIONS

We found 18 methodological filters across two eligible studies. Search strategies from the first study had higher sensitivity and precision, underwent external validation and targeted observational studies. Search strategies from the second study had lower sensitivity and precision, focused on cNRSs, and were not validated externally. Given this limited and heterogeneous evidence, and its methodological limitations, further research and better indexation are needed.

A critical review of evidence on the sociocultural impacts of food marketing and policy implications

Historically, responsible marketing policy development has drawn on a substantive research agenda regarding the micro level effects of marketing on food choice. In contrast there has been almost no research on macro level effects. To date public health has been the main disciplinary source of evidence. As a first step towards exploring the significance of this evidence gap, a critically interpretive review of evidence on the effects of food marketing on the sociocultural food environment was conducted. A review of reviews approach was used to search for evidence across a broad multi-disciplinary range of evidence sources. This was supplemented with snowball searches of the reference lists of the identified reviews and included studies. Ten reviews and 31 individual studies met review inclusion criteria. Evidence of impacts on dietary norms, population level shifts in food and drink category preferences and in the cultural values underpinning food behaviours were identified. The review also identified evidence for two mechanisms of effect. The findings represent preliminary evidence in support of the case for the responsible marketing policy research agenda to be expanded from its historical focus on micro level impacts to include research directly focused on its macro level impacts. Expanding research scope to include a much stronger focus on evidence regarding the impacts of for-profit food marketing on the sociocultural food environment would provide direct research support to the strategic policy aim of creating a food environment that encourages healthy food behaviours.

Low-calorie sweeteners and health outcomes: A demonstration of rapid evidence mapping (rEM)

BACKGROUND

"Evidence Mapping" is an emerging tool that is increasingly being used to systematically identify, review, organize, quantify, and summarize the literature. It can be used as an effective method for identifying well-studied topic areas relevant to a broad research question along with any important literature gaps. However, because the procedure can be significantly resource-intensive, approaches that can increase the speed and reproducibility of evidence mapping are in great demand.

METHODS

We propose an alternative process called "rapid Evidence Mapping" (rEM) to map the scientific evidence in a time-efficient manner, while still utilizing rigorous, transparent and explicit methodological approaches. To illustrate its application, we have conducted a proof-of-concept case study on the topic of low-calorie sweeteners (LCS) with respect to human dietary exposures and health outcomes. During this process, we developed and made publicly available our study protocol, established a PECO (Participants, Exposure, Comparator, and Outcomes) statement, searched the literature, screened titles and abstracts to identify potentially relevant studies, and applied semi-automated machine learning approaches to tag and categorize the included articles. We created various visualizations including bubble plots and frequency tables to map the evidence and research gaps according to comparison type, population baseline health status, outcome group, and study sample size. We compared our results with a traditional evidence mapping of the same topic published in 2016 (Wang et al., 2016).

RESULTS

We conducted an rEM of LCS, for which we identified 8122 records from a PubMed search (January 1, 1946-May 1, 2014) and then utilized machine learning (SWIFT-Active Screener) to prioritize relevant records. After screening 2267 (28%) of the total set of titles and abstracts to achieve 95% estimated recall, we ultimately included 297 relevant studies. Overall, our findings corroborated those of Wang et al. (2016) and identified that most studies were acute or short-term in healthy individuals, and studied the outcomes of appetite, energy sensing and body weight. We also identified a lack of studies assessing appetite and dietary intake related outcomes in people with diabetes. The rEM approach required approximately 100 person-hours conducted over 7 calendar months.

CONCLUSION

Rapid Evidence Mapping is an expeditious approach based on rigorous methodology that can be used to quickly summarize the available body of evidence relevant to a research question, identify gaps in the literature to inform future research, and contextualize the design of a systematic review within the broader scientific literature, significantly reducing human effort while yielding results comparable to those from traditional methods. The potential time savings of this approach in comparison to the traditional evidence mapping process make it a potentially powerful tool for rapidly translating knowledge to inform science-based decision-making.

Qualitative evidence synthesis for complex interventions and guideline development: clarification of the purpose, designs and relevant methods

This paper is one of a series exploring the implications of complexity for systematic reviews and guideline development, commissioned by the WHO. The paper specifically explores the role of qualitative evidence synthesis. Qualitative evidence synthesis is the broad term for the group of methods used to undertake systematic reviews of qualitative research evidence. As an approach, qualitative evidence synthesis is increasingly recognised as having a key role to play in addressing questions relating to intervention or system complexity, and guideline development processes. This is due to the unique role qualitative research can play in establishing the relative importance of outcomes, the acceptability, fidelity and reach of interventions, their feasibility in different settings and potential consequences on equity across populations. This paper outlines the purpose of qualitative evidence synthesis, provides detail of how qualitative evidence syntheses can help establish understanding and explanation of the complexity that can occur in relation to both interventions and systems, and how qualitative evidence syntheses can contribute to evidence to decision frameworks. It provides guidance for the choice of qualitative evidence synthesis methods in the context of guideline development for complex interventions, giving 'real life' examples of where this has occurred. Information to support decision-making around choice qualitative evidence synthesis methods in the context of guideline development is provided. Approaches for reporting qualitative evidence syntheses are discussed alongside mechanisms for assessing confidence in the findings of a review.

Harnessing Energies, Resolving Tensions: Acknowledging a Dual Heritage for Qualitative Evidence Synthesis

Qualitative evidence synthesis (QES) encompasses more than 20 methods for synthesizing qualitative accounts of research phenomena documenting real-life contexts. However, tensions frequently arise from the different heritages that shape QES methodology: namely, systematic reviews of effectiveness and primary qualitative research. Methodological innovations either derive from each heritage or are stimulated when both are in juxtaposition; it is important to broker a rapprochement. This article draws on practical experience from a range of syntheses and methodological development work conducted with the Cochrane Qualitative and Implementation Methods Group. The legacy of both heritages is briefly characterized. Three stages of the QES process offer exemplars: searching/sampling, quality assessment, and data synthesis. Rather than an antagonistic clash of research paradigms, this dual heritage offers an opportunity to harness the collective energies of both paradigms. Future methodological research is needed to identify further applications by which this dual heritage might be optimally harnessed.

What's Needed to Develop Strategic Purchasing in Healthcare? Policy Lessons from a Realist Review

BACKGROUND

In the context of serious concerns over the affordability of healthcare, various authors and international policy bodies advise that strategic purchasing is a key means of improving health system performance. Such advice is typically informed by theories from the economics of organization (EOO). This paper proposes that these theories are insufficient for a full understanding of strategic purchasing in healthcare, because they focus on safeguarding against poor performance and ignore the coordination and adaptation needed to improve performance. We suggest that insights from other, complementary theories are needed.

METHODS

A realist review method was adopted involving 3 steps: first, drawing upon complementary theories from the EOO and inter-organizational relationships (IOR) perspectives, a theoretical interpretation framework was developed to guide the review; second, a purposive search of scholarly databases to find relevant literature addressing healthcare purchasing; and third, qualitative analysis of the selected texts and thematic synthesis of the results focusing on lessons relevant to 3 key policy objectives taken from the international health policy literature. Texts were included if they provided relevant empirical data and met specified standards of rigour and robustness.

RESULTS

A total of 58 texts were included in the final analysis. Lessons for patient empowerment included: the need for clearly defined rights for patients and responsibilities for purchasers, and for these to be enacted through regular patientpurchaser interaction. Lessons for government stewardship included: the need for health strategy to contain specific targets to incentivise purchasers to align with national policy objectives, and for national government actors to build close, trusting relationships with purchasers to facilitate access to local knowledge about needs and priorities. Lessons for provider performance included: provider decision autonomy may drive innovation and efficient resource use, but may also create scope for opportunism, and interdependence likely to be the best power structure to incentivise collaboration needed to drive performance improvement.

CONCLUSION

Using complementary theories suggests a range of general policy lessons for strategic purchasing in healthcare, but further empirical work is needed to explore how far these lessons are a practically useful guide to policy in a variety of healthcare systems, country settings and purchasing process phases.