Systematic reviews: the good, the bad, and the ugly

Genetics of Exercise and Diet-Induced Fat Loss Efficiency: A Systematic Review

Physical exercise and dieting are well-known and effective methods for fat loss and improving cardiovascular health. However, different individuals often react differently to the same exercise regimen or dietary plan. While specific individuals may undergo substantial fat loss, others may observe only limited effects. A wide range of inter-individual variability in weight gain and changes in body composition induced by physical exercises and diets led to an investigation into the genetic factors that may contribute to the individual variations in such responses. This systematic review aimed at identifying the genetic markers associated with fat loss resulting from diet or exercise. A search of the current literature was performed using the PubMed database. Forty-seven articles met the inclusion criteria when assessing genetic markers associated with weight loss efficiency in response to different types of exercises and diets. Overall, we identified 30 genetic markers of fat-loss efficiency in response to different kinds of diets and 24 in response to exercise. Most studies (n = 46) used the candidate gene approach. We should aspire to the customized selection of exercise and dietary plans for each individual to prevent and treat obesity.

Toll-like receptor 9 (-1237 T/C, -1486 T/C) and the risk of gastric cancer: a meta-analysis of genetic association studies

BACKGROUND

Gastric cancer has a complex aetiology including genetic factors. Individual case-control studies of toll like receptor (TLR) 9 (-1237 T/C, -1486 T/C) polymorphisms in the gastric cancer risk were available, and they showed variation in the findings. Therefore, we performed a meta-analysis to synthesize the evidence on the association between polymorphisms of TLR 9 (-1237 T/C, -1486 T/C) and the risk of gastric cancer using data from eligible studies.

METHODS

This study followed the PRISMA 2020 Checklist. Studies were searched in health-related databases. The methodological quality of studies was evaluated with the use of Newcastle-Ottawa Scale criteria. The summary odds ratio (OR) and its 95% confidence interval (CI) were used to determine the strength of association between each polymorphism and the risk of gastric cancer using five genetic models. Stratification was done by ethnic groups. For the robustness of the analysis, a leave-one-out meta-analysis was performed.

RESULTS

Eight case-control studies with 3,644 participants (1914 cases, 1730 controls) were conducted across six countries. Half of the studies were conducted in China. In the NOS methodological quality assessment, only three studies received a high-quality rating (i.e., a score of ≥ 7). TLR 9 (-1486 T/C) polymorphism and the risk of gastric cancer were assessed in six studies, four of Asian ethnicity and two of non-Asian. Under the dominant model, only in the Asian ethnic group showed a marginally and significantly increased risk of gastric cancer (overall: OR = 1.22, 95%CI = 0.90-1.67, I2 = 56%; Asian: OR = 1.24, 95%CI = 1.00-1.54, I2 = 0%, non-Asian: OR = 1.25, 95%CI = 0.38-4.09, I2 = 89%). Under the recessive model in the absence of heterogeneity, only the Asian group had a significantly higher risk of developing gastric cancer (overall: OR = 1.4, 95% CI = 0.74-2.64, I2 = 85%; Asian: OR: 1.41, 95% CI = 1.07-1.86, I2 = 0%, non-Asian: OR = 1.18, 95% CI = 0.12-11.76, I2 = 97%). Under the heterozygous model, there was no significant association with the risk of gastric cancer overall or among any ethnic subgroup. Under the homozygous model in the absence of heterogeneity, only the Asian group had a significantly higher risk of gastric cancer (overall, OR = 1.47, 95% CI = 0.76-2.86, I2 = 82%; Asian: OR = 1.54, 95% CI = 1.13-2.1, I2 = 0%; non-Asian: OR = 1.19, 95% CI = 0.1-14.33, I2 = 96%). Under the allele model, a significantly increased risk of gastric cancer was observed only in the Asian group (overall: OR = 1.23, 95% CI = 0.89-1.71, I2 = 84%; Asian: OR = 1.22, 95% CI = 1.05-1.41, I2 = 0%; non-Asian: OR = 1.24, 95% CI = 0.34-4.59, I2 = 97%). Four studies investigated the association between TLR 9 (-1237 T/C) polymorphism and the risk of developing gastric cancer. Under any of the five genetic models, there was no association between TLR 9 (-1237 T/C) and the development of gastric cancer in overall or in any ethnic subgroup. Sensitivity analysis revealed that the effect was unstable. With a small number of studies with a small number of participants, we addressed the issue of insufficient power for drawing conclusions.

CONCLUSIONS

The findings suggested that TLR9 (-1486 T/C) may play a role in the risk of gastric cancer specific to the Asian ethnic group. To substantiate the findings on the association between these two polymorphisms (TLR9 -1237 T/C, -1486 T/C) and the risk of gastric cancer, future well-designed case-control studies with a sufficient number of participants in multi-ethnic groups are recommended.

Scan-Associated Distress in People Affected by Cancer: A Qualitative Systematic Review

OBJECTIVE

The term "scanxiety" has been coined to describe the anxiety commonly associated with individuals undergoing cancer-related imaging. Despite the prevalence and severity of scanxiety across various clinical and demographic populations, there remains a significant lack of qualitative insights from existing studies that effectively capture patients' experiences of scanxiety in their own words. Therefore, this review addresses the following research question: What are the experiences of scanxiety distress among people affected by cancer across the cancer care continuum?

DATA SOURCES

Following the PRISMA methodology, a meta-aggregation of qualitative studies was performed, encompassing patients of all age groups who had been diagnosed with cancer or were indicated for a cancer-related scan. Of the 556 articles screened, 15 were deemed eligible for inclusion in the analysis.

CONCLUSION

The three overarching themes of 1) experience of "scan-itis," 2) experience of "patient-clinician support," and 3) development of self-management strategies reveal the complex and interconnected factors that influence scanxiety in individuals undergoing cancer-related imaging. These findings emphasized distress experienced by patients during the waiting period for scan results, the act of viewing the results, and even the delivery of "bad" news. Consequently, patients expressed a strong desire for increased information, communication, and empathy from attending healthcare providers. Patients also report a myriad of self-coping strategies to manage their scanxiety well before, during, and after their scan appointment.

IMPLICATIONS FOR NURSING PRACTICE

The study highlights the need for targeted interventions for those undergoing cancer-related scans, including increased awareness and education for health professionals regarding scanxiety.

Novel Insights into the Physiology of Nutrient Sensing and Gut-Brain Communication in Surgical and Experimental Obesity Therapy

Despite standardized surgical technique and peri-operative care, metabolic outcomes of bariatric surgery are not uniform. Adaptive changes in brain function may play a crucial role in achieving optimal postbariatric weight loss. This review follows the anatomic-physiologic structure of the postbariatric nutrient-gut-brain communication chain through its key stations and provides a concise summary of recent findings in bariatric physiology, with a special focus on the composition of the intestinal milieu, intestinal nutrient sensing, vagal nerve-mediated gastrointestinal satiation signals, circulating hormones and nutrients, as well as descending neural signals from the forebrain. The results of interventional studies using brain or vagal nerve stimulation to induce weight loss are also summarized. Ultimately, suggestions are made for future diagnostic and therapeutic research for the treatment of obesity.

Genetics and athletic performance: a systematic SWOT analysis of non-systematic reviews

Exercise genetics/genomics is a growing research discipline comprising several Strengths and Opportunities but also deals with Weaknesses and Threats. This "systematic SWOT overview of non-systematic reviews" (sSWOT) aimed to identify the Strengths, Weaknesses, Opportunities, and Threats linked to exercise genetics/genomics. A systematic search was conducted in the Medline and Embase databases for non-systematic reviews to provide a comprehensive overview of the current literature/research area. The extracted data was thematically analyzed, coded, and categorized into SWOT clusters. In the 45 included reviews five Strengths, nine Weaknesses, six Opportunities, and three Threats were identified. The cluster of Strengths included "advances in technology", "empirical evidence", "growing research discipline", the "establishment of consortia", and the "acceptance/accessibility of genetic testing". The Weaknesses were linked to a "low research quality", the "complexity of exercise-related traits", "low generalizability", "high costs", "genotype scores", "reporting bias", "invasive methods", "research progress", and "causality". The Opportunities comprised of "precision exercise", "omics", "multicenter studies", as well as "genetic testing" as "commercial"-, "screening"-, and "anti-doping" detection tool. The Threats were related to "ethical issues", "direct-to-consumer genetic testing companies", and "gene doping". This overview of the present state of the art research in sport genetics/genomics indicates a field with great potential, while also drawing attention to the necessity for additional advancement in methodological and ethical guidance to mitigate the recognized Weaknesses and Threats. The recognized Strengths and Opportunities substantiate the capability of genetics/genomics to make significant contributions to the performance and wellbeing of athletes.

Agreement of clinical assessment of burn size and burn depth between referring hospitals and burn centres: A systematic review

BACKGROUND

The quality of burn care is highly dependent on the initial assessment and care. The aim of this systematic review was to investigate the agreement of clinical assessment of burn depth and %TBSA between the referring units and the receiving burn centres.

METHODS

Included articles had to meet criteria defined in a PICO (patients, interventions, comparisons, outcomes). Relevant databases were searched using a predetermined search string (November 6th 2021). Data were extracted in a standardised fashion. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach for test accuracy was used to assess the certainty of evidence. The QUADAS-2 tool was used to assess the risk of bias of individual studies as 'high', 'low' or 'unclear'.

RESULTS

A total of 412 abstracts were retrieved and of these 28 studies with a total of 6461 patients were included, all reporting %TBSA and one burn depth. All studies were cross-sectional and most of them comprising retrospectively enrolled consecutive cohort. All studies showed a low agreement between %TBSA calculations made at referring units and at burn centres. Most studies directly comparing estimations of %TBSA at referring institutions and burn centers showed a proportion of overestimations of 50% or higher. The study of burn depth showed that 55% were equal to the estimates from the burn centre. Most studies had severe study limitations and the risk of imprecision was high. The overall certainty of evidence for accuracy of clinical estimations in referring centres is low (GRADE ⊕⊕ОО) for %TBSA and very low (GRADE ⊕ООО) for burn depth and resuscitation.

CONCLUSION

Overestimation of %TBSA at referring hospitals occurs very frequently. The overall certainty of evidence for accuracy of clinical estimations in referring centres is low for burn size and very low for burn depth. The findings suggest that the burn community has a significant challenge in educating and communicating better with our colleagues at referring institutions and that high-quality studies are needed.

Tissue Engineering Supporting Regenerative Strategies to Enhance Clinical Orthodontics and Dentofacial Orthopaedics: A Scoping, Perspective Review

The personalized regenerative therapeutic strategies applicable in the structural and functional repair of maxillofacial/dental defects are expected to extend beyond the limits of what is currently possible in the management of dentofacial anomalies and treating malocclusions. The application of undifferentiated stem cells (SCs), including signaling molecule control and individualized tissue engineering based on targeted therapies, has been proposed to overcome therapeutic limitations and complications associated with treatments for craniofacial defects, including severe orthodontic discrepancies. This scoping, prospective review discusses comprehensively the current knowledge and prospects for improving clinical outcomes by the application of novel cell-required and cell-free regenerative strategies in biomedicine. The existing evidence, although scant, suggests that patients receiving an orthodontic treatment could benefit from precise tissue augmentation, allowing enhancement of tooth movement generated by orthognathic forces; faster, more predictable alignment of dental arches; optimal management of periodontal complications; and prevention of external root resorption. Ultimately, enriching orofacial tissues and “customizing” the repair of congenital/acquired defects in the craniofacial region can be vastly enhanced to provide a positive therapeutic outcome and improve patients’ quality of life.

The psycho-social impact of obstetric fistula and available support for women residing in Nigeria: a systematic review

BACKGROUND

Obstetric fistula continues to affect the social and mental wellbeing of women living in Nigeria giving rise to poor maternal health outcome. While the World Health Organisation (WHO) has recommended the introduction of psycho-social interventions in the management of obstetric fistula women, psycho-social support for women living with obstetric fistula in Nigeria, are limited. This systematic review aimed to synthesise the psycho-social impact of obstetric fistula on women living in Nigeria as well as the available psycho-social support for these affected women.

METHODS

Following a keyword strategy, Medline, CINAHL, Google scholar, ScienceDirect, Cochrane library, PsychINFO, AMED, British Nursing database, Pubmed central, TRIP database, UK Pubmed central, socINDEX, Annual reviews, ISI Web of Science, Academic search complete, Credo reference, Sage premier and Scopus databases were searched alongside hand searching of articles. The inclusion criteria were set as articles published between 2000 and 2020, on the psychosocial consequences of obstetric fistula in Nigeria. The Critical Appraisal Skills Program (CASP) tool was used to appraise the quality of the included studies. The data was extracted and then analysed using narrative synthesis.

RESULTS

620 relevant citations were identified, and 8 studies were included. Women with obstetric fistula, living in Nigeria were found to be ostracised, abandoned by families and friends, stigmatised and discriminated against, which led to depression, loneliness, loss of self-esteem, self-worth and identity. Psycho-social interventions for women who experienced obstetric fistula are not widely available.

CONCLUSION

There is a need for the introduction of more rehabilitation and reintegration programs across the country. The psychosocial effect of obstetric fistula is significant and should be considered when developing interventions. Further, more research is needed to evaluate the sustainability of psychosocial interventions in Nigeria.

Methodological appraisal of the evidence about efficacy of metabolic surgery in adults with non-morbid obesity and hypertension: An overview of systematic reviews

BACKGROUND

Nowadays, the high morbimortality of obesity is mainly related to diabetes, cancer, and hypertension. It is reported that obesity in patients with hypertension can lead to resistance to pressure reduction through pharmacological therapy and lifestyle changes, so bariatric surgery emerges as a proposed treatment for obesity.

METHODS

We performed an umbrella review that included systematic reviews of clinical trials that evaluated patients with hypertension and non-morbid obesity. The quality and certainty of the evidence was evaluated with the AMSTAR-II and GRADE tools.

RESULTS

677 systematic reviews were identified, of which only three were included for analysis. We considered the outcomes addressed by the reviews on hypertension, identifying that 5 RCTs evaluated pressure reduction at 1 year of follow-up and 5 RCTs at more than 1 year, 5 RCTs evaluated hypertension rate, 6 RCTs analyzed changes in systolic pressure and 5 RCTs changes in diastolic pressure. Likewise, when assessing the methodological quality, it was concluded that the three reviews have critically low quality.

CONCLUSIONS

We found only three systematic reviews that evaluated the topic with critically low methodological quality. They reported results in favor of metabolic surgery, but with very low certainty of evidence.

Using COVID-19 Pandemic as a Prism: A Systematic Review of Methodological Approaches and the Quality of Empirical Studies on Physical Activity Behavior Change

Background

The COVID-19 pandemic has highlighted the importance of scientific endeavors. The goal of this systematic review is to evaluate the quality of the research on physical activity (PA) behavior change and its potential to contribute to policy-making processes in the early days of COVID-19 related restrictions.

Methods

We conducted a systematic review of methodological quality of current research according to PRISMA guidelines using Pubmed and Web of Science, of articles on PA behavior change that were published within 365 days after COVID-19 was declared a pandemic by the World Health Organization (WHO). Items from the JBI checklist and the AXIS tool were used for additional risk of bias assessment. Evidence mapping is used for better visualization of the main results. Conclusions about the significance of published articles are based on hypotheses on PA behavior change in the light of the COVID-19 pandemic.

Results

Among the 1,903 identified articles, there were 36% opinion pieces, 53% empirical studies, and 9% reviews. Of the 332 studies included in the systematic review, 213 used self-report measures to recollect prepandemic behavior in often small convenience samples. Most focused changes in PA volume, whereas changes in PA types were rarely measured. The majority had methodological reporting flaws. Few had very large samples with objective measures using repeated measure design (pre and during the pandemic). In addition to the expected decline in PA duration, these studies show that many of those who were active prepandemic, continued to be active during the pandemic.

Conclusions

Research responded quickly at the onset of the pandemic. However, most of the studies lacked robust methodology, and PA behavior change data lacked the accuracy needed to guide policy makers. To improve the field, we propose the implementation of longitudinal cohort studies by larger organizations such as WHO to ease access to data on PA behavior, and suggest those institutions set clear standards for this research. Researchers need to ensure a better fit between the measurement method and the construct being measured, and use both objective and subjective measures where appropriate to complement each other and provide a comprehensive picture of PA behavior.

Incentives for Palm Oil Smallholders in Mandatory Certification in Indonesia

The Indonesian Sustainable Palm Oil (ISPO) is a mandatory certification for palm oil plantations based on compliance with Indonesia’s regulations. Its implementation has been slow, particularly for independent smallholders that face problems of complicated requirements, limited capacity, and limited funding. Meanwhile, limited incentives are in place, either in the form of premium prices, ease of regulation, or funding. This article aims to elaborate on the role of incentives and their options in supporting the acceleration of ISPO implementation to ensure and improve the market access of smallholders. It identifies ways to develop incentives to facilitate the acceleration of ISPO certification and alternative financing sources available to support this. The method of this research is based on qualitative methodology using a literature review, policy document analysis, and in-depth interviews with informants from the government and smallholders. The analysis of this article shows that incentives are needed in the form of funding, regulatory measures, technical assistance, promotion, and rewards for good practices to provide better facilitation and financial support for the regulatory compliance in the legal, managerial and financial aspects of the ISPO. These incentives target government and smallholders. Implications for enabling these incentives include the improvement of government coordination, improved understanding of challenges faced by smallholders, and adoption of innovative approaches to manage financial resources, which are crucial to facilitate smallholders’ capacity and organizational improvement.

Urinary Malondialdehyde (MDA) Concentrations in the General Population—A Systematic Literature Review and Meta-Analysis

Oxidative stress has been associated with various inflammation-related human diseases. It is defined as an imbalance between the production and elimination of reactive oxygen species (ROS). ROS can oxidize proteins, lipids, and DNA, and some of these oxidized products are excreted in urine, such as malondialdehyde (MDA), which is considered a biomarker for oxidative damage of lipids. To interpret changes of this biomarker as a measure of oxidative species overproduction in humans, a background range for urinary MDA concentration in the general population is needed. We sought to establish urinary MDA concentration ranges for healthy adult populations based on reported values in the available scientific literature. We conducted a systematic review and meta-analysis using the standardized protocol registered in PROSPERO (CRD42020146623). EMBASE, PubMed, Web of Science, and Cochrane library databases were searched from journal inception up to October 2020. We included 35 studies (divided into 47 subgroups for the quantitative analysis). Only studies that measured creatinine-corrected urinary MDA with high-performance liquid chromatography (HPLC) with mass spectrometry (MS), fluorescence detection, or UV photometry were included. The geometric mean (GM) of urinary MDA concentration was 0.10 mg/g creatinine and 95% percentile confidence interval (CI) 0.07–0.12. Age, geographical location but not sex, and smoking status had a significant effect on urinary MDA concentrations. There was a significant increasing trend of urinary MDA concentrations with age. These urinary MDA values should be considered preliminary, as they are based on mostly moderate to some low-quality evidence studies. Although urinary MDA can reliably reflect excessive oxidative stress in a population, the influence of physiological parameters that affect its meaning needs to be addressed as well as harmonizing the chemical analytical methods.

Methodological approaches for developing and reporting living evidence synthesis: a study protocol

Background: Living evidence (LE) refers to the methodological processes that permit new research findings to be continually incorporated into evidence synthesis. This approach is of great value in the resolution of relevant and rapidly changing clinical questions. To date, the methods to carry out this type of synthesis are not completely defined, and great variability is observed in the approaches used by different groups of authors. Objective: To identify, evaluate and summarise the current methods used for living evidence synthesis Methods: We will conduct a methodological study based on a systematic literature search to identify any type of evidence synthesis such as systematic reviews, network metanalyses and overviews that used "living evidence synthesis" as part of their methods. The search will be conducted in Medline (via PubMed) and Epistemonikos databases. Additionally, we will search websites of the organisations publishing any living evidence synthesis retrieved in the two databases, in order to identify unpublished subsequent reports. Two reviewers will independently assess each article against the selection criteria, extract data on methods and procedures, and assess the methodological quality of each publication. Data will be analysed descriptively.

A critical analysis of research methods and experimental models to study tooth discolouration from endodontic materials

As a range of materials used in endodontics may cause tooth discolouration, exploration of factors responsible for the darkening of the tooth crown or root is warranted. This narrative review paper discusses the range of technical factors that apply in laboratory studies that assess endodontic discolouration. As an example of how these factors operate, particular examples relating to discolouration caused by endodontic medicaments containing tetracycline antibiotics are used. Following the PRILE 2021 guidelines approach, a summary of key variables to be addressed in the methodology for laboratory studies is presented, to inform future work.

Hospitality Industry 4.0 and Climate Change

This paper investigates under which conditions implementation of Industry 4.0 in the hospitality sector could help to combat climate change. The paper takes the form of a systematic literature review to examine the main pillars of Industry 4.0 in the hospitality industry and discuss how these technologies could help combat climate change. We propose five conditions under which Industry 4.0 could help to combat climate change. First, in the hospitality industry, increased use of Industry 4.0 technologies induces an increase in energy efficiency and a reduction of GHG. Second, increased use of Industry 4.0 technologies induces a reduction in water consumption and an increase in water use efficiency. Third, increased use of Industry 4.0 technologies induces a reduction in food waste. Fourth, increased use of Industry 4.0 technologies can promote Circular Hospitality 4.0. Fifth, increased use of Industry 4.0 technologies helps to reduce transport and travel. Hospitality Industry 4.0 technologies offer new opportunities for enhancing sustainable development and reducing GHG emissions through the use of environmentally friendly approaches to achieve the Paris Agreement objectives.

Prophylactic central neck dissection for well-differentiated thyroid carcinoma: results and methodological assessment of systematic reviews

OBJECTIVE

The aim was to assess the methodological quality of systematic reviews evaluating the effectivness of prophylactic central neck dissection plus thyroidectomy to decrease locoregional recurrence in patients with thyroid carcinoma.

INTRODUCTION

Many systematic reviews have been published concerning prophylactic central neck dissection in well-differentiated thyroid carcinoma, finding inconsistent results regarding the risk of locoregional recurrence. Because systematic reviews are considered the best source on which to base clinical decisions, the assessment of methodological quality is important.

INCLUSION CRITERIA

This paper included studies that mentioned that a systematic review was performed in adult patients with confirmed diagnosis of well-differentiated thyroid carcinoma without evidence of nodal metastatic disease who underwent total thyroidectomy. Reviews evaluated prophylactic central neck dissection compared with no neck diessection for decreasing locoregional recurrence.

METHODS

A systematic search was performed using MEDLINE, Embase, the Cochrane Database of Systematic Reviews, LILACS, Web of Science, CNKI, and Google Scholar. PROSPERO was searched for unpublished studies and gray literature. Data regarding the study characteristics, patient types, numbers of patients, and locoregional recurrence by group were extracted. Methodological characteristics, type of statistical analysis and summary estimator, heterogeneity, and publication bias were recorded. The methodological quality was measured using the AMSTAR 2 tool.

RESULTS

The search identified 12 systematic reviews. Only four systematic reviews reported adherence to methodological guidelines. The AMSTAR 2 critical criteria classified all the studies as critically low quality. The pooled risk difference for locoregional recurrence varied among studies from -5% to 0%. Most of the studies were published in high-impact journals.

CONCLUSIONS

The published systematic reviews that assessed prophylactic central neck dissection as an intervention to decrease the rate of locoregional recurrence have a critically low methodological quality. The results and recommendations based on these studies should be used with caution. The evaluation of methodological quality by peer reviewers must be improved.

Storm Clouds on the Horizon: On the Emerging Need to Tighten Selection Policies

Athlete selection is fundamental in elite sport, occurring regularly throughout an athlete's development. Research in this area reveals the accuracy of these decisions is questionable in even the most elite sport environments and athletes are increasingly disputing these decisions as unfair and punitive. As a countermeasure to these dispute and arbitration practices, many elite sport systems have created policies where coaches must outline and stand behind the criteria used for their selection decisions. Selection criteria policies have the potential to help encourage fair selection practices by holding selectors accountable to their selection criteria, but their implementation also has the potential to wrongfully nudge selectors toward developing more defendable, but less-accurate selection practices. The paper concludes with 10 suggestions to help support practitioners when implementing selection criteria.

A comparison of systematic reviews and guideline-based systematic reviews in medical studies

The question of how citation impact relates to academic quality accompanies every decade in bibliometric research. Although experts have employed more complex conceptions of research quality for responsible evaluation, detailed analyses of how impact relates to dimensions such as methodological rigor are lacking. But the increasing number of formal guidelines for biomedical research offer not only the potential to understand the social dynamics of standardization, but also their relations to scientific rewards. By using data from Web of Science and PubMed, this study focuses on systematic reviews from biomedicine and compares this genre with those systematic reviews that applied the PRISMA reporting standard. Besides providing an overview about growth and location, it was found that the latter, more standardized type of systematic review accumulates more citations. It is argued that instead of reinforcing the traditional conception that higher impact represents higher quality, highly prolific authors could be more inclined to develop and apply new standards than more average researchers. In addition, research evaluation would benefit from a more nuanced conception of scientific output which respects the intellectual role of various document types.

A Critical Systematic Review of Current Evidence on the Effects of Physical Exercise on Whole/Regional Grey Matter Brain Volume in Populations at Risk of Neurodegeneration

BACKGROUND

Despite the intriguing potential of physical exercise being able to preserve or even restore brain volume (grey matter volume in particular)-a tissue essential for both cognitive and physical function-no reviews have so far synthesized the existing knowledge from randomized controlled trials investigating exercise-induced changes of the brain's grey matter volume in populations at risk of neurodegeneration. Our objective was to critically review the existing evidence regarding this topic.

METHODS

A systematic search was carried out in MEDLINE and EMBASE databases primo April 2020, to identify randomized controlled trials evaluating the effects of aerobic training, resistance training or concurrent training on brain grey volume changes (by MRI) in adult clinical or healthy elderly populations.

RESULTS

A total of 20 articles (from 19 RCTs) evaluating 3-12 months of aerobic, resistance, or concurrent training were identified and included, involving a total of 1662 participants (populations: healthy older adults, older adults with mild cognitive impairment or Alzheimer's disease, adults with schizophrenia or multiple sclerosis or major depression). While few studies indicated a positive effect-although modest-of physical exercise on certain regions of brain grey matter volume, the majority of study findings were neutral (i.e., no effects/small effect sizes) and quite divergent across populations. Meta-analyses showed that different exercise modalities failed to elicit any substantial effects on whole brain grey volume and hippocampus volume, although with rather large confidence interval width (i.e., variability).

CONCLUSION

Altogether, the current evidence on the effects of physical exercise on whole/regional grey matter brain volume appear sparse and inconclusive, and does not support that physical exercise is as potent as previously proposed when it comes to affecting brain grey matter volume.

Post-Traumatic Stress Disorder Symptoms Contribute to Worse Pain and Health Outcomes in Veterans With PTSD Compared to Those Without: A Systematic Review With Meta-Analysis

INTRODUCTION

Post-traumatic stress disorder (PTSD) and chronic pain are frequently co-morbid conditions in the U.S. veteran population. Although several theories about the cause of increased pain prevalence in individuals with PTSD have been presented, no synthesis of primary data informing the impact of co-morbid PTSD and pain has been completed. The purpose of this study was to systematically review the literature and quantify disability, function, and pain-related beliefs and outcomes in veterans with PTSD compared to veterans without PTSD.

MATERIALS AND METHODS

A systematic search of three electronic databases was conducted. Inclusion criteria required pain-related comparison of veterans with PTSD to those without PTSD. Primary outcome measures and standardized mean differences (SMDs) were assessed for pain, function, disability, pain beliefs, and healthcare utilization using a random effects model.

RESULTS

20 original research studies met inclusion criteria and were assessed for quality and outcomes of interest. The majority of studies were cross-sectional. Veterans with PTSD and pain demonstrated higher pain (SMD = 0.58, 95% CI 0.28-0.89), disability (SMD = 0.52, 95%CI 0.33-0.71), depression (SMD = 1.40, 95%CI 1.2-1.6), catastrophizing beliefs (SMD = 0.95, 95% CI 0.69-1.2), sleep disturbance (SMD = 0.80, 95% CI 0.57-1.02), and healthcare utilization; they had lower function (SMD = 0.41, 95% CI 0.25-0.56) and pain self-efficacy (SMD = 0.77, 95% CI 0.55-0.99) compared to veterans without PTSD.

CONCLUSION

In veterans with chronic pain, PTSD symptomology has a large effect for many negative health-related outcomes. This review supports the need for clinicians to screen and understand the effects of PTSD symptoms on patients with pain. Clinicians should recognize that veterans with PTSD and pain likely have elevated pain catastrophizing beliefs and decreased self-efficacy that should be targeted for intervention.

Intestinal Microbiota and Perspectives of the Use of Meta-Analysis for Comparison of Ulcerative Colitis Studies

Meta-analysis is a statistical process summarizing comparable data from a number of scientific papers. The use of meta-analysis in microbiology allows decision-making that has an impact on public health policy. It can happen that the primary researches come to different conclusions, although these are targeted with the same research question. It is, therefore, inevitable to have the means to systematically evaluate information and compare research results. Ulcerative colitis together with Crohn's disease are among the two main inflammatory bowel diseases. This chronic disease of the gastrointestinal tract, with an as yet unclear etiology, is presented by an uncontrolled inflammatory immune response in genetically predisposed individuals to as yet undefined environmental factors in interaction with the intestinal microbiota itself. In patients with ulcerative colitis (UC), changes in the composition and relative abundance of microorganisms could be observed. Sulfate-reducing bacteria (SRB), which commonly occur in the large intestine as part of the commensal microbiota of animals and humans involved in the pathogenesis of the disease, have been shown to occur. SRB are anaerobic organisms affecting short-chain fatty acid metabolism. This work outlines the perspectives of the use of meta-analysis for UC and changes in the representation of intestinal organisms in these patients.

A Need for Standardized Reporting: A Scoping Review of Bioretention Research 2000–2019

Bioretention cells are a type of low-impact development technology that, over the past two decades, have become a critical component of urban stormwater management. Research into bioretention has since proliferated, with disparate aims, intents and metrics used to assess the “performance” of bioretention cells. We conducted a comprehensive, systematic scoping review to answer the question of “How is the field performance of bioretention assessed in the literature?”, with the aim of understanding (1) how is the performance of bioretention defined in the literature? (2) what metrics are used to assess actual and theoretical performance? A review of 320 studies (mostly peer reviewed articles) found that performance was defined in terms of hydrologic controls, while investigations into water quality pathways and mechanisms of contaminant transport and fate and the role of vegetation were lacking; additionally, long term field and continuous modelling studies were limited. Bioretention field research was primarily conducted by a small number of institutions (26 institutions were responsible for 50% of the research) located mainly in high income countries, particularly Australia and the United States. We recommend that the research community (I) provide all original data when reporting results, (II) prioritize investigating the processes that determine bioretention performance and (III) standardize the collection, analysis and reporting of results. This dissemination of information will ensure that gaps in bioretention knowledge can be found and allow for improvements to the performance of bioretention cells around the world.

Quality of the Evidence Supporting the Role of Oral Nutritional Supplements in the Management of Malnutrition: An Overview of Systematic Reviews and Meta-Analyses

There is considerable heterogeneity across the findings of systematic reviews of oral nutritional supplement (ONS) interventions, presenting difficulties for healthcare decision-makers and patients alike. It is not known whether heterogeneity arises from differences in patient populations or relates to methodological rigor. This overview aimed to collate and compare findings from systematic reviews of ONSs compared with routine care in adult patients who were malnourished or at risk of malnutrition with any clinical condition and to examine their methodological quality. Three electronic databases were searched to July 2019, supplemented with hand-searching. Data on all outcomes were extracted and review methodological quality assessed using A MeaSurement Tool for Assessment of systematic Reviews (AMSTAR). Twenty-two reviews were included, 11 in groups from mixed clinical backgrounds and 11 in specific clinical conditions. Ninety-one meta-analyses were identified for 12 different outcomes but there was discordance between results. Significant benefits of ONSs were reported in 4 of 4 analyses of energy intake, 7 of 11 analyses of body weight, 7 of 22 analyses of mortality, 10 of 17 analyses of complications (total and infectious), 1 of 3 analyses of muscle strength, 4 of 9 analyses of body composition/nutritional status, 2 of 14 analyses of length of stay, and 2 of 5 analyses of hospital readmissions. Ten reviews were high quality (AMSTAR scores 8-11), 9 moderate (AMSTAR scores 3-8), and 3 poor (AMSTAR scores 0-3). Methodological deficiencies were limitations to searches, poor reporting of heterogeneity, and failure to incorporate quality of evidence into any recommendations. Discordance between reviews was not markedly reduced when only high-quality reviews were considered. Evidence for the effects of ONS in malnourished patients or those who are at risk of malnutrition is uncertain, and discordance in results can arise from differences in clinical background of patients or the etiological basis of malnutrition.

PPARG (Pro12Ala) genetic variant and risk of T2DM: a systematic review and meta-analysis

Type 2 diabetes mellitus (T2DM) is a complex disease caused by the interaction between genetic and environmental factors. A growing number of evidence suggests that the peroxisome proliferator-activated receptor gamma (PPARG) gene plays a major role in T2DM development. Meta-analysis of genetic association studies is an efficient tool to gain a better understanding of multifactorial diseases and potentially to provide valuable insights into gene-disease interactions. The present study was focused on assessing the association between Pro12Ala variation in the PPARG and T2DM risk through a comprehensive meta-analysis. We searched PubMed, WoS, Embase, Scopus and ProQuest from 1990 to 2017. The fixed-effect or random-effect model was used to evaluate the pooled odds ratios (ORs) and 95% confidence intervals (CIs) depending on the heterogeneity among studies. The sources of heterogeneity and publication bias among the included studies were assessed using I² statistics and Egger's tests. A total of 73 studies, involving 62,250 cases and 69,613 controls were included. The results showed that the minor allele (G) of the rs1801282 variant was associated with the decreased risk of T2DM under different genetic models. Moreover, the protective effect of minor allele was detected to be significantly more in some ethnicities including the European (18%), East Asian (20%), and South East Asian (18%). And the reduction of T2DM risk in Ala12 carriers was stronger in individuals from North Europe rather than Central and South Europe. Our findings indicated that the rs1801282 variant may contribute to decrease of T2DM susceptibility in different ancestries.

Reference Ranges of 8-Isoprostane Concentrations in Exhaled Breath Condensate (EBC): A Systematic Review and Meta-Analysis

Isoprostanes are physiopathologic mediators of oxidative stress, resulting in lipid peroxidation. 8-isoprostane seems particularly useful for measuring oxidative stress damage. However, no reference range values are available for 8-isoprosante in exhaled breath condensate (EBC) of healthy adults, enabling its meaningful interpretation as a biomarker. We conducted this systematic review and meta-analysis according to the protocol following PROSPERO (CRD42020146623). After searching and analyzing the literature, we included 86 studies. After their qualitative synthesis and risk of bias assessment, 52 studies were included in meta-analysis. The latter focused on studies using immunological analytical methods and investigated how the concentrations of 8-isoprostane differ based on gender. We found that gender had no significant effect in 8-isoprostane concentration. Among other studied factors, such as individual characteristics and factors related to EBC collection, only the device used for EBC collection significantly affected measured 8-isoprostane concentrations. However, adjustment for the factors related to EBC collection, yielded uncertainty whether this effect is due to the device itself or to the other factors. Given this uncertainty, we estimated the reference range values of 8-isoprostane stratified by gender and EBC collection device. A better standardization of EBC collection seems necessary; as well more studies using chemical analytical methods to extend this investigation.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence amongst medical students and residents? A systematic review and meta-analysis

OBJECTIVES

It remains unclear whether computer-assisted instruction (CAI) is more effective than other teaching methods in acquiring and retaining ECG competence among medical students and residents.

DESIGN

This systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

DATA SOURCES

Electronic literature searches of PubMed, databases via EBSCOhost, Scopus, Web of Science, Google Scholar and grey literature were conducted on 28 November 2017. We subsequently reviewed the citation indexes for articles identified by the search.

ELIGIBILITY CRITERIA

Studies were included if a comparative research design was used to evaluate the efficacy of CAI versus other methods of ECG instruction, as determined by the acquisition and/or retention of ECG competence of medical students and/or residents.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently extracted data from all eligible studies and assessed the risk of bias. After duplicates were removed, 559 papers were screened. Thirteen studies met the eligibility criteria. Eight studies reported sufficient data to be included in the meta-analysis.

RESULTS

In all studies, CAI was compared with face-to-face ECG instruction. There was a wide range of computer-assisted and face-to-face teaching methods. Overall, the meta-analysis found no significant difference in acquired ECG competence between those who received computer-assisted or face-to-face instruction. However, subanalyses showed that CAI in a blended learning context was better than face-to-face teaching alone, especially if trainees had unlimited access to teaching materials and/or deliberate practice with feedback. There was no conclusive evidence that CAI was better than face-to-face teaching for longer-term retention of ECG competence.

CONCLUSION

CAI was not better than face-to-face ECG teaching. However, this meta-analysis was constrained by significant heterogeneity amongst studies. Nevertheless, the finding that blended learning is more effective than face-to-face ECG teaching is important in the era of increased implementation of e-learning.

PROSPERO REGISTRATION NUMBER

CRD42017067054.

Methodological steps used by authors of systematic reviews and meta-analyses of clinical trials: a cross-sectional study

Background

The quality of systematic reviews and meta-analyses (SR/MAs) depends on the extent of the methods used. We investigated the methodological steps used by authors of SR/MAs of clinical trials via an author survey.

Methods

We conducted an email-based cross-sectional study by contacting corresponding authors of SR/MAs that were published in 2015 and 2016 and retrieved through the PubMed database. The 27-item questionnaire was developed to study the methodological steps used by authors when conducting a SR/MA and the demographic characteristics of the respondent. Besides the demographic characteristics, methodological questions regarding the source, extraction and synthesis of data were included.

Results

From 10,292 emails sent, 384 authors responded and were included in the final analysis. Manual searches were carried out by 69.2% of authors, while 87.3% do updated searches, 49.2% search grey literature, 74.9% use the Cochrane tool for risk of bias assessment, 69.8% assign more than two reviewers for data extraction, 20.5% use digital software to extract data from graphs, 57.9% use raw data in the meta-analysis, and 43.8% meta-analyze both adjusted and non-adjusted data. There was a positive correlation of years of experience in conducting of SR/MAs with both searching grey literature (P = 0.0003) and use of adjusted and non-adjusted data (P = 0.006).

Conclusions

Many authors still do not carry out many of the vital methodological steps to be taken when performing any SR/MA. The experience of the authors in SR/MAs is highly correlated with use of the recommended tips for SR/MA conduct. The optimal methodological approach for researchers conducting a SR/MA should be standardized.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0780-2) contains supplementary material, which is available to authorized users.

Methodological Quality of Systematic Reviews of Intraoperative Neuromonitoring in Thyroidectomy: A Systematic Review

Importance

Systematic reviews and meta-analyses are considered the best evidence for clinical decision making. Many reviews of intraoperative neuromonitoring (IONM) in thyroidectomy have conflicting results, owing in large part to methodological quality.

Objective

To assess the methodological quality and the causes of heterogeneous results of systematic reviews that compare routine IONM vs visual identification of the recurrent laryngeal nerve (RLN) in patients undergoing thyroidectomy.

Data Sources

A systematic search was performed of MEDLINE (PubMed), Embase, the Cochrane Library, LILACS (Literatura Latino Americana e do Caribe em Ciências da Saúde), Web of Science, and Google from January 1, 1968, through June 30, 2018. Data were analyzed from July 17 to November 30, 2018.

Study Selection

Studies that mentioned performance of a systematic review/meta-analysis during the search period.

Data Extraction and Synthesis

Data including study characteristics, type of patients, numbers of nerves at risk, and temporary and definitive RLN paralysis by group were extracted. Data about methodological characteristics, type of statistical analysis and summary estimator, endorsement of systematic review/meta-analysis guidelines, heterogeneity, publication bias, funding, conflict of interest, and statistical analysis were also recorded. The methodological quality was measured with the AMSTAR2 (A Measurement Tool to Assess Systematic Reviews) tool by 2 independent evaluators.

Main Outcomes and Measures

Methodological quality.

Results

The search identified 13 systematic reviews that included patients who underwent open or minimally invasive thyroidectomy, second operations, and a mixture of low- and high-risk procedures. The mean compliance with the AMSTAR2 overall criteria was 53% (range, 11%-83%); with critical criteria, 71% (range, 50%-94%). The percentage of nerves at risk from RCTs was 4.8%. The mean (SD) crude rate of definitive RLN paralysis was 0.81% (0.22%; median, 0.75% [range, 0.53%-1.30%]) in the monitoring group and 1.14% (0.56%; median, 0.96% [range, 0.57%-2.56%]) in the control group.

Conclusions and Relevance

A substantial number of systematic reviews of IONM in thyroidectomy have conflicting results, but their mean methodological quality is critically low. Design of a systematic review should comply with methodological standards and recommendations to offer relevant and practical information for decision making.

Women's experiences with postpartum anxiety disorders: a narrative literature review

PURPOSE

Postpartum anxiety disorders are common and may have significant consequences for mothers and their children. This review examines the literature on women's experiences with postpartum generalized anxiety disorder (GAD), postpartum panic disorder (PD), obsessive compulsive disorder (OCD), and posttraumatic stress disorder (PTSD).

METHODS

MEDLINE (Ovid), CINAHL, PsycINFO, and reference lists were searched. Qualitative and quantitative studies assessing women's experiences with GAD, postpartum PD, OCD, and PTSD were included. Narrative approach to literature synthesis was used.

RESULTS

Fourteen studies (among 44 articles) met the criteria for review to identify descriptions of women's cognitive, affective, and somatic experiences related to postpartum anxiety disorders. Loss, frustration, and guilt, accompanied by physical symptoms of tension, were some of the experiences identified across studies. Most women suffered from more than one anxiety disorder, in addition to postpartum depression. To date, research has focused on prevalence rates of postpartum anxiety disorders, and evidence about clinical and subclinical symptoms of postpartum anxiety disorders and outcomes on mother and child is lacking. Postpartum anxiety disorders may have negative effects on parenting and child development; however, the nature of the underlying mechanisms is unclear.

CONCLUSION

More robust longitudinal studies are needed to examine the impact of postpartum GAD, PD, OCD, and PTSD symptoms on the mother and the mother-child relationship to develop targets for therapeutic preventative interventions.

A systematic scoping review on the consequences of stress-related hyperglycaemia

Background

Stress-related hyperglycaemia (SHG) is commonly seen in acutely ill patients and has been associated with poor outcomes in many studies performed in different acute care settings. We aimed to review the available evidence describing the associations between SHG and different outcomes in acutely ill patients admitted to an ICU. Study designs, populations, and outcome measures used in observational studies were analysed.

Methods

We conducted a systematic scoping review of observational studies following the Joanna Briggs methodology. Medline, Embase, and the Cochrane Library were searched for publications between January 2000 and December 2015 that reported on SHG and mortality, infection rate, length of stay, time on ventilation, blood transfusions, renal replacement therapy, or acquired weakness.

Results

The search yielded 3,063 articles, of which 43 articles were included (totalling 536,476 patients). Overall, the identified studies were heterogeneous in study conduct, SHG definition, blood glucose measurements and monitoring, treatment protocol, and outcome reporting. The most frequently reported outcomes were mortality (38 studies), ICU and hospital length of stay (23 and 18 studies, respectively), and duration of mechanical ventilation (13 studies). The majority of these studies (40 studies) compared the reported outcomes in patients who experienced SHG with those who did not. Fourteen studies (35.9%) identified an association between hyperglycaemia and increased mortality (odds ratios ranging from 1.13 to 2.76). Five studies identified hyperglycaemia as an independent risk factor for increased infection rates, and one identified it as an independent predictor of increased ICU length of stay.

Discussion

SHG was consistently associated with poor outcomes. However, the wide divergences in the literature mandate standardisation of measuring and monitoring SHG and the creation of a consensus on SHG definition. A better comparability between practices will improve our knowledge on SHG consequences and management.

Systematic Review Methodology for the Fatigue in Emergency Medical Services Project

BACKGROUND

Guidance for managing fatigue in the Emergency Medical Services (EMS) setting is limited. The Fatigue in EMS Project sought to complete multiple systematic reviews guided by seven explicit research questions, assemble the best available evidence, and rate the quality of that evidence for purposes of producing an Evidence Based Guideline (EBG) for fatigue risk management in EMS operations.

METHODS

We completed seven systematic reviews that involved searches of six databases for literature relevant to seven research questions. These questions were developed a priori by an expert panel and framed in the Population, Intervention, Comparison, and Outcome (PICO) format and pre-registered with PROSPERO. Our target population was defined as persons 18 years of age and older classified as EMS personnel or similar shift worker groups. A panel of experts selected outcomes for each PICO question as prescribed by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology. We pooled findings, stratified by study design (experimental vs. observational) and presented results of each systematic review in narrative and quantitative form. We used meta-analyses of select outcomes to generate pooled effects. We used the GRADE methodology and the GRADEpro software to designate a quality of evidence rating for each outcome.

RESULTS

We present the results for each systematic review in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). More than 38,000 records were screened across seven systematic reviews. The median, minimum, and maximum inter-rater agreements (Kappa) between screeners for our seven systematic reviews were 0.66, 0.49, and 0.88, respectively. The median, minimum, and maximum number of records retained for the seven systematic reviews was 13, 1, and 100, respectively. We present key findings in GRADE Evidence Profile Tables in separate publications for each systematic review.

CONCLUSIONS

We describe a protocol for conducting multiple, simultaneous systematic reviews connected to fatigue with the goal of creating an EBG for fatigue risk management in the EMS setting. Our approach may be informative to others challenged with the creation of EBGs that address multiple, inter-related systematic reviews with overlapping outcomes.

Con: Meta-analysis: some key limitations and potential solutions

Meta-analysis, a statistical combination of results of several trials to produce a summary effect, has been subject to criticism in the past, mainly for the reasons of poor quality of included studies, heterogeneity between studies meta-analyzed and failing to address publication bias. These limitations can cause the results to be misleading, which is important if policy and practice decisions are based on systematic reviews and meta-analyses. We elaborate on these limitations and illustrate them with examples from the nephrology literature. Finally, we present some potential solutions, notably, education in meta-analysis for evidence producers and consumers as well as the use of individual patient data for meta-analyses.

Interventional Radiology Clinical Practice Guideline Recommendations for Neurovascular Disorders Are Not Based on High-Quality Systematic Reviews

BACKGROUND

In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception.

PURPOSE

Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology.

DATA SOURCES

Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology.

STUDY SELECTION

We selected 65 systematic reviews and meta-analyses.

DATA ANALYSIS

A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items.

DATA SYNTHESIS

On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%).

LIMITATIONS

We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews.

CONCLUSIONS

The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines.

Trends in published meta-analyses in cancer research, 2008-2013

In order to capture trends in the contribution of epidemiology to cancer research, we describe an online meta-analysis database resource for cancer clinical and population research and illustrate trends and descriptive detail of cancer meta-analyses from 2008 through 2013. A total of 4,686 cancer meta-analyses met our inclusion criteria. During this 6-year period, a fivefold increase was observed in the yearly number of meta-analyses. Fifty-six percent of meta-analyses concerned observational studies, mostly of cancer risk, more than half of which were genetic studies. The major cancer sites were breast, colorectal, and digestive. This online database for Cancer Genomics and Epidemiology Navigator will be continuously updated to allow investigators to quickly navigate the meta-analyses emerging from cancer epidemiology studies and cancer clinical trials.

Expediting evidence synthesis for healthcare decision-making: exploring attitudes and perceptions towards rapid reviews using Q methodology

Background

Rapid reviews expedite the knowledge synthesis process with the goal of providing timely information to healthcare decision-makers who want to use evidence-informed policy and practice approaches. A range of opinions and viewpoints on rapid reviews is thought to exist; however, no research to date has formally captured these views. This paper aims to explore evidence producer and knowledge user attitudes and perceptions towards rapid reviews.

Methods

A Q methodology study was conducted to identify central viewpoints about rapid reviews based on a broad topic discourse. Participants rank-ordered 50 text statements and explained their Q-sort in free-text comments. Individual Q-sorts were analysed using Q-Assessor (statistical method: factor analysis with varimax rotation). Factors, or salient viewpoints on rapid reviews, were identified, interpreted and described.

Results

Analysis of the 11 individual Q sorts identified three prominent viewpoints: Factor A cautions against the use of study design labels to make judgements. Factor B maintains that rapid reviews should be the exception and not the rule. Factor C focuses on the practical needs of the end-user over the review process.

Conclusion

Results show that there are opposing viewpoints on rapid reviews, yet some unity exists. The three factors described offer insight into how and why various stakeholders act as they do and what issues may need to be resolved before increase uptake of the evidence from rapid reviews can be realized in healthcare decision-making environments.

An Innovative, Comprehensive Mapping and Multiscale Analysis of Registered Trials for Stem Cell-Based Regenerative Medicine

We aim to provide an innovative, comprehensive way of mapping the profusion of stem cell-based clinical trials registered at ClinicalTrials.gov to explore the diversity of the fields of application and the temporal complexity of the domain. We used a chord diagram and phylogenetic-like tree visualizations to assist in data mining and knowledge discovery. The search strategy used the following terms: "stromal OR stem OR mesenchymal OR progenitor." The Medical Subject Headings (MeSH) thesaurus was used to more finely classify diseases treated by stem cells, from large fields of application to specific diseases. Of the 5,788 trials screened, 939 were included, 51.1% of which were related to mesenchymal stem cells (MSCs). No real specificity emerged as to the therapeutic uses of the different types of stem cells. More than half the MSC studies concerned allogeneic MSCs and received more support from industry than autologous MSC studies (p < .001). Over time, the uses of cultured cells have increased greatly, particularly since 2009. Cells derived from adipose tissue are also increasingly used in trials compared with bone marrow cells. The use of adipose-derived stromal cells was predominantly autologous (p < .001), restricted to European countries (p < .01), and supported by industry (p = .02) compared with other MSCs. Details about MeSH keywords are available at http://multireview.perso.sfr.fr/. In conclusion, mapping may reveal a lack of global strategy despite the regulations and the related costs associated with good manufacturing practices. A systematic approach to preclinical data, intended to objectively and robustly reveal the most appropriate fields with the most efficient cells, is needed. Repeated exchanges between the bench and the bedside are necessary.

SIGNIFICANCE

Except for a few trials concerning specific tissue stem cells used in their corresponding tissues, this global analysis revealed no real specificity of stem cell uses (including mesenchymal stromal cells). This raised the question of the physiopathological rationale for these uses and the lack of a global strategy despite the regulations and the related costs associated with good manufacturing practices. This original method, leading to the development of new concepts from already available data, would help policymakers to optimize resources and investments in terms of public health priorities. Such an approach should draw parallels between in vitro, in vivo, and human data. Exchanges in both directions between preclinical and clinical research could optimize the parameters of clinical trials step by step.

Evaluation of association studies and meta-analyses of MTHFR gene polymorphisms in colorectal cancer

There is a discrepancy between the results of 89 original studies and 15 meta-analyses investigating the association of MTHFR rs1801133 and rs1801131 polymorphisms with colorectal cancer (CRC) risk. We examined this hypothesis through meta-analyses of both loci and their diplotypes as well as evaluation of previous meta-analyses. The present meta-analysis showed that rs1801133 and rs1801131 might be CRC susceptibility variants in Americans and Australians and rs1801133 in Brazilians and Japanese. A strong linkage disequilibrium was observed between both loci and their diplotypes were associated with CRC risk. Evaluation of 15 meta-analyses showed a high discrepancy among their findings, mainly caused by population stratification of original studies and data analysis strategies in meta-analysis. Population stratification was more dominant in the studies from Australia, America and Brazil leading to false positive or negative results. In conclusion, these loci alone might modify the development of CRC in some ethnicities.

Using MEDLINE Elemental Similarity to Assist in the Article Screening Process for Systematic Reviews

Background

Systematic reviews and their implementation in practice provide high quality evidence for clinical practice but are both time and labor intensive due to the large number of articles. Automatic text classification has proven to be instrumental in identifying relevant articles for systematic reviews. Existing approaches use machine learning model training to generate classification algorithms for the article screening process but have limitations.

Objective

We applied a network approach to assist in the article screening process for systematic reviews using predetermined article relationships (similarity). The article similarity metric is calculated using the MEDLINE elements title (TI), abstract (AB), medical subject heading (MH), author (AU), and publication type (PT). We used an article network to illustrate the concept of article relationships. Using the concept, each article can be modeled as a node in the network and the relationship between 2 articles is modeled as an edge connecting them. The purpose of our study was to use the article relationship to facilitate an interactive article recommendation process.

Methods

We used 15 completed systematic reviews produced by the Drug Effectiveness Review Project and demonstrated the use of article networks to assist article recommendation. We evaluated the predictive performance of MEDLINE elements and compared our approach with existing machine learning model training approaches. The performance was measured by work saved over sampling at 95% recall (WSS95) and the F-measure (F₁). We also used repeated analysis over variance and Hommel’s multiple comparison adjustment to demonstrate statistical evidence.

Results

We found that although there is no significant difference across elements (except AU), TI and AB have better predictive capability in general. Collaborative elements bring performance improvement in both F₁ and WSS95. With our approach, a simple combination of TI+AB+PT could achieve a WSS95 performance of 37%, which is competitive to traditional machine learning model training approaches (23%-41% WSS95).

Conclusions

We demonstrated a new approach to assist in labor intensive systematic reviews. Predictive ability of different elements (both single and composited) was explored. Without using model training approaches, we established a generalizable method that can achieve a competitive performance.

Capturing Public Opinion on Public Health Topics: A Comparison of Experiences from a Systematic Review, Focus Group Study, and Analysis of Online, User-Generated Content

BACKGROUND

Capturing public opinion toward public health topics is important to ensure that services, policy, and research are aligned with the beliefs and priorities of the general public. A number of approaches can be used to capture public opinion.

METHODS

We are conducting a program of work on the effectiveness and acceptability of health promoting financial incentive interventions. We have captured public opinion on financial incentive interventions using three methods: a systematic review, focus group study, and analysis of online user-generated comments to news media reports. In this short editorial-style piece, we compare and contrast our experiences with these three methods.

RESULTS

Each of these methods had their advantages and disadvantages. Advantages include tailoring of the research question for systematic reviews, probing of answers during focus groups, and the ability to aggregate a large data set using online user-generated content. However, disadvantages include needing to update systematic reviews, participants conforming to a dominant perspective in focus groups, and being unable to collect respondent characteristics during analysis of user-generated online content. That said, analysis of user-generated online content offers additional time and resource advantages, and we found it elicited similar findings to those obtained via more traditional methods, such as systematic reviews and focus groups.

CONCLUSION

A number of methods for capturing public opinions on public health topics are available. Public health researchers, policy makers, and practitioners should choose methods appropriate to their aims. Analysis of user-generated online content, especially in the context of news media reports, may be a quicker and cheaper alternative to more traditional methods, without compromising on the breadth of opinions captured.

Low back pain-related meta-analysis: Caution is needed when interpreting published research results

The systematic reviews (SRs) including a meta-analysis are considered as the top level of evidence. Although the existence of more than a hundred of low back pain (LBP)-related SRs seems very appealing and might therefore suggest significant evidence on the topic, a deep analysis indicates that several of these SRs included only very few studies. Other SRs raise concerns because they included some randomized controlled trials which had a low methodological quality, or some studies which differed significantly regarding the studied populations and/or the experimental procedure. The sometimes controversial results of different SRs conducted on the same topic also highlight the significant influence of the inclusion/exclusion criteria used in the SRs to select the articles. To conclude, although meta-analysis is at the top of the evidence pyramid and have several strengths, the conclusions drawn from SRs should always be interpreted with caution because they can also have weaknesses. This is true, whether it be for LBP-related SRs including a meta-analysis, or any other. Therefore a critical analysis of any SR is always needed before integrating the results of the SR in its own clinical practice. Furthermore, clinical reasoning remains crucial, especially to consider the potential differences between one’s patient and the patients included in the meta-analysis.

Meta-analysis of genetic association studies

The object of this review is to help readers to understand meta-analysis of genetic association study. Genetic association studies are a powerful approach to identify susceptibility genes for common diseases. However, the results of these studies are not consistently reproducible. In order to overcome the limitations of individual studies, larger sample sizes or meta-analysis is required. Meta-analysis is a statistical tool for combining results of different studies on the same topic, thus increasing statistical strength and precision. Meta-analysis of genetic association studies combines the results from independent studies, explores the sources of heterogeneity, and identifies subgroups associated with the factor of interest. Meta-analysis of genetic association studies is an effective tool for garnering a greater understanding of complex diseases and potentially provides new insights into gene-disease associations.