Google Scholar as replacement for systematic literature searches: good relative recall and precision are not enough

A mixed-methods survey and focus group study to understand researcher and clinician preferences for a Journal transparency Tool

Transparency within biomedical research is essential for research integrity, credibility, and reproducibility. To increase adherence to optimal scientific practices and enhance transparency, we propose the creation of a journal transparency tool (JTT) that will allow users to obtain information about a given scholarly journal's operations and transparency policies. This study is part of a program of research to obtain user preferences to inform the proposed JTT. Here, we report on our consultation with clinicians and researchers. This mixed-methods study was conducted in two parts. The first part involved a cross-sectional survey conducted on a random sample of authors from biomedical journals. The survey asked clinicians and researchers about the inclusion of a series of potential scholarly metrics and user features in the proposed JTT. Quantitative survey items were summarized with descriptive statistics. Thematic content analysis was employed to analyze text-based responses. Subsequent focus groups used survey responses to further explore the inclusion of items in the JTT. Items with less than 70% agreement were used to structure discussion points during these sessions. Participants voted on the use of user features and metrics to be considered within the journal tool after each discussion. Thematic content analysis was conducted on interview transcripts to identify the core themes discussed. A total of 632 participants (5.5% response rate) took part in the survey. A collective total of 74.7% of respondents found it either 'occasionally, 'often', or 'almost always' difficult to determine if health information online is based on reliable research evidence. Twenty-two participants took part in the focus groups. Three user features and five journal tool metrics were major discussion points during these sessions. Thematic analysis of interview transcripts resulted in six themes. The use of registration was the only item to not meet the 70% threshold after both the survey and focus groups. Participants demonstrated low scholarly communication literacy when discussing tool metric suggestions. Our findings suggest that the JTT would be valuable for both researchers and clinicians. The outcomes of this research will contribute to developing and refining the tool in accordance with researchers and clinicians.

Occupational Therapy Assessment Tools for Children and Adolescents in Iran: A Scoping Review

Background

Assessment tools are essential in occupational therapy for providing client-centered care, clinical decision-making, evidence-based documentation, and defining expected outcomes. This study investigated available occupational therapy assessment tools for children and adolescents in Iran.

Methods

A comprehensive search was conducted in MEDLINE, PubMed Central, Web of Science, Embase, Scopus, SID, Magiran, and Google Scholar from their inception until May 24, 2022. Two reviewers screened records and applied inclusion criteria focused on peer-reviewed articles in English or Persian, covering children and adolescents aged 0-18 years old in Iran. The methodological quality of each study and the evidence quality of each measurement tool was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias Checklist, and the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach.

Results

A review of 66 articles published between 2010 and 2021, identified 51 assessment tools. The majority of tools (70.7%) targeted typically developing children and those with cerebral palsy, with limited options for adolescents (n=5) and infants (n=1). These tools primarily focused on assessing body functions (47.06%), particularly sensory-motor functions. While numerous tools demonstrated good reliability (66.67%) and significant content validity (31.37%), there was a paucity of high-quality evidence supporting other psychometric properties.

Conclusion

This study identified 51 occupational therapy assessment tools for Iranian children and adolescents. However, the present research identified some concerning trends, such as lack of tools available for specific populations, an overreliance on translated tools, and a predominant focus on body functions. Moreover, there were concerns about the methodological quality of studies using these tools.

Racism against healthcare users in inpatient care: a scoping review

BACKGROUND

Racism in the healthcare system has become a burgeoning focus in health policy-making and research. Existing research has shown both interpersonal and structural forms of racism limiting access to quality healthcare for racialised healthcare users. Nevertheless, little is known about the specifics of racism in the inpatient sector, specifically hospitals and rehabilitation facilities. The aim of this scoping review is therefore to map the evidence on racial discrimination experienced by people receiving treatment in inpatient settings (hospitals and rehabilitation facilities) or their caregivers in high-income countries, focusing specifically on whether intersectional axes of discrimination have been taken into account when describing these experiences.

METHODS

Based on the conceptual framework developed by Arksey and O'Malley, this scoping review surveyed existing research on racism and racial discrimination in inpatient care in high-income countries published between 2013 and 2023. The software Rayyan was used to support the screening process while MAXQDA was used for thematic coding.

RESULTS

Forty-seven articles were included in this review. Specifics of the inpatient sector included different hospitalisation, admission and referral rates within and across hospitals; the threat of racial discrimination from other healthcare users; and the spatial segregation of healthcare users according to ethnic, religious or racialised criteria. While most articles described some interactions between race and other social categories in the sample composition, the framework of intersectionality was rarely considered explicitly during analysis.

DISCUSSION

While the USA continue to predominate in discussions, other high-income countries including Canada, Australia and the UK also examine racism in their own healthcare systems. Absent from the literature are studies from a wider range of European countries as well as of racialised and disadvantaged groups other than refugees or recent immigrants. Research in this area would also benefit from an engagement with approaches to intersectionality in public health to produce a more nuanced understanding of the interactions of racism with other axes of discrimination. As inpatient care exhibits a range of specific structures, future research and policy-making ought to consider these specifics to develop targeted interventions, including training for non-clinical staff and robust, transparent and accessible complaint procedures.

"Cyclist at 12 o'clock!": a systematic review of in-vehicle advanced driver assistance systems (ADAS) for preventing car-rider crashes

Introduction

While Advanced Driver Assistance Systems (ADAS) have become a prominent topic in road safety research, there has been relatively little discussion about their effectiveness in preventing car collisions involving specific vulnerable road users, such as cyclists. Therefore, the primary objective of this systematic literature review is to analyze the available evidence regarding the effectiveness of in-vehicle ADAS in preventing vehicle collisions with cyclists.

Methods

To achieve this goal, this systematic review analyzed a selection of original research papers that examined the effectiveness of ADAS systems in preventing car-cyclist collisions. The review followed the PRISMA protocol, which led to the extraction of 21 eligible studies from an initial pool of 289 sources indexed in the primary scientific literature databases. Additionally, word community-based content analyses were used to examine the research topics and their links within the current scientific literature on the matter.

Results

Although the current number of studies available is still scarce (most sources focus on car-motorcyclist or car-pedestrian crashes), the overall quality of the available studies has been reasonably good, as determined by the selected evaluation methods. In terms of studies' outcomes, the literature supports the value of in-vehicle ADAS for preventing car-cyclist crashes. However, threatful side effects such as unrealistic expectations of these systems and users' overconfidence or desensitization are also highlighted, as well as the need to increase driver training and road user awareness.

Conclusion

The results of this study suggest that Advanced Driver Assistance Systems have significant potential to contribute to the prevention of driving crashes involving cyclists. However, the literature emphasizes the importance of concurrently enhancing user-related skills in both ADAS use and road-user interaction through educational and training initiatives. Future research should also address emerging issues, such as ADAS-related behavioral ergonomics, and conduct long-term effectiveness assessments of ADAS in preventing car-cycling crashes and their subsequent injuries.

Systematic review registration

PROSPERO, unique identifier CRD42024505492, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=505492.

The Role of AI in Serious Games and Gamification for Health: Scoping Review

BACKGROUND

Artificial intelligence (AI) and game-based methods such as serious games or gamification are both emerging technologies and methodologies in health care. The merging of the two could provide greater advantages, particularly in the field of therapeutic interventions in medicine.

OBJECTIVE

This scoping review sought to generate an overview of the currently existing literature on the connection of AI and game-based approaches in health care. The primary objectives were to cluster studies by disease and health topic addressed, level of care, and AI or games technology.

METHODS

For this scoping review, the databases PubMed, Scopus, IEEE Xplore, Cochrane Library, and PubPsych were comprehensively searched on February 2, 2022. Two independent authors conducted the screening process using Rayyan software (Rayyan Systems Inc). Only original studies published in English since 1992 were eligible for inclusion. The studies had to involve aspects of therapy or education in medicine and the use of AI in combination with game-based approaches. Each publication was coded for basic characteristics, including the population, intervention, comparison, and outcomes (PICO) criteria; the level of evidence; the disease and health issue; the level of care; the game variant; the AI technology; and the function type. Inductive coding was used to identify the patterns, themes, and categories in the data. Individual codings were analyzed and summarized narratively.

RESULTS

A total of 16 papers met all inclusion criteria. Most of the studies (10/16, 63%) were conducted in disease rehabilitation, tackling motion impairment (eg, after stroke or trauma). Another cluster of studies (3/16, 19%) was found in the detection and rehabilitation of cognitive impairment. Machine learning was the main AI technology applied and serious games the main game-based approach used. However, direct interaction between the technologies occurred only in 3 (19%) of the 16 studies. The included studies all show very limited quality evidence. From the patients' and healthy individuals' perspective, generally high usability, motivation, and satisfaction were found.

CONCLUSIONS

The review shows limited quality of evidence for the combination of AI and games in health care. Most of the included studies were nonrandomized pilot studies with few participants (14/16, 88%). This leads to a high risk for a range of biases and limits overall conclusions. However, the first results present a broad scope of possible applications, especially in motion and cognitive impairment, as well as positive perceptions by patients. In future, the development of adaptive game designs with direct interaction between AI and games seems promising and should be a topic for future reviews.

Methods used to evaluate usability of mobile clinical decision support systems for healthcare emergencies: a systematic review and qualitative synthesis

Objective

The aim of this study was to determine the methods and metrics used to evaluate the usability of mobile application Clinical Decision Support Systems (CDSSs) used in healthcare emergencies. Secondary aims were to describe the characteristics and usability of evaluated CDSSs.

Materials and Methods

A systematic literature review was conducted using Pubmed/Medline, Embase, Scopus, and IEEE Xplore databases. Quantitative data were descriptively analyzed, and qualitative data were described and synthesized using inductive thematic analysis.

Results

Twenty-three studies were included in the analysis. The usability metrics most frequently evaluated were efficiency and usefulness, followed by user errors, satisfaction, learnability, effectiveness, and memorability. Methods used to assess usability included questionnaires in 20 (87%) studies, user trials in 17 (74%), interviews in 6 (26%), and heuristic evaluations in 3 (13%). Most CDSS inputs consisted of manual input (18, 78%) rather than automatic input (2, 9%). Most CDSS outputs comprised a recommendation (18, 78%), with a minority advising a specific treatment (6, 26%), or a score, risk level or likelihood of diagnosis (6, 26%). Interviews and heuristic evaluations identified more usability-related barriers and facilitators to adoption than did questionnaires and user testing studies.

Discussion

A wide range of metrics and methods are used to evaluate the usability of mobile CDSS in medical emergencies. Input of information into CDSS was predominantly manual, impeding usability. Studies employing both qualitative and quantitative methods to evaluate usability yielded more thorough results.

Conclusion

When planning CDSS projects, developers should consider multiple methods to comprehensively evaluate usability.

Development and Validation of an Automated Tool to Retrieve and Curate Faculty Publications of Academic Departments

Introduction Academic departments need to monitor their faculty's academic productivity for various purposes, such as reporting to the medical school dean, assessing the allocation of non-clinical research time, evaluating for rank promotion, and reporting to the Accreditation Council for Graduate Medical Education (ACGME). Our objective was to develop and validate a simple method that automatically generates query strings to identify and process distinct department faculty publications listed in PubMed and Scopus. Methods We created a macro-enabled Excel workbook (Microsoft, Redmond, WA) to automate the retrieval of faculty publications from the PubMed and Scopus bibliometric databases (available at https://bit.ly/get-pubs). Where the returned reference includes the digital object identifier (doi), a link is provided in the workbook. Duplicate publications are removed automatically, and false attributions are managed. Results At the University of Miami, between 2020 and 2021, there were 143 anesthesiology faculty-authored publications with a PubMed identifier (PMID), 95.8% identified by the query and 4.2% missed. At Vanderbilt University Medical Center, between 2019 and 2021, there were 760 anesthesiology faculty-authored publications with a PMID, 94.3% identified by the query and 5.7% missed. Recall, precision, and the F1 score were all above 93% at both medical centers. Conclusions We developed a highly accurate, simple, transportable, scalable method to identify publications in PubMed and Scopus authored by anesthesiology faculty. Manual checking and faculty feedback are required because not all names can be disambiguated, and some references are missed. This process can greatly reduce the burden of curating a list of faculty publications. The methodology applies to other academic departments that track faculty publications.

Measuring the impact of the digital economy in developing countries: A systematic review and meta- analysis

The digital economy, driven by Information and Communication Technology (ICT), has emerged as a significant contributor to economies worldwide. However, accurately defining and measuring its impact on national economies remains a complex endeavor. This paper explores the definition, measurement, role, and impacts of the digital economy across various economies. It also examines the involvement of governments and telecommunication regulators in assessing the digital economy and identifies future directions for developing countries. A systematic literature review utilizing the PRISMA Model is employed to investigate the factors and indices used to measure the digital economy. The findings highlight ongoing efforts to harmonize the definition and metrics; nonetheless, challenges persist due to the scarcity of appropriate datasets and variations in country-specific definitions. Additionally, the effectiveness of existing digital economy indices and toolkits in assessing the level of digitalization in developing countries is evaluated. The paper concludes that despite ongoing efforts to bridge the gaps, the concept of the digital economy remains defined and measured differently, necessitating a new definition that accounts for various contextual peculiarities. Furthermore, a roadmap is proposed to develop a toolkit that ensures comprehensive measurement, thus preventing an underestimation of the digital economy's contribution to the Gross Domestic Product (GDP) in developing countries. The paper underscores the need for international and multi-stakeholder dialogue to establish a common understanding of the digital economy's definition and measurement. Developing countries, such as Nigeria, are urged to develop or adopt new metrics tailored to their unique circumstances, facilitating an accurate and efficient quantification of the digital economy's impact on crucial indicators like GDP. Improved statistical data collection and recording methodologies are recommended for both governments and the private sector. Moreover, the paper advocates for the establishment of a Digital Economy Advisory Board (DEAB) in developing countries to maximize the benefits of the ongoing global transition to the digital economy.

The Use of Multicriteria Decision Analysis to Support Decision Making in Healthcare: An Updated Systematic Literature Review

OBJECTIVES

Multicriteria decision analysis (MCDA) is increasingly used for decision making in healthcare. However, its application in different decision-making contexts is still unclear. This study aimed to provide a comprehensive review of MCDA studies performed to inform decisions in healthcare and to summarize its application in different decision contexts.

METHODS

We updated a systematic review conducted in 2013 by searching Embase, MEDLINE, and Google Scholar for MCDA studies in healthcare, published in English between August 2013 and November 2020. We also expanded the search by reviewing grey literature found via Trip Medical Database and Google, published between January 1990 and November 2020. A comprehensive template was developed to extract information about the decision context, criteria, methods, stakeholders involved, and sensitivity analyses conducted.

RESULTS

From the 4295 identified studies, 473 studies were eligible for full-text review after assessing titles and abstracts. Of those, 228 studies met the inclusion criteria and underwent data extraction. The use of MCDA continues to grow in healthcare literature, with most of the studies (49%) informing priority-setting decisions. Safety, cost, and quality of care delivery are the most frequently used criteria, although there are considerable differences across decision contexts. Almost half of the MCDA studies used the linear additive model whereas scales and the analytical hierarchy process were the most used techniques for scoring and weighting, respectively. Not all studies report on each one of the MCDA steps, consider axiomatic properties, or justify the methods used.

CONCLUSIONS

A guide on how to conduct and report MCDA that acknowledges the particularities of the different decision contexts and methods needs to be developed.

MicroRNAs expressed during normal wound healing and their associated pathways: A systematic review and bioinformatics analysis

MicroRNAs (miRNAs) are responsible for regulating gene expression post-transcriptionally. Are involved in several biological processes, such as wound healing. Understanding the miRNAs involved in this process is fundamental for the development of new therapies. So, due to the need to understand the role of these molecules, we aimed systematically review the literature in order to identify which miRNAs are involved in the wound healing and determine, through bioinformatics analysis, which signaling pathways are associated with these miRNAs. An electronic search was performed in the following databases: National Library of Medicine National Institutes of Health (PubMed), Science Direct, Scifinder, Scopus and Web of Science, using the descriptors: "(microRNA [MeSH])" and "(skin [MeSH])" and "(wound healing [MeSH])". After the search, two independent and previously calibrated reviewers selected the articles that analyzed the expression pattern of miRNAs in wound healing in in vivo studies, using the software Zotero bibliography manager. Following, bioinformatic analysis was performed using the software DIANA Tools, mirPath v.3 and the data was interpreted. The bioinformatics analysis revealed that on the day 1 there were 13 union pathways, eight of which were statistically significant. Still on the day 1, among the miRNAs that had a decrease in their expression, 12 of 17 union pathways found were statistically significant. On the day 5, among the miRNAs with an increase in expression, 16 union pathways were found, 12 of which were statistically significant. Finally, among the miRNAs with decreased expression, 11 of 15 union pathways found were statistically significant. Although it has been found substantial heterogeneity in the studies, with this systematic review, it was possible to study the panorama of miRNAs that may be altered in the wound healing. The present review summarizes existing evidence of miRNAs associated to wound healing, and these findings can contribute to new therapeutic approaches.

Psychological flexibility in older adulthood: a scoping review

OBJECTIVES

Psychological flexibility/inflexibility (PF/PI) is a core component of the acceptance and commitment therapy (ACT) model, which is gaining more attention in the geropsychological literature. This scoping review examines the size and scope of the research on PF/PI in older adulthood related to age differences between older adult and younger samples, correlates relevant to psychological health, and changes with ACT.

METHODS

A systematic literature search was conducted using PubMed, CINAHL, and PsycINFO. Peer-reviewed articles available in English were included that: had a mean age ≥65 and a minimum age ≥60; and reported self-report measures of PF/PI. We categorized PF/PI into three domains: open, aware, and engaged.

RESULTS

Forty-six articles were included. Most studies measured open or aware domains; few measured the engaged domain. Older adults evidenced greater awareness compared to younger adults (9 of 13 analyses were significant). Openness and awareness consistently yielded medium to large correlations with anxiety and depression. PF/PI did not relate with positive affect and inconsistently correlated with quality of life measures.

CONCLUSION

Despite emerging trends, variability and limitations were evident in the literature. Specifically, measurement issues, lack of conceptual clarity, and the omission of values and behavioral measures require future attention.

Database coverage and their use in systematic reviews regarding spinal manipulative therapy: an exploratory study

BACKGROUND

Systematic reviews (SRs) of randomized controlled trials (RCTs) are considered one of the most reliable study types. Through a systematic and thorough literature search, researchers aim to collect all research relevant to their purpose. The selection of databases can be challenging and depend on the topic of interest. The Cochrane Handbook suggests searching at least the following three databases: Cochrane Library, MEDLINE, and EMBASE. However, this is not always sufficient for reviews on the musculoskeletal field in general. This study aimed to examine the frequency and choice of databases used by researchers in SRs of spinal manipulative therapy (SMT). Secondly, to analyze the RCTs included in the SRs to determine the optimal combination of databases needed to conduct efficient literature searches for SRs of SMT.

METHODS

SRs investigating the effect of SMT on any patient-reported outcome measure were identified through searches in PubMed and Epistemonikos (all entries till date of search February 25, 2022). For each SR, databases searched and included RCTs were collected. RCTs were searched individually in nine databases (Cochrane Library, MEDLINE/PubMed, EMBASE, Google Scholar, CINAHL, Web of Science, Index to Chiropractic Literature, PEDro, and AMED). Coverage rates were calculated using the number of retrieved RCTs by the database or combinations of databases divided by the total number of RCTs.

RESULTS

Eighty-five SRs published met the inclusion criteria, and 442 unique RCTs were retrieved. The most frequently searched database was MEDLINE/PubMed. Cochrane Library had the highest overall coverage rate and contained the third most unique RCTs. While a 100% retrieval was not possible, as 18 RCTs could not be retrieved in any of the nine databases, the combination of Cochrane Library, Google Scholar, and PEDro retrieved all possible RCTs with a combined coverage rate of 95.9%.

CONCLUSIONS

For SRs on SMT, we recommend using the combination suggested by the Cochrane Handbook of Cochrane Library, MEDLINE/PubMed, Embase, and in addition, PEDro and Index to Chiropractic Literature. Google Scholar might be used additionally as a tool for searching gray literature and quality assurance.

Trends in Health Quality-Related Publications Over the Past Three Decades: Systematic Review

Background

Quality assessment in health care is a process of planned activities with the ultimate goal of achieving a continuous improvement of medical care through the evaluation of structure, process, and outcome measures. Physicians and health care specialists involved with quality issues are faced with an enormous and nearly always increasing amount of literature to read and integrate. Nevertheless, the novelty and quality of these articles (in terms of evidence-based medicine) has not been systematically assessed and described.

Objective

The objective of this study was to test the hypothesis that the number of high-evidence journal articles (according to the pyramid of evidence), such as randomized control trials, systematic reviews, and ultimately, practice guidelines, increases over time, relative to lower-evidence journal articles, such as editorials, reviews, and letters to the editors.

Methods

We used PubMed database to retrieve relevant articles published during the 31-year period between January 1, 1989, and December 31, 2021. The search was conducted in April 2022. We used the keywords “quality care,” “quality management,” “quality indicators,” and “quality improvement” and limited the search fields to title and abstract in order to limit our search results to articles nearly exclusively related to health care quality.

Results

During this 31-year evaluation period, there was a significant cubic increase in the total number of publications, reviews, clinical trials (peaking in 2017, with a sharp decline until 2021), controlled trials (peaking in 2016, with a sharp drop until 2021), randomized controlled trials (peaking in 2017, with a sharp drop until 2021), systematic reviews (nearly nonexistent in the 1980s through 1990s to a peak of 222 in 2021), and meta-analyses (from nearly none in the 1980s through 1990s to a peak of approximately 40 per year in 2020). There was a linear increase in practice guidelines from none during 1989-1991 to approximately 25 per year during 2019-2021, including a cubic increase in editorials, peaking in 2021 at 125 per year, and in letters to the editor, peaking at 50-78 per year in the last 4 years (ie, 2018-2021).

Conclusions

Over the past 31 years, the field of quality in health care has seen a significant yearly increase of published original studies with a relative stagnation since 2015. We suggest that contributors to this dynamic field of research should focus on producing more evidence-based publications and guidelines.

Comments on "Persistent, bioaccumulative, and toxic chemicals in insects: Current state of research and where to from here?"

A recent study published in Science of the Total Environment conducted a systematic review of persistent, bioaccumulative, and toxic chemicals (PBTs) in insects using Web of Science Core Collection. Interestingly, a remarkable increase of human, animal, and vertebrate publications related to PBTs appeared in the early 1990s. Despite the authors' attempts to illustrate the anomalies from different perspectives, no rational explanation has been found yet. Quite interested in this abnormal phenomenon, we intend to join the academic discussion by pointing out some problems in the data retrieval and processing process in this review study and giving a more reasonable explanation for the surge of research publications in the early 1990s. Our new interpretations based on large-scale empirical data will help scholars make better use of this well-known and widely used database.

Winners and runners-up alike?-a comparison between awardees and special mention recipients of the most reputable science award in Colombia via a composite citation indicator

The research agenda on global academic elites (e.g., those awarded the Nobel Prize) has overlooked academic awards and elites from developing countries and the public symbolic recognition of scientific elites by research awards. In this study, we examine the bibliometric features of individual researcher profiles of those participants who received a special mention in Colombia's most prestigious prize in the sciences: the Alejandro Ángel Escobar Prize (AAEP). First, we chart the citation per article trend of Colombia's most prolific researchers before and after receiving the special mention and the AAEP. We then compare the special mention group with those awarded the AAEP, using a composite citation indicator of six scientific impact and productivity indices to estimate (1) bulk impact (number of citations and h index) and (2) authorship order adjusted impact (Schreiber hm index; total citations for articles of which the scientist is the single author; total citations for articles of which the scientist is the single or first author; and total citations for articles of which the scientist is the single, first, or last author). Results show that there is no overall halo effect in citation per article after receiving the special mention or the AAEP. Such recognition comes after an academically productive career marked by multiple citations per article peaks. There is no clear-cut division between the composite citation indicator of those awarded a special mention and those awarded the AAEP. Findings place the profile of local authors in an adjusted and inclusive framework that takes full cognisance of the scientific elites in developing countries.

Application of Multi-Criteria Decision-Making Analysis to Rural Spatial Sustainability Evaluation: A Systematic Review

The rational allocation of spatial resources is an important factor to ensure the sustainable development of rural areas, and effective pre-emptive spatial evaluation is the prerequisite for identifying the predicament of rural resource allocation. Multi-criteria decision-making analysis has advantages in solving multi-attribute and multi-objective decision-making problems, and has been used in sustainability evaluation research in various disciplines in recent years. Previous studies have proved the value of spatial evaluation using multi-criteria decision analysis in guiding rural incremental development and inventory updates, but systematic reviews of the previous literature from a multidisciplinary perspective and studies of the implementation steps of the evaluation framework are lacking. In the current paper, the research is reviewed from the two levels of quantitative statistics and research content, and through vertical and horizontal comparisons based on three common operating procedures: standard formulation, weight distribution, and ranking and verification. Through the results, the application status and characteristics of the MCDA method in related research are determined, and five research foci in the future are proposed.

Land Management Change as Adaptation to Climate and Other Stressors: A Systematic Review of Decision Contexts Using Values-Rules-Knowledge

Agricultural producers are already experiencing the adverse effects of climate change, highlighting the urgent need for adaptation. While incremental changes to cope with interannual variability are widely applied, there is limited understanding of the social contexts that inform, enable, or constrain more transformational adaptations in response to anticipated or actual climate change and other stressors. Systematic review methods are used to identify 31 empirical examples of land management change as an adaptation response by agricultural producers in developed countries. We then applied the values-rules-knowledge (vrk) framework to analyse interactions between societal values, institutional rules, and scientific and experiential knowledge. The vrk is a heuristic to help decision makers analyze how the social system shapes their decision context. Three propositions highlighting the relative influence of different values–rules, values–knowledge, and rules–knowledge relationships on agri-food and forestry land-management decisions are presented and discussed. We suggest that further testing of these propositions will provide evidence for decision makers about how decision contexts can be shifted to enable anticipatory transformative adaptation in the primary industries and support sustainable transitions towards more resilient futures.

Irreproducibility in searches of scientific literature: A comparative analysis

Repeatability is the cornerstone of science, and it is particularly important for systematic reviews. However, little is known on how researchers' choice of database, and search platform influence the repeatability of systematic reviews. Here, we aim to unveil how the computer environment and the location where the search was initiated from influence hit results.We present a comparative analysis of time-synchronized searches at different institutional locations in the world and evaluate the consistency of hits obtained within each of the search terms using different search platforms.We revealed a large variation among search platforms and showed that PubMed and Scopus returned consistent results to identical search strings from different locations. Google Scholar and Web of Science's Core Collection varied substantially both in the number of returned hits and in the list of individual articles depending on the search location and computing environment. Inconsistency in Web of Science results has most likely emerged from the different licensing packages at different institutions.To maintain scientific integrity and consistency, especially in systematic reviews, action is needed from both the scientific community and scientific search platforms to increase search consistency. Researchers are encouraged to report the search location and the databases used for systematic reviews, and database providers should make search algorithms transparent and revise access rules to titles behind paywalls. Additional options for increasing the repeatability and transparency of systematic reviews are storing both search metadata and hit results in open repositories and using Application Programming Interfaces (APIs) to retrieve standardized, machine-readable search metadata.

Database selection and data gathering methods in systematic reviews of qualitative research regarding diabetes mellitus - an explorative study

BACKGROUND

Systematic reviews (SRs) are considered one of the most reliable types of studies in evidence-based medicine. SRs rely on a comprehensive and systematic data gathering, including the search of academic literature databases. This study aimed to investigate which combination of databases would result in the highest overall recall rate of references when conducting SRs of qualitative research regarding diabetes mellitus. Furthermore, we aimed to investigate the current use of databases and other sources for data collection.

METHODS

Twenty-six SRs (published between 2010 and 2020) of qualitative research regarding diabetes mellitus, located through PubMed, met the inclusion criteria. References of the SRs were systematically hand searched in the six academic literature databases CINAHL, MEDLINE/PubMed, PsycINFO, Embase, Web of Science, and Scopus and the academic search engine Google Scholar. Recall rates were calculated using the total number of included references retrieved by the database or database combination divided by the total number of included references, given in percentage.

RESULTS

The SRs searched five databases on average (range two to nine). MEDLINE/PubMed was the most commonly searched database (100% of SRs). In addition to academic databases, 18 of the 26 (69%) SRs hand searched the reference lists of included articles. This technique resulted in a median (IQR) of 2.5 (one to six) more references being included per SR than by database searches alone. 27 (5.4%) references were found only in one of six databases (when Google Scholar was excluded), with CINAHL retrieving the highest number of unique references (n = 15). The combinations of MEDLINE/PubMed and CINAHL (96.4%) and MEDLINE/PubMed, CINAHL, and Embase (98.8%) yielded the highest overall recall rates, with Google Scholar excluded.

CONCLUSIONS

We found that the combinations of MEDLINE/PubMed and CINAHL and MEDLINE/PubMed, CINAHL, and Embase yielded the highest overall recall rates of references included in SRs of qualitative research regarding diabetes mellitus. However, other combinations of databases yielded corresponding recall rates and are expected to perform comparably. Google Scholar can be a useful supplement to traditional scientific databases to ensure an optimal and comprehensive retrieval of relevant references.

Wearable Sensor-Based Real-Time Gait Detection: A Systematic Review

Gait analysis has traditionally been carried out in a laboratory environment using expensive equipment, but, recently, reliable, affordable, and wearable sensors have enabled integration into clinical applications as well as use during activities of daily living. Real-time gait analysis is key to the development of gait rehabilitation techniques and assistive devices such as neuroprostheses. This article presents a systematic review of wearable sensors and techniques used in real-time gait analysis, and their application to pathological gait. From four major scientific databases, we identified 1262 articles of which 113 were analyzed in full-text. We found that heel strike and toe off are the most sought-after gait events. Inertial measurement units (IMU) are the most widely used wearable sensors and the shank and foot are the preferred placements. Insole pressure sensors are the most common sensors for ground-truth validation for IMU-based gait detection. Rule-based techniques relying on threshold or peak detection are the most widely used gait detection method. The heterogeneity of evaluation criteria prevented quantitative performance comparison of all methods. Although most studies predicted that the proposed methods would work on pathological gait, less than one third were validated on such data. Clinical applications of gait detection algorithms were considered, and we recommend a combination of IMU and rule-based methods as an optimal solution.

STEM Abstracting and Indexing (A&I) Tool Overlap Analysis in 2020: An Open Science Informed Approach Amid Pandemic Budgets

Objectives: Compare journal coverage of abstract and indexing tools commonly used within academic science and engineering research. Methods: Title lists of Compendex, Inspec, Reaxys, SciFinder, and Web of Science were provided by their respective publishers. These lists were imported into Excel and the overlap of the ISSN/EISSNs and journal titles was determined using the VLOOKUP command, which determines if the value in one cell can be found in a column of other cells. Results: There is substantial overlap between the Web of Science’s Science Citation Index Expanded and the Emerging Sources Citation Index, the largest database with 17,014 titles, and Compendex (63.6%), Inspec (71.0%), Reaxys (67.0%), and SciFinder (75.8%). SciFinder also overlaps heavily with Reaxys (75.9%). Web of Science and Compendex combined contain 77.6% of the titles within Inspec. Conclusion: Flat or decreasing library budgets combined with increasing journal prices result in an unsustainable system that will require a calculated allocation of resources at many institutions. The overlap of commonly indexed journals among abstracting and indexing tools could serve as one way to determine how these resources should be allocated.

Multi-Criteria Decision-Making Methods to Address Water Allocation Problems: A Systematic Review

The water allocation problem is complex and requires a combination of regulations, policies, and mechanisms to support water management to minimize the risk of shortage among competing users. This paper compiles the application of multi-criteria decision-making (MCDM) related to water allocation. In this regard, this paper aims to identify and to discern the pattern, distribution of study regions, water problem classifications, and decision techniques application for a specific water allocation problem. We applied a systematic literature review study from 2000 to 2019 by using four literature databases (Web of Science, Scopus, Science Direct, and Google Scholar). From 109 papers, 49 publications have been identified and information extracted. This study reveals that in the past two decades the application of MCDM in the area of water allocation has increased particularly after 2014. Around 65% and 12% of study papers were conducted in Asia and Europe, respectively. Water shortage, water use management, and water quality were consecutively the most top-ranked discussed water problems. NSGA II (non-dominated sorting genetic algorithm), GA (genetic algorithm), and LP (linear programming) are the more often applied decision methods to solve water allocation problems. The key findings of this study provide guidelines for future research studies.

Commentary to Gusenbauer and Haddaway 2020: Evaluating retrieval qualities of Google Scholar and PubMed

We read with considerable interest the study by Gusenbauer and Haddaway (Gusenbauer and Haddaway, 2020, Research Synthesis Methods, doi:10.1002/jrsm.1378) comparing the systematic search qualities of 28 search systems, including Google Scholar (GS) and PubMed. Google Scholar and PubMed are the two most popular free academic search tools in biology and chemistry, with GS being the number one search tool in the world. Those academics using GS as their principal system for literature searches may be unaware of research which enumerates five critical features for scientific literature tools that greatly influenced Gusenbauer's 2020 study. Using this list as the framework for a targeted comparison between just GS and PubMed, we found stark differences which overwhelmingly favored PubMed. In this comment, we show that by comparing the characteristics of the two search tools, features that are particularly useful in one search tool, but are missing in the other, are strikingly spotlighted. One especially popular feature that ubiquitously appears in GS, but not in PubMed, is the forward citation search found under every citation as a clickable Cited by N link. We seek to improve the PubMed search experience using two approaches. First, we request that PubMed add Cited by N links, making them as omnipresent as the GS links. Second, we created an open‐source command‐line tool, pmidcite, which is used alongside PubMed to give information to researchers to help with the choice of the next paper to examine, analogous to how GS's Cited by N links help to guide users. Find pmidcite at https://github.com/dvklopfenstein/pmidcite.

What every researcher should know about searching - clarified concepts, search advice, and an agenda to improve finding in academia

We researchers have taken searching for information for granted for far too long. The COVID-19 pandemic shows us the boundaries of academic searching capabilities, both in terms of our know-how and of the systems we have. With hundreds of studies published daily on COVID-19, for example, we struggle to find, stay up-to-date, and synthesize information-all hampering evidence-informed decision making. This COVID-19 information crisis is indicative of the broader problem of information overloaded academic research. To improve our finding capabilities, we urgently need to improve how we search and the systems we use. We respond to Klopfenstein and Dampier (Res Syn Meth. 2020) who commented on our 2020 paper and proposed a way of improving PubMed's and Google Scholar's search functionalities. Our response puts their commentary in a larger frame and suggests how we can improve academic searching altogether. We urge that researchers need to understand that search skills require dedicated education and training. Better and more efficient searching requires an initial understanding of the different goals that define the way searching needs to be conducted. We explain the main types of searching that we academics routinely engage in; distinguishing lookup, exploratory, and systematic searching. These three types must be conducted using different search methods (heuristics) and using search systems with specific capabilities. To improve academic searching, we introduce the "Search Triangle" model emphasizing the importance of matching goals, heuristics, and systems. Further, we suggest an urgently needed agenda toward search literacy as the norm in academic research and fit-for-purpose search systems.

MicroRNAs expressed in neuronal differentiation and their associated pathways: Systematic review and bioinformatics analysis

MicroRNAs (miRNAs) plays an important role in the human brain from the embryonic period to adulthood. In this sense, they influence the development of neural stem cells (NSCs), regulating cellular differentiation and survival. Therefore, due to the importance of better comprehending the regulation of miRNAs in NSCs differentiation and the lack of studies that show the panorama of miRNAs and their signaling pathways studied until now we aimed to systematically review the literature to identify which miRNAs are currently being associated with neuronal differentiation and using bioinformatics analysis to identify their related pathways. A search was carried out in the following databases: Scientific Electronic Library Online (Scielo), National Library of Medicine National Institutes of Health (PubMed), Scopus, Web of Science and Science Direct, using the descriptors "(microRNA [MeSH])" and "(neurogenesis [MeSH])". From the articles found, two independent and previously calibrated reviewers, using the EndNote X7 (Thomson Reuters, New York, NY, US), selected those that concern miRNA in the development of NSCs, based on in vitro studies. After, bioinformatic analysis was performed using the software DIANA Tools, mirPath v.3. Subsequently, data was tabulated, analyzed and interpreted. Among the 106 miRNAs cited by included studies, 55 were up-regulated and 47 were down-regulated. The bioinformatics analysis revealed that among the up-regulated miRNAs there were 24 total and 6 union pathways, and 3 presented a statistically significant difference (p ≤ 0.05). Among the down-regulated miRNAs, 46 total and 13 union pathways were found, with 7 presenting a significant difference (p ≤ 0.05). The miR-125a-5p, miR-423-5p, miR-320 were the most frequently found miRNAs in the pathways determined by bioinformatics. In this study a panel of altered miRNAs in neuronal differentiation was created with their related pathways, which could be a step towards understanding the complex network of miRNAs in neuronal differentiation.

Applications, indications, and effects of passive hydrotherapy WATSU (WaterShiatsu)-A systematic review and meta-analysis

Background

WATSU (portmanteau word: water and shiatsu) is a form of passive hydrotherapy in chest-deep thermoneutral water (35°C = 95°F = 308.15 K). It combines elements of myofascial stretching, joint mobilization, massage, and shiatsu and is reported to be used to address physical and mental issues. The objective of this systematic review (PROSPERO Registration No. CRD42016029347) and the meta-analyses was to assess the applications, indications, and the effects of WATSU to form a basis for further studies.

Methods

A search for “WATSU OR watershiatsu OR (water AND shiatsu)” was conducted without any restrictions in 32 databases. Peer reviewed original articles addressing WATSU as a stand-alone hydrotherapy were assessed for risk of bias. Quantitative data of effects on pain, physical function, and mental issues were processed in random model meta-analyses with subgroup analyses by study design. Effect sizes were expressed as Hedges's g (± 95% confidence intervals).

Results

Of 1,906 unique citations, 27 articles regardless of study design were assessed for risk of bias. WATSU has been applied to individuals of all ages. Indications covered acute (e.g. pregnancy related low back pain) and chronic conditions (e.g. cerebral palsy) with beneficial effects of WATSU regarding e.g. relaxation or sleep quality. Meta-analyses suggest beneficial effect sizes of WATSU on pain (overall Hedges’s g = -0.71, 95% CI = -0.91 to -0.51), physical function (overall Hedges’s g = -0.76, 95% CI = -1.08 to -0.44), and mental issues (overall Hedges’s g = -0.68, 95% CI = -1.02 to -0.35).

Conclusion

Various applications, indications and beneficial effects of WATSU were identified. The grade of this evidence is estimated to be low to moderate at the best. To strengthen the findings of this study, high-quality RCTs are needed.

Precarious employment and migrant workers' mental health: a protocol for a systematic review of observational studies

BACKGROUND

Precarious employment has become an urgent public health issue at a global scale with potential consequences for quality of life and health of employees, especially in vulnerable groups such as migrants. The primary aim of this systematic review is thus to analyze and summarize existing research on the association between precarious employment and migrant workers' mental health.

METHODS

We will search PubMed/MEDLINE, PsycINFO, Web of Science (from January 1970 onwards) for original articles on observational studies (e.g., cohort, case-control and cross-sectional, and qualitative) published in English, German, Turkish, and Spanish. The primary outcome will be depression and anxiety disorders. Secondary outcomes will be burnout, sleeping problems, and occupational stress. Two reviewers will independently screen all citations, full-text articles, and abstract data. Potential conflicts will be resolved through discussion. The methodological quality (or risk of bias) of individual studies will be appraised using an appropriate tool. A narrative synthesis will summarize and explain the characteristics and findings of the studies. If feasible, we will conduct random effects meta-analyses where appropriate.

DISCUSSION

This systematic review will analyze the ways in which precarious employment affects migrant workers' mental health and the process that underlies this relationship. The results from the systematic review outlined in this protocol will be of interest to labor and health professionals, policy makers, labor unions, and non-governmental organizations. Our findings may encourage and impel related policy makers to establish human-focused, safe and healthy work environments, and workplace conditions.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO, CRD42019132560.

Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources

Rigorous evidence identification is essential for systematic reviews and meta-analyses (evidence syntheses) because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, recall, and reproducibility and also demand different levels of effort. To date, it remains unclear which search systems are most appropriate for evidence synthesis and why. Advice on which search engines and bibliographic databases to choose for systematic searches is limited and lacking systematic, empirical performance assessments. This study investigates and compares the systematic search qualities of 28 widely used academic search systems, including Google Scholar, PubMed, and Web of Science. A novel, query-based method tests how well users are able to interact and retrieve records with each system. The study is the first to show the extent to which search systems can effectively and efficiently perform (Boolean) searches with regards to precision, recall, and reproducibility. We found substantial differences in the performance of search systems, meaning that their usability in systematic searches varies. Indeed, only half of the search systems analyzed and only a few Open Access databases can be recommended for evidence syntheses without adding substantial caveats. Particularly, our findings demonstrate why Google Scholar is inappropriate as principal search system. We call for database owners to recognize the requirements of evidence synthesis and for academic journals to reassess quality requirements for systematic reviews. Our findings aim to support researchers in conducting better searches for better evidence synthesis.

Do wastewater treatment plants increase antibiotic resistant bacteria or genes in the environment? Protocol for a systematic review

BACKGROUND

Antibiotic resistance is a global public health threat. Water from human activities is collected at wastewater treatment plants where processes often do not sufficiently neutralize antibiotic resistant bacteria and genes, which are further shed into the local environment. This protocol outlines the steps to conduct a systematic review based on the Population, Exposure, Comparator and Outcome (PECO) framework, aiming at answering the question "Are antimicrobial-resistant enterobacteriaceae and antimicrobial resistance genes present (O) in air and water samples (P) taken either near or downstream or downwind or down-gradient from wastewater treatment plants (E), as compared to air and water samples taken either further away or upstream or upwind or up-gradient from such wastewater treatment plant (C)?" Presence of antimicrobial-resistant bacteria and genes will be quantitatively measured by extracting their prevalence or concentration, depending on the reviewed study.

METHODS

We will search PubMed, EMBASE, the Cochrane database and Web of Science for original articles published from 1 Jan 2000 to 3 Sep 2018 with language restriction. Articles will undergo a relevance and a design screening process. Data from eligible articles will be extracted by two independent reviewers. Further, we will perform a risk of bias assessment using a decision matrix. We will synthesize and present results in narrative and tabular form and will perform a meta-analysis if heterogeneity of results allows it.

DISCUSSION

Antibiotic resistance in environmental samples around wastewater treatment plants may pose a risk of exposure to workers and nearby residents. Results from the systematic review outlined in this protocol will allow to estimate the extend of exposure, to inform policy making and help to design future studies.

A new innovative method to measure the demographic representation of scientists via Google Scholar

Many countries around the globe have seen increases in the enrollment of female and visible minorities in postsecondary education. Therefore, it is critical to evaluate whether recent demographic changes at the postsecondary institution have translated to employment opportunities in scientific fields for women and previously underrepresented groups. Instead of relying on algorithm indices, surveys, or anonymous census data, this study is the first research to utilize an innovative approach to report the demographic representation of top-ranking scientists from around the world. The recently developed Google Scholar profile platform, university ranking system, and the search engine are the main methods that allowed this study to identify and categorize the top scientists from countries in which English is one of the official languages, or where English is used as the language of instruction in higher education. Overall, findings reveal that at top-ranking universities in which the majority of the population is Caucasian, women and minorities are severely underrepresented in all areas of science, capturing 7.3% and 6.4% of the total citations, respectively. Each country’s highest concentration of scientists in each field, based on citation and percentage of researchers, is highlighted. There are recommendations offered to help make scientific advancement more favorable to underrepresented groups, and also to encourage institutions of higher education to adapt and build new capacities.

MicroRNAs expressed in depression and their associated pathways: A systematic review and a bioinformatics analysis

Depression is a debilitating mental illness, one of the most prevalent worldwide. MicroRNAs have been studied to better understand the biological mechanisms that regulate this disease. This study review systematically the literature to identify which microRNAs are currently being associated with depression and their related pathways. The electronic search was conducted in PubMed, Scopus, Scielo, ISI Web of Knowledge, and PsycINFO databases, using the search terms "Depressive Disorder" or "Depression" and "MicroRNAs". After, microRNAs that were up and down-regulated in depression were analyzed by bioinformatics. We observed that among the 77 microRNAs cited by included studies, 54 had their levels altered in depressed individuals compared to controls, 30 being up-regulated and 24 down-regulated. The bioinformatics analysis revealed that among the up-regulated microRNAs there were 81 total and 43 union pathways, with 15 presenting a significant difference. Among the down-regulated microRNAs, 67 total and 45 union pathways were found, with 14 presenting a significant difference. The miR-17-5p and let-7a-5p were the most frequently found microRNAs in the statistically significant pathways. In this study a panel of altered microRNAs in depression was created with their related pathways, which is a step towards understanding the complex network of microRNAs in depression.

Consolidated principles for screening based on a systematic review and consensus process

BACKGROUND

In 1968, Wilson and Jungner published 10 principles of screening that often represent the de facto starting point for screening decisions today; 50 years on, are these principles still the right ones? Our objectives were to review published work that presents principles for population-based screening decisions since Wilson and Jungner's seminal publication, and to conduct a Delphi consensus process to assess the review results.

METHODS

We conducted a systematic review and modified Delphi consensus process. We searched multiple databases for articles published in English in 1968 or later that were intended to guide population-based screening decisions, described development and modification of principles, and presented principles as a set or list. Identified sets were compared for basic characteristics (e.g., number, categorization), a citation analysis was conducted, and principles were iteratively synthesized and consolidated into categories to assess evolution. Participants in the consensus process assessed the level of agreement with the importance and interpretability of the consolidated screening principles.

RESULTS

We identified 41 sets and 367 unique principles. Each unique principle was coded to 12 consolidated decision principles that were further categorized as disease/condition, test/intervention or program/system principles. Program or system issues were the focus of 3 of Wilson and Jungner's 10 principles, but comprised almost half of all unique principles identified in the review. The 12 consolidated principles were assessed through 2 rounds of the consensus process, leading to specific refinements to improve their relevance and interpretability. No gaps or missing principles were identified.

INTERPRETATION

Wilson and Jungner's principles are remarkably enduring, but increasingly reflect a truncated version of contemporary thinking on screening that does not fully capture subsequent focus on program or system principles. Ultimately, this review and consensus process provides a comprehensive and iterative modernization of guidance to inform population-based screening decisions.

Main gamification concepts: A systematic mapping study

Gamification involves incorporating elements of online games, such as points, leaderboards, and badges into non-game contexts, in order to improve engagement with both employees and consumers. The main point of this paper is, to sum up, what previous authors investigated in the field of Gamification. An analysis of the literature covering 50 papers from 2011 to 2016 was conducted, using Leximancer software, to determine and shape the main themes and concepts proposed in gamification papers. Answering our research question, "What guidelines may provide to future research, the key themes and concepts found in published scientific papers on gamification?", we conclude that the researchers identified eight themes (gamification; game; use; users; business; points; engagement; learning) and twenty-eight related concepts. The present systematic review contributes to establishing possible guidelines for prospective studies, based on the analyzed papers, considering particularly their 'Conclusions' and on the 'Future research' sections, integrating game design contents in business, learning and education. Further, highlights the usefulness of Leximancer for qualitative content analysis, in this field of research.

Searching for qualitative health research required several databases and alternative search strategies: a study of coverage in bibliographic databases

OBJECTIVE

Retrieving the qualitative literature can be challenging, but the number and specific choice of databases are key factors. The aim of the present study is to provide guidance for the choice of databases for retrieving qualitative health research.

STUDY DESIGN AND SETTING

Seventy-one qualitative systematic reviews, from the Cochrane Database of Systematic Reviews and JBI database of Systematic Reviews and Implementation Reports, including 927 qualitative studies, were used to analyze the coverage of the qualitative literature in nine bibliographic databases.

RESULTS

The results show that 94.4% of the qualitative studies are indexed in at least one database, with a lower coverage for publication types other than journal articles. Maximum recall with two databases is 89.1%, with three databases recall increases to 92% and maximum recall with four databases is 93.1%. The remaining 6.9% of the publications consists of 1.3% scattered across five databases and 5.6% that are not indexed in any of the nine databases used in this study.

CONCLUSION

Retrieval in one or a few-although well selected-databases does not provide all the relevant qualitative studies. The remaining studies needs to be located using several other databases and alternative search strategies.

Gender and health social enterprises in Africa: a research agenda

BACKGROUND

Health social enterprises in Africa working with community health workers (CHWs) are growing rapidly but understudied. In particular, gender equality issues related to their work has important public health and equity implications.

METHODS

Particularly suited for generating timely findings from reviews at the intersection of overlapping disciplines, we utilized the rapid evidence assessment (REA) methodology to identify key unanswered research questions at the intersection of the fields of gender equality, social enterprises and community health workers. The REA used a series of structured Google Scholar searches, expert interviews and bibliography reviews to identify 57 articles in the academic and grey literatures that met the study inclusion criteria. Articles were thematically coded to identify answers to "What are the most important research questions about the influence of gender on CHWs working with health social enterprises in Africa?"

RESULTS

The analysis identified six key unanswered research questions relating to 1) equitable systems and structures; 2) training; 3) leadership development and career enhancement; 4) payment and incentives; 5) partner, household and community support; and 6) performance.

CONCLUSION

This is the first study of its kind to identify the key unanswered research questions relevant to gender equality in health social enterprises in Africa using community health workers. As such, it sets out a research agenda for this newly emerging but rapidly developing area of research and practice with important public health implications.

Healthcare professional perceived barriers and facilitators to discussing sexual wellbeing with patients after diagnosis of chronic illness: A mixed-methods evidence synthesis

OBJECTIVES

To explore healthcare professional perceived barriers and facilitators to discussing sexual health and wellbeing with patients after diagnosis of chronic illness.

METHODS

Five databases were searched and included data were synthesised using a meta-ethnographic approach. Confidence in findings was assessed using the GRADE-CERQual framework. Searches, extraction and quality assessment procedures were conducted independently by at least two authors.

RESULTS

Concepts extracted from 30 included studies were used to develop a conceptual framework based on five overarching themes. These were [1] individual and societal attitudes to sex and sexual wellbeing [2], patient specific factors [3], organizational and professional factors [4], strategies to overcome barriers in practice and [5] perceived training needs. Healthcare professionals acknowledged the importance of discussing and providing support for sexual wellbeing needs, but recognized it is not routinely provided.

CONCLUSIONS

While patient specific factors and organizational issues such as lack of time were frequently identified as barriers, intra-personal and social perceptions appear to have the strongest influence on healthcare professional perspectives.

PRACTICE IMPLICATIONS

Brief education and tools to support healthcare professionals to have effective conversations with patients are required. These should address social barriers, normalise sexual issues, and support healthcare professionals to initiate discussions around sexual concerns.

Predatory publications in evidence syntheses

Objectives

The number of predatory journals is increasing in the scholarly communication realm. These journals use questionable business practices, minimal or no peer review, or limited editorial oversight and, thus, publish articles below a minimally accepted standard of quality. These publications have the potential to alter the results of knowledge syntheses. The objective of this study was to determine the degree to which articles published by a major predatory publisher in the health and biomedical sciences are cited in systematic reviews.

Methods

The authors downloaded citations of articles published by a known predatory publisher. Using forward reference searching in Google Scholar, we examined whether these publications were cited in systematic reviews.

Results

The selected predatory publisher published 459 journals in the health and biomedical sciences. Sixty-two of these journal titles had published a total of 120 articles that were cited by at least 1 systematic review, with a total of 157 systematic reviews citing an article from 1 of these predatory journals.

Discussion

Systematic review authors should be vigilant for predatory journals that can appear to be legitimate. To reduce the risk of including articles from predatory journals in knowledge syntheses, systematic reviewers should use a checklist to ensure a measure of quality control for included papers and be aware that Google Scholar and PubMed do not provide the same level of quality control as other bibliographic databases.

Following the Trail of eSports

Despite eSports' relatively long history, the attention paid by academia to this phenomenon has been much more recent and is still in an embryonic state in all of the views. The scientific production has grown because of the global success associated with the widespread growth of live events and the large following of competitions retransmitted via streaming. This article aims to offer a literature review of the research carried out on eSports to date, based upon a systematic review on the sample of selected research. The results confirm the growing variety of approaches to the issue, but also a clear dominance of computer science perspectives rather than to sport science or game studies. While showing some balance between qualitative and quantitative approaches, the prevalence of theoretical perspectives may be taken as a sign of struggle for consolidation as a field. Finally, a discussion about main matters and an author and institution average profile are also provided.

Activism and scientific research: 20 years of community action by the Vancouver area network of drug users

Background

Over the past several decades, there have been numerous peer-reviewed articles written about people who use drugs (PWUDs) from the Downtown Eastside neighborhood of Vancouver, Canada. While individual researchers have engaged and acknowledged this population as participants and community partners in their work, there has been comparatively little attention given to the role of PWUDs and drug user organizations in directing, influencing, and shaping research agendas.

Methods

In this community-driven research, we examine 20 years of peer-reviewed studies, university theses, books, and reports that have been directed, influenced, and shaped by members of the activist organization the Vancouver Area Network of Drug Users (VANDU). In this paper, we have summarized VANDU’s work based on different themes from each article.

Results

After applying the inclusion criteria to over 400 articles, 59 items containing peer-reviewed studies, books, and reports were included and three themes of topics researched or discussed were identified. Theme 1: ‘health needs’ of marginalized groups was found in 39% of articles, Theme 2: ‘evaluation of projects’ related to harm reduction in 19%, and Theme 3: ‘activism’ related work in 42%. Ninety-four percent of co-authors were from British Columbia and 44% of research was qualitative. Works that have been co-authored by VANDU’s members or acknowledged their participations created 628 citations. Moreover, their work has been accessed more than 149,600 times.

Conclusions

Peer-based, democratic harm reduction organizations are important partners in facilitating groundbreaking health and social research, and through research can advocate for the improved health and wellbeing of PWUDs and other marginalized groups in their community. This article also recommends that PWUDs should be more respectfully engaged and given appropriate credit for their contributions.

Optimal literature search for systematic reviews in surgery

BACKGROUND

The aim of the present study was to determine empirically which electronic databases contribute best to a literature search in surgical systematic reviews.

METHODS

For ten published systematic reviews, the systematic literature searches were repeated in the databases MEDLINE, Web of Science, CENTRAL, and EMBASE. On the basis of these reviews, a gold standard set of eligible articles was created. Recall (%), precision (%), unique contribution (%), and numbers needed to read (NNR) were calculated for each database, as well as for searches of citing references and of the reference lists of related systematic reviews (hand search).

RESULTS

CENTRAL yielded the highest recall (88.4%) and precision (8.3%) for randomized controlled trials (RCT), MEDLINE for non-randomized studies (NRS; recall 92.6%, precision 5.2%). The most effective combination of two databases plus hand searching for RCT was MEDLINE/CENTRAL (98.6% recall, NNR 97). Adding EMBASE marginally increased the recall to 99.3%, but with an NNR of 152. For NRS, the most effective combination was MEDLINE/Web of Science (99.5% recall, NNR 60).

CONCLUSIONS

For surgical systematic reviews, the optimal literature search for RCT employs MEDLINE and CENTRAL. For surgical systematic reviews of NRS, Web of Science instead of CENTRAL should be searched. EMBASE does not contribute substantially to reviews with a surgical intervention.

Information sources for obesity prevention policy research: a review of systematic reviews

BACKGROUND

Systematic identification of evidence in health policy can be time-consuming and challenging. This study examines three questions pertaining to systematic reviews on obesity prevention policy, in order to identify the most efficient search methods: (1) What percentage of the primary studies selected for inclusion in the reviews originated in scholarly as opposed to gray literature? (2) How much of the primary scholarly literature in this topic area is indexed in PubMed/MEDLINE? (3) Which databases index the greatest number of primary studies not indexed in PubMed, and are these databases searched consistently across systematic reviews?

METHODS

We identified systematic reviews on obesity prevention policy and explored their search methods and citations. We determined the percentage of scholarly vs. gray literature cited, the most frequently cited journals, and whether each primary study was indexed in PubMed. We searched 21 databases for all primary study articles not indexed in PubMed to determine which database(s) indexed the highest number of these relevant articles.

RESULTS

In total, 21 systematic reviews were identified. Ten of the 21 systematic reviews reported searching gray literature, and 12 reviews ultimately included gray literature in their analyses. Scholarly articles accounted for 577 of the 649 total primary study papers. Of these, 495 (76%) were indexed in PubMed. Google Scholar retrieved the highest number of the remaining 82 non-PubMed scholarly articles, followed by Scopus and EconLit. The Journal of the American Dietetic Association was the most-cited journal.

CONCLUSIONS

Researchers can maximize search efficiency by searching a small yet targeted selection of both scholarly and gray literature resources. A highly sensitive search of PubMed and those databases that index the greatest number of relevant articles not indexed in PubMed, namely multidisciplinary and economics databases, could save considerable time and effort. When combined with a gray literature search and additional search methods, including cited reference searching and consulting with experts, this approach could help maintain broad retrieval of relevant studies while improving search efficiency. Findings also have implications for designing specialized databases for public health research.

Tips and tricks for using the internet for professional purposes

Online resources provide access to large amounts of information which is expanding every day. Using search engines for reaching the relevant, updated and complete literature that is indexed in various bibliographical databases has already become part of the medical professionals’ everyday life.

However, most researchers often fail to conduct a efficient literature search on the internet. The right techniques in literature search save time and improve the quality of the retrieved data.

Efficient literature search is not a talent but a learnable skill, which should be a formal part of medical education.

This review briefly outlines the commonly used bibliographic databases, namely Pubmed, Cochrane Library, Web of Science, Scopus, EMBASE, CINAHL and Google Scholar. Also the definition of grey literature and its features are summarised.

Cite this article: EFORT Open Rev 2017;2. DOI: 10.1302/2058-5241.2.160066. Originally published online at www.efortopenreviews.org

A beginner's guide to the literature search in medical education

Conducting a literature search can be a daunting prospect if you have not done it before. This article aims to provide a beginner's guide to searching the medical education literature, by describing how to construct an effective search strategy, the resources that are available and the basics of how searching works.

Identifying models of delivery, care domains and quality indicators relevant to palliative day services: a scoping review protocol

BACKGROUND

With an ageing population and increasing numbers of people with life-limiting illness, there is a growing demand for palliative day services. There is a need to measure and demonstrate the quality of these services, but there is currently little agreement on which aspects of care should be used to do this. The aim of the scoping review will be to map the extent, range and nature of the evidence around models of delivery, care domains and existing quality indicators used to evaluate palliative day services.

METHODS

Electronic databases (MEDLINE, EMBASE, CINAHL, PsycINFO, Cochrane Central Register of Controlled Trials) will be searched for evidence using consensus development methods; randomised or quasi-randomised controlled trials; mixed methods; and prospective, longitudinal or retrospective case-control studies to develop or test quality indicators for evaluating palliative care within non-residential settings, including day hospices and community or primary care settings. At least two researchers will independently conduct all searches, study selection and data abstraction procedures. Meta-analyses and statistical methods of synthesis are not planned as part of the review. Results will be reported using numerical counts, including number of indicators in each care domain and by using qualitative approach to describe important indicator characteristics. A conceptual model will also be developed to summarise the impact of different aspects of quality in a palliative day service context. Methodological quality relating to indicator development will be assessed using the Appraisal of Indicators through Research and Evaluation (AIRE) tool. Overall strength of evidence will be assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) system. Final decisions on quality assessment will be made via consensus between review authors.

DISCUSSION

Identifying, developing and implementing evidence-based quality indicators is critical to the evaluation and continued improvement of palliative care. Review findings will be used to support clinicians and policymakers make decisions on which quality indicators are most appropriate for evaluating day services at the patient and service level, and to identify areas for further research.