What you see depends on where you sit: The effect of geographical location on web-searching for systematic reviews: A case study

Searching for studies: A guide to information retrieval for Campbell systematic reviews

This guide outlines general issues in searching for studies; describes the main sources of potential studies; and discusses how to plan the search process, design, and carry out search strategies, manage references found during the search process and document and report the search process.

An alternative screening approach for Google Search identifies an accurate and manageable number of results for a systematic review (case study)

BACKGROUND

A challenge when using Google Search to identify studies for a systematic review is managing the high number of results, which can number in the hundreds of thousands or even more. Studies and guidance on web searching suggest limiting the screening process, e.g. to the first 100 results.

OBJECTIVES

Our objective in this case study is to demonstrate an alternative approach to screening the results retrieved by Google Search which is based on our experience that the viewable number of results is often far fewer than the estimated number calculated by the search engine.

METHODS

We screened the results of three searches of Google Search using our approach, which involves increasing the number of results displayed per page from 10 to the maximum of 100. We then calculated the viewable number of results and compared this with the estimated number.

RESULTS

The mean of the estimated number of results for the three searches was 569,454,000. The mean of the viewable number results was 463 (0.00008% of the mean of the estimated number of results).

CONCLUSION

Our findings challenge the commonly reported view that the number of results retrieved when using Google Search is too high to screen in full.

Patient Education Materials for Immobilisation Masks in Radiation Therapy for Adult Head and Neck Cancer Patients: A Scoping Review

Immobilisation masks (IMs) are used for people with head and neck cancer (HNC) undergoing radiation therapy (RT) treatment to ensure accuracy and reproducibility between treatments. Claustrophobia-related mask anxiety in HNC patients is common and can compromise treatment due to patient distress. This scoping review aimed to describe the content of publicly available Patient Education Materials (PEMs) for people with HNC undergoing RT. Three search engines (Bing, Yahoo, and Google) were systematically searched using standard terms. PEMs in audio-visual or written formats were eligible for inclusion if the target readership was adults with HNC and included content on IMs for RT. Content was appraised using the Patient Education Materials Assessment Tool for Printable and Audio-Visual Materials to assess understandability and actionability. In total, 304 PEMs were identified of which 20 met the inclusion criteria. Sixteen PEMs were webpages, three were PDF format, and one was a standalone video. The understandability and actionability of PEMs ranged between 47 to 100% and 0 to 80%, respectively. PEMs authored by Foundations/Organisations scored higher in understandability (80-100%) and were more likely to discuss mask anxiety coping strategies. In comparison, News sites and IM manufacturers published PEMs with the lowest understandability scores (20-80%). The significant variations in the quality of IM PEMs identified suggest that some sources may be more effective at informing patients about IMs. Although multiple aspects of the PEMs were consistent across the reviewed materials, many PEMs lacked information, and a stronger focus on understandability and actionability is required.

A feasibility study for a unified, multimodal analysis of online information foraging in health-related topics

Background

Digital health literacy (DHL) is the ability to find, understand, and appraise online health-related information, as well as apply it to health behavior. It has become a core competence for navigating online information and health service environments. DHL involves solving ill-structured problems, where the problem and its solution are not clearcut and may have no single answer, such as in the process of sensemaking. We employ and expand on information foraging theory to address how experts and novices in information retrieval perform a search task. Our overarching aim is to pinpoint best practices and pitfalls in understanding and appraising health-related information online to develop a digital intervention to increase DHL and critical thinking.

Methods

In this feasibility study, we recruited a total of twenty participants for our expert and novice subsamples. We collected sociodemographic data with a self-developed survey, video data through an observation protocol of a 10-minute search task, as well as audio-video data via a retrospective think-aloud. The three, multimodal data streams were transcribed and aligned. Codes were developed inductively in several iterations, then applied deductively to the entire dataset. Tabularized, coded and segmented qualitative data were used to create various quantitative models, which demonstrate viability for the qualitative and statistical comparison of our two subsamples.

Results

Data were visualized with Epistemic Network Analysis to analyze code co-occurrences in the three aligned data streams, and with Qualitative/Unified Exploration of State Transitions to examine the order in which participants in our two subsamples encountered online content.

Conclusions

This paper describes our methods and planned analyses elaborated with mock figures. Quantifying qualitative data, aligning data streams, and representing all information in a tabularized dataset allows us to group data according to various participant attributes and employ data visualization techniques to pinpoint patterns therein.

A Tailored Approach: A model for literature searching in complex systematic reviews

Our previous work identified that nine leading guidance documents for seven different types of systematic review advocated the same process of literature searching. We defined and illustrated this process and we named it ‘the Conventional Approach’. The Conventional Approach appears to meet the needs of researchers undertaking literature searches for systematic reviews of clinical interventions. In this article, we report a new and alternate process model of literature searching called ‘A Tailored Approach’. A Tailored Approach is indicated as a search process for complex reviews which do not focus on the evaluation of clinical interventions. The aims of this article are to (1) explain the rationale for, and the theories behind, the design of A Tailored Approach; (2) report the current conceptual illustration of A Tailored Approach and to describe a user’s interaction with the process model; and (3) situate the elements novel to A Tailored Approach (when compared with the Conventional Approach) in the relevant literature. A Tailored Approach suggests investing time at the start of a review, to develop the information needs from the research objectives, and to tailor the search approach to studies or data. Tailored Approaches should be led by the information specialist (librarian) but developed by the research team. The aim is not necessarily to focus on comprehensive retrieval. Further research is indicated to evaluate the use of supplementary search methods, methods of team-working to define search approaches, and to evaluate the use of conceptual models of information retrieval for testing and evaluation.

Aquaculture for improving productivity, income, nutrition and women's empowerment in low- and middle-income countries: A systematic review and meta-analysis

Background

A steady increase in the international production and consumption of fish has positioned aquaculture as a development option. Previous literature has highlighted the potential of aquaculture to improve economic, nutritional and gender equality outcomes, however, the evidence on the effectiveness of these programmes remains unclear.

Objectives

The review assessed whether aquaculture interventions increase the productivity, income, nutrition, and women's empowerment of individuals. We additionally aimed to identify barriers and facilitators that could affect the effectiveness of these interventions, and the cost-effectiveness of such programmes.

Methods

We searched for experimental and quasi-experimental studies focused on low- and middle-income countries. We used standard methodological procedures expected by The Campbell Collaboration for the data collection and analysis.

Results

We identified 21 impact evaluations assessing the effect of 13 aquaculture interventions in low- and lower-middle income countries. Twelve of these studies have a high risk of bias. Aquaculture interventions lead to a small increase in the production value, income, total expenditures and food consumption of participants. The limited availability of evidence prevented us from assessing other nutritional and women's empowerment outcomes. We identified barriers and facilitators affecting the programmes' set up, the participation of beneficiaries, and the level of productive activities. Insufficient cost data hindered full comparisons across programmes.

Conclusions

The review suggests a lack of rigorous evidence assessing the effectiveness of aquaculture programmes. Future research could focus on evaluating nutrition and women's empowerment impacts, promoting reporting standards, and the use of cost data to continue building quality evidence around aquaculture interventions.

Literature searching methods or guidance and their application to public health topics: A narrative review

Background

Information specialists conducting searches for systematic reviews need to consider key questions around which and how many sources to search. This is particularly important for public health topics where evidence may be found in diverse sources.

Objectives

The objective of this review is to give an overview of recent studies on information retrieval guidance and methods that could be applied to public health evidence and used to guide future searches.

Methods

A literature search was performed in core databases and supplemented by browsing health information journals and citation searching. Results were sifted and reviewed.

Results

Seventy‐two papers were found and grouped into themes covering sources and search techniques. Public health topics were poorly covered in this literature.

Discussion

Many researchers follow the recommendations to search multiple databases. The review topic influences decisions about sources. Additional sources covering grey literature eliminate bias but are time‐consuming and difficult to search systematically. Public health searching is complex, often requiring searches in multidisciplinary sources and using additional methods.

Conclusions

Search planning is advisable to enable decisions about which and how many sources to search. This could improve with more work on modelling search scenarios, particularly in public health topics, to examine where publications were found and guide future research.

Irreproducibility in searches of scientific literature: A comparative analysis

Repeatability is the cornerstone of science, and it is particularly important for systematic reviews. However, little is known on how researchers' choice of database, and search platform influence the repeatability of systematic reviews. Here, we aim to unveil how the computer environment and the location where the search was initiated from influence hit results.We present a comparative analysis of time-synchronized searches at different institutional locations in the world and evaluate the consistency of hits obtained within each of the search terms using different search platforms.We revealed a large variation among search platforms and showed that PubMed and Scopus returned consistent results to identical search strings from different locations. Google Scholar and Web of Science's Core Collection varied substantially both in the number of returned hits and in the list of individual articles depending on the search location and computing environment. Inconsistency in Web of Science results has most likely emerged from the different licensing packages at different institutions.To maintain scientific integrity and consistency, especially in systematic reviews, action is needed from both the scientific community and scientific search platforms to increase search consistency. Researchers are encouraged to report the search location and the databases used for systematic reviews, and database providers should make search algorithms transparent and revise access rules to titles behind paywalls. Additional options for increasing the repeatability and transparency of systematic reviews are storing both search metadata and hit results in open repositories and using Application Programming Interfaces (APIs) to retrieve standardized, machine-readable search metadata.