|
1
|
Adam GP, Wallace BC, Trikalinos TA. Semi-automated Tools for Systematic Searches. Methods Mol Biol 2022; 2345:17-40. [PMID: 34550582 DOI: 10.1007/978-1-0716-1566-9_2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2023]
Abstract
Traditionally, literature identification for systematic reviews has relied on a two-step process: first, searching databases to identify potentially relevant citations, and then manually screening those citations. A number of tools have been developed to streamline and semi-automate this process, including tools to generate terms; to visualize and evaluate search queries; to trace citation linkages; to deduplicate, limit, or translate searches across databases; and to prioritize relevant abstracts for screening. Research is ongoing into tools that can unify searching and screening into a single step, and several protype tools have been developed. As this field grows, it is becoming increasingly important to develop and codify methods for evaluating the extent to which these tools fulfill their purpose.
Collapse
Affiliation(s)
- Gaelen P Adam
- Center for Evidence Synthesis in Health, Brown University School of Public Health, Providence, RI, USA.
| | - Byron C Wallace
- Khoury College of Computer Sciences, Northeastern University, Boston, MA, USA
| | - Thomas A Trikalinos
- Center for Evidence Synthesis in Health, Brown University School of Public Health, Providence, RI, USA
| |
Collapse
|
|
2
|
Clark JM, Sanders S, Carter M, Honeyman D, Cleo G, Auld Y, Booth D, Condron P, Dalais C, Bateup S, Linthwaite B, May N, Munn J, Ramsay L, Rickett K, Rutter C, Smith A, Sondergeld P, Wallin M, Jones M, Beller E. Improving the translation of search strategies using the Polyglot Search Translator: a randomized controlled trial. J Med Libr Assoc 2020; 108:195-207. [PMID: 32256231 PMCID: PMC7069833 DOI: 10.5195/jmla.2020.834] [Citation(s) in RCA: 228] [Impact Index Per Article: 57.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2019] [Accepted: 12/01/2019] [Indexed: 01/03/2023] Open
Abstract
Background Searching for studies to include in a systematic review (SR) is a time- and labor-intensive process with searches of multiple databases recommended. To reduce the time spent translating search strings across databases, a tool called the Polyglot Search Translator (PST) was developed. The authors evaluated whether using the PST as a search translation aid reduces the time required to translate search strings without increasing errors. Methods In a randomized trial, twenty participants were randomly allocated ten database search strings and then randomly assigned to translate five with the assistance of the PST (PST-A method) and five without the assistance of the PST (manual method). We compared the time taken to translate search strings, the number of errors made, and how close the number of references retrieved by a translated search was to the number retrieved by a reference standard translation. Results Sixteen participants performed 174 translations using the PST-A method and 192 translations using the manual method. The mean time taken to translate a search string with the PST-A method was 31 minutes versus 45 minutes by the manual method (mean difference: 14 minutes). The mean number of errors made per translation by the PST-A method was 8.6 versus 14.6 by the manual method. Large variation in the number of references retrieved makes results for this outcome inconclusive, although the number of references retrieved by the PST-A method was closer to the reference standard translation than the manual method. Conclusion When used to assist with translating search strings across databases, the PST can increase the speed of translation without increasing errors. Errors in search translations can still be a problem, and search specialists should be aware of this.
Collapse
Affiliation(s)
- Justin Michael Clark
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia, , https://orcid.org/0000-0003-0133-1613
| | - Sharon Sanders
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia,
| | - Matthew Carter
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia,
| | - David Honeyman
- Bond University Library, Bond University, Robina, Queensland, Australia,
| | - Gina Cleo
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia,
| | - Yvonne Auld
- Gold Coast Health Library Service, Gold Coast University Hospital, Southport, Queensland, Australia,
| | - Debbie Booth
- University Library, University of Newcastle, Callaghan, New South Wales, Australia,
| | - Patrick Condron
- University Library, University of Melbourne, Melbourne, Victoria, Australia,
| | - Christine Dalais
- University Library, University of Queensland, Brisbane, Queensland, Australia,
| | - Sarah Bateup
- Bond University Library, Bond University, Robina, Queensland, Australia,
| | - Bronwyn Linthwaite
- Bond University Library, Bond University, Robina, Queensland, Australia,
| | - Nikki May
- Sturt Library, Flinders University, Adelaide, South Australia, Australia,
| | - Jo Munn
- Centre for Teaching and Learning, Southern Cross University, Coffs Harbour, New South Wales, Australia,
| | - Lindy Ramsay
- University Library, Australian Catholic University, Banyo, Queensland, Australia,
| | - Kirsty Rickett
- University Library, University of Queensland, Brisbane, Queensland, Australia,
| | - Cameron Rutter
- University Library, Queensland University of Technology, Kelvin Grove, Queensland, Australia,
| | - Angela Smith
- Hunter New England Health Libraries, New South Wales (NSW) Health, Hunter Region, New South Wales, Australia,
| | - Peter Sondergeld
- University Library, Queensland University of Technology, Kelvin Grove, Queensland, Australia,
| | - Margie Wallin
- University Library, Southern Cross University, Coffs Harbour, New South Wales, Australia,
| | - Mark Jones
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia,
| | - Elaine Beller
- Institute for Evidence-Based Healthcare, Bond University, Robina, Queensland, Australia,
| |
Collapse
|