1
|
Ekhtiari H, Zare-Bidoky M, Sangchooli A, Valyan A, Abi-Dargham A, Cannon DM, Carter CS, Garavan H, George TP, Ghobadi-Azbari P, Juchem C, Krystal JH, Nichols TE, Öngür D, Pernet CR, Poldrack RA, Thompson PM, Paulus MP. Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility. Neuropsychopharmacology 2024; 50:67-84. [PMID: 39242922 PMCID: PMC11525976 DOI: 10.1038/s41386-024-01973-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 08/08/2024] [Accepted: 08/12/2024] [Indexed: 09/09/2024]
Abstract
Neuroimaging plays a crucial role in understanding brain structure and function, but the lack of transparency, reproducibility, and reliability of findings is a significant obstacle for the field. To address these challenges, there are ongoing efforts to develop reporting checklists for neuroimaging studies to improve the reporting of fundamental aspects of study design and execution. In this review, we first define what we mean by a neuroimaging reporting checklist and then discuss how a reporting checklist can be developed and implemented. We consider the core values that should inform checklist design, including transparency, repeatability, data sharing, diversity, and supporting innovations. We then share experiences with currently available neuroimaging checklists. We review the motivation for creating checklists and whether checklists achieve their intended objectives, before proposing a development cycle for neuroimaging reporting checklists and describing each implementation step. We emphasize the importance of reporting checklists in enhancing the quality of data repositories and consortia, how they can support education and best practices, and how emerging computational methods, like artificial intelligence, can help checklist development and adherence. We also highlight the role that funding agencies and global collaborations can play in supporting the adoption of neuroimaging reporting checklists. We hope this review will encourage better adherence to available checklists and promote the development of new ones, and ultimately increase the quality, transparency, and reproducibility of neuroimaging research.
Collapse
Affiliation(s)
- Hamed Ekhtiari
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
- Laureate Institute for Brain Research, Tulsa, OK, USA.
| | - Mehran Zare-Bidoky
- Iranian National Center for Addiction Studies, Tehran University of Medical Sciences, Tehran, Iran
| | - Arshiya Sangchooli
- Melbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Alireza Valyan
- Iranian National Center for Addiction Studies, Tehran University of Medical Sciences, Tehran, Iran
| | - Anissa Abi-Dargham
- Department of Psychiatry and Behavioral Health, Stony Brook University Renaissance School of Medicine, Stony Brook, NY, USA
- Department of Psychiatry, Columbia University Vagelos School of Medicine and New York State Psychiatric Institute, New York, NY, USA
| | - Dara M Cannon
- Clinical Neuroimaging Laboratory, Center for Neuroimaging, Cognition & Genomics, College of Medicine, Nursing & Health Sciences, University of Galway, Galway, Ireland
| | - Cameron S Carter
- Department of Psychiatry and Human Behavior, University of California at Irvine, Irvine, CA, USA
| | - Hugh Garavan
- Departments of Psychiatry and Psychology, University of Vermont, Burlington, VT, USA
| | - Tony P George
- Institute for Mental Health Policy and Research at CAMH, Toronto, ON, Canada
- Department of Psychiatry, Institute of Medical Sciences, University of Toronto, Toronto, ON, Canada
| | - Peyman Ghobadi-Azbari
- Iranian National Center for Addiction Studies, Tehran University of Medical Sciences, Tehran, Iran
| | - Christoph Juchem
- Department of Biomedical Engineering, Columbia University Fu Foundation, School of Engineering and Applied Science, New York, NY, USA
- Department of Radiology, Columbia University College of Physicians and Surgeons, New York, NY, USA
| | - John H Krystal
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- U.S. Department of Veterans Affairs National Center for Posttraumatic Stress Disorder, Clinical Neurosciences Division, VA Connecticut Healthcare System, West Haven, CT, USA
| | - Thomas E Nichols
- Nuffield Department of Population Health, Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, University of Oxford, Oxford, UK
| | - Dost Öngür
- McLean Hospital, Belmont, MA, USA
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA
| | - Cyril R Pernet
- Neurobiology Research Unit, Copenhagen University Hospital, Rigshospitalet, Copenhagen, Denmark
| | | | - Paul M Thompson
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA
| | | |
Collapse
|
2
|
Bernier A, Knoppers BM, Bermudez P, Beauvais MJS, Thorogood A. Open Data governance at the Canadian Open Neuroscience Platform (CONP): From the Walled Garden to the Arboretum. Gigascience 2024; 13:giad114. [PMID: 38217404 PMCID: PMC10787360 DOI: 10.1093/gigascience/giad114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 11/14/2023] [Accepted: 12/10/2023] [Indexed: 01/15/2024] Open
Abstract
Scientific research communities pursue dual imperatives in implementing strategies to share their data. These communities attempt to maximize the accessibility of biomedical data for downstream research use, in furtherance of open science objectives. Simultaneously, such communities safeguard the interests of research participants through data stewardship measures and the integration of suitable risk disclosures to the informed consent process. The Canadian Open Neuroscience Platform (CONP) convened an Ethics and Governance Committee composed of experts in bioethics, neuroethics, and law to develop holistic policy tools, organizational approaches, and technological supports to align the open governance of data with ethical and legal norms. The CONP has adopted novel platform governance methods that favor full data openness, legitimated through the use of robust deidentification processes and informed consent practices. The experience of the CONP is articulated as a potential template for other open science efforts to further build upon. This experience highlights informed consent guidance, deidentification practices, ethicolegal metadata, platform-level norms, and commercialization and publication policies as the principal pillars of a practicable approach to the governance of open data. The governance approach adopted by the CONP stands as a viable model for the broader neuroscience and open science communities to adopt for sharing data in full open access.
Collapse
Affiliation(s)
- Alexander Bernier
- Centre of Genomics and Policy, Department of Human Genetics, Faculty of Medicine and Health Sciences, McGill University, 740, Dr Penfield Ave, suite 5200, Montréal, Québec H3A 0G1, Canada
| | - Bartha M Knoppers
- Centre of Genomics and Policy, Department of Human Genetics, Faculty of Medicine and Health Sciences, McGill University, 740, Dr Penfield Ave, suite 5200, Montréal, Québec H3A 0G1, Canada
| | - Patrick Bermudez
- McGill Centre for Integrative Neuroscience, Montreal Neurological Institute, McGill University, Montréal, Québec H3A 2B4, Canada
| | - Michael J S Beauvais
- Faculty of Law, University of Toronto, Falconer Hall, 84 Queens Park, Toronto, Ontario M5S 2C5, Canada
| | - Adrian Thorogood
- The Terry Fox Research Institute, 110 Pine Ave W, Montreal, Quebec H2W IR7, Canada
| |
Collapse
|
3
|
Herington J, Connelly K, Illes J. Ethical Imperatives for Working With Diverse Populations in Digital Research. J Med Internet Res 2023; 25:e47884. [PMID: 37721792 PMCID: PMC10546274 DOI: 10.2196/47884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 07/17/2023] [Accepted: 07/20/2023] [Indexed: 09/19/2023] Open
Abstract
Digital research methodologies are driving a revolution in health technology but do not yet fully engage diverse and historically underrepresented populations. In this paper, we explore the ethical imperative for such engagement alongside accompanying challenges related to recruitment, appreciation of risk, and confidentiality, among others. We critically analyze existing research ethics frameworks and find that their reliance on individualistic and autonomy-focused models of research ethics does not offer adequate protection in the context of the diversity imperative. To meet the requirements of justice and inclusivity in digital research, methods will benefit from a reorientation toward more participatory practices.
Collapse
Affiliation(s)
- Jonathan Herington
- Department of Health Humanities and Bioethics, University of Rochester, Rochester, NY, United States
| | - Kay Connelly
- Department of Informatics, Indiana University, Bloomington, IN, United States
- College of Engineering, Michigan State University, Lansing, MI, United States
| | - Judy Illes
- Neuroethics Canada, Division of Neurology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
4
|
Knoppers BM, Bernier A, Bowers S, Kirby E. Open Data in the Era of the GDPR: Lessons from the Human Cell Atlas. Annu Rev Genomics Hum Genet 2023; 24:369-391. [PMID: 36791787 DOI: 10.1146/annurev-genom-101322-113255] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2023]
Abstract
The Human Cell Atlas (HCA) is striving to build an open community that is inclusive of all researchers adhering to its principles and as open as possible with respect to data access and use. However, open data sharing can pose certain challenges. For instance, being a global initiative, the HCA must contend with a patchwork of local and regional privacy rules. A notable example is the implementation of the European Union General Data Protection Regulation (GDPR), which caused some concern in the biomedical and genomic data-sharing community. We examine how the HCA's large, international group of researchers is investing tremendous efforts into ensuring appropriate sharing of data. We describe the HCA's objectives and governance, how it defines open data sharing, and ethico-legal challenges encountered early in its development; in particular, we describe the challenges prompted by the GDPR. Finally, we broaden the discussion to address tools and strategies that can be used to address ethical data governance.
Collapse
Affiliation(s)
- Bartha Maria Knoppers
- Centre of Genomics and Policy, School of Biomedical Sciences, Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada; , ,
| | - Alexander Bernier
- Centre of Genomics and Policy, School of Biomedical Sciences, Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada; , ,
| | | | - Emily Kirby
- Centre of Genomics and Policy, School of Biomedical Sciences, Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada; , ,
| |
Collapse
|
5
|
An Indigenous Lens on Priorities for the Canadian Brain Research Strategy. Can J Neurol Sci 2023; 50:96-98. [PMID: 34847973 DOI: 10.1017/cjn.2021.501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
6
|
Khalil AT, Shinwari ZK, Islam A. Fostering openness in open science: An ethical discussion of risks and benefits. FRONTIERS IN POLITICAL SCIENCE 2022; 4. [DOI: 10.3389/fpos.2022.930574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
Transformation of science by embracing the concepts of open science presents a very attractive strategy to enhance the reliability of science. Open science policies embody the concepts of open data and open access that encompass sharing of resources, dissemination of ideas, and synergizing the collaborative forums of research. Despite the opportunities in openness, however, there are grave ethical concerns too, and they present a dual-use dilemma. Access to sensitive information is seen as a security risk, and it also possesses other concerns such as confidentiality, privacy, and affordability. There are arguments that open science can be harmful to marginalized groups. Through this study, we aim to discuss the opportunities of open science, as well as the ethical and security aspects, which require further deliberation before full-fledged acceptance in the science community.
Collapse
|
7
|
Chiware ERT, Skelly L. Open Science in Africa: What policymakers should consider. Front Res Metr Anal 2022; 7:950139. [PMID: 36407914 PMCID: PMC9670184 DOI: 10.3389/frma.2022.950139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2022] [Accepted: 10/13/2022] [Indexed: 12/02/2022] Open
Abstract
As Open Science (OS) is being promoted as the best avenue to share and drive scientific discoveries at much lower costs and in transparent and credible ways, it is imperative that African governments and institutions take advantage of the momentum and build research infrastructures that are responsive to this movement. This paper aims to provide useful insight into the importance and implementation of OS policy frameworks. The paper uses a systematic review approach to review existing literature and analyse global OS policy development documents. The approach includes a review of existing OS policy frameworks that can guide similar work by African governments and institutions. This critical review also makes recommendations on key issues that Africa should consider in the process of OS policy development. These approaches can be widely used as further foundations for future developments in OS practices on the continent.
Collapse
Affiliation(s)
- Elisha R. T. Chiware
- 1Cape Peninsula University of Technology Library, Cape Peninsula University of Technology, Cape Town, South Africa,*Correspondence: Elisha R. T. Chiware
| | - Lara Skelly
- 2Loughborough University Library, Loughborough University, Loughborough, United Kingdom,3Stellenbosch Business School, Stellenbosch University, Stellenbosch, South Africa
| |
Collapse
|
8
|
Singh NM, Harrod JB, Subramanian S, Robinson M, Chang K, Cetin-Karayumak S, Dalca AV, Eickhoff S, Fox M, Franke L, Golland P, Haehn D, Iglesias JE, O'Donnell LJ, Ou Y, Rathi Y, Siddiqi SH, Sun H, Westover MB, Whitfield-Gabrieli S, Gollub RL. How Machine Learning is Powering Neuroimaging to Improve Brain Health. Neuroinformatics 2022; 20:943-964. [PMID: 35347570 PMCID: PMC9515245 DOI: 10.1007/s12021-022-09572-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/07/2022] [Indexed: 12/31/2022]
Abstract
This report presents an overview of how machine learning is rapidly advancing clinical translational imaging in ways that will aid in the early detection, prediction, and treatment of diseases that threaten brain health. Towards this goal, we aresharing the information presented at a symposium, "Neuroimaging Indicators of Brain Structure and Function - Closing the Gap Between Research and Clinical Application", co-hosted by the McCance Center for Brain Health at Mass General Hospital and the MIT HST Neuroimaging Training Program on February 12, 2021. The symposium focused on the potential for machine learning approaches, applied to increasingly large-scale neuroimaging datasets, to transform healthcare delivery and change the trajectory of brain health by addressing brain care earlier in the lifespan. While not exhaustive, this overview uniquely addresses many of the technical challenges from image formation, to analysis and visualization, to synthesis and incorporation into the clinical workflow. Some of the ethical challenges inherent to this work are also explored, as are some of the regulatory requirements for implementation. We seek to educate, motivate, and inspire graduate students, postdoctoral fellows, and early career investigators to contribute to a future where neuroimaging meaningfully contributes to the maintenance of brain health.
Collapse
Affiliation(s)
- Nalini M Singh
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Jordan B Harrod
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Sandya Subramanian
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Mitchell Robinson
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Ken Chang
- Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Suheyla Cetin-Karayumak
- Department of Psychiatry, Brigham and Women's Hospital and Harvard Medical School, Boston, 02115, USA
| | | | - Simon Eickhoff
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7) Research Centre Jülich, Jülich, Germany
| | - Michael Fox
- Center for Brain Circuit Therapeutics, Department of Neurology, Psychiatry, and Radiology, Brigham and Women's Hospital and Harvard Medical School, 02115, Boston, USA
| | - Loraine Franke
- University of Massachusetts Boston, Boston, MA, 02125, USA
| | - Polina Golland
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Daniel Haehn
- University of Massachusetts Boston, Boston, MA, 02125, USA
| | - Juan Eugenio Iglesias
- Centre for Medical Image Computing, University College London, London, UK
- Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, 02114, USA
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Lauren J O'Donnell
- Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, MA, 02115, Boston, USA
| | - Yangming Ou
- Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA, 02115, USA
| | - Yogesh Rathi
- Department of Psychiatry, Brigham and Women's Hospital and Harvard Medical School, Boston, 02115, USA
| | - Shan H Siddiqi
- Department of Psychiatry, Brigham and Women's Hospital and Harvard Medical School, Boston, 02115, USA
| | - Haoqi Sun
- Department of Neurology and McCance Center for Brain Health / Harvard Medical School, Massachusetts General Hospital, Boston, 02114, USA
| | - M Brandon Westover
- Department of Neurology and McCance Center for Brain Health / Harvard Medical School, Massachusetts General Hospital, Boston, 02114, USA
| | | | - Randy L Gollub
- Department of Psychiatry and Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA, 02114, USA.
| |
Collapse
|