1
|
Renton AI, Dao TT, Johnstone T, Civier O, Sullivan RP, White DJ, Lyons P, Slade BM, Abbott DF, Amos TJ, Bollmann S, Botting A, Campbell MEJ, Chang J, Close TG, Dörig M, Eckstein K, Egan GF, Evas S, Flandin G, Garner KG, Garrido MI, Ghosh SS, Grignard M, Halchenko YO, Hannan AJ, Heinsfeld AS, Huber L, Hughes ME, Kaczmarzyk JR, Kasper L, Kuhlmann L, Lou K, Mantilla-Ramos YJ, Mattingley JB, Meier ML, Morris J, Narayanan A, Pestilli F, Puce A, Ribeiro FL, Rogasch NC, Rorden C, Schira MM, Shaw TB, Sowman PF, Spitz G, Stewart AW, Ye X, Zhu JD, Narayanan A, Bollmann S. Neurodesk: an accessible, flexible and portable data analysis environment for reproducible neuroimaging. Nat Methods 2024; 21:804-808. [PMID: 38191935 PMCID: PMC11180540 DOI: 10.1038/s41592-023-02145-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 11/27/2023] [Indexed: 01/10/2024]
Abstract
Neuroimaging research requires purpose-built analysis software, which is challenging to install and may produce different results across computing environments. The community-oriented, open-source Neurodesk platform ( https://www.neurodesk.org/ ) harnesses a comprehensive and growing suite of neuroimaging software containers. Neurodesk includes a browser-accessible virtual desktop, command-line interface and computational notebook compatibility, allowing for accessible, flexible, portable and fully reproducible neuroimaging analysis on personal workstations, high-performance computers and the cloud.
Collapse
Affiliation(s)
- Angela I Renton
- The University of Queensland, Queensland Brain Institute, St Lucia, Brisbane, Queensland, Australia.
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia.
| | - Thuy T Dao
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
| | - Tom Johnstone
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - Oren Civier
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - Ryan P Sullivan
- The University of Sydney, School of Biomedical Engineering, Sydney, New South Wales, Australia
| | - David J White
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - Paris Lyons
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - Benjamin M Slade
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - David F Abbott
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Melbourne, Victoria, Australia
| | - Toluwani J Amos
- School of Life Science and Technology, University of Electronic Science and Technology, Chengdu, China
| | - Saskia Bollmann
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
| | - Andy Botting
- Australian Research Data Commons (ARDC), Sydney, New South Wales, Australia
| | - Megan E J Campbell
- School of Psychological Sciences, University of Newcastle, Newcastle, New South Wales, Australia
- Hunter Medical Research Institute Imaging Centre, Newcastle, New South Wales, Australia
| | - Jeryn Chang
- The University of Queensland, School of Biomedical Sciences, St Lucia, Brisbane, Queensland, Australia
| | - Thomas G Close
- The University of Sydney, School of Biomedical Engineering, Sydney, New South Wales, Australia
| | - Monika Dörig
- Integrative Spinal Research, Department of Chiropractic Medicine, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Korbinian Eckstein
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
| | - Gary F Egan
- The Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
- Monash Biomedical Imaging, Monash University, Melbourne, Victoria, Australia
| | - Stefanie Evas
- School of Psychology, University of Adelaide, Adelaide, South Australia, Australia
- Human Health, Health & Biosecurity, CSIRO, Adelaide, South Australia, Australia
| | - Guillaume Flandin
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Kelly G Garner
- School of Psychology, University of New South Wales, Sydney, New South Wales, Australia
- The University of Queensland, School of Psychology, St Lucia, Brisbane, Queensland, Australia
| | - Marta I Garrido
- Melbourne School of Psychological Sciences, he University of Melbourne, Melbourne, Victoria, Australia
- Graeme Clark Institute for Biomedical Engineering, The University of Melbourne, Melbourne, Victoria, Australia
| | - Satrajit S Ghosh
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Otolaryngology - Head and Neck Surgery, Harvard Medical School, Boston, MA, USA
| | - Martin Grignard
- GIGA CRC In-Vivo Imaging, University of Liège, Liège, Belgium
| | - Yaroslav O Halchenko
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Anthony J Hannan
- The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Melbourne, Victoria, Australia
| | - Anibal S Heinsfeld
- Department of Psychology, Center for Perceptual Systems, Institute for Neuroscience, Center For Learning and Memory, The University of Texas at Austin, Austin, TX, USA
| | - Laurentius Huber
- National Institute of Mental Health (NIMH), National Institutes Health, Bethesda, MD, USA
| | - Matthew E Hughes
- Centre for Mental Health & Brain Sciences, Swinburne University of Technology, Hawthorn, Victoria, Australia
| | - Jakub R Kaczmarzyk
- Department of Biomedical Informatics, Stony Brook University, New York, NY, USA
- Simons Center for Quantitative Biology, Cold Spring Harbor Laboratory, New York, NY, USA
| | - Lars Kasper
- BRAIN-TO Lab, Krembil Brain Institute, University Health Network, Toronto, Ontario, Canada
- Translational Neuromodeling Unit, Institute for Biomedical Engineering, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Levin Kuhlmann
- Department of Data Science and AI, Faculty of Information Technology, Monash University, Melbourne, Victoria, Australia
| | - Kexin Lou
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
- Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen, China
| | - Yorguin-Jose Mantilla-Ramos
- Grupo Neuropsicología y Conducta (GRUNECO), Facultad de Medicina, Universidad de Antioquia, Medellín, Colombia
| | - Jason B Mattingley
- The University of Queensland, Queensland Brain Institute, St Lucia, Brisbane, Queensland, Australia
- The University of Queensland, School of Psychology, St Lucia, Brisbane, Queensland, Australia
| | - Michael L Meier
- Integrative Spinal Research, Department of Chiropractic Medicine, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Jo Morris
- Australian Research Data Commons (ARDC), Sydney, New South Wales, Australia
| | - Akshaiy Narayanan
- School of Computer Science, The University of Auckland, Auckland, New Zealand
| | - Franco Pestilli
- Department of Psychology, Center for Perceptual Systems, Institute for Neuroscience, Center For Learning and Memory, The University of Texas at Austin, Austin, TX, USA
| | - Aina Puce
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA
| | - Fernanda L Ribeiro
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
| | - Nigel C Rogasch
- The Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
- Discipline of Psychiatry, Adelaide Medical School, University of Adelaide, Adelaide, South Australia, Australia
- Hopwood Centre for Neurobiology, Lifelong Health Theme, South Australian Health and Medical Research Institute (SAHMRI), Adelaide, South Australia, Australia
| | - Chris Rorden
- McCausland Center for Brain Imaging, Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Mark M Schira
- School of Psychology, University of Wollongong, Wollongong, New South Wales, Australia
| | - Thomas B Shaw
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
- The University of Queensland, Centre for Advanced Imaging, St Lucia, Brisbane, Queensland, Australia
- Department of Neurology, Royal Brisbane and Women's Hospital, Brisbane, Queensland, Australia
| | - Paul F Sowman
- Macquarie University, School of Psychological Sciences, Sydney, New South Wales, Australia
| | - Gershon Spitz
- Department of Neuroscience, Central Clinical School, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Victoria, Australia
- Monash-Epworth Rehabilitation Research Centre, Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
| | - Ashley W Stewart
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
- ARC Training Centre for Innovation in Biomedical Imaging Technology, The University of Queensland, Brisbane, Queensland, Australia
| | - Xincheng Ye
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia
| | - Judy D Zhu
- Macquarie University, School of Psychological Sciences, Sydney, New South Wales, Australia
| | - Aswin Narayanan
- The University of Queensland, Centre for Advanced Imaging, St Lucia, Brisbane, Queensland, Australia
| | - Steffen Bollmann
- The University of Queensland, School of Electrical Engineering and Computer Science, St Lucia, Brisbane, Queensland, Australia.
- The University of Queensland, Centre for Advanced Imaging, St Lucia, Brisbane, Queensland, Australia.
- ARC Training Centre for Innovation in Biomedical Imaging Technology, The University of Queensland, Brisbane, Queensland, Australia.
- Queensland Digital Health Centre, The University of Queensland, Brisbane, Queensland, Australia.
| |
Collapse
|
2
|
Ziemann M, Poulain P, Bora A. The five pillars of computational reproducibility: bioinformatics and beyond. Brief Bioinform 2023; 24:bbad375. [PMID: 37870287 PMCID: PMC10591307 DOI: 10.1093/bib/bbad375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 09/26/2023] [Accepted: 09/30/2023] [Indexed: 10/24/2023] Open
Abstract
Computational reproducibility is a simple premise in theory, but is difficult to achieve in practice. Building upon past efforts and proposals to maximize reproducibility and rigor in bioinformatics, we present a framework called the five pillars of reproducible computational research. These include (1) literate programming, (2) code version control and sharing, (3) compute environment control, (4) persistent data sharing and (5) documentation. These practices will ensure that computational research work can be reproduced quickly and easily, long into the future. This guide is designed for bioinformatics data analysts and bioinformaticians in training, but should be relevant to other domains of study.
Collapse
Affiliation(s)
- Mark Ziemann
- Deakin University, School of Life and Environmental Sciences, Geelong, Australia
- Burnet Institute, Melbourne, Australia
| | - Pierre Poulain
- Université Paris Cité, CNRS, Institut Jacques Monod, Paris, France
| | - Anusuiya Bora
- Deakin University, School of Life and Environmental Sciences, Geelong, Australia
| |
Collapse
|
3
|
Harding RJ, Bermudez P, Bernier A, Beauvais M, Bellec P, Hill S, Karakuzu A, Knoppers BM, Pavlidis P, Poline JB, Roskams J, Stikov N, Stone J, Strother S, Evans AC. The Canadian Open Neuroscience Platform-An open science framework for the neuroscience community. PLoS Comput Biol 2023; 19:e1011230. [PMID: 37498959 PMCID: PMC10374086 DOI: 10.1371/journal.pcbi.1011230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/29/2023] Open
Abstract
The Canadian Open Neuroscience Platform (CONP) takes a multifaceted approach to enabling open neuroscience, aiming to make research, data, and tools accessible to everyone, with the ultimate objective of accelerating discovery. Its core infrastructure is the CONP Portal, a repository with a decentralized design, where datasets and analysis tools across disparate platforms can be browsed, searched, accessed, and shared in accordance with FAIR principles. Another key piece of CONP infrastructure is NeuroLibre, a preprint server capable of creating and hosting executable and fully reproducible scientific publications that embed text, figures, and code. As part of its holistic approach, the CONP has also constructed frameworks and guidance for ethics and data governance, provided support and developed resources to help train the next generation of neuroscientists, and has fostered and grown an engaged community through outreach and communications. In this manuscript, we provide a high-level overview of this multipronged platform and its vision of lowering the barriers to the practice of open neuroscience and yielding the associated benefits for both individual researchers and the wider community.
Collapse
Affiliation(s)
- Rachel J Harding
- Structural Genomics Consortium, University of Toronto, Toronto, Ontario, Canada
| | - Patrick Bermudez
- McGill Centre for Integrative Neuroscience, Montreal Neurological Institute, McGill University, Montréal, Québec, Canada
| | - Alexander Bernier
- Centre of Genomics and Policy, Department of Human Genetics, Faculty of Medicine, McGill University, Montréal, Québec, Canada
| | - Michael Beauvais
- Centre of Genomics and Policy, Department of Human Genetics, Faculty of Medicine, McGill University, Montréal, Québec, Canada
| | - Pierre Bellec
- Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal, Montréal, Québec, Canada
- Department of Psychology, Université de Montréal, Montréal, Québec, Canada
| | - Sean Hill
- Krembil Centre for Neuroinformatics, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Institute of Medical Sciences, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Physiology, University of Toronto, Toronto, Ontario, Canada
| | - Agâh Karakuzu
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montréal, Montréal, Québec, Canada
- Montréal Heart Institute, Université de Montréal, Montréal, Québec, Canada
| | - Bartha M Knoppers
- Centre of Genomics and Policy, Department of Human Genetics, Faculty of Medicine, McGill University, Montréal, Québec, Canada
- Canada Research Chair in Law and Medicine, Montréal, Québec, Canada
| | - Paul Pavlidis
- Michael Smith Laboratories, University of British Columbia, Vancouver, British Columbia, Canada
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia, Canada
- Djavad Mowafaghian Center for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jean-Baptiste Poline
- ORIGAMI Neuro Data Science Laboratory, Montreal Neurological Institute, McGill University, Montréal, Québec, Canada
| | - Jane Roskams
- Djavad Mowafaghian Center for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada
- Neurosurgery University of Washington, Seattle, Washington, United States of America
| | - Nikola Stikov
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montréal, Montréal, Québec, Canada
- Montréal Heart Institute, Université de Montréal, Montréal, Québec, Canada
- Center for Advanced Interdisciplinary Research, Ss. Cyril and Methodius University, Skopje, North Macedonia
| | - Jessica Stone
- McGill Centre for Integrative Neuroscience, Montreal Neurological Institute, McGill University, Montréal, Québec, Canada
| | - Stephen Strother
- Rotman Research Institute, Baycrest, and Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada
| | - Alan C Evans
- McGill Centre for Integrative Neuroscience, Montreal Neurological Institute, McGill University, Montréal, Québec, Canada
| |
Collapse
|
4
|
Niso G, Botvinik-Nezer R, Appelhoff S, De La Vega A, Esteban O, Etzel JA, Finc K, Ganz M, Gau R, Halchenko YO, Herholz P, Karakuzu A, Keator DB, Markiewicz CJ, Maumet C, Pernet CR, Pestilli F, Queder N, Schmitt T, Sójka W, Wagner AS, Whitaker KJ, Rieger JW. Open and reproducible neuroimaging: From study inception to publication. Neuroimage 2022; 263:119623. [PMID: 36100172 PMCID: PMC10008521 DOI: 10.1016/j.neuroimage.2022.119623] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 08/17/2022] [Accepted: 09/09/2022] [Indexed: 10/31/2022] Open
Abstract
Empirical observations of how labs conduct research indicate that the adoption rate of open practices for transparent, reproducible, and collaborative science remains in its infancy. This is at odds with the overwhelming evidence for the necessity of these practices and their benefits for individual researchers, scientific progress, and society in general. To date, information required for implementing open science practices throughout the different steps of a research project is scattered among many different sources. Even experienced researchers in the topic find it hard to navigate the ecosystem of tools and to make sustainable choices. Here, we provide an integrated overview of community-developed resources that can support collaborative, open, reproducible, replicable, robust and generalizable neuroimaging throughout the entire research cycle from inception to publication and across different neuroimaging modalities. We review tools and practices supporting study inception and planning, data acquisition, research data management, data processing and analysis, and research dissemination. An online version of this resource can be found at https://oreoni.github.io. We believe it will prove helpful for researchers and institutions to make a successful and sustainable move towards open and reproducible science and to eventually take an active role in its future development.
Collapse
Affiliation(s)
- Guiomar Niso
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Universidad Politecnica de Madrid, Madrid and CIBER-BBN, Spain; Instituto Cajal, CSIC, Madrid, Spain.
| | - Rotem Botvinik-Nezer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Stefan Appelhoff
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | | | - Oscar Esteban
- Dept. of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; Department of Psychology, Stanford University, Stanford, CA, USA
| | - Joset A Etzel
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | - Karolina Finc
- Centre for Modern Interdisciplinary Technologies, Nicolaus Copernicus University, Toruń, Poland
| | - Melanie Ganz
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Rémi Gau
- Institute of Psychology, Université catholique de Louvain, Louvain la Neuve, Belgium
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Peer Herholz
- Montreal Neurological Institute-Hospital, McGill University, Montréal, Quebec, Canada
| | - Agah Karakuzu
- Biomedical Engineering Institute, Polytechnique Montréal, Montréal, Quebec, Canada; Montréal Heart Institute, Montréal, Quebec, Canada
| | - David B Keator
- Department of Psychiatry and Human Behavior, University of California, Irvine, CA, USA
| | | | - Camille Maumet
- Inria, Univ Rennes, CNRS, Inserm - IRISA UMR 6074, Empenn ERL U 1228, Rennes, France
| | - Cyril R Pernet
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark
| | - Franco Pestilli
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Department of Psychology, The University of Texas at Austin, Austin, TX, USA
| | - Nazek Queder
- Montreal Neurological Institute-Hospital, McGill University, Montréal, Quebec, Canada; Department of Neurobiology and Behavior, University of California, Irvine, CA, USA
| | - Tina Schmitt
- Neuroimaging Unit, Carl-von-Ossietzky Universität, Oldenburg, Germany
| | - Weronika Sójka
- Faculty of Philosophy and Social Sciences, Nicolaus Copernicus University, Toruń, Poland
| | - Adina S Wagner
- Institute for Neuroscience and Medicine, Research Centre Juelich, Germany
| | | | - Jochem W Rieger
- Neuroimaging Unit, Carl-von-Ossietzky Universität, Oldenburg, Germany; Department of Psychology, Carl-von-Ossietzky Universität, Oldenburg, Germany.
| |
Collapse
|
5
|
Karakuzu A, Appelhoff S, Auer T, Boudreau M, Feingold F, Khan AR, Lazari A, Markiewicz C, Mulder M, Phillips C, Salo T, Stikov N, Whitaker K, de Hollander G. qMRI-BIDS: An extension to the brain imaging data structure for quantitative magnetic resonance imaging data. Sci Data 2022; 9:517. [PMID: 36002444 PMCID: PMC9402561 DOI: 10.1038/s41597-022-01571-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 07/19/2022] [Indexed: 11/16/2022] Open
Abstract
The Brain Imaging Data Structure (BIDS) established community consensus on the organization of data and metadata for several neuroimaging modalities. Traditionally, BIDS had a strong focus on functional magnetic resonance imaging (MRI) datasets and lacked guidance on how to store multimodal structural MRI datasets. Here, we present and describe the BIDS Extension Proposal 001 (BEP001), which adds a range of quantitative MRI (qMRI) applications to the BIDS. In general, the aim of qMRI is to characterize brain microstructure by quantifying the physical MR parameters of the tissue via computational, biophysical models. By proposing this new standard, we envision standardization of qMRI through multicenter dissemination of interoperable datasets. This way, BIDS can act as a catalyst of convergence between qMRI methods development and application-driven neuroimaging studies that can help develop quantitative biomarkers for neural tissue characterization. In conclusion, this BIDS extension offers a common ground for developers to exchange novel imaging data and tools, reducing the entrance barrier for qMRI in the field of neuroimaging.
Collapse
Affiliation(s)
- Agah Karakuzu
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada. .,Montreal Heart Institute, Montreal, QC, Canada.
| | - Stefan Appelhoff
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Tibor Auer
- NeuroModulation Lab, School of Psychology, University of Surrey, Guildford, UK
| | - Mathieu Boudreau
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada.,Montreal Heart Institute, Montreal, QC, Canada
| | | | - Ali R Khan
- Department of Medical Biophysics, Robarts Research Institute, University of Western Ontario, London, Canada
| | - Alberto Lazari
- Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | | | - Martijn Mulder
- Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | - Christophe Phillips
- GIGA Cyclotron Research Centre in vivo imaging, GIGA Institute, University of Liège, Liège, Belgium
| | - Taylor Salo
- Florida International University, Miami, FL, USA
| | - Nikola Stikov
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada.,Montreal Heart Institute, Montreal, QC, Canada.,Center for Advanced Interdisciplinary Research, Ss. Cyril and Methodius University, Skopje, North Macedonia
| | | | - Gilles de Hollander
- Zurich Center for Neuroeconomics (ZNE), Department of Economics, University of Zurich, Zurich, Switzerland. .,Spinoza Centre for Neuroimaging, Amsterdam, The Netherlands.
| |
Collapse
|
6
|
Karakuzu A, Biswas L, Cohen-Adad J, Stikov N. Vendor-neutral sequences and fully transparent workflows improve inter-vendor reproducibility of quantitative MRI. Magn Reson Med 2022; 88:1212-1228. [PMID: 35657066 DOI: 10.1002/mrm.29292] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 04/18/2022] [Accepted: 04/19/2022] [Indexed: 12/20/2022]
Abstract
PURPOSE We developed an end-to-end workflow that starts with a vendor-neutral acquisition and tested the hypothesis that vendor-neutral sequences decrease inter-vendor variability of T1, magnetization transfer ratio (MTR), and magnetization transfer saturation-index (MTsat) measurements. METHODS We developed and deployed a vendor-neutral 3D spoiled gradient-echo (SPGR) sequence on three clinical scanners by two MRI vendors. We then acquired T1 maps on the ISMRM-NIST system phantom, as well as T1, MTR, and MTsat maps in three healthy participants. We performed hierarchical shift function analysis in vivo to characterize the differences between scanners when the vendor-neutral sequence is used instead of commercial vendor implementations. Inter-vendor deviations were compared for statistical significance to test the hypothesis. RESULTS In the phantom, the vendor-neutral sequence reduced inter-vendor differences from 8% to 19.4% to 0.2% to 5% with an overall accuracy improvement, reducing ground truth T1 deviations from 7% to 11% to 0.2% to 4%. In vivo, we found that the variability between vendors is significantly reduced (p = 0.015) for all maps (T1, MTR, and MTsat) using the vendor-neutral sequence. CONCLUSION We conclude that vendor-neutral workflows are feasible and compatible with clinical MRI scanners. The significant reduction of inter-vendor variability using vendor-neutral sequences has important implications for qMRI research and for the reliability of multicenter clinical trials.
Collapse
Affiliation(s)
- Agah Karakuzu
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montréal, Montréal, Quebec, Canada.,Montréal Heart Institute, Montréal, Quebec, Canada
| | - Labonny Biswas
- Sunnybrook Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - Julien Cohen-Adad
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montréal, Montréal, Quebec, Canada.,Functional Neuroimaging Unit, CRIUGM, Université de Montréal, Montréal, Quebec, Canada.,Mila - Quebec AI Institute, Montreal, Quebec, Canada
| | - Nikola Stikov
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montréal, Montréal, Quebec, Canada.,Montréal Heart Institute, Montréal, Quebec, Canada.,Center for Advanced Interdisciplinary Research, Ss. Cyril and Methodius University, Skopje, North Macedonia
| |
Collapse
|
7
|
Abstract
Recent advances in imaging and tracing technology provide increasingly detailed reconstructions of brain connectomes. Concomitant analytic advances enable rigorous identification and quantification of functionally important features of brain network architecture. Null models are a flexible tool to statistically benchmark the presence or magnitude of features of interest, by selectively preserving specific architectural properties of brain networks while systematically randomizing others. Here we describe the logic, implementation and interpretation of null models of connectomes. We introduce randomization and generative approaches to constructing null networks, and outline a taxonomy of network methods for statistical inference. We highlight the spectrum of null models - from liberal models that control few network properties, to conservative models that recapitulate multiple properties of empirical networks - that allow us to operationalize and test detailed hypotheses about the structure and function of brain networks. We review emerging scenarios for the application of null models in network neuroscience, including for spatially embedded networks, annotated networks and correlation-derived networks. Finally, we consider the limits of null models, as well as outstanding questions for the field.
Collapse
|