51
|
fMRI reliability: influences of task and experimental design. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2014; 13:690-702. [PMID: 23934630 DOI: 10.3758/s13415-013-0195-1] [Citation(s) in RCA: 63] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
As scientists, it is imperative that we understand not only the power of our research tools to yield results, but also their ability to obtain similar results over time. This study is an investigation into how common decisions made during the design and analysis of a functional magnetic resonance imaging (fMRI) study can influence the reliability of the statistical results. To that end, we gathered back-to-back test-retest fMRI data during an experiment involving multiple cognitive tasks (episodic recognition and two-back working memory) and multiple fMRI experimental designs (block, event-related genetic sequence, and event-related m-sequence). Using these data, we were able to investigate the relative influences of task, design, statistical contrast (task vs. rest, target vs. nontarget), and statistical thresholding (unthresholded, thresholded) on fMRI reliability, as measured by the intraclass correlation (ICC) coefficient. We also utilized data from a second study to investigate test-retest reliability after an extended, six-month interval. We found that all of the factors above were statistically significant, but that they had varying levels of influence on the observed ICC values. We also found that these factors could interact, increasing or decreasing the relative reliability of certain Task × Design combinations. The results suggest that fMRI reliability is a complex construct whose value may be increased or decreased by specific combinations of factors.
Collapse
|
52
|
Healthy children show gender differences in correlations between nonverbal cognitive ability and brain activation during visual perception. Neurosci Lett 2014; 577:66-71. [DOI: 10.1016/j.neulet.2014.06.015] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2014] [Revised: 05/27/2014] [Accepted: 06/06/2014] [Indexed: 11/17/2022]
|
53
|
Stelzer J, Lohmann G, Mueller K, Buschmann T, Turner R. Deficient approaches to human neuroimaging. Front Hum Neurosci 2014; 8:462. [PMID: 25071503 PMCID: PMC4076796 DOI: 10.3389/fnhum.2014.00462] [Citation(s) in RCA: 50] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2014] [Accepted: 06/06/2014] [Indexed: 11/18/2022] Open
Abstract
Functional magnetic resonance imaging (fMRI) is the workhorse of imaging-based human cognitive neuroscience. The use of fMRI is ever-increasing; within the last 4 years more fMRI studies have been published than in the previous 17 years. This large body of research has mainly focused on the functional localization of condition- or stimulus-dependent changes in the blood-oxygenation-level dependent signal. In recent years, however, many aspects of the commonly practiced analysis frameworks and methodologies have been critically reassessed. Here we summarize these critiques, providing an overview of the major conceptual and practical deficiencies in widely used brain-mapping approaches, and exemplify some of these issues by the use of imaging data and simulations. In particular, we discuss the inherent pitfalls and shortcomings of methodologies for statistical parametric mapping. Our critique emphasizes recent reports of excessively high numbers of both false positive and false negative findings in fMRI brain mapping. We outline our view regarding the broader scientific implications of these methodological considerations and briefly discuss possible solutions.
Collapse
Affiliation(s)
- Johannes Stelzer
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany ; Danish Research Centre for Magnetic Resonance, Copenhagen University Hospital Hvidovre Hvidovre, Denmark
| | - Gabriele Lohmann
- Department of Biomedical Magnetic Resonance, University Hospital Tübingen Tübingen, Germany ; Magnetic Resonance Center, Max Planck Institute for Biological Cybernetics Tübingen, Germany
| | - Karsten Mueller
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany ; Nuclear Magnetic Resonance Unit, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany
| | - Tilo Buschmann
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany ; Department of Diagnostics, Fraunhofer Institute for Cell Therapy and Immunology, Leipzig , Germany
| | - Robert Turner
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany ; Department of Physics, University of Nottingham Nottingham, UK
| |
Collapse
|
54
|
Number of events and reliability in fMRI. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2014; 13:615-26. [PMID: 23754543 DOI: 10.3758/s13415-013-0178-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Relatively early in the history of fMRI, research focused on issues of power and reliability, with an important line concerning the establishment of optimal procedures for experimental design in order to maximize the various statistical properties of such designs. However, in recent years, tasks wherein events are defined only a posteriori, on the basis of behavior, have become increasingly common. Although these designs enable a much wider array of questions to be answered, they are not amenable to the tight control afforded by designs with events defined entirely a priori, and little work has assessed issues of power and reliability in such designs. We demonstrate how differences in numbers of events-as can occur with a posteriori event definition-affect reliability, both through simulation and in real data.
Collapse
|
55
|
Sanfratello L, Caprihan A, Stephen JM, Knoefel JE, Adair JC, Qualls C, Lundy SL, Aine CJ. Same task, different strategies: how brain networks can be influenced by memory strategy. Hum Brain Mapp 2014; 35:5127-40. [PMID: 24931401 DOI: 10.1002/hbm.22538] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2014] [Revised: 04/04/2014] [Accepted: 04/15/2014] [Indexed: 11/07/2022] Open
Abstract
Previous functional neuroimaging studies demonstrated that different neural networks underlie different types of cognitive processing by engaging participants in particular tasks, such as verbal or spatial working memory (WM) tasks. However, we report here that even when a WM task is defined as verbal or spatial, different types of memory strategies may be used to complete it, with concomitant variations in brain activity. We developed a questionnaire to characterize the type of strategy used by individual members in a group of 28 young healthy participants (18-25 years) during a spatial WM task. A cluster analysis was performed to differentiate groups. We acquired functional magnetoencephalography and structural diffusion tensor imaging measures to characterize the brain networks associated with the use of different strategies. We found two types of strategies were used during the spatial WM task, a visuospatial and a verbal strategy, and brain regions and time courses of activation differed between participants who used each. Task performance also varied by type of strategy used with verbal strategies showing an advantage. In addition, performance on neuropsychological tests (indices from Wechsler Adult Intelligence Scale-IV, Rey Complex Figure Test) correlated significantly with fractional anisotropy measures for the visuospatial strategy group in white matter tracts implicated in other WM and attention studies. We conclude that differences in memory strategy can have a pronounced effect on the locations and timing of brain activation and that these differences need further investigation as a possible confounding factor for studies using group averaging as a means for summarizing results.
Collapse
Affiliation(s)
- Lori Sanfratello
- Department of Radiology, University of New Mexico School of Medicine, Albuquerque, New Mexico
| | | | | | | | | | | | | | | |
Collapse
|
56
|
Hawco C, Berlim MT, Lepage M. The dorsolateral prefrontal cortex plays a role in self-initiated elaborative cognitive processing during episodic memory encoding: rTMS evidence. PLoS One 2013; 8:e73789. [PMID: 24040072 PMCID: PMC3764025 DOI: 10.1371/journal.pone.0073789] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2013] [Accepted: 07/31/2013] [Indexed: 01/18/2023] Open
Abstract
During episodic memory encoding, elaborative cognitive processing can improve later recall or recognition. While multiple studies examined the neural correlates of encoding strategies, few studies have explicitly focused on the self-initiation of elaborative encoding. Repetitive transcranial magnetic stimulation (rTMS), a method which can transiently disrupt neural activity, was administered during an associative encoding task. rTMS was either applied to the left dorsolateral prefrontal cortex (DLPFC) or to the vertex (a control region not involved in memory encoding) during presentation of pairs of words. Pairs could be semantically related or not related. Two encoding instructions were given, either cueing participants to analyze semantic relationships (cued condition), or to memorize the pair without any specific strategy cues (the self-initiated condition). Participants filled out a questionnaire regarding their use of memory strategies and performed a cued-recall task. We hypothesized that if the DLPFC plays a role in the self-initiation of elaborative encoding we would observe a reduction in memory performance in the self-initiated condition, particularly for related. We found a significant correlation between the effects of rTMS and strategy use, only in the self-initiated condition with related pairs. High strategy users showed reduced performance following DLPFC stimulation, while low strategy users tended to show increased recall following DLPFC stimulation during encoding. These results suggest the left DLPFC may be involved in the self-initiation of memory strategy use, and individuals may utilize different neural networks depending on their use of encoding strategies.
Collapse
Affiliation(s)
- Colin Hawco
- Department of Neurology and Neurosurgery, Douglas Mental Health University Institute, McGill University, Montreal, Quebec, Canada
| | - Marcelo T. Berlim
- Department of Psychiatry, Douglas Mental Health University Institute, McGill University, Montreal, Quebec, Canada
| | - Martin Lepage
- Department of Psychiatry, Douglas Mental Health University Institute, McGill University, Montreal, Quebec, Canada
- * E-mail:
| |
Collapse
|
57
|
Reproducible paired sources from concurrent EEG-fMRI data using BICAR. J Neurosci Methods 2013; 219:205-19. [PMID: 23933055 DOI: 10.1016/j.jneumeth.2013.07.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2013] [Revised: 07/22/2013] [Accepted: 07/22/2013] [Indexed: 11/24/2022]
Abstract
We introduce BICAR, an algorithm for obtaining robust, reproducible pairs of temporal and spatial components at the individual subject level from concurrent electroencephalographic and functional magnetic resonance imaging data. BICAR assigns a task-independent measure of component quality, reproducibility, to each paired source. Under BICAR a reproducibility cutoff is derived that can be used to objectively discard spuriously paired EEG-fMRI components. BICAR is run on minimally processed data: fMRI images undergo the standard preprocessing steps (alignment, motion correction, etc.) and EEG data, after scanner artifact removal, are simply bandpass filtered. This minimal processing allows the secondary scoring of the same set of BICAR components for a variety of different endpoint analyses; in this manuscript we propose a general method for scoring components for task event synchronization (evoked response analysis), but scoring using many other criteria, for example frequency content, are possible. BICAR is applied to five subjects performing a visual search task, and among the most reproducible components we find biologically relevant paired sources involved in visual processing, motor planning, execution, and attention.
Collapse
|
58
|
Abstract
AbstractThe notion of an enactive system requires thinking about the brain in a way that is different from the standard computational-representational models. In evolutionary terms, the brain does what it does and is the way that it is, across some scale of variations, because it is part of a living body with hands that can reach and grasp in certain limited ways, eyes structured to focus, an autonomic system, an upright posture, etc. coping with specific kinds of environments, and with other people. Changes to any of the bodily, environmental, or intersubjective conditions elicit responses from the system as a whole. On this view, rather than representing or computing information, the brain is better conceived as participating in the action.
Collapse
|
59
|
A hybrid model for the neural representation of complex mental processing in the human brain. Cogn Neurodyn 2012; 7:89-103. [PMID: 24427194 DOI: 10.1007/s11571-012-9220-2] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2012] [Revised: 09/14/2012] [Accepted: 09/15/2012] [Indexed: 12/14/2022] Open
Abstract
In the present conceptual review several theoretical and empirical sources of information were integrated, and a hybrid model of the neural representation of complex mental processing in the human brain was proposed. Based on empirical evidence for strategy-related and inter-individually different task-related brain activation networks, and further based on empirical evidence for a remarkable overlap of fronto-parietal activation networks across different complex mental processes, it was concluded by the author that there might be innate and modular organized neuro-developmental starting regions, for example, in intra-parietal, and both medial and middle frontal brain regions, from which the neural organization of different kinds of complex mental processes emerge differently during individually shaped learning histories. Thus, the here proposed model provides a hybrid of both massive modular and holistic concepts of idiosyncratic brain physiological elaboration of complex mental processing. It is further concluded that 3-D information, obtained by respective methodological approaches, are not appropriate to identify the non-linear spatio-temporal dynamics of complex mental process-related brain activity in a sufficient way. How different participating network parts communicate with each other seems to be an indispensable aspect, which has to be considered in particular to improve our understanding of the neural organization of complex cognition.
Collapse
|
60
|
Abstract
The brain governs food intake behaviour by integrating many different internal and external state and trait-related signals. Understanding how the decisions to start and to stop eating are made is crucial to our understanding of (maladaptive patterns of) eating behaviour. Here, we aim to (1) review the current state of the field of 'nutritional neuroscience' with a focus on the interplay between food-induced brain responses and eating behaviour and (2) highlight research needs and techniques that could be used to address these. The brain responses associated with sensory stimulation (sight, olfaction and taste), gastric distension, gut hormone administration and food consumption are the subject of increasing investigation. Nevertheless, only few studies have examined relations between brain responses and eating behaviour. However, the neural circuits underlying eating behaviour are to a large extent generic, including reward, self-control, learning and decision-making circuitry. These limbic and prefrontal circuits interact with the hypothalamus, a key homeostatic area. Target areas for further elucidating the regulation of food intake are: (eating) habit and food preference formation and modification, the neural correlates of self-control, nutrient sensing and dietary learning, and the regulation of body adiposity. Moreover, to foster significant progress, data from multiple studies need to be integrated. This requires standardisation of (neuroimaging) measures, data sharing and the application and development of existing advanced analysis and modelling techniques to nutritional neuroscience data. In the next 20 years, nutritional neuroscience will have to prove its potential for providing insights that can be used to tackle detrimental eating behaviour.
Collapse
|
61
|
Abstract
There is considerable interest in the structural and functional properties of the angular gyrus (AG). Located in the posterior part of the inferior parietal lobule, the AG has been shown in numerous meta-analysis reviews to be consistently activated in a variety of tasks. This review discusses the involvement of the AG in semantic processing, word reading and comprehension, number processing, default mode network, memory retrieval, attention and spatial cognition, reasoning, and social cognition. This large functional neuroimaging literature depicts a major role for the AG in processing concepts rather than percepts when interfacing perception-to-recognition-to-action. More specifically, the AG emerges as a cross-modal hub where converging multisensory information is combined and integrated to comprehend and give sense to events, manipulate mental representations, solve familiar problems, and reorient attention to relevant information. In addition, this review discusses recent findings that point to the existence of multiple subdivisions in the AG. This spatial parcellation can serve as a framework for reporting AG activations with greater definition. This review also acknowledges that the role of the AG cannot comprehensibly be identified in isolation but needs to be understood in parallel with the influence from other regions. Several interesting questions that warrant further investigations are finally emphasized.
Collapse
Affiliation(s)
- Mohamed L Seghier
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, UCL, London, UK.
| |
Collapse
|
62
|
Parasuraman R, Jiang Y. Individual differences in cognition, affect, and performance: behavioral, neuroimaging, and molecular genetic approaches. Neuroimage 2012; 59:70-82. [PMID: 21569853 PMCID: PMC3482491 DOI: 10.1016/j.neuroimage.2011.04.040] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2011] [Revised: 04/12/2011] [Accepted: 04/19/2011] [Indexed: 11/30/2022] Open
Abstract
We describe the use of behavioral, neuroimaging, and genetic methods to examine individual differences in cognition and affect, guided by three criteria: (1) relevance to human performance in work and everyday settings; (2) interactions between working memory, decision-making, and affective processing; and (3) examination of individual differences. The results of behavioral, functional MRI (fMRI), event-related potential (ERP), and molecular genetic studies show that analyses at the group level often mask important findings associated with sub-groups of individuals. Dopaminergic/noradrenergic genes influencing prefrontal cortex activity contribute to inter-individual variation in working memory and decision behavior, including performance in complex simulations of military decision-making. The interactive influences of individual differences in anxiety, sensation seeking, and boredom susceptibility on evaluative decision-making can be systematically described using ERP and fMRI methods. We conclude that a multi-modal neuroergonomic approach to examining brain function (using both neuroimaging and molecular genetics) can be usefully applied to understanding individual differences in cognition and affect and has implications for human performance at work.
Collapse
Affiliation(s)
- Raja Parasuraman
- Arch Laboratory and Department of Psychology, George Mason University, Fairfax, VA 22030, USA.
| | | |
Collapse
|
63
|
Affiliation(s)
- Michael I Posner
- Department of Psychology, University of Oregon, Eugene, OR, USA.
| |
Collapse
|