1
|
Wehrheim MH, Faskowitz J, Schubert A, Fiebach CJ. Reliability of variability and complexity measures for task and task-free BOLD fMRI. Hum Brain Mapp 2024; 45:e26778. [PMID: 38980175 PMCID: PMC11232465 DOI: 10.1002/hbm.26778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 05/06/2024] [Accepted: 06/24/2024] [Indexed: 07/10/2024] Open
Abstract
Brain activity continuously fluctuates over time, even if the brain is in controlled (e.g., experimentally induced) states. Recent years have seen an increasing interest in understanding the complexity of these temporal variations, for example with respect to developmental changes in brain function or between-person differences in healthy and clinical populations. However, the psychometric reliability of brain signal variability and complexity measures-which is an important precondition for robust individual differences as well as longitudinal research-is not yet sufficiently studied. We examined reliability (split-half correlations) and test-retest correlations for task-free (resting-state) BOLD fMRI as well as split-half correlations for seven functional task data sets from the Human Connectome Project to evaluate their reliability. We observed good to excellent split-half reliability for temporal variability measures derived from rest and task fMRI activation time series (standard deviation, mean absolute successive difference, mean squared successive difference), and moderate test-retest correlations for the same variability measures under rest conditions. Brain signal complexity estimates (several entropy and dimensionality measures) showed moderate to good reliabilities under both, rest and task activation conditions. We calculated the same measures also for time-resolved (dynamic) functional connectivity time series and observed moderate to good reliabilities for variability measures, but poor reliabilities for complexity measures derived from functional connectivity time series. Global (i.e., mean across cortical regions) measures tended to show higher reliability than region-specific variability or complexity estimates. Larger subcortical regions showed similar reliability as cortical regions, but small regions showed lower reliability, especially for complexity measures. Lastly, we also show that reliability scores are only minorly dependent on differences in scan length and replicate our results across different parcellation and denoising strategies. These results suggest that the variability and complexity of BOLD activation time series are robust measures well-suited for individual differences research. Temporal variability of global functional connectivity over time provides an important novel approach to robustly quantifying the dynamics of brain function. PRACTITIONER POINTS: Variability and complexity measures of BOLD activation show good split-half reliability and moderate test-retest reliability. Measures of variability of global functional connectivity over time can robustly quantify neural dynamics. Length of fMRI data has only a minor effect on reliability.
Collapse
Affiliation(s)
- Maren H. Wehrheim
- Department of PsychologyGoethe University FrankfurtFrankfurtGermany
- Department of Computer Science and MathematicsGoethe University FrankfurtFrankfurtGermany
- Frankfurt Institute for Advanced Studies (FIAS)FrankfurtGermany
| | - Joshua Faskowitz
- Department of Psychological and Brain SciencesIndiana UniversityBloomingtonUSA
| | - Anna‐Lena Schubert
- Department of PsychologyJohannes Gutenberg‐Universität MainzMainzGermany
| | - Christian J. Fiebach
- Department of PsychologyGoethe University FrankfurtFrankfurtGermany
- Brain Imaging CenterGoethe University FrankfurtFrankfurtGermany
| |
Collapse
|
2
|
Grange JA, Schuch S. A spurious correlation between difference scores in evidence-accumulation model parameters. Behav Res Methods 2023; 55:3348-3369. [PMID: 36138317 PMCID: PMC10615941 DOI: 10.3758/s13428-022-01956-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/09/2022] [Indexed: 11/08/2022]
Abstract
Evidence-accumulation models are a useful tool for investigating the cognitive processes that give rise to behavioural data patterns in reaction times (RTs) and error rates. In their simplest form, evidence-accumulation models include three parameters: The average rate of evidence accumulation over time (drift rate) and the amount of evidence that needs to be accumulated before a response becomes selected (boundary) both characterise the response-selection process; a third parameter summarises all processes before and after the response-selection process (non-decision time). Researchers often compute experimental effects as simple difference scores between two within-subject conditions and such difference scores can also be computed on model parameters. In the present paper, we report spurious correlations between such model parameter difference scores, both in empirical data and in computer simulations. The most pronounced spurious effect is a negative correlation between boundary difference and non-decision difference, which amounts to r = - .70 or larger. In the simulations, we only observed this spurious negative correlation when either (a) there was no true difference in model parameters between simulated experimental conditions, or (b) only drift rate was manipulated between simulated experimental conditions; when a true difference existed in boundary separation, non-decision time, or all three main parameters, the correlation disappeared. We suggest that care should be taken when using evidence-accumulation model difference scores for correlational approaches because the parameter difference scores can correlate in the absence of any true inter-individual differences at the population level.
Collapse
|
3
|
Anomal RF, Brandão DS, de Souza RFL, de Oliveira SS, Porto SB, Hazin Pires IA, Pereira A. The spectral profile of cortical activation during a visuospatial mental rotation task and its correlation with working memory. Front Neurosci 2023; 17:1134067. [PMID: 37008234 PMCID: PMC10061141 DOI: 10.3389/fnins.2023.1134067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 02/28/2023] [Indexed: 03/18/2023] Open
Abstract
IntroductionThe search for a cortical signature of intelligent behavior has been a longtime motivation in Neuroscience. One noticeable characteristic of intelligence is its association with visuospatial skills. This has led to a steady focus on the functional and structural characteristics of the frontoparietal network (FPN) of areas involved with higher cognition and spatial behavior in humans, including the question of whether intelligence is correlated with larger or smaller activity in this important cortical circuit. This question has broad significance, including speculations about the evolution of human cognition. One way to indirectly measure cortical activity with millisecond precision is to evaluate the event-related spectral perturbation (ERSP) of alpha power (alpha ERSP) during cognitive tasks. Mental rotation, or the ability to transform a mental representation of an object to accurately predict how the object would look from a different angle, is an important feature of everyday activities and has been shown in previous work by our group to be positively correlated with intelligence. In the present work, we evaluate whether alpha ERSP recorded over the parietal, frontal, temporal, and occipital regions of adolescents performing easy and difficult trials of the Shepard–Metzler’s mental rotation task, correlates or are predicted by intelligence measures of the Weschler’s intelligence scale.MethodsWe used a database obtained from a previous study of intellectually gifted (N = 15) and average intelligence (N = 15) adolescents.ResultsOur findings suggest that in challenging task conditions, there is a notable difference in the prominence of alpha event-related spectral perturbation (ERSP) activity between various cortical regions. Specifically, we found that alpha ERSP in the parietal region was less prominent relative to those in the frontal, temporal and occipital regions. Working memory scores predict alpha ERSP values in the frontal and parietal regions. In the frontal cortex, alpha ERSP of difficult trials was negatively correlated with working memory scores.DiscussionThus, our results suggest that even though the FPN is task-relevant during mental rotation tasks, only the frontal alpha ERSP is correlated with working memory score in mental rotation tasks.
Collapse
Affiliation(s)
| | | | | | | | | | - Izabel Augusta Hazin Pires
- Department of Psychology, Federal University of Rio Grande do Norte, Natal, Brazil
- Digital Metropolis Institute, Federal University of Rio Grande do Norte, Natal, Brazil
| | - Antonio Pereira
- Laboratory of Signal Processing, Institute of Technology, Federal University of Pará, Belém, Brazil
- *Correspondence: Antonio Pereira Jr.,
| |
Collapse
|
4
|
Parra-Martinez FA, Desmet OA, Wai J. The Evolution of Intelligence: Analysis of the Journal of Intelligence and Intelligence. J Intell 2023; 11:jintelligence11020035. [PMID: 36826933 PMCID: PMC9961905 DOI: 10.3390/jintelligence11020035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 02/09/2023] [Accepted: 02/10/2023] [Indexed: 02/17/2023] Open
Abstract
What are the current trends in intelligence research? This parallel bibliometric analysis covers the two premier journals in the field: Intelligence and the Journal of Intelligence (JOI) between 2013 and 2022. Using Scopus data, this paper extends prior bibliometric articles reporting the evolution of the journal Intelligence from 1977 up to 2018. It includes JOI from its inception, along with Intelligence to the present. Although the journal Intelligence's growth has declined over time, it remains a stronghold for traditional influential research (average publications per year = 71.2, average citations per article = 17.07, average citations per year = 2.68). JOI shows a steady growth pattern in the number of publications and citations (average publications per year = 33.2, average citations per article = 6.48, total average citations per year = 1.48) since its inception in 2013. Common areas of study across both journals include cognitive ability, fluid intelligence, psychometrics-statistics, g-factor, and working memory. Intelligence includes core themes like the Flynn effect, individual differences, and geographic IQ variability. JOI addresses themes such as creativity, personality, and emotional intelligence. We discuss research trends, co-citation networks, thematic maps, and their implications for the future of the two journals and the evolution and future of the scientific study of intelligence.
Collapse
Affiliation(s)
| | | | - Jonathan Wai
- Department of Education Reform, University of Arkansas, Fayetteville, AR 72701, USA
| |
Collapse
|
5
|
Schubert AL, Löffler C, Hagemann D, Sadus K. How robust is the relationship between neural processing speed and cognitive abilities? Psychophysiology 2023; 60:e14165. [PMID: 35995756 DOI: 10.1111/psyp.14165] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 07/08/2022] [Accepted: 07/31/2022] [Indexed: 01/04/2023]
Abstract
Individual differences in processing speed are consistently related to individual differences in cognitive abilities, but the mechanisms through which a higher processing speed facilitates reasoning remain largely unknown. To identify these mechanisms, researchers have been using latencies of the event-related potential (ERP) to study how the speed of cognitive processes associated with specific ERP components is related to cognitive abilities. Although there is some evidence that latencies of ERP components associated with higher-order cognitive processes are related to intelligence, results are overall quite inconsistent. These inconsistencies likely result from variations in analytic procedures and little consideration of the psychometric properties of ERP latencies in relatively small sample studies. Here we used a multiverse approach to evaluate how different analytical choices regarding references, low-pass filter cutoffs, and latency measures affect the psychometric properties of P2, N2, and P3 latencies and their relations with cognitive abilities in a sample of 148 participants. Latent correlations between neural processing speed and cognitive abilities ranged from -.49 to -.78. ERP latency measures contained about equal parts of measurement error variance and systematic variance, and only about half of the systematic variance was related to cognitive abilities, whereas the other half reflected nuisance factors. We recommend addressing these problematic psychometric properties by recording EEG data from multiple tasks and modeling relations between ERP latencies and covariates in latent variable models. All in all, our results indicate that there is a substantial and robust relationship between neural processing speed and cognitive abilities when those issues are addressed.
Collapse
Affiliation(s)
| | - Christoph Löffler
- Department of Psychology, University of Mainz, Mainz, Germany.,Institute of Psychology, Heidelberg University, Heidelberg, Germany
| | - Dirk Hagemann
- Institute of Psychology, Heidelberg University, Heidelberg, Germany
| | - Kathrin Sadus
- Institute of Psychology, Heidelberg University, Heidelberg, Germany
| |
Collapse
|
6
|
Hilger K, Euler MJ. Intelligence and Visual Mismatch Negativity: Is Pre-Attentive Visual Discrimination Related to General Cognitive Ability? J Cogn Neurosci 2022; 35:1-17. [PMID: 36473095 DOI: 10.1162/jocn_a_01946] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2024]
Abstract
EEG has been used for decades to identify neurocognitive processes related to intelligence. Evidence is accumulating for associations with neural markers of higher-order cognitive processes (e.g., working memory); however, whether associations are specific to complex processes or also relate to earlier processing stages remains unclear. Addressing these issues has implications for improving our understanding of intelligence and its neural correlates. The MMN is an ERP that is elicited when, within a series of frequent standard stimuli, rare deviant stimuli are presented. As stimuli are typically presented outside the focus of attention, the MMN is suggested to capture automatic pre-attentive discrimination processes. However, the MMN and its relation to intelligence has largely only been studied in the auditory domain, thus preventing conclusions about the involvement of automatic discrimination processes in humans' dominant sensory modality-vision. EEG was recorded from 50 healthy participants during a passive visual oddball task that presented simple sequence violations and deviations within a more complex hidden pattern. Signed area amplitudes and fractional area latencies of the visual MMN were calculated with and without Laplacian transformation. Correlations between visual MMN and intelligence (Raven's Advanced Progressive Matrices) were of negligible to small effect sizes, differed critically between measurement approaches, and Bayes Factors provided anecdotal to substantial evidence for the absence of an association. We discuss differences between the auditory and visual MMN, the implications of different measurement approaches, and offer recommendations for further research in this evolving field.
Collapse
Affiliation(s)
- Kirsten Hilger
- Julius-Maximilians University of Würzburg, Germany
- Goethe University, Frankfurt Germany
| | | |
Collapse
|
7
|
Haier RJ. Are we thinking big enough about the road ahead? Overview of the special issue on the future of intelligence research. INTELLIGENCE 2021. [DOI: 10.1016/j.intell.2021.101603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|