Cortical Power-Density Changes of Different Frequency Bands in Visually Guided Associative Learning: A Human EEG-Study

Visual consequent stimulus complexity affects performance in audiovisual associative learning

In associative learning (AL), cues and/or outcome events are coupled together. AL is typically tested in visual learning paradigms. Recently, our group developed various AL tests based on the Rutgers Acquired Equivalence Test (RAET), both visual and audiovisual, keeping the structure and logic of RAET but with different stimuli. In this study, 55 volunteers were tested in two of our audiovisual tests, SoundFace (SF) and SoundPolygon (SP). The antecedent stimuli in both tests are sounds, and the consequent stimuli are images. The consequents in SF are cartoon faces, while in SP, they are simple geometric shapes. The aim was to test how the complexity of the applied consequent stimuli influences performance regarding the various aspects of learning the tests assess (stimulus pair learning, retrieval, and generalization of the previously learned associations to new but predictable stimulus pairs). In SP, behavioral performance was significantly poorer than in SF, and the reaction times were significantly longer, for all phases of the test. The results suggest that audiovisual associative learning is significantly influenced by the complexity of the consequent stimuli.

Multisensory stimuli enhance the effectiveness of equivalence learning in healthy children and adolescents

It has been demonstrated earlier in healthy adult volunteers that visually and multisensory (audiovisual) guided equivalence learning are similarly effective. Thus, these processes seem to be independent of stimulus modality. The question arises as to whether this phenomenon can be observed also healthy children and adolescents. To assess this, visual and audiovisual equivalence learning was tested in 157 healthy participants younger than 18 years of age, in both a visual and an audiovisual paradigm consisting of acquisition, retrieval and generalization phases. Performance during the acquisition phase (building of associations), was significantly better in the multisensory paradigm, but there was no difference between the reaction times (RTs). Performance during the retrieval phase (where the previously learned associations are tested) was also significantly better in the multisensory paradigm, and RTs were significantly shorter. On the other hand, transfer (generalization) performance (where hitherto not learned but predictable associations are tested) was not significantly enhanced in the multisensory paradigm, while RTs were somewhat shorter. Linear regression analysis revealed that all the studied psychophysical parameters in both paradigms showed significant correlation with the age of the participants. Audiovisual stimulation enhanced acquisition and retrieval as compared to visual stimulation only, regardless of whether the subjects were above or below 12 years of age. Our results demonstrate that multisensory stimuli significantly enhance association learning and retrieval in the context of sensory guided equivalence learning in healthy children and adolescents. However, the audiovisual gain was significantly higher in the cohort below 12 years of age, which suggests that audiovisually guided equivalence learning is still in development in childhood.

The influence of stimulus complexity on the effectiveness of visual associative learning

Visually guided equivalence learning is a special type of associative learning, which can be evaluated using the Rutgers Acquired Equivalence Test (RAET) among other tests. RAET applies complex stimuli (faces and colored fish) between which the test subjects build associations. The complexity of these stimuli offers the test subject several clues that might ease association learning. To reduce the number of such clues, we developed an equivalence learning test (Polygon), which is structured as RAET but uses simple grayscale geometric shapes instead of faces and colored fish. In this study, we compared the psychophysical performances of the same healthy volunteers in both RAET and Polygon test. Equivalence learning, which is a basal ganglia-associated form of learning, appears to be strongly influenced by the complexity of the visual stimuli. The simple geometric shapes were associated with poor performance as compared to faces and fish. However, the difference in stimulus complexity did not affect performance in the retrieval and transfer parts of the test phase, which are assumed to be mediated by the hippocampi.

Predicting Stimulus Modality and Working Memory Load During Visual- and Audiovisual-Acquired Equivalence Learning

Scholars have extensively studied the electroencephalography (EEG) correlates of associative working memory (WM) load. However, the effect of stimulus modality on EEG patterns within this process is less understood. To fill this research gap, the present study re-analyzed EEG datasets recorded during visual and audiovisual equivalence learning tasks from earlier studies. The number of associations required to be maintained (WM load) in WM was increased using the staircase method during the acquisition phase of the tasks. The support vector machine algorithm was employed to predict WM load and stimulus modality using the power, phase connectivity, and cross-frequency coupling (CFC) values obtained during time segments with different WM loads in the visual and audiovisual tasks. A high accuracy (>90%) in predicting stimulus modality based on power spectral density and from the theta-beta CFC was observed. However, accuracy in predicting WM load was higher (≥75% accuracy) than that in predicting stimulus modality (which was at chance level) using theta and alpha phase connectivity. Under low WM load conditions, this connectivity was highest between the frontal and parieto-occipital channels. The results validated our findings from earlier studies that dissociated stimulus modality based on power-spectra and CFC during equivalence learning. Furthermore, the results emphasized the importance of alpha and theta frontoparietal connectivity in WM load.

Maintained Visual-, Auditory-, and Multisensory-Guided Associative Learning Functions in Children With Obsessive-Compulsive Disorder

Sensory-guided acquired equivalence learning, a specific kind of non-verbal associative learning, is associated with the frontal cortex-basal ganglia loops and hippocampi, which seem to be involved in the pathogenesis of obsessive-compulsive disorder (OCD). In this study, we asked whether visual-, auditory-, and multisensory-guided associative acquired equivalence learning is affected in children with OCD. The first part of the applied learning paradigm investigated association building between two different sensory stimuli (where feedback was given about the correctness of the choices), a task that critically depends upon the basal ganglia. During the test phases, which primarily depended upon the hippocampi, the earlier learned and hitherto not shown but predictable associations were asked about without feedback. This study involved 31 children diagnosed with OCD according to the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-V) criteria and 31 matched healthy control participants. The children suffering from OCD had the same performance as the control children in all phases of the applied visual-, auditory-, and multisensory-guided associative learning paradigms. Thus, both the acquisition and test phases were not negatively affected by OCD. The reaction times did not differ between the two groups, and the applied medication had no effect on the performances of the OCD patients. Our results support the findings that the structural changes of basal ganglia and hippocampi detected in adult OCD patients are not as pronounced in children, which could be the explanation of the maintained associative equivalence learning functions in children suffering from OCD.

Power-spectra and cross-frequency coupling changes in visual and Audio-visual acquired equivalence learning

The three phases of the applied acquired equivalence learning test, i.e. acquisition, retrieval and generalization, investigate the capabilities of humans in associative learning, working memory load and rule-transfer, respectively. Earlier findings denoted the role of different subcortical structures and cortical regions in the visual test. However, there is a lack of information about how multimodal cues modify the EEG-patterns during acquired equivalence learning. To test this we have recorded EEG from 18 healthy volunteers and analyzed the power spectra and the strength of cross-frequency coupling, comparing a unimodal visual-guided and a bimodal, audio-visual-guided paradigm. We found that the changes in the power of the different frequency band oscillations were more critical during the visual paradigm and they showed less synchronized activation compared to the audio-visual paradigm. These findings indicate that multimodal cues require less prominent, but more synchronized cortical contribution, which might be a possible biomarker of forming multimodal associations.

Multisensory guided associative learning in healthy humans

Associative learning is a basic cognitive function by which discrete and often different percepts are linked together. The Rutgers Acquired Equivalence Test investigates a specific kind of associative learning, visually guided equivalence learning. The test consists of an acquisition (pair learning) and a test (rule transfer) phase, which are associated primarily with the function of the basal ganglia and the hippocampi, respectively. Earlier studies described that both fundamentally-involved brain structures in the visual associative learning, the basal ganglia and the hippocampi, receive not only visual but also multisensory information. However, no study has investigated whether there is a priority for multisensory guided equivalence learning compared to unimodal ones. Thus we had no data about the modality-dependence or independence of the equivalence learning. In the present study, we have therefore introduced the auditory- and multisensory (audiovisual)-guided equivalence learning paradigms and investigated the performance of 151 healthy volunteers in the visual as well as in the auditory and multisensory paradigms. Our results indicated that visual, auditory and multisensory guided associative learning is similarly effective in healthy humans, which suggest that the acquisition phase is fairly independent from the modality of the stimuli. On the other hand, in the test phase, where participants were presented with acquisitions that were learned earlier and associations that were until then not seen or heard but predictable, the multisensory stimuli elicited the best performance. The test phase, especially its generalization part, seems to be a harder cognitive task, where the multisensory information processing could improve the performance of the participants.