Audiovisual integration supports face-name associative memory formation

Grey matter volume reduction in the frontotemporal cortex associated with persistent verbal auditory hallucinations in Chinese patients with chronic schizophrenia: Insights from a 3 T magnetic resonance imaging study

BACKGROUND

Persistent auditory verbal hallucinations (pAVHs) are a fundamental manifestation of schizophrenia (SCZ), yet the exact connection between pAVHs and brain structure remains contentious. This study aims to explore the potential correlation between pAVHs and alterations in grey matter volume (GMV) within specific brain regions among individuals diagnosed with SCZ.

METHODS

76 SCZ patients with pAVHs (pAVH group), 57 SCZ patients without AVHs (non-AVH group), and 83 healthy controls (HC group) were investigated using 3 T magnetic resonance imaging. The P3 hallucination item of the Positive and Negative Syndrome Scale was used to assess the severity of pAVHs. Voxel-based morphometry was used to analyze the GMV profile between the three groups.

RESULTS

Compared to the non-AVH and HC groups, the pAVH group exhibited extensive reduction in GMV within the frontotemporal cortex. Conversely, no significant difference in GMV was observed between the non-AVH and HC groups. The severity of pAVHs showed a negative correlation with GMV in several regions, including the right fusiform, right inferior temporal, right medial orbitofrontal, right superior frontal, and right temporal pole (p = 0.0036, Bonferroni correction). Stepwise linear regression analysis revealed that GMV in the right temporal pole (β = -0.29, p = 0.001) and right fusiform (β = -0.21, p = 0.01) were significantly associated with the severity of pAVHs.

CONCLUSIONS

Widespread reduction in GMV is observed within the frontotemporal cortex, particularly involving the right temporal pole and right fusiform, which potentially contribute to the pathogenesis of pAVHs in individuals with chronic SCZ.

Crossmodal interactions in human learning and memory

Most studies of memory and perceptual learning in humans have employed unisensory settings to simplify the study paradigm. However, in daily life we are often surrounded by complex and cluttered scenes made up of many objects and sources of sensory stimulation. Our experiences are, therefore, highly multisensory both when passively observing the world and when acting and navigating. We argue that human learning and memory systems are evolved to operate under these multisensory and dynamic conditions. The nervous system exploits the rich array of sensory inputs in this process, is sensitive to the relationship between the sensory inputs, and continuously updates sensory representations, and encodes memory traces based on the relationship between the senses. We review some recent findings that demonstrate a range of human learning and memory phenomena in which the interactions between visual and auditory modalities play an important role, and suggest possible neural mechanisms that can underlie some surprising recent findings. We outline open questions as well as directions of future research to unravel human perceptual learning and memory.

Semantically congruent audiovisual integration with modal-based attention accelerates auditory short-term memory retrieval

Evidence has shown that multisensory integration benefits to unisensory perception performance are asymmetric and that auditory perception performance can receive more multisensory benefits, especially when the attention focus is directed toward a task-irrelevant visual stimulus. At present, whether the benefits of semantically (in)congruent multisensory integration with modal-based attention for subsequent unisensory short-term memory (STM) retrieval are also asymmetric remains unclear. Using a delayed matching-to-sample paradigm, the present study investigated this issue by manipulating the attention focus during multisensory memory encoding. The results revealed that both visual and auditory STM retrieval reaction times were faster under semantically congruent multisensory conditions than under unisensory memory encoding conditions. We suggest that coherent multisensory representation formation might be optimized by restricted multisensory encoding and can be rapidly triggered by subsequent unisensory memory retrieval demands. Crucially, auditory STM retrieval is exclusively accelerated by semantically congruent multisensory memory encoding, indicating that the less effective sensory modality of memory retrieval relies more on the coherent prior formation of a multisensory representation optimized by modal-based attention.

A novel, interactive game to improve understanding of respiratory control pathways in first-year medical students

The physiology of respiration is a challenging subject for many medical students. To assist students, we have developed an active learning game that physically places students within a model outlining the respiratory control pathway. Participants were provided with a vodcast describing the physiology of respiratory control and instructed to view this before the activity. Once in the classroom, groups of students sat at tables marked to represent components of the respiratory control pathway (e.g., apneustic center, diaphragm etc.). Tables were connected with green and red ropes indicating excitatory or inhibitory effects, respectively. Students were presented with various scenarios (e.g., diabetic ketoacidosis) and asked to predict and illustrate the scenario's effect on subsequent steps in the respiratory pathway by waving the appropriate connecting rope. The next table would continue the pattern to simulate the collective physiological adaptation of the respiratory pathway. Thirty first-year medical students participated in this study. Following the activity, 25 out of the 30 participants completed an optional survey. The survey aimed to assess the benefits of adding this activity to our first-year medical curriculum to build a foundational understanding of the physiology of respiration. Responses were overwhelmingly favorable, and participants reported that playing the game significantly improved their perceived understanding of the physiology of respiratory control. All but one of the participants recommended using the activity in future classes. Because the small size of the study group may limit generalizability, future larger scale studies are planned.

Emotional learning promotes perceptual predictions by remodeling stimulus representation in visual cortex

Emotions exert powerful effects on perception and memory, notably by modulating activity in sensory cortices so as to capture attention. Here, we examine whether emotional significance acquired by a visual stimulus can also change its cortical representation by linking neuronal populations coding for different memorized versions of the same stimulus, a mechanism that would facilitate recognition across different appearances. Using fMRI, we show that after pairing a given face with threat through conditioning, viewing this face activates the representation of another viewpoint of the same person, which itself was never conditioned, leading to robust repetition-priming across viewpoints in the ventral visual stream (including medial fusiform, lateral occipital, and anterior temporal cortex). We also observed a functional-anatomical segregation for coding view-invariant and view-specific identity information. These results indicate emotional signals may induce plasticity of stimulus representations in visual cortex, serving to generate new sensory predictions about different appearances of threat-associated stimuli.

Power-spectra and cross-frequency coupling changes in visual and Audio-visual acquired equivalence learning

The three phases of the applied acquired equivalence learning test, i.e. acquisition, retrieval and generalization, investigate the capabilities of humans in associative learning, working memory load and rule-transfer, respectively. Earlier findings denoted the role of different subcortical structures and cortical regions in the visual test. However, there is a lack of information about how multimodal cues modify the EEG-patterns during acquired equivalence learning. To test this we have recorded EEG from 18 healthy volunteers and analyzed the power spectra and the strength of cross-frequency coupling, comparing a unimodal visual-guided and a bimodal, audio-visual-guided paradigm. We found that the changes in the power of the different frequency band oscillations were more critical during the visual paradigm and they showed less synchronized activation compared to the audio-visual paradigm. These findings indicate that multimodal cues require less prominent, but more synchronized cortical contribution, which might be a possible biomarker of forming multimodal associations.

Multisensory guided associative learning in healthy humans

Associative learning is a basic cognitive function by which discrete and often different percepts are linked together. The Rutgers Acquired Equivalence Test investigates a specific kind of associative learning, visually guided equivalence learning. The test consists of an acquisition (pair learning) and a test (rule transfer) phase, which are associated primarily with the function of the basal ganglia and the hippocampi, respectively. Earlier studies described that both fundamentally-involved brain structures in the visual associative learning, the basal ganglia and the hippocampi, receive not only visual but also multisensory information. However, no study has investigated whether there is a priority for multisensory guided equivalence learning compared to unimodal ones. Thus we had no data about the modality-dependence or independence of the equivalence learning. In the present study, we have therefore introduced the auditory- and multisensory (audiovisual)-guided equivalence learning paradigms and investigated the performance of 151 healthy volunteers in the visual as well as in the auditory and multisensory paradigms. Our results indicated that visual, auditory and multisensory guided associative learning is similarly effective in healthy humans, which suggest that the acquisition phase is fairly independent from the modality of the stimuli. On the other hand, in the test phase, where participants were presented with acquisitions that were learned earlier and associations that were until then not seen or heard but predictable, the multisensory stimuli elicited the best performance. The test phase, especially its generalization part, seems to be a harder cognitive task, where the multisensory information processing could improve the performance of the participants.