The Influence of Music on Prefrontal Cortex during Episodic Encoding and Retrieval of Verbal Information: A Multichannel fNIRS Study

Lights on music cognition: A systematic and critical review of fNIRS applications and future perspectives

Research investigating the neural processes related to music perception and production constitutes a well-established field within the cognitive neurosciences. While most neuroimaging tools have limitations in studying the complexity of musical experiences, functional Near-Infrared Spectroscopy (fNIRS) represents a promising, relatively new tool for studying music processes in both laboratory and ecological settings, which is also suitable for both typical and pathological populations across development. Here we systematically review fNIRS studies on music cognition, highlighting prospects and potentialities. We also include an overview of fNIRS basic theory, together with a brief comparison to characteristics of other neuroimaging tools. Fifty-nine studies meeting inclusion criteria (i.e., using fNIRS with music as the primary stimulus) are presented across five thematic sections. Critical discussion of methodology leads us to propose guidelines of good practices aiming for robust signal analyses and reproducibility. A continuously updated world map is proposed, including basic information from studies meeting the inclusion criteria. It provides an organized, accessible, and updatable reference database, which could serve as a catalyst for future collaborations within the community. In conclusion, fNIRS shows potential for investigating cognitive processes in music, particularly in ecological contexts and with special populations, aligning with current research priorities in music cognition.

Brightening the Study of Listening Effort with Functional Near-Infrared Spectroscopy: A Scoping Review

Listening effort is a long-standing area of interest in auditory cognitive neuroscience. Prior research has used multiple techniques to shed light on the neurophysiological mechanisms underlying listening during challenging conditions. Functional near-infrared spectroscopy (fNIRS) is growing in popularity as a tool for cognitive neuroscience research, and its recent advances offer many potential advantages over other neuroimaging modalities for research related to listening effort. This review introduces the basic science of fNIRS and its uses for auditory cognitive neuroscience. We also discuss its application in recently published studies on listening effort and consider future opportunities for studying effortful listening with fNIRS. After reading this article, the learner will know how fNIRS works and summarize its uses for listening effort research. The learner will also be able to apply this knowledge toward generation of future research in this area.

A tradeoff between musical tension perception and declarative memory

Successful formation of long-term declarative memory is influenced, among other things, by attention, emotion, and deviation from expectations. A unique form of expectation can be elicited through musical tension, evoked by the prolongation of certain musical progressions. We examined the effect that musical tension exerts on the formation of declarative memory, by composing three original music pieces that contained tension segments, achieved by delays in release from dominant to tonic harmonies. Music-evoked tension was validated using music information retrieval (MIR) analysis, as well as skin conductance response (SCR) measures. Indeed, tension-evoking musical excerpts were associated with heightened SCR, corroborated by increased subjective ratings of tension, as compared to neutral excerpts. In the main experiment, 50 participants listened to the three musical pieces while they were presented with unique images that were randomly assigned to four conditions: tension, tension-release, neutral music, and silence. One day later, their memory for the images was examined using a recognition test. We found that memory performance was enhanced for images presented during both neutral and tense music compared to silence. Moreover, we observed a tradeoff effect between post-experiment tension perception and memory, such that individuals who perceived musical tension as such displayed reduced memory performance for images encoded during musical tension, whereas tense music benefited memory for those with lower musical tension perception. Understanding the interrelations between musical components, which exert powerful and fundamental responses in humans, and cognitive faculties, may provide insights as to the basic features of memory formation.

Do you listen to music while studying? A portrait of how people use music to optimize their cognitive performance

The effect of background music (BGM) on cognitive task performance is a popular topic. However, the evidence is not converging: experimental studies show mixed results depending on the task, the type of music used and individual characteristics. Here, we explored how people use BGM while optimally performing various cognitive tasks in everyday life, such as reading, writing, memorizing, and critical thinking. Specifically, the frequency of BGM usage, preferred music types, beliefs about the scientific evidence on BGM, and individual characteristics, such as age, extraversion and musical background were investigated. Although the results confirmed highly diverse strategies among individuals regarding when, how often, why and what type of BGM is used, we found several general tendencies: people tend to use less BGM when engaged in more difficult tasks, they become less critical about the type of BGM when engaged in easier tasks, and there is a negative correlation between the frequency of BGM and age, indicating that younger generations tend to use more BGM than older adults. The current and previous evidence are discussed in light of existing theories. Altogether, this study identifies essential variables to consider in future research and further forwards a theory-driven perspective in the field.

Effects of transcranial direct current stimulation combined with listening to preferred music on memory in older adults

Listening to autobiographically-salient music (i.e., music evoking personal memories from the past), and transcranial direct current stimulation (tDCS) have each been suggested to temporarily improve older adults' subsequent performance on memory tasks. Limited research has investigated the effects of combining both tDCS and music listening together on cognition. The present study examined whether anodal tDCS stimulation over the left dorsolateral prefrontal cortex (2 mA, 20 min) with concurrent listening to autobiographically-salient music amplified subsequent changes in working memory and recognition memory in older adults than either tDCS or music listening alone. In a randomized sham-controlled crossover study, 14 healthy older adults (64-81 years) participated in three neurostimulation conditions: tDCS with music listening (tDCS + Music), tDCS in silence (tDCS-only), or sham-tDCS with music listening (Sham + Music), each separated by at least a week. Working memory was assessed pre- and post-stimulation using a digit span task, and recognition memory was assessed post-stimulation using an auditory word recognition task (WRT) during which electroencephalography (EEG) was recorded. Performance on the backwards digit span showed improvement in tDCS + Music, but not in tDCS-only or Sham + Music conditions. Although no differences in behavioural performance were observed in the auditory WRT, changes in neural correlates underlying recognition memory were observed following tDCS + Music compared to Sham + Music. Findings suggest listening to autobiographically-salient music may amplify the effects of tDCS for working memory, and highlight the potential utility of neurostimulation combined with personalized music to improve cognitive performance in the aging population.

fNIRS & e-drum: An ecological approach to monitor hemodynamic and behavioural effects of rhythmic auditory cueing training

Converging evidence suggests a beneficial effect of rhythmic music-therapy in easing motor dysfunctions. Nevertheless, the neural systems underpinning both the direct effect and the influence of rhythm on movement control and execution during training in ecological settings are still largely unknown. In this study, we propose an ecological approach to monitor brain activity and behavioural performance during rhythmic auditory cueing short-term training. Our approach envisages the combination of functional near-infrared spectroscopy (fNIRS), which is a non-invasive neuroimaging technique that allows unconstrained movements of participants, with electronic drum (e-drum), which is an instrument able to collect behavioural tapping data in real time. The behavioural and brain effects of this short-term training were investigated on a group of healthy participants, who well tolerated the experimental settings, since none of them withdrew from the study. The rhythmic auditory cueing short-term training improved beat regularity and decreased group variability. At the group level, the training resulted in a reduction of brain activity primarily in premotor areas. Furthermore, participants with the highest behavioural improvement during training showed the smallest reduction in brain activity. Overall, we conclude that our study could pave the way towards translating the proposed approach to clinical settings.

The impact of musical pleasure and musical hedonia on verbal episodic memory

Music listening is one of the most pleasurable activities in our life. As a rewarding stimulus, pleasant music could induce long-term memory improvements for the items encoded in close temporal proximity. In the present study, we behaviourally investigated (1) whether musical pleasure and musical hedonia enhance verbal episodic memory, and (2) whether such enhancement takes place even when the pleasant stimulus is not present during the encoding. Participants (N = 100) were asked to encode words presented in different auditory contexts (highly and lowly pleasant classical music, and control white noise), played before and during (N = 49), or only before (N = 51) the encoding. The Barcelona Music Reward Questionnaire was used to measure participants’ sensitivity to musical reward. 24 h later, participants’ verbal episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed that participants with a high musical reward sensitivity present an increased recollection performance, especially for words encoded in a highly pleasant musical context. Furthermore, this effect persists even when the auditory stimulus is not concurrently present during the encoding of target items. Taken together, these findings suggest that musical pleasure might constitute a helpful encoding context able to drive memory improvements via reward mechanisms.

The impact of musical pleasure and musical hedonia on verbal episodic memory

Music listening is one of the most pleasurable activities in our life. As a rewarding stimulus, pleasant music could induce long-term memory improvements for the items encoded in close temporal proximity. In the present study, we behaviourally investigated (1) whether musical pleasure and musical hedonia enhance verbal episodic memory, and (2) whether such enhancement takes place even when the pleasant stimulus is not present during the encoding. Participants (N = 100) were asked to encode words presented in different auditory contexts (highly and lowly pleasant classical music, and control white noise), played before and during (N = 49), or only before (N = 51) the encoding. The Barcelona Music Reward Questionnaire was used to measure participants' sensitivity to musical reward. 24 h later, participants' verbal episodic memory was tested (old/new recognition and remember/know paradigm). Results revealed that participants with a high musical reward sensitivity present an increased recollection performance, especially for words encoded in a highly pleasant musical context. Furthermore, this effect persists even when the auditory stimulus is not concurrently present during the encoding of target items. Taken together, these findings suggest that musical pleasure might constitute a helpful encoding context able to drive memory improvements via reward mechanisms.

Temporal predictions provided by musical rhythm influence visual memory encoding

Selective attention plays a key role in determining what aspects of our environment are encoded into long-term memory. Auditory rhythms with a regular beat provide temporal expectations that entrain attention and facilitate perception of visual stimuli aligned with the beat. The current study investigated whether entrainment to background auditory rhythms also facilitates higher-level cognitive functions such as episodic memory. In a series of experiments, we manipulated temporal attention through the use of rhythmic, instrumental music. In Experiment 1A and 1B, we found that background musical rhythm influenced the encoding of visual targets into memory, evident in enhanced subsequent memory for targets that appeared in-synchrony compared to out-of-synchrony with the background beat. Response times at encoding did not differ for in-synchrony compared to out-of-synchrony stimuli, suggesting that the rhythmic modulation of memory does not simply reflect rhythmic effects on perception and action. Experiment 2 investigated whether rhythmic effects on response times emerge when task procedures more closely match prior studies that have demonstrated significant auditory entrainment effects. Responses were faster for in-synchrony compared to out-of-synchrony stimuli when participants performed a more perceptually-oriented task that did not contain intervening recognition memory tests, suggesting that rhythmic effects on perception and action depend on the nature of the task demands. Together, these results support the hypothesis that rhythmic temporal regularities provided by background music can entrain attention and influence the encoding of visual stimuli into memory.

Cognitive and neural mechanisms underlying the mnemonic effect of songs after stroke

Sung melody provides a mnemonic cue that can enhance the acquisition of novel verbal material in healthy subjects. Recent evidence suggests that also stroke patients, especially those with mild aphasia, can learn and recall novel narrative stories better when they are presented in sung than spoken format. Extending this finding, the present study explored the cognitive mechanisms underlying this effect by determining whether learning and recall of novel sung vs. spoken stories show a differential pattern of serial position effects (SPEs) and chunking effects in non-aphasic and aphasic stroke patients (N = 31) studied 6 months post-stroke. The structural neural correlates of these effects were also explored using voxel-based morphometry (VBM) and deterministic tractography (DT) analyses of structural MRI data. Non-aphasic patients showed more stable recall with reduced SPEs in the sung than spoken task, which was coupled with greater volume and integrity (indicated by fractional anisotropy, FA) of the left arcuate fasciculus. In contrast, compared to non-aphasic patients, the aphasic patients showed a larger recency effect (better recall of the last vs. middle part of the story) and enhanced chunking (larger units of correctly recalled consecutive items) in the sung than spoken task. In aphasics, the enhanced chunking and better recall on the middle verse in the sung vs. spoken task correlated also with better ability to perceive emotional prosody in speech. Neurally, the sung > spoken recency effect in aphasic patients was coupled with greater grey matter volume in a bilateral network of temporal, frontal, and parietal regions and also greater volume of the right inferior fronto-occipital fasciculus (IFOF). These results provide novel cognitive and neurobiological insight on how a repetitive sung melody can function as a verbal mnemonic aid after stroke.

•

Non-aphasic stroke patients show more stable recall of sung than spoken stories.

•

Aphasic patients show larger recency and chunking effects to sung vs. spoken stories.

•

The left dorsal pathway mediates better recall of sung stories in non-aphasics.

•

The right ventral pathway mediates better recall of sung stories in aphasics.

•

Large-scale bilateral cortical networks are linked to musical mnemonics in aphasia.

Poetic Science: Bidirectional Reflection in Science and Medicine

The arts are making their mark in science, technology, engineering, arts, and mathematics/medicine (STEAM). Integrating creative expression-poetry and other visual and performing arts-can help clinicians, scientists, and others use familiar social constructs to embody science and medicine, in what may be termed poetic science. Poetic science imbues bidirectional reflections of science and medicine on the clinician or scientist or other inquisitor, creatively engaging the learner's brain cells as mirrors. This ultimately leads to a subjective perspective on the understanding or the proposition of underlying principles. Such an approach is encouraged here with poignant examples that can be accessed publicly online and used widely by readers, teachers, learners, clinicians, scientists, students, and others.

Interactive effects of music and prefrontal cortex stimulation in modulating response inhibition

Influential hypotheses propose that alterations in emotional state influence decision processes and executive control of behavior. Both music and transcranial direct current stimulation (tDCS) of prefrontal cortex affect emotional state, however interactive effects of music and tDCS on executive functions remain unknown. Learning to inhibit inappropriate responses is an important aspect of executive control which is guided by assessing the decision outcomes such as errors. We found that high-tempo music, but not low-tempo music or low-level noise, significantly influenced learning and implementation of inhibitory control. In addition, a brief period of tDCS over prefrontal cortex specifically interacted with high-tempo music and altered its effects on executive functions. Measuring event-related autonomic and arousal response of participants indicated that exposure to task demands and practice led to a decline in arousal response to the decision outcome and high-tempo music enhanced such practice-related processes. However, tDCS specifically moderated the high-tempo music effect on the arousal response to errors and concomitantly restored learning and improvement in executive functions. Here, we show that tDCS and music interactively influence the learning and implementation of inhibitory control. Our findings indicate that alterations in the arousal-emotional response to the decision outcome might underlie these interactive effects.

Process-specific analysis in episodic memory retrieval using fast optical signals and hemodynamic signals in the right prefrontal cortex

OBJECTIVE

Memory is formed by the interaction of various brain functions at the item and task level. Revealing individual and combined effects of item- and task-related processes on retrieving episodic memory is an unsolved problem because of limitations in existing neuroimaging techniques. To investigate these issues, we analyze fast and slow optical signals measured from a custom-built continuous wave functional near-infrared spectroscopy (CW-fNIRS) system.

APPROACH

In our work, we visually encode the words to the subjects and let them recall the words after a short rest. The hemodynamic responses evoked by the episodic memory are compared with those evoked by the semantic memory in retrieval blocks. In the fast optical signal, we compare the effects of old and new items (previously seen and not seen) to investigate the item-related process in episodic memory. The Kalman filter is simultaneously applied to slow and fast optical signals in different time windows.

MAIN RESULTS

A significant task-related HbR decrease was observed in the episodic memory retrieval blocks. Mean amplitude and peak latency of a fast optical signal are dependent upon item types and reaction time, respectively. Moreover, task-related hemodynamic and item-related fast optical responses are correlated in the right prefrontal cortex.

SIGNIFICANCE

We demonstrate that episodic memory is retrieved from the right frontal area by a functional connectivity between the maintained mental state through retrieval and item-related transient activity. To the best of our knowledge, this demonstration of functional NIRS research is the first to examine the relationship between item- and task-related memory processes in the prefrontal area using single modality.