1
|
Ning M, Duwadi S, Yücel MA, von Lühmann A, Boas DA, Sen K. fNIRS dataset during complex scene analysis. Front Hum Neurosci 2024; 18:1329086. [PMID: 38576451 PMCID: PMC10991699 DOI: 10.3389/fnhum.2024.1329086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 03/06/2024] [Indexed: 04/06/2024] Open
Affiliation(s)
- Matthew Ning
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Sudan Duwadi
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Meryem A. Yücel
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Alexander von Lühmann
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
- BIFOLD – Berlin Institute for the Foundations of Learning and Data, Berlin, Germany
- Intelligent Biomedical Sensing (IBS) Lab, Technical University Berlin, Berlin, Germany
| | - David A. Boas
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| | - Kamal Sen
- Department of Biomedical Engineering, Neurophotonics Center, Boston University, Boston, MA, United States
| |
Collapse
|
2
|
Ning M, Duwadi S, Yücel MA, Von Lühmann A, Boas DA, Sen K. fNIRS Dataset During Complex Scene Analysis. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.23.576715. [PMID: 38328139 PMCID: PMC10849700 DOI: 10.1101/2024.01.23.576715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/09/2024]
Abstract
When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.
Collapse
Affiliation(s)
- Matthew Ning
- Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Sudan Duwadi
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Meryem A. Yücel
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Alexander Von Lühmann
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
- BIFOLD – Berlin Institute for the Foundations of Learning and Data, 10587 Berlin, Germany
- Intelligent Biomedical Sensing (IBS) Lab, Technische Universität Berlin, 10587 Berlin, Germany
| | - David A. Boas
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| | - Kamal Sen
- Neurophotonics Center, Department of Biomedical Engineering, Boston University
| |
Collapse
|
3
|
Richter M, Buhiyan T, Bramsløw L, Innes-Brown H, Fiedler L, Hadley LV, Naylor G, Saunders GH, Wendt D, Whitmer WM, Zekveld AA, Kramer SE. Combining Multiple Psychophysiological Measures of Listening Effort: Challenges and Recommendations. Semin Hear 2023; 44:95-105. [PMID: 37122882 PMCID: PMC10147512 DOI: 10.1055/s-0043-1767669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023] Open
Abstract
About one-third of all recently published studies on listening effort have used at least one physiological measure, providing evidence of the popularity of such measures in listening effort research. However, the specific measures employed, as well as the rationales used to justify their inclusion, vary greatly between studies, leading to a literature that is fragmented and difficult to integrate. A unified approach that assesses multiple psychophysiological measures justified by a single rationale would be preferable because it would advance our understanding of listening effort. However, such an approach comes with a number of challenges, including the need to develop a clear definition of listening effort that links to specific physiological measures, customized equipment that enables the simultaneous assessment of multiple measures, awareness of problems caused by the different timescales on which the measures operate, and statistical approaches that minimize the risk of type-I error inflation. This article discusses in detail the various obstacles for combining multiple physiological measures in listening effort research and provides recommendations on how to overcome them.
Collapse
Affiliation(s)
- Michael Richter
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| | | | - Lars Bramsløw
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
| | - Hamish Innes-Brown
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Hearing Systems Section, Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Lorenz Fiedler
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
| | - Lauren V. Hadley
- Hearing Sciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Graham Naylor
- Hearing Sciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Gabrielle H. Saunders
- Manchester Centre for Audiology and Deafness, University of Manchester, Manchester, United Kingdom
| | - Dorothea Wendt
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Department of Health Technology, Technical University of Denmark, Lyngby, Denmark
| | - William M. Whitmer
- Hearing Sciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Adriana A. Zekveld
- Section of Ear and Hearing, Department of Otolaryngology – Head and Neck Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Sophia E. Kramer
- Section of Ear and Hearing, Department of Otolaryngology – Head and Neck Surgery, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| |
Collapse
|
4
|
Lanzilotti C, Andéol G, Micheyl C, Scannella S. Cocktail party training induces increased speech intelligibility and decreased cortical activity in bilateral inferior frontal gyri. A functional near-infrared study. PLoS One 2022; 17:e0277801. [PMID: 36454948 PMCID: PMC9714910 DOI: 10.1371/journal.pone.0277801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Accepted: 11/03/2022] [Indexed: 12/03/2022] Open
Abstract
The human brain networks responsible for selectively listening to a voice amid other talkers remain to be clarified. The present study aimed to investigate relationships between cortical activity and performance in a speech-in-speech task, before (Experiment I) and after training-induced improvements (Experiment II). In Experiment I, 74 participants performed a speech-in-speech task while their cortical activity was measured using a functional near infrared spectroscopy (fNIRS) device. One target talker and one masker talker were simultaneously presented at three different target-to-masker ratios (TMRs): adverse, intermediate and favorable. Behavioral results show that performance may increase monotonically with TMR in some participants and failed to decrease, or even improved, in the adverse-TMR condition for others. On the neural level, an extensive brain network including the frontal (left prefrontal cortex, right dorsolateral prefrontal cortex and bilateral inferior frontal gyri) and temporal (bilateral auditory cortex) regions was more solicited by the intermediate condition than the two others. Additionally, bilateral frontal gyri and left auditory cortex activities were found to be positively correlated with behavioral performance in the adverse-TMR condition. In Experiment II, 27 participants, whose performance was the poorest in the adverse-TMR condition of Experiment I, were trained to improve performance in that condition. Results show significant performance improvements along with decreased activity in bilateral inferior frontal gyri, the right dorsolateral prefrontal cortex, the left inferior parietal cortex and the right auditory cortex in the adverse-TMR condition after training. Arguably, lower neural activity reflects higher efficiency in processing masker inhibition after speech-in-speech training. As speech-in-noise tasks also imply frontal and temporal regions, we suggest that regardless of the type of masking (speech or noise) the complexity of the task will prompt the implication of a similar brain network. Furthermore, the initial significant cognitive recruitment will be reduced following a training leading to an economy of cognitive resources.
Collapse
Affiliation(s)
- Cosima Lanzilotti
- Département Neuroscience et Sciences Cognitives, Institut de Recherche Biomédicale des Armées, Brétigny sur Orge, France
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- Thales SIX GTS France, Gennevilliers, France
| | - Guillaume Andéol
- Département Neuroscience et Sciences Cognitives, Institut de Recherche Biomédicale des Armées, Brétigny sur Orge, France
| | | | | |
Collapse
|
5
|
Zhang M, Denison RN, Pelli DG, Le TTC, Ihlefeld A. An auditory-visual tradeoff in susceptibility to clutter. Sci Rep 2021; 11:23540. [PMID: 34876580 PMCID: PMC8651672 DOI: 10.1038/s41598-021-00328-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 08/12/2021] [Indexed: 01/13/2023] Open
Abstract
Sensory cortical mechanisms combine auditory or visual features into perceived objects. This is difficult in noisy or cluttered environments. Knowing that individuals vary greatly in their susceptibility to clutter, we wondered whether there might be a relation between an individual's auditory and visual susceptibilities to clutter. In auditory masking, background sound makes spoken words unrecognizable. When masking arises due to interference at central auditory processing stages, beyond the cochlea, it is called informational masking. A strikingly similar phenomenon in vision, called visual crowding, occurs when nearby clutter makes a target object unrecognizable, despite being resolved at the retina. We here compare susceptibilities to auditory informational masking and visual crowding in the same participants. Surprisingly, across participants, we find a negative correlation (R = -0.7) between susceptibility to informational masking and crowding: Participants who have low susceptibility to auditory clutter tend to have high susceptibility to visual clutter, and vice versa. This reveals a tradeoff in the brain between auditory and visual processing.
Collapse
Affiliation(s)
- Min Zhang
- grid.260896.30000 0001 2166 4955Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ USA ,grid.430387.b0000 0004 1936 8796Department of Biomedical Engineering, Rutgers New Jersey Medical School, Newark, NJ USA
| | - Rachel N Denison
- grid.189504.10000 0004 1936 7558Department of Psychology, Boston University, Boston, MA USA
| | - Denis G Pelli
- grid.137628.90000 0004 1936 8753Department of Psychology, New York University, New York, NY USA
| | - Thuy Tien C Le
- grid.260896.30000 0001 2166 4955Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ USA ,grid.430387.b0000 0004 1936 8796Department of Biomedical Engineering, Rutgers New Jersey Medical School, Newark, NJ USA
| | - Antje Ihlefeld
- Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, USA.
| |
Collapse
|