1
|
Vakitbilir N, Islam A, Gomez A, Stein KY, Froese L, Bergmann T, Sainbhi AS, McClarty D, Raj R, Zeiler FA. Multivariate Modelling and Prediction of High-Frequency Sensor-Based Cerebral Physiologic Signals: Narrative Review of Machine Learning Methodologies. SENSORS (BASEL, SWITZERLAND) 2024; 24:8148. [PMID: 39771880 PMCID: PMC11679405 DOI: 10.3390/s24248148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Revised: 12/09/2024] [Accepted: 12/18/2024] [Indexed: 01/11/2025]
Abstract
Monitoring cerebral oxygenation and metabolism, using a combination of invasive and non-invasive sensors, is vital due to frequent disruptions in hemodynamic regulation across various diseases. These sensors generate continuous high-frequency data streams, including intracranial pressure (ICP) and cerebral perfusion pressure (CPP), providing real-time insights into cerebral function. Analyzing these signals is crucial for understanding complex brain processes, identifying subtle patterns, and detecting anomalies. Computational models play an essential role in linking sensor-derived signals to the underlying physiological state of the brain. Multivariate machine learning models have proven particularly effective in this domain, capturing intricate relationships among multiple variables simultaneously and enabling the accurate modeling of cerebral physiologic signals. These models facilitate the development of advanced diagnostic and prognostic tools, promote patient-specific interventions, and improve therapeutic outcomes. Additionally, machine learning models offer great flexibility, allowing different models to be combined synergistically to address complex challenges in sensor-based data analysis. Ensemble learning techniques, which aggregate predictions from diverse models, further enhance predictive accuracy and robustness. This review explores the use of multivariate machine learning models in cerebral physiology as a whole, with an emphasis on sensor-derived signals related to hemodynamics, cerebral oxygenation, metabolism, and other modalities such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) where applicable. It will detail the operational principles, mathematical foundations, and clinical implications of these models, providing a deeper understanding of their significance in monitoring cerebral function.
Collapse
Affiliation(s)
- Nuray Vakitbilir
- Department of Biomedical Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (A.I.); (K.Y.S.); (A.S.S.); (F.A.Z.)
| | - Abrar Islam
- Department of Biomedical Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (A.I.); (K.Y.S.); (A.S.S.); (F.A.Z.)
| | - Alwyn Gomez
- Section of Neurosurgery, Department of Surgery, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB R3A 1R9, Canada
- Department of Human Anatomy and Cell Science, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB R3E 0J9, Canada
| | - Kevin Y. Stein
- Department of Biomedical Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (A.I.); (K.Y.S.); (A.S.S.); (F.A.Z.)
| | - Logan Froese
- Department of Clinical Neuroscience, Karolinska Institutet, 171 77 Stockholm, Sweden;
| | - Tobias Bergmann
- Undergraduate Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada;
| | - Amanjyot Singh Sainbhi
- Department of Biomedical Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (A.I.); (K.Y.S.); (A.S.S.); (F.A.Z.)
| | - Davis McClarty
- Undergraduate Medicine, College of Medicine, Rady Faculty of Health Sciences, Winnipeg, MB R3E 3P5, Canada;
| | - Rahul Raj
- Department of Neurosurgery, University of Helsinki, 00100 Helsinki, Finland;
| | - Frederick A. Zeiler
- Department of Biomedical Engineering, Price Faculty of Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (A.I.); (K.Y.S.); (A.S.S.); (F.A.Z.)
- Section of Neurosurgery, Department of Surgery, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB R3A 1R9, Canada
- Department of Clinical Neuroscience, Karolinska Institutet, 171 77 Stockholm, Sweden;
- Pan Am Clinic Foundation, Winnipeg, MB R3M 3E4, Canada
| |
Collapse
|
2
|
Hill DF, Hickman RW, Al-Mohammad A, Stasiak A, Schultz W. Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task. Nat Commun 2024; 15:8138. [PMID: 39289338 PMCID: PMC11408490 DOI: 10.1038/s41467-024-52311-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Accepted: 08/29/2024] [Indexed: 09/19/2024] Open
Abstract
The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward ("incentive compatibility"). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals' bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.
Collapse
Affiliation(s)
- Daniel F Hill
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK.
| | - Robert W Hickman
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK
| | - Alaa Al-Mohammad
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK
| | - Arkadiusz Stasiak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK.
| |
Collapse
|
3
|
Hill DF, Hickman RW, Al-Mohammad A, Stasiak A, Schultz W. Dopamine neurons encode trial-by-trial subjective reward value in an auction-like task. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.01.20.524896. [PMID: 36711724 PMCID: PMC9882283 DOI: 10.1101/2023.01.20.524896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
The dopamine reward prediction error signal is known to be subjective but has so far only been assessed in aggregate choices. However, personal choices fluctuate across trials and thus reflect the instantaneous subjective reward value. In the well-established Becker-DeGroot-Marschak (BDM) auction-like mechanism, participants are encouraged to place bids that accurately reveal their instantaneous subjective reward value; inaccurate bidding results in suboptimal reward ('incentive compatibility'). In our experiment, male rhesus monkeys became experienced over several years to place accurate BDM bids for juice rewards without specific external constraints. Their bids for physically identical rewards varied trial by trial and increased overall for larger rewards. In these highly experienced animals, responses of midbrain dopamine neurons followed the trial-by-trial variations of bids despite constant, explicitly predicted reward amounts. Inversely, dopamine responses were similar with similar bids for different physical reward amounts. Support Vector Regression demonstrated accurate prediction of the animals' bids by as few as twenty dopamine neurons. Thus, the phasic dopamine reward signal reflects instantaneous subjective reward value.
Collapse
Affiliation(s)
- Daniel F Hill
- Department of Physiology, Development and Neuroscience , University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Robert W Hickman
- Department of Physiology, Development and Neuroscience , University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Alaa Al-Mohammad
- Department of Physiology, Development and Neuroscience , University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Arkadiusz Stasiak
- Department of Physiology, Development and Neuroscience , University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience , University of Cambridge, Cambridge CB2 3DY, United Kingdom
| |
Collapse
|
4
|
Franch M, Yellapantula S, Parajuli A, Kharas N, Wright A, Aazhang B, Dragoi V. Visuo-frontal interactions during social learning in freely moving macaques. Nature 2024; 627:174-181. [PMID: 38355804 PMCID: PMC10959748 DOI: 10.1038/s41586-024-07084-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 01/16/2024] [Indexed: 02/16/2024]
Abstract
Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.
Collapse
Affiliation(s)
- Melissa Franch
- Deparment of Neurobiology and Anatomy, McGovern Medical School, University of Texas, Houston, TX, USA
| | - Sudha Yellapantula
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Arun Parajuli
- Deparment of Neurobiology and Anatomy, McGovern Medical School, University of Texas, Houston, TX, USA
| | - Natasha Kharas
- Deparment of Neurobiology and Anatomy, McGovern Medical School, University of Texas, Houston, TX, USA
| | - Anthony Wright
- Deparment of Neurobiology and Anatomy, McGovern Medical School, University of Texas, Houston, TX, USA
| | - Behnaam Aazhang
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Valentin Dragoi
- Deparment of Neurobiology and Anatomy, McGovern Medical School, University of Texas, Houston, TX, USA.
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA.
- Neuroengineering Initiative, Rice University, Houston, TX, USA.
- Houston Methodist Research Institute, Houston, TX, USA.
| |
Collapse
|
5
|
Baker M, Kang S, Hong SI, Song M, Yang MA, Peyton L, Essa H, Lee SW, Choi DS. External globus pallidus input to the dorsal striatum regulates habitual seeking behavior in male mice. Nat Commun 2023; 14:4085. [PMID: 37438336 PMCID: PMC10338526 DOI: 10.1038/s41467-023-39545-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 06/16/2023] [Indexed: 07/14/2023] Open
Abstract
The external globus pallidus (GPe) coordinates action-selection through GABAergic projections throughout the basal ganglia. GPe arkypallidal (arky) neurons project exclusively to the dorsal striatum, which regulates goal-directed and habitual seeking. However, the role of GPe arky neurons in reward-seeking remains unknown. Here, we identified that a majority of arky neurons target the dorsolateral striatum (DLS). Using fiber photometry, we found that arky activities were higher during random interval (RI; habit) compared to random ratio (RR; goal) operant conditioning. Support vector machine analysis demonstrated that arky neuron activities have sufficient information to distinguish between RR and RI behavior. Genetic ablation of this arkyGPe→DLS circuit facilitated a shift from goal-directed to habitual behavior. Conversely, chemogenetic activation globally reduced seeking behaviors, which was blocked by systemic D1R agonism. Our findings reveal a role of this arkyGPe→DLS circuit in constraining habitual seeking in male mice, which is relevant to addictive behaviors and other compulsive disorders.
Collapse
Affiliation(s)
- Matthew Baker
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA
| | - Seungwoo Kang
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA
- Department of Pharmacology and Toxicology, Medical College of Georgia, Augusta University, Augusta, GA, 30912, USA
| | - Sa-Ik Hong
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA
| | - Minryung Song
- Department of Brain and Cognitive Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
| | - Minsu Abel Yang
- Department of Brain and Cognitive Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
| | - Lee Peyton
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA
| | - Hesham Essa
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA
| | - Sang Wan Lee
- Department of Brain and Cognitive Sciences, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
| | - Doo-Sup Choi
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, MN, 55905, USA.
- Department of Psychiatry and Psychology, Mayo Clinic College of Medicine and Science, Rochester, MN, 55905, USA.
- Neuroscience Program, Mayo Clinic College of Medicine and Science, Rochester, MN, 55905, USA.
| |
Collapse
|
6
|
Pastor-Bernier A, Volkmann K, Chi U Seak L, Stasiak A, Plott CR, Schultz W. Studying neural responses for multi-component economic choices in human and non-human primates using concept-based behavioral choice experiments. STAR Protoc 2023; 4:102296. [PMID: 37294630 PMCID: PMC10323126 DOI: 10.1016/j.xpro.2023.102296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 02/24/2023] [Accepted: 04/19/2023] [Indexed: 06/11/2023] Open
Abstract
Realistic, everyday rewards contain multiple components, such as taste and size. However, our reward valuations and the associated neural reward signals are single dimensional (vector to scalar transformation). Here, we present a protocol to identify these single-dimensional neural responses for multi-component choice options in humans and monkeys using concept-based behavioral choice experiments. We describe the use of stringent economic concepts to develop and implement behavioral tasks. We detail regional neuroimaging in humans and fine-grained neurophysiology in monkeys and describe approaches for data analysis. For complete details on the use and execution of this protocol, please refer to our work on humans Seak et al.1 and Pastor-Bernier et al.2 and monkeys Pastor-Bernier et al. 3, Pastor-Bernier et al.4, and Pastor-Bernier et al.5.
Collapse
Affiliation(s)
- Alexandre Pastor-Bernier
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Konstantin Volkmann
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Leo Chi U Seak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Arkadiusz Stasiak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Charles R Plott
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK.
| |
Collapse
|