1
|
Wang Y. Efficient Neural Decoding Based on Multimodal Training. Brain Sci 2024; 14:988. [PMID: 39452003 PMCID: PMC11506634 DOI: 10.3390/brainsci14100988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Academic Contribution Register] [Received: 08/23/2024] [Revised: 09/24/2024] [Accepted: 09/26/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND/OBJECTIVES Neural decoding methods are often limited by the performance of brain encoders, which map complex brain signals into a latent representation space of perception information. These brain encoders are constrained by the limited amount of paired brain and stimuli data available for training, making it challenging to learn rich neural representations. METHODS To address this limitation, we present a novel multimodal training approach using paired image and functional magnetic resonance imaging (fMRI) data to establish a brain masked autoencoder that learns the interactions between images and brain activities. Subsequently, we employ a diffusion model conditioned on brain data to decode realistic images. RESULTS Our method achieves high-quality decoding results in semantic contents and low-level visual attributes, outperforming previous methods both qualitatively and quantitatively, while maintaining computational efficiency. Additionally, our method is applied to decode artificial patterns across region of interests (ROIs) to explore their functional properties. We not only validate existing knowledge concerning ROIs but also unveil new insights, such as the synergy between early visual cortex and higher-level scene ROIs, as well as the competition within the higher-level scene ROIs. CONCLUSIONS These findings provide valuable insights for future directions in the field of neural decoding.
Collapse
Affiliation(s)
- Yun Wang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai 200433, China;
- Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, Shanghai 200433, China
| |
Collapse
|
2
|
Abstract
We review the structure and function of the vagus nerve, drawing on information obtained in humans and experimental animals. The vagus nerve is the largest and longest cranial nerve, supplying structures in the neck, thorax, and abdomen. It is also the only cranial nerve in which the vast majority of its innervation territory resides outside the head. While belonging to the parasympathetic division of the autonomic nervous system, the nerve is primarily sensory-it is dominated by sensory axons. We discuss the macroscopic and microscopic features of the nerve, including a detailed description of its extensive territory. Histochemical and genetic profiles of afferent and efferent axons are also detailed, as are the central nuclei involved in the processing of sensory information conveyed by the vagus nerve and the generation of motor (including parasympathetic) outflow via the vagus nerve. We provide a comprehensive review of the physiological roles of vagal sensory and motor neurons in control of the cardiovascular, respiratory, and gastrointestinal systems, and finish with a discussion on the interactions between the vagus nerve and the immune system. © 2022 American Physiological Society. Compr Physiol 12: 1-49, 2022.
Collapse
Affiliation(s)
- Matteo M Ottaviani
- Department of Neurosurgery, Università Politecnica delle Marche, Ancona, Italy
| | - Vaughan G Macefield
- Baker Heart and Diabetes Institute, Melbourne, Australia.,Baker Department of Cardiometabolic Health, University of Melbourne, Melbourne, Australia.,Department of Anatomy & Physiology, University of Melbourne, Melbourne, Australia
| |
Collapse
|
3
|
You C, Yao L, Yao P, Li L, Ding P, Liang S, Liu C, Xue N. An iEEG Recording and Adjustable Shunt-Current Conduction Platform for Epilepsy Treatment. BIOSENSORS 2022; 12:bios12040247. [PMID: 35448307 PMCID: PMC9032513 DOI: 10.3390/bios12040247] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Academic Contribution Register] [Received: 02/18/2022] [Revised: 04/08/2022] [Accepted: 04/09/2022] [Indexed: 05/05/2023]
Abstract
This paper proposes a compact bioelectronics sensing platform, including a multi-channel electrode, intracranial electroencephalogram (iEEG) recorder, adjustable galvanometer, and shunt-current conduction circuit pathway. The developed implantable electrode made of polyurethane-insulated stainless-steel materials is capable of recording iEEG signals and shunt-current conduction. The electrochemical impedance of the conduction, ground/reference, and working electrode were characterized in phosphate buffer saline solution, revealing in vitro results of 517.2 Ω@1 kHz (length of 0.1 mm, diameter of 0.8 mm), 1.374 kΩ@1 kHz (length of 0.3 mm, diameter of 0.1 mm), and 3.188 kΩ@1 kHz (length of 0.1 mm, diameter of 0.1 mm), respectively. On-bench measurement of the system revealed that the input noise of the system is less than 2 μVrms, the signal frequency bandwidth range is 1 Hz~10 kHz, and the shunt-current detection range is 0.1~3000 μA with an accuracy of above 99.985%. The electrode was implanted in the CA1 region of the right hippocampus of rats for the in vivo experiments. Kainic acid (KA)-induced seizures were detected through iEEG monitoring, and the induced shunt-current was successfully measured and conducted out of the brain through the designed circuit-body path, which verifies the potential of current conduction for the treatment of epilepsy.
Collapse
Affiliation(s)
- Changhua You
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute (AIR), Chinese Academy of Sciences, Beijing 100190, China; (C.Y.); (P.Y.); (C.L.)
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Lei Yao
- School of Microelectronics, Shanghai University, Shanghai 200444, China;
| | - Pan Yao
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute (AIR), Chinese Academy of Sciences, Beijing 100190, China; (C.Y.); (P.Y.); (C.L.)
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Li Li
- SPF Biotechnology Co., Ltd., Beijing 102100, China;
| | - Ping Ding
- Functional Neurosurgery Department, Beijing Children’s Hospital, Capital Medical University, Beijing 100045, China; (P.D.); (S.L.)
| | - Shuli Liang
- Functional Neurosurgery Department, Beijing Children’s Hospital, Capital Medical University, Beijing 100045, China; (P.D.); (S.L.)
| | - Chunxiu Liu
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute (AIR), Chinese Academy of Sciences, Beijing 100190, China; (C.Y.); (P.Y.); (C.L.)
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
- Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, Beijing 100190, China
| | - Ning Xue
- State Key Laboratory of Transducer Technology, Aerospace Information Research Institute (AIR), Chinese Academy of Sciences, Beijing 100190, China; (C.Y.); (P.Y.); (C.L.)
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
- Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, Beijing 100190, China
- Correspondence:
| |
Collapse
|
4
|
Ottaviani MM, Vallone F, Micera S, Recchia FA. Closed-Loop Vagus Nerve Stimulation for the Treatment of Cardiovascular Diseases: State of the Art and Future Directions. Front Cardiovasc Med 2022; 9:866957. [PMID: 35463766 PMCID: PMC9021417 DOI: 10.3389/fcvm.2022.866957] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Academic Contribution Register] [Received: 01/31/2022] [Accepted: 03/14/2022] [Indexed: 01/07/2023] Open
Abstract
The autonomic nervous system exerts a fine beat-to-beat regulation of cardiovascular functions and is consequently involved in the onset and progression of many cardiovascular diseases (CVDs). Selective neuromodulation of the brain-heart axis with advanced neurotechnologies is an emerging approach to corroborate CVDs treatment when classical pharmacological agents show limited effectiveness. The vagus nerve is a major component of the cardiac neuroaxis, and vagus nerve stimulation (VNS) is a promising application to restore autonomic function under various pathological conditions. VNS has led to encouraging results in animal models of CVDs, but its translation to clinical practice has not been equally successful, calling for more investigation to optimize this technique. Herein we reviewed the state of the art of VNS for CVDs and discuss avenues for therapeutic optimization. Firstly, we provided a succinct description of cardiac vagal innervation anatomy and physiology and principles of VNS. Then, we examined the main clinical applications of VNS in CVDs and the related open challenges. Finally, we presented preclinical studies that aim at overcoming VNS limitations through optimization of anatomical targets, development of novel neural interface technologies, and design of efficient VNS closed-loop protocols.
Collapse
Affiliation(s)
- Matteo Maria Ottaviani
- Institute of Life Sciences, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics and Artificial Intelligence, The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Fabio Vallone
- Department of Excellence in Robotics and Artificial Intelligence, The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Silvestro Micera
- Department of Excellence in Robotics and Artificial Intelligence, The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Bertarelli Foundation Chair in Translational Neural Engineering, Center for Neuroprosthetics, Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Fabio A. Recchia
- Institute of Life Sciences, Scuola Superiore Sant’Anna, Pisa, Italy
- Fondazione Toscana Gabriele Monasterio, Pisa, Italy
- Department of Physiology, Cardiovascular Research Center, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, United States
| |
Collapse
|
5
|
Vallone F, Ottaviani MM, Dedola F, Cutrone A, Romeni S, Panarese AM, Bernini F, Cracchiolo M, Strauss I, Gabisonia K, Gorgodze N, Mazzoni A, Recchia FA, Micera S. Simultaneous decoding of cardiovascular and respiratory functional changes from pig intraneural vagus nerve signals. J Neural Eng 2021; 18. [PMID: 34153949 DOI: 10.1088/1741-2552/ac0d42] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Academic Contribution Register] [Received: 06/29/2020] [Accepted: 06/21/2021] [Indexed: 12/15/2022]
Abstract
Objective. Bioelectronic medicine is opening new perspectives for the treatment of some major chronic diseases through the physical modulation of autonomic nervous system activity. Being the main peripheral route for electrical signals between central nervous system and visceral organs, the vagus nerve (VN) is one of the most promising targets. Closed-loop VN stimulation (VNS) would be crucial to increase effectiveness of this approach. Therefore, the extrapolation of useful physiological information from VN electrical activity would represent an invaluable source for single-target applications. Here, we present an advanced decoding algorithm novel to VN studies and properly detecting different functional changes from VN signals.Approach. VN signals were recorded using intraneural electrodes in anaesthetized pigs during cardiovascular and respiratory challenges mimicking increases in arterial blood pressure, tidal volume and respiratory rate. We developed a decoding algorithm that combines discrete wavelet transformation, principal component analysis, and ensemble learning made of classification trees.Main results. The new decoding algorithm robustly achieved high accuracy levels in identifying different functional changes and discriminating among them. Interestingly our findings suggest that electrodes positioning plays an important role on decoding performances. We also introduced a new index for the characterization of recording and decoding performance of neural interfaces. Finally, by combining an anatomically validated hybrid neural model and discrimination analysis, we provided new evidence suggesting a functional topographical organization of VN fascicles.Significance. This study represents an important step towards the comprehension of VN signaling, paving the way for the development of effective closed-loop VNS systems.
Collapse
Affiliation(s)
- Fabio Vallone
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Matteo Maria Ottaviani
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy.,Institute of Life Sciences, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Francesca Dedola
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Annarita Cutrone
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Simone Romeni
- Bertarelli Foundation Chair in Translational Neural Engineering, Center for Neuroprosthetics and Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Adele Macrí Panarese
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Fabio Bernini
- Institute of Life Sciences, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Marina Cracchiolo
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Ivo Strauss
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Khatia Gabisonia
- Institute of Life Sciences, Scuola Superiore Sant'Anna, Pisa, Italy.,Fondazione Toscana Gabriele Monasterio, Pisa, Italy
| | - Nikoloz Gorgodze
- Institute of Life Sciences, Scuola Superiore Sant'Anna, Pisa, Italy.,Fondazione Toscana Gabriele Monasterio, Pisa, Italy
| | - Alberto Mazzoni
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Fabio A Recchia
- Institute of Life Sciences, Scuola Superiore Sant'Anna, Pisa, Italy.,Fondazione Toscana Gabriele Monasterio, Pisa, Italy.,Department of Physiology, Cardiovascular Research Center, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, United States of America
| | - Silvestro Micera
- The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy.,Bertarelli Foundation Chair in Translational Neural Engineering, Center for Neuroprosthetics and Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| |
Collapse
|
6
|
Abstract
Research in bioelectronics is highly interdisciplinary, with many new developments being based on techniques from across the physical and life sciences. Advances in our understanding of the fundamental chemistry underlying the materials used in bioelectronic applications have been a crucial component of many recent discoveries. In this review, we highlight ways in which a chemistry-oriented perspective may facilitate novel and deep insights into both the fundamental scientific understanding and the design of materials, which can in turn tune the functionality and biocompatibility of bioelectronic devices. We provide an in-depth examination of several developments in the field, organized by the chemical properties of the materials. We conclude by surveying how some of the latest major topics of chemical research may be further integrated with bioelectronics.
Collapse
Affiliation(s)
- Yin Fang
- The James Franck Institute, University of Chicago, Chicago, IL 60637, USA
| | - Lingyuan Meng
- Pritzker School of Molecular Engineering, University of Chicago, Chicago, IL 60637, USA
| | | | - Erik Schaumann
- Department of Chemistry, University of Chicago, Chicago, IL 60637, USA
| | - Matthew Seebald
- Department of Chemistry, University of Chicago, Chicago, IL 60637, USA
| | - Bozhi Tian
- The James Franck Institute, University of Chicago, Chicago, IL 60637, USA
- Department of Chemistry, University of Chicago, Chicago, IL 60637, USA
- The Institute for Biophysical Dynamics, University of Chicago, Chicago, IL 60637, USA
| |
Collapse
|
7
|
Lubba CH, Ouyang A, Jones NS, Bruns TM, Schultz S. Bladder pressure encoding by sacral dorsal root ganglion fibres: implications for decoding. J Neural Eng 2020; 18. [PMID: 33202396 DOI: 10.1088/1741-2552/abcb14] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Academic Contribution Register] [Received: 10/25/2020] [Accepted: 11/17/2020] [Indexed: 11/11/2022]
Abstract
OBJECTIVE We aim at characterising the encoding of bladder pressure (intravesical pressure) by a population of sensory fibres. This research is motivated by the possibility to restore bladder function in elderly patients or after spinal cord injury using implanted devices, so called bioelectronic medicines. For these devices, nerve-based estimation of intravesical pressure can enable a personalized and on-demand stimulation paradigm, which has promise of being more effective and efficient. In this context, a better understanding of the encoding strategies employed by the body might in the future be exploited by informed decoding algorithms that enable a precise and robust bladder-pressure estimation. APPROACH To this end, we apply information theory to microelectrode-array recordings from the cat sacral dorsal root ganglion while filling the bladder, conduct surrogate data studies to augment the data we have, and finally decode pressure in a simple informed approach. MAIN RESULTS We find an encoding scheme by different main bladder neuron types that we divide into three response types (slow tonic, phasic, and derivative fibres). We show that an encoding by different bladder neuron types, each represented by multiple cells, offers reliability through within-type redundancy and high information rates through semi-independence of different types. Our subsequent decoding study shows a more robust decoding from mean responses of homogeneous cell pools. SIGNIFICANCE We have here, for the first time, established a link between an information theoretic analysis of the encoding of intravesical pressure by a population of sensory neurons to an informed decoding paradigm. We show that even a simple adapted decoder can exploit the redundancy in the population to be more robust against cell loss. This work thus paves the way towards principled encoding studies in the periphery and towards a new generation of informed peripheral nerve decoders for bioelectronic medicines.
Collapse
Affiliation(s)
- Carl Henning Lubba
- Bioengineering, Imperial College London, Royal School of Mines, Exhibition Road, London, SW7 2AZ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Aileen Ouyang
- Department of Biomedical Engineering, University of Michigan , Ann Arbor, Michigan, UNITED STATES
| | - Nick S Jones
- Department of Mathematics, Imperial College London, London, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Tim M Bruns
- Department of Biomedical Engineering, University of Michigan , Ann Arbor, Michigan, UNITED STATES
| | - Simon Schultz
- Imperial College London, London, SW7 2AZ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| |
Collapse
|
8
|
Xue N, Martinez ID, Sun J, Cheng Y, Liu C. Flexible multichannel vagus nerve electrode for stimulation and recording for heart failure treatment. Biosens Bioelectron 2018; 112:114-119. [DOI: 10.1016/j.bios.2018.04.043] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Academic Contribution Register] [Received: 02/14/2018] [Revised: 04/17/2018] [Accepted: 04/18/2018] [Indexed: 01/27/2023]
|
9
|
Sharma G, Annetta N, Friedenberg D, Blanco T, Vasconcelos D, Shaikhouni A, Rezai AR, Bouton C. Time Stability and Coherence Analysis of Multiunit, Single-Unit and Local Field Potential Neuronal Signals in Chronically Implanted Brain Electrodes. Bioelectron Med 2015. [DOI: 10.15424/bioelectronmed.2015.00010] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Academic Contribution Register] [Indexed: 11/05/2022] Open
|