1
|
Birkelund L, Dieperink KB, Sodemann M, Lindell JF, Steffensen KD, Nielsen DS. Language - a vital pill missing in patients' treatment: language barriers during cancer care through the eyes of patients and families. Int J Qual Stud Health Well-being 2025; 20:2448127. [PMID: 39801442 PMCID: PMC11731038 DOI: 10.1080/17482631.2024.2448127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 12/26/2024] [Indexed: 01/16/2025] Open
Abstract
PURPOSE When serious illness occurs, effective communication is essential but challenged by language barriers. This study explores how patients with limited Danish proficiency and their families experience language barriers during cancer care in two Danish public hospitals. METHOD Adopting a phenomenological-hermeneutic approach, the study stresses narratives in understanding participants' lived experiences. Accordingly, nine qualitative, semi-structured interviews were conducted with 17 informants, including nine patients and eight relatives. The interviews were audio-recorded and transcribed verbatim. RESULTS Based on analysis, three themes were identified: 1) A history of pain behind the language barrier; 2) Linguistic pain-a feeling of being trapped in mother tongue; and 3) Barriers and pathways to linguistic safety. The findings reveal that painful stories were not only brought into the hospital but continued there. Painful feelings associated with being unable to communicate directly with the healthcare professionals seemed inescapable, but continuity of empathetic care providers, including professional interpreters, increased the well-being of both patients and family members. CONCLUSION Language barriers not only make patients more susceptible to misunderstandings and medical errors but amplify experiences of pain during cancer care. The generated knowledge from this study emphasizes language as a foundational element in advancing more equitable cancer care.
Collapse
Affiliation(s)
- Lisbeth Birkelund
- Department of Geriatric Medicine, Odense University Hospital, Odense, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Family Focused Healthcare Research Center, University of Southern Denmark, Odense, Denmark
- Center for Shared Decision Making, Lillebaelt University Hospital of Southern Denmark, Vejle, Denmark
- Research Center for Culture and Older People (Vulnerability), University of Southern Denmark, Odense, Denmark
| | - Karin Brochstedt Dieperink
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Family Focused Healthcare Research Center, University of Southern Denmark, Odense, Denmark
- Department of Oncology, Odense University Hospital, Odense, Denmark
| | - Morten Sodemann
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Department of Infectious Diseases, Migrant Health Clinic, Odense University Hospital, Odense, Denmark
| | - Johanna Falby Lindell
- Department of Nordic Studies and Linguistics, University of Copenhagen, Copenhagen, Denmark
| | - Karina Dahl Steffensen
- Center for Shared Decision Making, Lillebaelt University Hospital of Southern Denmark, Vejle, Denmark
- Department of Regional Health Research, Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Dorthe Susanne Nielsen
- Department of Geriatric Medicine, Odense University Hospital, Odense, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Research Center for Culture and Older People (Vulnerability), University of Southern Denmark, Odense, Denmark
| |
Collapse
|
2
|
King BJ, Read GJM, Salmon PM. Prospectively identifying risks and controls for advanced brain-computer interfaces: A Networked Hazard Analysis and Risk Management System (Net-HARMS) approach. APPLIED ERGONOMICS 2025; 122:104382. [PMID: 39265503 DOI: 10.1016/j.apergo.2024.104382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 08/26/2024] [Accepted: 09/04/2024] [Indexed: 09/14/2024]
Abstract
The introduction of advanced digital technologies continues to increase system complexity and introduce risks, which must be proactively identified and managed to support system resilience. Brain-computer interfaces (BCIs) are one such technology; however, the risks arising from broad societal use of the technology have yet to be identified and controlled. This study applied a structured systems thinking-based risk assessment method to prospectively identify risks and risk controls for a hypothetical future BCI system lifecycle. The application of the Networked Hazard Analysis and Risk Management System (Net-HARMS) method identified over 800 risks throughout the BCI system lifecycle, from BCI development and regulation through to BCI use, maintenance, and decommissioning. High-criticality risk themes include the implantation and degradation of unsafe BCIs, unsolicited brain stimulation, incorrect signals being sent to safety-critical technologies, and insufficiently supported BCI users. Over 600 risk controls were identified that could be implemented to support system safety and performance resilience. Overall, many highly-impactful BCI system safety and performance risks may arise throughout the BCI system lifecycle and will require collaborative efforts from a wide range of BCI stakeholders to adequately control. Whilst some of the identified controls are practical, work is required to develop a more systematic set of controls to best support the design of a resilient sociotechnical BCI system.
Collapse
Affiliation(s)
- Brandon J King
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, ML 47, Locked Bag 4, Maroochydore DC, Queensland, 4558, Australia; Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia.
| | - Gemma J M Read
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia; School of Health, University of the Sunshine Coast, Australia. https://twitter.com/gemma_read
| | - Paul M Salmon
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia. https://twitter.com/DrPaulSalmon
| |
Collapse
|
3
|
Alsuradi H, Hong J, Mazi H, Eid M. Neuro-motor controlled wearable augmentations: current research and emerging trends. Front Neurorobot 2024; 18:1443010. [PMID: 39544848 PMCID: PMC11560910 DOI: 10.3389/fnbot.2024.1443010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 10/15/2024] [Indexed: 11/17/2024] Open
Abstract
Wearable augmentations (WAs) designed for movement and manipulation, such as exoskeletons and supernumerary robotic limbs, are used to enhance the physical abilities of healthy individuals and substitute or restore lost functionality for impaired individuals. Non-invasive neuro-motor (NM) technologies, including electroencephalography (EEG) and sufrace electromyography (sEMG), promise direct and intuitive communication between the brain and the WA. After presenting a historical perspective, this review proposes a conceptual model for NM-controlled WAs, analyzes key design aspects, such as hardware design, mounting methods, control paradigms, and sensory feedback, that have direct implications on the user experience, and in the long term, on the embodiment of WAs. The literature is surveyed and categorized into three main areas: hand WAs, upper body WAs, and lower body WAs. The review concludes by highlighting the primary findings, challenges, and trends in NM-controlled WAs. This review motivates researchers and practitioners to further explore and evaluate the development of WAs, ensuring a better quality of life.
Collapse
Affiliation(s)
- Haneen Alsuradi
- Engineering Division, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Joseph Hong
- Engineering Division, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Helin Mazi
- Engineering Division, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Mohamad Eid
- Engineering Division, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
4
|
Violante IR, Okyere P. Can neurotechnology revolutionize cognitive enhancement? PLoS Biol 2024; 22:e3002831. [PMID: 39471132 PMCID: PMC11521288 DOI: 10.1371/journal.pbio.3002831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2024] Open
Abstract
The development and implementation of neurotechnology for cognitive enhancement could spearhead a new wave of innovation in the information age. However, we argue here that this will only happen with a more fundamental understanding of human brain function.
Collapse
Affiliation(s)
- Ines R. Violante
- School of Psychology, Faculty of Health and Medical Sciences, University of Surrey, Guildford, United Kingdom
- School of Biomedical Engineering and Imaging Sciences, King’s College London, London, United Kingdom
| | - Prince Okyere
- School of Psychology, Faculty of Health and Medical Sciences, University of Surrey, Guildford, United Kingdom
| |
Collapse
|
5
|
Tesink V, Douglas T, Forsberg L, Ligthart S, Meynen G. Right to mental integrity and neurotechnologies: implications of the extended mind thesis. JOURNAL OF MEDICAL ETHICS 2024; 50:656-663. [PMID: 38408854 PMCID: PMC11503137 DOI: 10.1136/jme-2023-109645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 01/14/2024] [Indexed: 02/28/2024]
Abstract
The possibility of neurotechnological interference with our brain and mind raises questions about the moral rights that would protect against the (mis)use of these technologies. One such moral right that has received recent attention is the right to mental integrity. Though the metaphysical boundaries of the mind are a matter of live debate, most defences of this moral right seem to assume an internalist (brain-based) view of the mind. In this article, we will examine what an extended account of the mind might imply for the right to mental integrity and the protection it provides against neurotechnologies. We argue that, on an extended account of the mind, the scope of the right to mental integrity would expand significantly, implying that neurotechnologies would no longer pose a uniquely serious threat to the right. In addition, some neurotechnologies may even be protected by the right to mental integrity, as the technologies would become part of the mind. We conclude that adopting an extended account of the mind has significant implications for the right to mental integrity in terms of its protective scope and capacity to protect against neurotechnologies, demonstrating that metaphysical assumptions about the mind play an important role in determining the moral protection provided by the right.
Collapse
Affiliation(s)
- Vera Tesink
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Thomas Douglas
- Oxford Uehiro Centre for Practical Ethics, Faculty of Philosophy, University of Oxford, Oxford, UK
- Jesus College, University of Oxford, Oxford, UK
| | - Lisa Forsberg
- Oxford Uehiro Centre for Practical Ethics, Faculty of Philosophy, University of Oxford, Oxford, UK
| | - Sjors Ligthart
- Department of Criminal Law, Tilburg University, Tilburg, Netherlands
- Willem Pompe Institute for Criminal Law and Criminology and UCALL, Utrecht University, Utrecht, Netherlands
| | - Gerben Meynen
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Willem Pompe Institute for Criminal Law and Criminology and UCALL, Utrecht University, Utrecht, Netherlands
| |
Collapse
|
6
|
Shah DD, Carter P, Shivdasani MN, Fong N, Duan W, Esrafilzadeh D, Poole-Warren LA, Aregueta Robles UA. Deciphering platinum dissolution in neural stimulation electrodes: Electrochemistry or biology? Biomaterials 2024; 309:122575. [PMID: 38677220 DOI: 10.1016/j.biomaterials.2024.122575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 03/28/2024] [Accepted: 04/13/2024] [Indexed: 04/29/2024]
Abstract
Platinum (Pt) is the metal of choice for electrodes in implantable neural prostheses like the cochlear implants, deep brain stimulating devices, and brain-computer interfacing technologies. However, it is well known since the 1970s that Pt dissolution occurs with electrical stimulation. More recent clinical and in vivo studies have shown signs of corrosion in explanted electrode arrays and the presence of Pt-containing particulates in tissue samples. The process of degradation and release of metallic ions and particles can significantly impact on device performance. Moreover, the effects of Pt dissolution products on tissue health and function are still largely unknown. This is due to the highly complex chemistry underlying the dissolution process and the difficulty in decoupling electrical and chemical effects on biological responses. Understanding the mechanisms and effects of Pt dissolution proves challenging as the dissolution process can be influenced by electrical, chemical, physical, and biological factors, all of them highly variable between experimental settings. By evaluating comprehensive findings on Pt dissolution mechanisms reported in the fuel cell field, this review presents a critical analysis of the possible mechanisms that drive Pt dissolution in neural stimulation in vitro and in vivo. Stimulation parameters, such as aggregate charge, charge density, and electrochemical potential can all impact the levels of dissolved Pt. However, chemical factors such as electrolyte types, dissolved gases, and pH can all influence dissolution, confounding the findings of in vitro studies with multiple variables. Biological factors, such as proteins, have been documented to exhibit a mitigating effect on the dissolution process. Other biological factors like cells and fibro-proliferative responses, such as fibrosis and gliosis, impact on electrode properties and are suspected to impact on Pt dissolution. However, the relationship between electrical properties of stimulating electrodes and Pt dissolution remains contentious. Host responses to Pt degradation products are also controversial due to the unknown chemistry of Pt compounds formed and the lack of understanding of Pt distribution in clinical scenarios. The cytotoxicity of Pt produced via electrical stimulation appears similar to Pt-based compounds, including hexachloroplatinates and chemotherapeutic agents like cisplatin. While the levels of Pt produced under clinical and acute stimulation regimes were typically an order of magnitude lower than toxic concentrations observed in vitro, further research is needed to accurately assess the mass balance and type of Pt produced during long-term stimulation and its impact on tissue response. Finally, approaches to mitigating the dissolution process are reviewed. A wide variety of approaches, including stimulation strategies, coating electrode materials, and surface modification techniques to avoid excess charge during stimulation and minimise tissue response, may ultimately support long-term and safe operation of neural stimulating devices.
Collapse
Affiliation(s)
- Dhyey Devashish Shah
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia
| | - Paul Carter
- Cochlear Ltd, Macquarie University, NSW, Australia
| | | | - Nicole Fong
- Cochlear Ltd, Macquarie University, NSW, Australia
| | - Wenlu Duan
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia
| | - Dorna Esrafilzadeh
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia
| | - Laura Anne Poole-Warren
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, Australia; The Tyree Foundation Institute of Health Engineering, University of New South Wales, Sydney, Australia.
| | | |
Collapse
|
7
|
Ploesser M, Abraham ME, Daphne Broekman ML, Zincke MT, Beach CA, Urban NB, Ben-Haim S. Electrical and Magnetic Neuromodulation Technologies and Brain-Computer Interfaces: Ethical Considerations for Enhancement of Brain Function in Healthy People - A Systematic Scoping Review. Stereotact Funct Neurosurg 2024; 102:308-324. [PMID: 38986460 PMCID: PMC11457974 DOI: 10.1159/000539757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 06/09/2024] [Indexed: 07/12/2024]
Abstract
INTRODUCTION This scoping review aimed to synthesize the fragmented evidence on ethical concerns related to the use of electrical and magnetic neuromodulation technologies, as well as brain-computer interfaces for enhancing brain function in healthy individuals, addressing the gaps in understanding spurred by rapid technological advancements and ongoing ethical debates. METHODS The following databases and interfaces were queried: MEDLINE (via PubMed), Web of Science, PhilPapers, and Google Scholar. Additional references were identified via bibliographies of included citations. References included experimental studies, reviews, opinion papers, and letters to editors published in peer-reviewed journals that explored the ethical implications of electrical and magnetic neuromodulation technologies and brain-computer interfaces for enhancement of brain function in healthy adult or pediatric populations. RESULTS A total of 23 articles were included in the review, of which the majority explored expert opinions in the form of qualitative studies or surveys as well as reviews. Two studies explored the view of laypersons on the topic. The majority of evidence pointed to ethical concerns relating to a lack of sufficient efficacy and safety data for these new technologies, with the risks of invasive procedures potentially outweighing the benefits. Additionally, concerns about potential socioeconomic consequences were raised that could further exacerbate existing socioeconomic inequalities, as well as the risk of changes to person and environment. CONCLUSION This scoping review highlights a critical shortage of ethical research on electrical and magnetic neuromodulation technologies and brain-computer interfaces for enhancement of brain function in healthy individuals, with key concerns regarding the safety, efficacy, and socioeconomic impacts of neuromodulation technologies. It underscores the urgent need for integrating ethical considerations into neuroscientific research to address significant gaps and ensure equitable access and outcomes.
Collapse
Affiliation(s)
- Markus Ploesser
- Department of Psychiatry and Neuroscience, UC Riverside School of Medicine, Riverside, CA, USA
- Division of Forensic Psychiatry, Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, Canada
| | - Mickey Ellis Abraham
- Department of Neurological Surgery, University of California San Diego, La Jolla, CA, USA
| | - Marike Lianne Daphne Broekman
- Department of Neurosurgery, Haaglanden Medical Center, The Hague, The Netherlands
- Leiden University Medical Center, Leiden, The Netherlands
| | | | | | | | - Sharona Ben-Haim
- Department of Neurological Surgery, University of California San Diego, La Jolla, CA, USA
| |
Collapse
|
8
|
Beck A, Schönau A, MacDuffie K, Dasgupta I, Flynn G, Song D, Goering S, Klein E. "In the spectrum of people who are healthy": Views of individuals at risk of dementia on using neurotechnology for cognitive enhancement. NEUROETHICS-NETH 2024; 17:24. [PMID: 39790464 PMCID: PMC11709137 DOI: 10.1007/s12152-024-09557-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 04/14/2024] [Indexed: 01/12/2025]
Abstract
Neurotechnological cognitive enhancement has become an area of intense scientific, policy, and ethical interest. However, while work has increasingly focused on ethical views of the general public, less studied are those with personal connections to cognitive impairment. Using a mixed-methods design, we surveyed attitudes regarding implantable neurotechnological cognitive enhancement in individuals who self-identified as having increased likelihood of developing dementia (n=25; 'Our Study'), compared to a nationally representative sample of Americans (n=4726; 'Pew Study'). Participants in Our Study were additionally shown four videos showcasing hypothetical neurotechnological devices designed to enhance different cognitive abilities and were interviewed for more in-depth responses. Both groups expressed comparable degrees of worry and acknowledgement of potential ethical ramifications (all ps>0.05). Compared to the Pew Study, participants in Our Study expressed slightly higher desire (p<0.01), as well as higher acknowledgment for potential impacts on productivity (p<0.05). Ultimately, participants in Our Study were more likely to deem the device morally acceptable (56%; compared to Pew Study, 25.2%; p=0.0001). Interviews conducted in Our Study allowed participants to supply additional nuance and reasoning to survey responses, such as giving examples for increased productivity, perceived downsides of memory enhancement, or concerns regarding potentially resulting inequality. This study builds upon and adds to the growing focus on potential ethical issues surrounding neurotechnological cognitive enhancement by centering stakeholder perspectives, highlighting the need for inclusive research and consideration of diverse perspectives and lived experiences to ensure inclusive dialogue that best informs ethical and policy discussions in this rapidly advancing field.
Collapse
Affiliation(s)
- Asad Beck
- Department of Biology, University of Washington, Life Sciences Building, Seattle, WA, 98195, USA
- Graduate Program in Neuroscience, University of Washington, Health Sciences Building, Seattle, WA, 98195, USA
- Department of Philosophy, Savery Hall, University of Washington, Seattle, WA, 98195, USA
| | - Andreas Schönau
- Department of Philosophy, Savery Hall, University of Washington, Seattle, WA, 98195, USA
| | - Kate MacDuffie
- Treuman Katz Center for Pediatric Bioethics, Seattle Children’s Research Institute, 1900 Ninth Ave. Seattle, WA, 98101, USA
- Department of Pediatrics, Division of Bioethics and Palliative Care, University of Washington School of Medicine, Seattle, WA, 98105, USA
| | - Ishan Dasgupta
- The Dana Foundation, 1270 Avenue of the Americas, 12th Floor, New York, NY, 10020, USA
| | - Garrett Flynn
- Department of Biomedical Engineering, Denney Research Center, University of Southern California, Los Angeles, CA, 90089-1111, USA
| | - Dong Song
- Department of Biomedical Engineering, Denney Research Center, University of Southern California, Los Angeles, CA, 90089-1111, USA
| | - Sara Goering
- Department of Philosophy, Savery Hall, University of Washington, Seattle, WA, 98195, USA
| | - Eran Klein
- Department of Philosophy, Savery Hall, University of Washington, Seattle, WA, 98195, USA
- Department of Neurology, Oregon Health and Science University, Portland, OR, 97239-3098, USA
| |
Collapse
|
9
|
Granley J, Fauvel T, Chalk M, Beyeler M. Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2023; 36:79376-79398. [PMID: 38984104 PMCID: PMC11232484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
Neuroprostheses show potential in restoring lost sensory function and enhancing human capabilities, but the sensations produced by current devices often seem unnatural or distorted. Exact placement of implants and differences in individual perception lead to significant variations in stimulus response, making personalized stimulus optimization a key challenge. Bayesian optimization could be used to optimize patient-specific stimulation parameters with limited noisy observations, but is not feasible for high-dimensional stimuli. Alternatively, deep learning models can optimize stimulus encoding strategies, but typically assume perfect knowledge of patient-specific variations. Here we propose a novel, practically feasible approach that overcomes both of these fundamental limitations. First, a deep encoder network is trained to produce optimal stimuli for any individual patient by inverting a forward model mapping electrical stimuli to visual percepts. Second, a preferential Bayesian optimization strategy utilizes this encoder to optimize patient-specific parameters for a new patient, using a minimal number of pairwise comparisons between candidate stimuli. We demonstrate the viability of this approach on a novel, state-of-the-art visual prosthesis model. We show that our approach quickly learns a personalized stimulus encoder, leads to dramatic improvements in the quality of restored vision, and is robust to noisy patient feedback and misspecifications in the underlying forward model. Overall, our results suggest that combining the strengths of deep learning and Bayesian optimization could significantly improve the perceptual experience of patients fitted with visual prostheses and may prove a viable solution for a range of neuroprosthetic technologies.
Collapse
Affiliation(s)
- Jacob Granley
- Department of Computer Science, University of California, Santa Barbara
| | - Tristan Fauvel
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France, Now with Quinten Health
| | - Matthew Chalk
- Institut de la Vision, Sorbonne Université, 17 rue Moreau, F-75012 Paris, France
| | - Michael Beyeler
- Department of Computer Science, Department of Psychological & Brain Sciences, University of California, Santa Barbara
| |
Collapse
|
10
|
Vukelić M, Bui M, Vorreuther A, Lingelbach K. Combining brain-computer interfaces with deep reinforcement learning for robot training: a feasibility study in a simulation environment. FRONTIERS IN NEUROERGONOMICS 2023; 4:1274730. [PMID: 38234482 PMCID: PMC10790930 DOI: 10.3389/fnrgo.2023.1274730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 10/31/2023] [Indexed: 01/19/2024]
Abstract
Deep reinforcement learning (RL) is used as a strategy to teach robot agents how to autonomously learn complex tasks. While sparsity is a natural way to define a reward in realistic robot scenarios, it provides poor learning signals for the agent, thus making the design of good reward functions challenging. To overcome this challenge learning from human feedback through an implicit brain-computer interface (BCI) is used. We combined a BCI with deep RL for robot training in a 3-D physical realistic simulation environment. In a first study, we compared the feasibility of different electroencephalography (EEG) systems (wet- vs. dry-based electrodes) and its application for automatic classification of perceived errors during a robot task with different machine learning models. In a second study, we compared the performance of the BCI-based deep RL training to feedback explicitly given by participants. Our findings from the first study indicate the use of a high-quality dry-based EEG-system can provide a robust and fast method for automatically assessing robot behavior using a sophisticated convolutional neural network machine learning model. The results of our second study prove that the implicit BCI-based deep RL version in combination with the dry EEG-system can significantly accelerate the learning process in a realistic 3-D robot simulation environment. Performance of the BCI-based trained deep RL model was even comparable to that achieved by the approach with explicit human feedback. Our findings emphasize the usage of BCI-based deep RL methods as a valid alternative in those human-robot applications where no access to cognitive demanding explicit human feedback is available.
Collapse
Affiliation(s)
- Mathias Vukelić
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering (IAO), Stuttgart, Germany
| | - Michael Bui
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering (IAO), Stuttgart, Germany
| | - Anna Vorreuther
- Applied Neurocognitive Systems, Institute of Human Factors and Technology Management (IAT), University of Stuttgart, Stuttgart, Germany
| | - Katharina Lingelbach
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering (IAO), Stuttgart, Germany
| |
Collapse
|
11
|
Sadras N, Sani OG, Ahmadipour P, Shanechi MM. Post-stimulus encoding of decision confidence in EEG: toward a brain-computer interface for decision making. J Neural Eng 2023; 20:056012. [PMID: 37524073 DOI: 10.1088/1741-2552/acec14] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 07/31/2023] [Indexed: 08/02/2023]
Abstract
Objective.When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI.Approach.We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap.Main results.We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost of errors are high.Significance.Our results show feasibility of non-invasive EEG-based BCIs to improve human decision making.
Collapse
Affiliation(s)
- Nitin Sadras
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Omid G Sani
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Parima Ahmadipour
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
| | - Maryam M Shanechi
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Department of Computer Science, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America
- Neuroscience Graduate Program University of Southern California, Los Angeles, CA, United States of America
| |
Collapse
|
12
|
Erden YJ, Brey P. Neurotechnology and ethics guidelines for human enhancement: The case of the hippocampal cognitive prosthesis. Artif Organs 2023; 47:1235-1241. [PMID: 37533179 DOI: 10.1111/aor.14615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/04/2023]
Abstract
Neurotechnologies offer both therapeutic and enhancement potential. In this article, we demonstrate how ethics guidelines can help with critical reflection on their potential for enhancement. We do this through the case of the hippocampal cognitive prosthesis. This prothesis developed in the US, has primarily therapeutic ends, with scope for enhancement. This technology raises several ethical issues, including as related to identity and memory, autonomy and authenticity. In the first section, we outline what we mean by enhancement, and introduce neurotechnologies generally and the hippocampal cognitive prosthesis specifically, with an introduction to generally relevant ethical issues. In the second section, we outline ethical issues pertinent to the hippocampal cognitive prosthesis and explore how ethics guidelines can help to promote essential critical reflection on a technology like this. Through all this, our emphasis is to balance between technological optimism and caution, especially where technologies have enhancement potential.
Collapse
Affiliation(s)
- Yasemin J Erden
- Philosophy Section, Faculty of Behavioural, Management and Social Sciences, University of Twente, Enschede, The Netherlands
| | - Philip Brey
- Philosophy Section, Faculty of Behavioural, Management and Social Sciences, University of Twente, Enschede, The Netherlands
| |
Collapse
|
13
|
Yoo SH, Choi K, Nam S, Yoon EK, Sohn JW, Oh BM, Shim J, Choi MY. Development of Korea Neuroethics Guidelines. J Korean Med Sci 2023; 38:e193. [PMID: 37365727 DOI: 10.3346/jkms.2023.38.e193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 03/07/2023] [Indexed: 06/28/2023] Open
Abstract
BACKGROUND Advances in neuroscience and neurotechnology provide great benefits to humans though unknown challenges may arise. We should address these challenges using new standards as well as existing ones. Novel standards should include ethical, legal, and social aspects which would be appropriate for advancing neuroscience and technology. Therefore, the Korea Neuroethics Guidelines were developed by stakeholders related to neuroscience and neurotechnology, including experts, policy makers, and the public in the Republic of Korea. METHOD The guidelines were drafted by neuroethics experts, were disclosed at a public hearing, and were subsequently revised by opinions of various stakeholders. RESULTS The guidelines are composed of twelve issues; humanity or human dignity, individual personality and identity, social justice, safety, sociocultural prejudice and public communication, misuse of technology, responsibility for the use of neuroscience and technology, specificity according to the purpose of using neurotechnology, autonomy, privacy and personal information, research, and enhancement. CONCLUSION Although the guidelines may require a more detailed discussion after future advances in neuroscience and technology or changes in socio-cultural milieu, the development of the Korea Neuroethics Guidelines is a milestone for the scientific community and society in general for the ongoing development in neuroscience and neurotechnology.
Collapse
Affiliation(s)
- Sang-Ho Yoo
- Department of Medical Humanities and Ethics, Hanyang University College of Medicine, Seoul, Korea
| | - Kyungsuk Choi
- School of Law/Bioethics Policy Studies, Ewha Womans University, Seoul, Korea
| | - Seungmin Nam
- Department of Pre-Medicine, College of Medicine, Ewha Womans University, Seoul, Korea
| | - Ei-Kyung Yoon
- Department of Criminal Justice Policy Research, Korean Institute of Criminology and Justice, Seoul, Korea
| | - Jeong-Woo Sohn
- Department of Medical Science, College of Medicine, Catholic Kwandong University, Gangneung, Korea
| | - Byung-Mo Oh
- Department of Rehabilitation Medicine, Seoul National University College of Medicine, Seoul National University Hospital, Seoul, Korea
| | - Jiwon Shim
- Department of Philosophy, Dongguk University, Seoul, Korea
| | - Min-Young Choi
- Department of Criminal Justice Policy Research, Korean Institute of Criminology and Justice, Seoul, Korea.
| |
Collapse
|
14
|
King BJ, Read GJM, Salmon PM. Identifying risk controls for future advanced brain-computer interfaces: A prospective risk assessment approach using work domain analysis. APPLIED ERGONOMICS 2023; 111:104028. [PMID: 37148587 DOI: 10.1016/j.apergo.2023.104028] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Revised: 04/13/2023] [Accepted: 04/13/2023] [Indexed: 05/08/2023]
Abstract
Brain-computer interface (BCI) technologies are progressing rapidly and may eventually be implemented widely within society, yet their risks have arguably not yet been comprehensively identified, nor understood. This study analysed an anticipated invasive BCI system lifecycle to identify the individual, organisational, and societal risks associated with BCIs, and controls that could be used to mitigate or eliminate these risks. A BCI system lifecycle work domain analysis model was developed and validated with 10 subject matter experts. The model was subsequently used to undertake a systems thinking-based risk assessment approach to identify risks that could emerge when functions are either undertaken sub-optimally or not undertaken at all. Eighteen broad risk themes were identified that could negatively impact the BCI system lifecycle in a variety of unique ways, while a larger number of controls for these risks were also identified. The most concerning risks included inadequate regulation of BCI technologies and inadequate training of BCI stakeholders, such as users and clinicians. In addition to specifying a practical set of risk controls to inform BCI device design, manufacture, adoption, and utilisation, the results demonstrate the complexity involved in managing BCI risks and suggests that a system-wide coordinated response is required. Future research is required to evaluate the comprehensiveness of the identified risks and the practicality of implementing the risk controls.
Collapse
Affiliation(s)
- Brandon J King
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia.
| | - Gemma J M Read
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia; School of Health, University of the Sunshine Coast, Australia. https://twitter.com/gemma_read
| | - Paul M Salmon
- Centre for Human Factors and Sociotechnical Systems, University of the Sunshine Coast, Australia. https://twitter.com/DrPaulSalmon
| |
Collapse
|
15
|
Wascher E, Reiser J, Rinkenauer G, Larrá M, Dreger FA, Schneider D, Karthaus M, Getzmann S, Gutberlet M, Arnau S. Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design. HUMAN FACTORS 2023; 65:86-106. [PMID: 33861182 PMCID: PMC9846382 DOI: 10.1177/00187208211007707] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 03/13/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVE We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed. BACKGROUND Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics. RESULTS Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior. CONCLUSION Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.
Collapse
Affiliation(s)
- Edmund Wascher
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Julian Reiser
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Gerhard Rinkenauer
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Mauro Larrá
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Felix A. Dreger
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Daniel Schneider
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Melanie Karthaus
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Stephan Getzmann
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | | | - Stefan Arnau
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| |
Collapse
|
16
|
Granley J, Relic L, Beyeler M. Hybrid Neural Autoencoders for Stimulus Encoding in Visual and Other Sensory Neuroprostheses. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2022; 35:22671-22685. [PMID: 37719469 PMCID: PMC10504858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
Sensory neuroprostheses are emerging as a promising technology to restore lost sensory function or augment human capabilities. However, sensations elicited by current devices often appear artificial and distorted. Although current models can predict the neural or perceptual response to an electrical stimulus, an optimal stimulation strategy solves the inverse problem: what is the required stimulus to produce a desired response? Here, we frame this as an end-to-end optimization problem, where a deep neural network stimulus encoder is trained to invert a known and fixed forward model that approximates the underlying biological system. As a proof of concept, we demonstrate the effectiveness of this hybrid neural autoencoder (HNA) in visual neuroprostheses. We find that HNA produces high-fidelity patient-specific stimuli representing handwritten digits and segmented images of everyday objects, and significantly outperforms conventional encoding strategies across all simulated patients. Overall this is an important step towards the long-standing challenge of restoring high-quality vision to people living with incurable blindness and may prove a promising solution for a variety of neuroprosthetic technologies.
Collapse
Affiliation(s)
- Jacob Granley
- Department of Computer Science, University of California, Santa Barbara
| | - Lucas Relic
- Department of Computer Science, University of California, Santa Barbara
| | - Michael Beyeler
- Department of Computer Science, University of California, Santa Barbara; Department of Psychological & Brain Sciences, University of California, Santa Barbara
| |
Collapse
|
17
|
Di Stefano N, Jarrassé N, Valera L. The Ethics of Supernumerary Robotic Limbs. An Enactivist Approach. SCIENCE AND ENGINEERING ETHICS 2022; 28:57. [PMID: 36376778 PMCID: PMC9663385 DOI: 10.1007/s11948-022-00405-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 09/12/2022] [Indexed: 06/16/2023]
Abstract
Supernumerary robotic limbs are innovative devices in the field of wearable robotics which can provide humans with unprecedented sensorimotor abilities. However, scholars have raised awareness of the ethical issues that would arise from the large adoption of technologies for human augmentation in society. Most negative attitudes towards such technologies seem to rely on an allegedly clear distinction between therapy and enhancement in the use of technological devices. Based on such distinction, people tend to accept technologies when used for therapeutic purposes (e.g., prostheses), but tend to raise issues when similar devices are used for upgrading a physical or cognitive ability (e.g., supernumerary robotics limbs). However, as many scholars have pointed out, the distinction between therapy and enhancement might be theoretically flawed. In this paper, we present an alternative approach to the ethics of supernumerary limbs which is based on two related claims. First, we propose to conceive supernumerary limbs as tools that necessarily modify our psychological and bodily identity. At the same time, we stress that such a modification is not ethically bad in itself; on the contrary, it drives human interaction with the environment. Second, by comparing our view with the extended mind thesis, we claim that the mediation through tools is crucial for the formation of novel meanings and skills that constitute human interaction with the world. We will relate the latter claim to enactivism as a helpful theoretical perspective to frame issues related to artificial limbs and, more in general, to technologies for augmentation. Based on this approach, we finally sketch some suggestions for future directions in the ethics of supernumerary limbs.
Collapse
Affiliation(s)
- Nicola Di Stefano
- Institute of Cognitive Sciences and Technologies (ISTC), National Research Council of Italy (CNR), Via S. Martino Della Battaglia 44, 00185, Rome, Italy.
| | - Nathanaël Jarrassé
- Centre National de la Recherche Scientifique (CNRS) UMR 7222, Institut des Systèmes Intelligentes et de Robotique (ISIR) /INSERM U1150 Agathe‑ISIR, Sorbonne Université, 75005, Paris, France
| | - Luca Valera
- Center for Bioethics, Pontifical Universidad Catolica de Chile, Av. Libertador Bernardo O'Higgins 340, Santiago, Chile
- Facultad de Filosofia y Letras, Universidad de Valladolid, Plaza Campus Universitario, s/n. 47011, Valladolid, Spain
| |
Collapse
|
18
|
Valeriani D, Santoro F, Ienca M. The present and future of neural interfaces. Front Neurorobot 2022; 16:953968. [PMID: 36304780 PMCID: PMC9592849 DOI: 10.3389/fnbot.2022.953968] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 07/13/2022] [Indexed: 11/18/2022] Open
Abstract
The 2020's decade will likely witness an unprecedented development and deployment of neurotechnologies for human rehabilitation, personalized use, and cognitive or other enhancement. New materials and algorithms are already enabling active brain monitoring and are allowing the development of biohybrid and neuromorphic systems that can adapt to the brain. Novel brain-computer interfaces (BCIs) have been proposed to tackle a variety of enhancement and therapeutic challenges, from improving decision-making to modulating mood disorders. While these BCIs have generally been developed in an open-loop modality to optimize their internal neural decoders, this decade will increasingly witness their validation in closed-loop systems that are able to continuously adapt to the user's mental states. Therefore, a proactive ethical approach is needed to ensure that these new technological developments go hand in hand with the development of a sound ethical framework. In this perspective article, we summarize recent developments in neural interfaces, ranging from neurohybrid synapses to closed-loop BCIs, and thereby identify the most promising macro-trends in BCI research, such as simulating vs. interfacing the brain, brain recording vs. brain stimulation, and hardware vs. software technology. Particular attention is devoted to central nervous system interfaces, especially those with application in healthcare and human enhancement. Finally, we critically assess the possible futures of neural interfacing and analyze the short- and long-term implications of such neurotechnologies.
Collapse
Affiliation(s)
| | - Francesca Santoro
- Institute for Biological Information Processing - Bioelectronics, IBI-3, Forschungszentrum Juelich, Juelich, Germany
- Faculty of Electrical Engineering and Information Technology, RWTH Aachen University, Aachen, Germany
| | - Marcello Ienca
- College of Humanities, Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland
- *Correspondence: Marcello Ienca
| |
Collapse
|
19
|
Jangwan NS, Ashraf GM, Ram V, Singh V, Alghamdi BS, Abuzenadah AM, Singh MF. Brain augmentation and neuroscience technologies: current applications, challenges, ethics and future prospects. Front Syst Neurosci 2022; 16:1000495. [PMID: 36211589 PMCID: PMC9538357 DOI: 10.3389/fnsys.2022.1000495] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 08/31/2022] [Indexed: 12/02/2022] Open
Abstract
Ever since the dawn of antiquity, people have strived to improve their cognitive abilities. From the advent of the wheel to the development of artificial intelligence, technology has had a profound leverage on civilization. Cognitive enhancement or augmentation of brain functions has become a trending topic both in academic and public debates in improving physical and mental abilities. The last years have seen a plethora of suggestions for boosting cognitive functions and biochemical, physical, and behavioral strategies are being explored in the field of cognitive enhancement. Despite expansion of behavioral and biochemical approaches, various physical strategies are known to boost mental abilities in diseased and healthy individuals. Clinical applications of neuroscience technologies offer alternatives to pharmaceutical approaches and devices for diseases that have been fatal, so far. Importantly, the distinctive aspect of these technologies, which shapes their existing and anticipated participation in brain augmentations, is used to compare and contrast them. As a preview of the next two decades of progress in brain augmentation, this article presents a plausible estimation of the many neuroscience technologies, their virtues, demerits, and applications. The review also focuses on the ethical implications and challenges linked to modern neuroscientific technology. There are times when it looks as if ethics discussions are more concerned with the hypothetical than with the factual. We conclude by providing recommendations for potential future studies and development areas, taking into account future advancements in neuroscience innovation for brain enhancement, analyzing historical patterns, considering neuroethics and looking at other related forecasts.
Collapse
Affiliation(s)
- Nitish Singh Jangwan
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| | - Ghulam Md Ashraf
- Pre-Clinical Research Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Medical Laboratory Sciences, Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Veerma Ram
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| | - Vinod Singh
- Prabha Harji Lal College of Pharmacy and Paraclinical Sciences, University of Jammu, Jammu, India
| | - Badrah S. Alghamdi
- Pre-Clinical Research Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
- Department of Physiology, Neuroscience Unit, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Adel Mohammad Abuzenadah
- Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah, Saudi Arabia
- King Fahd Medical Research Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Mamta F. Singh
- Department of Pharmacology, School of Pharmaceutical Sciences and Technology, Sardar Bhagwan Singh University, Balawala, India
| |
Collapse
|
20
|
Cinel C, Fernandez-Vargas J, Tremmel C, Citi L, Poli R. Enhancing performance with multisensory cues in a realistic target discrimination task. PLoS One 2022; 17:e0272320. [PMID: 35930533 PMCID: PMC9355224 DOI: 10.1371/journal.pone.0272320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Accepted: 07/17/2022] [Indexed: 11/19/2022] Open
Abstract
Making decisions is an important aspect of people’s lives. Decisions can be highly critical in nature, with mistakes possibly resulting in extremely adverse consequences. Yet, such decisions have often to be made within a very short period of time and with limited information. This can result in decreased accuracy and efficiency. In this paper, we explore the possibility of increasing speed and accuracy of users engaged in the discrimination of realistic targets presented for a very short time, in the presence of unimodal or bimodal cues. More specifically, we present results from an experiment where users were asked to discriminate between targets rapidly appearing in an indoor environment. Unimodal (auditory) or bimodal (audio-visual) cues could shortly precede the target stimulus, warning the users about its location. Our findings show that, when used to facilitate perceptual decision under time pressure, and in condition of limited information in real-world scenarios, spoken cues can be effective in boosting performance (accuracy, reaction times or both), and even more so when presented in bimodal form. However, we also found that cue timing plays a critical role and, if the cue-stimulus interval is too short, cues may offer no advantage. In a post-hoc analysis of our data, we also show that congruency between the response location and both the target location and the cues, can interfere with the speed and accuracy in the task. These effects should be taken in consideration, particularly when investigating performance in realistic tasks.
Collapse
Affiliation(s)
- Caterina Cinel
- Brain Computer Interface and Neural Engineering Lab, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
- * E-mail:
| | - Jacobo Fernandez-Vargas
- Brain Computer Interface and Neural Engineering Lab, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Christoph Tremmel
- Brain Computer Interface and Neural Engineering Lab, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
- WellthLab, Electronics and Computer Science, University of Southampton, Southampton, United Kingdom
| | - Luca Citi
- Brain Computer Interface and Neural Engineering Lab, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Riccardo Poli
- Brain Computer Interface and Neural Engineering Lab, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| |
Collapse
|
21
|
Tremmel C, Fernandez-Vargas J, Stamos D, Cinel C, Pontil M, Citi L, Poli R. A meta-learning BCI for estimating decision confidence. J Neural Eng 2022; 19. [PMID: 35738232 DOI: 10.1088/1741-2552/ac7ba8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Accepted: 06/23/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE We investigated whether a recently introduced transfer-learning technique based on meta-learning could improve the performance of Brain-Computer Interfaces (BCIs) for decision-confidence prediction with respect to more traditional machine learning methods. APPROACH We adapted the meta-learning by biased regularisation algorithm to the problem of predicting decision confidence from EEG and EOG data on a decision-by-decision basis in a difficult target discrimination task based on video feeds. The method exploits previous participants' data to produce a prediction algorithm that is then quickly tuned to new participants. We compared it with with the traditional single-subject training almost universally adopted in BCIs, a state-of-the-art transfer learning technique called Domain Adversarial Neural Networks (DANN), a transfer-learning adaptation of a zero-training method we used recently for a similar task, and with a simple baseline algorithm. MAIN RESULTS The meta-learning approach was significantly better than other approaches in most conditions, and much better in situations where limited data from a new participant are available for training/tuning. Meta-learning by biased regularisation allowed our BCI to seamlessly integrate information from past participants with data from a specific user to produce high-performance predictors. Its robustness in the presence of small training sets is a real-plus in BCI applications, as new users need to train the BCI for a much shorter period. SIGNIFICANCE Due to the variability and noise of EEG/EOG data, BCIs need to be normally trained with data from a specific participant. This work shows that even better performance can be obtained using our version of meta-learning by biased regularisation.
Collapse
Affiliation(s)
- Christoph Tremmel
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Jacobo Fernandez-Vargas
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Dimitrios Stamos
- Department of Computer Science, University College London, Malet Place, London, London, WC1E 6BT, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Caterina Cinel
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Massimiliano Pontil
- University College London, Malet Place, London, London, WC1E 6BT, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Luca Citi
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Riccardo Poli
- School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| |
Collapse
|
22
|
Wong JK, Deuschl G, Wolke R, Bergman H, Muthuraman M, Groppa S, Sheth SA, Bronte-Stewart HM, Wilkins KB, Petrucci MN, Lambert E, Kehnemouyi Y, Starr PA, Little S, Anso J, Gilron R, Poree L, Kalamangalam GP, Worrell GA, Miller KJ, Schiff ND, Butson CR, Henderson JM, Judy JW, Ramirez-Zamora A, Foote KD, Silburn PA, Li L, Oyama G, Kamo H, Sekimoto S, Hattori N, Giordano JJ, DiEuliis D, Shook JR, Doughtery DD, Widge AS, Mayberg HS, Cha J, Choi K, Heisig S, Obatusin M, Opri E, Kaufman SB, Shirvalkar P, Rozell CJ, Alagapan S, Raike RS, Bokil H, Green D, Okun MS. Proceedings of the Ninth Annual Deep Brain Stimulation Think Tank: Advances in Cutting Edge Technologies, Artificial Intelligence, Neuromodulation, Neuroethics, Pain, Interventional Psychiatry, Epilepsy, and Traumatic Brain Injury. Front Hum Neurosci 2022; 16:813387. [PMID: 35308605 PMCID: PMC8931265 DOI: 10.3389/fnhum.2022.813387] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 01/11/2022] [Indexed: 01/09/2023] Open
Abstract
DBS Think Tank IX was held on August 25-27, 2021 in Orlando FL with US based participants largely in person and overseas participants joining by video conferencing technology. The DBS Think Tank was founded in 2012 and provides an open platform where clinicians, engineers and researchers (from industry and academia) can freely discuss current and emerging deep brain stimulation (DBS) technologies as well as the logistical and ethical issues facing the field. The consensus among the DBS Think Tank IX speakers was that DBS expanded in its scope and has been applied to multiple brain disorders in an effort to modulate neural circuitry. After collectively sharing our experiences, it was estimated that globally more than 230,000 DBS devices have been implanted for neurological and neuropsychiatric disorders. As such, this year's meeting was focused on advances in the following areas: neuromodulation in Europe, Asia and Australia; cutting-edge technologies, neuroethics, interventional psychiatry, adaptive DBS, neuromodulation for pain, network neuromodulation for epilepsy and neuromodulation for traumatic brain injury.
Collapse
Affiliation(s)
- Joshua K. Wong
- Department of Neurology, Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, United States
| | - Günther Deuschl
- Department of Neurology, Christian-Albrechts-University, Kiel, Germany
| | - Robin Wolke
- Department of Neurology, Christian-Albrechts-University, Kiel, Germany
| | - Hagai Bergman
- Department of Medical Neurobiology (Physiology), Institute of Medical Research Israel-Canada, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Muthuraman Muthuraman
- Biomedical Statistics and Multimodal Signal Processing Unit, Section of Movement Disorders and Neurostimulation, Focus Program Translational Neuroscience, Department of Neurology, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany
| | - Sergiu Groppa
- Biomedical Statistics and Multimodal Signal Processing Unit, Section of Movement Disorders and Neurostimulation, Focus Program Translational Neuroscience, Department of Neurology, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany
| | - Sameer A. Sheth
- Department of Neurological Surgery, Baylor College of Medicine, Houston, TX, United States
| | - Helen M. Bronte-Stewart
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
| | - Kevin B. Wilkins
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
| | - Matthew N. Petrucci
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
| | - Emilia Lambert
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
| | - Yasmine Kehnemouyi
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
| | - Philip A. Starr
- Department of Neurological Surgery, Kavli Institute for Fundamental Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Simon Little
- Department of Neurological Surgery, Kavli Institute for Fundamental Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Juan Anso
- Department of Neurological Surgery, Kavli Institute for Fundamental Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Ro’ee Gilron
- Department of Neurological Surgery, Kavli Institute for Fundamental Neuroscience, University of California, San Francisco, San Francisco, CA, United States
| | - Lawrence Poree
- Department of Anesthesia, University of California, San Francisco, San Francisco, CA, United States
| | - Giridhar P. Kalamangalam
- Department of Neurology, Wilder Center for Epilepsy Research, University of Florida, Gainesville, FL, United States
| | | | - Kai J. Miller
- Department of Neurosurgery, Mayo Clinic, Rochester, NY, United States
| | - Nicholas D. Schiff
- Department of Neurology, Weill Cornell Brain and Spine Institute, Weill Cornell Medicine, New York, NY, United States
| | - Christopher R. Butson
- Department of Neurology, Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, United States
| | - Jaimie M. Henderson
- Department of Neurosurgery, Stanford University, Stanford, CA, United States
| | - Jack W. Judy
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, United States
| | - Adolfo Ramirez-Zamora
- Department of Neurology, Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, United States
| | - Kelly D. Foote
- Department of Neurosurgery, Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, United States
| | - Peter A. Silburn
- Queensland Brain Institute, University of Queensland and Saint Andrews War Memorial Hospital, Brisbane, QLD, Australia
| | - Luming Li
- National Engineering Laboratory for Neuromodulation, School of Aerospace Engineering, Tsinghua University, Beijing, China
| | - Genko Oyama
- Department of Neurology, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Hikaru Kamo
- Department of Neurology, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Satoko Sekimoto
- Department of Neurology, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - Nobutaka Hattori
- Department of Neurology, Faculty of Medicine, Juntendo University, Tokyo, Japan
| | - James J. Giordano
- Neuroethics Studies Program, Department of Neurology, Georgetown University Medical Center, Washington, DC, United States
| | - Diane DiEuliis
- US Department of Defense Fort Lesley J. McNair, National Defense University, Washington, DC, United States
| | - John R. Shook
- Department of Philosophy and Science Education, University of Buffalo, Buffalo, NY, United States
| | - Darin D. Doughtery
- Department of Psychiatry, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United States
| | - Alik S. Widge
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, United States
| | - Helen S. Mayberg
- Department of Neurology and Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Jungho Cha
- Department of Neurology and Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Kisueng Choi
- Department of Neurology and Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Stephen Heisig
- Department of Neurology and Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Mosadolu Obatusin
- Department of Neurology and Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Enrico Opri
- Department of Neurology, Emory University, Atlanta, GA, United States
| | - Scott B. Kaufman
- Department of Psychology, Columbia University, New York, NY, United States
| | - Prasad Shirvalkar
- The Human Motor Control and Neuromodulation Laboratory, Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford University, Stanford, CA, United States
- Department of Anesthesiology (Pain Management) and Neurology, University of California, San Francisco, San Francisco, CA, United States
| | - Christopher J. Rozell
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Sankaraleengam Alagapan
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, United States
| | - Robert S. Raike
- Restorative Therapies Group Implantables, Research and Core Technology, Medtronic Inc., Minneapolis, MN, United States
| | - Hemant Bokil
- Boston Scientific Neuromodulation Corporation, Valencia, CA, United States
| | - David Green
- NeuroPace, Inc., Mountain View, CA, United States
| | - Michael S. Okun
- Department of Neurology, Fixel Institute for Neurological Diseases, University of Florida, Gainesville, FL, United States
| |
Collapse
|
23
|
Huggins JE, Krusienski D, Vansteensel MJ, Valeriani D, Thelen A, Stavisky S, Norton JJS, Nijholt A, Müller-Putz G, Kosmyna N, Korczowski L, Kapeller C, Herff C, Halder S, Guger C, Grosse-Wentrup M, Gaunt R, Dusang AN, Clisson P, Chavarriaga R, Anderson CW, Allison BZ, Aksenova T, Aarnoutse E. Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier. BRAIN-COMPUTER INTERFACES 2022; 9:69-101. [PMID: 36908334 PMCID: PMC9997957 DOI: 10.1080/2326263x.2021.2009654] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Accepted: 11/15/2021] [Indexed: 12/11/2022]
Abstract
The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.
Collapse
Affiliation(s)
- Jane E Huggins
- Department of Physical Medicine and Rehabilitation, Department of Biomedical Engineering, Neuroscience Graduate Program, University of Michigan, Ann Arbor, Michigan, United States 325 East Eisenhower, Room 3017; Ann Arbor, Michigan 48108-5744, 734-936-7177
| | - Dean Krusienski
- Department of Biomedical Engineering, Virginia Commonwealth University, Richmond, VA 23219
| | - Mariska J Vansteensel
- UMC Utrecht Brain Center, Dept of Neurosurgery, University Medical Center Utrecht, The Netherlands
| | | | - Antonia Thelen
- eemagine Medical Imaging Solutions GmbH, Berlin, Germany
| | | | - James J S Norton
- National Center for Adaptive Neurotechnologies, US Department of Veterans Affairs, 113 Holland Ave, Albany, NY 12208
| | - Anton Nijholt
- Faculty EEMCS, University of Twente, Enschede, The Netherlands
| | - Gernot Müller-Putz
- Institute of Neural Engineering, GrazBCI Lab, Graz University of Technology, Stremayrgasse 16/4, 8010 Graz, Austria
| | - Nataliya Kosmyna
- Massachusetts Institute of Technology (MIT), Media Lab, E14-548, Cambridge, MA 02139, Unites States
| | | | | | - Christian Herff
- School of Mental Health and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | | | - Christoph Guger
- g.tec medical engineering GmbH/Guger Technologies OG, Austria, Sierningstrasse 14, 4521 Schiedlberg, Austria, +43725122240-0
| | - Moritz Grosse-Wentrup
- Research Group Neuroinformatics, Faculty of Computer Science, Vienna Cognitive Science Hub, Data Science @ Uni Vienna University of Vienna
| | - Robert Gaunt
- Rehab Neural Engineering Labs, Department of Physical Medicine and Rehabilitation, Center for the Neural Basis of Cognition, University of Pittsburgh, Pittsburgh, PA, USA, 3520 5th Ave, Suite 300, Pittsburgh, PA 15213, 412-383-1426
| | - Aliceson Nicole Dusang
- Department of Electrical and Computer Engineering, School of Engineering, Brown University, Carney Institute for Brain Science, Brown University, Providence, RI
- Department of Veterans Affairs Medical Center, Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Providence, RI
- Center for Neurotechnology and Neurorecovery, Neurology, Massachusetts General Hospital, Boston, MA
| | | | - Ricardo Chavarriaga
- IEEE Standards Association Industry Connections group on neurotechnologies for brain-machine interface, Center for Artificial Intelligence, School of Engineering, ZHAW-Zurich University of Applied Sciences, Switzerland, Switzerland
| | - Charles W Anderson
- Department of Computer Science, Molecular, Cellular and Integrative Neurosience Program, Colorado State University, Fort Collins, CO 80523
| | - Brendan Z Allison
- Dept. of Cognitive Science, Mail Code 0515, University of California at San Diego, La Jolla, United States, 619-534-9754
| | - Tetiana Aksenova
- University Grenoble Alpes, CEA, LETI, Clinatec, Grenoble 38000, France
| | - Erik Aarnoutse
- UMC Utrecht Brain Center, Department of Neurology & Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
| |
Collapse
|
24
|
A Collaborative Brain-Computer Interface Framework for Enhancing Group Detection Performance of Dynamic Visual Targets. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4752450. [PMID: 35087580 PMCID: PMC8789438 DOI: 10.1155/2022/4752450] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 12/12/2021] [Accepted: 12/14/2021] [Indexed: 11/25/2022]
Abstract
The superiority of collaborative brain-computer interface (cBCI) in performance enhancement makes it an effective way to break through the performance bottleneck of the BCI-based dynamic visual target detection. However, the existing cBCIs focus on multi-mind information fusion with a static and unidirectional mode, lacking the information interaction and learning guidance among multiple agents. Here, we propose a novel cBCI framework to enhance the group detection performance of dynamic visual targets. Specifically, a mutual learning domain adaptation network (MLDANet) with information interaction, dynamic learning, and individual transferring abilities is developed as the core of the cBCI framework. MLDANet takes P3-sSDA network as individual network unit, introduces mutual learning strategy, and establishes a dynamic interactive learning mechanism between individual networks and collaborative decision-making at the neural decision level. The results indicate that the proposed MLDANet-cBCI framework can achieve the best group detection performance, and the mutual learning strategy can improve the detection ability of individual networks. In MLDANet-cBCI, the F1 scores of collaborative detection and individual network are 0.12 and 0.19 higher than those in the multi-classifier cBCI, respectively, when three minds collaborate. Thus, the proposed framework breaks through the traditional multi-mind collaborative mode and exhibits a superior group detection performance of dynamic visual targets, which is also of great significance for the practical application of multi-mind collaboration.
Collapse
|
25
|
Farkhondeh Tale Navi F, Heysieattalab S, Ramanathan DS, Raoufy MR, Nazari MA. Closed-loop Modulation of the Self-regulating Brain: A Review on Approaches, Emerging Paradigms, and Experimental Designs. Neuroscience 2021; 483:104-126. [PMID: 34902494 DOI: 10.1016/j.neuroscience.2021.12.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2021] [Revised: 11/30/2021] [Accepted: 12/06/2021] [Indexed: 11/27/2022]
Abstract
Closed-loop approaches, setups, and experimental designs have been applied within the field of neuroscience to enhance the understanding of basic neurophysiology principles (closed-loop neuroscience; CLNS) and to develop improved procedures for modulating brain circuits and networks for clinical purposes (closed-loop neuromodulation; CLNM). The contents of this review are thus arranged into the following sections. First, we describe basic research findings that have been made using CLNS. Next, we provide an overview of the application, rationale, and therapeutic aspects of CLNM for clinical purposes. Finally, we summarize methodological concerns and critics in clinical practice of neurofeedback and novel applications of closed-loop perspective and techniques to improve and optimize its experiments. Moreover, we outline the theoretical explanations and experimental ideas to test animal models of neurofeedback and discuss technical issues and challenges associated with implementing closed-loop systems. We hope this review is helpful for both basic neuroscientists and clinical/ translationally-oriented scientists interested in applying closed-loop methods to improve mental health and well-being.
Collapse
Affiliation(s)
- Farhad Farkhondeh Tale Navi
- Department of Cognitive Neuroscience, Faculty of Education and Psychology, University of Tabriz, Tabriz, Iran
| | - Soomaayeh Heysieattalab
- Department of Cognitive Neuroscience, Faculty of Education and Psychology, University of Tabriz, Tabriz, Iran
| | | | - Mohammad Reza Raoufy
- Department of Physiology, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
| | - Mohammad Ali Nazari
- Department of Cognitive Neuroscience, Faculty of Education and Psychology, University of Tabriz, Tabriz, Iran; Department of Neuroscience, Faculty of Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
26
|
Gaudry KS, Ayaz H, Bedows A, Celnik P, Eagleman D, Grover P, Illes J, Rao RPN, Robinson JT, Thyagarajan K. Projections and the Potential Societal Impact of the Future of Neurotechnologies. Front Neurosci 2021; 15:658930. [PMID: 34867139 PMCID: PMC8634831 DOI: 10.3389/fnins.2021.658930] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 10/04/2021] [Indexed: 12/17/2022] Open
Abstract
Traditionally, recording from and stimulating the brain with high spatial and temporal resolution required invasive means. However, recently, the technical capabilities of less invasive and non-invasive neuro-interfacing technology have been dramatically improving, and laboratories and funders aim to further improve these capabilities. These technologies can facilitate functions such as multi-person communication, mood regulation and memory recall. We consider a potential future where the less invasive technology is in high demand. Will this demand match that the current-day demand for a smartphone? Here, we draw upon existing research to project which particular neuroethics issues may arise in this potential future and what preparatory steps may be taken to address these issues.
Collapse
Affiliation(s)
- Kate S. Gaudry
- Kilpatrick Townsend & Stockton LLP, Washington, DC, United States
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
- Department of Psychology, College of Arts and Sciences, Drexel University, Philadelphia, PA, United States
- Drexel Solutions Institute, Drexel University, Philadelphia, PA, United States
- Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States
- Center for Injury Research and Prevention, Children’s Hospital of Philadelphia, Philadelphia, PA, United States
| | | | - Pablo Celnik
- Department of Physical Medicine and Rehabilitation, Johns Hopkins, School of Medicine, Baltimore, MD, United States
| | - David Eagleman
- Department of Psychiatry, Stanford University School of Medicine, Stanford, CA, United States
| | - Pulkit Grover
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, United States
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Judy Illes
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
- Neuroethics Canada, University of British Columbia, Vancouver, BC, Canada
| | - Rajesh P. N. Rao
- Center for Neurotechnology, Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, DC, United States
| | - Jacob T. Robinson
- Department of Bioengineering, Rice University, Houston, TX, United States
- Department of Electrical and Computer Engineering, Rice University, Houston, TX, United States
- Applied Physics Program, Rice University, Houston, TX, United States
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, United States
| | | |
Collapse
|
27
|
Borbón D, Borbón L. A Critical Perspective on NeuroRights: Comments Regarding Ethics and Law. Front Hum Neurosci 2021; 15:703121. [PMID: 34759805 PMCID: PMC8573066 DOI: 10.3389/fnhum.2021.703121] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 09/30/2021] [Indexed: 11/29/2022] Open
Affiliation(s)
- Diego Borbón
- The Latin American Observatory of Human Rights and Enterprises, NeuroRights Research Line, Universidad Externado de Colombia, Bogotá, Colombia
| | - Luisa Borbón
- Faculty of Engineering, University of Los Andes, Bogotá, Colombia
| |
Collapse
|
28
|
Valeriani D, Ayaz H, Kosmyna N, Poli R, Maes P. Editorial: Neurotechnologies for Human Augmentation. Front Neurosci 2021; 15:789868. [PMID: 34858136 PMCID: PMC8631818 DOI: 10.3389/fnins.2021.789868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 10/18/2021] [Indexed: 11/17/2022] Open
Affiliation(s)
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Nataliya Kosmyna
- Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Riccardo Poli
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Pattie Maes
- Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
29
|
Bhattacharyya S, Hayashibe M. An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals. Brain Sci 2021; 11:1393. [PMID: 34827392 PMCID: PMC8615878 DOI: 10.3390/brainsci11111393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 10/15/2021] [Accepted: 10/19/2021] [Indexed: 11/26/2022] Open
Abstract
This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain-computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulation (FES) device and hence are somato-sensory in nature. The BCI system designed for this study activates an electrical stimulator placed on the left hand, right hand, left foot, and right foot of the user. Trials containing erroneous feedback can be detected from the neural signals in form of the error related potential (ErrP). The inclusion of neuro-feedback during the experiments indicated the possibility that ErrP signals can be evoked when the participant perceives an error from the feedback. Hence, to detect such feedback using ErrP, a transferable (offline) decoder based on optimal transport theory is introduced herein. The offline system detects single-trial erroneous trials from the feedback period of an online neuro-feedback BCI system. The results of the FES-based feedback BCI system were compared to a similar visual-based (VIS) feedback system. Using our framework, the error detector systems for both the FES and VIS feedback paradigms achieved an F1-score of 92.66% and 83.10%, respectively, and are significantly superior to a comparative system where an optimal transport was not used. It is expected that this form of transferable and automated error detection system compounded with a motor imagery system will augment the performance of a BCI and provide a better BCI-based neuro-rehabilitation protocol that has an error control mechanism embedded into it.
Collapse
Affiliation(s)
- Saugat Bhattacharyya
- School of Computing, Engineering and Intelligent Systems, Ulster University, Magee Campus, Londonderry BT48 7JL, UK
| | - Mitsuhiro Hayashibe
- Department of Robotics, Tohoku University, Sendai 980-8579, Japan;
- Department of Biomedical Engineering, Tohoku University, Sendai 980-8579, Japan
| |
Collapse
|
30
|
Lehnertz K, Rings T, Bröhl T. Time in Brain: How Biological Rhythms Impact on EEG Signals and on EEG-Derived Brain Networks. FRONTIERS IN NETWORK PHYSIOLOGY 2021; 1:755016. [PMID: 36925573 PMCID: PMC10013076 DOI: 10.3389/fnetp.2021.755016] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Accepted: 09/13/2021] [Indexed: 11/13/2022]
Abstract
Electroencephalography (EEG) is a widely employed tool for exploring brain dynamics and is used extensively in various domains, ranging from clinical diagnosis via neuroscience, cognitive science, cognitive psychology, psychophysiology, neuromarketing, neurolinguistics, and pharmacology to research on brain computer interfaces. EEG is the only technique that enables the continuous recording of brain dynamics over periods of time that range from a few seconds to hours and days and beyond. When taking long-term recordings, various endogenous and exogenous biological rhythms may impinge on characteristics of EEG signals. While the impact of the circadian rhythm and of ultradian rhythms on spectral characteristics of EEG signals has been investigated for more than half a century, only little is known on how biological rhythms influence characteristics of brain dynamics assessed with modern EEG analysis techniques. At the example of multiday, multichannel non-invasive and invasive EEG recordings, we here discuss the impact of biological rhythms on temporal changes of various characteristics of human brain dynamics: higher-order statistical moments and interaction properties of multichannel EEG signals as well as local and global characteristics of EEG-derived evolving functional brain networks. Our findings emphasize the need to take into account the impact of biological rhythms in order to avoid erroneous statements about brain dynamics and about evolving functional brain networks.
Collapse
Affiliation(s)
- Klaus Lehnertz
- Department of Epileptology, University of Bonn Medical Centre, Bonn, Germany
- Helmholtz Institute for Radiation and Nuclear Physics, University of Bonn, Bonn, Germany
- Interdisciplinary Center for Complex Systems, University of Bonn, Bonn, Germany
| | - Thorsten Rings
- Department of Epileptology, University of Bonn Medical Centre, Bonn, Germany
- Helmholtz Institute for Radiation and Nuclear Physics, University of Bonn, Bonn, Germany
| | - Timo Bröhl
- Department of Epileptology, University of Bonn Medical Centre, Bonn, Germany
- Helmholtz Institute for Radiation and Nuclear Physics, University of Bonn, Bonn, Germany
| |
Collapse
|
31
|
Anytime collaborative brain-computer interfaces for enhancing perceptual group decision-making. Sci Rep 2021; 11:17008. [PMID: 34417494 PMCID: PMC8379268 DOI: 10.1038/s41598-021-96434-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Accepted: 07/20/2021] [Indexed: 11/15/2022] Open
Abstract
In this paper we present, and test in two realistic environments, collaborative Brain-Computer Interfaces (cBCIs) that can significantly increase both the speed and the accuracy of perceptual group decision-making. The key distinguishing features of this work are: (1) our cBCIs combine behavioural, physiological and neural data in such a way as to be able to provide a group decision at any time after the quickest team member casts their vote, but the quality of a cBCI-assisted decision improves monotonically the longer the group decision can wait; (2) we apply our cBCIs to two realistic scenarios of military relevance (patrolling a dark corridor and manning an outpost at night where users need to identify any unidentified characters that appear) in which decisions are based on information conveyed through video feeds; and (3) our cBCIs exploit Event-Related Potentials (ERPs) elicited in brain activity by the appearance of potential threats but, uniquely, the appearance time is estimated automatically by the system (rather than being unrealistically provided to it). As a result of these elements, in the two test environments, groups assisted by our cBCIs make both more accurate and faster decisions than when individual decisions are integrated in more traditional manners.
Collapse
|
32
|
Hildt E. Affective Brain-Computer Music Interfaces-Drivers and Implications. Front Hum Neurosci 2021; 15:711407. [PMID: 34267633 PMCID: PMC8275997 DOI: 10.3389/fnhum.2021.711407] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Accepted: 06/02/2021] [Indexed: 11/13/2022] Open
Affiliation(s)
- Elisabeth Hildt
- Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago, IL, United States
| |
Collapse
|
33
|
Gao X, Wang Y, Chen X, Gao S. Interface, interaction, and intelligence in generalized brain-computer interfaces. Trends Cogn Sci 2021; 25:671-684. [PMID: 34116918 DOI: 10.1016/j.tics.2021.04.003] [Citation(s) in RCA: 76] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 03/07/2021] [Accepted: 04/05/2021] [Indexed: 11/16/2022]
Abstract
A brain-computer interface (BCI) establishes a direct communication channel between a brain and an external device. With recent advances in neurotechnology and artificial intelligence (AI), the brain signals in BCI communication have been advanced from sensation and perception to higher-level cognition activities. While the field of BCI has grown rapidly in the past decades, the core technologies and innovative ideas behind seemingly unrelated BCI systems have never been summarized from an evolutionary point of view. Here, we review various BCI paradigms and present an evolutionary model of generalized BCI technology which comprises three stages: interface, interaction, and intelligence (I3). We also highlight challenges, opportunities, and future perspectives in the development of new BCI technology.
Collapse
Affiliation(s)
- Xiaorong Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
| | - Yijun Wang
- Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China
| | - Xiaogang Chen
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences, Tianjin, China
| | - Shangkai Gao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China.
| |
Collapse
|
34
|
Toma FM, Miyakoshi M. Left Frontal EEG Power Responds to Stock Price Changes in a Simulated Asset Bubble Market. Brain Sci 2021; 11:brainsci11060670. [PMID: 34063778 PMCID: PMC8223788 DOI: 10.3390/brainsci11060670] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 05/17/2021] [Accepted: 05/19/2021] [Indexed: 11/16/2022] Open
Abstract
Financial bubbles are a result of aggregate irrational behavior and cannot be explained by standard economic pricing theory. Research in neuroeconomics can improve our understanding of their causes. We conducted an experiment in which 28 healthy subjects traded in a simulated market bubble, while scalp EEG was recorded using a low-cost, BCI-friendly desktop device with 14 electrodes. Independent component (IC) analysis was performed to decompose brain signals and the obtained scalp topography was used to cluster the ICs. We computed single-trial time-frequency power relative to the onset of stock price display and estimated the correlation between EEG power and stock price across trials using a general linear model. We found that delta band (1-4 Hz) EEG power within the left frontal region negatively correlated with the trial-by-trial stock prices including the financial bubble. We interpreted the result as stimulus-preceding negativity (SPN) occurring as a dis-inhibition of the resting state network. We conclude that the combination between the desktop-BCI-friendly EEG, the simulated financial bubble and advanced signal processing and statistical approaches could successfully identify the neural correlate of the financial bubble. We add to the neuroeconomics literature a complementary EEG neurometric as a bubble predictor, which can further be explored in future decision-making experiments.
Collapse
Affiliation(s)
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, 9500 Gilman Drive, La Jolla, CA 92093-0559, USA
- Correspondence:
| |
Collapse
|
35
|
Fernandez-Vargas J, Tremmel C, Valeriani D, Bhattacharyya S, Cinel C, Citi L, Poli R. Subject- and task-independent neural correlates and prediction of decision confidence in perceptual decision making. J Neural Eng 2021; 18. [PMID: 33780913 DOI: 10.1088/1741-2552/abf2e4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 03/29/2021] [Indexed: 11/12/2022]
Abstract
Objective.In many real-world decision tasks, the information available to the decision maker is incomplete. To account for this uncertainty, we associate a degree of confidence to every decision, representing the likelihood of that decision being correct. In this study, we analyse electroencephalography (EEG) data from 68 participants undertaking eight different perceptual decision-making experiments. Our goals are to investigate (1) whether subject- and task-independent neural correlates of decision confidence exist, and (2) to what degree it is possible to build brain computer interfaces that can estimate confidence on a trial-by-trial basis. The experiments cover a wide range of perceptual tasks, which allowed to separate the task-related, decision-making features from the task-independent ones.Approach.Our systems train artificial neural networks to predict the confidence in each decision from EEG data and response times. We compare the decoding performance with three training approaches: (1) single subject, where both training and testing data were acquired from the same person; (2) multi-subject, where all the data pertained to the same task, but the training and testing data came from different users; and (3) multi-task, where the training and testing data came from different tasks and subjects. Finally, we validated our multi-task approach using data from two additional experiments, in which confidence was not reported.Main results.We found significant differences in the EEG data for different confidence levels in both stimulus-locked and response-locked epochs. All our approaches were able to predict the confidence between 15% and 35% better than the corresponding reference baselines.Significance.Our results suggest that confidence in perceptual decision making tasks could be reconstructed from neural signals even when using transfer learning approaches. These confidence estimates are based on the decision-making process rather than just the confidence-reporting process.
Collapse
Affiliation(s)
- Jacobo Fernandez-Vargas
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom
| | - Christoph Tremmel
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom
| | - Davide Valeriani
- Department of Otolaryngology
- Head and Neck Surgery, Massachusetts Eye and Ear, Boston, MA, United States of America.,Department of Otolaryngology
- Head and Neck Surgery, Harvard Medical School, Boston, MA, United States of America
| | - Saugat Bhattacharyya
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom.,School of Computing, Engineering & Intelligent Systems, Ulster University, Londonderry, United Kingdom
| | - Caterina Cinel
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom
| | - Luca Citi
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom
| | - Riccardo Poli
- Brain-Computer Interfaces and Neural Engineering laboratory, School of Computer Science and Electronic Engineering, University of Essex, Essex, United Kingdom
| |
Collapse
|
36
|
MacDuffie KE, Ransom S, Klein E. Neuroethics Inside and Out: A Comparative Survey of Neural Device Industry Representatives and the General Public on Ethical Issues and Principles in Neurotechnology. AJOB Neurosci 2021; 13:44-54. [PMID: 33787456 DOI: 10.1080/21507740.2021.1896596] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Neurotechnologies are rapidly being developed with the aim of alleviating suffering caused by disease and assisting individuals with various disabilities. As the capabilities and applications of neural devices advance, potential ethical challenges related to agency, identity, privacy, equality, normality and justice have been noted. We sought to explore attitudes toward these ethical challenges in two important, but understudied groups of stakeholders-members of the neural device industry and members of the general public. Survey responses from 66 industry professionals and 1088 members of the general public who do not work with neural devices were collected. After controlling for demographic differences between the groups (industry vs. general public; age, gender, racial/ethnic background), we found a large degree of consistency between the groups in their attitudes toward the ethical topic areas and the need for guiding ethical principles, but also some differences related to privacy, consent, and confidence in the neural device industry to incorporate ethical concerns into the design process. These data have implications for industry professionals tasked with designing and disseminating new neural devices, end-users of their products, and stakeholders at each step in between who must navigate the rapidly-growing landscape of advances in neurotechnology.
Collapse
Affiliation(s)
| | | | - Eran Klein
- University of Washington.,Oregon Health & Science University
| |
Collapse
|
37
|
De Sousa C, Gaillard C, Di Bello F, Ben Hadj Hassen S, Ben Hamed S. Behavioral validation of novel high resolution attention decoding method from multi-units & local field potentials. Neuroimage 2021; 231:117853. [PMID: 33582274 DOI: 10.1016/j.neuroimage.2021.117853] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 02/03/2021] [Accepted: 02/04/2021] [Indexed: 11/28/2022] Open
Abstract
The ability to access brain information in real-time is crucial both for a better understanding of cognitive functions and for the development of therapeutic applications based on brain-machine interfaces. Great success has been achieved in the field of neural motor prosthesis. Progress is still needed in the real-time decoding of higher-order cognitive processes such as covert attention. Recently, we showed that we can track the location of the attentional spotlight using classification methods applied to prefrontal multi-unit activity (MUA) in the non-human primates. Importantly, we demonstrated that the decoded (x,y) attentional spotlight parametrically correlates with the behavior of the monkeys thus validating our decoding of attention. We also demonstrate that this spotlight is extremely dynamic. Here, in order to get closer to non-invasive decoding applications, we extend our previous work to local field potential signals (LFP). Specifically, we achieve, for the first time, high decoding accuracy of the (x,y) location of the attentional spotlight from prefrontal LFP signals, to a degree comparable to that achieved from MUA signals, and we show that this LFP content is predictive of behavior. This LFP attention-related information is maximal in the gamma band (30-250 Hz), peaking between 60 to 120 Hz. In addition, we introduce a novel two-step decoding procedure based on the labelling of maximally attention-informative trials during the decoding procedure. This procedure strongly improves the correlation between our real-time MUA and LFP based decoding and behavioral performance, thus further refining the functional relevance of this real-time decoding of the (x,y) locus of attention. This improvement is more marked for LFP signals than for MUA signals. Overall, this study demonstrates that the attentional spotlight can be accessed from LFP frequency content, in real-time, and can be used to drive high-information content cognitive brain-machine interfaces for the development of new therapeutic strategies.
Collapse
Affiliation(s)
- Carine De Sousa
- Institut des Sciences Cognitives Marc Jeannerod, CNRS UMR 5229, Université Claude Bernard Lyon I, 67 Boulevard Pinel, 69675 Bron Cedex, France.
| | - C Gaillard
- Institut des Sciences Cognitives Marc Jeannerod, CNRS UMR 5229, Université Claude Bernard Lyon I, 67 Boulevard Pinel, 69675 Bron Cedex, France
| | - F Di Bello
- Institut des Sciences Cognitives Marc Jeannerod, CNRS UMR 5229, Université Claude Bernard Lyon I, 67 Boulevard Pinel, 69675 Bron Cedex, France
| | - S Ben Hadj Hassen
- Institut des Sciences Cognitives Marc Jeannerod, CNRS UMR 5229, Université Claude Bernard Lyon I, 67 Boulevard Pinel, 69675 Bron Cedex, France
| | - S Ben Hamed
- Institut des Sciences Cognitives Marc Jeannerod, CNRS UMR 5229, Université Claude Bernard Lyon I, 67 Boulevard Pinel, 69675 Bron Cedex, France.
| |
Collapse
|
38
|
Ovchinnikova AO, Vasilyev AN, Zubarev IP, Kozyrskiy BL, Shishkin SL. MEG-Based Detection of Voluntary Eye Fixations Used to Control a Computer. Front Neurosci 2021; 15:619591. [PMID: 33613182 PMCID: PMC7892913 DOI: 10.3389/fnins.2021.619591] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Accepted: 01/07/2021] [Indexed: 11/13/2022] Open
Abstract
Gaze-based input is an efficient way of hand-free human-computer interaction. However, it suffers from the inability of gaze-based interfaces to discriminate voluntary and spontaneous gaze behaviors, which are overtly similar. Here, we demonstrate that voluntary eye fixations can be discriminated from spontaneous ones using short segments of magnetoencephalography (MEG) data measured immediately after the fixation onset. Recently proposed convolutional neural networks (CNNs), linear finite impulse response filters CNN (LF-CNN) and vector autoregressive CNN (VAR-CNN), were applied for binary classification of the MEG signals related to spontaneous and voluntary eye fixations collected in healthy participants (n = 25) who performed a game-like task by fixating on targets voluntarily for 500 ms or longer. Voluntary fixations were identified as those followed by a fixation in a special confirmatory area. Spontaneous vs. voluntary fixation-related single-trial 700 ms MEG segments were non-randomly classified in the majority of participants, with the group average cross-validated ROC AUC of 0.66 ± 0.07 for LF-CNN and 0.67 ± 0.07 for VAR-CNN (M ± SD). When the time interval, from which the MEG data were taken, was extended beyond the onset of the visual feedback, the group average classification performance increased up to 0.91. Analysis of spatial patterns contributing to classification did not reveal signs of significant eye movement impact on the classification results. We conclude that the classification of MEG signals has a certain potential to support gaze-based interfaces by avoiding false responses to spontaneous eye fixations on a single-trial basis. Current results for intention detection prior to gaze-based interface's feedback, however, are not sufficient for online single-trial eye fixation classification using MEG data alone, and further work is needed to find out if it could be used in practical applications.
Collapse
Affiliation(s)
- Anastasia O. Ovchinnikova
- MEG Center, Moscow State University of Psychology and Education, Moscow, Russia
- Laboratory for Neurocognitive Technologies, NRC Kurchatov Institute, Moscow, Russia
- Department of Physics of Extreme States of Matter, National Research Nuclear University MEPhI, Moscow, Russia
| | - Anatoly N. Vasilyev
- MEG Center, Moscow State University of Psychology and Education, Moscow, Russia
- Laboratory for Neurophysiology and Neuro-Computer Interfaces, M. V. Lomonosov Moscow State University, Moscow, Russia
| | - Ivan P. Zubarev
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Bogdan L. Kozyrskiy
- Laboratory for Neurocognitive Technologies, NRC Kurchatov Institute, Moscow, Russia
- Department of Data Science, EURECOM, Biot, France
| | - Sergei L. Shishkin
- MEG Center, Moscow State University of Psychology and Education, Moscow, Russia
- Laboratory for Neurocognitive Technologies, NRC Kurchatov Institute, Moscow, Russia
| |
Collapse
|
39
|
Lajoie K, Marigold DS, Valdés BA, Menon C. The potential of noisy galvanic vestibular stimulation for optimizing and assisting human performance. Neuropsychologia 2021; 152:107751. [PMID: 33434573 DOI: 10.1016/j.neuropsychologia.2021.107751] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 01/07/2021] [Accepted: 01/08/2021] [Indexed: 12/17/2022]
Abstract
Noisy galvanic vestibular stimulation (nGVS) is an emerging non-invasive brain stimulation technique. It involves applying alternating currents of different frequencies and amplitudes presented in a random, or noisy, manner through electrodes on the mastoid bones behind the ears. Because it directly activates vestibular hair cells and afferents and has an indirect effect on a variety of brain regions, it has the potential to impact many different functions. The objective of this review is twofold: (1) to review how nGVS affects motor, sensory, and cognitive performance in healthy adults; and (2) to discuss potential clinical applications of nGVS. First, we introduce the technique. We then describe the regions receiving and processing vestibular information. Next, we discuss the effects of nGVS on motor, sensory, and cognitive function in healthy adults. Subsequently, we outline its potential clinical applications. Finally, we highlight other electrical stimulation technologies and discuss why nGVS offers an alternative or complementary approach. Overall, nGVS appears promising for optimizing human performance and as an assistive technology, though further research is required.
Collapse
Affiliation(s)
- Kim Lajoie
- Menrva Research Group, Schools of Mechatronic Systems Engineering and Engineering Science, Simon Fraser University, Metro Vancouver, BC, Canada
| | - Daniel S Marigold
- Sensorimotor Neuroscience Lab, Department of Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada.
| | - Bulmaro A Valdés
- Menrva Research Group, Schools of Mechatronic Systems Engineering and Engineering Science, Simon Fraser University, Metro Vancouver, BC, Canada
| | - Carlo Menon
- Menrva Research Group, Schools of Mechatronic Systems Engineering and Engineering Science, Simon Fraser University, Metro Vancouver, BC, Canada.
| |
Collapse
|
40
|
Easttom C, Bianchi L, Valeriani D, Nam CS, Hossaini A, Zapala D, Roman-Gonzalez A, Singh AK, Antonietti A, Sahonero-Alvarez G, Balachandran P. A Functional Model for Unifying Brain Computer Interface Terminology. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2021; 2:91-96. [PMID: 35402984 PMCID: PMC8901026 DOI: 10.1109/ojemb.2021.3057471] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 02/01/2021] [Accepted: 02/02/2021] [Indexed: 11/30/2022] Open
Abstract
Brain Computer Interface (BCI) technology is a critical area both for researchers and clinical practitioners. The IEEE P2731 working group is developing a comprehensive BCI lexicography and a functional model of BCI. The glossary and the functional model are inextricably intertwined. The functional model guides the development of the glossary. Terminology is developed from the basis of a BCI functional model. This paper provides the current status of the P2731 working group's progress towards developing a BCI terminology standard and functional model for the IEEE.
Collapse
Affiliation(s)
| | | | | | - Chang S Nam
- North Carolina State University Raleigh NC 27695 USA
| | | | - Dariusz Zapala
- John Paul II Catholic University of Lublin Lublin 20-950 Poland
| | | | - Avinash K Singh
- Australian Artificial Intelligence InstituteUniversity of Technology Sydney NSW 2007 Australia
| | | | | | - Pradeep Balachandran
- Georgetown University Washington DC 20057 USA
- Tor Vergata University Rome 00133 Italy
- Harvard University Boston MA 02114 USA
- North Carolina State University Raleigh NC 27695 USA
- King's College London London N6 6HD U.K
- John Paul II Catholic University of Lublin Lublin 20-950 Poland
- Universidad Nacional Tecnologica de Lima Sur 15834 Villa el Salvador Peru
- Australian Artificial Intelligence InstituteUniversity of Technology Sydney NSW 2007 Australia
- Politecnico di Milano 20133 Milan Italy
- Universidad Católica Boliviana San Pablo 4805 La Paz Bolivia
| |
Collapse
|
41
|
O'Brien JT, Nelson C. Assessing the Risks Posed by the Convergence of Artificial Intelligence and Biotechnology. Health Secur 2020; 18:219-227. [PMID: 32559154 PMCID: PMC7310294 DOI: 10.1089/hs.2019.0122] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 03/04/2020] [Accepted: 04/29/2020] [Indexed: 12/22/2022] Open
Abstract
Rapid developments are currently taking place in the fields of artificial intelligence (AI) and biotechnology, and applications arising from the convergence of these 2 fields are likely to offer immense opportunities that could greatly benefit human health and biosecurity. The combination of AI and biotechnology could potentially lead to breakthroughs in precision medicine, improved biosurveillance, and discovery of novel medical countermeasures as well as facilitate a more effective public health emergency response. However, as is the case with many preceding transformative technologies, new opportunities often present new risks in parallel. Understanding the current and emerging risks at the intersection of AI and biotechnology is crucial for health security specialists and unlikely to be achieved by examining either field in isolation. Uncertainties multiply as technologies merge, showcasing the need to identify robust assessment frameworks that could adequately analyze the risk landscape emerging at the convergence of these 2 domains.This paper explores the criteria needed to assess risks associated with Artificial intelligence and biotechnology and evaluates 3 previously published risk assessment frameworks. After highlighting their strengths and limitations and applying to relevant Artificial intelligence and biotechnology examples, the authors suggest a hybrid framework with recommendations for future approaches to risk assessment for convergent technologies.
Collapse
Affiliation(s)
- John T. O'Brien
- John T. O'Brien, MS, is a Research Associate, Bipartisan Commission on Biodefense, Washington, DC
| | - Cassidy Nelson
- Cassidy Nelson, MBBS, MPH, is a Research Scholar, Future of Humanity Institute, University of Oxford, Oxford, UK
| |
Collapse
|
42
|
Abstract
As systems grow more automatized, the human operator is all too often overlooked. Although human-robot interaction (HRI) can be quite demanding in terms of cognitive resources, the mental states (MS) of the operators are not yet taken into account by existing systems. As humans are no providential agents, this lack can lead to hazardous situations. The growing number of neurophysiology and machine learning tools now allows for efficient operators’ MS monitoring. Sending feedback on MS in a closed-loop solution is therefore at hand. Involving a consistent automated planning technique to handle such a process could be a significant asset. This perspective article was meant to provide the reader with a synthesis of the significant literature with a view to implementing systems that adapt to the operator’s MS to improve human-robot operations’ safety and performance. First of all, the need for this approach is detailed regarding remote operation, an example of HRI. Then, several MS identified as crucial for this type of HRI are defined, along with relevant electrophysiological markers. A focus is made on prime degraded MS linked to time-on-task and task demands, as well as collateral MS linked to system outputs (i.e., feedback and alarms). Lastly, the principle of symbiotic HRI is detailed and one solution is proposed to include the operator state vector into the system using a mixed-initiative decisional framework to drive such an interaction.
Collapse
|
43
|
Dehais F, Karwowski W, Ayaz H. Brain at Work and in Everyday Life as the Next Frontier: Grand Field Challenges for Neuroergonomics. FRONTIERS IN NEUROERGONOMICS 2020; 1:583733. [PMID: 38234310 PMCID: PMC10790928 DOI: 10.3389/fnrgo.2020.583733] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Accepted: 08/28/2020] [Indexed: 01/19/2024]
Affiliation(s)
- Frederic Dehais
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Waldemar Karwowski
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL, United States
| | - Hasan Ayaz
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
- Drexel Solutions Institute, Drexel University, Philadelphia, PA, United States
- Department of Psychology, College of Arts and Sciences, Drexel University, Philadelphia, PA, United States
- Department of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States
- Center for Injury Research and Prevention, Children's Hospital of Philadelphia, Philadelphia, PA, United States
| |
Collapse
|
44
|
Alimardani M, Hiraki K. Passive Brain-Computer Interfaces for Enhanced Human-Robot Interaction. Front Robot AI 2020; 7:125. [PMID: 33501291 PMCID: PMC7805996 DOI: 10.3389/frobt.2020.00125] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Accepted: 08/05/2020] [Indexed: 11/13/2022] Open
Abstract
Brain-computer interfaces (BCIs) have long been seen as control interfaces that translate changes in brain activity, produced either by means of a volitional modulation or in response to an external stimulation. However, recent trends in the BCI and neurofeedback research highlight passive monitoring of a user's brain activity in order to estimate cognitive load, attention level, perceived errors and emotions. Extraction of such higher order information from brain signals is seen as a gateway for facilitation of interaction between humans and intelligent systems. Particularly in the field of robotics, passive BCIs provide a promising channel for prediction of user's cognitive and affective state for development of a user-adaptive interaction. In this paper, we first illustrate the state of the art in passive BCI technology and then provide examples of BCI employment in human-robot interaction (HRI). We finally discuss the prospects and challenges in integration of passive BCIs in socially demanding HRI settings. This work intends to inform HRI community of the opportunities offered by passive BCI systems for enhancement of human-robot interaction while recognizing potential pitfalls.
Collapse
Affiliation(s)
- Maryam Alimardani
- Department of Cognitive Science and Artificial Intelligence, School of Humanities and Digital Sciences, Tilburg University, Tilburg, Netherlands
| | - Kazuo Hiraki
- Department of General Systems Studies, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
45
|
Iqbal MU, Srinivasan B, Srinivasan R. Dynamic assessment of control room operator's cognitive workload using Electroencephalography (EEG). Comput Chem Eng 2020. [DOI: 10.1016/j.compchemeng.2020.106726] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
46
|
Klaproth OW, Vernaleken C, Krol LR, Halbruegge M, Zander TO, Russwinkel N. Tracing Pilots' Situation Assessment by Neuroadaptive Cognitive Modeling. Front Neurosci 2020; 14:795. [PMID: 32848566 PMCID: PMC7431601 DOI: 10.3389/fnins.2020.00795] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Accepted: 07/07/2020] [Indexed: 01/08/2023] Open
Abstract
This study presents the integration of a passive brain-computer interface (pBCI) and cognitive modeling as a method to trace pilots' perception and processing of auditory alerts and messages during operations. Missing alerts on the flight deck can result in out-of-the-loop problems that can lead to accidents. By tracing pilots' perception and responses to alerts, cognitive assistance can be provided based on individual needs to ensure they maintain adequate situation awareness. Data from 24 participating aircrew in a simulated flight study that included multiple alerts and air traffic control messages in single pilot setup are presented. A classifier was trained to identify pilots' neurophysiological reactions to alerts and messages from participants' electroencephalogram (EEG). A neuroadaptive ACT-R model using EEG data was compared to a conventional normative model regarding accuracy in representing individual pilots. Results show that passive BCI can distinguish between alerts that are processed by the pilot as task-relevant or irrelevant in the cockpit based on the recorded EEG. The neuroadaptive model's integration of this data resulted in significantly higher performance of 87% overall accuracy in representing individual pilots' responses to alerts and messages compared to 72% accuracy of a normative model that did not consider EEG data. We conclude that neuroadaptive technology allows for implicit measurement and tracing of pilots' perception and processing of alerts on the flight deck. Careful handling of uncertainties inherent to passive BCI and cognitive modeling shows how the representation of pilot cognitive states can be improved iteratively for providing assistance.
Collapse
Affiliation(s)
- Oliver W Klaproth
- Airbus Central R&T, Hamburg, Germany.,Chair of Cognitive Modelling in Dynamic Systems, Department of Psychology and Ergonomics, Technische Universität Berlin, Berlin, Germany
| | | | | | - Marc Halbruegge
- Chair of Cognitive Modelling in Dynamic Systems, Department of Psychology and Ergonomics, Technische Universität Berlin, Berlin, Germany
| | - Thorsten O Zander
- Zander Laboratories B.V., Amsterdam, Netherlands.,Chair of Neuroadaptive Human-Computer Interaction, Brandenburg University of Technology, Cottbus-Senftenberg, Germany
| | - Nele Russwinkel
- Chair of Cognitive Modelling in Dynamic Systems, Department of Psychology and Ergonomics, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
47
|
Eberwine J, Kahn J. The BRAIN Initiative and Neuroethics: Enabling and Enhancing Neuroscience Advances for Society. AJOB Neurosci 2020; 11:135-139. [DOI: 10.1080/21507740.2020.1778121] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023]
|
48
|
Griskova-Bulanova I, Sveistyte K, Bjekic J. Neuromodulation of Gamma-Range Auditory Steady-State Responses: A Scoping Review of Brain Stimulation Studies. Front Syst Neurosci 2020; 14:41. [PMID: 32714158 PMCID: PMC7344212 DOI: 10.3389/fnsys.2020.00041] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Accepted: 06/02/2020] [Indexed: 11/29/2022] Open
Abstract
Neural oscillations represent a fundamental mechanism that enables coordinated action during normal brain functioning. Auditory steady-state responses (ASSRs) are used to test the ability to generate gamma-range activity. Different non-invasive brain stimulation (NIBS) techniques have the potential to modulate neural activation patterns that are aberrant in a variety of neuropsychiatric disorders. Here, we summarize the current state of knowledge on how different methods of NIBS (transcranial altering current stimulation—tACS, transcranial direct current stimulation—tDCS, transcranial random noise stimulation—tRNS, paired associative stimulation—PAS, repetitive transcranial magnetic stimulation—rTMS) affect the gamma-range ASSRs in both healthy and clinical populations. We show that the current research has been far from systematic and methodologically heterogeneous. Nevertheless, some brain stimulation techniques, especially tACS and rTMS show strong potential for further exploration. We outline the main findings and provide directions for further research into neuromodulation of ASSRs as a promising biomarker of different psychopathological conditions such as schizophrenia, bipolar disorder, attention deficit hyperactivity disorder (ADHD), autism.
Collapse
Affiliation(s)
| | - Kristina Sveistyte
- School of Life Sciences, University of Nottingham, Nottingham, United Kingdom
| | - Jovana Bjekic
- Human Neuroscience Group, Institute for Medical Research, University of Belgrade, Belgrade, Serbia
| |
Collapse
|
49
|
Dehais F, Lafont A, Roy R, Fairclough S. A Neuroergonomics Approach to Mental Workload, Engagement and Human Performance. Front Neurosci 2020; 14:268. [PMID: 32317914 PMCID: PMC7154497 DOI: 10.3389/fnins.2020.00268] [Citation(s) in RCA: 65] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Accepted: 03/10/2020] [Indexed: 12/26/2022] Open
Abstract
The assessment and prediction of cognitive performance is a key issue for any discipline concerned with human operators in the context of safety-critical behavior. Most of the research has focused on the measurement of mental workload but this construct remains difficult to operationalize despite decades of research on the topic. Recent advances in Neuroergonomics have expanded our understanding of neurocognitive processes across different operational domains. We provide a framework to disentangle those neural mechanisms that underpin the relationship between task demand, arousal, mental workload and human performance. This approach advocates targeting those specific mental states that precede a reduction of performance efficacy. A number of undesirable neurocognitive states (mind wandering, effort withdrawal, perseveration, inattentional phenomena) are identified and mapped within a two-dimensional conceptual space encompassing task engagement and arousal. We argue that monitoring the prefrontal cortex and its deactivation can index a generic shift from a nominal operational state to an impaired one where performance is likely to degrade. Neurophysiological, physiological and behavioral markers that specifically account for these states are identified. We then propose a typology of neuroadaptive countermeasures to mitigate these undesirable mental states.
Collapse
Affiliation(s)
- Frédéric Dehais
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
- School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, United States
| | - Alex Lafont
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Raphaëlle Roy
- ISAE-SUPAERO, Université de Toulouse, Toulouse, France
| | - Stephen Fairclough
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| |
Collapse
|
50
|
Bacomics: a comprehensive cross area originating in the studies of various brain-apparatus conversations. Cogn Neurodyn 2020; 14:425-442. [PMID: 32655708 DOI: 10.1007/s11571-020-09577-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 02/17/2020] [Accepted: 03/05/2020] [Indexed: 12/20/2022] Open
Abstract
The brain is the most important organ of the human body, and the conversations between the brain and an apparatus can not only reveal a normally functioning or a dysfunctional brain but also can modulate the brain. Here, the apparatus may be a nonbiological instrument, such as a computer, and the consequent brain-computer interface is now a very popular research area with various applications. The apparatus may also be a biological organ or system, such as the gut and muscle, and their efficient conversations with the brain are vital for a healthy life. Are there any common bases that bind these different scenarios? Here, we propose a new comprehensive cross area: Bacomics, which comes from brain-apparatus conversations (BAC) + omics. We take Bacomics to cover at least three situations: (1) The brain is normal, but the conversation channel is disabled, as in amyotrophic lateral sclerosis. The task is to reconstruct or open up new channels to reactivate the brain function. (2) The brain is in disorder, such as in Parkinson's disease, and the work is to utilize existing or open up new channels to intervene, repair and modulate the brain by medications or stimulation. (3) Both the brain and channels are in order, and the goal is to enhance coordinated development between the brain and apparatus. In this paper, we elaborate the connotation of BAC into three aspects according to the information flow: the issue of output to the outside (BAC-1), the issue of input to the brain (BAC-2) and the issue of unity of brain and apparatus (BAC-3). More importantly, there are no less than five principles that may be taken as the cornerstones of Bacomics, such as feedforward and feedback control, brain plasticity, harmony, the unity of opposites and systems principles. Clearly, Bacomics integrates these seemingly disparate domains, but more importantly, opens a much wider door for the research and development of the brain, and the principles further provide the general framework in which to realize or optimize these various conversations.
Collapse
|