1
|
Qi Y, Chen J, Wang Y. Neuromorphic computing facilitates deep brain-machine fusion for high-performance neuroprosthesis. Front Neurosci 2023; 17:1153985. [PMID: 37250394 PMCID: PMC10213428 DOI: 10.3389/fnins.2023.1153985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 04/10/2023] [Indexed: 05/31/2023] Open
Abstract
Brain-machine interfaces (BMI) have developed rapidly in recent years, but still face critical issues such as accuracy and stability. Ideally, a BMI system would be an implantable neuroprosthesis that would be tightly connected and integrated into the brain. However, the heterogeneity of brains and machines hinders deep fusion between the two. Neuromorphic computing models, which mimic the structure and mechanism of biological nervous systems, present a promising approach to developing high-performance neuroprosthesis. The biologically plausible property of neuromorphic models enables homogeneous information representation and computation in the form of discrete spikes between the brain and the machine, promoting deep brain-machine fusion and bringing new breakthroughs for high-performance and long-term usable BMI systems. Furthermore, neuromorphic models can be computed at ultra-low energy costs and thus are suitable for brain-implantable neuroprosthesis devices. The intersection of neuromorphic computing and BMI has great potential to lead the development of reliable, low-power implantable BMI devices and advance the development and application of BMI.
Collapse
Affiliation(s)
- Yu Qi
- Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, Zhejiang University School of Medicine, Hangzhou, China
| | - Jiajun Chen
- Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, MOE Frontier Science Center for Brain Science and Brain-Machine Integration, Zhejiang University School of Medicine, Hangzhou, China
| | - Yueming Wang
- Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou, China
| |
Collapse
|
2
|
Qin C, Wang Y, Hu J, Wang T, Liu D, Dong J, Lu Y. Artificial Olfactory Biohybrid System: An Evolving Sense of Smell. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2204726. [PMID: 36529960 PMCID: PMC9929144 DOI: 10.1002/advs.202204726] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 11/29/2022] [Indexed: 06/17/2023]
Abstract
The olfactory system can detect and recognize tens of thousands of volatile organic compounds (VOCs) at low concentrations in complex environments. Bioelectronic nose (B-EN), which mimics olfactory systems, is becoming an emerging sensing technology for identifying VOCs with sensitivity and specificity. B-ENs integrate electronic sensors with bioreceptors and pattern recognition technologies to enable medical diagnosis, public security, environmental monitoring, and food safety. However, there is currently no commercially available B-EN on the market. Apart from the high selectivity and sensitivity necessary for volatile organic compound analysis, commercial B-ENs must overcome issues impacting sensor operation and other problems associated with odor localization. The emergence of nanotechnology has provided a novel research concept for addressing these problems. In this work, the structure and operational mechanisms of biomimetic olfactory systems are discussed, with an emphasis on the development and immobilization of materials. Various biosensor applications and current developments are reviewed. Challenges and opportunities for fulfilling the potential of artificial olfactory biohybrid systems in fundamental and practical research are investigated in greater depth.
Collapse
Affiliation(s)
- Chuanting Qin
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
- Tianjin Industrial Microbiology Key LaboratoryCollege of BiotechnologyTianjin University of Science and TechnologyTianjin300457China
| | - Yi Wang
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
- Tianjin Industrial Microbiology Key LaboratoryCollege of BiotechnologyTianjin University of Science and TechnologyTianjin300457China
| | - Jiawang Hu
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
| | - Ting Wang
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
| | - Dong Liu
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
| | - Jian Dong
- Tianjin Industrial Microbiology Key LaboratoryCollege of BiotechnologyTianjin University of Science and TechnologyTianjin300457China
| | - Yuan Lu
- Key Laboratory of Industrial BiocatalysisMinistry of EducationDepartment of Chemical EngineeringTsinghua UniversityBeijing100084China
| |
Collapse
|
3
|
Ma S, Pei J, Zhang W, Wang G, Feng D, Yu F, Song C, Qu H, Ma C, Lu M, Liu F, Zhou W, Wu Y, Lin Y, Li H, Wang T, Song J, Liu X, Li G, Zhao R, Shi L. Neuromorphic computing chip with spatiotemporal elasticity for multi-intelligent-tasking robots. Sci Robot 2022; 7:eabk2948. [PMID: 35704609 DOI: 10.1126/scirobotics.abk2948] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
Recent advances in artificial intelligence have enhanced the abilities of mobile robots in dealing with complex and dynamic scenarios. However, to enable computationally intensive algorithms to be executed locally in multitask robots with low latency and high efficiency, innovations in computing hardware are required. Here, we report TianjicX, a neuromorphic computing hardware that can support true concurrent execution of multiple cross-computing-paradigm neural network (NN) models with various coordination manners for robotics. With spatiotemporal elasticity, TianjicX can support adaptive allocation of computing resources and scheduling of execution time for each task. Key to this approach is a high-level model, "Rivulet," which bridges the gap between robotic-level requirements and hardware implementations. It abstracts the execution of NN tasks through distribution of static data and streaming of dynamic data to form the basic activity context, adopts time and space slices to achieve elastic resource allocation for each activity, and performs configurable hybrid synchronous-asynchronous grouping. Thereby, Rivulet is capable of supporting independent and interactive execution. Building on Rivulet with hardware design for realizing spatiotemporal elasticity, a 28-nanometer TianjicX neuromorphic chip with event-driven, high parallelism, low latency, and low power was developed. Using a single TianjicX chip and a specially developed compiler stack, we built a multi-intelligent-tasking mobile robot, Tianjicat, to perform a cat-and-mouse game. Multiple tasks, including sound recognition and tracking, object recognition, obstacle avoidance, and decision-making, can be concurrently executed. Compared with NVIDIA Jetson TX2, latency is substantially reduced by 79.09 times, and dynamic power is reduced by 50.66%.
Collapse
Affiliation(s)
- Songchen Ma
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Jing Pei
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Weihao Zhang
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Guanrui Wang
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China.,Lynxi Technologies Co. Ltd, Beijing, China
| | - Dahu Feng
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Fangwen Yu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Chenhang Song
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Huanyu Qu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Cheng Ma
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Mingsheng Lu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Faqiang Liu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Wenhao Zhou
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Yujie Wu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Yihan Lin
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Hongyi Li
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Taoyi Wang
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Jiuru Song
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Xue Liu
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Guoqi Li
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Rong Zhao
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Luping Shi
- Center for Brain-Inspired Computing Research (CBICR), Beijing Innovation Center for Future Chip, Optical Memory National Engineering Research Center, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| |
Collapse
|