1
|
Liu W, Du Z, Duan Z, Li L, Shen G. Neuroprosthetic contact lens enabled sensorimotor system for point-of-care monitoring and feedback of intraocular pressure. Nat Commun 2024; 15:5635. [PMID: 38965218 PMCID: PMC11224243 DOI: 10.1038/s41467-024-49907-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Accepted: 06/24/2024] [Indexed: 07/06/2024] Open
Abstract
The wearable contact lens that continuously monitors intraocular pressure (IOP) facilitates prompt and early-state medical treatments of oculopathies such as glaucoma, postoperative myopia, etc. However, either taking drugs for pre-treatment or delaying the treatment process in the absence of a neural feedback component cannot realize accurate diagnosis or effective treatment. Herein, a neuroprosthetic contact lens enabled sensorimotor system is reported, which consists of a smart contact lens with Ti3C2Tx Wheatstone bridge structured IOP strain sensor, a Ti3C2Tx temperature sensor and an IOP point-of-care monitoring/display system. The point-of-care IOP monitoring and warning can be realized due to the high sensitivity of 12.52 mV mmHg-1 of the neuroprosthetic contact lens. In vivo experiments on rabbit eyes demonstrate the excellent wearability and biocompatibility of the neuroprosthetic contact lens. Further experiments on a living rate in vitro successfully mimic the biological sensorimotor loop. The leg twitching (larger or smaller angles) of the living rat was demonstrated under the command of motor cortex controlled by somatosensory cortex when the IOP is away from the normal range (higher or lower).
Collapse
Affiliation(s)
- Weijia Liu
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, 100081, Beijing, China
| | - Zhijian Du
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, 100081, Beijing, China
| | - Zhongyi Duan
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, 100081, Beijing, China
| | - La Li
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, 100081, Beijing, China.
| | - Guozhen Shen
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, 100081, Beijing, China.
| |
Collapse
|
2
|
Kim C, Roe DG, Lim DU, Choi YY, Kang MS, Kim DH, Cho JH. Toward human-like adaptability in robotics through a retention-engineered synaptic control system. SCIENCE ADVANCES 2024; 10:eadn6217. [PMID: 38924417 PMCID: PMC11204284 DOI: 10.1126/sciadv.adn6217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 05/21/2024] [Indexed: 06/28/2024]
Abstract
Although advanced robots can adeptly mimic human movement and aesthetics, they are still unable to adapt or evolve in response to external experiences. To address this limitation, we propose an innovative approach that uses parallel-processable retention-engineered synaptic devices in the control system. This approach aims to simulate a human-like learning system without necessitating complex computational systems. The retention properties of the synaptic devices were modulated by adjusting the amount of Ag/AgCl ink sprayed. This changed the voltage drop across the interface between the gate electrode and the electrolyte. Furthermore, the unrestricted movement of ions in the electrolyte enhanced the signal multiplexing capability of the ion gel, enabling device-level parallel processing. By integrating the unique characteristics of the synaptic devices with actuators, we successfully emulated a human-like workout process that includes feedback between acute and chronic responses. The proposed control system offers an innovative approach to reducing system complexity and achieving a human-like learning system in the field of biomimicry.
Collapse
Affiliation(s)
- Chan Kim
- Department of Chemical and Biomolecular Engineering, Yonsei University, Seoul 03722, Republic of Korea
| | - Dong Gue Roe
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Republic of Korea
| | - Dong Un Lim
- Hydrogen Energy Research Center, Korea Research Institute of Chemical Technology (KRICT), Daejeon 305-600 Republic of Korea
| | - Yoon Young Choi
- Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Moon Sung Kang
- Department of Chemical and Biomolecular Engineering, Institute of Emergent Materials, Sogang University, Seoul 04107, Republic of Korea
| | - Dong-Hwan Kim
- School of Chemical Engineering, Biomedical Institute for Convergence at SKKU (BICS), Sungkyunkwan University (SKKU), Suwon 16419, Republic of Korea
| | - Jeong Ho Cho
- Department of Chemical and Biomolecular Engineering, Yonsei University, Seoul 03722, Republic of Korea
| |
Collapse
|
3
|
Sun S, Zhang M, Bian J, Xu T, Su J. In 2O 3/ZnO heterojunction thin film transistor for high recognition accuracy neuromorphic computing and optoelectronic artificial synapses. NANOTECHNOLOGY 2024; 35:365602. [PMID: 38861958 DOI: 10.1088/1361-6528/ad5685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 06/11/2024] [Indexed: 06/13/2024]
Abstract
Solid electrolyte-gated transistors exhibit improved chemical stability and can fulfill the requirements of microelectronic packaging. Typically, metal oxide semiconductors are employed as channel materials. However, the extrinsic electron transport properties of these oxides, which are often prone to defects, pose limitations on the overall electrical performance. Achieving excellent repeatability and stability of transistors through the solution process remains a challenging task. In this study, we propose the utilization of a solution-based method to fabricate an In2O3/ZnO heterojunction structure, enabling the development of efficient multifunctional optoelectronic devices. The heterojunction's upper and lower interfaces induce energy band bending, resulting in the accumulation of a large number of electrons and a significant enhancement in transistor mobility. To mimic synaptic plasticity responses to electrical and optical stimuli, we utilize Li+-doped high-k ZrOxthin films as a solid electrolyte in the device. Notably, the heterojunction transistor-based convolutional neural network achieves a high accuracy rate of 93% in recognizing handwritten digits. Moreover, our research involves the simulation of a typical sensory neuron, specifically a nociceptor, within our synaptic transistor. This research offers a novel avenue for the advancement of cost-effective three-terminal thin-film transistors tailored for neuromorphic applications.
Collapse
Affiliation(s)
- Shangheng Sun
- School of Physics Science, Qingdao University, Qingdao 266071, People's Republic of China
| | - Minghao Zhang
- School of Physics Science, Qingdao University, Qingdao 266071, People's Republic of China
| | - Jing Bian
- School of Electronic and Information Engineering, Qingdao University, Qingdao 266071, People's Republic of China
| | - Ting Xu
- School of Electronic and Information Engineering, Qingdao University, Qingdao 266071, People's Republic of China
| | - Jie Su
- School of Physics Science, Qingdao University, Qingdao 266071, People's Republic of China
- School of Electronic and Information Engineering, Qingdao University, Qingdao 266071, People's Republic of China
- National Laboratory of Solid State Microstructures, Physics Department, Nanjing University, Nanjing 210093, People's Republic of China
| |
Collapse
|
4
|
Wang K, Ren S, Jia Y, Yan X. An Ultrasensitive Biomimetic Optic Afferent Nervous System with Circadian Learnability. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2309489. [PMID: 38468430 DOI: 10.1002/advs.202309489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 02/04/2024] [Indexed: 03/13/2024]
Abstract
The optic afferent nervous system (OANS) plays a significant role in generating vision and circadian behaviors based on light detection and signals from the endocrine system. However, the bionic simulation of this photochemically mediated behavior is still a challenge for neuromorphic devices. Herein, stimuli of neurotransmitters at ultralow concentrations and illumination are coupled to artificial synapses with the aid of biofunctionalized heterojunction and tunneling to successfully simulate a circadian neural response. Furthermore, the mechanisms underlying the photosensitive synaptic current in response to stimuli are described. Interestingly, this OANS is demonstrated to be capable of mimicking normal and abnormal circadian learnability by combining the measured synaptic current with a three-layer spike neural network. Strong theoretical and experimental evidence, as well as applications, are provided for the proposed biomimetic OANS to demonstrate that it can reproduce biological circadian behavior, thus establishing it as a promising candidate for future neuromorphic intelligent robots.
Collapse
Affiliation(s)
- Kaiyang Wang
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Shuhui Ren
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Yunfang Jia
- College of Electronic Information and Optical Engineering, Nankai University, Tianjin, 300071, P. R. China
| | - Xiaobing Yan
- Key Laboratory of Brain-Like Neuromorphic Devices and Systems of Hebei Province, College of Electron and Information Engineering, Hebei University, Baoding, 071002, P. R. China
| |
Collapse
|
5
|
Choi C, Lee GJ, Chang S, Song YM, Kim DH. Nanomaterial-Based Artificial Vision Systems: From Bioinspired Electronic Eyes to In-Sensor Processing Devices. ACS NANO 2024; 18:1241-1256. [PMID: 38166167 DOI: 10.1021/acsnano.3c10181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2024]
Abstract
High-performance robotic vision empowers mobile and humanoid robots to detect and identify their surrounding objects efficiently, which enables them to cooperate with humans and assist human activities. For error-free execution of these robots' tasks, efficient imaging and data processing capabilities are essential, even under diverse and complex environments. However, conventional technologies fall short of meeting the high-standard requirements of robotic vision under such circumstances. Here, we discuss recent progress in artificial vision systems with high-performance imaging and data processing capabilities enabled by distinctive electrical, optical, and mechanical characteristics of nanomaterials surpassing the limitations of traditional silicon technologies. In particular, we focus on nanomaterial-based electronic eyes and in-sensor processing devices inspired by biological eyes and animal visual recognition systems, respectively. We provide perspectives on key nanomaterials, device components, and their functionalities, as well as explain the remaining challenges and future prospects of the artificial vision systems.
Collapse
Affiliation(s)
- Changsoon Choi
- Center for Optoelectronic Materials and Devices, Post-silicon Semiconductor Institute, Korea Institute of Science and Technology (KIST), Seoul 02792, Republic of Korea
| | - Gil Ju Lee
- Department of Electronics Engineering, Pusan National University, Busan 46241, Republic of Korea
| | - Sehui Chang
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| | - Young Min Song
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
- AI Graduate School, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
- Department of Semiconductor Engineering, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| | - Dae-Hyeong Kim
- Center for Nanoparticle Research, Institute for Basic Science (IBS), Seoul 08826, Republic of Korea
- School of Chemical and Biological Engineering, Institute of Chemical Processes, Seoul National University, Seoul 08826, Republic of Korea
| |
Collapse
|
6
|
Sun L, Qu S, Xu W. A retinomorphic neuron for artificial vision and iris accommodation. MATERIALS HORIZONS 2023; 10:5753-5762. [PMID: 37807818 DOI: 10.1039/d3mh01036h] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/10/2023]
Abstract
The iris of an eye automatically optimizes the amount of light that strikes the retina by accommodating the intensity of ambient light. Here, we describe a retinomorphic neuron using neuromorphic photoreceptors for artificial vision and iris accommodation that mimics the biological structure and processing functions of retinal neurons for light sensing and signal transduction. The system consists of a neuromorphic photoreceptor, an electrochromic device as a light filter, and a spike-generation unit. In particular, the Au nanoparticle (NP) decorated ITO fiber photoreceptor with a well-aligned array structure is able to rely on its own light-tunable synaptic plasticity and the plasmon-enhanced light absorption. Therefore, it allows real-time feedback about light intensity, emits a higher-frequency electrical stimulus to stronger light, flash, or prolonged light illumination time, and drives the electrochromic filter to work, allowing mild light to pass through. Compared with traditional artificial irises or artificial photoreceptors, our design introduces neural pathways and neuromorphic devices, which are closer to biological functions in simulation. To our knowledge, this is the first time that a retinal neuron with neuromorphic photoreceptors has been used for artificial iris vision. Furthermore, we demonstrate direct and consensual pupillary light reflexes. The design of artificial iris vision has potential applications in biomimetic engineering, smart interaction, and visual prostheses.
Collapse
Affiliation(s)
- Lin Sun
- Institute of Photoelectronic Thin Film Devices and Technology, Key Laboratory of Optoelectronic Thin Film Devices and Technology of Tianjin, College of Electrical Information and Optical Engineering, Engineering Research Center of Thin Film Photoelectronic Technology of Ministry of Education, Smart Sensing Interdisciplinary Science Center, Nankai University, Tianjin 300350, China.
- Shenzhen Research Institute of Nankai University, Shenzhen 518000, China
| | - Shangda Qu
- Institute of Photoelectronic Thin Film Devices and Technology, Key Laboratory of Optoelectronic Thin Film Devices and Technology of Tianjin, College of Electrical Information and Optical Engineering, Engineering Research Center of Thin Film Photoelectronic Technology of Ministry of Education, Smart Sensing Interdisciplinary Science Center, Nankai University, Tianjin 300350, China.
- Shenzhen Research Institute of Nankai University, Shenzhen 518000, China
| | - Wentao Xu
- Institute of Photoelectronic Thin Film Devices and Technology, Key Laboratory of Optoelectronic Thin Film Devices and Technology of Tianjin, College of Electrical Information and Optical Engineering, Engineering Research Center of Thin Film Photoelectronic Technology of Ministry of Education, Smart Sensing Interdisciplinary Science Center, Nankai University, Tianjin 300350, China.
- Shenzhen Research Institute of Nankai University, Shenzhen 518000, China
| |
Collapse
|
7
|
Seok H, Son S, Jathar SB, Lee J, Kim T. Synapse-Mimetic Hardware-Implemented Resistive Random-Access Memory for Artificial Neural Network. SENSORS (BASEL, SWITZERLAND) 2023; 23:3118. [PMID: 36991829 PMCID: PMC10058286 DOI: 10.3390/s23063118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 03/11/2023] [Accepted: 03/13/2023] [Indexed: 06/19/2023]
Abstract
Memristors mimic synaptic functions in advanced electronics and image sensors, thereby enabling brain-inspired neuromorphic computing to overcome the limitations of the von Neumann architecture. As computing operations based on von Neumann hardware rely on continuous memory transport between processing units and memory, fundamental limitations arise in terms of power consumption and integration density. In biological synapses, chemical stimulation induces information transfer from the pre- to the post-neuron. The memristor operates as resistive random-access memory (RRAM) and is incorporated into the hardware for neuromorphic computing. Hardware composed of synaptic memristor arrays is expected to lead to further breakthroughs owing to their biomimetic in-memory processing capabilities, low power consumption, and amenability to integration; these aspects satisfy the upcoming demands of artificial intelligence for higher computational loads. Among the tremendous efforts toward achieving human-brain-like electronics, layered 2D materials have demonstrated significant potential owing to their outstanding electronic and physical properties, facile integration with other materials, and low-power computing. This review discusses the memristive characteristics of various 2D materials (heterostructures, defect-engineered materials, and alloy materials) used in neuromorphic computing for image segregation or pattern recognition. Neuromorphic computing, the most powerful artificial networks for complicated image processing and recognition, represent a breakthrough in artificial intelligence owing to their enhanced performance and lower power consumption compared with von Neumann architectures. A hardware-implemented CNN with weight control based on synaptic memristor arrays is expected to be a promising candidate for future electronics in society, offering a solution based on non-von Neumann hardware. This emerging paradigm changes the computing algorithm using entirely hardware-connected edge computing and deep neural networks.
Collapse
Affiliation(s)
- Hyunho Seok
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon 16419, Republic of Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Shihoon Son
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon 16419, Republic of Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Sagar Bhaurao Jathar
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon 16419, Republic of Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Jaewon Lee
- School of Mechanical Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| | - Taesung Kim
- SKKU Advanced Institute of Nanotechnology (SAINT), Sungkyunkwan University, Suwon 16419, Republic of Korea
- Department of Nano Science and Technology, Sungkyunkwan University, Suwon 16419, Republic of Korea
- School of Mechanical Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea
| |
Collapse
|