1
|
Sakib NU, Karim Sadaf MU, Pannone A, Ghosh S, Zheng Y, Ravichandran H, Das S. A Crayfish-Inspired Sensor Fusion Platform for Super Additive Integration of Visual, Chemical, and Tactile Information. NANO LETTERS 2024; 24:6948-6956. [PMID: 38810209 DOI: 10.1021/acs.nanolett.4c01187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2024]
Abstract
The concept of cross-sensor modulation, wherein one sensor modality can influence another's response, is often overlooked in traditional sensor fusion architectures, leading to missed opportunities for enhancing data accuracy and robustness. In contrast, biological systems, such as aquatic animals like crayfish, demonstrate superior sensor fusion through multisensory integration. These organisms adeptly integrate visual, tactile, and chemical cues to perform tasks such as evading predators and locating prey. Drawing inspiration from this, we propose a neuromorphic platform that integrates graphene-based chemitransistors, monolayer molybdenum disulfide (MoS2) based photosensitive memtransistors, and triboelectric tactile sensors to achieve "Super-Additive" responses to weak chemical, visual, and tactile cues and demonstrate contextual response modulation, also referred to as the "Inverse Effectiveness Effect." We hold the view that integrating bio-inspired sensor fusion principles across various modalities holds promise for a wide range of applications.
Collapse
Affiliation(s)
- Najam U Sakib
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Muhtasim Ul Karim Sadaf
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Andrew Pannone
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Subir Ghosh
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Yikai Zheng
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Harikrishnan Ravichandran
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
| | - Saptarshi Das
- Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States
- Electrical Engineering, Penn State University, University Park, Pennsylvania 16802, United States
- Materials Science and Engineering, Penn State University, University Park, Pennsylvania 16802, United States
- Materials Research Institute, Penn State University, University Park, Pennsylvania 16802, United States
| |
Collapse
|
2
|
Luo X, Deng W, Sheng F, Ren X, Zhao Z, Zhao C, Liu Y, Shi J, Liu Z, Zhang X, Jie J. Bionic Scotopic Adaptation Transistors for Nighttime Low Illumination Imaging. ACS NANO 2024; 18:13726-13737. [PMID: 38742941 DOI: 10.1021/acsnano.4c01663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
Human vision excels in perceiving nighttime low illumination due to biological feedforward adaptation. Replicating this ability in biomimetic vision using solid-state devices has been highly sought after. However, emulating scotopic adaptation, entailing a confluence of efficient photoexcitation and dynamic carrier modulation, presents formidable challenges. Here, we demonstrate a low-power and bionic scotopic adaptation transistor by coupling a light-absorption layer and an electron-trapping layer at the bottom of the semiconducting channel, enabling simultaneous achievement of efficient generation of free photocarriers and adaptive carrier accumulation within a single device. This innovation empowers our transistor to exhibit sensitivity-potentiated characteristics after adaptation, detecting scotopic-level illumination (0.001 lx) with exceptional photosensitivity up to 103 at low voltages below 2 V. Moreover, we have successfully replicated diverse scotopic vision functions, encompassing time-dependent visual threshold enhancement, light intensity-dependent adaptation index, imaging contrast enhancement for nighttime low illumination imaging, opening an opportunity for artificial night vision.
Collapse
Affiliation(s)
- Xiangkai Luo
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Wei Deng
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Fangming Sheng
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Xiaobin Ren
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Zishen Zhao
- School of Advanced Technology, Xi'an Jiaotong-Liverpool University, Suzhou, Jiangsu 215123, China
| | - Chun Zhao
- School of Advanced Technology, Xi'an Jiaotong-Liverpool University, Suzhou, Jiangsu 215123, China
| | - Yang Liu
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Jialin Shi
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Zeke Liu
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Xiujuan Zhang
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| | - Jiansheng Jie
- Institute of Functional Nano & Soft Materials (FUNSOM), Jiangsu Key Laboratory for Carbon-Based Functional Materials & Devices, Soochow University, Suzhou, Jiangsu 215123, China
| |
Collapse
|
3
|
Wang K, Liao Y, Li W, Li J, Su H, Chen R, Park JH, Zhang Y, Zhou X, Wu C, Liu Z, Guo T, Kim TW. Memory-electroluminescence for multiple action-potentials combination in bio-inspired afferent nerves. Nat Commun 2024; 15:3505. [PMID: 38664383 PMCID: PMC11045776 DOI: 10.1038/s41467-024-47641-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 04/05/2024] [Indexed: 04/28/2024] Open
Abstract
The development of optoelectronics mimicking the functions of the biological nervous system is important to artificial intelligence. This work demonstrates an optoelectronic, artificial, afferent-nerve strategy based on memory-electroluminescence spikes, which can realize multiple action-potentials combination through a single optical channel. The memory-electroluminescence spikes have diverse morphologies due to their history-dependent characteristics and can be used to encode distributed sensor signals. As the key to successful functioning of the optoelectronic, artificial afferent nerve, a driving mode for light-emitting diodes, namely, the non-carrier injection mode, is proposed, allowing it to drive nanoscale light-emitting diodes to generate a memory-electroluminescence spikes that has multiple sub-peaks. Moreover, multiplexing of the spikes can be obtained by using optical signals with different wavelengths, allowing for a large signal bandwidth, and the multiple action-potentials transmission process in afferent nerves can be demonstrated. Finally, sensor-position recognition with the bio-inspired afferent nerve is developed and shown to have a high recognition accuracy of 98.88%. This work demonstrates a strategy for mimicking biological afferent nerves and offers insights into the construction of artificial perception systems.
Collapse
Affiliation(s)
- Kun Wang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Yitao Liao
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Wenhao Li
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Junlong Li
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Hao Su
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Rong Chen
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Jae Hyeon Park
- Department of Electronic and Computer Engineering, Hanyang University, Seoul, 133-791, Korea
| | - Yongai Zhang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Xiongtu Zhou
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China
| | - Chaoxing Wu
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China.
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China.
| | - Zhiqiang Liu
- Research and Development Center for Semiconductor Lighting Technology, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China.
| | - Tailiang Guo
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China.
- Fujian Science & Technology Innovation Laboratory for Optoelectronic Information of China, Fuzhou, 350108, China.
| | - Tae Whan Kim
- Department of Electronic and Computer Engineering, Hanyang University, Seoul, 133-791, Korea.
| |
Collapse
|
4
|
Zheng Y, Ghosh S, Das S. A Butterfly-Inspired Multisensory Neuromorphic Platform for Integration of Visual and Chemical Cues. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023:e2307380. [PMID: 38069632 DOI: 10.1002/adma.202307380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 11/25/2023] [Indexed: 12/23/2023]
Abstract
Unisensory cues are often insufficient for animals to effectively engage in foraging, mating, and predatory activities. In contrast, integration of cues collected from multiple sensory organs enhances the overall perceptual experience and thereby facilitates better decision-making. Despite the importance of multisensory integration in animals, the field of artificial intelligence (AI) and neuromorphic computing has primarily focused on processing unisensory information. This lack of emphasis on multisensory integration can be attributed to the absence of a miniaturized hardware platform capable of co-locating multiple sensing modalities and enabling in-sensor and near-sensor processing. In this study, this limitation is addressed by utilizing the chemo-sensing properties of graphene and the photo-sensing capability of monolayer molybdenum disulfide (MoS2 ) to create a multisensory platform for visuochemical integration. Additionally, the in-memory-compute capability of MoS2 memtransistors is leveraged to develop neural circuits that facilitate multisensory decision-making. The visuochemical integration platform is inspired by intricate courtship of Heliconius butterflies, where female species rely on the integration of visual cues (such as wing color) and chemical cues (such as pheromones) generated by the male butterflies for mate selection. The butterfly-inspired visuochemical integration platform has significant implications in both robotics and the advancement of neuromorphic computing, going beyond unisensory intelligence and information processing.
Collapse
Affiliation(s)
- Yikai Zheng
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA
| | - Subir Ghosh
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA
| | - Saptarshi Das
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA
- Electrical Engineering, Penn State University, University Park, PA, 16802, USA
- Materials Science and Engineering, Penn State University, University Park, PA, 16802, USA
- Materials Research Institute, Penn State University, University Park, PA, 16802, USA
| |
Collapse
|
5
|
Sadaf MUK, Sakib NU, Pannone A, Ravichandran H, Das S. A bio-inspired visuotactile neuron for multisensory integration. Nat Commun 2023; 14:5729. [PMID: 37714853 PMCID: PMC10504285 DOI: 10.1038/s41467-023-40686-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 08/03/2023] [Indexed: 09/17/2023] Open
Abstract
Multisensory integration is a salient feature of the brain which enables better and faster responses in comparison to unisensory integration, especially when the unisensory cues are weak. Specialized neurons that receive convergent input from two or more sensory modalities are responsible for such multisensory integration. Solid-state devices that can emulate the response of these multisensory neurons can advance neuromorphic computing and bridge the gap between artificial and natural intelligence. Here, we introduce an artificial visuotactile neuron based on the integration of a photosensitive monolayer MoS2 memtransistor and a triboelectric tactile sensor which minutely captures the three essential features of multisensory integration, namely, super-additive response, inverse effectiveness effect, and temporal congruency. We have also realized a circuit which can encode visuotactile information into digital spiking events, with probability of spiking determined by the strength of the visual and tactile cues. We believe that our comprehensive demonstration of bio-inspired and multisensory visuotactile neuron and spike encoding circuitry will advance the field of neuromorphic computing, which has thus far primarily focused on unisensory intelligence and information processing.
Collapse
Affiliation(s)
| | - Najam U Sakib
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA
| | - Andrew Pannone
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA
| | | | - Saptarshi Das
- Engineering Science and Mechanics, Penn State University, University Park, PA, 16802, USA.
- Electrical Engineering, Penn State University, University Park, PA, 16802, USA.
- Materials Science and Engineering, Penn State University, University Park, PA, 16802, USA.
- Materials Research Institute, Penn State University, University Park, PA, 16802, USA.
| |
Collapse
|
6
|
Lau CS, Das S, Verzhbitskiy IA, Huang D, Zhang Y, Talha-Dean T, Fu W, Venkatakrishnarao D, Johnson Goh KE. Dielectrics for Two-Dimensional Transition-Metal Dichalcogenide Applications. ACS NANO 2023. [PMID: 37257134 DOI: 10.1021/acsnano.3c03455] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Despite over a decade of intense research efforts, the full potential of two-dimensional transition-metal dichalcogenides continues to be limited by major challenges. The lack of compatible and scalable dielectric materials and integration techniques restrict device performances and their commercial applications. Conventional dielectric integration techniques for bulk semiconductors are difficult to adapt for atomically thin two-dimensional materials. This review provides a brief introduction into various common and emerging dielectric synthesis and integration techniques and discusses their applicability for 2D transition metal dichalcogenides. Dielectric integration for various applications is reviewed in subsequent sections including nanoelectronics, optoelectronics, flexible electronics, valleytronics, biosensing, quantum information processing, and quantum sensing. For each application, we introduce basic device working principles, discuss the specific dielectric requirements, review current progress, present key challenges, and offer insights into future prospects and opportunities.
Collapse
Affiliation(s)
- Chit Siong Lau
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Sarthak Das
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Ivan A Verzhbitskiy
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Ding Huang
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Yiyu Zhang
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Teymour Talha-Dean
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
- Department of Physics and Astronomy, Queen Mary University of London, London E1 4NS, United Kingdom
| | - Wei Fu
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Dasari Venkatakrishnarao
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
| | - Kuan Eng Johnson Goh
- Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR), 2 Fusionopolis Way, Innovis #08-03, Singapore 138634, Republic of Singapore
- Department of Physics, National University of Singapore, 2 Science Drive 3, 117551, Singapore
- Division of Physics and Applied Physics, School of Physical and Mathematical Sciences, Nanyang Technological University, 50 Nanyang Avenue 639798, Singapore
| |
Collapse
|