1
|
Qi Y, Feng Y, Wang H, Wang C, Bai M, Liu J, Zhan X, Wu J, Wang Q, Chen J. Flash-Based Computing-in-Memory Architecture to Implement High-Precision Sparse Coding. MICROMACHINES 2023; 14:2190. [PMID: 38138359 PMCID: PMC10745354 DOI: 10.3390/mi14122190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Revised: 11/27/2023] [Accepted: 11/28/2023] [Indexed: 12/24/2023]
Abstract
To address the concerns with power consumption and processing efficiency in big-size data processing, sparse coding in computing-in-memory (CIM) architectures is gaining much more attention. Here, a novel Flash-based CIM architecture is proposed to implement large-scale sparse coding, wherein various matrix weight training algorithms are verified. Then, with further optimizations of mapping methods and initialization conditions, the variation-sensitive training (VST) algorithm is designed to enhance the processing efficiency and accuracy of the applications of image reconstructions. Based on the comprehensive characterizations observed when considering the impacts of array variations, the experiment demonstrated that the trained dictionary could successfully reconstruct the images in a 55 nm flash memory array based on the proposed architecture, irrespective of current variations. The results indicate the feasibility of using Flash-based CIM architectures to implement high-precision sparse coding in a wide range of applications.
Collapse
Affiliation(s)
- Yueran Qi
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Yang Feng
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Hai Wang
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Chengcheng Wang
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Maoying Bai
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Jing Liu
- Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics of Chinese Academy of Sciences, Beijing 100029, China;
| | - Xuepeng Zhan
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Jixuan Wu
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Qianwen Wang
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| | - Jiezhi Chen
- School of Information Science and Engineering, Shandong University, Qingdao 266237, China; (Y.Q.); (Y.F.); (H.W.); (C.W.); (M.B.); (X.Z.); (J.W.); (Q.W.)
| |
Collapse
|
2
|
Mangalwedhekar R, Singh N, Thakur CS, Seelamantula CS, Jose M, Nair D. Achieving nanoscale precision using neuromorphic localization microscopy. NATURE NANOTECHNOLOGY 2023; 18:380-389. [PMID: 36690737 DOI: 10.1038/s41565-022-01291-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 11/09/2022] [Indexed: 06/17/2023]
Abstract
Neuromorphic cameras are a new class of dynamic-vision-inspired sensors that encode the rate of change of intensity as events. They can asynchronously record intensity changes as spikes, independent of the other pixels in the receptive field, resulting in sparse measurements. This recording of such sparse events makes them ideal for imaging dynamic processes, such as the stochastic emission of isolated single molecules. Here we show the application of neuromorphic detection to localize nanoscale fluorescent objects below the diffraction limit, with a precision below 20 nm. We demonstrate a combination of neuromorphic detection with segmentation and deep learning approaches to localize and track fluorescent particles below 50 nm with millisecond temporal resolution. Furthermore, we show that combining information from events resulting from the rate of change of intensities improves the classical limit of centroid estimation of single fluorescent objects by nearly a factor of two. Additionally, we validate that using post-processed data from the neuromorphic detector at defined windows of temporal integration allows a better evaluation of the fractalized diffusion of single particle trajectories. Our observations and analysis is useful for event sensing by nonlinear neuromorphic devices to ameliorate real-time particle localization approaches at the nanoscale.
Collapse
Affiliation(s)
| | - Nivedita Singh
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | - Chetan Singh Thakur
- Department of Electronic Systems Engineering, Indian Institute of Science, Bangalore, India
| | | | - Mini Jose
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India
| | - Deepak Nair
- Centre for Neuroscience, Indian Institute of Science, Bangalore, India.
| |
Collapse
|
3
|
Annamalai L, Ramanathan V, Thakur CS. Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3151426] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|