1
|
Mei T, Zhou Y, Chen CQ. Mechanical Neural Networks with Explicit and Robust Neurons. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024:e2310241. [PMID: 38898738 DOI: 10.1002/advs.202310241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 05/21/2024] [Indexed: 06/21/2024]
Abstract
Mechanical computing provides an information processing method to realize sensing-analyzing-actuation integrated mechanical intelligence and, when combined with neural networks, can be more efficient for data-rich cognitive tasks. The requirement of solving implicit and usually nonlinear equilibrium equations of motion in training mechanical neural networks makes computation challenging and costly. Here, an explicit mechanical neuron is developed of which the response can be directly determined without the need of solving equilibrium equations. A training method is proposed to ensure the robustness of the neuron, i.e., insensitivity to defects and perturbations. The explicitness and robustness of the neurons facilitate the assembly of various network structures. Two exemplified networks, a robust mechanical convolutional neural network and a mechanical recurrent neural network with long short-term memory capabilities for associative learning, are experimentally demonstrated. The introduction of the explicit and robust mechanical neuron streamlines the design of mechanical neural networks fulfilling robotic matter with a level of intelligence.
Collapse
Affiliation(s)
- Tie Mei
- Department of Engineering Mechanics, CNMM and AML, Tsinghua University, Beijing, 100084, P. R. China
| | - Yuan Zhou
- Department of Engineering Mechanics, CNMM and AML, Tsinghua University, Beijing, 100084, P. R. China
| | - Chang Qing Chen
- Department of Engineering Mechanics, CNMM and AML, Tsinghua University, Beijing, 100084, P. R. China
| |
Collapse
|
2
|
Key Technologies of Photonic Artificial Intelligence Chip Structure and Algorithm. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11125719] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Artificial intelligence chips (AICs) are the intersection of integrated circuits and artificial intelligence (AI), involving structure design, algorithm analysis, chip fabrication and application scenarios. Due to their excellent ability in data processing, AICs show a long-term industrial prospect in big data services, cloud centers, etc. However, with the conceivable exhaustion of Moore’s Law, the size of traditional electronic AICs (EAICs) is gradually approaching the limit, and an architectural update is highly required. Photonic artificial intelligence chips (PAIC) utilize light beam propagation in the silicon waveguide, contributing to a high parallelism configuration, fast calculation speed and low latency. Due to light manipulation, PAICs perform well in anti-electromagnetic interference and energy conservation. This invited paper summarized the recent research on PAICs. The characteristics of different hardware structures are discussed. The current widely used training algorithm is given and the Photonic Design Automatic (PDA) simulation platform is introduced. In addition, the authors’ related work on PAICs is presented and we believe that PAICs may play a critical role in the deployment of data processing technology.
Collapse
|
3
|
Spall J, Guo X, Barrett TD, Lvovsky AI. Fully reconfigurable coherent optical vector-matrix multiplication. OPTICS LETTERS 2020; 45:5752-5755. [PMID: 33057276 DOI: 10.1364/ol.401675] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Accepted: 09/14/2020] [Indexed: 06/11/2023]
Abstract
Optics is a promising platform in which to help realize the next generation of fast, parallel, and energy-efficient computation. We demonstrate a reconfigurable free-space optical multiplier that is capable of over 3000 computations in parallel, using spatial light modulators with a pixel resolution of only 340×340. This enables vector-matrix multiplication and parallel vector-vector multiplication with vector size of up to 56. Our design is, to the best of our knowledge, the first to simultaneously support optical implementation of reconfigurable, large-sized, and real-valued linear algebraic operations. Such an optical multiplier can serve as a building block of special-purpose optical processors such as optical neural networks and optical Ising machines.
Collapse
|
4
|
Wang X, Peng J, Li M, Shen Z, Shan O. Carry-free vector-matrix multiplication on a dynamically reconfigurable optical platform. APPLIED OPTICS 2010; 49:2352-2362. [PMID: 20411016 DOI: 10.1364/ao.49.002352] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Applying the parallelism of optical computing, we present a novel method of vector-matrix multiplication (VMM) based on a new optical computing platform, the ternary optical computer, which can reconfigure any two-input trivalued logic optical processor at runtime, according to the decrease-radix design principle. In this work, we investigate a novel optical VMM (OVMM) using five logic operations with the modified signed-digit (MSD) number system. To simplify the computation process, we realize a carry-free optical addition in three steps, which is independent of the length of the operands. And a new implementation method is proposed that can be used to realize the MSD multiplication in parallel. Based on the generation of partial products in parallel and the binary-addition-tree algorithm, the multiplication can be implemented with the MSD addition. Our initial experiments have been performed to verify the proposed OVMM method. The results show that the proposed method of OVMM is feasible and correct.
Collapse
Affiliation(s)
- Xianchao Wang
- School of Computer Engineering and Science, Shanghai University,149 Yanchang Road, Shanghai 200072, China
| | | | | | | | | |
Collapse
|
5
|
Zhao L, Zhao Q, Zhou J, Tian S, Zhang H. Two-dimensional multi-channel acousto-optic diffraction. ULTRASONICS 2010; 50:512-516. [PMID: 20080278 DOI: 10.1016/j.ultras.2009.10.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2009] [Revised: 10/30/2009] [Accepted: 10/31/2009] [Indexed: 05/28/2023]
Abstract
In this paper, we have investigated the interaction between acoustic waves generated by an incident light beam propagating through two-dimensional transducers. A set of coupled mode equations for two-dimensional multi-channel acousto-optic inter-modulation are derived, and the solutions are obtained. A new type of two-dimensional multi-channel Bragg acousto-optic modulator is designed by analyzing two-dimensional multi-channel acousto-optic inter-modulation based on the coupled mode theory, and its performance has also been experimentally characterized. The experimental results are in accordance with our theoretical analysis.
Collapse
Affiliation(s)
- Luming Zhao
- The College of Physics, Nankai University, Tianjin 300071, China.
| | | | | | | | | |
Collapse
|
6
|
Zhou C, Liu L, Li G, Ying Y. Modified engagement method for matrix operation. APPLIED OPTICS 1995; 34:7608-7614. [PMID: 21060639 DOI: 10.1364/ao.34.007608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
We describe a modified engagement method for matrix operation based on a two-dimensional crossed-ring interconnection network. Our method incorporates fewer steps than that reported by Bocker et al. [Appl. Opt. 22, 804 (1983)], and its performance is found to be the most efficient (minimum steps) in comparison with other systolic and/or engagement methods for matrix operation. Thus, it may be helpful for other optical and electronic implementations of matrix operations. One compact optoelectronic integrity approach for implementing the modified engagement method is briefly described.
Collapse
|
7
|
Li G, Liu L, Shao L, Yin Y. Modified direct twos-complement parallel array multiplication algorithm for complex matrix operation. APPLIED OPTICS 1995; 34:1321-1328. [PMID: 21037663 DOI: 10.1364/ao.34.001321] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
A direct twos-complement parallel array multiplication algorithm is introduced and modified for digital optical numerical computation. The modified version overcomes the problems encountered in the conventional optical twos-complement algorithm. In the array, all the summands are generated in parallel, and the relevant summands having the same weights are added simultaneously without carries, resulting in the product expressed in a mixed twos-complement system. In a two-stage array, complex multiplication is possible with using four real subarrays. Furthermore, with a three-stage array architecture, complex matrix operation is straightforwardly accomplished. In the experiment, parallel two-stage array complex multiplication with liquid-crystal panels is demonstrated.
Collapse
|
8
|
Li G, Liu L, Shao L, Wang Z. Negative binary arithmetic algorithms for digital parallel optical computation. OPTICS LETTERS 1994; 19:1337-1339. [PMID: 19855513 DOI: 10.1364/ol.19.001337] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Based on a negative binary number system, an algorithm with weighted-shifted addition, parallel-array multiplication, and a two-stage-array complex operation is proposed to carry out the multiplication of two complex numbers. The complex multiplication is performed without signs, carries, and recoding. The algorithm is suitable for optical implementation, and an optical parallel architecture is suggested. The experimental result is also given.
Collapse
|
9
|
Reif JH, Yoshida A. Optical expanders with applications in optical computing. APPLIED OPTICS 1993; 32:159-165. [PMID: 20802672 DOI: 10.1364/ao.32.000159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
An optical system called the optical expander is described and investigated. The optical expander electro-optically expands an optical Boolean pattern encoded in d bits into an optical pattern of size N bits. It is assumed that d is equal to c log(2)N for some constant c, and each expanded pattern is orthogonal to the others. Two different architectures to implement the optical expander are described: one uses an optical matrix-vector multiplier and an array of N threshold devices; the other uses log(2)N novel reflection-transmission switching cells. These architectures are analyzed in terms of size, energy requirement, and speed. The optical expander described utilizes high-speed and high-space-bandwidth-product connections that are provided by optical beams in three dimensions. Potential applications, holographic memory, and message routing systems are also discussed.
Collapse
|
10
|
Gary CK. Matrix-vector multiplication using digital partitioning for more accurate optical computing. APPLIED OPTICS 1992; 31:6205-6211. [PMID: 20733832 DOI: 10.1364/ao.31.006205] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Digital partitioning offers a flexible means of increasing the accuracy of an optical matrix-vector processor. This algorithm can be implemented with the same architecture required for a purely analog processor, which gives optical matrix-vector processors the ability to perform high-accuracy calculations at speeds comparable with or greater than electronic computers as well as the ability to perform analog operations at a much greater speed. Digital partitioning is compared with digital multiplication by analog convolution, residue number systems, and redundant number representation in terms of the size and the speed required for an equivalent throughput as well as in terms of the hardware requirements. Digital partitioning and digital multiplication by analog convolution are found to be the most efficient algorithms if coding time and hardware are considered, and the architecture for digital partitioning permits the use of analog computations to provide the greatest throughput for a single processor. To our knowledge this is the first study to propose the use of digital partitioning for optical matrix processing.
Collapse
|