Intelligent indoor metasurface robotics

Phasor-based analysis of a neuromorphic architecture for microwave sensing

This article presents a design procedure for implementing artificial neural networks (ANNs) using conventional microwave components at the hardware level with potential applications in radar and remote sensing. The main objective is to develop structured hardware design methods for implementing artificial neurons, utilizing microwave devices to create neuromorphic devices compatible with high-frequency electromagnetic waves. The research aims to address the challenge of encoding and modulating information in electromagnetic waves into a format suitable for the neuromorphic device by using frequency-modulated information instead of intensity-modulated information. It also proposes a method for integrating principal component analysis as a dimensionality reduction technique with the implementation of ANNs on a single hardware. As a dummy task, the process outlined here is used to implement an artificial neural network at the hardware level, with a specific emphasis on creating hardware that is capable of performing matrix multiplications in the form of dot products while also being able to extract the resulting data in an interpretable manner. The proposed implementation involves the use of directional couplers to implement weights and sample the resulting signal at specific intervals to obtain the multiplication result.

Microwave Speech Recognizer Empowered by a Programmable Metasurface

Speech recognition becomes increasingly important in the modern society, especially for human-machine interactions, but its deployment is still severely thwarted by the struggle of machines to recognize voiced commands in challenging real-life settings: oftentimes, ambient noise drowns the acoustic sound signals, and walls, face masks or other obstacles hide the mouth motion from optical sensors. To address these formidable challenges, an experimental prototype of a microwave speech recognizer empowered by programmable metasurface is presented here that can remotely recognize human voice commands and speaker identities even in noisy environments and if the speaker's mouth is hidden behind a wall or face mask. The programmable metasurface is the pivotal hardware ingredient of the system because its large aperture and huge number of degrees of freedom allows the system to perform a complex sequence of sensing tasks, orchestrated by artificial-intelligence tools. Relying solely on microwave data, the system avoids visual privacy infringements. The developed microwave speech recognizer can enable privacy-respecting voice-commanded human-machine interactions is experimentally demonstrated in many important but to-date inaccessible application scenarios. The presented strategy will unlock new possibilities and have expectations for future smart homes, ambient-assisted health monitoring, as well as intelligent surveillance and security.

Simultaneously Intelligent Sensing and Beamforming Based on an Adaptive Information Metasurface

Due to its ability to adapt to a variety of electromagnetic (EM) environments, the sensing-enabled metasurface has garnered significant attention. However, large-scale EM-field sensing to obtain more information is still very challenging. Here, an adaptive information metasurface is proposed to enable intelligent sensing and wave manipulating simultaneously or more specifically, to realize intelligent target localization and beam tracking adaptively. The metasurface is composed of an array of meta-atoms, and each is loaded with two PIN diodes and a sensing-channel structure, for polarization-insensitive and programmable beamforming and sensing. By controlling the state of the PIN diode, the proposed meta-atom has 1-bit phase response in the designed frequency band, while the sensing loss keeps higher than -10 dB for both "ON" and "OFF" states. Hence there is nearly no interaction between the beamforming and sensing modes. Experiments are conducted to show multiple functions of the metasurface, including intelligent target sensing and self-adaptive beamforming, and the measured results are in good agreement with the numerical simulations and theoretical calculations.

Independent Manipulations of Transmitting and Receiving Channels by Nonreciprocal Programmable Metasurface

The electromagnetic (EM) beam manipulations such as spatial scanning have always been the focus in information science and technology. Generally, the transmitting and receiving (T/R) beams of the same aperture should be coincident due to the reciprocal theory, and hence, more flexible controls of the spatial information are limited accordingly. Here, we propose a new approach to achieve independent controls of beam scanning in spatial T/R channels based on one aperture made by a nonreciprocal programmable metasurface. The meta-atom is designed to have independent propagation chains for T/R waves by introducing dual-direction power amplifiers (PAs) as the isolators for one-way transparency. A programmable phase shifter with a 360° coverage is loaded with the PA device in the transmitting or receiving chain to realize independent beam scanning in the T/R channels. A prototype of the proposed metasurface is fabricated, and independent beam scanning in the T/R channels is directly acquired with good performance in our measurements. In addition, a proof of concept of integrated sensing and auxiliary communications is accomplished to verify the validity of the presented method.