1
|
Lykourinas A, Rottenberg X, Catthoor F, Skodras A. Unsupervised Domain Adaptation for Inter-Session Re-Calibration of Ultrasound-Based HMIs. SENSORS (BASEL, SWITZERLAND) 2024; 24:5043. [PMID: 39124090 PMCID: PMC11314926 DOI: 10.3390/s24155043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 07/12/2024] [Accepted: 07/30/2024] [Indexed: 08/12/2024]
Abstract
Human-Machine Interfaces (HMIs) have gained popularity as they allow for an effortless and natural interaction between the user and the machine by processing information gathered from a single or multiple sensing modalities and transcribing user intentions to the desired actions. Their operability depends on frequent periodic re-calibration using newly acquired data due to their adaptation needs in dynamic environments, where test-time data continuously change in unforeseen ways, a cause that significantly contributes to their abandonment and remains unexplored by the Ultrasound-based (US-based) HMI community. In this work, we conduct a thorough investigation of Unsupervised Domain Adaptation (UDA) algorithms for the re-calibration of US-based HMIs during within-day sessions, which utilize unlabeled data for re-calibration. Our experimentation led us to the proposal of a CNN-based architecture for simultaneous wrist rotation angle and finger gesture prediction that achieves comparable performance with the state-of-the-art while featuring 87.92% less trainable parameters. According to our findings, DANN (a Domain-Adversarial training algorithm), with proper initialization, offers an average 24.99% classification accuracy performance enhancement when compared to no re-calibration setting. However, our results suggest that in cases where the experimental setup and the UDA configuration may differ, observed enhancements would be rather small or even unnoticeable.
Collapse
Affiliation(s)
- Antonios Lykourinas
- Department of Electrical and Computer Engineering, University of Patras, 26504 Patras, Greece;
- Imec, 3001 Leuven, Belgium; (F.C.); (X.R.)
| | | | | | - Athanassios Skodras
- Department of Electrical and Computer Engineering, University of Patras, 26504 Patras, Greece;
| |
Collapse
|
2
|
Skoraczynski DJ, Chen C. Novel near E-Field Topography Sensor for Human-Machine Interfacing in Robotic Applications. SENSORS (BASEL, SWITZERLAND) 2024; 24:1379. [PMID: 38474915 DOI: 10.3390/s24051379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Revised: 02/10/2024] [Accepted: 02/14/2024] [Indexed: 03/14/2024]
Abstract
This work investigates a new sensing technology for use in robotic human-machine interface (HMI) applications. The proposed method uses near E-field sensing to measure small changes in the limb surface topography due to muscle actuation over time. The sensors introduced in this work provide a non-contact, low-computational-cost, and low-noise method for sensing muscle activity. By evaluating the key sensor characteristics, such as accuracy, hysteresis, and resolution, the performance of this sensor is validated. Then, to understand the potential performance in intention detection, the unmodified digital output of the sensor is analysed against movements of the hand and fingers. This is done to demonstrate the worst-case scenario and to show that the sensor provides highly targeted and relevant data on muscle activation before any further processing. Finally, a convolutional neural network is used to perform joint angle prediction over nine degrees of freedom, achieving high-level regression performance with an RMSE value of less than six degrees for thumb and wrist movements and 11 degrees for finger movements. This work demonstrates the promising performance of this novel approach to sensing for use in human-machine interfaces.
Collapse
Affiliation(s)
- Dariusz J Skoraczynski
- Laboratory of Motion Generation and Analysis (LMGA), Monash University, Clayton, VIC 3800, Australia
| | - Chao Chen
- Laboratory of Motion Generation and Analysis (LMGA), Monash University, Clayton, VIC 3800, Australia
| |
Collapse
|
3
|
Greco A, Baek S, Middelmann T, Mehring C, Braun C, Marquetand J, Siegel M. Discrimination of finger movements by magnetomyography with optically pumped magnetometers. Sci Rep 2023; 13:22157. [PMID: 38092937 PMCID: PMC10719385 DOI: 10.1038/s41598-023-49347-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 12/07/2023] [Indexed: 12/17/2023] Open
Abstract
Optically pumped magnetometers (OPM) are quantum sensors that offer new possibilities to measure biomagnetic signals. Compared to the current standard surface electromyography (EMG), in magnetomyography (MMG), OPM sensors offer the advantage of contactless measurements of muscle activity. However, little is known about the relative performance of OPM-MMG and EMG, e.g. in their ability to detect and classify finger movements. To address this in a proof-of-principle study, we recorded simultaneous OPM-MMG and EMG of finger flexor muscles for the discrimination of individual finger movements on a single human participant. Using a deep learning model for movement classification, we found that both sensor modalities were able to discriminate finger movements with above 89% accuracy. Furthermore, model predictions for the two sensor modalities showed high agreement in movement detection (85% agreement; Cohen's kappa: 0.45). Our findings show that OPM sensors can be employed for contactless discrimination of finger movements and incentivize future applications of OPM in magnetomyography.
Collapse
Affiliation(s)
- Antonino Greco
- Department of Neural Dynamics and Magnetoencephalography, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany.
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany.
- MEG-Center, University of Tübingen, Tübingen, Germany.
| | - Sangyeob Baek
- Department of Neural Dynamics and Magnetoencephalography, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- MEG-Center, University of Tübingen, Tübingen, Germany
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy
| | - Thomas Middelmann
- Department of Biosignals, Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Carsten Mehring
- Bernstein Center Freiburg, University of Freiburg, Freiburg Im Breisgau, Germany
- Faculty of Biology, University of Freiburg, 79104, Freiburg Im Breisgau, Germany
| | - Christoph Braun
- Department of Neural Dynamics and Magnetoencephalography, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- MEG-Center, University of Tübingen, Tübingen, Germany
| | - Justus Marquetand
- Department of Neural Dynamics and Magnetoencephalography, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- MEG-Center, University of Tübingen, Tübingen, Germany
- Department of Epileptology, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Markus Siegel
- Department of Neural Dynamics and Magnetoencephalography, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
- Centre for Integrative Neuroscience, University of Tübingen, Tübingen, Germany
- MEG-Center, University of Tübingen, Tübingen, Germany
- German Center for Mental Health (DZPG), University of Tübingen, Tübingen, Germany
| |
Collapse
|
4
|
Abdelatty M, Incandela J, Hu K, Larkin JW, Reda S, Rosenstein JK. Microscale 3-D Capacitance Tomography with a CMOS Sensor Array. IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE : HEALTHCARE TECHNOLOGY : [PROCEEDINGS]. IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE 2023; 2023:10.1109/biocas58349.2023.10388576. [PMID: 38384749 PMCID: PMC10880799 DOI: 10.1109/biocas58349.2023.10388576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/23/2024]
Abstract
Electrical capacitance tomography (ECT) is a non-optical imaging technique in which a map of the interior permittivity of a volume is estimated by making capacitance measurements at its boundary and solving an inverse problem. While previous ECT demonstrations have often been at centimeter scales, ECT is not limited to macroscopic systems. In this paper, we demonstrate ECT imaging of polymer microspheres and bacterial biofilms using a CMOS microelectrode array, achieving spatial resolution of 10 microns. Additionally, we propose a deep learning architecture and an improved multi-objective training scheme for reconstructing out-of-plane permittivity maps from the sensor measurements. Experimental results show that the proposed approach is able to resolve microscopic 3-D structures, achieving 91.5% prediction accuracy on the microsphere dataset and 82.7% on the biofilm dataset, including an average of 4.6% improvement over baseline computational methods.
Collapse
|
5
|
Li Y, Wang N, Fan LF, Zhao PF, Li JH, Huang L, Wang ZY. Robust electrical impedance tomography for biological application: A mini review. Heliyon 2023; 9:e15195. [PMID: 37089335 PMCID: PMC10113865 DOI: 10.1016/j.heliyon.2023.e15195] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 03/10/2023] [Accepted: 03/29/2023] [Indexed: 04/05/2023] Open
Abstract
Electrical impedance tomography (EIT) has been used by researchers across several areas because of its low-cost and no-radiation properties. Researchers use complex conductivity in bioimpedance experiments to evaluate changes in various indicators within the image target. The diverse volumes and edges of biological tissues and the large impedance range impose dedicated demands on hardware design. The EIT hardware with a high signal-to-noise ratio (SNR), fast scanning and suitable for the impedance range of the image target is a fundamental foundation that EIT research needs to be equipped with. Understanding the characteristics of this technique and state-of-the-art design will accelerate the development of the robust system and provide a guidance for the superior performance of next-generation EIT. This review explores the hardware strategies for EIT proposed in the literature.
Collapse
|
6
|
Nguyen XT, Ali M, Lee JW. 3.6 mW Active-Electrode ECG/ETI Sensor System Using Wideband Low-Noise Instrumentation Amplifier and High Impedance Balanced Current Driver. SENSORS (BASEL, SWITZERLAND) 2023; 23:2536. [PMID: 36904738 PMCID: PMC10007594 DOI: 10.3390/s23052536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 02/17/2023] [Accepted: 02/22/2023] [Indexed: 06/18/2023]
Abstract
An active electrode (AE) and back-end (BE) integrated system for enhanced electrocardiogram (ECG)/electrode-tissue impedance (ETI) measurement is proposed. The AE consists of a balanced current driver and a preamplifier. To increase the output impedance, the current driver uses a matched current source and sink, which operates under negative feedback. To increase the linear input range, a new source degeneration method is proposed. The preamplifier is realized using a capacitively-coupled instrumentation amplifier (CCIA) with a ripple-reduction loop (RRL). Compared to the traditional Miller compensation, active frequency feedback compensation (AFFC) achieves bandwidth extension using the reduced size of the compensation capacitor. The BE performs three types of signal sensing: ECG, band power (BP), and impedance (IMP) data. The BP channel is used to detect the Q-, R-, and S-wave (QRS) complex in the ECG signal. The IMP channel measures the resistance and reactance of the electrode-tissue. The integrated circuits for the ECG/ETI system are realized in the 180 nm CMOS process and occupy a 1.26 mm2 area. The measured results show that the current driver supplies a relatively high current (>600 μApp) and achieves a high output impedance (1 MΩ at 500 kHz). The ETI system can detect resistance and capacitance in the ranges of 10 mΩ-3 kΩ and 100 nF-100 μF, respectively. The ECG/ETI system consumes 3.6 mW using a single 1.8 V supply.
Collapse
|
7
|
Xu J, Pan J, Cui T, Zhang S, Yang Y, Ren TL. Recent Progress of Tactile and Force Sensors for Human-Machine Interaction. SENSORS (BASEL, SWITZERLAND) 2023; 23:1868. [PMID: 36850470 PMCID: PMC9961639 DOI: 10.3390/s23041868] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/23/2023] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
Human-Machine Interface (HMI) plays a key role in the interaction between people and machines, which allows people to easily and intuitively control the machine and immersively experience the virtual world of the meta-universe by virtual reality/augmented reality (VR/AR) technology. Currently, wearable skin-integrated tactile and force sensors are widely used in immersive human-machine interactions due to their ultra-thin, ultra-soft, conformal characteristics. In this paper, the recent progress of tactile and force sensors used in HMI are reviewed, including piezoresistive, capacitive, piezoelectric, triboelectric, and other sensors. Then, this paper discusses how to improve the performance of tactile and force sensors for HMI. Next, this paper summarizes the HMI for dexterous robotic manipulation and VR/AR applications. Finally, this paper summarizes and proposes the future development trend of HMI.
Collapse
Affiliation(s)
- Jiandong Xu
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Jiong Pan
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Tianrui Cui
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Sheng Zhang
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
| | - Yi Yang
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
| | - Tian-Ling Ren
- School of Integrated Circuits and Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing 100084, China
- Center for Flexible Electronics Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
8
|
Guo J, Guo C, Zhou J, Duan K, Wang Q. Flexible Capacitive Sensing and Ultrasound Calibration for Skeletal Muscle Deformations. Soft Robot 2022. [DOI: 10.1089/soro.2022.0065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Affiliation(s)
- Jiajie Guo
- State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Chuxuan Guo
- State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Jialei Zhou
- State Key Laboratory of Digital Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Kui Duan
- Huazhong University of Science and Technology, School Hospital, Wuhan, China
| | - Qining Wang
- Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China
| |
Collapse
|
9
|
Wang T, Zhao Y, Wang Q. A Flexible Iontronic Capacitive Sensing Array for Hand Gesture Recognition Using Deep Convolutional Neural Networks. Soft Robot 2022. [DOI: 10.1089/soro.2021.0209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Affiliation(s)
- Tiantong Wang
- Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, Beijing, China
| | - Yunbiao Zhao
- Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, Beijing, China
| | - Qining Wang
- Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China
- Beijing Engineering Research Center of Intelligent Rehabilitation Engineering, Beijing, China
- Institute for Artificial Intelligence, Peking University, Beijing, China
- Beijing Institute for General Artificial Intelligence, Beijing, China
| |
Collapse
|
10
|
Alraho S, Zaman Q, Abd H, König A. Integrated Sensor Electronic Front-Ends with Self-X Capabilities. CHIPS 2022; 1:83-120. [DOI: 10.3390/chips1020008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
The ongoing vivid advance in integration technologies is giving leverage both to computing systems as well as to sensors and sensor systems. Both conventional computing systems as well as innovative computing systems, e.g., following bio-inspiration from nervous systems or neural networks, require efficient interfacing to an increasing diversity of sensors under the constraints of metrology. The realization of sufficiently accurate, robust, and flexible analog front-ends (AFE) is decisive for the overall application system and quality and requires substantial design expertise both for cells in System-on-Chip (SoC) or chips in System-in-Package (SiP) realizations. Adding robustness and flexibility to sensory systems, e.g., for Industry 4.0., by self-X or self-* features, e.g., self-monitoring, -trimming, or -healing (AFEX) approaches the capabilities met in living beings and is pursued in our research. This paper summarizes on two chips, denoted as Universal-Sensor-Interface-with-self-X-properties (USIX) based on amplitude representation and reports on recently identified challenges and corresponding advanced solutions, e.g., on circuit assessment as well as observer robustness for classic amplitude-based AFE, and transition activities to spike domain representation spiking-analog-front-ends with self-X properties (SAFEX) based on adaptive spiking electronics as the next evolutionary step in AFE development. Key cells for AFEX and SAFEX have been designed in XFAB xh035 CMOS technology and have been subject to extrinsic optimization and/or adaptation. The submitted chip features 62,921 transistors, a total area of 10.89 mm2 (74% analog, 26% digital), and 66 bytes of the configuration memory. The prepared demonstrator will allow intrinsic optimization and/or adaptation for the developed technology agnostic concepts and chip instances. In future work, confirmed cells will be moved to complete versatile and robust AFEs, which can serve both for conventional as well as innovative computing systems, e.g., spiking neurocomputers, as well as to leading-edge technologies to serve in SOCs.
Collapse
|
11
|
Electrical Impedance Tomography for Hand Gesture Recognition for HMI Interaction Applications. JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS 2022. [DOI: 10.3390/jlpea12030041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Electrical impedance tomography (EIT) is based on the physical principle of bioimpedance defined as the opposition that biological tissues exhibit to the flow of a rotating alternating electrical current. Consequently, here, we propose studying the characterization and classification of bioimpedance patterns based on EIT by measuring, on the forearm with eight electrodes in a non-invasive way, the potential drops resulting from the execution of six hand gestures. The starting point was the acquisition of bioimpedance patterns studied by means of principal component analysis (PCA), validated through the cross-validation technique, and classified using the k-nearest neighbor (kNN) classification algorithm. As a result, it is concluded that reduction and classification is feasible, with a sensitivity of 0.89 in the worst case, for each of the reduced bioimpedance patterns, leading to the following direct advantage: a reduction in the numbers of electrodes and electronics required. In this work, bioimpedance patterns were investigated for monitoring subjects’ mobility, where, generally, these solutions are based on a sensor system with moving parts that suffer from significant problems of wear, lack of adaptability to the patient, and lack of resolution. Whereas, the proposal implemented in this prototype, based on the so-called electrical impedance tomography, does not have these problems.
Collapse
|
12
|
Park K, Yuk H, Yang M, Cho J, Lee H, Kim J. A biomimetic elastomeric robot skin using electrical impedance and acoustic tomography for tactile sensing. Sci Robot 2022; 7:eabm7187. [PMID: 35675452 DOI: 10.1126/scirobotics.abm7187] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Human skin perceives physical stimuli applied to the body and mitigates the risk of physical interaction through its soft and resilient mechanical properties. Social robots would benefit from whole-body robotic skin (or tactile sensors) resembling human skin in realizing a safe, intuitive, and contact-rich human-robot interaction. However, existing soft tactile sensors show several drawbacks (complex structure, poor scalability, and fragility), which limit their application in whole-body robotic skin. Here, we introduce biomimetic robotic skin based on hydrogel-elastomer hybrids and tomographic imaging. The developed skin consists of a tough hydrogel and a silicone elastomer forming a skin-inspired multilayer structure, achieving sufficient softness and resilience for protection. The sensor structure can also be easily repaired with adhesives even after severe damage (incision). For multimodal tactile sensation, electrodes and microphones are deployed in the sensor structure to measure local resistance changes and vibration due to touch. The ionic hydrogel layer is deformed owing to an external force, and the resulting local conductivity changes are measured via electrodes. The microphones also detect the vibration generated from touch to determine the location and type of dynamic tactile stimuli. The measurement data are then converted into multimodal tactile information through tomographic imaging and deep neural networks. We further implement a sensorized cosmetic prosthesis, demonstrating that our design could be used to implement deformable or complex-shaped robotic skin.
Collapse
Affiliation(s)
- K Park
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - H Yuk
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - M Yang
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - J Cho
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| | - H Lee
- Institute of Smart Sensors, University of Stuttgart, Stuttgart, Germany
| | - J Kim
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea
| |
Collapse
|
13
|
Wang J, Chen YH, Yang J, Sawan M. Intelligent Classification Technique of Hand Motor Imagery Using EEG Beta Rebound Follow-Up Pattern. BIOSENSORS 2022; 12:bios12060384. [PMID: 35735532 PMCID: PMC9221354 DOI: 10.3390/bios12060384] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 05/18/2022] [Accepted: 05/20/2022] [Indexed: 11/16/2022]
Abstract
To apply EEG-based brain-machine interfaces during rehabilitation, separating various tasks during motor imagery (MI) and assimilating MI into motor execution (ME) are needed. Previous studies were focusing on classifying different MI tasks based on complex algorithms. In this paper, we implement intelligent, straightforward, comprehensible, time-efficient, and channel-reduced methods to classify ME versus MI and left- versus right-hand MI. EEG of 30 healthy participants undertaking motional tasks is recorded to investigate two classification tasks. For the first task, we first propose a “follow-up” pattern based on the beta rebound. This method achieves an average classification accuracy of 59.77% ± 11.95% and can be up to 89.47% for finger-crossing. Aside from time-domain information, we map EEG signals to feature space using extraction methods including statistics, wavelet coefficients, average power, sample entropy, and common spatial patterns. To evaluate their practicability, we adopt a support vector machine as an intelligent classifier model and sparse logistic regression as a feature selection technique and achieve 79.51% accuracy. Similar approaches are taken for the second classification reaching 75.22% accuracy. The classifiers we propose show high accuracy and intelligence. The achieved results make our approach highly suitable to be applied to the rehabilitation of paralyzed limbs.
Collapse
Affiliation(s)
- Jiachen Wang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-Chips Neurotechnologies (CenBRAIN Neurotech), School of Engineering, Westlake University, Hangzhou 310024, China; (J.W.); (J.Y.)
| | - Yun-Hsuan Chen
- Center of Excellence in Biomedical Research on Advanced Integrated-on-Chips Neurotechnologies (CenBRAIN Neurotech), School of Engineering, Westlake University, Hangzhou 310024, China; (J.W.); (J.Y.)
- Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou 310024, China
- Correspondence: (Y.-H.C.); (M.S.)
| | - Jie Yang
- Center of Excellence in Biomedical Research on Advanced Integrated-on-Chips Neurotechnologies (CenBRAIN Neurotech), School of Engineering, Westlake University, Hangzhou 310024, China; (J.W.); (J.Y.)
- Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou 310024, China
| | - Mohamad Sawan
- Center of Excellence in Biomedical Research on Advanced Integrated-on-Chips Neurotechnologies (CenBRAIN Neurotech), School of Engineering, Westlake University, Hangzhou 310024, China; (J.W.); (J.Y.)
- Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou 310024, China
- Correspondence: (Y.-H.C.); (M.S.)
| |
Collapse
|
14
|
Kweon SJ, Rafi AK, Cheon SI, Je M, Ha S. On-Chip Sinusoidal Signal Generators for Electrical Impedance Spectroscopy: Methodological Review. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:337-360. [PMID: 35482701 DOI: 10.1109/tbcas.2022.3171163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This paper reviews architectures and circuit implementations of on-chip sinusoidal signal generators (SSGs) for electrical impedance spectroscopy (EIS) applications. In recent years, there have been increasing interests in on-chip EIS systems, which measure a target material's impedance spectrum over a frequency range. The on-chip implementation allows EIS systems to have low power and small form factor, enabling various biomedical applications. One of the key building blocks of on-chip EIS systems is on-chip SSG, which determines the frequency range and the analysis precision of the whole EIS system. On-chip SSGs are generally required to have high linearity, wide frequency range, and high power and area efficiency. They are typically composed of three stages in general: waveform generation, linearity enhancement, and current injection. First, a sinusoidal waveform should be generated in SSGs. The generated waveform's frequency should be accurately adjustable over a wide range. The firstly generated waveform may not be perfectly linear, including unwanted harmonics. In the following linearity-enhancement step, these harmonics are attenuated by using filters typically. As the linearity of the waveform is improved, the precision of the EIS system gets ensured. Lastly, the filtered voltage waveform is now converted to a current by a current driver. Then, the current sinusoidal signal is injected into the target impedance. This review discusses the principles, advantages, and disadvantages of various techniques applied to each step in state-of-the-art on-chip SSGs. In addition, state-of-the-art designs are compared and summarized.
Collapse
|
15
|
Briko A, Kapravchuk V, Kobelev A, Hammoud A, Leonhardt S, Ngo C, Gulyaev Y, Shchukin S. A Way of Bionic Control Based on EI, EMG, and FMG Signals. SENSORS 2021; 22:s22010152. [PMID: 35009694 PMCID: PMC8747574 DOI: 10.3390/s22010152] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/07/2021] [Accepted: 12/22/2021] [Indexed: 01/24/2023]
Abstract
Creating highly functional prosthetic, orthotic, and rehabilitation devices is a socially relevant scientific and engineering task. Currently, certain constraints hamper the development of such devices. The primary constraint is the lack of an intuitive and reliable control interface working between the organism and the actuator. The critical point in developing these devices and systems is determining the type and parameters of movements based on control signals recorded on an extremity. In the study, we investigate the simultaneous acquisition of electric impedance (EI), electromyography (EMG), and force myography (FMG) signals during basic wrist movements: grasping, flexion/extension, and rotation. For investigation, a laboratory instrumentation and software test setup were made for registering signals and collecting data. The analysis of the acquired signals revealed that the EI signals in conjunction with the analysis of EMG and FMG signals could potentially be highly informative in anthropomorphic control systems. The study results confirm that the comprehensive real-time analysis of EI, EMG, and FMG signals potentially allows implementing the method of anthropomorphic and proportional control with an acceptable delay.
Collapse
Affiliation(s)
- Andrey Briko
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, 105005 Moscow, Russia; (V.K.); (A.K.); (A.H.); (S.S.)
- Correspondence: ; Tel.: +7-903-261-60-14
| | - Vladislava Kapravchuk
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, 105005 Moscow, Russia; (V.K.); (A.K.); (A.H.); (S.S.)
| | - Alexander Kobelev
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, 105005 Moscow, Russia; (V.K.); (A.K.); (A.H.); (S.S.)
| | - Ahmad Hammoud
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, 105005 Moscow, Russia; (V.K.); (A.K.); (A.H.); (S.S.)
| | - Steffen Leonhardt
- Medical Information Technology, RWTH Aachen University, 52074 Aachen, Germany; (S.L.); (C.N.)
| | - Chuong Ngo
- Medical Information Technology, RWTH Aachen University, 52074 Aachen, Germany; (S.L.); (C.N.)
| | - Yury Gulyaev
- Kotelnikov Institute of Radioengineering and Electronics (IRE) of Russian Academy of Sciences, 125009 Moscow, Russia;
| | - Sergey Shchukin
- Department of Medical and Technical Information Technology, Bauman Moscow State Technical University, 105005 Moscow, Russia; (V.K.); (A.K.); (A.H.); (S.S.)
| |
Collapse
|
16
|
Lu X, Sun S, Liu K, Sun J, Xu L. Development of a Wearable Gesture Recognition System Based on Two-terminal Electrical Impedance Tomography. IEEE J Biomed Health Inform 2021; 26:2515-2523. [PMID: 34818198 DOI: 10.1109/jbhi.2021.3130374] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper proposes a low-cost, wearable gesture recognition system based on the two-terminal electrical impedance tomography (EIT) technique. The system includes a wearable EIT sensor of eight electrodes, a hardware device, and gesture recognition software running on a PC. Nine different gestures can be stably identified from the measured impedance changes through machine learning algorithms. Experimental results show that the Quadric Discriminator algorithm has the highest recognition rate of 98.49% for the filtered validation set. Besides, the recognition results in the two-terminal mode and transformed four-terminal mode are compared by applying a two-to-four-terminal mapping to the two-terminal EIT system, and the recognition rate decreases with the most classification models in the latter mode. Thus, it is supposed that contact impedance plays an important role in gesture recognition. By analyzing the data characteristics with variance inflation factor (VIF) test and principal component analysis (PCA), the supposition is explained and verified, proving the merit of a two-terminal EIT system in gesture recognition.
Collapse
|
17
|
Liu X, Li J, Mao W, Chen Z, Chen Z, Wan P, Yu H. A Charge Balanced Neural Stimulator Silicon Chip for Human-Machine Interface. FRONTIERS IN ELECTRONICS 2021. [DOI: 10.3389/felec.2021.773812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
This paper proposes a neural stimulator silicon chip design with an improved charge balancing technology. The proposed neural stimulation integrated circuit (IC) uses two charge balancing modules including synchronous charge detection module and short-time pulse insertion module. The synchronous charge detection module is designed based on a current splitter with ultra-small output current and an integrator circuit for neural stimulation pulse width control, which greatly reduces the residual charge remained on the electrode-tissue interface. The short-time pulse insertion module is designed based on the electrode voltage detection and compensation current control, which further reduces the accumulated residual charge and keeps the electrode voltage within a safety range of ±25 mV during multiple stimulation cycles. Finally, this neural stimulator is implemented in TSMC 0.18-μm CMOS process technology, and the chip function is tested and verified in both experiments with the electrode-tissue RC model and the PBS saline solution environment. The measurement result shows the neural stimulator chip achieves improved charge balancing with the residual charge smaller than 0.95 nC, which is the lowest compared to the traditional neural stimulator chips.
Collapse
|
18
|
Zheng E, Zhang J, Wang Q, Qiao H. Continuous Multi-DoF Wrist Kinematics Estimation Based on a Human-Machine Interface With Electrical-Impedance-Tomography. Front Neurorobot 2021; 15:734525. [PMID: 34658831 PMCID: PMC8515921 DOI: 10.3389/fnbot.2021.734525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 08/16/2021] [Indexed: 11/21/2022] Open
Abstract
This study proposed a multiple degree-of-freedom (DoF) continuous wrist angle estimation approach based on an electrical impedance tomography (EIT) interface. The interface can inspect the spatial information of deep muscles with a soft elastic fabric sensing band, extending the measurement scope of the existing muscle-signal-based sensors. The designed estimation algorithm first extracted the mutual correlation of the EIT regions with a kernel function, and second used a regularization procedure to select the optimal coefficients. We evaluated the method with different features and regression models on 12 healthy subjects when they performed six basic wrist joint motions. The average root-mean-square error of the 3-DoF estimation task was 7.62°, and the average R2 was 0.92. The results are comparable to state-of-the-art with sEMG signals in multi-DoF tasks. Future endeavors will be paid in this new direction to get more promising results.
Collapse
Affiliation(s)
- Enhao Zheng
- The State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Jingzhi Zhang
- The State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China.,School of General Engineering, Beihang University, Beijing, China
| | - Qining Wang
- Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, Beijing, China
| | - Hong Qiao
- The State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
19
|
Esposito D, Centracchio J, Andreozzi E, Gargiulo GD, Naik GR, Bifulco P. Biosignal-Based Human-Machine Interfaces for Assistance and Rehabilitation: A Survey. SENSORS 2021; 21:s21206863. [PMID: 34696076 PMCID: PMC8540117 DOI: 10.3390/s21206863] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 09/30/2021] [Accepted: 10/12/2021] [Indexed: 12/03/2022]
Abstract
As a definition, Human–Machine Interface (HMI) enables a person to interact with a device. Starting from elementary equipment, the recent development of novel techniques and unobtrusive devices for biosignals monitoring paved the way for a new class of HMIs, which take such biosignals as inputs to control various applications. The current survey aims to review the large literature of the last two decades regarding biosignal-based HMIs for assistance and rehabilitation to outline state-of-the-art and identify emerging technologies and potential future research trends. PubMed and other databases were surveyed by using specific keywords. The found studies were further screened in three levels (title, abstract, full-text), and eventually, 144 journal papers and 37 conference papers were included. Four macrocategories were considered to classify the different biosignals used for HMI control: biopotential, muscle mechanical motion, body motion, and their combinations (hybrid systems). The HMIs were also classified according to their target application by considering six categories: prosthetic control, robotic control, virtual reality control, gesture recognition, communication, and smart environment control. An ever-growing number of publications has been observed over the last years. Most of the studies (about 67%) pertain to the assistive field, while 20% relate to rehabilitation and 13% to assistance and rehabilitation. A moderate increase can be observed in studies focusing on robotic control, prosthetic control, and gesture recognition in the last decade. In contrast, studies on the other targets experienced only a small increase. Biopotentials are no longer the leading control signals, and the use of muscle mechanical motion signals has experienced a considerable rise, especially in prosthetic control. Hybrid technologies are promising, as they could lead to higher performances. However, they also increase HMIs’ complexity, so their usefulness should be carefully evaluated for the specific application.
Collapse
Affiliation(s)
- Daniele Esposito
- Department of Electrical Engineering and Information Technologies, Polytechnic and Basic Sciences School, University of Naples “Federico II”, 80125 Naples, Italy; (D.E.); (J.C.); (E.A.); (P.B.)
| | - Jessica Centracchio
- Department of Electrical Engineering and Information Technologies, Polytechnic and Basic Sciences School, University of Naples “Federico II”, 80125 Naples, Italy; (D.E.); (J.C.); (E.A.); (P.B.)
| | - Emilio Andreozzi
- Department of Electrical Engineering and Information Technologies, Polytechnic and Basic Sciences School, University of Naples “Federico II”, 80125 Naples, Italy; (D.E.); (J.C.); (E.A.); (P.B.)
| | - Gaetano D. Gargiulo
- School of Engineering, Design and Built Environment, Western Sydney University, Penrith, NSW 2747, Australia;
- The MARCS Institute, Western Sydney University, Penrith, NSW 2751, Australia
| | - Ganesh R. Naik
- School of Engineering, Design and Built Environment, Western Sydney University, Penrith, NSW 2747, Australia;
- The Adelaide Institute for Sleep Health, Flinders University, Bedford Park, SA 5042, Australia
- Correspondence:
| | - Paolo Bifulco
- Department of Electrical Engineering and Information Technologies, Polytechnic and Basic Sciences School, University of Naples “Federico II”, 80125 Naples, Italy; (D.E.); (J.C.); (E.A.); (P.B.)
| |
Collapse
|
20
|
Leins DP, Gibas C, Brück R, Haschke R. Toward More Robust Hand Gesture Recognition on EIT Data. Front Neurorobot 2021; 15:659311. [PMID: 34456704 PMCID: PMC8385652 DOI: 10.3389/fnbot.2021.659311] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 07/19/2021] [Indexed: 11/13/2022] Open
Abstract
Striving for more robust and natural control of multi-fingered hand prostheses, we are studying electrical impedance tomography (EIT) as a method to monitor residual muscle activations. Previous work has shown promising results for hand gesture recognition, but also lacks generalization across multiple sessions and users. Thus, the present paper aims for a detailed analysis of an existing EIT dataset acquired with a 16-electrode wrist band as a prerequisite for further improvements of machine learning results on this type of signal. The performed t-SNE analysis confirms a much stronger inter-session and inter-user variance compared to the expected in-class variance. Additionally, we observe a strong drift of signals within a session. To handle these challenging problems, we propose new machine learning architectures based on deep learning, which allow to separate undesired from desired variation and thus significantly improve the classification accuracy. With these new architectures we increased cross-session classification accuracy on 12 gestures from 19.55 to 30.45%. Based on a fundamental data analysis we developed three calibration methods and thus were able to further increase cross-session classification accuracy to 39.01, 55.37, and 56.34%, respectively.
Collapse
Affiliation(s)
- David P Leins
- Research Institute Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| | - Christian Gibas
- Medical Informatics and Microsytems Engineering, Faculty of Life Sciences, University of Siegen, Siegen, Germany
| | - Rainer Brück
- Medical Informatics and Microsytems Engineering, Faculty of Life Sciences, University of Siegen, Siegen, Germany
| | - Robert Haschke
- Research Institute Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
21
|
Zheng E, Wan J, Yang L, Wang Q, Qiao H. Wrist Angle Estimation With a Musculoskeletal Model Driven by Electrical Impedance Tomography Signals. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3060400] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
22
|
Development of a Portable, Reliable and Low-Cost Electrical Impedance Tomography System Using an Embedded System. ELECTRONICS 2020. [DOI: 10.3390/electronics10010015] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Electrical impedance tomography (EIT) is a useful procedure with applications in industry and medicine, particularly in the lungs and brain area. In this paper, the development of a portable, reliable and low-cost EIT system for image reconstruction by using an embedded system (ES) is introduced herein. The novelty of this article is the hardware development of a complete low-cost EIT system, as well as three simple and efficient algorithms that can be implemented on ES. The proposed EIT system applies the adjacent voltage method, starting with an impedance acquisition stage that sends data to a Raspberry Pi 4 (RPi4) as ES. To perform the image reconstruction, a user interface was developed by using GNU Octave for RPi4 and the EIDORS library. A statistical analysis is performed to determine the best average value from the samples measured by using an analog-to-digital converter (ADC) with a capacity of 30 kSPS and 24-bit resolution. The tests for the proposed EIT system were performed using materials such as metal, glass and an orange to simulate its application in food industry. Experimental results show that the statistical median is more accurate with respect to the real voltage measurement; however, it represents a higher computational cost. Therefore, the mean is calculated and improved by discarding data values in a transitory state, achieving better accuracy than the median to determine the real voltage value, enhancing the quality of the reconstructed images. A performance comparison between a personal computer (PC) and RPi4 is presented. The proposed EIT system offers an excellent cost-benefit ratio with respect to a traditional PC, taking into account precision, accuracy, energy consumption, price, light weight, size, portability and reliability. The proposed EIT system has potential application in mechanical ventilation, food industry and structural health monitoring.
Collapse
|
23
|
Rzecki K. Classification Algorithm for Person Identification and Gesture Recognition Based on Hand Gestures with Small Training Sets. SENSORS (BASEL, SWITZERLAND) 2020; 20:E7279. [PMID: 33353008 PMCID: PMC7766068 DOI: 10.3390/s20247279] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 12/11/2020] [Accepted: 12/15/2020] [Indexed: 11/16/2022]
Abstract
Classification algorithms require training data initially labelled by classes to build a model and then to be able to classify the new data. The amount and diversity of training data affect the classification quality and usually the larger the training set, the better the accuracy of classification. In many applications only small amounts of training data are available. This article presents a new time series classification algorithm for problems with small training sets. The algorithm was tested on hand gesture recordings in tasks of person identification and gesture recognition. The algorithm provides significantly better classification accuracy than other machine learning algorithms. For 22 different hand gestures performed by 10 people and the training set size equal to 5 gesture execution records per class, the error rate for the newly proposed algorithm is from 37% to 75% lower than for the other compared algorithms. When the training set consists of only one sample per class the new algorithm reaches from 45% to 95% lower error rate. Conducted experiments indicate that the algorithm outperforms state-of-the-art methods in terms of classification accuracy in the problem of person identification and gesture recognition.
Collapse
Affiliation(s)
- Krzysztof Rzecki
- AGH University of Science and Technology, 30 Mickiewicz Ave., 30-059 Kraków, Poland
| |
Collapse
|
24
|
Wu Y, Jiang D, Habibollahi M, Almarri N, Demosthenous A. Time Stamp - A Novel Time-to-Digital Demodulation Method for Bioimpedance Implant Applications. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2020; 14:997-1007. [PMID: 32746362 DOI: 10.1109/tbcas.2020.3012057] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Bioimpedance analysis is a noninvasive and inexpensive technology used to investigate the electrical properties of biological tissues. The analysis requires demodulation to extract the real and imaginary parts of the impedance. Conventional systems use complex architectures such as I-Q demodulation. In this paper, a very simple alternative time-to-digital demodulation method or 'time stamp' is proposed. It employs only three comparators to identify or stamp in the time domain, the crossing points of the excitation signal, and the measured signal. In a CMOS proof of concept design, the accuracy of impedance magnitude and phase is 97.06% and 98.81% respectively over a bandwidth of 10 kHz to 500 kHz. The effect of fractional-N synthesis is analysed for the counter-based zero crossing phase detector obtaining a finer phase resolution (0.51˚ at 500 kHz) using a counter clock frequency ( fclk = 12.5 MHz). Because of its circuit simplicity and ease of transmitting the time stamps, the method is very suited to implantable devices requiring low area and power consumption.
Collapse
|
25
|
Grushko S, Spurný T, Černý M. Control Methods for Transradial Prostheses Based on Remnant Muscle Activity and Its Relationship with Proprioceptive Feedback. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4883. [PMID: 32872291 PMCID: PMC7506660 DOI: 10.3390/s20174883] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 08/24/2020] [Accepted: 08/25/2020] [Indexed: 02/07/2023]
Abstract
The loss of a hand can significantly affect one's work and social life. For many patients, an artificial limb can improve their mobility and ability to manage everyday activities, as well as provide the means to remain independent. This paper provides an extensive review of available biosensing methods to implement the control system for transradial prostheses based on the measured activity in remnant muscles. Covered techniques include electromyography, magnetomyography, electrical impedance tomography, capacitance sensing, near-infrared spectroscopy, sonomyography, optical myography, force myography, phonomyography, myokinetic control, and modern approaches to cineplasty. The paper also covers combinations of these approaches, which, in many cases, achieve better accuracy while mitigating the weaknesses of individual methods. The work is focused on the practical applicability of the approaches, and analyses present challenges associated with each technique along with their relationship with proprioceptive feedback, which is an important factor for intuitive control over the prosthetic device, especially for high dexterity prosthetic hands.
Collapse
Affiliation(s)
- Stefan Grushko
- Department of Robotics, VSB-Technical University of Ostrava, 70800 Ostrava, Czech Republic; (T.S.); (M.Č.)
| | | | | |
Collapse
|
26
|
Wu C, Soleimani M. In-water handwriting in multi-medium using electrical impedance imaging. IOP SCINOTES 2020. [DOI: 10.1088/2633-1357/ab9724] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Abstract
A novel approach to human–computer interaction, in water handwriting is presented in this work. The novel handwriting method is based on tomographic imaging of electrical resistivity changes. The new method allows the users to write inside of a water ball in a natural, unconstrained way. In-water handwriting suffers no friction and allows handwriting or drawing in a more relaxed way. This work shows how an electrical impedance tomography (EIT) system and sensor/phantom can be used to create a robust handwriting in water. It is well known that EIT has low special resolution but offers a very good functional imaging with high temporal resolution. The work shows an example of a good quality functional imaging aspect of the EIT in a novel human computer interface (HCI) application. Although it is almost impossible to produce images of letters or complex shapes using EIT sensor, it is totally possible to produce the same using many EIT frames. The system used in this study has a frame rate of 15 frames per second so the actual handwriting of letters and shapes can be done without noticing any delays. Analysis of image similarity between actual handwriting and the one follow the EIT scheme shows a good correlation.
Collapse
|
27
|
Ma G, Hao Z, Wu X, Wang X. An Optimal Electrical Impedance Tomography Drive Pattern for Human-Computer Interaction Applications. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2020; 14:402-411. [PMID: 31976903 DOI: 10.1109/tbcas.2020.2967785] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
In this article, we presented an optimal Electrical Impedance Tomography (EIT) drive pattern based on feature selection and model explanation, and proposed a portable EIT system for applications in human-computer interaction for gesture recognition and contact detection, which can reduce the measurement time and realize a performance trade-off between the accuracy and the time response. In our experiment, eleven hand gestures were designed to verify the proposed approach and EIT system. Compared to the traditional eight-electrode method, the optimal electrode drive pattern achieved a recognition accuracy of 97.5% with seven electrodes and the measurement time was reduced by 60%. To illustrate the universality of this method, we performed a contact detection experiment. By setting seven labels on the conductive panel and using optimal electrode drive pattern, the detection accuracy reached 100% with seven electrodes and the measurement time was reduced by 85%.
Collapse
|
28
|
Wu Y, Jiang D, Bardill A, Bayford R, Demosthenous A. A 122 fps, 1 MHz Bandwidth Multi-Frequency Wearable EIT Belt Featuring Novel Active Electrode Architecture for Neonatal Thorax Vital Sign Monitoring. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2019; 13:927-937. [PMID: 31283510 DOI: 10.1109/tbcas.2019.2925713] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
A highly integrated, wearable electrical impedance tomography (EIT) belt for neonatal thorax vital multiple sign monitoring is presented. The belt has 16 active electrodes. Each electrode has an application-specific integrated circuit (ASIC) connected to it. The ASIC contains a fully differential current driver, a high-performance instrumentation amplifier, a digital controller, and multiplexors. The belt features a new active electrode architecture that allows programmable flexible electrode current drive and voltage sense patterns under simple digital control. It provides intimate connections to the electrodes for the current drive and to the IA for direct differential voltage measurement, providing superior common-mode rejection ratio. The ASIC was designed in a CMOS 0.35-μm high-voltage technology. The high-specification EIT belt has an image frame rate of 122 fps, a wide operating bandwidth of 1 MHz, and multi-frequency operation. It measures impedance with 98% accuracy and has less than 0.5 Ω and 1° variation across all possible channels. The image results confirmed the advantage of the new active electrode architecture and the benefit of wideband, multi-frequency EIT operation. The system successfully captured high-quality lung-respiration EIT images, breathing cycle, and heart rate. It can also provide boundary-shape information by using an array of MEMS sensors interfaced to the ASICs.
Collapse
|
29
|
Liu B, Wang G, Li Y, Zeng L, Li H, Gao Y, Ma Y, Lian Y, Heng CH. A 13-Channel 1.53-mW 11.28-mm 2 Electrical Impedance Tomography SoC Based on Frequency Division Multiplexing for Lung Physiological Imaging. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2019; 13:938-949. [PMID: 31331896 DOI: 10.1109/tbcas.2019.2927132] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
An electrical impedance tomography (EIT) system based on frequency division multiplexing (FDM) is proposed for real-time lung physiological imaging. The FDM technique allows the integration of 13 dedicated voltage sensing channels by combining data on-chip and sharing of ADC to alleviate area penalty caused by multi-channel. The EIT system-on-chip (SoC) is of the following features. 1) Early I/Q demodulation to relax the bandwidth requirement of analog front end and minimize the impact of motion artifacts and dc electrode offset. 2) Eliminates the need of adaptive gain control with constant inverted "U-shape" gain configuration to compensate amplitude variations across all channels. 3) FDM to combine 13 pairs of I/Q signals into two data streams for quantization using only two ΔΣ modulators. 4) Batch data recovery by Blackman window corrected fast Fourier transform without any digital filtering involved. 5) Lowest power consumption and smallest area occupation per channel reported to date. The EIT SoC occupies an area of 11.28 mm2 in 130-nm CMOS technology with a total power consumption of 1.53 mW under 1-V power supply. As a result, it generates lung EIT images at up to five frames per second.
Collapse
|
30
|
Analog Integrated Current Drivers for Bioimpedance Applications: A Review. SENSORS 2019; 19:s19040756. [PMID: 30781772 PMCID: PMC6412483 DOI: 10.3390/s19040756] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Revised: 02/01/2019] [Accepted: 02/04/2019] [Indexed: 11/23/2022]
Abstract
An important component in bioimpedance measurements is the current driver, which can operate over a wide range of impedance and frequency. This paper provides a review of integrated circuit analog current drivers which have been developed in the last 10 years. Important features for current drivers are high output impedance, low phase delay, and low harmonic distortion. In this paper, the analog current drivers are grouped into two categories based on open loop or closed loop designs. The characteristics of each design are identified.
Collapse
|