1
|
Lee J, Miri S, Bayro A, Kim M, Jeong H, Yeo WH. Biosignal-integrated robotic systems with emerging trends in visual interfaces: A systematic review. BIOPHYSICS REVIEWS 2024; 5:011301. [PMID: 38510371 PMCID: PMC10903439 DOI: 10.1063/5.0185568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/29/2024] [Indexed: 03/22/2024]
Abstract
Human-machine interfaces (HMI) are currently a trendy and rapidly expanding area of research. Interestingly, the human user does not readily observe the interface between humans and machines. Instead, interactions between the machine and electrical signals from the user's body are obscured by complex control algorithms. The result is effectively a one-way street, wherein data is only transmitted from human to machine. Thus, a gap remains in the literature: how can information be effectively conveyed to the user to enable mutual understanding between humans and machines? Here, this paper reviews recent advancements in biosignal-integrated wearable robotics, with a particular emphasis on "visualization"-the presentation of relevant data, statistics, and visual feedback to the user. This review article covers various signals of interest, such as electroencephalograms and electromyograms, and explores novel sensor architectures and key materials. Recent developments in wearable robotics are examined from control and mechanical design perspectives. Additionally, we discuss current visualization methods and outline the field's future direction. While much of the HMI field focuses on biomedical and healthcare applications, such as rehabilitation of spinal cord injury and stroke patients, this paper also covers less common applications in manufacturing, defense, and other domains.
Collapse
Affiliation(s)
| | - Sina Miri
- Department of Mechanical and Industrial Engineering, The University of Illinois at Chicago, Chicago, Illinois 60607, USA
| | - Allison Bayro
- School of Biological and Health Systems Engineering, Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, Arizona 85287, USA
| | - Myunghee Kim
- Department of Mechanical and Industrial Engineering, The University of Illinois at Chicago, Chicago, Illinois 60607, USA
| | - Heejin Jeong
- Authors to whom correspondence should be addressed:; ; and
| | - Woon-Hong Yeo
- Authors to whom correspondence should be addressed:; ; and
| |
Collapse
|
2
|
Meyer L, Araiza-Illan G, Rachman L, Gaudrain E, Başkent D. Evaluating speech-in-speech perception via a humanoid robot. Front Neurosci 2024; 18:1293120. [PMID: 38406584 PMCID: PMC10884269 DOI: 10.3389/fnins.2024.1293120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/15/2024] [Indexed: 02/27/2024] Open
Abstract
Introduction Underlying mechanisms of speech perception masked by background speakers, a common daily listening condition, are often investigated using various and lengthy psychophysical tests. The presence of a social agent, such as an interactive humanoid NAO robot, may help maintain engagement and attention. However, such robots potentially have limited sound quality or processing speed. Methods As a first step toward the use of NAO in psychophysical testing of speech- in-speech perception, we compared normal-hearing young adults' performance when using the standard computer interface to that when using a NAO robot to introduce the test and present all corresponding stimuli. Target sentences were presented with colour and number keywords in the presence of competing masker speech at varying target-to-masker ratios. Sentences were produced by the same speaker, but voice differences between the target and masker were introduced using speech synthesis methods. To assess test performance, speech intelligibility and data collection duration were compared between the computer and NAO setups. Human-robot interaction was assessed using the Negative Attitude Toward Robot Scale (NARS) and quantification of behavioural cues (backchannels). Results Speech intelligibility results showed functional similarity between the computer and NAO setups. Data collection durations were longer when using NAO. NARS results showed participants had a relatively positive attitude toward "situations of interactions" with robots prior to the experiment, but otherwise showed neutral attitudes toward the "social influence" of and "emotions in interaction" with robots. The presence of more positive backchannels when using NAO suggest higher engagement with the robot in comparison to the computer. Discussion Overall, the study presents the potential of the NAO for presenting speech materials and collecting psychophysical measurements for speech-in-speech perception.
Collapse
Affiliation(s)
- Luke Meyer
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| | - Gloria Araiza-Illan
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| | - Laura Rachman
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
- Pento Audiology Centre, Zwolle, Netherlands
| | - Etienne Gaudrain
- Lyon Neuroscience Research Center, CNRS UMR 5292, INSERM UMRS 1028, Université Claude Bernard Lyon 1, Université de Lyon, Lyon, France
| | - Deniz Başkent
- Department of Otorhinolaryngology/Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
- University Medical Center Groningen, W.J. Kolff Institute for Biomedical Engineering and Materials Science, University of Groningen, Groningen, Netherlands
| |
Collapse
|
3
|
Coşkun B, Ay S, Erol Barkana D, Bostanci H, Uzun İ, Oktay AB, Tuncel B, Tarakci D. A physiological signal database of children with different special needs for stress recognition. Sci Data 2023; 10:382. [PMID: 37316526 DOI: 10.1038/s41597-023-02272-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 05/30/2023] [Indexed: 06/16/2023] Open
Abstract
This study presents a new dataset AKTIVES for evaluating the methods for stress detection and game reaction using physiological signals. We collected data from 25 children with obstetric brachial plexus injury, dyslexia, and intellectual disabilities, and typically developed children during game therapy. A wristband was used to record physiological data (blood volume pulse (BVP), electrodermal activity (EDA), and skin temperature (ST)). Furthermore, the facial expressions of children were recorded. Three experts watched the children's videos, and physiological data is labeled "Stress/No Stress" and "Reaction/No Reaction", according to the videos. The technical validation supported high-quality signals and showed consistency between the experts.
Collapse
Affiliation(s)
- Buket Coşkun
- Yeditepe University, Faculty of Engineering, Department of Electrical and Electronics Engineering, Istanbul, 34755, Turkey.
| | - Sevket Ay
- INOSENS Bilisim, Gebze, Kocaeli, 41400, Turkey
| | - Duygun Erol Barkana
- Yeditepe University, Faculty of Engineering, Department of Electrical and Electronics Engineering, Istanbul, 34755, Turkey
| | - Hilal Bostanci
- Istanbul Medipol University, Faculty of Health Sciences, Department of Ergotherapy, Istanbul, 34810, Turkey
| | - İsmail Uzun
- INOSENS Bilisim, Gebze, Kocaeli, 41400, Turkey
| | - Ayse Betul Oktay
- Yildiz Technical University, Faculty of Engineering, Department of Computer Engineering, Istanbul, 34349, Turkey
| | - Basak Tuncel
- Istanbul Medipol University, Faculty of Health Sciences, Department of Ergotherapy, Istanbul, 34810, Turkey
| | - Devrim Tarakci
- Istanbul Medipol University, Faculty of Health Sciences, Department of Ergotherapy, Istanbul, 34810, Turkey
| |
Collapse
|
4
|
A Survey on Recent Advances in Social Robotics. ROBOTICS 2022. [DOI: 10.3390/robotics11040075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Over decades, social robotics has evolved as a concept that presently covers different areas of application, and interacts with different domains in technology, education, medicine and others. Today, it is possible to envision social robots in tasks that were not expected years ago, and that is not only due to the evolution of social robots, but also to the evolution of the vision humans have for them. This survey addresses recent advances in social robotics from different perspectives. Different contexts and areas of application of social robots are addressed, as well as modalities of interaction with humans. Different robotic platforms used in social contexts are shown and discussed. Relationships of social robotics with advances in other technological areas are surveyed, and methods and metrics used for the human evaluation of the interaction with robots are presented. The future of social robotics is also envisioned based on surveyed works and from different points of view.
Collapse
|
5
|
Monoscalco L, Simeoni R, Maccioni G, Giansanti D. Information Security in Medical Robotics: A Survey on the Level of Training, Awareness and Use of the Physiotherapist. Healthcare (Basel) 2022; 10:159. [PMID: 35052322 PMCID: PMC8775601 DOI: 10.3390/healthcare10010159] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 01/03/2022] [Accepted: 01/06/2022] [Indexed: 01/27/2023] Open
Abstract
Cybersecurity is becoming an increasingly important aspect to investigate for the adoption and use of care robots, in term of both patients' safety, and the availability, integrity and privacy of their data. This study focuses on opinions about cybersecurity relevance and related skills for physiotherapists involved in rehabilitation and assistance thanks to the aid of robotics. The goal was to investigate the awareness among insiders about some facets of cybersecurity concerning human-robot interactions. We designed an electronic questionnaire and submitted it to a relevant sample of physiotherapists. The questionnaire allowed us to collect data related to: (i) use of robots and its relationship with cybersecurity in the context of physiotherapy; (ii) training in cybersecurity and robotics for the insiders; (iii) insiders' self-assessment on cybersecurity and robotics in some usage scenarios, and (iv) their experiences of cyber-attacks in this area and proposals for improvement. Besides contributing some specific statistics, the study highlights the importance of both acculturation processes in this field and monitoring initiatives based on surveys. The study exposes direct suggestions for continuation of these types of investigations in the context of scientific societies operating in the rehabilitation and assistance robotics. The study also shows the need to stimulate similar initiatives in other sectors of medical robotics (robotic surgery, care and socially assistive robots, rehabilitation systems, training for health and care workers) involving insiders.
Collapse
Affiliation(s)
- Lisa Monoscalco
- Faculty of Engineering, Tor Vergata University, Via Cracovia, 00133 Rome, Italy;
| | - Rossella Simeoni
- Facoltà di Medicina e Chirurgia, Università Cattolica del Sacro Cuore, Largo Francesco Vito, 1, 00168 Rome, Italy;
| | | | | |
Collapse
|