1
|
Baltieri M, Iizuka H, Witkowski O, Sinapayen L, Suzuki K. Hybrid Life: Integrating biological, artificial, and cognitive systems. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2023; 14:e1662. [PMID: 37403661 DOI: 10.1002/wcs.1662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 05/22/2023] [Accepted: 05/30/2023] [Indexed: 07/06/2023]
Abstract
Artificial life is a research field studying what processes and properties define life, based on a multidisciplinary approach spanning the physical, natural, and computational sciences. Artificial life aims to foster a comprehensive study of life beyond "life as we know it" and toward "life as it could be," with theoretical, synthetic, and empirical models of the fundamental properties of living systems. While still a relatively young field, artificial life has flourished as an environment for researchers with different backgrounds, welcoming ideas, and contributions from a wide range of subjects. Hybrid Life brings our attention to some of the most recent developments within the artificial life community, rooted in more traditional artificial life studies but looking at new challenges emerging from interactions with other fields. Hybrid Life aims to cover studies that can lead to an understanding, from first principles, of what systems are and how biological and artificial systems can interact and integrate to form new kinds of hybrid (living) systems, individuals, and societies. To do so, it focuses on three complementary perspectives: theories of systems and agents, hybrid augmentation, and hybrid interaction. Theories of systems and agents are used to define systems, how they differ (e.g., biological or artificial, autonomous, or nonautonomous), and how multiple systems relate in order to form new hybrid systems. Hybrid augmentation focuses on implementations of systems so tightly connected that they act as a single, integrated one. Hybrid interaction is centered around interactions within a heterogeneous group of distinct living and nonliving systems. After discussing some of the major sources of inspiration for these themes, we will focus on an overview of the works that appeared in Hybrid Life special sessions, hosted by the annual Artificial Life Conference between 2018 and 2022. This article is categorized under: Neuroscience > Cognition Philosophy > Artificial Intelligence Computer Science and Robotics > Robotics.
Collapse
Affiliation(s)
- Manuel Baltieri
- Araya Inc., Tokyo, Japan
- Department of Informatics, University of Sussex, Brighton, UK
| | - Hiroyuki Iizuka
- Faculty of Information Science and Technology, Hokkaido University, Sapporo, Japan
- Center for Human Nature, Artificial Intelligence and Neuroscience (CHAIN), Hokkaido University, Sapporo, Japan
| | - Olaf Witkowski
- Center for Human Nature, Artificial Intelligence and Neuroscience (CHAIN), Hokkaido University, Sapporo, Japan
- Cross Labs, Cross Compass, Kyoto, Japan
- College of Arts and Sciences, University of Tokyo, Tokyo, Japan
| | - Lana Sinapayen
- Sony Computer Science Laboratories, Kyoto, Japan
- National Institute for Basic Biology, Okazaki, Japan
| | - Keisuke Suzuki
- Center for Human Nature, Artificial Intelligence and Neuroscience (CHAIN), Hokkaido University, Sapporo, Japan
| |
Collapse
|
2
|
Rayes RK, Mazorow RN, Mrotek LA, Scheidt RA. Utility and Usability of Two Forms of Supplemental Vibrotactile Kinesthetic Feedback for Enhancing Movement Accuracy and Efficiency in Goal-Directed Reaching. SENSORS (BASEL, SWITZERLAND) 2023; 23:5455. [PMID: 37420621 DOI: 10.3390/s23125455] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 05/25/2023] [Accepted: 06/06/2023] [Indexed: 07/09/2023]
Abstract
Recent advances in wearable sensors and computing have made possible the development of novel sensory augmentation technologies that promise to enhance human motor performance and quality of life in a wide range of applications. We compared the objective utility and subjective user experience for two biologically inspired ways to encode movement-related information into supplemental feedback for the real-time control of goal-directed reaching in healthy, neurologically intact adults. One encoding scheme mimicked visual feedback encoding by converting real-time hand position in a Cartesian frame of reference into supplemental kinesthetic feedback provided by a vibrotactile display attached to the non-moving arm and hand. The other approach mimicked proprioceptive encoding by providing real-time arm joint angle information via the vibrotactile display. We found that both encoding schemes had objective utility in that after a brief training period, both forms of supplemental feedback promoted improved reach accuracy in the absence of concurrent visual feedback over performance levels achieved using proprioception alone. Cartesian encoding promoted greater reductions in target capture errors in the absence of visual feedback (Cartesian: 59% improvement; Joint Angle: 21% improvement). Accuracy gains promoted by both encoding schemes came at a cost in terms of temporal efficiency; target capture times were considerably longer (1.5 s longer) when reaching with supplemental kinesthetic feedback than without. Furthermore, neither encoding scheme yielded movements that were particularly smooth, although movements made with joint angle encoding were smoother than movements with Cartesian encoding. Participant responses on user experience surveys indicate that both encoding schemes were motivating and that both yielded passable user satisfaction scores. However, only Cartesian endpoint encoding was found to have passable usability; participants felt more competent using Cartesian encoding than joint angle encoding. These results are expected to inform future efforts to develop wearable technology to enhance the accuracy and efficiency of goal-directed actions using continuous supplemental kinesthetic feedback.
Collapse
Affiliation(s)
- Ramsey K Rayes
- Joint Department of Biomedical Engineering, Marquette University and the Medical College of Wisconsin, Milwaukee, WI 53233, USA
- Medical School, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Rachel N Mazorow
- Joint Department of Biomedical Engineering, Marquette University and the Medical College of Wisconsin, Milwaukee, WI 53233, USA
| | - Leigh A Mrotek
- Joint Department of Biomedical Engineering, Marquette University and the Medical College of Wisconsin, Milwaukee, WI 53233, USA
| | - Robert A Scheidt
- Joint Department of Biomedical Engineering, Marquette University and the Medical College of Wisconsin, Milwaukee, WI 53233, USA
| |
Collapse
|
3
|
Clawson WP, Levin M. Endless forms most beautiful 2.0: teleonomy and the bioengineering of chimaeric and synthetic organisms. Biol J Linn Soc Lond 2022. [DOI: 10.1093/biolinnean/blac073] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Abstract
The rich variety of biological forms and behaviours results from one evolutionary history on Earth, via frozen accidents and selection in specific environments. This ubiquitous baggage in natural, familiar model species obscures the plasticity and swarm intelligence of cellular collectives. Significant gaps exist in our understanding of the origin of anatomical novelty, of the relationship between genome and form, and of strategies for control of large-scale structure and function in regenerative medicine and bioengineering. Analysis of living forms that have never existed before is necessary to reveal deep design principles of life as it can be. We briefly review existing examples of chimaeras, cyborgs, hybrots and other beings along the spectrum containing evolved and designed systems. To drive experimental progress in multicellular synthetic morphology, we propose teleonomic (goal-seeking, problem-solving) behaviour in diverse problem spaces as a powerful invariant across possible beings regardless of composition or origin. Cybernetic perspectives on chimaeric morphogenesis erase artificial distinctions established by past limitations of technology and imagination. We suggest that a multi-scale competency architecture facilitates evolution of robust problem-solving, living machines. Creation and analysis of novel living forms will be an essential testbed for the emerging field of diverse intelligence, with numerous implications across regenerative medicine, robotics and ethics.
Collapse
Affiliation(s)
| | - Michael Levin
- Allen Discovery Center at Tufts University , Medford, MA , USA
- Wyss Institute for Biologically Inspired Engineering at Harvard University , Boston, MA , USA
| |
Collapse
|
4
|
Distance Assessment by Object Detection—For Visually Impaired Assistive Mechatronic System. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12136342] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Techniques for the detection and recognition of objects have experienced continuous development over recent years, as their application and benefits are so very obvious. Whether they are involved in driving a car, environment surveillance and security, or assistive living for people with different disabilities, not to mention advanced robotic surgery, these techniques are almost indispensable. This article presents the research results of a distance assessment using object detection and recognition techniques. The first is a new technique based on low-cost photo cameras and special sign detection. The second is a classic approach based on a LIDAR sensor and an HQ photo camera. Its novelty, in this case, consists of the concept and prototype of the hardware subsystem for high-precision distance measurement, as well as fast and accurate object recognition. The experimentally obtained results are used for the motion control strategy (directional inverse kinematics) of the robotic arm (virtual prototype) component in special assistive devices designed for visually impaired persons. The advantages of the original technical solution, experimentally validated by a prototype system with modern equipment, are the precision and the short time required for the identification and recognition of objects at relatively short distances. The research results obtained, in both the real and virtual experiments, stand as a basis for the further development of the visually impaired mechatronic system prototype using additional ultrasonic sensors, stereoscopic or multiple cameras, and the implementation of machine-learning models for safety-critical tasks.
Collapse
|
5
|
Biology, Buddhism, and AI: Care as the Driver of Intelligence. ENTROPY 2022; 24:e24050710. [PMID: 35626593 PMCID: PMC9140411 DOI: 10.3390/e24050710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 04/28/2022] [Accepted: 05/11/2022] [Indexed: 11/17/2022]
Abstract
Intelligence is a central feature of human beings’ primary and interpersonal experience. Understanding how intelligence originated and scaled during evolution is a key challenge for modern biology. Some of the most important approaches to understanding intelligence are the ongoing efforts to build new intelligences in computer science (AI) and bioengineering. However, progress has been stymied by a lack of multidisciplinary consensus on what is central about intelligence regardless of the details of its material composition or origin (evolved vs. engineered). We show that Buddhist concepts offer a unique perspective and facilitate a consilience of biology, cognitive science, and computer science toward understanding intelligence in truly diverse embodiments. In coming decades, chimeric and bioengineering technologies will produce a wide variety of novel beings that look nothing like familiar natural life forms; how shall we gauge their moral responsibility and our own moral obligations toward them, without the familiar touchstones of standard evolved forms as comparison? Such decisions cannot be based on what the agent is made of or how much design vs. natural evolution was involved in their origin. We propose that the scope of our potential relationship with, and so also our moral duty toward, any being can be considered in the light of Care—a robust, practical, and dynamic lynchpin that formalizes the concepts of goal-directedness, stress, and the scaling of intelligence; it provides a rubric that, unlike other current concepts, is likely to not only survive but thrive in the coming advances of AI and bioengineering. We review relevant concepts in basal cognition and Buddhist thought, focusing on the size of an agent’s goal space (its cognitive light cone) as an invariant that tightly links intelligence and compassion. Implications range across interpersonal psychology, regenerative medicine, and machine learning. The Bodhisattva’s vow (“for the sake of all sentient life, I shall achieve awakening”) is a practical design principle for advancing intelligence in our novel creations and in ourselves.
Collapse
|
6
|
Levin M. Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds. Front Syst Neurosci 2022; 16:768201. [PMID: 35401131 PMCID: PMC8988303 DOI: 10.3389/fnsys.2022.768201] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 01/24/2022] [Indexed: 12/11/2022] Open
Abstract
Synthetic biology and bioengineering provide the opportunity to create novel embodied cognitive systems (otherwise known as minds) in a very wide variety of chimeric architectures combining evolved and designed material and software. These advances are disrupting familiar concepts in the philosophy of mind, and require new ways of thinking about and comparing truly diverse intelligences, whose composition and origin are not like any of the available natural model species. In this Perspective, I introduce TAME-Technological Approach to Mind Everywhere-a framework for understanding and manipulating cognition in unconventional substrates. TAME formalizes a non-binary (continuous), empirically-based approach to strongly embodied agency. TAME provides a natural way to think about animal sentience as an instance of collective intelligence of cell groups, arising from dynamics that manifest in similar ways in numerous other substrates. When applied to regenerating/developmental systems, TAME suggests a perspective on morphogenesis as an example of basal cognition. The deep symmetry between problem-solving in anatomical, physiological, transcriptional, and 3D (traditional behavioral) spaces drives specific hypotheses by which cognitive capacities can increase during evolution. An important medium exploited by evolution for joining active subunits into greater agents is developmental bioelectricity, implemented by pre-neural use of ion channels and gap junctions to scale up cell-level feedback loops into anatomical homeostasis. This architecture of multi-scale competency of biological systems has important implications for plasticity of bodies and minds, greatly potentiating evolvability. Considering classical and recent data from the perspectives of computational science, evolutionary biology, and basal cognition, reveals a rich research program with many implications for cognitive science, evolutionary biology, regenerative medicine, and artificial intelligence.
Collapse
Affiliation(s)
- Michael Levin
- Allen Discovery Center at Tufts University, Medford, MA, United States
- Wyss Institute for Biologically Inspired Engineering at Harvard University, Cambridge, MA, United States
| |
Collapse
|
7
|
Abramson CI, Levin M. Behaviorist approaches to investigating memory and learning: A primer for synthetic biology and bioengineering. Commun Integr Biol 2021; 14:230-247. [PMID: 34925687 PMCID: PMC8677006 DOI: 10.1080/19420889.2021.2005863] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
The fields of developmental biology, biomedicine, and artificial life are being revolutionized by advances in synthetic morphology. The next phase of synthetic biology and bioengineering is resulting in the construction of novel organisms (biobots), which exhibit not only morphogenesis and physiology but functional behavior. It is now essential to begin to characterize the behavioral capacity of novel living constructs in terms of their ability to make decisions, form memories, learn from experience, and anticipate future stimuli. These synthetic organisms are highly diverse, and often do not resemble familiar model systems used in behavioral science. Thus, they represent an important context in which to begin to unify and standardize vocabulary and techniques across developmental biology, behavioral ecology, and neuroscience. To facilitate the study of behavior in novel living systems, we present a primer on techniques from the behaviorist tradition that can be used to probe the functions of any organism – natural, chimeric, or synthetic – regardless of the details of their construction or origin. These techniques provide a rich toolkit for advancing the fields of synthetic bioengineering, evolutionary developmental biology, basal cognition, exobiology, and robotics.
Collapse
Affiliation(s)
- Charles I Abramson
- Department of Psychology, Laboratory of Comparative Psychology and Behavioral Biology at Oklahoma State University, United States of America
| | - Michael Levin
- Department of Biology, Allen Discovery Center at Tufts University, United States of America
| |
Collapse
|
8
|
Bongard J, Levin M. Living Things Are Not (20th Century) Machines: Updating Mechanism Metaphors in Light of the Modern Science of Machine Behavior. Front Ecol Evol 2021. [DOI: 10.3389/fevo.2021.650726] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
One of the most useful metaphors for driving scientific and engineering progress has been that of the “machine.” Much controversy exists about the applicability of this concept in the life sciences. Advances in molecular biology have revealed numerous design principles that can be harnessed to understand cells from an engineering perspective, and build novel devices to rationally exploit the laws of chemistry, physics, and computation. At the same time, organicists point to the many unique features of life, especially at larger scales of organization, which have resisted decomposition analysis and artificial implementation. Here, we argue that much of this debate has focused on inessential aspects of machines – classical properties which have been surpassed by advances in modern Machine Behavior and no longer apply. This emerging multidisciplinary field, at the interface of artificial life, machine learning, and synthetic bioengineering, is highlighting the inadequacy of existing definitions. Key terms such as machine, robot, program, software, evolved, designed, etc., need to be revised in light of technological and theoretical advances that have moved past the dated philosophical conceptions that have limited our understanding of both evolved and designed systems. Moving beyond contingent aspects of historical and current machines will enable conceptual tools that embrace inevitable advances in synthetic and hybrid bioengineering and computer science, toward a framework that identifies essential distinctions between fundamental concepts of devices and living agents. Progress in both theory and practical applications requires the establishment of a novel conception of “machines as they could be,” based on the profound lessons of biology at all scales. We sketch a perspective that acknowledges the remarkable, unique aspects of life to help re-define key terms, and identify deep, essential features of concepts for a future in which sharp boundaries between evolved and designed systems will not exist.
Collapse
|
9
|
Perrotta MV, Asgeirsdottir T, Eagleman DM. Deciphering Sounds Through Patterns of Vibration on the Skin. Neuroscience 2021; 458:77-86. [PMID: 33465416 DOI: 10.1016/j.neuroscience.2021.01.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 12/04/2020] [Accepted: 01/05/2021] [Indexed: 11/26/2022]
Abstract
Sensory substitution refers to the concept of feeding information to the brain via an atypical sensory pathway. We here examined the degree to which participants (deaf and hard of hearing) can learn to identify sounds that are algorithmically translated into spatiotemporal patterns of vibration on the skin of the wrist. In a three-alternative forced choice task, participants could determine the identity of up to 95% and on average 70% of the stimuli simply by the spatial pattern of vibrations on the skin. Performance improved significantly over the course of 1 month. Younger participants tended to score better, possibly because of higher brain plasticity, more sensitive skin, or better skills at playing digital games. Similar results were obtained with pattern discrimination, in which a pattern representing the sound of one word was presented to the skin, followed by that of a second word. Participants answered whether the word was the same or different. With minimal difference pairs (distinguished by only one phoneme, such as "house" and "mouse"), the best performance was 83% (average of 62%), while with non-minimal pairs (such as "house" and "zip") the best performance was 100% (average of 70%). Collectively, these results demonstrate that participants are capable of using the channel of the skin to interpret auditory stimuli, opening the way for low-cost, wearable sensory substitution for the deaf and hard of hearing communities.
Collapse
Affiliation(s)
| | | | - David M Eagleman
- Neosensory, 4 West 4th Street, Suite 301, San Mateo, CA 94402, USA; Department of Psychiatry and Behavioral Sciences, Stanford University, 401 Quarry Road, Stanford, CA 94304, USA.
| |
Collapse
|
10
|
Visual Echolocation Concept for the Colorophone Sensory Substitution Device Using Virtual Reality. SENSORS 2021; 21:s21010237. [PMID: 33401458 PMCID: PMC7796075 DOI: 10.3390/s21010237] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2020] [Revised: 12/16/2020] [Accepted: 12/21/2020] [Indexed: 11/17/2022]
Abstract
Detecting characteristics of 3D scenes is considered one of the biggest challenges for visually impaired people. This ability is nonetheless crucial for orientation and navigation in the natural environment. Although there are several Electronic Travel Aids aiming at enhancing orientation and mobility for the blind, only a few of them combine passing both 2D and 3D information, including colour. Moreover, existing devices either focus on a small part of an image or allow interpretation of a mere few points in the field of view. Here, we propose a concept of visual echolocation with integrated colour sonification as an extension of Colorophone-an assistive device for visually impaired people. The concept aims at mimicking the process of echolocation and thus provides 2D, 3D and additionally colour information of the whole scene. Even though the final implementation will be realised by a 3D camera, it is first simulated, as a proof of concept, by using VIRCO-a Virtual Reality training and evaluation system for Colorophone. The first experiments showed that it is possible to sonify colour and distance of the whole scene, which opens up a possibility to implement the developed algorithm on a hardware-based stereo camera platform. An introductory user evaluation of the system has been conducted in order to assess the effectiveness of the proposed solution for perceiving distance, position and colour of the objects placed in Virtual Reality.
Collapse
|
11
|
Life, death, and self: Fundamental questions of primitive cognition viewed through the lens of body plasticity and synthetic organisms. Biochem Biophys Res Commun 2020; 564:114-133. [PMID: 33162026 DOI: 10.1016/j.bbrc.2020.10.077] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2020] [Revised: 10/25/2020] [Accepted: 10/28/2020] [Indexed: 12/16/2022]
Abstract
Central to the study of cognition is being able to specify the Subject that is making decisions and owning memories and preferences. However, all real cognitive agents are made of parts (such as brains made of cells). The integration of many active subunits into a coherent Self appearing at a larger scale of organization is one of the fundamental questions of evolutionary cognitive science. Typical biological model systems, whether basal or advanced, have a static anatomical structure which obscures important aspects of the mind-body relationship. Recent advances in bioengineering now make it possible to assemble, disassemble, and recombine biological structures at the cell, organ, and whole organism levels. Regenerative biology and controlled chimerism reveal that studies of cognition in intact, "standard", evolved animal bodies are just a narrow slice of a much bigger and as-yet largely unexplored reality: the incredible plasticity of dynamic morphogenesis of biological forms that house and support diverse types of cognition. The ability to produce living organisms in novel configurations makes clear that traditional concepts, such as body, organism, genetic lineage, death, and memory are not as well-defined as commonly thought, and need considerable revision to account for the possible spectrum of living entities. Here, I review fascinating examples of experimental biology illustrating that the boundaries demarcating somatic and cognitive Selves are fluid, providing an opportunity to sharpen inquiries about how evolution exploits physical forces for multi-scale cognition. Developmental (pre-neural) bioelectricity contributes a novel perspective on how the dynamic control of growth and form of the body evolved into sophisticated cognitive capabilities. Most importantly, the development of functional biobots - synthetic living machines with behavioral capacity - provides a roadmap for greatly expanding our understanding of the origin and capacities of cognition in all of its possible material implementations, especially those that emerge de novo, with no lengthy evolutionary history of matching behavioral programs to bodyplan. Viewing fundamental questions through the lens of new, constructed living forms will have diverse impacts, not only in basic evolutionary biology and cognitive science, but also in regenerative medicine of the brain and in artificial intelligence.
Collapse
|
12
|
Allison TS, Moritz J, Turk P, Stone-Roy LM. Lingual electrotactile discrimination ability is associated with the presence of specific connective tissue structures (papillae) on the tongue surface. PLoS One 2020; 15:e0237142. [PMID: 32764778 PMCID: PMC7413419 DOI: 10.1371/journal.pone.0237142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2019] [Accepted: 07/21/2020] [Indexed: 11/19/2022] Open
Abstract
Electrical stimulation of nerve endings in the tongue can be used to communicate information to users and has been shown to be highly effective in sensory substitution applications. The anterior tip of the tongue has very small somatosensory receptive fields, comparable to those of the finger tips, allowing for precise two-point discrimination and high tactile sensitivity. However, perception of electrotactile stimuli varies significantly between users, and across the tongue surface. Despite this, previous studies all used uniform electrode grids to stimulate a region of the dorsal-medial tongue surface. In an effort to customize electrode layouts for individual users, and thus improve efficacy for sensory substitution applications, we investigated whether specific neuroanatomical and physiological features of the tongue are associated with enhanced ability to perceive active electrodes. Specifically, the study described here was designed to test whether fungiform papillae density and/or propylthiouracil sensitivity are positively or negatively associated with perceived intensity and/or discrimination ability for lingual electrotactile stimuli. Fungiform papillae number and distribution were determined for 15 participants and they were exposed to patterns of electrotactile stimulation (ETS) and asked to report perceived intensity and perceived number of stimuli. Fungiform papillae number and distribution were then compared to ETS characteristics using comprehensive and rigorous statistical analyses. Our results indicate that fungiform papillae density is correlated with enhanced discrimination ability for electrical stimuli. In contrast, papillae density, on average, is not correlated with perceived intensity of active electrodes. However, results for at least one participant suggest that further research is warranted. Our data indicate that propylthiouracil taster status is not related to ETS perceived intensity or discrimination ability. These data indicate that individuals with higher fungiform papillae number and density in the anterior medial tongue region may be better able to use lingual ETS for sensory substitution.
Collapse
Affiliation(s)
- Tyler S. Allison
- Department of Biomedical Sciences, Colorado State University, Fort Collins, Colorado, United States of America
| | - Joel Moritz
- Department of Mechanical Engineering, Colorado State University, Fort Collins, Colorado, United States of America
- Sapien LLC, Fort Collins, Colorado, United States of America
| | - Philip Turk
- Department of Statistics, Colorado State University, Fort Collins, Colorado, United States of America
| | - Leslie M. Stone-Roy
- Department of Biomedical Sciences, Colorado State University, Fort Collins, Colorado, United States of America
- * E-mail:
| |
Collapse
|
13
|
Lloyd-Esenkaya T, Lloyd-Esenkaya V, O'Neill E, Proulx MJ. Multisensory inclusive design with sensory substitution. COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS 2020; 5:37. [PMID: 32770416 PMCID: PMC7415050 DOI: 10.1186/s41235-020-00240-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2019] [Accepted: 07/13/2020] [Indexed: 11/10/2022]
Abstract
Sensory substitution techniques are perceptual and cognitive phenomena used to represent one sensory form with an alternative. Current applications of sensory substitution techniques are typically focused on the development of assistive technologies whereby visually impaired users can acquire visual information via auditory and tactile cross-modal feedback. But despite their evident success in scientific research and furthering theory development in cognition, sensory substitution techniques have not yet gained widespread adoption within sensory-impaired populations. Here we argue that shifting the focus from assistive to mainstream applications may resolve some of the current issues regarding the use of sensory substitution devices to improve outcomes for those with disabilities. This article provides a tutorial guide on how to use research into multisensory processing and sensory substitution techniques from the cognitive sciences to design new inclusive cross-modal displays. A greater focus on developing inclusive mainstream applications could lead to innovative technologies that could be enjoyed by every person.
Collapse
Affiliation(s)
- Tayfun Lloyd-Esenkaya
- Crossmodal Cognition Lab, University of Bath, Bath, BA2 7AY, UK.,Department of Computer Science, University of Bath, Bath, UK
| | | | - Eamonn O'Neill
- Department of Computer Science, University of Bath, Bath, UK
| | - Michael J Proulx
- Crossmodal Cognition Lab, University of Bath, Bath, BA2 7AY, UK. .,Department of Psychology, University of Bath, Bath, UK.
| |
Collapse
|
14
|
Abstract
Genital sensation (GS) is an essential component of male sexual function. Genital sensory disturbance (GSD) caused by spinal cord injury (SCI) has a severe impact on the patients' sexual function but has garnered little research focus. Under normal conditions, GS encompasses the erection, ejaculation, sexual arousal, and orgasm courses associated with physiological and psychological responses in male sexual activity. However, in SCI patients, the deficiency of GS makes the tactile stimulation of the penis unable to cause sexual arousal, disturbs the normal processes of erection and ejaculation, and decreases sexual desire and satisfaction. To provide an overview of the contemporary conception and management of male GS after SCI, we review the innervation and sexual function of male GS in this article, discuss the effects of GSD following SCI, and summarize the current diagnosis and treatment of GSD in male SCI patients.
Collapse
Affiliation(s)
- Hao Zhang
- Department of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China
| | - Bing Li
- Department of Urology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China
| |
Collapse
|
15
|
Rahimi M, Jiang F, Shen Y. Non-linearity of Skin Properties in Electrotactile Applications: Identification and Mitigation. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2019; 7:169844-169852. [PMID: 33747667 PMCID: PMC7970715 DOI: 10.1109/access.2019.2955648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Electrotactile displays can open a new sensory substitution channel to be utilized in a vast array of applications. Our Finger-Eye research used this approach to build a system for the blind to easily read any text not written in Braille. But there are still challenges in different aspects of such systems. One of the most crucial concerns, is the effects of receptor fatigue. Our tests show that during prolonged exposure of receptors to the electrical signals, their sensitivity to the signal level changes gradually and adjustments in the signal's power are required to keep the receptors is the stimulated state. This was confirmed by monitoring the electrical current passing through the skin and calculating the corresponding impedance. More interestingly, the rates of the impedance changes are different for each part of the skin, indicating inconsistent rates of receptor fatigue for each region of the skin. These electrical properties of the skin were addressed in this research for the purpose of rendering consistent sensations for the users regardless of the person or skin conditions. To solve these challenges, two methods are employed: a voltage control system based on pulse-width modulation is used to adjust the signal power; and Kalman filtering is used to predict impedance changes in advance and supply the skin with the proper signal. The result is a self-contained automated system capable of managing the signal power for any user at any given time or skin condition.
Collapse
Affiliation(s)
- Mehdi Rahimi
- Department of Electrical and Biomedical Engineering, University of Nevada-Reno, Reno, NV, 89557 USA
| | - Fang Jiang
- Department of Psychology, University of Nevada, Reno, Reno, NV, 89557 USA
| | - Yantao Shen
- Department of Electrical and Biomedical Engineering, University of Nevada-Reno, Reno, NV, 89557 USA
| |
Collapse
|
16
|
Zhang X, Zhang H, Zhang L, Zhu Y, Hu F. Double-Diamond Model-Based Orientation Guidance in Wearable Human-Machine Navigation Systems for Blind and Visually Impaired People. SENSORS 2019; 19:s19214670. [PMID: 31661798 PMCID: PMC6864851 DOI: 10.3390/s19214670] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2019] [Revised: 10/06/2019] [Accepted: 10/24/2019] [Indexed: 11/17/2022]
Abstract
This paper presents the analysis and design of a new, wearable orientation guidance device in modern travel aid systems for blind and visually impaired people. The four-stage double-diamond design model was applied in the design process to achieve human-centric innovation and to ensure technical feasibility and economic viability. Consequently, a sliding tactile feedback wristband was designed and prototyped. Furthermore, a Bezier curve-based adaptive path planner is proposed to guarantee collision-free planned motion. Proof-of-concept experiments on both virtual and real-world scenarios are conducted. The evaluation results confirmed the efficiency and feasibility of the design and imply the design’s remarkable potential in spatial perception rehabilitation.
Collapse
Affiliation(s)
- Xiaochen Zhang
- Department of Industrial Design, Guangdong University of Technology, Guangzhou 510006, China.
| | - Hui Zhang
- Department of Industrial Design, Guangdong University of Technology, Guangzhou 510006, China.
| | - Linyue Zhang
- School of Communication and Design, Sun Yat-Sen University, Guangzhou 510275, China.
| | - Yi Zhu
- Department of Industrial Design, Guangdong University of Technology, Guangzhou 510006, China.
- School of Industrial Design, Georgia Institute of Technology, Atlanta, GA 30332, USA.
| | - Fei Hu
- Department of Industrial Design, Guangdong University of Technology, Guangzhou 510006, China.
| |
Collapse
|
17
|
Exploring User Perception Challenges in Vibrotactile Haptic Display Using Resonant Microbeams under Contact with Skin. MULTIMODAL TECHNOLOGIES AND INTERACTION 2019. [DOI: 10.3390/mti3020038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Resonant vibrotactile microbeams use the concept of resonance to excite the vibration of cantilever beams, which correspond to pixels of an image. The primary benefit of this type of tactile display is its potential for high resolution. This paper presents the concept of the proposed system and human skin contact experiments to explore user perception challenges related to beam vibration during skin contact. The human skin contact experiments can be described in five phases: dried skin contact to metal beam tips, wet and soaped skin contact to metal beam tips, skin contact with a constraint, normal force measurement, and skin contact to the tips of silicone rubber beams attached to metal beam tips. Experimental results are analyzed to determine in what cases of skin contact the beams stop vibrating. It is found that the addition of silicone rubber beams allows the primary metal beams to continue vibrating while in contact with skin. Thus, the vibration response of a metal beam with silicone rubber beams is investigated for the better understanding of the effect of silicone rubber beams on the metal beam vibration.
Collapse
|
18
|
Arditi A, Tian Y. User Interface Preferences in the Design of a Camera-Based Navigation and Wayfinding Aid. JOURNAL OF VISUAL IMPAIRMENT & BLINDNESS 2019. [DOI: 10.1177/0145482x1310700205] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Introduction Development of a sensing device that can provide a sufficient perceptual substrate for persons with visual impairments to orient themselves and travel confidently has been a persistent rehabilitation technology goal, with the user interface posing a significant challenge. In the study presented here, we enlist the advice and ideas of individuals who are blind with respect to this challenge, for an envisioned camera-based aid to navigation and wayfinding. Methods We administered a short questionnaire about user preferences and needs for such a device to a sample of 10 well-educated, employed (or retired) visually impaired participants with light perception or less, who were familiar and comfortable with assistive technology. Generally, the items were rankings of relative priority. Results Participants preferred speech as a communications medium for navigating the environment; preferred controlling the auditory display by querying the system rather than interacting via a menu or receiving a stream of continuous speech; and preferred providing input to the system through a keypad rather than through a voice recognition system. Architectural features such as doors and stairs were ranked the most important environmental objects to be located with such a device (over furniture, persons, personal items, and even text signs). Discussion Our sample reported a desire for devices that can guide them to architectural features of their environment. They appear to prefer device interfaces that give them control, and would rather query a system than interact with a menu. They prefer unobtrusive input on a device via keypad rather than through voice recognition. Implications for practitioners Designers of camera-based navigation devices may wish to consider the preferences of our sample by incorporating a query-based interface with simple keypad input and speech output, and to include in their object recognition efforts the goal of identifying architectural features that are significant to users who are blind in navigation.
Collapse
Affiliation(s)
- Aries Arditi
- Visibility Metrics LLC, 49 Valley View Road, Chappaqua, NY 10514
| | - YingLi Tian
- Department of Electrical Engineering, City College of New York, 160 Convent Avenue, New York, NY 10031
| |
Collapse
|
19
|
Phamduy P, Rizzo JR, Hudson TE, Torre M, Levon K, Porfiri M. Communicating through Touch: Macro Fiber Composites for Tactile Stimulation on the Abdomen. IEEE TRANSACTIONS ON HAPTICS 2018; 11:174-184. [PMID: 29927741 DOI: 10.1109/toh.2017.2781244] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Research into sensory substitution systems has expanded, as alternative senses are utilized in real-time to afford object recognition or spatial understanding. Tactile stimulation has long shown promise as a communicatory strategy when applied unobtrusively to the redundant surface areas of the skin. Here, a novel belt, integrating a matrix of macro fiber composites, is purposed to deliver tactile stimuli to the abdomen. The design and development of the belt is presented and a systematic experimental study is conducted to analyze the impact of frequency and duty cycle. The belt is a beta precursor to a soft haptic feedback device that will enable situational awareness and obstacle avoidance through the localization of tactile stimulation relative to a body-centric frame of reference in a local environment.
Collapse
|
20
|
Buimer HP, Bittner M, Kostelijk T, van der Geest TM, Nemri A, van Wezel RJA, Zhao Y. Conveying facial expressions to blind and visually impaired persons through a wearable vibrotactile device. PLoS One 2018; 13:e0194737. [PMID: 29584738 PMCID: PMC5870993 DOI: 10.1371/journal.pone.0194737] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2017] [Accepted: 03/08/2018] [Indexed: 11/18/2022] Open
Abstract
In face-to-face social interactions, blind and visually impaired persons (VIPs) lack access to nonverbal cues like facial expressions, body posture, and gestures, which may lead to impaired interpersonal communication. In this study, a wearable sensory substitution device (SSD) consisting of a head mounted camera and a haptic belt was evaluated to determine whether vibrotactile cues around the waist could be used to convey facial expressions to users and whether such a device is desired by VIPs for use in daily living situations. Ten VIPs (mean age: 38.8, SD: 14.4) and 10 sighted persons (SPs) (mean age: 44.5, SD: 19.6) participated in the study, in which validated sets of pictures, silent videos, and videos with audio of facial expressions were presented to the participant. A control measurement was first performed to determine how accurately participants could identify facial expressions while relying on their functional senses. After a short training, participants were asked to determine facial expressions while wearing the emotion feedback system. VIPs using the device showed significant improvements in their ability to determine which facial expressions were shown. A significant increase in accuracy of 44.4% was found across all types of stimuli when comparing the scores of the control (mean±SEM: 35.0±2.5%) and supported (mean±SEM: 79.4±2.1%) phases. The greatest improvements achieved with the support of the SSD were found for silent stimuli (68.3% for pictures and 50.8% for silent videos). SPs also showed consistent, though not statistically significant, improvements while supported. Overall, our study shows that vibrotactile cues are well suited to convey facial expressions to VIPs in real-time. Participants became skilled with the device after a short training session. Further testing and development of the SSD is required to improve its accuracy and aesthetics for potential daily use.
Collapse
Affiliation(s)
- Hendrik P. Buimer
- Department of Biomedical Signals and Systems, MIRA Institute, University of Twente, Enschede, The Netherlands
- Department of Biophysics, Donders Institute, Radboud University, Nijmegen, The Netherlands
- * E-mail:
| | - Marian Bittner
- Department of Biomedical Signals and Systems, MIRA Institute, University of Twente, Enschede, The Netherlands
| | | | - Thea M. van der Geest
- Department of Media, Communication, & Organization, University of Twente, Enschede, The Netherlands
- Department of Media and Design, HAN University of Applied Sciences, Arnhem, The Netherlands
| | - Abdellatif Nemri
- Department of Biomedical Signals and Systems, MIRA Institute, University of Twente, Enschede, The Netherlands
| | - Richard J. A. van Wezel
- Department of Biomedical Signals and Systems, MIRA Institute, University of Twente, Enschede, The Netherlands
- Department of Biophysics, Donders Institute, Radboud University, Nijmegen, The Netherlands
| | - Yan Zhao
- Department of Biomedical Signals and Systems, MIRA Institute, University of Twente, Enschede, The Netherlands
| |
Collapse
|
21
|
Reinkensmeyer DJ, Blackstone S, Bodine C, Brabyn J, Brienza D, Caves K, DeRuyter F, Durfee E, Fatone S, Fernie G, Gard S, Karg P, Kuiken TA, Harris GF, Jones M, Li Y, Maisel J, McCue M, Meade MA, Mitchell H, Mitzner TL, Patton JL, Requejo PS, Rimmer JH, Rogers WA, Zev Rymer W, Sanford JA, Schneider L, Sliker L, Sprigle S, Steinfeld A, Steinfeld E, Vanderheiden G, Winstein C, Zhang LQ, Corfman T. How a diverse research ecosystem has generated new rehabilitation technologies: Review of NIDILRR's Rehabilitation Engineering Research Centers. J Neuroeng Rehabil 2017; 14:109. [PMID: 29110728 PMCID: PMC5674748 DOI: 10.1186/s12984-017-0321-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2016] [Accepted: 10/26/2017] [Indexed: 01/14/2023] Open
Abstract
Over 50 million United States citizens (1 in 6 people in the US) have a developmental, acquired, or degenerative disability. The average US citizen can expect to live 20% of his or her life with a disability. Rehabilitation technologies play a major role in improving the quality of life for people with a disability, yet widespread and highly challenging needs remain. Within the US, a major effort aimed at the creation and evaluation of rehabilitation technology has been the Rehabilitation Engineering Research Centers (RERCs) sponsored by the National Institute on Disability, Independent Living, and Rehabilitation Research. As envisioned at their conception by a panel of the National Academy of Science in 1970, these centers were intended to take a "total approach to rehabilitation", combining medicine, engineering, and related science, to improve the quality of life of individuals with a disability. Here, we review the scope, achievements, and ongoing projects of an unbiased sample of 19 currently active or recently terminated RERCs. Specifically, for each center, we briefly explain the needs it targets, summarize key historical advances, identify emerging innovations, and consider future directions. Our assessment from this review is that the RERC program indeed involves a multidisciplinary approach, with 36 professional fields involved, although 70% of research and development staff are in engineering fields, 23% in clinical fields, and only 7% in basic science fields; significantly, 11% of the professional staff have a disability related to their research. We observe that the RERC program has substantially diversified the scope of its work since the 1970's, addressing more types of disabilities using more technologies, and, in particular, often now focusing on information technologies. RERC work also now often views users as integrated into an interdependent society through technologies that both people with and without disabilities co-use (such as the internet, wireless communication, and architecture). In addition, RERC research has evolved to view users as able at improving outcomes through learning, exercise, and plasticity (rather than being static), which can be optimally timed. We provide examples of rehabilitation technology innovation produced by the RERCs that illustrate this increasingly diversifying scope and evolving perspective. We conclude by discussing growth opportunities and possible future directions of the RERC program.
Collapse
Affiliation(s)
| | | | | | - John Brabyn
- The Smith-Kettlewell Eye Research Institute, San Francesco, USA
| | | | | | | | | | - Stefania Fatone
- Northwestern University Prosthetics-Orthotics Center, Evanston, USA
| | - Geoff Fernie
- Toronto Rehabilitation Institute, Toronto, Canada
| | - Steven Gard
- Northwestern University Prosthetics-Orthotics Center, Evanston, USA
| | | | | | | | | | - Yue Li
- Toronto Rehabilitation Institute, Toronto, Canada
| | | | | | | | | | | | - James L. Patton
- Rehabilitation Institute of Chicago, University of Illinois at Chicago, Chicago, USA
| | | | - James H. Rimmer
- Lakeshore FoundationUniversity of Alabama-Birmingham, Birmingham, USA
| | | | - W. Zev Rymer
- Rehabilitation Institute of Chicago, Chicago, USA
| | | | | | | | | | - Aaron Steinfeld
- Robotics Institute, Carnegie Mellon University, Pittsburgh, USA
| | | | | | | | | | - Thomas Corfman
- National Institute on Disability, Independent Living, and Rehabilitation Research, Washington, DC, USA
| |
Collapse
|
22
|
Ghafoor U, Kim S, Hong KS. Selectivity and Longevity of Peripheral-Nerve and Machine Interfaces: A Review. Front Neurorobot 2017; 11:59. [PMID: 29163122 PMCID: PMC5671609 DOI: 10.3389/fnbot.2017.00059] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2017] [Accepted: 10/17/2017] [Indexed: 11/22/2022] Open
Abstract
For those individuals with upper-extremity amputation, a daily normal living activity is no longer possible or it requires additional effort and time. With the aim of restoring their sensory and motor functions, theoretical and technological investigations have been carried out in the field of neuroprosthetic systems. For transmission of sensory feedback, several interfacing modalities including indirect (non-invasive), direct-to-peripheral-nerve (invasive), and cortical stimulation have been applied. Peripheral nerve interfaces demonstrate an edge over the cortical interfaces due to the sensitivity in attaining cortical brain signals. The peripheral nerve interfaces are highly dependent on interface designs and are required to be biocompatible with the nerves to achieve prolonged stability and longevity. Another criterion is the selection of nerves that allows minimal invasiveness and damages as well as high selectivity for a large number of nerve fascicles. In this paper, we review the nerve-machine interface modalities noted above with more focus on peripheral nerve interfaces, which are responsible for provision of sensory feedback. The invasive interfaces for recording and stimulation of electro-neurographic signals include intra-fascicular, regenerative-type interfaces that provide multiple contact channels to a group of axons inside the nerve and the extra-neural-cuff-type interfaces that enable interaction with many axons around the periphery of the nerve. Section Current Prosthetic Technology summarizes the advancements made to date in the field of neuroprosthetics toward the achievement of a bidirectional nerve-machine interface with more focus on sensory feedback. In the Discussion section, the authors propose a hybrid interface technique for achieving better selectivity and long-term stability using the available nerve interfacing techniques.
Collapse
Affiliation(s)
- Usman Ghafoor
- School of Mechanical Engineering, Pusan National University, Busan, South Korea
| | - Sohee Kim
- Department of Robotics Engineering, Daegu Gyeongbuk Institute of Science and Technology, Daegu, South Korea
| | - Keum-Shik Hong
- School of Mechanical Engineering, Pusan National University, Busan, South Korea.,Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, South Korea
| |
Collapse
|
23
|
Review of rehabilitation and habilitation strategies for children and young people with homonymous visual field loss caused by cerebral vision impairment. BRITISH JOURNAL OF VISUAL IMPAIRMENT 2017. [DOI: 10.1177/0264619617706100] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Partial and homonymous visual field loss (HVFL) is a common consequence of post-chiasmatic injury to the primary visual pathway or injury to the primary visual cortex. Different approaches to rehabilitation have been reported for older adults with HVFL and there is evidence to support the use of compensatory training over other proposed therapies. We reviewed the literature to investigate the current state of the art of rehabilitation and habilitation strategies for children and young people with HVFL, and whether there is enough evidence to support the use of these strategies in the paediatric population. We have provided an overview of the existing literature on children and young people with HVFL, a brief overview of rehabilitation strategies for adults with HVFL, and evidence on whether these different interventions have been applied with children and young people effectively. We found that there have been very few studies to investigate these strategies with children and young people, and the quality of evidence is currently low. New research is required to evaluate which strategies are effective for children and young people with HVFL and whether new strategies need to be developed.
Collapse
|
24
|
Stronks HC, Walker J, Parker DJ, Barnes N. Training Improves Vibrotactile Spatial Acuity and Intensity Discrimination on the Lower Back Using Coin Motors. Artif Organs 2017; 41:1059-1070. [DOI: 10.1111/aor.12882] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2016] [Revised: 08/10/2016] [Accepted: 09/21/2016] [Indexed: 11/27/2022]
Affiliation(s)
- H. Christiaan Stronks
- NICTAComputer Vision Research GroupCanberra Australia
- Department of Neuroscience, The John Curtin School of Medical ResearchAustralian National UniversityCanberra Australia
| | - Janine Walker
- NICTAComputer Vision Research GroupCanberra Australia
- Centre for Mental Health ResearchAustralian National UniversityCanberra Australia
| | | | - Nick Barnes
- NICTAComputer Vision Research GroupCanberra Australia
- College of Engineering and Computer ScienceAustralian National UniversityCanberra Australia
| |
Collapse
|
25
|
Moritz J, Turk P, Williams JD, Stone-Roy LM. Perceived Intensity and Discrimination Ability for Lingual Electrotactile Stimulation Depends on Location and Orientation of Electrodes. Front Hum Neurosci 2017; 11:186. [PMID: 28484380 PMCID: PMC5399529 DOI: 10.3389/fnhum.2017.00186] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 03/29/2017] [Indexed: 11/13/2022] Open
Abstract
Malfunctioning sensory systems can severely impact quality of life and repair is not always possible. One solution, called sensory substitution, is to use another sensory system to bring lost information to the brain. This approach often involves the use of bioengineered devices that electrically stimulate somatosensory fibers. Interestingly, the tongue is an ideal location for electrotactile stimulation due to its dense innervation, moisture, and protected environment. Success with transmitting visual and vestibular information through the tongue indicates promise for future applications. However, sensitivity and discrimination ability varies between individuals and across the tongue surface complicating efforts to produce reliable and consistent sensations. The goals of the present study were to investigate these differences more precisely to better understand the mechanosensory innervation of the tongue so that future electrotactile devices can be designed more effectively. Specifically, we tested whether stimulation of certain regions of the tongue consistently result in better perception, whether the spacing of stimulating electrodes affects perceived intensity, and whether the orientation of electrodes affects perceived intensity and discrimination. To test these hypotheses, we built a custom tongue stimulation device, recruited 25 participants, and collected perceived intensity and discrimination data. We then subjected the data to thorough statistical analyses. Consistent with previous studies, we found that stimulation of the anterior medial tongue region was perceived as more intense than stimulation of lateral and posterior regions. This region also had the best discrimination ability for electrodes. Dividing the stimulated tongue area into 16 distinct regions allowed us to compare perception ability between anterior and posterior regions, medial and lateral regions, and the left and right sides of the tongue. Stimulation of the most anterior and medial tongue resulted in the highest perceived intensity and the best discrimination ability. Most individuals were able to perceive and discriminate electrotactile stimulation better on one side of the tongue, and orientation of stimulating electrodes affected perception. In conclusion, the present studies reveal new information about the somatosensory innervation of the tongue and will assist the design of future electrotactile tongue stimulation devices that will help provide sensory information to people with damaged sensory systems.
Collapse
Affiliation(s)
- Joel Moritz
- Department of Mechanical Engineering, Colorado State UniversityFort Collins, CO, USA
| | - Philip Turk
- Department of Statistics, Colorado State UniversityFort Collins, CO, USA
| | - John D Williams
- Department of Mechanical Engineering, Colorado State UniversityFort Collins, CO, USA
| | - Leslie M Stone-Roy
- Department of Biomedical Sciences, Colorado State UniversityFort Collins, CO, USA
| |
Collapse
|
26
|
Stronks HC, Parker DJ, Barnes N. Vibrotactile Spatial Acuity and Intensity Discrimination on the Lower Back Using Coin Motors. IEEE TRANSACTIONS ON HAPTICS 2016; 9:446-454. [PMID: 27214917 DOI: 10.1109/toh.2016.2569484] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Tactile vision substitution devices are assistive devices for the blind that redirect visual information to the skin. The amount of visual information that can be presented on a tactile display is limited mainly by the spatial resolution of the skin and the ability to distinguish between various vibration intensities. In this study, we have determined the two-point discrimination (TPD) threshold and intensity-discrimination threshold (just-noticeable difference, or JND) on the lower back using coin motors. Given the importance of stimulus timing, we have determined TPD threshold and JND at different stimulus onset asynchronies (SOAs). The JND was determined between two coin motors with a distance equal to the TPD threshold. In this way, we could establish the contrast sensitivity at the maximal theoretical resolution. TPD thresholds tended to decrease at longer SOAs, from 52 mm edge-to-edge at an SOA of 0 ms, to 28 mm at 200 ms. The JND did not depend on SOA, and the average Weber fraction was 0.14. A median of 5 JNDs was available across the available dynamic range. Together, these data provide the predicted spatial resolution and contrast resolution achievable with a back-worn tactile display based on coin motors.
Collapse
|
27
|
Tzorakoleftherakis E, Murphey TD, Scheidt RA. Augmenting sensorimotor control using "goal-aware" vibrotactile stimulation during reaching and manipulation behaviors. Exp Brain Res 2016; 234:2403-14. [PMID: 27074942 DOI: 10.1007/s00221-016-4645-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2015] [Accepted: 04/02/2016] [Indexed: 10/22/2022]
Abstract
We describe two sets of experiments that examine the ability of vibrotactile encoding of simple position error and combined object states (calculated from an optimal controller) to enhance performance of reaching and manipulation tasks in healthy human adults. The goal of the first experiment (tracking) was to follow a moving target with a cursor on a computer screen. Visual and/or vibrotactile cues were provided in this experiment, and vibrotactile feedback was redundant with visual feedback in that it did not encode any information above and beyond what was already available via vision. After only 10 minutes of practice using vibrotactile feedback to guide performance, subjects tracked the moving target with response latency and movement accuracy values approaching those observed under visually guided reaching. Unlike previous reports on multisensory enhancement, combining vibrotactile and visual feedback of performance errors conferred neither positive nor negative effects on task performance. In the second experiment (balancing), vibrotactile feedback encoded a corrective motor command as a linear combination of object states (derived from a linear-quadratic regulator implementing a trade-off between kinematic and energetic performance) to teach subjects how to balance a simulated inverted pendulum. Here, the tactile feedback signal differed from visual feedback in that it provided information that was not readily available from visual feedback alone. Immediately after applying this novel "goal-aware" vibrotactile feedback, time to failure was improved by a factor of three. Additionally, the effect of vibrotactile training persisted after the feedback was removed. These results suggest that vibrotactile encoding of appropriate combinations of state information may be an effective form of augmented sensory feedback that can be applied, among other purposes, to compensate for lost or compromised proprioception as commonly observed, for example, in stroke survivors.
Collapse
Affiliation(s)
- Emmanouil Tzorakoleftherakis
- Neuroscience and Robotics Laboratory, Department of Mechanical Engineering, Northwestern University, Evanston, IL, 60208, USA.
| | - Todd D Murphey
- Neuroscience and Robotics Laboratory, Department of Mechanical Engineering, Northwestern University, Evanston, IL, 60208, USA.,Department of Physical Therapy and Human Movement Sciences, Northwestern University, Chicago, IL, 60611, USA
| | - Robert A Scheidt
- Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, Chicago, IL, 60611, USA.,NeuroMotor Control Laboratory, Department of Biomedical Engineering, Marquette University, Milwaukee, WI, 53201, USA.,Robotics Laboratory, Sensory Motor Performance Program, Rehabilitation Institute of Chicago, Chicago, IL, 60611, USA
| |
Collapse
|
28
|
Grant P, Spencer L, Arnoldussen A, Hogle R, Nau A, Szlyk J, Nussdorf J, Fletcher DC, Gordon K, Seiple W. The Functional Performance of the BrainPort V100 Device in Persons who Are Profoundly Blind. JOURNAL OF VISUAL IMPAIRMENT & BLINDNESS 2016. [DOI: 10.1177/0145482x1611000202] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Introduction This study was conducted to evaluate the functional performance of the BrainPort V100 device, an FDA-cleared sensory-substitution system, in persons who are profoundly blind (that is, have some or no light perception). Methods This was a prospective, single-arm, multicenter clinical investigation. Participants received 10 hours of device training and were required to use the device in their everyday environments for 1 year. Functional performance measures of object identification, orientation and mobility (O&M), and word identification were assessed at baseline, in post-device training, and at the 3-, 6-, 9-, and 12-month time points. Results Fifty-seven participants completed the study and used the device for 1 year. No device-related serious adverse events were reported, demonstrating that the risks associated with the BrainPort are minimal. Participants performed object recognition (91.2% success rate) and O&M (57.9% success rate) tasks beyond chance level. Discussion This study demonstrates that the BrainPort can be used safely and independently by persons who are blind. Participants with profound blindness can accomplish a set of tasks more successfully by using the BrainPort than without the device. Following initial training, performance on these tasks was maintained or improved over the course of 1 year. Implications for practitioners The BrainPort is a noninvasive and nonsurgical device that heightens functional independence for persons who are blind. The device presents users with more information about their environment than conventional assistive devices, and can enhance independence in performing activities of daily living.
Collapse
Affiliation(s)
- Patricia Grant
- Director of clinical research, Wicab, Inc., 8313 Greenway Boulevard, Suite 100, Middleton, WI 53562
| | - Lindsey Spencer
- Program manager, McPherson Eye Research Institute, University of Wisconsin–Madison, 1111 Highland Avenue, Madison, WI 53705
| | - Aimee Arnoldussen
- Technology assessment program manager, UW Health, McPherson Eye Research Institute, University of Wisconsin–Madison, 600 Highland Ave, Madison, WI 53792; and scientific consultant, Wicab, Inc., Middleton, WI
| | - Rich Hogle
- Vice president and director of product development, Wicab, Inc., Middleton, WI
| | - Amy Nau
- Optometrist, Korb & Associates, 400 Commonwealth Avenue, Suite 2, Boston, MA 02215
| | - Janet Szlyk
- President and CEO, Chicago Lighthouse for People Who Are Blind or Visually Impaired; professor, University of Illinois at Chicago; research health scientist, Jesse Brown VA Medical Center, Chicago, IL
| | - Jonathan Nussdorf
- Chairman, Department of Ophthalmology, Ochsner Health System, 1514 Jefferson Highway, New Orleans, LA 70121; associate professor, University of Queensland School of Medicine, Queensland, Australia
| | - Donald C. Fletcher
- Medical director, Envision Low Vision Rehabilitation Center, 610 North Main Street, 2nd Floor, Wichita, KS 67203
| | - Keith Gordon
- Vice president, research, Canadian National Institute for the Blind, 1929 Bayview Avenue, Toronto, Ontario, Canada M4G 3E8
| | - William Seiple
- Vice president of research, Lighthouse Guild International, 111 East 59th Street, New York, NY 10023; professor, Department of Ophthalmology, New York University School of Medicine, New York, NY; research biologist, Jesse Brown VA Medical Center, Chicago, IL; invited professor, University Pierre & Marie Curie, Paris, France
| |
Collapse
|
29
|
Kiroy VN, Aslanyan EV, Lazurenko DM, Minyaeva NR, Bakhtin OM. Efficiency analysis of voluntary control of human's EEG spectral characteristics. J Integr Neurosci 2016; 15:97-108. [PMID: 26912214 DOI: 10.1142/s0219635216500072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Spectral power (SP) of EEG alpha and beta-2 frequencies in different cortical areas has been used for neurofeedback training to control a graphic interface in different scenarios. The results show that frequency range and brain cortical areas are associated with high or low efficiency of voluntary control. Overall, EEG phenomena observed in the course of training are largely general changes involving extensive brain areas and frequency bands. Finally, we have demonstrated EEG patterns that dynamically switch with a specific feature in different tasks within one training, after a relatively short period of training.
Collapse
Affiliation(s)
- Valery N Kiroy
- 1 A. B. Kogan Research Institute for Neurocybernetics, SFedU, 194/1, Stachki ave, Rostov-on-Don, 344090, Russian Federation
| | - Elena V Aslanyan
- 1 A. B. Kogan Research Institute for Neurocybernetics, SFedU, 194/1, Stachki ave, Rostov-on-Don, 344090, Russian Federation
| | - Dmitry M Lazurenko
- 1 A. B. Kogan Research Institute for Neurocybernetics, SFedU, 194/1, Stachki ave, Rostov-on-Don, 344090, Russian Federation
| | - Nadezhda R Minyaeva
- 1 A. B. Kogan Research Institute for Neurocybernetics, SFedU, 194/1, Stachki ave, Rostov-on-Don, 344090, Russian Federation
| | - Oleg M Bakhtin
- 1 A. B. Kogan Research Institute for Neurocybernetics, SFedU, 194/1, Stachki ave, Rostov-on-Don, 344090, Russian Federation
| |
Collapse
|
30
|
Stronks HC, Nau AC, Ibbotson MR, Barnes N. The role of visual deprivation and experience on the performance of sensory substitution devices. Brain Res 2015; 1624:140-152. [DOI: 10.1016/j.brainres.2015.06.033] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2014] [Revised: 06/15/2015] [Accepted: 06/23/2015] [Indexed: 10/23/2022]
|
31
|
O'Modhrain S, Giudice NA, Gardner JA, Legge GE. Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls. IEEE TRANSACTIONS ON HAPTICS 2015; 8:248-257. [PMID: 26276998 DOI: 10.1109/toh.2015.2466231] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
This paper discusses issues of importance to designers of media for visually impaired users. The paper considers the influence of human factors on the effectiveness of presentation as well as the strengths and weaknesses of tactile, vibrotactile, haptic, and multimodal methods of rendering maps, graphs, and models. The authors, all of whom are visually impaired researchers in this domain, present findings from their own work and work of many others who have contributed to the current understanding of how to prepare and render images for both hard-copy and technology-mediated presentation of Braille and tangible graphics.
Collapse
|
32
|
Brown DJ, Simpson AJR, Proulx MJ. Visual objects in the auditory system in sensory substitution: how much information do we need? Multisens Res 2015; 27:337-57. [PMID: 25693300 DOI: 10.1163/22134808-00002462] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Sensory substitution devices such as The vOICe convert visual imagery into auditory soundscapes and can provide a basic 'visual' percept to those with visual impairment. However, it is not known whether technical or perceptual limits dominate the practical efficacy of such systems. By manipulating the resolution of sonified images and asking naïve sighted participants to identify visual objects through a six-alternative forced-choice procedure (6AFC) we demonstrate a 'ceiling effect' at 8 x 8 pixels, in both visual and tactile conditions, that is well below the theoretical limits of the technology. We discuss our results in the context of auditory neural limits on the representation of 'auditory' objects in a cortical hierarchy and how perceptual training may be used to circumvent these limitations.
Collapse
|
33
|
|
34
|
Nau A, Bach M, Fisher C. Clinical Tests of Ultra-Low Vision Used to Evaluate Rudimentary Visual Perceptions Enabled by the BrainPort Vision Device. Transl Vis Sci Technol 2013; 2:1. [PMID: 24049716 DOI: 10.1167/tvst.2.3.1] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2012] [Accepted: 02/10/2013] [Indexed: 10/26/2022] Open
Abstract
PURPOSE We evaluated whether existing ultra-low vision tests are suitable for measuring outcomes using sensory substitution. The BrainPort is a vision assist device coupling a live video feed with an electrotactile tongue display, allowing a user to gain information about their surroundings. METHODS We enrolled 30 adult subjects (age range 22-74) divided into two groups. Our blind group included 24 subjects (n = 16 males and n = 8 females, average age 50) with light perception or worse vision. Our control group consisted of six subjects (n = 3 males, n = 3 females, average age 43) with healthy ocular status. All subjects performed 11 computer-based psychophysical tests from three programs: Basic Assessment of Light Motion, Basic Assessment of Grating Acuity, and the Freiburg Vision Test as well as a modified Tangent Screen. Assessments were performed at baseline and again using the BrainPort after 15 hours of training. RESULTS Most tests could be used with the BrainPort. Mean success scores increased for all of our tests except contrast sensitivity. Increases were statistically significant for tests of light perception (8.27 ± 3.95 SE), time resolution (61.4% ± 3.14 SE), light localization (44.57% ± 3.58 SE), grating orientation (70.27% ± 4.64 SE), and white Tumbling E on a black background (2.49 logMAR ± 0.39 SE). Motion tests were limited by BrainPort resolution. CONCLUSIONS Tactile-based sensory substitution devices are amenable to psychophysical assessments of vision, even though traditional visual pathways are circumvented. TRANSLATIONAL RELEVANCE This study is one of many that will need to be undertaken to achieve a common outcomes infrastructure for the field of artificial vision.
Collapse
Affiliation(s)
- Amy Nau
- University of Pittsburgh Medical Center Eye Center, Department of Ophthalmology, University of Pittsburgh, Pittsburgh, PA
| | | | | |
Collapse
|
35
|
|
36
|
Chekhchoukh A, Vuillerme N, Payan Y, Glade N. Effect of saccades in tongue electrotactile stimulation for vision substitution applications. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2013:3543-3546. [PMID: 24110494 DOI: 10.1109/embc.2013.6610307] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
The visual substitution paradigm aims to facilitate the life of blind people. Generally one uses electro-stimulating devices where electrodes are arranged into arrays to stimulate the skin or the tongue mucosa to send signals of visual type to the subjects. When an electro-stimulation signal is applied continuously (e.g. when static visual scenes are displayed for a long period of time), the receptors of the affected region can get saturated and the patient may lose the displayed information. We propose here some mechanisms that ameliorate the quality of perception of the electro-stimulation information. The electrical signal is encoded as 2D scenes projected onto the tongue via a Tongue Display Unit, i.e. an electro-tactile stimulator formed by a 12×12 matrix of electrodes. We propose to apply stochastic saccades on this signal. Our assumption is that this eye-inspired mechanism should make the visual substitution more efficient (by improving the perception) because of the reduction of the tactile receptors saturation. The influence of saccades was evaluated by a series of experiments. Results revealed a benefit on the persistence of perception due to saccades. This work helps to prevent the saturation of receptors on the tongue. Therefore increasing the quality of vision by the way of the electro-stimulation. It allows new enhancement features to retinal prosthesis devices which suffer from the same phenomenon.
Collapse
|
37
|
Wildenberg JC, Tyler ME, Danilov YP, Kaczmarek KA, Meyerand ME. Altered connectivity of the balance processing network after tongue stimulation in balance-impaired individuals. Brain Connect 2013; 3:87-97. [PMID: 23216162 PMCID: PMC3621359 DOI: 10.1089/brain.2012.0123] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Some individuals with balance impairment have hypersensitivity of the motion-sensitive visual cortices (hMT+) compared to healthy controls. Previous work showed that electrical tongue stimulation can reduce the exaggerated postural sway induced by optic flow in this subject population and decrease the hypersensitive response of hMT+. Additionally, a region within the brainstem (BS), likely containing the vestibular and trigeminal nuclei, showed increased optic flow-induced activity after tongue stimulation. The aim of this study was to understand how the modulation induced by tongue stimulation affects the balance-processing network as a whole and how modulation of BS structures can influence cortical activity. Four volumes of interest, discovered in a general linear model analysis, constitute major contributors to the balance-processing network. These regions were entered into a dynamic causal modeling analysis to map the network and measure any connection or topology changes due to the stimulation. Balance-impaired individuals had downregulated response of the primary visual cortex (V1) to visual stimuli but upregulated modulation of the connection between V1 and hMT+ by visual motion compared to healthy controls (p ≤ 1E-5). This upregulation was decreased to near-normal levels after stimulation. Additionally, the region within the BS showed increased response to visual motion after stimulation compared to both prestimulation and controls. Stimulation to the tongue enters the central nervous system at the BS but likely propagates to the cortex through supramodal information transfer. We present a model to explain these brain responses that utilizes an anatomically present, but functionally dormant pathway of information flow within the processing network.
Collapse
Affiliation(s)
- Joe C Wildenberg
- Neuroscience Training Program, University of Wisconsin, Madison, Wisconsin 53705, USA.
| | | | | | | | | |
Collapse
|
38
|
Stingl K, Zrenner E. Electronic Approaches to Restitute Vision in Patients with Neurodegenerative Diseases of the Retina. Ophthalmic Res 2013; 50:215-20. [DOI: 10.1159/000354424] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2013] [Accepted: 07/15/2013] [Indexed: 11/19/2022]
|
39
|
Abstract
Much of our science and technology relies on the visualization of complex data, and chemical biology, more than most fields, often deals with complex datasets. There are, however, other ways of making information available to our senses beyond the visual. Rare individuals naturally have sensory crossover, whose synesthesia permits them, for example, to see colors or shapes when hearing sounds or to sense a specific taste with a specific word. Many scientists, technologists and inventors, however, make a conscious attempt to convert one type of sensory-like input to a different sensory output. A laser light show, for example, converts sound to sight; infrared imaging converts heat to sight. Two recent examples of such intentional synesthesia are discussed in this context: sight-tasting and smell-seeing.
Collapse
Affiliation(s)
- Kenneth S Suslick
- Department of Chemistry, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA.
| |
Collapse
|
40
|
Wilson JA, Walton LM, Tyler M, Williams J. Lingual electrotactile stimulation as an alternative sensory feedback pathway for brain–computer interface applications. J Neural Eng 2012; 9:045007. [DOI: 10.1088/1741-2560/9/4/045007] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
41
|
Chekhchoukh A, Glade N. Influence of sparkle and saccades on tongue electro-stimulation-based vision substitution of 2D vectors. Acta Biotheor 2012; 60:41-53. [PMID: 22302363 DOI: 10.1007/s10441-012-9148-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2012] [Accepted: 01/17/2012] [Indexed: 10/14/2022]
Abstract
Vision substitution by electro-stimulation has been studied since the 60s beginning with P. Bach-y-Rita. Camera pictures or movies encoded in gray levels are displayed using an electro-stimulation display device on the surface of a body part, such as the skin or the tongue. Medical-technical devices have been developed on this principle to compensate for sensory-motor disabilities such as blindness or loss of balance, or to guide specific actions, such as surgery. However, the electrical signals of stationary or moving slowly moving objects, displayed on a Tongue display unit (TDU), are quickly lost due to saturation of receptors undergoing electrostimulation. We propose to add random saccades or sparkle to the displayed visual scene to increase the quality of pattern recognition by the subjects. In the present experimental trimodal study (normal vision, TDU vision substitution, or both), we show that the presence of a moderate sparkle level enhances the perception of the direction of lines drawn on a TDU and reduces the response time.
Collapse
|
42
|
Borisoff JF, Elliott SL, Hocaloski S, Birch GE. The development of a sensory substitution system for the sexual rehabilitation of men with chronic spinal cord injury. J Sex Med 2010; 7:3647-58. [PMID: 20807328 DOI: 10.1111/j.1743-6109.2010.01997.x] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
INTRODUCTION Sexual health is often severely impacted after spinal cord injury (SCI). Current research has primarily addressed male erection and fertility, when in fact pleasure and orgasm are top priorities for functional recovery. Sensory substitution technology operates by communicating input from a lost sensory pathway to another intact sensory modality. It was hypothesized that through training and neuroplasticity, mapped tongue sensations would be interpreted as sensory perceptions arising from insensate genitalia, and improve the sexual experience. AIM To report the development of a sensory substitution system for the sexual rehabilitation of men with chronic SCI. METHODS Subjects performed sexual self-stimulation while using a novel sensory substitution device that mapped the stroking motion of the hand to a congruous flow of electrocutaneous sensations on the tongue. MAIN OUTCOME MEASURES Three questionnaires, along with structured interviews, were used to rate the perceived sexual sensations following each training session. RESULTS Subjects completed 20 sessions over approximately 8 weeks of training. Each subject reported an increased level of sexual pleasure soon after training with the device. Each subject also reported specific perceptions of cutaneous-like sensations below their lesion that matched their hand motion. Later sessions, while remaining pleasurable and interesting, were inconsistent, and no subject reported an orgasmic feeling during a session. The subjects were all interested in continuing training with the device at home, if possible, in the future. CONCLUSIONS This study is the first to show that sensory substitution is a possible therapeutic avenue for sexual rehabilitation in people lacking normal genital sexual sensations. However more research, for instance on frequency and duration of training, is needed in order to induce functional lasting neuroplasticity. In the near term, SCI rehabilitation should more fully address sexuality and the role of neuroplasticity for promoting the maximal potential for sexual pleasure and orgasm.
Collapse
|
43
|
Konrad P, Shanks T. Implantable brain computer interface: Challenges to neurotechnology translation. Neurobiol Dis 2010; 38:369-75. [DOI: 10.1016/j.nbd.2009.12.007] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2009] [Revised: 09/18/2009] [Accepted: 12/08/2009] [Indexed: 10/20/2022] Open
|
44
|
Abstract
OBJECTIVE To determine the efficacy of vestibular rehabilitation with the electrotactile vestibular substitution system, as a new treatment modality in patients with bilateral vestibular disorders. STUDY DESIGN AND SETTINGS Nineteen patients with bilateral, chronic, idiopathic vestibulopathy were studied prospectively. Patients were divided to two groups. Patients in the first group were rehabilitated with the electrotactile vestibular substitution system, while patients in the second group were treated with standard vestibular rehabilitation therapy. The sensory organisation test and dizziness handicap inventory were used to compare the pre- and post-training results of both rehabilitative treatments. RESULTS All group one patients in the standardised testing subset demonstrated improved results for both the composite sensory organisation test and for the functional transfer aspect of the dizziness handicap inventory, after five days' training with the electrotactile vestibular substitution system. In contrast, group two patients showed no significant improvement in their composite sensory organisation test or dizziness handicap inventory scores after eight weeks of therapy, compared with pre-treatment levels. CONCLUSION These preliminary results indicate the efficacy of the electrotactile vestibular substitution system in improving patients' symptoms of vestibulopathy, and constitute evidence of successful sensory substitution.
Collapse
|
45
|
Eye position affects the perceived location of touch. Exp Brain Res 2009; 198:403-10. [PMID: 19533110 DOI: 10.1007/s00221-009-1884-4] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2008] [Accepted: 05/27/2009] [Indexed: 12/23/2022]
Abstract
Here, we demonstrate a systematic shift in the perceived location of a tactile stimulus on the arm toward where the eye is looking. Participants reported the perceived position of touches presented between the elbow and the wrist while maintaining eye positions at various eccentricities. The perceived location of the touch was shifted by between 1 and 5 cm (1.9 degrees -9.5 degrees visual angle) by a change in eye position of +/-25 degrees from straight ahead. In a control condition, we repeat the protocol with the eyes fixating straight ahead. Changes in attention accounted for only 17% of the shift due to eye position. The pattern of tactile shifts due to eye position was comparable whether or not the arm was visible. However, touches at locations along the forearm were perceived as being farther apart when the arm was visible compared to when it was covered. These results are discussed in terms of the coding of tactile space, which seems to require integration of tactile, visual and eye position information.
Collapse
|
46
|
Walther LE, Nikolaus T, Schaaf H, Hörmann K. [Vertigo and falls in the elderly: Part 2: Fall diagnostics, prophylaxis and therapy]. HNO 2008; 56:927-36; quiz 937. [PMID: 18712512 DOI: 10.1007/s00106-008-1802-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
In many acute or chronic vestibular diseases in old age, the risk of falling is increased. A fear of falling often develops together with further limitations to physical activity and subsequent physical and psychological consequences. Falls represent a substantial health-related risk factor. A regular balance, walking and muscle training is an effective prophylaxis. Components of the treatment of vestibular diseases in old age are counselling and encouragement (psychotherapy), treatment of the specific organic disease, specific vestibular rehabilitation and a symptomatic medication therapy. Vertigo in old age is a multifactorial process. The differential diagnosis of disorders of the equilibrium function in old age represents a challenge which can only be overcome by interdisciplinary cooperation.
Collapse
Affiliation(s)
- L E Walther
- HNO-Gemeinschaftspraxis, Main-Taunus-Zentrum, 65843, Sulzbach, Taunus, Deutschland.
| | | | | | | |
Collapse
|
47
|
Vestibular rehabilitation with electrotactile vestibular substitution: early effects. Eur Arch Otorhinolaryngol 2008; 266:1199-203. [PMID: 19082618 DOI: 10.1007/s00405-008-0886-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2008] [Accepted: 11/27/2008] [Indexed: 10/21/2022]
Abstract
We aimed to determine the early efficacy of vestibular rehabilitation with electrotactile vestibular substitution system (EVSS) as a new treatment modality in patients with bilateral vestibular loss due to aminoglycoside-induced ototoxicity. Six men and four women with bilateral vestibular failure were rehabilitated with EVSS prospectively. Patients were trained with EVSS for ten sessions each lasted 20 min, two sessions per day. Sensory organization test (SOT) protocol and dizziness handicap inventory (DHI) were used to compare pre- and post-training results of the rehabilitative treatment. Post-training tests were done at the first day of post-treatment period. All ten patients in the standardized testing subset demonstrated improved scores in the composite SOT scores and in the functional transfer testing with DHI after 5 days of training with the EVSS. In conclusion, these preliminary results demonstrate efficacy of the EVSS in improving patients symptoms and signs and signify the evidence of sensory substitution in the early post-training period.
Collapse
|
48
|
Abstract
Brain-computer interface (BCI) systems support communication through direct measures of neural activity without muscle activity. BCIs may provide the best and sometimes the only communication option for users disabled by the most severe neuromuscular disorders and may eventually become useful to less severely disabled and/or healthy individuals across a wide range of applications. This review discusses the structure and functions of BCI systems, clarifies terminology and addresses practical applications. Progress and opportunities in the field are also identified and explicated.
Collapse
Affiliation(s)
- Brendan Z Allison
- IAT, University of Bremen, Otto-Hahn-Allee NW1, N1151, 28359 Bremen, Germany.
| | | | | |
Collapse
|
49
|
Vuillerme N, Pinsault N, Chenu O, Demongeot J, Payan Y, Danilov Y. Sensory supplementation system based on electrotactile tongue biofeedback of head position for balance control. Neurosci Lett 2007; 431:206-10. [PMID: 18166270 DOI: 10.1016/j.neulet.2007.11.049] [Citation(s) in RCA: 33] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2007] [Revised: 10/18/2007] [Accepted: 11/12/2007] [Indexed: 11/25/2022]
Abstract
The present study aimed at investigating the effects of an artificial head position-based tongue-placed electrotactile biofeedback on postural control during quiet standing under different somatosensory conditions from the support surface. Eight young healthy adults were asked to stand as immobile as possible with their eyes closed on two Firm and Foam support surface conditions executed in two conditions of No-biofeedback and Biofeedback. In the Foam condition, a 6-cm thick foam support surface was placed under the subjects' feet to alter the quality and/or quantity of somatosensory information at the plantar sole and the ankle. The underlying principle of the biofeedback consisted of providing supplementary information about the head orientation with respect to gravitational vertical through electrical stimulation of the tongue. Centre of foot pressure (CoP) displacements were recorded using a force platform. Larger CoP displacements were observed in the Foam than Firm conditions in the two conditions of No-biofeedback and Biofeedback. Interestingly, this destabilizing effect was less accentuated in the Biofeedback than No-biofeedback condition. In accordance with the sensory re-weighting hypothesis for balance control, the present findings evidence that the availability of the central nervous system to integrate an artificial head orientation information delivered through electrical stimulation of the tongue to limit the postural perturbation induced by alteration of somatosensory input from the support surface.
Collapse
|