1
|
Ouyang Q, Wu J, Sun S, Pensa J, Abiri A, Dutson E, Bisley J. Bio-inspired Haptic Feedback for Artificial Palpation in Robotic Surgery. IEEE Trans Biomed Eng 2021; 68:3184-3193. [PMID: 33905321 DOI: 10.1109/tbme.2021.3076094] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Adding haptic feedback has been reported to improve the outcome of minimally invasive robotic surgery. In this study, we seek to determine whether an algorithm based on simulating responses of a cutaneous afferent population can be implemented to improve the performance of presenting haptic feedback for robot-assisted surgery. We propose a bio-inspired controlling model to present vibration and force feedback to help surgeons localize underlying structures in phantom tissue. A single pair of actuators was controlled by outputs of a model of a population of cutaneous afferents based on the pressure signal from a single sensor embedded in surgical forceps. We recruited 25 subjects including 10 expert surgeons to evaluate the performance of the bio-inspired controlling model in an artificial palpation task using the da Vinci surgical robot. Among the control methods tested, the bio-inspired system was unique in allowing both novices and experts to easily identify the locations of all classes of tumors and did so with reduced contact force and tumor contact time. This work demonstrates the utility of our bio-inspired multi-modal feedback system, which resulted in superior performance for both novice and professional users, in comparison to a traditional linear and the existing piecewise discrete algorithms of haptic feedback.
Collapse
|
2
|
Kvansakul J, Hamilton L, Ayton LN, McCarthy C, Petoe MA. Sensory augmentation to aid training with retinal prostheses. J Neural Eng 2020; 17:045001. [PMID: 32554868 DOI: 10.1088/1741-2552/ab9e1d] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
OBJECTIVE Retinal prosthesis recipients require rehabilitative training to learn the non-intuitive nature of prosthetic 'phosphene vision'. This study investigated whether the addition of auditory cues, using The vOICe sensory substitution device (SSD), could improve functional performance with simulated phosphene vision. APPROACH Forty normally sighted subjects completed two visual tasks under three conditions. The phosphene condition converted the image to simulated phosphenes displayed on a virtual reality headset. The SSD condition provided auditory information via stereo headphones, translating the image into sound. Horizontal information was encoded as stereo timing differences between ears, vertical information as pitch, and pixel intensity as audio intensity. The third condition combined phosphenes and SSD. Tasks comprised light localisation from the Basic Assessment of Light and Motion (BaLM) and the Tumbling-E from the Freiburg Acuity and Contrast Test (FrACT). To examine learning effects, twenty of the forty subjects received SSD training prior to assessment. MAIN RESULTS Combining phosphenes with auditory SSD provided better light localisation accuracy than either phosphenes or SSD alone, suggesting a compound benefit of integrating modalities. Although response times for SSD-only were significantly longer than all other conditions, combined condition response times were as fast as phosphene-only, highlighting that audio-visual integration provided both response time and accuracy benefits. Prior SSD training provided a benefit to localisation accuracy and speed in SSD-only (as expected) and Combined conditions compared to untrained SSD-only. Integration of the two modalities did not improve spatial resolution task performance, with resolution limited to that of the higher resolution modality (SSD). SIGNIFICANCE Combining phosphene (visual) and SSD (auditory) modalities was effective even without SSD training and led to an improvement in light localisation accuracy and response times. Spatial resolution performance was dominated by auditory SSD. The results suggest there may be a benefit to including auditory cues when training vision prosthesis recipients.
Collapse
Affiliation(s)
- Jessica Kvansakul
- Bionics Institute, East Melbourne, VIC, Australia. Department of Medical Bionics, University of Melbourne, Parkville, VIC, Australia
| | | | | | | | | |
Collapse
|
3
|
Iandolo R, Carè M, Shah VA, Schiavi S, Bommarito G, Boffa G, Giannoni P, Inglese M, Mrotek LA, Scheidt RA, Casadio M. A two alternative forced choice method for assessing vibrotactile discrimination thresholds in the lower limb. Somatosens Mot Res 2019; 36:162-170. [PMID: 31267810 DOI: 10.1080/08990220.2019.1632184] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
The development of an easy to implement, quantitative measure to examine vibration perception would be useful for future application in clinical settings. Vibration sense in the lower limb of younger and older adults was examined using the method of constant stimuli (MCS) and the two-alternative forced choice paradigm. The focus of this experiment was to determine an appropriate stimulation site on the lower limb (tendon versus bone) to assess vibration threshold and to determine if the left and right legs have varying thresholds. Discrimination thresholds obtained at two stimulation sites in the left and right lower limbs showed differences in vibration threshold across the two ages groups, but not across sides of the body nor between stimulation sites within each limb. Overall, the MCS can be implemented simply, reliably, and with minimal time. It can also easily be implemented with low-cost technology. Therefore, it could be a good candidate method to assess the presence of specific deep sensitivity deficits in clinical practice, particularly in populations likely to show the onset of sensory deficits.
Collapse
Affiliation(s)
- Riccardo Iandolo
- a Robotics, Brain and Cognitive Sciences , Istituto Italiano di Tecnologia , Genova , Italy.,b Department of Informatics, Bioengineering, Robotics and System Engineering , University of Genova , Genova , Italy
| | - Marta Carè
- b Department of Informatics, Bioengineering, Robotics and System Engineering , University of Genova , Genova , Italy
| | - Valay A Shah
- c Department of Biomedical Engineering , Marquette University and Medical College of Wisconsin , Milwaukee , WI , USA
| | - Simona Schiavi
- d Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health , University of Genova , Genova , Italy
| | - Giulia Bommarito
- d Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health , University of Genova , Genova , Italy
| | - Giacomo Boffa
- d Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health , University of Genova , Genova , Italy
| | - Psiche Giannoni
- b Department of Informatics, Bioengineering, Robotics and System Engineering , University of Genova , Genova , Italy
| | - Matilde Inglese
- d Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health , University of Genova , Genova , Italy.,e Ospedale Policlinico San Martino-IRCSS , Genova , Italy
| | - Leigh Ann Mrotek
- c Department of Biomedical Engineering , Marquette University and Medical College of Wisconsin , Milwaukee , WI , USA
| | - Robert A Scheidt
- c Department of Biomedical Engineering , Marquette University and Medical College of Wisconsin , Milwaukee , WI , USA.,f Feinberg School of Medicine , Northwestern University , Chicago , IL , USA.,g Division of Civil, Mechanical and Manufacturing Innovation , National Science Foundation , Alexandria , VA , USA
| | - Maura Casadio
- a Robotics, Brain and Cognitive Sciences , Istituto Italiano di Tecnologia , Genova , Italy.,b Department of Informatics, Bioengineering, Robotics and System Engineering , University of Genova , Genova , Italy
| |
Collapse
|
4
|
Stronks HC, Parker DJ, Stacey A, Barnes N. Psychophysical Evaluation of a Tactile Display Based on Coin Motors. Artif Organs 2018; 42:1224-1233. [PMID: 29761832 DOI: 10.1111/aor.13134] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2017] [Revised: 01/21/2018] [Accepted: 02/02/2018] [Indexed: 11/28/2022]
Abstract
Tactile vision substitution devices present visual images as tactile representations on the skin. In this study we have tested the performance of a prototype 96-tactor vibrotactile using a subset of 64 tactors. We have determined the tactile spatial acuity and intensity discrimination in 14 naïve subjects. Spatial acuity was determined using a grating acuity task. Subjects could successfully identify the orientation of horizontal and vertical gratings with an average psychophysical threshold of 120 mm. When diagonal gratings were included in the analysis, the median performance dropped below psychophysical threshold, but was still significantly above chance at gratings of 142 mm wide. Intensity discrimination yielded an average Weber fraction of 0.44, corresponding to 13 discernable "gray levels" in the available dynamic range. Interleaved stimulation of the motors did not significantly affect spatial acuity or intensity discrimination.
Collapse
Affiliation(s)
- H Christiaan Stronks
- Department of Computer Vision, Data61 CSIRO, Canberra, Australia.,Department of Otorhinolaryngology, Leiden University Medical Center, Leiden, The Netherlands.,Department of Neuroscience, Australian National University, Canberra, Australia
| | - Daniel J Parker
- Department of Computer Vision, Data61 CSIRO, Canberra, Australia
| | - Ashley Stacey
- Department of Computer Vision, Data61 CSIRO, Canberra, Australia
| | - Nick Barnes
- Department of Computer Vision, Data61 CSIRO, Canberra, Australia.,Research School of Engineering, Australian National University, Canberra, Australia
| |
Collapse
|
5
|
Stronks HC, Walker J, Parker DJ, Barnes N. Training Improves Vibrotactile Spatial Acuity and Intensity Discrimination on the Lower Back Using Coin Motors. Artif Organs 2017; 41:1059-1070. [DOI: 10.1111/aor.12882] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2016] [Revised: 08/10/2016] [Accepted: 09/21/2016] [Indexed: 11/27/2022]
Affiliation(s)
- H. Christiaan Stronks
- NICTAComputer Vision Research GroupCanberra Australia
- Department of Neuroscience, The John Curtin School of Medical ResearchAustralian National UniversityCanberra Australia
| | - Janine Walker
- NICTAComputer Vision Research GroupCanberra Australia
- Centre for Mental Health ResearchAustralian National UniversityCanberra Australia
| | | | - Nick Barnes
- NICTAComputer Vision Research GroupCanberra Australia
- College of Engineering and Computer ScienceAustralian National UniversityCanberra Australia
| |
Collapse
|
6
|
Abstract
In this Editor's Review, articles published in 2015 are organized by category and briefly summarized. We aim to provide a brief reflection of the currently available worldwide knowledge that is intended to advance and better human life while providing insight for continued application of technologies and methods of organ Replacement, Recovery, and Regeneration. As the official journal of The International Federation for Artificial Organs, The International Faculty for Artificial Organs, the International Society for Rotary Blood Pumps, the International Society for Pediatric Mechanical Cardiopulmonary Support, and the Vienna International Workshop on Functional Electrical Stimulation, Artificial Organs continues in the original mission of its founders "to foster communications in the field of artificial organs on an international level." Artificial Organs continues to publish developments and clinical applications of artificial organ technologies in this broad and expanding field of organ Replacement, Recovery, and Regeneration from all over the world. We take this time also to express our gratitude to our authors for providing their work to this journal. We offer our very special thanks to our reviewers who give so generously of their time and expertise to review, critique, and especially provide meaningful suggestions to the author's work whether eventually accepted or rejected. Without these excellent and dedicated reviewers, the quality expected from such a journal could not be possible. We also express our special thanks to our Publisher, John Wiley & Sons for their expert attention and support in the production and marketing of Artificial Organs. We look forward to reporting further advances in the coming years.
Collapse
|
7
|
Stronks HC, Parker DJ, Barnes N. Vibrotactile Spatial Acuity and Intensity Discrimination on the Lower Back Using Coin Motors. IEEE TRANSACTIONS ON HAPTICS 2016; 9:446-454. [PMID: 27214917 DOI: 10.1109/toh.2016.2569484] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Tactile vision substitution devices are assistive devices for the blind that redirect visual information to the skin. The amount of visual information that can be presented on a tactile display is limited mainly by the spatial resolution of the skin and the ability to distinguish between various vibration intensities. In this study, we have determined the two-point discrimination (TPD) threshold and intensity-discrimination threshold (just-noticeable difference, or JND) on the lower back using coin motors. Given the importance of stimulus timing, we have determined TPD threshold and JND at different stimulus onset asynchronies (SOAs). The JND was determined between two coin motors with a distance equal to the TPD threshold. In this way, we could establish the contrast sensitivity at the maximal theoretical resolution. TPD thresholds tended to decrease at longer SOAs, from 52 mm edge-to-edge at an SOA of 0 ms, to 28 mm at 200 ms. The JND did not depend on SOA, and the average Weber fraction was 0.14. A median of 5 JNDs was available across the available dynamic range. Together, these data provide the predicted spatial resolution and contrast resolution achievable with a back-worn tactile display based on coin motors.
Collapse
|