1
|
Lora-Rivera R, Oballe-Peinado Ó, Vidal-Verdú F. Proposal and Implementation of a Procedure for Compliance Recognition of Objects with Smart Tactile Sensors. Sensors (Basel) 2023; 23:4120. [PMID: 37112461 PMCID: PMC10144469 DOI: 10.3390/s23084120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 04/17/2023] [Accepted: 04/18/2023] [Indexed: 06/19/2023]
Abstract
This paper presents a procedure for classifying objects based on their compliance with information gathered using tactile sensors. Specifically, smart tactile sensors provide the raw moments of the tactile image when the object is squeezed and desqueezed. A set of simple parameters from moment-versus-time graphs are proposed as features, to build the input vector of a classifier. The extraction of these features was implemented in the field programmable gate array (FPGA) of a system on chip (SoC), while the classifier was implemented in its ARM core. Many different options were realized and analyzed, depending on their complexity and performance in terms of resource usage and accuracy of classification. A classification accuracy of over 94% was achieved for a set of 42 different classes. The proposed approach is intended for developing architectures with preprocessing on the embedded FPGA of smart tactile sensors, to obtain high performance in real-time complex robotic systems.
Collapse
Affiliation(s)
- Raúl Lora-Rivera
- Instituto de Investigación Biomédica de Málaga (IBIMA), Universidad de Málaga (UMA), 29010 Malaga, Spain
| | - Óscar Oballe-Peinado
- Instituto Universitario de Investigación en Ingeniería Mecatrónica y Sistemas Ciberfísicos (IMECH.UMA), Universidad de Málaga (UMA), 29017 Malaga, Spain; (Ó.O.-P.); (F.V.-V.)
| | - Fernando Vidal-Verdú
- Instituto Universitario de Investigación en Ingeniería Mecatrónica y Sistemas Ciberfísicos (IMECH.UMA), Universidad de Málaga (UMA), 29017 Malaga, Spain; (Ó.O.-P.); (F.V.-V.)
| |
Collapse
|
2
|
Remache-Vinueza B, Trujillo-León A, Zapata M, Sarmiento-Ortiz F, Vidal-Verdú F. Audio-Tactile Rendering: A Review on Technology and Methods to Convey Musical Information through the Sense of Touch. Sensors (Basel) 2021; 21:s21196575. [PMID: 34640895 PMCID: PMC8513049 DOI: 10.3390/s21196575] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 09/24/2021] [Accepted: 09/27/2021] [Indexed: 11/29/2022]
Abstract
Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to give the opportunity of experiencing music through touch to the hearing impaired. These devices may also be conceived as vibrotactile music players to enrich music listening activities. In this review, technology and methods to render musical information by means of vibrotactile stimuli are systematically studied. The methodology used to find out relevant literature is first outlined, and a preliminary classification of musical haptics is proposed. A comparison between different technologies and methods for vibrotactile rendering is performed to later organize the information according to the type of HMP. Limitations and advantages are highlighted to find out opportunities for future research. Likewise, methods for music audio-tactile rendering (ATR) are analyzed and, finally, strategies to compose for the sense of touch are summarized. This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR.
Collapse
Affiliation(s)
- Byron Remache-Vinueza
- Departamento de Electrónica, Universidad de Málaga, 29071 Málaga, Spain; (A.T.-L.); (F.V.-V.)
- SISAu Research Group, Facultad de Ingeniería y Tecnologías de la Información y la Comunicación, Universidad Tecnológica Indoamérica, Quito 170103, Ecuador;
- Correspondence:
| | - Andrés Trujillo-León
- Departamento de Electrónica, Universidad de Málaga, 29071 Málaga, Spain; (A.T.-L.); (F.V.-V.)
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain
| | - Mireya Zapata
- Research Center of Mechatronics and Interactive Systems—MIST, Facultad de Ingeniería y Tecnologías de la Información y la Comunicación, Universidad Tecnológica Indoamérica, Quito 170103, Ecuador;
| | - Fabián Sarmiento-Ortiz
- SISAu Research Group, Facultad de Ingeniería y Tecnologías de la Información y la Comunicación, Universidad Tecnológica Indoamérica, Quito 170103, Ecuador;
| | - Fernando Vidal-Verdú
- Departamento de Electrónica, Universidad de Málaga, 29071 Málaga, Spain; (A.T.-L.); (F.V.-V.)
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain
| |
Collapse
|
3
|
Trujillo-León A, de Guzmán-Manzano A, Velázquez R, Vidal-Verdú F. Generation of Gait Events with a FSR Based Cane Handle. Sensors (Basel) 2021; 21:5632. [PMID: 34451073 PMCID: PMC8402470 DOI: 10.3390/s21165632] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 08/18/2021] [Accepted: 08/19/2021] [Indexed: 01/01/2023]
Abstract
Gait analysis has many applications, and specifically can improve the control of prosthesis, exoskeletons, or Functional Electrical Stimulation systems. The use of canes is common to complement the assistance in these cases, and the synergy between upper and lower limbs can be exploited to obtain information about the gait. This is interesting especially in the case of unilateral assistance, for instance in the case of one side lower limb exoskeletons. If the cane is instrumented, it can hold sensors that otherwise should be attached to the body of the impaired user. This can ease the use of the assistive system in daily life as well as its acceptance. Moreover, Force Sensing Resistors (FSRs) are common in gait phase detection systems, and force sensors are also common in user intention detection. Therefore, a cane that incorporates FSRs on the handle can take advantage from the direct interface with the human and provide valuable information to implement real-time control. This is done in this paper, and the results confirm that many events are detected from variables derived from the readings of the FSRs that provide rich information about gait. However, a large inter-subject variability points to the need of tailored control systems.
Collapse
Affiliation(s)
- Andrés Trujillo-León
- Departamento de Electrónica, Universidad de Málaga, 29071 Málaga, Spain;
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29071 Málaga, Spain
| | | | - Ramiro Velázquez
- Facultad de Ingeniería, Universidad Panamericana, Aguascalientes 29020, Mexico;
| | - Fernando Vidal-Verdú
- Departamento de Electrónica, Universidad de Málaga, 29071 Málaga, Spain;
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29071 Málaga, Spain
| |
Collapse
|
4
|
Abstract
Assistive ambulatory devices are used for gait rehabilitation and assistance. In both cases, their benefit is greater when they are used properly. As for canes, embedded sensors can be used for monitoring purposes. In this paper, a custom tactile handle equipping a cane is described. It is composed of cost-effective commercially available pressure sensors. Experimental results involving 10 subjects show that the developed handle can provide information on the cane orientation as well as on the load applied to it during assisted gait. These data can help monitoring the cane usage and misuses detection.
Collapse
|
5
|
Sánchez-Durán JA, Vidal-Verdú F, Oballe-Peinado Ó, Castellanos-Ramos J, Hidalgo-López JA. A new model based on adaptation of the external loop to compensate the hysteresis of tactile sensors. Sensors (Basel) 2015; 15:26170-97. [PMID: 26501279 PMCID: PMC4634431 DOI: 10.3390/s151026170] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/12/2015] [Revised: 09/28/2015] [Accepted: 10/09/2015] [Indexed: 11/16/2022]
Abstract
This paper presents a novel method to compensate for hysteresis nonlinearities observed in the response of a tactile sensor. The External Loop Adaptation Method (ELAM) performs a piecewise linear mapping of the experimentally measured external curves of the hysteresis loop to obtain all possible internal cycles. The optimal division of the input interval where the curve is approximated is provided by the error minimization algorithm. This process is carried out off line and provides parameters to compute the split point in real time. A different linear transformation is then performed at the left and right of this point and a more precise fitting is achieved. The models obtained with the ELAM method are compared with those obtained from three other approaches. The results show that the ELAM method achieves a more accurate fitting. Moreover, the involved mathematical operations are simpler and therefore easier to implement in devices such as Field Programmable Gate Array (FPGAs) for real time applications. Furthermore, the method needs to identify fewer parameters and requires no previous selection process of operators or functions. Finally, the method can be applied to other sensors or actuators with complex hysteresis loop shapes.
Collapse
Affiliation(s)
- José A Sánchez-Durán
- Universidad de Málaga, Andalucía Tech, Departamento de Electrónica, ETSI Informática, Campus de Teatinos, 29071 Málaga, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain.
| | - Fernando Vidal-Verdú
- Universidad de Málaga, Andalucía Tech, Departamento de Electrónica, ETSI Informática, Campus de Teatinos, 29071 Málaga, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain.
| | - Óscar Oballe-Peinado
- Universidad de Málaga, Andalucía Tech, Departamento de Electrónica, ETSI Informática, Campus de Teatinos, 29071 Málaga, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain.
| | - Julián Castellanos-Ramos
- Universidad de Málaga, Andalucía Tech, Departamento de Electrónica, ETSI Informática, Campus de Teatinos, 29071 Málaga, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain.
| | - José A Hidalgo-López
- Universidad de Málaga, Andalucía Tech, Departamento de Electrónica, ETSI Informática, Campus de Teatinos, 29071 Málaga, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), 29010 Málaga, Spain.
| |
Collapse
|
6
|
Sánchez-Durán JA, Hidalgo-López JA, Castellanos-Ramos J, Oballe-Peinado Ó, Vidal-Verdú F. Influence of Errors in Tactile Sensors on Some High Level Parameters Used for Manipulation with Robotic Hands. Sensors (Basel) 2015; 15:20409-35. [PMID: 26295393 PMCID: PMC4570428 DOI: 10.3390/s150820409] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2015] [Revised: 07/20/2015] [Accepted: 08/10/2015] [Indexed: 11/16/2022]
Abstract
Tactile sensors suffer from many types of interference and errors like crosstalk, non-linearity, drift or hysteresis, therefore calibration should be carried out to compensate for these deviations. However, this procedure is difficult in sensors mounted on artificial hands for robots or prosthetics for instance, where the sensor usually bends to cover a curved surface. Moreover, the calibration procedure should be repeated often because the correction parameters are easily altered by time and surrounding conditions. Furthermore, this intensive and complex calibration could be less determinant, or at least simpler. This is because manipulation algorithms do not commonly use the whole data set from the tactile image, but only a few parameters such as the moments of the tactile image. These parameters could be changed less by common errors and interferences, or at least their variations could be in the order of those caused by accepted limitations, like reduced spatial resolution. This paper shows results from experiments to support this idea. The experiments are carried out with a high performance commercial sensor as well as with a low-cost error-prone sensor built with a common procedure in robotics.
Collapse
Affiliation(s)
- José A Sánchez-Durán
- Departamento de Electrónica, ETSI Informática Universidad de Málaga, Andalucía Tech, Campus de Teatinos, Málaga 29071, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), Málaga 29010, Spain.
| | - José A Hidalgo-López
- Departamento de Electrónica, ETSI Informática Universidad de Málaga, Andalucía Tech, Campus de Teatinos, Málaga 29071, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), Málaga 29010, Spain.
| | - Julián Castellanos-Ramos
- Departamento de Electrónica, ETSI Informática Universidad de Málaga, Andalucía Tech, Campus de Teatinos, Málaga 29071, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), Málaga 29010, Spain.
| | - Óscar Oballe-Peinado
- Departamento de Electrónica, ETSI Informática Universidad de Málaga, Andalucía Tech, Campus de Teatinos, Málaga 29071, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), Málaga 29010, Spain.
| | - Fernando Vidal-Verdú
- Departamento de Electrónica, ETSI Informática Universidad de Málaga, Andalucía Tech, Campus de Teatinos, Málaga 29071, Spain.
- Instituto de Investigación Biomédica de Málaga (IBIMA), Málaga 29010, Spain.
| |
Collapse
|
7
|
Oballe-Peinado Ó, Castellanos-Ramos J, Hidalgo-López JA, Vidal-Verdú F. Direct interfaces for smart skins based on FPGAs. ACTA ACUST UNITED AC 2009. [DOI: 10.1117/12.821642] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
|
8
|
Abstract
This paper presents an up-to-date survey of graphical tactile displays. These devices provide information through the sense of touch. At best, they should display both text and graphics (text may be considered a type of graphic). Graphs made with shapeable sheets result in bulky items awkward to store and transport; their production is expensive and time-consuming and they deteriorate quickly. Research is ongoing for a refreshable tactile display that acts as an output device for a computer or other information source and can present the information in text and graphics. The work in this field has branched into diverse areas, from physiological studies to technological aspects and challenges. Moreover, interest in these devices is now being shown by other fields such as virtual reality, minimally invasive surgery and teleoperation. It is attracting more and more people, research and money. Many proposals have been put forward, several of them succeeding in the task of presenting tactile information. However, most are research prototypes and very expensive to produce commercially. Thus the goal of an efficient low-cost tactile display for visually-impaired people has not yet been reached.
Collapse
|