1
|
Muñoz J, de Santos-Rico R, Mena L, Monje CA. Humanoid Head Camera Stabilization Using a Soft Robotic Neck and a Robust Fractional Order Controller. Biomimetics (Basel) 2024; 9:219. [PMID: 38667231 PMCID: PMC11048281 DOI: 10.3390/biomimetics9040219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 03/23/2024] [Accepted: 03/25/2024] [Indexed: 04/28/2024] Open
Abstract
In this paper, a new approach for head camera stabilization of a humanoid robot head is proposed, based on a bio-inspired soft neck. During walking, the sensors located on the humanoid's head (cameras or inertial measurement units) show disturbances caused by the torso inclination changes inherent to this process. This is currently solved by a software correction of the measurement, or by a mechanical correction by motion cancellation. Instead, we propose a novel mechanical correction, based on strategies observed in different animals, by means of a soft neck, which is used to provide more natural and compliant head movements. Since the neck presents a complex kinematic model and nonlinear behavior due to its soft nature, the approach requires a robust control solution. Two different control approaches are addressed: a classical PID controller and a fractional order controller. For the validation of the control approaches, an extensive set of experiments is performed, including real movements of the humanoid, different head loading conditions or transient disturbances. The results show the superiority of the fractional order control approach, which provides higher robustness and performance.
Collapse
Affiliation(s)
- Jorge Muñoz
- Center for Automation and Robotics, Spanish National Research Council (CSIC), 28049 Madrid, Spain
| | - Raúl de Santos-Rico
- Department of Systems Engineering and Automation, Carlos III University of Madrid, 28903 Madrid, Spain; (R.d.S.-R.); (L.M.); (C.A.M.)
| | - Lisbeth Mena
- Department of Systems Engineering and Automation, Carlos III University of Madrid, 28903 Madrid, Spain; (R.d.S.-R.); (L.M.); (C.A.M.)
| | - Concepción A. Monje
- Department of Systems Engineering and Automation, Carlos III University of Madrid, 28903 Madrid, Spain; (R.d.S.-R.); (L.M.); (C.A.M.)
| |
Collapse
|
2
|
Itahara A, Kano F. Gaze tracking of large-billed crows (Corvus macrorhynchos) in a motion capture system. J Exp Biol 2024; 227:jeb246514. [PMID: 38362616 PMCID: PMC11007591 DOI: 10.1242/jeb.246514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 02/07/2024] [Indexed: 02/17/2024]
Abstract
Previous studies often inferred the focus of a bird's attention from its head movements because it provides important clues about their perception and cognition. However, it remains challenging to do so accurately, as the details of how they orient their visual field toward the visual targets remain largely unclear. We thus examined visual field configurations and the visual field use of large-billed crows (Corvus macrorhynchos Wagler 1827). We used an established ophthalmoscopic reflex technique to identify the visual field configuration, including the binocular width and optical axes, as well as the degree of eye movement. A newly established motion capture system was then used to track the head movements of freely moving crows to examine how they oriented their reconstructed visual fields toward attention-getting objects. When visual targets were moving, the crows frequently used their binocular visual fields, particularly around the projection of the beak-tip. When the visual targets stopped moving, crows frequently used non-binocular visual fields, particularly around the regions where their optical axes were found. On such occasions, the crows slightly preferred the right eye. Overall, the visual field use of crows is clearly predictable. Thus, while the untracked eye movements could introduce some level of uncertainty (typically within 15 deg), we demonstrated the feasibility of inferring a crow's attentional focus by 3D tracking of their heads. Our system represents a promising initial step towards establishing gaze tracking methods for studying corvid behavior and cognition.
Collapse
Affiliation(s)
- Akihiro Itahara
- Wildlife Research Center, Kyoto University, Kyoto 6068203, Japan
| | - Fumihiro Kano
- Centre for the Advanced Study of Collective Behavior, University of Konstanz, Konstanz 78464, Germany
- Max-Planck Institute of Animal Behavior, Radolfzell 78315, Germany
| |
Collapse
|
3
|
Kano F, Naik H, Keskin G, Couzin ID, Nagy M. Head-tracking of freely-behaving pigeons in a motion-capture system reveals the selective use of visual field regions. Sci Rep 2022; 12:19113. [PMID: 36352049 PMCID: PMC9646700 DOI: 10.1038/s41598-022-21931-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 10/06/2022] [Indexed: 11/11/2022] Open
Abstract
Using a motion-capture system and custom head-calibration methods, we reconstructed the head-centric view of freely behaving pigeons and examined how they orient their head when presented with various types of attention-getting objects at various relative locations. Pigeons predominantly employed their retinal specializations to view a visual target, namely their foveas projecting laterally (at an azimuth of ± 75°) into the horizon, and their visually-sensitive "red areas" projecting broadly into the lower-frontal visual field. Pigeons used their foveas to view any distant object while they used their red areas to view a nearby object on the ground (< 50 cm). Pigeons "fixated" a visual target with their foveas; the intervals between head-saccades were longer when the visual target was viewed by birds' foveas compared to when it was viewed by any other region. Furthermore, pigeons showed a weak preference to use their right eye to examine small objects distinctive in detailed features and their left eye to view threat-related or social stimuli. Despite the known difficulty in identifying where a bird is attending, we show that it is possible to estimate the visual attention of freely-behaving birds by tracking the projections of their retinal specializations in their visual field with cutting-edge methods.
Collapse
Affiliation(s)
- Fumihiro Kano
- grid.9811.10000 0001 0658 7699Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Universitätsstraße 10, 78464 Konstanz, Germany ,grid.507516.00000 0004 7661 536XDepartment of Collective Behaviour, Max-Planck Institute of Animal Behavior, Konstanz, Germany
| | - Hemal Naik
- grid.507516.00000 0004 7661 536XDepartment of Collective Behaviour, Max-Planck Institute of Animal Behavior, Konstanz, Germany ,grid.507516.00000 0004 7661 536XDepartment of Ecology of Animal Societies, Max-Planck Institute of Animal Behavior, Konstanz, Germany ,grid.5252.00000 0004 1936 973XComputer Aided Medical Procedures, Teschnische Universiät Munchen, Munich, Germany ,grid.9811.10000 0001 0658 7699Department of Biology, University of Konstanz, Konstanz, Germany
| | - Göksel Keskin
- grid.5018.c0000 0001 2149 4407MTA-ELTE Lendület Collective Behaviour Research Group, Hungarian Academy of Sciences, Budapest, Hungary ,grid.5591.80000 0001 2294 6276Department of Biological Physics, Eötvös Loránd University, Budapest, Hungary
| | - Iain D. Couzin
- grid.9811.10000 0001 0658 7699Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Universitätsstraße 10, 78464 Konstanz, Germany ,grid.507516.00000 0004 7661 536XDepartment of Collective Behaviour, Max-Planck Institute of Animal Behavior, Konstanz, Germany ,grid.9811.10000 0001 0658 7699Department of Biology, University of Konstanz, Konstanz, Germany
| | - Máté Nagy
- grid.507516.00000 0004 7661 536XDepartment of Collective Behaviour, Max-Planck Institute of Animal Behavior, Konstanz, Germany ,grid.5018.c0000 0001 2149 4407MTA-ELTE Lendület Collective Behaviour Research Group, Hungarian Academy of Sciences, Budapest, Hungary ,grid.5591.80000 0001 2294 6276Department of Biological Physics, Eötvös Loránd University, Budapest, Hungary
| |
Collapse
|
4
|
Wittek N, Matsui H, Kessel N, Oeksuez F, Güntürkün O, Anselme P. Mirror Self-Recognition in Pigeons: Beyond the Pass-or-Fail Criterion. Front Psychol 2021; 12:669039. [PMID: 34079500 PMCID: PMC8165164 DOI: 10.3389/fpsyg.2021.669039] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 04/21/2021] [Indexed: 11/13/2022] Open
Abstract
Spontaneous mirror self-recognition is achieved by only a limited number of species, suggesting a sharp "cognitive Rubicon" that only few can pass. But is the demarcation line that sharp? In studies on monkeys, who do not recognize themselves in a mirror, animals can make a difference between their mirror image and an unknown conspecific. This evidence speaks for a gradualist view of mirror self-recognition. We hypothesize that such a gradual process possibly consists of at least two independent aptitudes, the ability to detect synchronicity between self- and foreign movement and the cognitive understanding that the mirror reflection is oneself. Pigeons are known to achieve the first but fail at the second aptitude. We therefore expected them to treat their mirror image differently from an unknown pigeon, without being able to understand that the mirror reflects their own image. We tested pigeons in a task where they either approached a mirror or a Plexiglas barrier to feed. Behind the Plexiglas an unknown pigeon walked at the same time toward the food bowl. Thus, we pitched a condition with a mirror-self and a foreign bird against each other, with both of them walking close toward the food bowl. By a detailed analysis of a whole suit of behavioral details, our results make it likely that the foreign pigeon was treated as a competitor while the mirror image caused hesitation as if being an uncanny conspecific. Our results are akin to those with monkeys and show that pigeons do not equal their mirror reflection with a conspecific, although being unable to recognize themselves in the mirror.
Collapse
Affiliation(s)
- Neslihan Wittek
- Faculty of Psychology, Department of Biopsychology, Ruhr University Bochum, Bochum, Germany
| | - Hiroshi Matsui
- Faculty of Psychology, Department of Biopsychology, Ruhr University Bochum, Bochum, Germany
| | - Nicole Kessel
- Faculty of Psychology, University of Hagen, Hagen, Germany
| | - Fatma Oeksuez
- Faculty of Psychology, Department of Biopsychology, Ruhr University Bochum, Bochum, Germany
| | - Onur Güntürkün
- Faculty of Psychology, Department of Biopsychology, Ruhr University Bochum, Bochum, Germany
| | - Patrick Anselme
- Faculty of Psychology, Department of Biopsychology, Ruhr University Bochum, Bochum, Germany
| |
Collapse
|
5
|
Directional differences in head stabilisation in Acanthodactylus pardalis lizards. J Biomech 2021; 121:110418. [PMID: 33887537 DOI: 10.1016/j.jbiomech.2021.110418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 02/05/2021] [Accepted: 03/21/2021] [Indexed: 11/20/2022]
Abstract
Running inevitably causes the animal trunk to undulate. The consequential head rotations have to be stabilised in space for a steady gaze and an accurate sense of self-motion for balance. The ecology and anatomy of the species determine the necessity to stabilise the head in yaw, pitch, and roll direction. Terrestrial lizards, running with a sprawled body posture, are especially prone to undulations in the horizontal (yaw) plane. Measurements on an experimental oscillation platform show that Acanthodactylus pardalis lizards stabilise their head less in pitch direction (54% stabilisation) than in yaw and roll direction (66% and 64% stabilisation, respectively). Because we performed these experiments in darkness, the lizards based their head stabilisation on vestibular information. Hence, we hypothesised that their vestibular system is less sensitive in pitch direction than in yaw and roll direction. Yet, this was not confirmed by a detailed Fluid-Structure Interaction model of the membranous labyrinth, which showed that not pitch sensitivity (88% of yaw sensitivity), but roll sensitivity (73% of yaw sensitivity) is the lowest. So why is the head stabilisation in darkness almost as good in roll direction as in yaw direction? While this may be due to neurological nonlinearities, it seems worth noticing that the moment of inertia is lowest in roll direction due to the elongated head shape. Hence, less torque is needed to stabilise a head rotation in roll direction than in the other two directions.
Collapse
|
6
|
Jorissen C, Paillet E, Scholliers J, Aerts P, Goyens J. Head stabilization in small vertebrates that run at high frequencies with a sprawled posture. Biol J Linn Soc Lond 2020. [DOI: 10.1093/biolinnean/blaa034] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Abstract
Small animals face a large challenge when running. A stable head is key to maintenance of a stable gaze and a good sense of self-motion and spatial awareness. However, trunk undulations caused by the cyclic limb movements result in involuntary head movements. Hence, the head needs to be stabilized. Humans are capable of stabilizing their head up to 2–3 Hz, but small animals run at cycle frequencies that are up to six times higher. We wondered how natural selection has adapted their head stabilization control. We observed that the relative contributions of vision, on the one hand, and vestibular perception and proprioception, on the other hand, remain the same when lizards undergo fast or slow body undulations in an experimental set-up. Lizards also maintain a short phase lag at both low and high undulation frequencies. Hence, we found no indication that they use a different control mechanism at high frequencies. Instead, head stabilization probably remains possible owing to faster reflex pathways and a lower head inertia. Hence, the intrinsic physical and neurological characteristics of lizards seem to be sufficient to enable head stabilization at high frequencies, obviating the need for evolutionary adaptation of the control pathways. These properties are not unique to lizards and might, therefore, also facilitate head stabilization at high frequencies in other small, fast animals.
Collapse
Affiliation(s)
- Cas Jorissen
- Laboratory of Functional Morphology, University of Antwerp, Universiteitsplein, Antwerpen, Belgium
| | - Eric Paillet
- Constrained Systems Lab, University of Antwerp, Groenenborgerlaan, Antwerpen, Belgium
| | - Jan Scholliers
- Laboratory of Functional Morphology, University of Antwerp, Universiteitsplein, Antwerpen, Belgium
| | - Peter Aerts
- Laboratory of Functional Morphology, University of Antwerp, Universiteitsplein, Antwerpen, Belgium
- Department of Movement and Sports Sciences, University of Ghent, Watersportlaan, Ghent, Belgium
| | - Jana Goyens
- Laboratory of Functional Morphology, University of Antwerp, Universiteitsplein, Antwerpen, Belgium
| |
Collapse
|
7
|
Quinn D, Kress D, Chang E, Stein A, Wegrzynski M, Lentink D. How lovebirds maneuver through lateral gusts with minimal visual information. Proc Natl Acad Sci U S A 2019; 116:15033-15041. [PMID: 31289235 PMCID: PMC6660782 DOI: 10.1073/pnas.1903422116] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Flying birds maneuver effectively through lateral gusts, even when gust speeds are as high as flight speeds. What information birds use to sense gusts and how they compensate is largely unknown. We found that lovebirds can maneuver through 45° lateral gusts similarly well in forest-, lake-, and cave-like visual environments. Despite being diurnal and raised in captivity, the birds fly to their goal perch with only a dim point light source as a beacon, showing that they do not need optic flow or a visual horizon to maneuver. To accomplish this feat, lovebirds primarily yaw their bodies into the gust while fixating their head on the goal using neck angles of up to 30°. Our corroborated model for proportional yaw reorientation and speed control shows how lovebirds can compensate for lateral gusts informed by muscle proprioceptive cues from neck twist. The neck muscles not only stabilize the lovebirds' visual and inertial head orientations by compensating low-frequency body maneuvers, but also attenuate faster 3D wingbeat-induced perturbations. This head stabilization enables the vestibular system to sense the direction of gravity. Apparently, the visual horizon can be replaced by a gravitational horizon to inform the observed horizontal gust compensation maneuvers in the dark. Our scaling analysis shows how this minimal sensorimotor solution scales favorably for bigger birds, offering local wind angle feedback within a wingbeat. The way lovebirds glean wind orientation may thus inform minimal control algorithms that enable aerial robots to maneuver in similar windy and dark environments.
Collapse
Affiliation(s)
- Daniel Quinn
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305;
- Mechanical & Aerospace Engineering Department, University of Virginia, Charlottesville, VA 22904
- Electrical & Computer Engineering Department, University of Virginia, Charlottesville, VA 22904
| | - Daniel Kress
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305
| | - Eric Chang
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305
| | - Andrea Stein
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305
| | - Michal Wegrzynski
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305
| | - David Lentink
- Mechanical Engineering Department, Stanford University, Stanford, CA 94305;
| |
Collapse
|