1
|
Yang Y, Yared DG, Fortune ES, Cowan NJ. Sensorimotor adaptation to destabilizing dynamics in weakly electric fish. Curr Biol 2024; 34:2118-2131.e5. [PMID: 38692275 DOI: 10.1016/j.cub.2024.04.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 12/18/2023] [Accepted: 04/09/2024] [Indexed: 05/03/2024]
Abstract
Humans and other animals can readily learn to compensate for changes in the dynamics of movement. Such changes can result from an injury or changes in the weight of carried objects. These changes in dynamics can lead not only to reduced performance but also to dramatic instabilities. We evaluated the impacts of compensatory changes in control policies in relation to stability and robustness in Eigenmannia virescens, a species of weakly electric fish. We discovered that these fish retune their sensorimotor control system in response to experimentally generated destabilizing dynamics. Specifically, we used an augmented reality system to manipulate sensory feedback during an image stabilization task in which a fish maintained its position within a refuge. The augmented reality system measured the fish's movements in real time. These movements were passed through a high-pass filter and multiplied by a gain factor before being fed back to the refuge motion. We adjusted the gain factor to gradually destabilize the fish's sensorimotor loop. The fish retuned their sensorimotor control system to compensate for the experimentally induced destabilizing dynamics. This retuning was partially maintained when the augmented reality feedback was abruptly removed. The compensatory changes in sensorimotor control improved tracking performance as well as control-theoretic measures of robustness, including reduced sensitivity to disturbances and improved phase margins.
Collapse
Affiliation(s)
- Yu Yang
- Department of Mechanical Engineering, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218, USA; Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218, USA.
| | - Dominic G Yared
- Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218, USA
| | - Eric S Fortune
- Federated Department of Biological Sciences, New Jersey Institute of Technology, 323 Dr. Martin Luther King Jr. Boulevard, Newark, NJ 07102, USA
| | - Noah J Cowan
- Department of Mechanical Engineering, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218, USA; Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218, USA.
| |
Collapse
|
2
|
Verbe A, Martinez D, Viollet S. Sensory fusion in the hoverfly righting reflex. Sci Rep 2023; 13:6138. [PMID: 37061548 PMCID: PMC10105705 DOI: 10.1038/s41598-023-33302-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 04/11/2023] [Indexed: 04/17/2023] Open
Abstract
We study how falling hoverflies use sensory cues to trigger appropriate roll righting behavior. Before being released in a free fall, flies were placed upside-down with their legs contacting the substrate. The prior leg proprioceptive information about their initial orientation sufficed for the flies to right themselves properly. However, flies also use visual and antennal cues to recover faster and disambiguate sensory conflicts. Surprisingly, in one of the experimental conditions tested, hoverflies flew upside-down while still actively flapping their wings. In all the other conditions, flies were able to right themselves using two roll dynamics: fast ([Formula: see text]50ms) and slow ([Formula: see text]110ms) in the presence of consistent and conflicting cues, respectively. These findings suggest that a nonlinear sensory integration of the three types of sensory cues occurred. A ring attractor model was developed and discussed to account for this cue integration process.
Collapse
Affiliation(s)
- Anna Verbe
- Aix-Marseille Université, CNRS, ISM, 13009, Marseille, France
- PNI, Princeton University, Washington Road, Princeton, NJ, 08540, USA
| | - Dominique Martinez
- Aix-Marseille Université, CNRS, ISM, 13009, Marseille, France
- Université de Lorraine, CNRS, LORIA, 54000, Nancy, France
| | | |
Collapse
|
3
|
Whitehead SC, Leone S, Lindsay T, Meiselman MR, Cowan NJ, Dickinson MH, Yapici N, Stern DL, Shirangi T, Cohen I. Neuromuscular embodiment of feedback control elements in Drosophila flight. SCIENCE ADVANCES 2022; 8:eabo7461. [PMID: 36516241 PMCID: PMC9750141 DOI: 10.1126/sciadv.abo7461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 11/10/2022] [Indexed: 06/17/2023]
Abstract
While insects such as Drosophila are flying, aerodynamic instabilities require that they make millisecond time scale adjustments to their wing motion to stay aloft and on course. These stabilization reflexes can be modeled as a proportional-integral (PI) controller; however, it is unclear how such control might be instantiated in insects at the level of muscles and neurons. Here, we show that the b1 and b2 motor units-prominent components of the fly's steering muscle system-modulate specific elements of the PI controller: the angular displacement (integral) and angular velocity (proportional), respectively. Moreover, these effects are observed only during the stabilization of pitch. Our results provide evidence for an organizational principle in which each muscle contributes to a specific functional role in flight control, a finding that highlights the power of using top-down behavioral modeling to guide bottom-up cellular manipulation studies.
Collapse
Affiliation(s)
| | - Sofia Leone
- Department of Biology, Villanova University, Villanova, PA 19805, USA
| | - Theodore Lindsay
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Matthew R. Meiselman
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY 14850, USA
| | - Noah J. Cowan
- Department of Mechanical Engineering, Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Michael H. Dickinson
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Nilay Yapici
- Department of Neurobiology and Behavior, Cornell University, Ithaca, NY 14850, USA
| | | | - Troy Shirangi
- Division of Biology and Bioengineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Itai Cohen
- Department of Physics, Cornell University, Ithaca, NY 14850, USA
| |
Collapse
|
4
|
Salem W, Cellini B, Kabutz H, Hari Prasad HK, Cheng B, Jayaram K, Mongeau JM. Flies trade off stability and performance via adaptive compensation to wing damage. SCIENCE ADVANCES 2022; 8:eabo0719. [PMID: 36399568 PMCID: PMC9674276 DOI: 10.1126/sciadv.abo0719] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 09/30/2022] [Indexed: 06/16/2023]
Abstract
Physical injury often impairs mobility, which can have dire consequences for survival in animals. Revealing mechanisms of robust biological intelligence to prevent system failure can provide critical insights into how complex brains generate adaptive movement and inspiration to design fault-tolerant robots. For flying animals, physical injury to a wing can have severe consequences, as flight is inherently unstable. Using a virtual reality flight arena, we studied how flying fruit flies compensate for damage to one wing. By combining experimental and mathematical methods, we show that flies compensate for wing damage by corrective wing movement modulated by closed-loop sensing and robust mechanics. Injured flies actively increase damping and, in doing so, modestly decrease flight performance but fly as stably as uninjured flies. Quantifying responses to injury can uncover the flexibility and robustness of biological systems while informing the development of bio-inspired fault-tolerant strategies.
Collapse
Affiliation(s)
- Wael Salem
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Benjamin Cellini
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Heiko Kabutz
- Department of Mechanical Engineering, University of Colorado Boulder, Boulder, CO 80309, USA
| | | | - Bo Cheng
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| | - Kaushik Jayaram
- Department of Mechanical Engineering, University of Colorado Boulder, Boulder, CO 80309, USA
| | - Jean-Michel Mongeau
- Department of Mechanical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
| |
Collapse
|
5
|
Comertler MS, Uyanik I. Salience of multisensory feedback regulates behavioral variability. BIOINSPIRATION & BIOMIMETICS 2021; 17:016006. [PMID: 34768247 DOI: 10.1088/1748-3190/ac392d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 11/12/2021] [Indexed: 06/13/2023]
Abstract
Many animal behaviors are robust to dramatic variations in morphophysiological features, both across and within individuals. The control strategies that animals use to achieve such robust behavioral performances are not known. Recent evidence suggests that animals rely on sensory feedback rather than precise tuning of neural controllers for robust control. Here we examine the structure of sensory feedback, including multisensory feedback, for robust control of animal behavior. We re-examined two recent datasets of refuge tracking responses ofEigenmannia virescens, a species of weakly electric fish.Eigenmanniarely on both the visual and electrosensory cues to track the position of a moving refuge. The datasets include experiments that varied the strength of visual and electrosensory signals. Our analyses show that increasing the salience (perceptibility) of visual or electrosensory signals resulted in more robust and precise behavioral responses. Further, we find that robust performance was enhanced by multisensory integration of simultaneous visual and electrosensory cues. These findings suggest that engineers may achieve better system performance by improving the salience of multisensory feedback rather than solely focusing on precisely tuned controllers.
Collapse
Affiliation(s)
- Muhammed Seyda Comertler
- Department of Electrical and Electronics Engineering, Hacettepe University, Ankara, Turkey
- Command Control and Defence Technologies VP, Havelsan A.S., Ankara, Turkey
| | - Ismail Uyanik
- Department of Electrical and Electronics Engineering, Hacettepe University, Ankara, Turkey
| |
Collapse
|
6
|
Uyanik I, Sefati S, Stamper SA, Cho KA, Ankarali MM, Fortune ES, Cowan NJ. Variability in locomotor dynamics reveals the critical role of feedback in task control. eLife 2020; 9:51219. [PMID: 31971509 PMCID: PMC7041942 DOI: 10.7554/elife.51219] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2019] [Accepted: 01/21/2020] [Indexed: 11/19/2022] Open
Abstract
Animals vary considerably in size, shape, and physiological features across individuals, but yet achieve remarkably similar behavioral performances. We examined how animals compensate for morphophysiological variation by measuring the system dynamics of individual knifefish (Eigenmannia virescens) in a refuge tracking task. Kinematic measurements of Eigenmannia were used to generate individualized estimates of each fish’s locomotor plant and controller, revealing substantial variability between fish. To test the impact of this variability on behavioral performance, these models were used to perform simulated ‘brain transplants’—computationally swapping controllers and plants between individuals. We found that simulated closed-loop performance was robust to mismatch between plant and controller. This suggests that animals rely on feedback rather than precisely tuned neural controllers to compensate for morphophysiological variability. People come in different shapes and sizes, but most will perform similarly well if asked to complete a task requiring fine manual dexterity – such as holding a pen or picking up a single grape. How can different individuals, with different sized hands and muscles, produce such similar movements? One explanation is that an individual’s brain and nervous system become precisely tuned to mechanics of the body’s muscles and skeleton. An alternative explanation is that brain and nervous system use a more “robust” control policy that can compensate for differences in the body by relying on feedback from the senses to guide the movements. To distinguish between these two explanations, Uyanik et al. turned to weakly electric freshwater fish known as glass knifefish. These fish seek refuge within root systems, reed grass and among other objects in the water. They swim backwards and forwards to stay hidden despite constantly changing currents. Each fish shuttles back and forth by moving a long ribbon-like fin on the underside of its body. Uyanik et al. measured the movements of the ribbon fin under controlled conditions in the laboratory, and then used the data to create computer models of the brain and body of each fish. The models of each fish’s brain and body were quite different. To study how the brain interacts with the body, Uyanik et al. then conducted experiments reminiscent of those described in the story of Frankenstein and transplanted the brain from each computer model into the body of different model fish. These “brain swaps” had almost no effect on the model’s simulated swimming behavior. Instead, these “Frankenfish” used sensory feedback to compensate for any mismatch between their brain and body. This suggests that, for some behaviors, an animal’s brain does not need to be precisely tuned to the specific characteristics of its body. Instead, robust control of movement relies on many seemingly redundant systems that provide sensory feedback. This has implications for the field of robotics. It further suggests that when designing robots, engineers should prioritize enabling the robots to use sensory feedback to cope with unexpected events, a well-known idea in control engineering.
Collapse
Affiliation(s)
- Ismail Uyanik
- Department of Electrical and Electronics Engineering, Hacettepe University, Ankara, Turkey.,Laboratory of Computational Sensing and Robotics, Johns Hopkins University, Baltimore, United States.,Department of Biological Sciences, New Jersey Institute of Technology, Newark, United States
| | - Shahin Sefati
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, United States
| | - Sarah A Stamper
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, United States
| | - Kyoung-A Cho
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, United States
| | - M Mert Ankarali
- Department of Electrical and Electronics Engineering, Middle East Technical University, Ankara, Turkey
| | - Eric S Fortune
- Department of Biological Sciences, New Jersey Institute of Technology, Newark, United States
| | - Noah J Cowan
- Laboratory of Computational Sensing and Robotics, Johns Hopkins University, Baltimore, United States.,Department of Mechanical Engineering, Johns Hopkins University, Baltimore, United States
| |
Collapse
|