1
|
Maya R, Lerner N, Ben-Dov O, Pons A, Beatus T. A hull reconstruction-reprojection method for pose estimation of free-flying fruit flies. J Exp Biol 2023; 226:jeb245853. [PMID: 37795876 PMCID: PMC10629692 DOI: 10.1242/jeb.245853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 09/18/2023] [Indexed: 10/06/2023]
Abstract
Understanding the mechanisms of insect flight requires high-quality data of free-flight kinematics, e.g. for comparative studies or genetic screens. Although recent improvements in high-speed videography allow us to acquire large amounts of free-flight data, a significant bottleneck is automatically extracting accurate body and wing kinematics. Here, we present an experimental system and a hull reconstruction-reprojection algorithm for measuring the flight kinematics of fruit flies. The experimental system can automatically record hundreds of flight events per day. Our algorithm resolves a significant portion of the occlusions in this system by a reconstruction-reprojection scheme that integrates information from all cameras. Wing and body kinematics, including wing deformation, are then extracted from the hulls of the wing boundaries and body. This model-free method is fully automatic, accurate and open source, and can be readily adjusted for different camera configurations or insect species.
Collapse
Affiliation(s)
- Roni Maya
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Center of Bioengineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Noam Lerner
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Center of Bioengineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Omri Ben-Dov
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Center of Bioengineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Arion Pons
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Center of Bioengineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Tsevi Beatus
- School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Institute of Life Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
- Center of Bioengineering, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| |
Collapse
|
2
|
Paz A, Holt KJ, Clarke A, Aviles A, Abraham B, Keene AC, Duboué ER, Fily Y, Kowalko JE. Changes in local interaction rules during ontogeny underlie the evolution of collective behavior. iScience 2023; 26:107431. [PMID: 37636065 PMCID: PMC10448030 DOI: 10.1016/j.isci.2023.107431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/17/2023] [Accepted: 07/17/2023] [Indexed: 08/29/2023] Open
Abstract
Collective motion emerges from individual interactions which produce group-wide patterns in behavior. While adaptive changes to collective motion are observed across animal species, how local interactions change when these collective behaviors evolve is poorly understood. Here, we use the Mexican tetra, Astyanax mexicanus, which exists as a schooling surface form and a non-schooling cave form, to study differences in how fish alter their swimming in response to neighbors across ontogeny and between evolutionarily diverged populations. We find that surface fish undergo a transition to schooling mediated by changes in the way fish modulate speed and turning relative to neighbors. This transition begins with the tendency to align to neighbors emerging by 28 days post-fertilization and ends with the emergence of robust attraction by 70 days post-fertilization. Cavefish exhibit neither alignment nor attraction at any stage of development. These results reveal how evolution alters local interactions to produce striking differences in collective behavior.
Collapse
Affiliation(s)
- Alexandra Paz
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Karla J. Holt
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Anik Clarke
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Ari Aviles
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Briana Abraham
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Alex C. Keene
- Department of Biology, Texas A&M, College Station, TX 77840, USA
| | - Erik R. Duboué
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Yaouen Fily
- Wilkes Honors College, Florida Atlantic University, Jupiter, FL 33458, USA
| | - Johanna E. Kowalko
- Department of Biological Sciences, Lehigh University, Bethlehem, PA 18015, USA
| |
Collapse
|
3
|
Paz A, Holt KJ, Clarke A, Aviles A, Abraham B, Keene AC, Duboué ER, Fily Y, Kowalko JE. Changes in local interaction rules during ontogeny underlie the evolution of collective behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.28.534467. [PMID: 37034671 PMCID: PMC10081253 DOI: 10.1101/2023.03.28.534467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Collective motion emerges from individual interactions which produce groupwide patterns in behavior. While adaptive changes to collective motion are observed across animal species, how local interactions change when these collective behaviors evolve is poorly understood. Here, we use the Mexican tetra, A. mexicanus, which exists as a schooling surface form and a non-schooling cave form, to study differences in how fish alter their swimming in response to neighbors across ontogeny and between evolutionarily diverged populations. We find that surface fish undergo a transition to schooling during development that occurs through increases in inter-individual alignment and attraction mediated by changes in the way fish modulate speed and turning relative to neighbors. Cavefish, which have evolved loss of schooling, exhibit neither of these schooling-promoting interactions at any stage of development. These results reveal how evolution alters local interaction rules to produce striking differences in collective behavior.
Collapse
Affiliation(s)
- Alexandra Paz
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | - Karla J. Holt
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | - Anik Clarke
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | - Ari Aviles
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | - Briana Abraham
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | | | - Erik R. Duboué
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | - Yaouen Fily
- Wilkes Honors College, Florida Atlantic University, Jupiter FL
| | | |
Collapse
|
4
|
Ahmed I, Abramson CI, Faruque IA. Honey bee flights near hover under ethanol-exposure show changes in body and wing kinematics. PLoS One 2022; 17:e0278916. [PMID: 36520797 PMCID: PMC9754180 DOI: 10.1371/journal.pone.0278916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Accepted: 11/23/2022] [Indexed: 12/23/2022] Open
Abstract
Flying social insects can provide model systems for in-flight interactions in computationally-constrained aerial robot swarms. The social interactions in flying insects may be chemically modulated and quantified via recent measurement advancements able to simultaneously make precise measurements of insect wing and body motions. This paper presents the first in-flight quantitative measurements of ethanol-exposed honey bee body and wing kinematics in archival literature. Four high-speed cameras (9000 frames/sec) were used to record the wing and body motions of flying insects (Apis mellifera) and automated analysis was used to extract 9000 frame/sec measurements of honey bees' wing and body motions through data association, hull reconstruction, and segmentation. The kinematic changes induced by exposure to incremental ethanol concentrations from 0% to 5% were studied using statistical analysis tools. Analysis considered trial-wise mean and maximum values and gross wingstroke parameters, and tested deviations for statistical significance using Welch's t-test and Cohen's d test. The results indicate a decrease in maximal heading and pitch rates of the body, and that roll rate is affected at high concentrations (5%). The wingstroke effects include a stroke frequency decrease and stroke amplitude increase for 2.5% or greater concentrations, gradual stroke inclination angle increase up to 2.5% concentration, and a more planar wingstroke with increasing concentration according to bulk wingstroke analysis. These ethanol-exposure effects provide a basis to separate ethanol exposure and neighbor effects in chemically mediated interaction studies.
Collapse
Affiliation(s)
- Ishriak Ahmed
- School of Mechanical and Aerospace Engineering, Oklahoma State University, Stillwater, Oklahoma, United States of America
- * E-mail:
| | - Charles I. Abramson
- Laboratory of Comparative Psychology and Behavioral Biology, Oklahoma State University, Stillwater, Oklahoma, United States of America
| | - Imraan A. Faruque
- School of Mechanical and Aerospace Engineering, Oklahoma State University, Stillwater, Oklahoma, United States of America
| |
Collapse
|