1
|
Goodwin NL, Choong JJ, Hwang S, Pitts K, Bloom L, Islam A, Zhang YY, Szelenyi ER, Tong X, Newman EL, Miczek K, Wright HR, McLaughlin RJ, Norville ZC, Eshel N, Heshmati M, Nilsson SRO, Golden SA. Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience. Nat Neurosci 2024; 27:1411-1424. [PMID: 38778146 PMCID: PMC11268425 DOI: 10.1038/s41593-024-01649-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 04/12/2024] [Indexed: 05/25/2024]
Abstract
The study of complex behaviors is often challenging when using manual annotation due to the absence of quantifiable behavioral definitions and the subjective nature of behavioral annotation. Integration of supervised machine learning approaches mitigates some of these issues through the inclusion of accessible and explainable model interpretation. To decrease barriers to access, and with an emphasis on accessible model explainability, we developed the open-source Simple Behavioral Analysis (SimBA) platform for behavioral neuroscientists. SimBA introduces several machine learning interpretability tools, including SHapley Additive exPlanation (SHAP) scores, that aid in creating explainable and transparent behavioral classifiers. Here we show how the addition of explainability metrics allows for quantifiable comparisons of aggressive social behavior across research groups and species, reconceptualizing behavior as a sharable reagent and providing an open-source framework. We provide an open-source, graphical user interface (GUI)-driven, well-documented package to facilitate the movement toward improved automation and sharing of behavioral classification tools across laboratories.
Collapse
Affiliation(s)
- Nastacia L Goodwin
- Department of Biological Structure, University of Washington, Seattle, WA, USA
- Graduate Program in Neuroscience, University of Washington, Seattle, WA, USA
- Center of Excellence in Neurobiology of Addiction, Pain and Emotion (NAPE), University of Washington, Seattle, WA, USA
| | - Jia J Choong
- Department of Biological Structure, University of Washington, Seattle, WA, USA
- Department of Electrical and Computer Engineering, University of Washington, Seattle, WA, USA
| | - Sophia Hwang
- Department of Biological Structure, University of Washington, Seattle, WA, USA
| | - Kayla Pitts
- Department of Biological Structure, University of Washington, Seattle, WA, USA
| | - Liana Bloom
- Department of Biological Structure, University of Washington, Seattle, WA, USA
| | - Aasiya Islam
- Department of Biological Structure, University of Washington, Seattle, WA, USA
| | - Yizhe Y Zhang
- Department of Biological Structure, University of Washington, Seattle, WA, USA
- Graduate Program in Neuroscience, University of Washington, Seattle, WA, USA
- Center of Excellence in Neurobiology of Addiction, Pain and Emotion (NAPE), University of Washington, Seattle, WA, USA
| | - Eric R Szelenyi
- Department of Biological Structure, University of Washington, Seattle, WA, USA
- Center of Excellence in Neurobiology of Addiction, Pain and Emotion (NAPE), University of Washington, Seattle, WA, USA
| | - Xiaoyu Tong
- New York University Neuroscience Institute, New York, NY, USA
| | - Emily L Newman
- Department of Psychiatry, Harvard Medical School McLean Hospital, Belmont, MA, USA
| | - Klaus Miczek
- Department of Psychology, Tufts University, Medford, MA, USA
| | - Hayden R Wright
- Department of Integrative Physiology and Neuroscience, Washington State University, Pullman, WA, USA
- Graduate Program in Neuroscience, Washington State University, Pullman, WA, USA
| | - Ryan J McLaughlin
- Department of Integrative Physiology and Neuroscience, Washington State University, Pullman, WA, USA
- Graduate Program in Neuroscience, Washington State University, Pullman, WA, USA
| | | | - Neir Eshel
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Mitra Heshmati
- Department of Biological Structure, University of Washington, Seattle, WA, USA
- Graduate Program in Neuroscience, University of Washington, Seattle, WA, USA
- Center of Excellence in Neurobiology of Addiction, Pain and Emotion (NAPE), University of Washington, Seattle, WA, USA
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, WA, USA
| | - Simon R O Nilsson
- Department of Biological Structure, University of Washington, Seattle, WA, USA.
| | - Sam A Golden
- Department of Biological Structure, University of Washington, Seattle, WA, USA.
- Graduate Program in Neuroscience, University of Washington, Seattle, WA, USA.
- Center of Excellence in Neurobiology of Addiction, Pain and Emotion (NAPE), University of Washington, Seattle, WA, USA.
| |
Collapse
|
2
|
Chen Z, Jia G, Zhou Q, Zhang Y, Quan Z, Chen X, Fukuda T, Huang Q, Shi Q. ARBUR, a machine learning-based analysis system for relating behaviors and ultrasonic vocalizations of rats. iScience 2024; 27:109998. [PMID: 38947508 PMCID: PMC11214285 DOI: 10.1016/j.isci.2024.109998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Revised: 04/01/2024] [Accepted: 05/14/2024] [Indexed: 07/02/2024] Open
Abstract
Deciphering how different behaviors and ultrasonic vocalizations (USVs) of rats interact can yield insights into the neural basis of social interaction. However, the behavior-vocalization interplay of rats remains elusive because of the challenges of relating the two communication media in complex social contexts. Here, we propose a machine learning-based analysis system (ARBUR) that can cluster without bias both non-step (continuous) and step USVs, hierarchically detect eight types of behavior of two freely behaving rats with high accuracy, and locate the vocal rat in 3-D space. ARBUR reveals that rats communicate via distinct USVs during different behaviors. Moreover, we show that ARBUR can indicate findings that are long neglected by former manual analysis, especially regarding the non-continuous USVs during easy-to-confuse social behaviors. This work could help mechanistically understand the behavior-vocalization interplay of rats and highlights the potential of machine learning algorithms in automatic animal behavioral and acoustic analysis.
Collapse
Affiliation(s)
- Zhe Chen
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
| | - Guanglu Jia
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Qijie Zhou
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Yulai Zhang
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
| | - Zhenzhen Quan
- Key Laboratory of Molecular Medicine and Biotherapy, School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Xuechao Chen
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Toshio Fukuda
- Institute of Innovation for Future Society, Nagoya University, Nagoya, Japan
| | - Qiang Huang
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| | - Qing Shi
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing, China
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
3
|
Sakata S. SaLSa: A Combinatory Approach of Semi-Automatic Labeling and Long Short-Term Memory to Classify Behavioral Syllables. eNeuro 2023; 10:ENEURO.0201-23.2023. [PMID: 37989587 PMCID: PMC10714892 DOI: 10.1523/eneuro.0201-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 10/19/2023] [Accepted: 11/09/2023] [Indexed: 11/23/2023] Open
Abstract
Accurately and quantitatively describing mouse behavior is an important area. Although advances in machine learning have made it possible to track their behaviors accurately, reliable classification of behavioral sequences or syllables remains a challenge. In this study, we present a novel machine learning approach, called SaLSa (a combination of semi-automatic labeling and long short-term memory-based classification), to classify behavioral syllables of mice exploring an open field. This approach consists of two major steps. First, after tracking multiple body parts, spatial and temporal features of their egocentric coordinates are extracted. A fully automated unsupervised process identifies candidates for behavioral syllables, followed by manual labeling of behavioral syllables using a graphical user interface (GUI). Second, a long short-term memory (LSTM) classifier is trained with the labeled data. We found that the classification performance was marked over 97%. It provides a performance equivalent to a state-of-the-art model while classifying some of the syllables. We applied this approach to examine how hyperactivity in a mouse model of Alzheimer's disease develops with age. When the proportion of each behavioral syllable was compared between genotypes and sexes, we found that the characteristic hyperlocomotion of female Alzheimer's disease mice emerges between four and eight months. In contrast, age-related reduction in rearing is common regardless of genotype and sex. Overall, SaLSa enables detailed characterization of mouse behavior.
Collapse
Affiliation(s)
- Shuzo Sakata
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow G4 0RE, United Kingdom
| |
Collapse
|