An Automated AI Framework for Quantitative Measurement of Mammalian Behavior
Despite the large amount of video data captured during ethological studies of wild mammals, there is no widely accepted method available to automatically and quantitatively measure and analyze animal behavior. We developed a framework using facial recognition and deep learning to automatically track, measure, and quantify the behavior of single or multiple individuals from 10 distinct mammalian taxa, including three species of primates, three species of bovids, three species of carnivores, and one species of equid. We used spatiotemporal information based on animal skeleton models to recognize a set of distinct behaviors such as walking, feeding, grooming, and resting, and achieved an accuracy ranging from 0.82 to 0.96. Accuracies of validation videos ranged from 0.80 to 0.99. Our study offers an innovative analytical platform for the rapid and accurate evaluation of animal behavior in both captive and field settings.
Authors
- Fengyi Guo (ORCID: https://orcid.org/0000-0002-5426-324X)
- Zhiming Hu (ORCID: https://orcid.org/0000-0002-2176-0127)
- Tongzuo Zhang (ORCID: https://orcid.org/0000-0001-5524-4262)
- Ruliang Pan (ORCID: https://orcid.org/0000-0003-4467-2143)
- Songtao Guo (ORCID: https://orcid.org/0000-0002-8291-5487)
- Paul A. Garber (ORCID: https://orcid.org/0000-0003-0053-8356)
- Colin A. Chapman (ORCID: https://orcid.org/0000-0002-8827-8140)
- Derek W. Dunn (ORCID: https://orcid.org/0000-0001-5909-1224)
- Tao Liu (ORCID: https://orcid.org/0000-0001-5347-5892)
- Yang Zhao (ORCID: https://orcid.org/0000-0001-6984-1770)
- Fan Wu (ORCID: https://orcid.org/0009-0003-5109-5118)
- Jia Liu (ORCID: https://orcid.org/0000-0003-0383-0934)
- Zhan Wang (ORCID: https://orcid.org/0009-0007-1426-062X)
- Baoguo Li (ORCID: https://orcid.org/0000-0003-2506-7597)
- Pengfei Xu (ORCID: https://orcid.org/0000-0001-8701-2669)
- Gang He (ORCID: https://orcid.org/0000-0003-4964-8871)
- Shuang Yin (ORCID: https://orcid.org/0009-0004-5353-1558)
- Haojie Wu
- Wenjie Guo (ORCID: https://orcid.org/0009-0004-8544-4686)
- Yiyi Men
Institutions
- University of Illinois Urbana-Champaign (US)
- The University of Western Australia (AU)
- Chinese Academy of Sciences (CN)
- Vancouver Island University (CA)
- Northwest University (CN)
- Yanan University Affiliated Hospital (CN)
- Xinjiang Institute of Ecology and Geography (CN)
- Shaanxi Institute of Zoology (CN)
- Dali University (CN)
Publication Details
- Journal
- Integrative Zoology
- Published
- 2025-04-14
- DOI
- https://doi.org/10.1111/1749-4877.12985
- Citations
- 1
- Primary Topic
- Primate Behavior and Ecology
- Type
- article
- Field-Weighted Citation Impact
- 2.44
Funders
- National Natural Science Foundation of China
- National Key Research and Development Program of China