Evaluation of unsupervised learning algorithms for the classification of behavior from pose estimation data
Analyzing animal behavior is crucial for decoding brain function, modeling neurological disorders, and assessing therapeutics. Recent advances in pose-estimation tools like DeepLabCut and SLEAP have revolutionized behavioral analysis by enabling precise tracking of animal body movements. However, these tools do not automate behavioral classification. Unsupervised learning algorithms address this gap by identifying clusters of recurring behavioral motifs from pose-tracking data without requiring pre-labeled datasets, reducing observer bias and uncovering novel patterns. This study compares four recent unsupervised learning algorithms-B-SOiD, BFA, VAME, and Keypoint-MoSeq-analyzing their methodological approaches, clustering efficiency, and ability to produce meaningful behavioral classifications. By offering a qualitative and quantitative evaluation, this paper aims to aid researchers in selecting the most suitable tool for their specific research needs.
Authors
- Jakub Mlost (ORCID: https://orcid.org/0000-0003-4102-7245)
- Ana Rita Costa (ORCID: https://orcid.org/0000-0001-6749-6408)
- Iskra Pollak Dorocic (ORCID: https://orcid.org/0000-0002-6391-5377)
- Xuan Liu (ORCID: https://orcid.org/0000-0002-6194-4588)
- Rame Dawli
Institutions
- Stockholm University (SE)
- Science for Life Laboratory (SE)
Publication Details
- Journal
- Patterns
- Published
- 2025-04-22
- DOI
- https://doi.org/10.1016/j.patter.2025.101237
- Citations
- 2
- Primary Topic
- Human Pose and Action Recognition
- Type
- article
- Field-Weighted Citation Impact
- 2.55
Funders
- Wenner-Gren Stiftelserna
- Science for Life Laboratory
- Narodowa Agencja Wymiany Akademickiej