Fine-Grained Fidgety Movement Classification Using Active Learning
Typically developing infants, between the corrected age of 9-20 weeks, produce fidgety movements. These movements can be identified with the General Movement Assessment, but their identification requires trained professionals to conduct the assessment from video recordings. Since trained professionals are expensive and their demand may be higher than their availability, computer vision-based solutions have been developed to assist practitioners. However, most solutions to date treat the problem as a direct mapping from video to infant status, without modeling fidgety movements throughout the video. To address that, we propose to directly model infants' short movements and classify them as fidgety or non-fidgety. In this way, we model the explanatory factor behind the infant's status and improve model interpretability. The issue with our proposal is that labels for an infant's short movements are not available, which precludes us to train such a model. We overcome this issue with active learning. Active learning is a framework that minimizes the amount of labeled data required to train a model, by only labeling examples that are considered "informative" to the model. The assumption is that a model trained on informative examples reaches a higher performance level than a model trained with randomly selected examples. We validate our framework by modeling the movements of infants' hips on two representative cohorts: typically developing and at-risk infants. Our results show that active learning is suitable to our problem and that it works adequately even when the models are trained with labels provided by a novice annotator.
Authors
- Alison Salt (ORCID: https://orcid.org/0000-0002-1890-6412)
- Romero Morais (ORCID: https://orcid.org/0000-0001-9114-543X)
- Natasha Amery (ORCID: https://orcid.org/0000-0002-3705-6927)
- Catherine Elliott (ORCID: https://orcid.org/0009-0002-6918-1500)
- Vuong Le (ORCID: https://orcid.org/0000-0003-1582-1269)
- Jane Valentine (ORCID: https://orcid.org/0000-0003-1854-7381)
- Paul A. Dawson (ORCID: https://orcid.org/0000-0002-7318-4985)
- Svetha Venkatesh (ORCID: https://orcid.org/0000-0001-8675-6631)
- Alicia J. Spittle (ORCID: https://orcid.org/0000-0002-6535-661X)
- Nadia A. Badawi (ORCID: https://orcid.org/0000-0001-6828-1636)
- Elizabeth Hurrion (ORCID: https://orcid.org/0000-0002-3950-8907)
- Truyen Tran (ORCID: https://orcid.org/0000-0001-6531-8907)
- Catherine Morgan (ORCID: https://orcid.org/0000-0003-3670-0845)
- Caroline Alexander (ORCID: https://orcid.org/0000-0003-4870-4616)
Institutions
- The University of Sydney (AU)
- Royal Women's Hospital (AU)
- Deakin University (AU)
- The University of Queensland (AU)
- The University of Melbourne (AU)
- Curtin University (AU)
- Cerebral Palsy Alliance (AU)
- Princess Margaret Hospital for Children (AU)
- Mater Research (AU)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2024-10-03
- DOI
- https://doi.org/10.1109/jbhi.2024.3473947
- Citations
- 4
- Primary Topic
- Human Motion and Animation
- Type
- article
- Field-Weighted Citation Impact
- 1.31