Tracking Uncertainty During Uncertain Tracking

Multiple object tracking is often studied in settings where objects are largely observable. However, tracking often occurs in settings with much greater uncertainty. Objects can frequently go in and out of view, requiring us to constantly update our estimates of where things might be, and assess whether or not something new has appeared. To accomplish this, people need to rely on top-down inferences to fill in the gaps of uncertainty. To study this phenomenon, we introduce a novel ``firefly tracking" paradigm, in which people need to estimate the quantity and dynamics of an unknown objects under highly sparse observations. We model human behavior on this task and demonstrate how probabilistic inference in a generative model captures human uncertainty during challenging tracking tasks. ------------------------------- Paper available at https://yonifriedman.com/publications/CogSci2025_Tracking-Uncertainty.pdf