What do navigating animals see? Reconstructing the visual histories of desert ants

To understand how brains translate sensory input into behavioural outputs requires a fuller account of the sensory experience of individual animals in their natural settings. Previously we developed a visual rendering software capable of reconstructing the information that insect's compound eyes perceive (Millward et al, 2022). In this work, we extend this software pipeline to integrate data from animal tracking, habitat mapping, and compound eye modelling methods. The result is a new type of dataset that documents the natural foraging behaviour of desert ants (a model species for the study of animal navigation) within their natural habitat, combined with simulation tools to accurately reconstruct the visual experience of each forager as they learned to navigate their surroundings. This addresses a long-held need to create realistic training input for brain models complimented with verification tests in the same real ecologically relevant scenarios.