Using neural style transfer to study the evolution of animal signal design: A case study in an ornamented fish

The sensory drive hypothesis of animal signal evolution describes how animal communication signals and preferences evolve as adaptations to local environments. While classical approaches to testing this hypothesis often focus on preference for one aspect of a signal, deep learning techniques like generative models can create and manipulate stimuli without targeting a specific feature. Here, we used an artificial intelligence technique called neural style transfer to experimentally test preferences for color patterns in a fish. Findings in empirical aesthetics show that humans tend to prefer images with the visual statistics of the environment because the visual system is adapted to process them efficiently, making those images easier to process. Whether this is the case in other species remains to be tested. We therefore manipulated how similar or dissimilar male body patterns were to their habitats using the Neural Style Transfer (NST) algorithm. We predicted that males whose body patterns are more similar to their native habitats will be preferred by conspecifics. Our findings suggest that both males and females are sensitive to habitat congruence in their preferences, but to different extents, requiring additional investigation. Nonetheless, this study demonstrates the potential of artificial intelligence for testing hypotheses about animal communication signals. • Neural style transfer was used to test preferences for patterns in a colourful fish • Results trend in support of the processing bias hypothesis, a component of sensory drive • This study demonstrates the use of generative AI for animal behavioral studies