FlyAwareV2: A multimodal cross-domain UAV dataset for urban scene understanding

The development of computer vision algorithms for Unmanned Aerial Vehicle (UAV) applications in urban environments heavily relies on the availability of large-scale datasets with accurate annotations. However, collecting and annotating real-world UAV data is extremely challenging and costly. To address this limitation, we present FlyAwareV2, a novel multimodal dataset encompassing both real and synthetic UAV imagery tailored for urban scene understanding tasks. Building upon the recently introduced SynDrone and FlyAware datasets, FlyAwareV2 introduces several new key contributions: (1) Multimodal data (RGB, depth, semantic labels) across diverse environmental conditions including varying weather and daytime; (2) Depth maps for real samples computed via state-of-the-art monocular depth estimation; (3) Benchmarks for RGB and multimodal semantic segmentation on standard architectures; (4) Studies on synthetic-to-real domain adaptation to assess the generalization capabilities of models trained on the synthetic data. With its rich set of annotations and environmental diversity, FlyAwareV2 provides a valuable resource for research on UAV-based 3D urban scene understanding. Dataset link: https://medialab.dei.unipd.it/paper_data/FlyAwareV2 • We introduce a multimodal dataset for aerial imaging across diverse environmental conditions including varying weather and daytime. • The dataset encompasses both real and synthetic data including depth maps for real samples computed via state-of-the-art monocular depth estimation. • Benchmarks for RGB and multimodal semantic segmentation on standard architectures are provided. • We also evaluate performances of synthetic-to-real domain adaptation to assess the generalization capabilities of models trained on the synthetic data.