Pipeline for Text-to-Image Panoramic Road Scene Generation and Evaluation

The Panoramic Road Scene Generation (PRSG) pipeline is a framework designed to generate realistic and contextually accurate panoramic road scenes from textual descriptions. This approach leverages a combination of a stable diffusion model and super-resolution techniques to produce panoramic images for autonomous vehicle (AV) simulations and VR/AR applications. By generating detailed panoramic road scenes viewable in a VR HMD, an additional avenue for easily creating and simulating vehicular scenarios is possible. The pipeline utilizes a customized dataset with specifically tailored captions to fine-tune the generation process, ensuring both visual fidelity and contextual relevance. The evaluation framework includes both subjective and objective metrics to assess to the quality and applicability of the generated images. A pilot study determined the generated road scenes to be relatively realistic and acceptable for viewing. Potential applications include the creation of new synthetic scenes for simulating AV scenarios, or training and validation of autonomous systems.