Searching Agricultural Learning Experiences in the Metaverse via Textual and Visual Queries Within the AgriMus project

Abstract Every day, social media and content sharing platforms receive numerous training videos across a multitude of sectors, including home gardening, agriculture, and indoor farming. Recently, the Metaverse has offered the opportunity to create enclosed virtual spaces where a user can focus and learn specialized skills, e.g., medical, in an easy, interactive, and engaging way. However, finding suitable educational spaces for specific themes remains a challenge. In light of these advancements and to support agricultural education, in this work, we introduce AgriMus project, which aims to design agricultural-themed museums covering a broad range of topics. Users can explore and retrieve specific educational experiences through visual or textual queries. Beyond creating a dataset for the agricultural setting, we also propose a hierarchical method to model these virtual museums. Several experiments have been conducted to evaluate the effectiveness of the proposed approach. The full source code and dataset used in this study are available at: https://github.com/aliabdari/AgriMus/ .