Folding Reality: Learning Spatial Computing through VR Interactive Paper Folding Game

We introduce "Folding Reality" for conducting research on training spatial computing in virtual reality scenarios. It is designed for children and Large Multimodal Models (LMMs). We aim to understand how creativity emerges during the 2D to 3D folding process through interactive data gathered from children’s engagement with the game. We will then use this data to train LMMs, providing them an opportunity to enhance their spatial computing abilities through interactive paper folding. Our goal is to create a learning environment where both children and LMM can explore and understand spatial relationships, advancing research in this field.