Projection-Based Augmented Reality with Computer Vision for Interactive Assembly Guidance

This study presents an interactive augmented reality (AR) system that supports preschool children in building block assembly. The system integrates real-time camera capture, YOLOv7-based[1] object detection, and projectorbased visualization to deliver step-by-step, screen-free guidance. Experimental results show a detection accuracy of 0.9984, as demonstrated through controlled testing. The workflow begins with camera activation and block detection, followed by instruction matching from a preloaded JSON script. Visual cues are projected onto physical blocks, enabling intuitive and handson interaction until the task is completed. In contrast to existing AR tools such as Brickit, which rely on screen-based mobile interaction, the proposed system emphasizes tangible learning by combining AI-driven feedback with physical guidance. This approach promotes spatial reasoning, hand-eye coordination, and cognitive development while enhancing engagement and reducing reliance on screens, offering a practical and effective solution for preschool education.