AR Autonomous Switching: An IoT-Enabled Augmented Reality System For Virtual Control Of Electrical Panels

The convergence of Internet of Things (IoT) and Augmented Reality (AR) technologies has opened new frontiers in human computer interaction, particularly in the domain of smart home automation and industrial control systems. Traditional physical switchboards, while functional, lack flexibility, require physical presence for operation, and offer limited accessibility for individuals with mobility challenges. This paper presents AR Autonomous Switching, a novel IoT-enabled augmented reality system that allows users to virtually control electrical switches through an intuitive AR interface. The system comprises three integrated components: an ESP8266-based hardware circuit with relay modules connected to physical switchboards, providing wireless control capabilities through GPIO pins and 5V relays capable of switching loads up to 250V/10A; a Firebase Realtime Database cloud infrastructure that maintains real-time state synchronization, device registration data, and user authentication with latency under 200ms; and a Python-based AR application developed using OpenCV and ARUCO markers that enables users to register switchboard panels by generating unique QR codes, which when scanned through a camera interface, overlay interactive virtual switches on the real-world view. The system implements a complete workflow: switchboard registration through QR code generation and physical placement; virtual panel creation with switch configuration (number of switches, type: toggle/push button, labels); real-time state synchronization between AR interface and physical hardware via Firebase; and intuitive gesture-based control through screen taps on virtual switches,. The ESP8266 firmware, written in Arduino C++, maintains persistent connection to Firebase using REST APIs, with deep sleep mode achieving 45-day battery life when operating on 3.7V LiPo batteries. The Python AR application utilizes ARUCO markers for precise 6-degree-of-freedom pose estimation, enabling accurate virtual overlay alignment with physical panels even under varying lighting conditions . Experimental evaluation with 50 users across 100 switching operations demonstrates 98.7% command success rate, average response latency of 180ms, and user satisfaction score of 4.8/5. The system supports up to 100 concurrent devices per Firebase instance with real-time synchronization across multiple users. Security implementation includes Firebase Authentication with email/password and Google Sign-In, SSL/TLS encryption for all communications, and device-specific access tokens preventing unauthorized control. This work represents the first integrated IoT-AR system for autonomous switch control, demonstrating significant potential for smart homes, industrial automation, and accessible design applications.