Risk Evaluation of AI Systems in the Energy Sector - Three Case Studies from TSO Business

Artificial intelligence (AI) systems are nowadays widely used in electricity systems. The rising awareness of its potential risks requires that regulators and policy makers assess and compare AI systems considering criteria regarding their systemic criticality. Such evaluation is fundamental for a risk-aware use of AI systems and the timely development of mitigation strategies that ensure the safe and secure operation of the electricity sector. In this work, we introduce a practicable evaluation framework for AI systems in electricity systems. Using three case studies from electricity transmission system operators, we demonstrate the applicability of our framework.