A Hyperscaler's Perspective on Platform Debug Capabilities for OCP Compliant AI Hardware

Platform level details are critical for product development in the AI space, with solutions coming in from multiple technology vendors. It is necessary to have specialized debug features to extract key platform information. This paper studies the current capabilities and challenges in AI solutions NPI (New Product Introduction) development and fleet debug. For NPI, the paper talks about gaps in PCIe debugging, RAS tool usage and vendor diagnostic tools. Debug capability gaps for in-band and out of band are highlighted from a fleet debug perspective. To address these gaps the paper highlights using OCP Compliance tools and OCP compliant debug hardware for short term while pushing for long term solutions to address debug standardization for the AI products