SambaNova SN40L RDU: Breaking the Barrier of Trillion+ Parameter Scale Gen AI Computing

•Configurable as a systolic array or a SIMD vector unit with M lanes •BF16, FP32, INT32, and INT8 compute data types, configurable storage data types •Arithmetic, Logical, and Bitwise operations •A cross-lane reduction tree (blue) to reduce along the vectorized dimension •Tail stage provides transcendental functions, casting, and stochastic rounding capabilities