Graphcore

Abstract

IPU Foundations • AI is nascent – facilitating exploration is as vital as executing known algorithms. • Tera-scale models will be necessary for “super-human” AI. • Sparse evaluation will be necessary at tera-scale, $\text{for} \$ $ and Watts. • Rich natural data is sequences, images, and graphs. • Post-Dennard, keep memory and logic close. • Post-Moore, parallel computing over many chips.