The world’s largest computer chip, the Wafer Scale Engine 3 (WSE-3), boasting an astounding four trillion transistors, is set to revolutionize AI supercomputing. This gargantuan chip, developed by Cerebras, promises to power the Condor Galaxy 3 supercomputer, slated to be eight times faster than its predecessors.
The WSE-3 chip, housing an impressive 900,000 AI cores, maintains the same power consumption as its predecessor while doubling its processing prowess. This adherence to Moore’s Law reflects the relentless progress in semiconductor technology.
In comparison to existing powerful chips like Nvidia’s H200 GPU, the WSE-3 dwarfs them with its unparalleled transistor count, paving the way for unprecedented computational capabilities.
The Condor Galaxy 3 supercomputer, comprised of 64 Cerebras CS-3 AI system units driven by WSE-3 chips, will deliver a staggering 8 exaFLOPs of computing power. This colossal system, when integrated with its predecessors, will soar to a total of 16 exaFLOPs, dwarfing even the most powerful supercomputers in existence.
Designed to train AI models of unprecedented scale, the Condor Galaxy 3 will facilitate the development of systems far surpassing the likes of GPT-4 or Google’s Gemini, potentially accommodating up to 24 trillion parameters. This leap in computational capability heralds a new era in AI research and development.