Musk’s X.ai recently announced the world’s largest super computer working out of memphis tennessee. I’m reading it has broken all kinds of records. Its showing that the scaling laws can go to the moon and back.
The big thing is its ability to enable coherence at scales all the other groups working on AI have not been able to attain. Coherence means the ability of every chip to talk to every other chip simultaneously. The limit is 30 (measurement). X.ai achieved a limit of 100(measurement) with a theoretical limit of 1 million (measurement).
I hardly know what I’m talking about. It looks bigger than the Amazon announcement, except if Amazon can make chips at a scale that is as good as Nvidia and can work interoperably with Nvidia Cuda software.
“and can work interoperably with Nvidia Cuda software”
Most people aren’t aware of how important their software is!