Posted on 02/22/2022 5:55:34 PM PST by algore
Microsoft has revealed it operates a planet-scale distributed scheduling service for AI workloads that it has modestly dubbed "Singularity".
Described in a pre-press paper [PDF] co-authored by 26 Microsoft employees, Singularity's aim is described as helping the software giant control costs by driving high utilization for deep learning workloads.
Singularity achieves that goal with what the paper describes as a "novel workload-aware scheduler that can transparently preempt and elastically scale deep learning workloads to drive high utilization without impacting their correctness or performance, across a global fleet of AI accelerators (e.g., GPUs, FPGAs)."
The paper spends more time on the scheduler than on Singularity itself, but does offer some figures to depict the system's architecture.
An analysis of Singularity's performance mentions a test run on Nvidia DGX-2 servers using a Xeon Platinum 8168 with two sockets of 20 cores each, eight V100 Model GPUs per server, 692GB of RAM, and networked over InfiniBand.
With hundreds of thousands of GPUs in the Singularity fleet, plus FPGAs and possibly other accelerators
(Excerpt) Read more at theregister.com ...
Is this SkyNet?
That’s nice - don’t even think about connecting to my stuff and you’ll be fine 🤪
Nope, the Blue Screen of Death..
Worry worts. What could possibly go wrong? (No sarcasm tag needed)
The bad news: its run by Microsoft.
The good news: its run by Microsoft.
I honestly feel as though our world is moving to an inescapable dystopian future.
No.
It is global, real-time, citizen vaccine compliance tracking.
Or some other evil thing like that.
“An analysis of Singularity’s performance mentions a test run on Nvidia DGX-2 servers using a Xeon Platinum 8168 with two sockets of 20 cores each, eight V100 Model GPUs per server, 692GB of RAM, and networked over InfiniBand.
With hundreds of thousands of GPUs in the Singularity fleet, plus FPGAs and possibly other accelerators“
Yeah whatever.
I have one of these as well in my basement .
It’s pretty cool to use to play animal noises.
So I’ll end up unemployed, living in the woods, eating berries and rodents?…
No, it is just stupid.
I looked at the people involved, surprisingly I only know a few.
20 years from now it could be annoying
... and I thought it was Chinese crypto miners buying my next gaming GPU.
OOOOH. Reminds me of The Condor Cluster consisting of 1,760 Sony PlayStation 3’s. Fastest supercomputer in the world.
Nope, the Blue Screen of Death..
Don’t despair, you can always shop at notted’s government cheese store DOWN by the river!
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.