Free Republic
Browse · Search
Smoky Backroom
Topics · Post Article

Skip to comments.

Microsoft details 'planet-scale' AI infrastructure packing 100,000-plus GPUs
the register ^

Posted on 02/22/2022 5:55:34 PM PST by algore

Microsoft has revealed it operates a planet-scale distributed scheduling service for AI workloads that it has modestly dubbed "Singularity".

Described in a pre-press paper [PDF] co-authored by 26 Microsoft employees, Singularity's aim is described as helping the software giant control costs by driving high utilization for deep learning workloads.

Singularity achieves that goal with what the paper describes as a "novel workload-aware scheduler that can transparently preempt and elastically scale deep learning workloads to drive high utilization without impacting their correctness or performance, across a global fleet of AI accelerators (e.g., GPUs, FPGAs)."

The paper spends more time on the scheduler than on Singularity itself, but does offer some figures to depict the system's architecture.

An analysis of Singularity's performance mentions a test run on Nvidia DGX-2 servers using a Xeon Platinum 8168 with two sockets of 20 cores each, eight V100 Model GPUs per server, 692GB of RAM, and networked over InfiniBand.

With hundreds of thousands of GPUs in the Singularity fleet, plus FPGAs and possibly other accelerators

(Excerpt) Read more at theregister.com ...


TOPICS: Heated Discussion
KEYWORDS:
Navigation: use the links below to view more comments.
first previous 1-2021-4041-44 next last
To: notted
Well maybe I'll live in a van down by the river!


21 posted on 02/22/2022 6:31:33 PM PST by EEGator
[ Post Reply | Private Reply | To 20 | View Replies]

To: EEGator

Good luck, it’s gonna be crowded.


22 posted on 02/22/2022 6:34:55 PM PST by notted
[ Post Reply | Private Reply | To 21 | View Replies]

To: notted

I will make origami and barter for food...


23 posted on 02/22/2022 6:38:35 PM PST by EEGator
[ Post Reply | Private Reply | To 22 | View Replies]

To: EEGator
"...So I’ll end up unemployed, living in the woods, eating berries and rodents?…"

Hey, look on the bright side - it could be worse.

/s

24 posted on 02/22/2022 6:44:17 PM PST by GaltAdonis
[ Post Reply | Private Reply | To 15 | View Replies]

To: algore

20 years from now that will be running in iPhone 27.


25 posted on 02/22/2022 6:44:34 PM PST by ProtectOurFreedom (If truckers quit their jobs, society would collapse. If politicians quit their jobs...HALLELUJAH!)
[ Post Reply | Private Reply | To 16 | View Replies]

To: EEGator

Is it the image of the beast?


26 posted on 02/22/2022 6:46:04 PM PST by D Rider ( )
[ Post Reply | Private Reply | To 2 | View Replies]

To: GaltAdonis

https://m.youtube.com/watch?v=jQE66WA2s-A

20 years ago.


27 posted on 02/22/2022 6:58:15 PM PST by algore
[ Post Reply | Private Reply | To 24 | View Replies]

To: algore

I hate Bill Gates.


28 posted on 02/22/2022 7:28:36 PM PST by sauropod (Whom the gods would destroy they first make mad. Life is risk, your highness.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: wbarmy

I would have gone for 1761 PS3 in the background just to piss them off.


29 posted on 02/22/2022 7:50:08 PM PST by wgmalabama (We will find out if the Vac or virus risk was the correct choice - can we put truth above narrative )
[ Post Reply | Private Reply | To 18 | View Replies]

To: wgmalabama
I would have gone for 1761 PS3 in the background just to piss them off.

A man with a plan.
30 posted on 02/22/2022 8:12:32 PM PST by wbarmy (I chose to be a sheepdog once I saw what happens to the sheep.)
[ Post Reply | Private Reply | To 29 | View Replies]

To: ShadowAce
Singularity (2017)
(IMDB)








"Earth 2020, 3/4 of it's households have a robot.
The AI supercomputer, Kronos, considers humans the biggest threat to Earth.
A century later, few humans are left.
Calia seeks the last human stronghold as does Kronos.
"

31 posted on 02/22/2022 8:41:36 PM PST by Bikkuri (I am proud to be a PureBlood.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: algore

Ain’t Digital technology GREAT!

Like a door that was locked I opened.

Oh now I’ve paid that price ten fold over.

Knowledge- was it worth such torment

Oh to see the far side of shadow.


32 posted on 02/22/2022 10:16:59 PM PST by Revel
[ Post Reply | Private Reply | To 1 | View Replies]

To: algore

I’ll ask to be a beta tester and pop some bitcoins out ...


33 posted on 02/22/2022 11:41:45 PM PST by BiglyCommentary
[ Post Reply | Private Reply | To 1 | View Replies]

To: EEGator

The Beast ...

I am convinced more everyday, the internet is the Beast.

A Beast is never described as a person. It is typically thought to describe a nation. Something with borders and a bit ambiguous at times. But, THE Beast, well it is something to behold and yet all knowing etc.

The more I learn of what they are creating behind the scenes, algorithms, facial recognition, vaccine passports, and the incredible AI. This that we use everyday to do millions of things and transactions, is The Beast.


34 posted on 02/23/2022 2:32:31 AM PST by EBH (Hold My Beer. 1776-2021 May God Save Us.)
[ Post Reply | Private Reply | To 11 | View Replies]

To: algore

35 posted on 02/23/2022 2:59:04 AM PST by Bratch
[ Post Reply | Private Reply | To 1 | View Replies]

To: algore
"...20 years ago..."

I remember it well.
Despite the traumatic head injury.

36 posted on 02/23/2022 3:26:39 AM PST by GaltAdonis
[ Post Reply | Private Reply | To 27 | View Replies]

To: sauropod
"...I hate Bill Gates...."

Why?
His products have always been so reliable and of good quality...

/s


37 posted on 02/23/2022 5:36:09 AM PST by GaltAdonis
[ Post Reply | Private Reply | To 28 | View Replies]

To: EBH

I won’t argue with you about that.

It’s not considered wise to bring up here, but I agree with the first 2/3 of Ted Kaczynski’s book. (Not the bombing people part) The internet pushes filth upon society. Tons of porn, social media, and assorted trash talk of the worst kind.
The internet has almost all the pertinent information on everything one could ever want to know, but what is it really used for? The majority of people can’t handle the freedom and information in a decent way. Most seem removed from God, nature, and decency/morals. Greatest technology ever, most obese ever, and probably least moral ever in modern society.


38 posted on 02/23/2022 6:26:31 AM PST by EEGator
[ Post Reply | Private Reply | To 34 | View Replies]

To: GaltAdonis

Bill Gates is no longer at Microsoft. Been gone for quite a long time now.


39 posted on 02/23/2022 6:50:21 AM PST by for-q-clinton (Cancel Culture IS fascism...Let's start calling it that!)
[ Post Reply | Private Reply | To 37 | View Replies]

To: for-q-clinton
We are still living with the cosquencess of his actions and
philosophies in software technologies as well as - now -
vaccine protocols - for good or ill.
40 posted on 02/23/2022 7:04:33 AM PST by GaltAdonis
[ Post Reply | Private Reply | To 39 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-44 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
Smoky Backroom
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson