Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Upcoming Nvidia Blackwell GPU will consume 1kW of power
Data Centre Dynamics ^ | March 05, 2024 | Charlotte Trueman

Posted on 04/30/2024 12:59:26 PM PDT by SunkenCiv

Answering a question about what he was excited about in the coming year, Dell CEO Jeff Clarke said that after a year of what he called "the H100 show," the company was "excited about what happens at the B100 and the B200" with regards to performance improvement.

He then went on to tell analysts on the call that the B100s don't need direct liquid cooling to get to the energy density of 1kW per GPU, although he said that would happen "next year with the B200."

Nvidia's H100 GPUs have a thermal design point (TDP) of 700W and are manufactured on a custom version of TSMC's 4N process, with 80 billion transistors and 80GB of HBM3, enabling 3.5TBps of memory bandwidth.

It provides up to 30 teraflops of peak standard IEEE FP64 performance, 60 teraflops of peak FP64 tensor core performance, and 60 teraflops of peak FP32 performance.

Nvidia has not released any specification details relating to its Blackwell GPUs, with that information expected to be divulged at the company's GTC conference later this month. The Blackwell chips have an anticipated release date of the latter half of 2024, after the company's H200 GPUs have come to market.

(Excerpt) Read more at datacenterdynamics.com ...


TOPICS: Business/Economy; Computers/Internet
KEYWORDS: blackwell; computers; computing; dell; donatefreerepublic; internet; nvda; nvidia; technology; tsla; tsmc

1 posted on 04/30/2024 12:59:26 PM PDT by SunkenCiv
[ Post Reply | Private Reply | View Replies]

To: AdmSmith; AnonymousConservative; Arthur Wildfire! March; Berosus; Bockscar; BraveMan; cardinal4; ...
Chip ship slips, stock dips.

Actually it's up about $110 since the 19th, after a $200 fall from a 52 week (and probably all-time) high.

Welcome back, Maalox Roller Coaster!

2 posted on 04/30/2024 1:00:23 PM PDT by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | View Replies]

To: SunkenCiv

All destined for bitcoin mining and AI image production?


3 posted on 04/30/2024 1:01:18 PM PDT by Blueflag
[ Post Reply | Private Reply | To 1 | View Replies]

To: SunkenCiv

US electricity generation/demand was flat for 15+ years from mid 2000s

With AI computing power needed, its going to start growing again, and rather quickly too


4 posted on 04/30/2024 1:03:18 PM PDT by PGR88
[ Post Reply | Private Reply | To 1 | View Replies]

To: Blueflag

I heard that miners moved to ASICs to optimize search.


5 posted on 04/30/2024 1:03:40 PM PDT by who_would_fardels_bear (Kafka was an optimist.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: Blueflag
More like AI management of the WWW, and internal networks of large companies.

6 posted on 04/30/2024 1:04:07 PM PDT by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: PGR88
> With AI computing power needed, its [the demand for electricity] going to start growing again, and rather quickly too <

Somebody should inform this Tesla owner. He’s gonna have to budget more waiting time for charging.


7 posted on 04/30/2024 1:09:34 PM PDT by Leaning Right (The steal is real.)
[ Post Reply | Private Reply | To 4 | View Replies]

To: PGR88

Yet we’re about to end coal generation in about a decade by administrative edict. This will not end well.


8 posted on 04/30/2024 1:15:31 PM PDT by FreedomPoster (Islam delenda est)
[ Post Reply | Private Reply | To 4 | View Replies]

To: PGR88
With AI computing power needed, its going to start growing again, and rather quickly too

I agree. Then demand will drop back down quickly after the AI fad is over.

Don't get me wrong. AI has value and is applicable for many scenarios. I just believe from an investing perspective there's a lot of hype priced into AI stocks that's beyond AI's intrinsic value. So if anyone decides to invest in AI, I suggest being ready to get back out quickly when the hype starts fading and stock price for companies like Nvidia go back to being based on actual earnings.

9 posted on 04/30/2024 1:19:26 PM PDT by Tell It Right (1st Thessalonians 5:21 -- Put everything to the test, hold fast to that which is true.)
[ Post Reply | Private Reply | To 4 | View Replies]

To: who_would_fardels_bear

“I heard that miners moved to ASICs to optimize search.”

ASICs do one thing and do it well. GPUs can do many things well.


In the early days of crypto, there was a short period when ASICs had pretty much buried GPUs. But as crypto is a grassroots movement, it didn’t take long for people to come up with new PoW algorithms that were difficult to create ASICs for. Even when ASICs did come out for them, they were either barely more efficient than GPUs (Ethereum), or most cryptos changed their software to make the ASICs useless (Cryptonight, Equihash). New ASIC-resistant algorithms and coins are coming out all the time. Put simply, if ASICs were going to completely kill GPUs, they already would have. The fact that they didn’t is proof that they won’t. It’s a cat and mouse game, and the cat will never catch all the mice. Sometimes it feels like a losing battle, but those mice aren’t just going to roll over. There only are a handful of companies profiting from ASIC mining. Whereas there are literally thousands of companies big and small profiting from or completely dependent on GPU mining. And it runs the gamut from gigantic publicly-owned multinational corporations like Nvidia and AMD: raking in millions of dollars on GPU sales, down to the everyday gamer with a few GPUs. The huge number of stakeholders in GPU mining will not just throw up their hands and cede the entire cryptocurrency mining market to Bitmain without a fight.

https://bitproit.com/asic-vs-gpu-mining/


10 posted on 04/30/2024 1:20:25 PM PDT by TexasGator
[ Post Reply | Private Reply | To 5 | View Replies]

To: PGR88

Yeah, the big tech CEOs are concerned that there won’t be enough power generation, which should be a break for us, once they take a big dump on the AGW hoax because they just gotta have it.


11 posted on 04/30/2024 1:49:14 PM PDT by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | To 4 | View Replies]

To: SunkenCiv
Yeah, the big tech CEOs are concerned that there won’t be enough power generation, which should be a break for us, once they take a big dump on the AGW hoax

As a corollary to that - Fed.gov in all its central-planning psychopathy, will not do anything about massive AI electricity demand, but will continue their asinine meddling with energy consumption on your toaster, washing-machine, and 60W reading-lamp light bulbs

12 posted on 04/30/2024 1:54:13 PM PDT by PGR88
[ Post Reply | Private Reply | To 11 | View Replies]

To: SunkenCiv

Get your bitcoin for nothin and your chips for free.


13 posted on 04/30/2024 2:21:54 PM PDT by bigbob
[ Post Reply | Private Reply | To 1 | View Replies]

To: PGR88

They’ll double down on crushing regular people. The AI must take precedence so they can use it to tell you what to view, read, hear, believe, and think.


14 posted on 04/30/2024 3:57:28 PM PDT by No.6
[ Post Reply | Private Reply | To 12 | View Replies]

To: Leaning Right

Plug in a Tesla.

Tear down a dam.

What could possibly go wrong?


15 posted on 04/30/2024 7:02:11 PM PDT by Uncle Miltie (DEI = Didn't Earn It!)
[ Post Reply | Private Reply | To 7 | View Replies]

To: Leaning Right

Tesla owners using public charging stations vs Bitcoin miners.

-— Who deserves priority for electricity?


16 posted on 04/30/2024 7:12:46 PM PDT by dennisw (Why is the rabbit unafraid? Because he's smarter than the panther.)
[ Post Reply | Private Reply | To 7 | View Replies]

To: bigbob

I laughed, but the truth is, I’ve always loathed that song.


17 posted on 04/30/2024 7:40:08 PM PDT by SunkenCiv (Putin should skip ahead to where he kills himself in the bunker.)
[ Post Reply | Private Reply | To 13 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson