Free Republic
Browse · Search
General/Chat
Topics · Post Article

To: Lazamataz

If intending to run AI locally, you need at least 32G memory (and that’s for the smallest model).


2 posted on 08/02/2024 6:20:13 AM PDT by The Duke (Not without incident)
[ Post Reply | Private Reply | To 1 | View Replies ]


To: The Duke

Ok, 32G it is.


4 posted on 08/02/2024 6:21:11 AM PDT by Lazamataz (If you are upset the bullet missed, contact me immediately. I'll make sure your bullet doesn't.)
[ Post Reply | Private Reply | To 2 | View Replies ]

To: The Duke; Lazamataz

If you want to run local AI models, get an NVidia GPU. You can run some of them using the cpu and DRAM but it will be very slow. The NVidia RTX50 series may be released this fall, maybe not. The more VRAM the better.


25 posted on 08/02/2024 6:34:59 AM PDT by fretzer
[ Post Reply | Private Reply | To 2 | View Replies ]

To: The Duke
If intending to run AI locally, you need at least 32G memory (and that’s for the smallest model).

And a beefy GPU (Video Card) with at least 8GB of memory. $$$$$

52 posted on 08/02/2024 7:10:20 AM PDT by usconservative (When The Ballot Box No Longer Counts, The Ammunition Box Does. (What's In Your Ammo Box?))
[ Post Reply | Private Reply | To 2 | View Replies ]

Free Republic
Browse · Search
General/Chat
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson