Free Republic
Browse · Search
General/Chat
Topics · Post Article

To: Lazamataz
The s1 paper suggests that reasoning models can be distilled using a relatively small dataset through supervised fine-tuning (SFT), a more cost-effective method compared to large-scale reinforcement learning, which DeepSeek used to train its own model, R1. SFT allows AI models to mimic specific behaviours in a dataset, achieving high reasoning performance with lower costs.

Dude, it's a very small dataset focused on ONE set of facts, designed for specific queries.

If the commie chinese taught us anything with DeepSeek its this:

LLM's aren't the way. Focused, well trained, smaller, distributed, FOCUSED AI engines are far faster, will scale out better, be more efficient, and deliver better, more consistent results.

The above statement comes with a large number of assumptions, the biggest being this: The smaller, more focused and trained AI becomes, the more dependent on UNBIASED information they are to be properly trained and provide reliable results.

This is where DeepSeek FAILED: heavily biased algorithms with government approved data to train them. (Knew THIS point specifically as soon as I started reading up on DeepSeek and how the Chinese did it.)

BTW, I've told you this before: It's relatively easy to run a small AI engine at home with a proper graphics card (I believe I recommended one to you when you were building your PC). The instructions on running a small Docker packaged AI engine are out there. I do it on my Ubuntu Linux server @ home.

16 posted on 02/11/2025 7:03:01 AM PST by usconservative (When The Ballot Box No Longer Counts, The Ammunition Box Does. (What's In Your Ammo Box?))
[ Post Reply | Private Reply | To 8 | View Replies ]


To: usconservative
It's relatively easy to run a small AI engine at home with a proper graphics card

What functions do graphics cards serve to aid algorithms in conjunction with AI?

Please excuse my question, am dumbfounded and dumbstruck in regards to knowledge of subject matter ….. AI

21 posted on 02/13/2025 1:06:43 AM PST by no-to-illegals (The enemy has US surrounded. May God have mercy on them.t)
[ Post Reply | Private Reply | To 16 | View Replies ]

Free Republic
Browse · Search
General/Chat
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson