logoalt Hacker News

kopirgantoday at 4:02 AM7 repliesview on HN

Can a model be stripped off anything not relevant to coding and get a lot lighter? Or is that impossible?

Just like we have professors with specialisation wondering if AI models can also be so.


Replies

htrptoday at 4:15 AM

You can... but the trick is to do so without killing performance. Turns out a lot of random things help make coding performance good.

applicativetoday at 5:19 AM

Does this desideratum make any sense? The whole point is that you write to it in English or Urdu, and it writes the specified code. If you cut off everything but the code writing, you cut off everything.

show 2 replies
vlyantoday at 4:56 AM

no, apparently, otherwise we'd already have specialized models. every bit of meaningful human-generated data appears to improve the overall capability of the model.

show 1 reply
konarttoday at 7:04 AM

Kind of yes, but this be get you are pretty stupid autocomplete yuo can probably avhieve without an LLM at all.

>we have professors with specialisation

Yes, but any professor with a specialisation is an erudite with vast knowledge across the board.

I'd argue we can have a meaningful BIG model with a specialisation but not vice versa.

PS: all of this is about a model that is expected to be able to execute development tasks on a human level. Obviously we can have small models that are very capable in things like TTS or STT.

ReptileMantoday at 4:23 AM

I guess it can but it will be useless. After all the model superpower is awareness and ability to guess and infer some stuff. Right now a model saves you time not only by coding faster, but that it can figure out some stuff about the shape of the data and its purpose.

If you throw general purpose model at a codebase - it will look at the table and data logical connections beyond what is explicitly declared. It will figure out on its own that Salaries should be displayed on SalariesTable.php and it will "know" that your prices should include vat and so on.

A human knows that VAT and price go together and are related, full size LLM does too, stripped one - doesn't.

jbellistoday at 5:50 AM

Yes, look up REAP.

show 1 reply
sp1982today at 4:41 AM

[dead]