logoalt Hacker News

JulianPembroketoday at 6:52 PM1 replyview on HN

[flagged]


Replies

kennywinkertoday at 8:06 PM

Are you using 7/8b models for coding? I keep getting the impression from what i read that 8b is only good for autocomplete. Also, it seems like an 8b model will run on a $100 2nd hand gpu (e.g. an 8gb gtx 1050/1060/1070 kind of thing) - why would you need to quantize?