alt
Hacker News
kzrdude
•
yesterday at 7:02 PM
•
1 reply
•
view on HN
Raw model size is around 27x2 GB since it's in BF16 format
Replies
macwhisperer
•
yesterday at 9:21 PM
4-bit quant sits at 15.72GB
alt Hacker News
4-bit quant sits at 15.72GB