alt
Hacker News
DrammBA
•
yesterday at 4:02 AM
•
0 replies
•
view on HN
> I’m running the same model on a 48GB MBP with a q4 quant and it’s pretty decent.
Context size?