logoalt Hacker News

kybernetikosyesterday at 4:13 PM1 replyview on HN

I've run it with a large context window on 256GB ram + 4090. It wasn't super fast, but it was manageable and it completed the tasks I gave it well.


Replies

xiconfjsyesterday at 5:53 PM

How many tps and size of ctx?