logoalt Hacker News

mips_avatar • last Saturday at 7:41 PM • 4 replies • view on HN

even 8x rtx pro 6000 is only 768GB of VRAM. IDK how anyone is going to run k3

Replies

dannyw • last Sunday at 10:12 AM

Usually offloading experts to system RAM. DDR4 has gone up a lot, but on a 8-channel used Xeon motherboard or whatever, you can get tolerable mem bandwidth out of it.

montroser • last Saturday at 8:08 PM

This is why God gave us 1.58-bit ternary quants?

➕ show 1 reply
bawana • last Sunday at 12:18 PM

on the 1.5 tB macStudio that is going to be released next quarter

➕ show 1 reply
InsideOutSanta • last Saturday at 8:14 PM

Free server racks for everyone when the bubble bursts!

➕ show 2 replies