logoalt Hacker News

formvoltron • yesterday at 8:41 PM • 0 replies • view on HN

Also gpu speedup. If vera Rubin is 7x faster then to serve same number of tokens you need 1/7 the memory. Did I get that right?