logoalt Hacker News

kristjanssontoday at 2:07 AM0 repliesview on HN

With MTP and FP4 I max out at 30ish t/s on mine. Without MTP or in regimes where the drafter performs poorly it’s about 10 t/s. FP8 is about half that