logoalt Hacker News

ac29yesterday at 2:42 PM0 repliesview on HN

This 35B-A3B model is 4-5x cheaper than Haiku though, suggesting it would still be cheaper to outsource inference to the cloud vs running locally in your example