I find that 35B-A3B is much easier to run on my M4 Max (both prefill and generation)
It's well known 35b is much faster (on any hardware) and quite a bit dumber
alt Hacker News
It's well known 35b is much faster (on any hardware) and quite a bit dumber