yes, I have, I use both. 27B slower in tok/s due to density, obviously, 35B-A3B for speed on simpler tasks.
You should enable MTP now that its available.
LLamaCPP has had some massive updates in the last week or so.
alt Hacker News
You should enable MTP now that its available.
LLamaCPP has had some massive updates in the last week or so.