logoalt Hacker News

intothemildyesterday at 11:08 PM2 repliesview on HN

Well considering right now MTP support is being developed, there was a conversation in that that seemed to throw around the idea of separating the MTP model out of the main GGUF, like with Mmproj. This was rejected.

Which I'm happy for. So given that decision, I don't think it's unreasonable to think that they might be open to including Mmproj files in the GGUF.

Only issue I can think of is, which one? BF16, F16? Etc


Replies

Philpaxyesterday at 11:20 PM

Quantiser's choice, IMO. They're best-placed to decide what compromise to make for their particular model.