It would be great to have upstream llama.cpp support for this!
Agreed. They always sound exciting to try out but are such a pain to get working.
alt Hacker News
Agreed. They always sound exciting to try out but are such a pain to get working.