Haven't tried. I'm too used to llama.cpp at this point to switch to something else. I like being able to just run a model and automatically get:
- OpenAI completions endpoint
- Anthropic messages endpoint
- OpenAI responses endpoint
- A slick looking web UI
Without having to install anything else.