logoalt Hacker News

vikmals • today at 12:24 AM • 1 reply • view on HN

fastllm targets the GPU, while colibri uses CPU inference only

Replies

aliljet • today at 12:48 AM

I'd be curious about an.option that would allow glm use with a low end GPU like a 2080 ti...