logoalt Hacker News

yujongleeyesterday at 10:58 PM2 repliesview on HN

also if you had resource issues with your production deployment, keen to hear more details


Replies

testycoolyesterday at 11:45 PM

I don't have specifics since it's been months, but LiteLLM on a hetzner server, deployed through Coolify was using 1-4 GB (cannot exactly, and dont know why either).

Bifrost feels very light, though.

Will try LiteLLM if it's in Rust.

Would also appreciate a slicker aesthetic. I got used to Bifrost shadcn with 0 border radius.

show 1 reply