Pi.dev at home.
And I’m slowly writing my own. But it’s garbage at the moment.
Don’t write your own. Fork maki.sh and customize it like I did. It’s built in Rust and is absolutely amazing.
What kind of hardware do you need to run a useful LLM at home? To train one?
I wrote one and kept iterating by using it to fix bugs in itself
I still also use other harnesses, but mine is already at the point where I prefer it more often than not
You should totally keep working on yours. It’s a cool learning experience. And you might stumble on some good ideas that nobody else has had