I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt
Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.
Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.