I like to use llamafile for cases like this: https://github.com/mozilla-ai/llamafile