What’s wrong with shipping a local llm? This is quite nice IMO is there a privacy concern with running it locally? I already have a few games I wrote web based using this and it’s quiet nice to not need a server to run my game in pure HTML from my file system