Who the heck deleted my comments, I didnt know that was a thing in Hacker news, OFC I will repost them:

-1 points by trilogic 9 hours ago | parent | context | next [–] | on: Ggml v1.0.0

> We like simplicity and aim to keep the codebase as small and as simple as possible Spawning the cli to server routing everything to http it complicates it instead of keeping it simple. This is pure telemetry or in plain english Spying on users. Rip LLama.cpp.

reply

gabucino 7 hours ago | parent | next [–]

They were already doing that by making the build process phone home to Huggingface and also download huge swathes of indecipherable JavaScript (3 of those have been backdoored a month ago and only version pinning saved downstream). reply

*

1 point by trilogic 4 hours ago | root | parent | next [–]

Yes there is much more I forgot to mention (you nailed some of it), but as I already said, everyone has a price. Although it remains a piece of engineering that empowered users certainly. Anyway we managed to eliminate all unpleasantries and have a clean CLI. I leave the server to whom may like it. Hit me up if you want to test it. reply

gabucino 4 hours ago [dead] | root | parent | next [–]

Thanks, I've also maintained my own "sanity" patchset for llama.cpp (and sent PRs), but eventually gave up in the deluge of bugs, ignored PRs (except one that I deliberately made unignoreable, but that simply got closed: https://github.com/ggml-org/llama.cpp/issues/24410) incompatible changes, and instead rolled my own engine, that's more futureproof: https://github.com/whoreson/picolm

gabucino 2 hours ago | unvote | parent | prev | next [–]

>Spawning the cli to server holy fucking shit I just checked and they really did this LOL (https://github.com/ggml-org/llama.cpp/pull/17824)

good thing i'm never touching that repo ever again, or only to steal implementations

reply