you would have to be especially incompetent to give a compromise opportunity to streamed tokens, the CVE he listed proves the point. whoever is responsible for that has no business coding anything.

    > offers easy access to the LLM’s weights

not really. the weights are encrypted in-memory. through the use of TEE's.