alt Hacker NewsBro, I had to read this sentence in the context of the previous one, 3 fcking times.. and it sill does not make any sense to me.
Bro, I had to read this sentence in the context of the previous one, 3 fcking times.. and it sill does not make any sense to me.
Sounds like they are saying they tested with a long prompt and just tested for a failure, but the test likely would have seen that same KV cache leakage and just interpreted it as success.