logoalt Hacker News

kgeistyesterday at 10:20 PM0 repliesview on HN

Yeah, I turned it off completely after it once started generating random garbage in long conversations with memory enabled. Like, it would give completely unrelated replies: I'd ask about Go, and it would tell me about the weather in Paris (or something else we discussed once months ago). Maybe it was just a temporary bug, but it was an eye-opener that context poisoning exists.