logoalt Hacker News

mrkn1 • today at 9:34 AM • 0 replies • view on HN

subword tokenizers were never causal in the first place, so BPE was peeking at future bytes all along! TIL