logoalt Hacker News

wat10000yesterday at 7:35 PM0 repliesview on HN

"飞机" and "airplane" aren't fundamentally different in terms of how they're represented to a computer. Especially for an LLM, where tokenization likely turns each of those into a single token.