logoalt Hacker News

embedding-shape • today at 1:44 PM • 0 replies • view on HN

> when it can't be found by scraping a web page?

This is the very purpose of those tokens! The reason they're like that, is because you won't encounter it in random content, so during training, you can put them where you want them to end up at prediction time.