Some Thing is Happening A note from the AI companies

> It’s true that so-called “hallucinations” are an artifact of LLM technology that can never be totally eradicated. But if you think about it, humans make a lot of mistakes as well. A calculator that gives you the correct answer 90% of the time is still an impressive technological achievement!

I know this article is meant to be dissing on LLMs, am I too caught up in the mania that this sounds to me unironically like a positive argument for LLMs?

> We’re already ripping the spines out of old rare paper books (we playfully call these “low-background steel”)

can someone closer to pretraining elaborate?