Traditional programming requires the absolute precision provided by digital circuits; a single bit flip can lead to a completely different outcome.
Large models do not require that kind of exactness. They are somewhat like a "field" or a "probability cloud": as long as the main directional tendency is correct, a few individual deviations—or even a whole cluster of them—make almost no difference.
alt Hacker News
Traditional programming requires the absolute precision provided by digital circuits; a single bit flip can lead to a completely different outcome.
Large models do not require that kind of exactness. They are somewhat like a "field" or a "probability cloud": as long as the main directional tendency is correct, a few individual deviations—or even a whole cluster of them—make almost no difference.