logoalt Hacker News

grey-areayesterday at 10:31 AM1 replyview on HN

This particular situation is not in the training data, though I’m sure it will be soon to try to shore up claims of ‘reasoning’.


Replies

jason_ostertoday at 1:50 AM

The goal of training data is not to collect and reproduce facts. It is to align the model with the statistical probability of producing the correct (expected) response for data outside of its knowledge domain. This is called generalization [1], and it has been explored in depth.

[1]: https://arxiv.org/abs/2312.17173