logoalt Hacker News

stri8tedtoday at 7:32 PM2 repliesview on HN

You seem to assume training on pelican would not result in improved performance on other similar tasks. Why?


Replies

HarHarVeryFunnytoday at 8:37 PM

Either you've memorized the outline (or detailed component shapes) of, say, a horse, or you haven't. Memorizing the outline of a pelican isn't going to help you with the horse.

You could train a model to do something a bit different like a pencil sketch, or vector graphic sketch, of something given a photo of it, and expect that to be a generalized skill, but if you are asking the model to do it "from memory" then memorizing a pelican is no substitute for not having memorized a horse.

altcognitotoday at 7:36 PM

He didn't. That's why the article exists. You have to do the science to see if it does.

He was asking the question - do we see gains across other tasks? The underlying question was: Is the additional attention given to this specific task creating a false impression of progress?