logoalt Hacker News

risyachkayesterday at 4:12 PM1 replyview on HN

At this point it does not show anything as models are fine tuned on all kinds of benchmarks.


Replies

SoMomentaryyesterday at 5:26 PM

I thought the Gemini 3.5 Flash Lite response was quite telling myself. I personally like the Pelican SVG test, to me it is still a charming snapshot of model performance anecdata. No one would argue it's rigorous but I don't think it was ever intended to be.

I get people burning out on the pelican SVG test alongside the rest of the AI burnout, but I guess for myself I'm just choosing to keep enjoying it while I still can.