logoalt Hacker News

himata4113last Tuesday at 10:05 PM2 repliesview on HN

The measured entropy of the model remains nearly unchanged though which means we have lost capabilities we have not measured, the model hasn't become "denser" it just became more specialized.

It's like comparing two person A and B of similar intelligence where A is smarter and B is a genius at signing, but signing was not on the test so person A won.


Replies

Philpaxlast Tuesday at 10:23 PM

Assumes facts not in evidence. Please show your working.

show 1 reply
neuroticnews25yesterday at 7:17 AM

> The measured entropy of the model remains nearly unchanged though which means we have lost capabilities

Or we've lost random noise, or redundancy not captured by the entropy measurement.