> It kind of confirms a hypothesis I have that the next phase of AI development will be about getting smaller

isn't that, in the end, the case with all/most technologies?

i can get a petaflop of compute capacity in a dgx spark for relatively cheap nowadays. that used to be a whole supercomputer like 20 years ago.