Even if TurboQuant, which was released a year ago, drastically lower RAM requirements, AI labs will just release bigger models.
Jevons Paradox. When are we going to learn that efficiency gains in AI does not decrease hardware usage?
valid point, it reminds me of video games. GPUs got faster, devs pushed higher resolutions, more complex lighting instead of saving power :)
valid point, it reminds me of video games. GPUs got faster, devs pushed higher resolutions, more complex lighting instead of saving power :)