LLMs have consistently and dramatically gotten better at everything over the last 5 years.
Not at constant processing power, memory, training, etc.
But that’s beside the point, being arbitrarily bad at everything isn’t a problem. The diminishing returns as you apply the ceiling is problematic for self improving AI.
Yeah and a five-year old gets bigger every year so they'll surely grow up to be 100m tall.
Not at constant processing power, memory, training, etc.
But that’s beside the point, being arbitrarily bad at everything isn’t a problem. The diminishing returns as you apply the ceiling is problematic for self improving AI.