alt Hacker NewsIt should be noted that optimization of a convex bounded lipschitz function is exactly what most modern statistical learning (AI) models are based on.
Replies
theteapot • last Saturday at 9:15 PM
What do you mean by this? A neural network hypothesis space is not typically strictly convex or a lipschitz function.
➕ show 1 reply
Very confused by this comment. The older (poorer) parts of the ML literature focus on models with convex and (gradient-)Lipschitz objectives, but that's not representative of reality, not even close. Modern objectives for AI models are famously nonconvex (catastrophically, from the point of view of classical optimisation theory), and that's where the interesting research is.