It really depends on the "somehow". The most realistic downside scenario, it seems to me, is that most people don't care too much about super cheap intelligence for all because there ends up being another bottleneck for most of the things we value.

Like, trains are an incredible technology which transformed the world, but very few people go around counting their lucky stars that they live in a world that permits such wonders. It's a train, it gets things where they need to go, and by the way isn't it so annoying that sometimes it doesn't quite arrive when the schedule said it would?