Sure, at the start, yes.

But then came Java and Wap. You could, in theory, download a jar from a site and try to run it. God knows if it would run. But it wasn't a locked-down app store that bypassing would land you in hot water.