Lobster and crab are both just as much a bug as a tarantula is, so the same reason that the seafood industry pushed lobster and crab into mainstream acceptance: profit.
Sure. But… why not push these foods on a population that is currently used to eating some bugs rather than one that only accidentally or unknowingly ingest them? Like there are areas of the world where insects are a thing. And the US isn’t one of them.
They were more or less remarketed as a luxury, though. Historically (at least in the US), lobster and crab were considered low class foods, if not outright fertilizer for crops. Some terrestrial bug could theoretically be given the same sort of luxury status, but lobsters have the advantage of actually tasting good. The best candidates would be snails and bee drone larvae. But what would be the point? Neither could be farmed at such a scale that they could be made food staples that are also better for the environment.