The problem with this comparison is that it only really serves to water down the very real harms of actual gambling.

Unlike sports gambling or casinos, the stock market actually does have some legitimate utility, as compared to being (at best) pure entertainment.