My back of the napkin math says you need launch prices of about $100/kg to $200/kg for it to make sense.

The cooling problem is vastly exaggerated, you need around 0.5x the area of your solar panels in radiators.

I think AI inference in space is definitely possible, but it's very unlikely we'll get launch costs cheap enough that they make economical sense.