You already could by disabling watch history. I know that also disables the non-Shorts recommendations, but you know, if you're asking YT to recommend you stuff then of course it'll do it the way it wants.