I think it’s the same reason there’s no sport of throwing stones at targets but there is a sport of throwing darts at a board. Scoring is harder when the projectile bounces.
Horseshoes, curling, shuffleboard, etc use where the projectile ends up but that’s not a viable option with a slingshot.