You can compile two versions, it's not a big deal. "Fundamentally no way" means you're trying to solve math proofs instead of going for practical speedups.

But this case I think they do know the number type for sure, they're just failing to optimize around that fact.