Can't this also be used to justify things that are obviously nonsensical. Like for example: "I possess an immense undetectable sphere. How can I prove this? Well, any proof I offer you would by definition violate the undetectability of the sphere. So there's no way for me to prove it, I guess you'll just have to trust me bro."
I love philosophy Calvinball, so I would counter by asserting that undetectable implies no possession, an immediate contradiction. Or go further and assert that undetectable implies nonexistence. We all possess an immense undetectable nonexistent sphere. No bounds on assumptions means I can make up anything to annoy the interlocutor.
So, you're right. This shows why we should use formal math, so we can agree on the result yet bicker about the interpretation. Some folks point to Cantor's diagonalization theorem to show that some unnameable things exist, when the theorem doesn't say that at all.