It's a bit like:

"Doc, I feel pain in my toe."

"No, sorry, the math says you don't."

"Okay, but like... I do."

"Sorry, you're just not good at accepting math!"

Not a perfect analogy, of course, but people have competing intuitions of what to do when the map fails to match the territory. MWI abandons the latter, most prefer the former.