Look up parasitic inductance.
Through hole parts cap out at maybe low MHz. Many electrolytic caps frankly cannot effectively decouple signals above 100s of kHz even. Above that value, capacitors become inductors due to lead lengths, parasitic resistance, and other details.
To make capacitors work faster, we make them smaller and smaller. Surface Mount Caps are the only way to reach 20MHz++ decoupling speeds, and you need crazier tricks if you need additional decoupling beyond that frequency.
Yes, but we are splitting hairs at that point. The transient spike is a high impedance voltage that is tripping the high impedance internal protection circuitry of the magnetometer. So whether we have 20mOhms of capacitive decoupling or 500mOhms of inductive decoupling, both are better than the infinite impedance of nothing there.
We're not building a precision filter, were cutting the paws off of a paper tiger. No need to let perfect be the enemy of good.