I think the point is that you stop caring about the fiat part of it at all. Government ownership of fiat currency is not a natural feature of the universe, it's just something we did for a little while.