You may need to have certain directories be excluded depending on the programs you use. For example, the default Chrome profile location is within ~/.config, which includes cache data that can be multiple gigabytes in size.
That's what .gitignore is for ;)
Ouch. It doesn't respect `$XDG_CACHE_HOME`?