I do believe a lot of it boils down to tolerance. I for example feel basically 0 effects, and drink it just because I like the taste (of a good one with milk, or exceptionally some good espresso / ristretto after big dinner).

I recently traveled and didn't have coffee for more than a week. No change I could feel, no craving, nothing. But one of my ex-gf was quite sensitive on many things, had frequent headaches, low blood pressure and coffee was helping with those visibly. So YMMV.